2024-09-13T16:53:56.095 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T16:53:56.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T16:53:56.209 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903865 branch: wip-rishabh-testing-20240910.100730-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/quota} email: null first_in_suite: false job_id: '7903865' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_quota teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T16:53:56.209 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T16:53:56.210 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T16:53:56.210 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T16:53:56.212 INFO:teuthology.task.internal:Checking packages... 2024-09-13T16:53:56.232 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T16:53:56.232 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T16:53:56.233 INFO:teuthology.packaging:ref: None 2024-09-13T16:53:56.233 INFO:teuthology.packaging:tag: None 2024-09-13T16:53:56.233 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T16:53:56.233 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T16:53:56.233 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T16:53:56.383 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860-g6c6b083f-1focal 2024-09-13T16:53:56.385 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T16:53:56.392 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T16:53:56.392 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T16:53:56.420 INFO:teuthology.task.internal:Saving configuration 2024-09-13T16:53:56.437 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T16:53:56.463 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T16:53:56.497 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903865', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 16:47:52.057552', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T16:53:56.529 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903865', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 16:47:52.055915', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T16:53:56.529 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T16:53:56.586 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-13T16:53:56.586 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-13T16:53:56.586 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T16:53:56.737 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6498613be0>, signals=[15]) 2024-09-13T16:53:56.738 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T16:53:57.031 INFO:teuthology.task.internal:Opening connections... 2024-09-13T16:53:57.031 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T16:53:57.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:53:57.144 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T16:53:57.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:53:57.249 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T16:53:57.368 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-09-13T16:53:57.375 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-09-13T16:53:57.376 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-09-13T16:53:57.422 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2024-09-13T16:53:57.422 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T16:53:57.422 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2024-09-13T16:53:57.422 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2024-09-13T16:53:57.422 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T16:53:57.422 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="20.04" 2024-09-13T16:53:57.423 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T16:53:57.423 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T16:53:57.423 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T16:53:57.423 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T16:53:57.423 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=focal 2024-09-13T16:53:57.423 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=focal 2024-09-13T16:53:57.423 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-09-13T16:53:57.448 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-09-13T16:53:57.455 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-09-13T16:53:57.456 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-09-13T16:53:57.504 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2024-09-13T16:53:57.504 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T16:53:57.504 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2024-09-13T16:53:57.505 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2024-09-13T16:53:57.505 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T16:53:57.505 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="20.04" 2024-09-13T16:53:57.505 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T16:53:57.505 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T16:53:57.506 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T16:53:57.506 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T16:53:57.506 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=focal 2024-09-13T16:53:57.506 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=focal 2024-09-13T16:53:57.507 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-09-13T16:53:57.540 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T16:53:57.550 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T16:53:57.578 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T16:53:57.578 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-09-13T16:53:57.580 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-09-13T16:53:57.586 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T16:53:57.603 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T16:53:57.603 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-09-13T16:53:57.605 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-09-13T16:53:57.622 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T16:53:57.703 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T16:53:57.716 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T16:53:57.717 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T16:53:57.717 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T16:53:57.717 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T16:53:57.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:53:57.723 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-09-13T16:53:57.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:53:57.724 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-13T16:53:57.730 INFO:teuthology.orchestra.run.smithi123.stdout:5.4.0-124-generic 2024-09-13T16:53:57.730 INFO:teuthology.task.kernel:Running kernel on smithi123: 5.4.0-124-generic 2024-09-13T16:53:57.730 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get clean 2024-09-13T16:53:57.731 INFO:teuthology.orchestra.run.smithi153.stdout:5.4.0-124-generic 2024-09-13T16:53:57.731 INFO:teuthology.task.kernel:Running kernel on smithi153: 5.4.0-124-generic 2024-09-13T16:53:57.731 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2024-09-13T16:53:57.836 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get update 2024-09-13T16:53:57.837 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-13T16:53:57.997 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T16:53:58.011 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-13T16:53:58.071 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-13T16:53:58.107 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-13T16:53:58.121 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T16:53:58.121 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-13T16:53:58.176 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-13T16:53:58.382 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,563 kB] 2024-09-13T16:53:58.509 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-13T16:53:58.519 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-13T16:53:58.525 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-13T16:53:58.525 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-13T16:53:58.526 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,236 kB] 2024-09-13T16:53:58.528 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-13T16:53:58.547 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [453 kB] 2024-09-13T16:53:58.551 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T16:53:58.551 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-13T16:53:58.556 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,230 kB] 2024-09-13T16:53:58.564 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-13T16:53:58.566 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-13T16:53:58.567 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-13T16:53:58.567 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-13T16:53:58.567 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-13T16:53:58.572 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-13T16:53:58.572 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-13T16:53:58.572 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-13T16:53:58.595 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-13T16:53:58.596 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-13T16:53:58.596 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-13T16:53:58.597 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-13T16:53:58.606 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-13T16:53:58.700 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-13T16:53:58.745 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,563 kB] 2024-09-13T16:53:59.037 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-13T16:53:59.129 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-13T16:53:59.142 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-13T16:53:59.151 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-13T16:53:59.151 INFO:teuthology.orchestra.run.smithi123.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-13T16:53:59.212 INFO:teuthology.orchestra.run.smithi123.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-13T16:53:59.229 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-13T16:53:59.229 INFO:teuthology.orchestra.run.smithi123.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-13T16:53:59.237 INFO:teuthology.orchestra.run.smithi123.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-13T16:53:59.238 INFO:teuthology.orchestra.run.smithi123.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,236 kB] 2024-09-13T16:53:59.240 INFO:teuthology.orchestra.run.smithi123.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-13T16:53:59.241 INFO:teuthology.orchestra.run.smithi123.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-13T16:53:59.243 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-13T16:53:59.243 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-13T16:53:59.248 INFO:teuthology.orchestra.run.smithi123.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T16:53:59.249 INFO:teuthology.orchestra.run.smithi123.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-13T16:53:59.299 INFO:teuthology.orchestra.run.smithi123.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-13T16:53:59.311 INFO:teuthology.orchestra.run.smithi123.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-13T16:53:59.314 INFO:teuthology.orchestra.run.smithi123.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-13T16:53:59.314 INFO:teuthology.orchestra.run.smithi123.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-13T16:53:59.315 INFO:teuthology.orchestra.run.smithi123.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-13T16:53:59.328 INFO:teuthology.orchestra.run.smithi123.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-13T16:53:59.329 INFO:teuthology.orchestra.run.smithi123.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [453 kB] 2024-09-13T16:53:59.336 INFO:teuthology.orchestra.run.smithi123.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T16:53:59.336 INFO:teuthology.orchestra.run.smithi123.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-13T16:53:59.350 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-13T16:53:59.363 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-13T16:53:59.371 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T16:53:59.377 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-13T16:53:59.386 INFO:teuthology.orchestra.run.smithi123.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,230 kB] 2024-09-13T16:53:59.387 INFO:teuthology.orchestra.run.smithi123.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-13T16:53:59.388 INFO:teuthology.orchestra.run.smithi123.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-13T16:53:59.394 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-13T16:53:59.399 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-13T16:53:59.404 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-13T16:53:59.405 INFO:teuthology.orchestra.run.smithi123.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-13T16:53:59.410 INFO:teuthology.orchestra.run.smithi123.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-13T16:53:59.410 INFO:teuthology.orchestra.run.smithi123.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-13T16:53:59.410 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-13T16:53:59.411 INFO:teuthology.orchestra.run.smithi123.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-13T16:53:59.413 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-13T16:53:59.473 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-13T16:53:59.474 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-13T16:53:59.475 INFO:teuthology.orchestra.run.smithi123.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-13T16:53:59.475 INFO:teuthology.orchestra.run.smithi123.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-13T16:53:59.475 INFO:teuthology.orchestra.run.smithi123.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-13T16:53:59.475 INFO:teuthology.orchestra.run.smithi123.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-13T16:53:59.476 INFO:teuthology.orchestra.run.smithi123.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-13T16:53:59.555 INFO:teuthology.orchestra.run.smithi123.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-13T16:53:59.556 INFO:teuthology.orchestra.run.smithi123.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-13T16:53:59.556 INFO:teuthology.orchestra.run.smithi123.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-13T16:54:02.962 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 21.8 MB in 3s (7,220 kB/s) 2024-09-13T16:54:03.435 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 21.8 MB in 4s (6,119 kB/s) 2024-09-13T16:54:04.431 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-13T16:54:04.456 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T16:54:04.540 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-13T16:54:04.761 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-13T16:54:04.761 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-13T16:54:04.910 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-09-13T16:54:04.936 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T16:54:04.963 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-13T16:54:04.963 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T16:54:04.963 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-generic linux-image-5.4.0-195-generic 2024-09-13T16:54:04.964 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-5.4.0-195-generic linux-modules-extra-5.4.0-195-generic 2024-09-13T16:54:04.965 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-13T16:54:04.965 INFO:teuthology.orchestra.run.smithi153.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-13T16:54:04.965 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-09-13T16:54:04.965 INFO:teuthology.orchestra.run.smithi153.stdout: thermald 2024-09-13T16:54:05.006 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-09-13T16:54:05.025 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-13T16:54:05.025 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T16:54:05.025 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-195-generic linux-modules-5.4.0-195-generic 2024-09-13T16:54:05.026 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-extra-5.4.0-195-generic 2024-09-13T16:54:05.027 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-09-13T16:54:05.028 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T16:54:05.211 INFO:teuthology.orchestra.run.smithi153.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T16:54:05.211 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 77.2 MB of archives. 2024-09-13T16:54:05.211 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-13T16:54:05.211 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-195-generic amd64 5.4.0-195.215 [15.0 MB] 2024-09-13T16:54:05.231 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2024-09-13T16:54:05.232 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2024-09-13T16:54:05.439 INFO:teuthology.orchestra.run.smithi123.stdout:The following additional packages will be installed: 2024-09-13T16:54:05.439 INFO:teuthology.orchestra.run.smithi123.stdout: linux-generic linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T16:54:05.439 INFO:teuthology.orchestra.run.smithi123.stdout: linux-headers-generic linux-image-5.4.0-195-generic 2024-09-13T16:54:05.439 INFO:teuthology.orchestra.run.smithi123.stdout: linux-modules-5.4.0-195-generic linux-modules-extra-5.4.0-195-generic 2024-09-13T16:54:05.440 INFO:teuthology.orchestra.run.smithi123.stdout:Suggested packages: 2024-09-13T16:54:05.440 INFO:teuthology.orchestra.run.smithi123.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-13T16:54:05.441 INFO:teuthology.orchestra.run.smithi123.stdout:Recommended packages: 2024-09-13T16:54:05.441 INFO:teuthology.orchestra.run.smithi123.stdout: thermald 2024-09-13T16:54:05.501 INFO:teuthology.orchestra.run.smithi123.stdout:The following NEW packages will be installed: 2024-09-13T16:54:05.501 INFO:teuthology.orchestra.run.smithi123.stdout: linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T16:54:05.501 INFO:teuthology.orchestra.run.smithi123.stdout: linux-image-5.4.0-195-generic linux-modules-5.4.0-195-generic 2024-09-13T16:54:05.501 INFO:teuthology.orchestra.run.smithi123.stdout: linux-modules-extra-5.4.0-195-generic 2024-09-13T16:54:05.502 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages will be upgraded: 2024-09-13T16:54:05.503 INFO:teuthology.orchestra.run.smithi123.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T16:54:05.687 INFO:teuthology.orchestra.run.smithi123.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T16:54:05.687 INFO:teuthology.orchestra.run.smithi123.stdout:Need to get 77.2 MB of archives. 2024-09-13T16:54:05.687 INFO:teuthology.orchestra.run.smithi123.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-13T16:54:05.687 INFO:teuthology.orchestra.run.smithi123.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-195-generic amd64 5.4.0-195.215 [15.0 MB] 2024-09-13T16:54:06.346 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-195-generic amd64 5.4.0-195.215 [10.5 MB] 2024-09-13T16:54:06.618 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-195-generic amd64 5.4.0-195.215 [39.2 MB] 2024-09-13T16:54:06.942 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-195-generic amd64 5.4.0-195.215 [10.5 MB] 2024-09-13T16:54:07.214 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-195-generic amd64 5.4.0-195.215 [39.2 MB] 2024-09-13T16:54:07.915 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.195.193 [1,900 B] 2024-09-13T16:54:07.916 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.195.193 [2,584 B] 2024-09-13T16:54:07.916 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195 all 5.4.0-195.215 [11.0 MB] 2024-09-13T16:54:08.199 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195-generic amd64 5.4.0-195.215 [1,386 kB] 2024-09-13T16:54:08.247 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.195.193 [2,460 B] 2024-09-13T16:54:08.579 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.195.193 [1,900 B] 2024-09-13T16:54:08.579 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.195.193 [2,584 B] 2024-09-13T16:54:08.580 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195 all 5.4.0-195.215 [11.0 MB] 2024-09-13T16:54:08.859 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195-generic amd64 5.4.0-195.215 [1,386 kB] 2024-09-13T16:54:08.915 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.195.193 [2,460 B] 2024-09-13T16:54:08.935 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 77.2 MB in 3s (24.0 MB/s) 2024-09-13T16:54:09.145 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-5.4.0-195-generic. 2024-09-13T16:54:09.616 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 77.2 MB in 3s (22.7 MB/s) 2024-09-13T16:54:09.782 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-modules-5.4.0-195-generic. 2024-09-13T16:54:10.881 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-13T16:54:10.886 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../0-linux-modules-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T16:54:10.983 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:11.497 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-13T16:54:11.502 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../0-linux-modules-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T16:54:11.579 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:12.808 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-image-5.4.0-195-generic. 2024-09-13T16:54:12.825 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../1-linux-image-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T16:54:12.920 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:13.455 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-image-5.4.0-195-generic. 2024-09-13T16:54:13.468 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../1-linux-image-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T16:54:13.566 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-195-generic. 2024-09-13T16:54:13.983 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T16:54:14.011 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:14.640 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-195-generic. 2024-09-13T16:54:14.653 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T16:54:14.690 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:18.733 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../3-linux-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T16:54:18.875 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T16:54:19.251 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T16:54:19.378 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T16:54:19.383 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../3-linux-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T16:54:19.510 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T16:54:19.731 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.4.0-195. 2024-09-13T16:54:19.749 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../5-linux-headers-5.4.0-195_5.4.0-195.215_all.deb ... 2024-09-13T16:54:19.798 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T16:54:19.827 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T16:54:19.980 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-image-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T16:54:20.332 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-headers-5.4.0-195. 2024-09-13T16:54:20.346 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../5-linux-headers-5.4.0-195_5.4.0-195.215_all.deb ... 2024-09-13T16:54:20.391 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T16:54:25.653 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.4.0-195-generic. 2024-09-13T16:54:25.676 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../6-linux-headers-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T16:54:25.719 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:25.892 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-headers-5.4.0-195-generic. 2024-09-13T16:54:25.914 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../6-linux-headers-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T16:54:25.958 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:28.396 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T16:54:28.534 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T16:54:28.877 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:29.474 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T16:54:29.595 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-headers-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T16:54:29.943 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:30.397 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:31.151 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:32.291 INFO:teuthology.orchestra.run.smithi123.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-195-generic 2024-09-13T16:54:32.292 INFO:teuthology.orchestra.run.smithi123.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-195-generic 2024-09-13T16:54:32.427 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:32.491 INFO:teuthology.orchestra.run.smithi153.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-195-generic 2024-09-13T16:54:32.491 INFO:teuthology.orchestra.run.smithi153.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-195-generic 2024-09-13T16:54:32.650 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:33.587 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T16:54:33.843 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T16:54:33.969 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-generic (5.4.0.195.193) ... 2024-09-13T16:54:34.103 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:34.254 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-generic (5.4.0.195.193) ... 2024-09-13T16:54:34.380 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-generic (5.4.0.195.193) ... 2024-09-13T16:54:34.507 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:34.566 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T16:54:34.566 INFO:teuthology.orchestra.run.smithi153.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-195-generic 2024-09-13T16:54:34.836 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-image-generic (5.4.0.195.193) ... 2024-09-13T16:54:34.965 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:35.066 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-headers-generic (5.4.0.195.193) ... 2024-09-13T16:54:35.192 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-generic (5.4.0.195.193) ... 2024-09-13T16:54:35.318 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T16:54:35.393 INFO:teuthology.orchestra.run.smithi123.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T16:54:35.393 INFO:teuthology.orchestra.run.smithi123.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-195-generic 2024-09-13T16:54:56.855 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T16:54:56.855 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub' 2024-09-13T16:54:56.864 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T16:54:56.877 INFO:teuthology.orchestra.run.smithi153.stdout:Generating grub configuration file ... 2024-09-13T16:54:57.198 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T16:54:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T16:54:57.610 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T16:54:57.623 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T16:54:57.746 INFO:teuthology.orchestra.run.smithi123.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T16:54:57.746 INFO:teuthology.orchestra.run.smithi123.stdout:Sourcing file `/etc/default/grub' 2024-09-13T16:54:57.757 INFO:teuthology.orchestra.run.smithi123.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T16:54:57.768 INFO:teuthology.orchestra.run.smithi123.stdout:Generating grub configuration file ... 2024-09-13T16:54:58.082 INFO:teuthology.orchestra.run.smithi123.stdout:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T16:54:58.106 INFO:teuthology.orchestra.run.smithi123.stdout:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T16:54:58.478 INFO:teuthology.orchestra.run.smithi123.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T16:54:58.489 INFO:teuthology.orchestra.run.smithi123.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T16:55:00.359 INFO:teuthology.orchestra.run.smithi153.stdout:done 2024-09-13T16:55:00.757 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2024-09-13T16:55:00.799 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2024-09-13T16:55:00.799 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2024-09-13T16:55:00.800 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2024-09-13T16:55:00.800 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2024-09-13T16:55:00.800 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 20 2024-09-13T16:55:00.800 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T16:55:00.800 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2024-09-13T16:55:00.800 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2024-09-13T16:55:00.800 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.4.0.195.193 2024-09-13T16:55:00.800 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T16:55:00.800 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T16:55:00.800 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2024-09-13T16:55:00.800 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2024-09-13T16:55:00.800 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2024-09-13T16:55:00.801 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2024-09-13T16:55:00.801 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-195-generic 2024-09-13T16:55:00.801 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T16:55:00.801 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T16:55:00.801 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-13T16:55:00.801 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T16:55:00.801 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2024-09-13T16:55:00.875 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-13T16:55:01.089 INFO:teuthology.orchestra.run.smithi123.stdout:done 2024-09-13T16:55:01.148 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T16:55:01.149 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T16:55:01.219 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T16:55:01.302 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T16:55:01.509 DEBUG:teuthology.orchestra.run.smithi123:> dpkg -s linux-image-generic 2024-09-13T16:55:01.567 INFO:teuthology.orchestra.run.smithi123.stdout:Package: linux-image-generic 2024-09-13T16:55:01.567 INFO:teuthology.orchestra.run.smithi123.stdout:Status: install ok installed 2024-09-13T16:55:01.567 INFO:teuthology.orchestra.run.smithi123.stdout:Priority: optional 2024-09-13T16:55:01.567 INFO:teuthology.orchestra.run.smithi123.stdout:Section: kernel 2024-09-13T16:55:01.567 INFO:teuthology.orchestra.run.smithi123.stdout:Installed-Size: 20 2024-09-13T16:55:01.567 INFO:teuthology.orchestra.run.smithi123.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T16:55:01.567 INFO:teuthology.orchestra.run.smithi123.stdout:Architecture: amd64 2024-09-13T16:55:01.567 INFO:teuthology.orchestra.run.smithi123.stdout:Source: linux-meta 2024-09-13T16:55:01.567 INFO:teuthology.orchestra.run.smithi123.stdout:Version: 5.4.0.195.193 2024-09-13T16:55:01.567 INFO:teuthology.orchestra.run.smithi123.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T16:55:01.567 INFO:teuthology.orchestra.run.smithi123.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T16:55:01.568 INFO:teuthology.orchestra.run.smithi123.stdout:Recommends: thermald 2024-09-13T16:55:01.568 INFO:teuthology.orchestra.run.smithi123.stdout:Description: Generic Linux kernel image 2024-09-13T16:55:01.568 INFO:teuthology.orchestra.run.smithi123.stdout: This package will always depend on the latest generic kernel image 2024-09-13T16:55:01.568 INFO:teuthology.orchestra.run.smithi123.stdout: available. 2024-09-13T16:55:01.568 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-195-generic 2024-09-13T16:55:01.568 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T16:55:01.568 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T16:55:01.568 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T16:55:01.568 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi123.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T16:55:01.569 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get clean 2024-09-13T16:55:01.666 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get update 2024-09-13T16:55:01.798 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T16:55:01.798 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T16:55:01.804 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T16:55:01.821 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T16:55:03.011 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-13T16:55:03.037 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T16:55:03.112 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-13T16:55:03.330 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-13T16:55:03.330 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-13T16:55:03.572 INFO:teuthology.orchestra.run.smithi153.stdout:linux-image-generic is already the newest version (5.4.0.195.193). 2024-09-13T16:55:03.572 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T16:55:03.574 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2024-09-13T16:55:03.594 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2024-09-13T16:55:03.595 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2024-09-13T16:55:03.595 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2024-09-13T16:55:03.595 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2024-09-13T16:55:03.595 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 20 2024-09-13T16:55:03.595 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T16:55:03.595 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2024-09-13T16:55:03.595 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2024-09-13T16:55:03.595 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.4.0.195.193 2024-09-13T16:55:03.595 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T16:55:03.595 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T16:55:03.595 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2024-09-13T16:55:03.595 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2024-09-13T16:55:03.596 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2024-09-13T16:55:03.596 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2024-09-13T16:55:03.596 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-13T16:55:03.600 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.CjMGX1bBrF 2024-09-13T16:55:03.600 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub/grub.cfg /tmp/tmp.CjMGX1bBrF 2024-09-13T16:55:03.633 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-09-13T16:55:03.655 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.CjMGX1bBrF 2024-09-13T16:55:03.661 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T16:55:03.686 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.CjMGX1bBrF is 9KB 2024-09-13T16:55:03.699 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.CjMGX1bBrF 2024-09-13T16:55:03.706 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T16:55:03.736 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-09-13T16:55:03.761 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T16:55:03.762 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T16:55:03.762 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T16:55:03.802 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-195-generic 2024-09-13T16:55:03.802 DEBUG:teuthology.orchestra.run.smithi153:> sudo update-grub 2024-09-13T16:55:03.948 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2024-09-13T16:55:03.949 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2024-09-13T16:55:04.181 INFO:teuthology.orchestra.run.smithi123.stdout:linux-image-generic is already the newest version (5.4.0.195.193). 2024-09-13T16:55:04.182 INFO:teuthology.orchestra.run.smithi123.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T16:55:04.183 DEBUG:teuthology.orchestra.run.smithi123:> dpkg -s linux-image-generic 2024-09-13T16:55:04.206 INFO:teuthology.orchestra.run.smithi123.stdout:Package: linux-image-generic 2024-09-13T16:55:04.207 INFO:teuthology.orchestra.run.smithi123.stdout:Status: install ok installed 2024-09-13T16:55:04.207 INFO:teuthology.orchestra.run.smithi123.stdout:Priority: optional 2024-09-13T16:55:04.207 INFO:teuthology.orchestra.run.smithi123.stdout:Section: kernel 2024-09-13T16:55:04.207 INFO:teuthology.orchestra.run.smithi123.stdout:Installed-Size: 20 2024-09-13T16:55:04.207 INFO:teuthology.orchestra.run.smithi123.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T16:55:04.207 INFO:teuthology.orchestra.run.smithi123.stdout:Architecture: amd64 2024-09-13T16:55:04.207 INFO:teuthology.orchestra.run.smithi123.stdout:Source: linux-meta 2024-09-13T16:55:04.207 INFO:teuthology.orchestra.run.smithi123.stdout:Version: 5.4.0.195.193 2024-09-13T16:55:04.207 INFO:teuthology.orchestra.run.smithi123.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T16:55:04.207 INFO:teuthology.orchestra.run.smithi123.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T16:55:04.208 INFO:teuthology.orchestra.run.smithi123.stdout:Recommends: thermald 2024-09-13T16:55:04.208 INFO:teuthology.orchestra.run.smithi123.stdout:Description: Generic Linux kernel image 2024-09-13T16:55:04.208 INFO:teuthology.orchestra.run.smithi123.stdout: This package will always depend on the latest generic kernel image 2024-09-13T16:55:04.208 INFO:teuthology.orchestra.run.smithi123.stdout: available. 2024-09-13T16:55:04.208 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2024-09-13T16:55:04.212 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.K2ROdRsHfj 2024-09-13T16:55:04.213 DEBUG:teuthology.orchestra.run.smithi123:> sudo cp /boot/grub/grub.cfg /tmp/tmp.K2ROdRsHfj 2024-09-13T16:55:04.277 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.K2ROdRsHfj 2024-09-13T16:55:04.322 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.K2ROdRsHfj is 9KB 2024-09-13T16:55:04.336 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.K2ROdRsHfj 2024-09-13T16:55:04.345 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T16:55:04.403 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T16:55:04.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T16:55:04.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T16:55:04.443 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-195-generic 2024-09-13T16:55:04.443 DEBUG:teuthology.orchestra.run.smithi123:> sudo update-grub 2024-09-13T16:55:05.108 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub' 2024-09-13T16:55:05.117 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T16:55:05.129 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-09-13T16:55:05.379 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T16:55:05.391 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T16:55:05.695 INFO:teuthology.orchestra.run.smithi123.stderr:Sourcing file `/etc/default/grub' 2024-09-13T16:55:05.704 INFO:teuthology.orchestra.run.smithi123.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T16:55:05.713 INFO:teuthology.orchestra.run.smithi123.stderr:Generating grub configuration file ... 2024-09-13T16:55:05.730 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T16:55:05.742 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T16:55:05.959 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T16:55:05.970 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T16:55:06.329 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T16:55:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T16:55:07.379 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-09-13T16:55:07.381 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-09-13T16:55:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:done 2024-09-13T16:55:07.959 DEBUG:teuthology.orchestra.run.smithi123:> sudo shutdown -r now 2024-09-13T16:55:37.413 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-13T16:55:37.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-13T16:55:37.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:55:37.963 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T16:55:37.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-13T16:55:37.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:56:12.093 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-13T16:56:12.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-09-13T16:56:21.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-13T16:56:21.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:56:21.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-13T16:56:21.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:56:39.485 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-13T16:56:39.997 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-09-13T16:56:51.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-13T16:56:51.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:56:51.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-13T16:56:51.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:56:52.159 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-13T16:56:52.475 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-09-13T16:56:53.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-13T16:56:53.215 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-195-generic"... 2024-09-13T16:56:53.215 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-09-13T16:56:53.221 INFO:teuthology.orchestra.run.smithi123.stdout:5.4.0-195-generic 2024-09-13T16:56:53.222 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-195-generic vs 5.4.0-195-generic 2024-09-13T16:56:53.222 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T16:56:53.222 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T16:56:53.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-13T16:56:53.240 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-195-generic"... 2024-09-13T16:56:53.240 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-13T16:56:53.246 INFO:teuthology.orchestra.run.smithi153.stdout:5.4.0-195-generic 2024-09-13T16:56:53.246 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-195-generic vs 5.4.0-195-generic 2024-09-13T16:56:53.246 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T16:56:53.246 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T16:56:54.223 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T16:56:54.223 DEBUG:teuthology.orchestra.run.smithi123:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T16:56:54.247 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-13T16:56:54.247 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T16:56:54.319 INFO:teuthology.orchestra.run.smithi123.stdout:ttyS1 2024-09-13T16:56:54.341 DEBUG:teuthology.parallel:result is None 2024-09-13T16:56:54.402 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2024-09-13T16:56:54.436 DEBUG:teuthology.parallel:result is None 2024-09-13T16:56:54.437 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T16:56:54.445 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T16:56:54.445 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T16:56:54.448 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T16:56:54.455 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T16:56:54.490 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T16:56:54.525 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T16:56:54.525 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T16:56:54.528 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T16:56:54.554 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T16:56:54.563 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T16:56:54.563 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T16:56:54.584 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T16:56:54.600 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:56:54.610 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:56:54.614 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:56:54.626 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:56:54.628 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T16:56:54.636 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T16:56:54.636 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T16:56:54.638 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T16:56:54.653 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T16:56:54.666 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T16:56:54.666 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T16:56:54.669 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T16:56:54.700 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:56:54.721 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:56:54.727 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T16:56:54.727 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T16:56:54.756 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:56:54.763 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:56:54.773 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T16:56:54.773 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T16:56:54.799 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2024-09-13T16:56:54.801 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-09-13T16:56:55.068 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T16:56:55.075 INFO:teuthology.task.internal:Starting timer... 2024-09-13T16:56:55.075 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T16:56:55.118 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T16:56:55.148 DEBUG:teuthology.task.selinux:Excluding smithi123: OS 'ubuntu' does not support SELinux 2024-09-13T16:56:55.149 DEBUG:teuthology.task.selinux:Excluding smithi153: OS 'ubuntu' does not support SELinux 2024-09-13T16:56:55.149 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T16:56:55.149 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T16:56:55.149 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T16:56:55.149 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T16:56:55.186 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T16:56:55.199 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T16:56:55.200 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi123.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T17:02:35.915 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-09-13T17:02:35.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-13T17:02:35.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:02:36.027 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-09-13T17:02:36.151 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-13T17:02:36.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-13T17:02:36.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:02:36.274 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-13T17:02:36.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-13T17:02:36.398 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T17:02:36.410 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T17:02:36.410 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:02:36.411 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:02:36.413 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:02:36.414 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:02:36.447 INFO:teuthology.orchestra.run.smithi123.stdout:13 Sep 17:02:36 ntpd[13737]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T17:02:36.447 INFO:teuthology.orchestra.run.smithi123.stdout:13 Sep 17:02:36 ntpd[13737]: Command line: ntpd -gq 2024-09-13T17:02:36.448 INFO:teuthology.orchestra.run.smithi123.stdout:13 Sep 17:02:36 ntpd[13737]: proto: precision = 0.264 usec (-22) 2024-09-13T17:02:36.449 INFO:teuthology.orchestra.run.smithi123.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:02:36.449 INFO:teuthology.orchestra.run.smithi123.stdout:13 Sep 17:02:36 ntpd[13737]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:02:36.450 INFO:teuthology.orchestra.run.smithi123.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:02:36.451 INFO:teuthology.orchestra.run.smithi123.stdout:13 Sep 17:02:36 ntpd[13737]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:02:36.451 INFO:teuthology.orchestra.run.smithi123.stdout:13 Sep 17:02:36 ntpd[13737]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T17:02:36.451 INFO:teuthology.orchestra.run.smithi123.stdout:13 Sep 17:02:36 ntpd[13737]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T17:02:36.451 INFO:teuthology.orchestra.run.smithi123.stdout:13 Sep 17:02:36 ntpd[13737]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T17:02:36.451 INFO:teuthology.orchestra.run.smithi123.stdout:13 Sep 17:02:36 ntpd[13737]: Listen normally on 3 enp3s0f1 172.21.15.123:123 2024-09-13T17:02:36.451 INFO:teuthology.orchestra.run.smithi123.stdout:13 Sep 17:02:36 ntpd[13737]: Listen normally on 4 lo [::1]:123 2024-09-13T17:02:36.451 INFO:teuthology.orchestra.run.smithi123.stdout:13 Sep 17:02:36 ntpd[13737]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3f1%5]:123 2024-09-13T17:02:36.451 INFO:teuthology.orchestra.run.smithi123.stdout:13 Sep 17:02:36 ntpd[13737]: Listening on routing socket on fd #22 for interface updates 2024-09-13T17:02:36.471 INFO:teuthology.orchestra.run.smithi153.stdout:13 Sep 17:02:36 ntpd[13686]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T17:02:36.471 INFO:teuthology.orchestra.run.smithi153.stdout:13 Sep 17:02:36 ntpd[13686]: Command line: ntpd -gq 2024-09-13T17:02:36.472 INFO:teuthology.orchestra.run.smithi153.stdout:13 Sep 17:02:36 ntpd[13686]: proto: precision = 0.243 usec (-22) 2024-09-13T17:02:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:02:36.473 INFO:teuthology.orchestra.run.smithi153.stdout:13 Sep 17:02:36 ntpd[13686]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:02:36.473 INFO:teuthology.orchestra.run.smithi153.stdout:13 Sep 17:02:36 ntpd[13686]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:02:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:02:36.474 INFO:teuthology.orchestra.run.smithi153.stdout:13 Sep 17:02:36 ntpd[13686]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T17:02:36.474 INFO:teuthology.orchestra.run.smithi153.stdout:13 Sep 17:02:36 ntpd[13686]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T17:02:36.474 INFO:teuthology.orchestra.run.smithi153.stdout:13 Sep 17:02:36 ntpd[13686]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T17:02:36.475 INFO:teuthology.orchestra.run.smithi153.stdout:13 Sep 17:02:36 ntpd[13686]: Listen normally on 3 enp3s0f1 172.21.15.153:123 2024-09-13T17:02:36.475 INFO:teuthology.orchestra.run.smithi153.stdout:13 Sep 17:02:36 ntpd[13686]: Listen normally on 4 lo [::1]:123 2024-09-13T17:02:36.475 INFO:teuthology.orchestra.run.smithi153.stdout:13 Sep 17:02:36 ntpd[13686]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6deb%5]:123 2024-09-13T17:02:36.475 INFO:teuthology.orchestra.run.smithi153.stdout:13 Sep 17:02:36 ntpd[13686]: Listening on routing socket on fd #22 for interface updates 2024-09-13T17:02:37.448 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:37 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:37.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:37 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:37.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:37 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:37.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:37 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:37.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:37 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:37.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:37 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:37.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:37 ntpd[13737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:37.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:37 ntpd[13737]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:37.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:37 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:37.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:37 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:37.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:37 ntpd[13737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:37.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:37 ntpd[13737]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:37 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:37 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:37 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:37 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:37 ntpd[13686]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:37 ntpd[13686]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:39.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:39 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:39.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:39 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:39.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:39 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:39.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:39 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:39.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:39 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:39.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:39 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:39.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:39 ntpd[13737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:39.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:39 ntpd[13737]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:39.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:39 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:39.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:39 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:39.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:39 ntpd[13737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:39.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:39 ntpd[13737]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:39.472 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:39 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:39.472 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:39 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:39.472 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:39 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:39.472 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:39 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:39.472 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:39 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:39.472 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:39 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:39.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:39 ntpd[13686]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:39.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:39 ntpd[13686]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:39.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:39 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:39.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:39 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:39.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:39 ntpd[13686]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:39.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:39 ntpd[13686]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:40.472 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:40 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:40.472 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:40 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:41.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:41.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:41.451 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:41.451 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:41.451 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:41.451 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:41.451 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:41 ntpd[13737]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:41.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:41.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:41.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:41.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:41.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:41.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:41.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:41.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:41 ntpd[13686]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:43.448 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:43 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:43.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:43 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:43.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:43 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:43.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:43 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:43.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:43 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:43.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:43 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:43.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:43 ntpd[13737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:43.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:43 ntpd[13737]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:43.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:43 ntpd[13737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:43.449 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:43 ntpd[13737]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:43.449 INFO:teuthology.orchestra.run.smithi123.stdout:13 Sep 17:02:43 ntpd[13737]: ntpd: time slew +0.000823 s 2024-09-13T17:02:43.450 INFO:teuthology.orchestra.run.smithi123.stdout:ntpd: time slew +0.000823s 2024-09-13T17:02:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:43 ntpd[13737]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T17:02:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:13 Sep 17:02:43 ntpd[13737]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T17:02:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:02:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:02:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:02:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:02:43.475 INFO:teuthology.orchestra.run.smithi153.stdout:13 Sep 17:02:43 ntpd[13686]: ntpd: time slew +0.000180 s 2024-09-13T17:02:43.476 INFO:teuthology.orchestra.run.smithi153.stdout:ntpd: time slew +0.000180s 2024-09-13T17:02:43.476 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T17:02:43.476 INFO:teuthology.orchestra.run.smithi153.stderr:13 Sep 17:02:43 ntpd[13686]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T17:02:43.516 INFO:teuthology.orchestra.run.smithi123.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:02:43.516 INFO:teuthology.orchestra.run.smithi123.stdout:============================================================================== 2024-09-13T17:02:43.516 INFO:teuthology.orchestra.run.smithi123.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:02:43.516 INFO:teuthology.orchestra.run.smithi123.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:02:43.516 INFO:teuthology.orchestra.run.smithi123.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:02:43.516 INFO:teuthology.orchestra.run.smithi123.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:02:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:02:43.538 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-09-13T17:02:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:02:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:02:43.538 INFO:teuthology.orchestra.run.smithi153.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:02:43.539 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:02:43.539 INFO:teuthology.run_tasks:Running task install... 2024-09-13T17:02:43.549 DEBUG:teuthology.task.install:project ceph 2024-09-13T17:02:43.549 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T17:02:43.549 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T17:02:43.549 INFO:teuthology.task.install:Using flavor: default 2024-09-13T17:02:43.555 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T17:02:43.555 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T17:02:43.555 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-key list | grep Ceph 2024-09-13T17:02:43.556 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-key list | grep Ceph 2024-09-13T17:02:43.653 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T17:02:43.664 INFO:teuthology.orchestra.run.smithi123.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T17:02:43.711 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T17:02:43.712 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T17:02:43.713 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T17:02:43.713 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T17:02:43.713 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:02:43.727 INFO:teuthology.orchestra.run.smithi123.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T17:02:43.727 INFO:teuthology.orchestra.run.smithi123.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T17:02:43.728 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T17:02:43.728 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T17:02:43.728 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:02:43.867 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default/ 2024-09-13T17:02:43.867 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1focal 2024-09-13T17:02:43.885 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default/ 2024-09-13T17:02:43.887 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1focal 2024-09-13T17:02:44.029 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:02:44.029 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T17:02:44.035 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:02:44.035 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T17:02:44.046 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-13T17:02:44.051 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get update 2024-09-13T17:02:44.234 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T17:02:44.235 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T17:02:44.240 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T17:02:44.240 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T17:02:44.258 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T17:02:44.314 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal InRelease 2024-09-13T17:02:44.324 INFO:teuthology.orchestra.run.smithi123.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal InRelease 2024-09-13T17:02:44.351 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T17:02:44.356 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T17:02:44.360 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T17:02:44.388 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T17:02:44.399 INFO:teuthology.orchestra.run.smithi123.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T17:02:44.424 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main i386 Packages [3,433 B] 2024-09-13T17:02:44.436 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main i386 Packages [3,433 B] 2024-09-13T17:02:44.446 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T17:02:44.469 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T17:02:44.483 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T17:02:44.521 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T17:02:44.879 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 28.7 kB in 1s (46.2 kB/s) 2024-09-13T17:02:44.891 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 28.7 kB in 1s (45.8 kB/s) 2024-09-13T17:02:46.036 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-13T17:02:46.046 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-09-13T17:02:46.061 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1focal cephadm=18.2.4-860-g6c6b083f-1focal ceph-mds=18.2.4-860-g6c6b083f-1focal ceph-mgr=18.2.4-860-g6c6b083f-1focal ceph-common=18.2.4-860-g6c6b083f-1focal ceph-fuse=18.2.4-860-g6c6b083f-1focal ceph-test=18.2.4-860-g6c6b083f-1focal ceph-volume=18.2.4-860-g6c6b083f-1focal radosgw=18.2.4-860-g6c6b083f-1focal python3-rados=18.2.4-860-g6c6b083f-1focal python3-rgw=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal python3-rbd=18.2.4-860-g6c6b083f-1focal libcephfs2=18.2.4-860-g6c6b083f-1focal libcephfs-dev=18.2.4-860-g6c6b083f-1focal librados2=18.2.4-860-g6c6b083f-1focal librbd1=18.2.4-860-g6c6b083f-1focal rbd-fuse=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal cephfs-shell=18.2.4-860-g6c6b083f-1focal cephfs-top=18.2.4-860-g6c6b083f-1focal cephfs-mirror=18.2.4-860-g6c6b083f-1focal 2024-09-13T17:02:46.072 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1focal cephadm=18.2.4-860-g6c6b083f-1focal ceph-mds=18.2.4-860-g6c6b083f-1focal ceph-mgr=18.2.4-860-g6c6b083f-1focal ceph-common=18.2.4-860-g6c6b083f-1focal ceph-fuse=18.2.4-860-g6c6b083f-1focal ceph-test=18.2.4-860-g6c6b083f-1focal ceph-volume=18.2.4-860-g6c6b083f-1focal radosgw=18.2.4-860-g6c6b083f-1focal python3-rados=18.2.4-860-g6c6b083f-1focal python3-rgw=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal python3-rbd=18.2.4-860-g6c6b083f-1focal libcephfs2=18.2.4-860-g6c6b083f-1focal libcephfs-dev=18.2.4-860-g6c6b083f-1focal librados2=18.2.4-860-g6c6b083f-1focal librbd1=18.2.4-860-g6c6b083f-1focal rbd-fuse=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal cephfs-shell=18.2.4-860-g6c6b083f-1focal cephfs-top=18.2.4-860-g6c6b083f-1focal cephfs-mirror=18.2.4-860-g6c6b083f-1focal 2024-09-13T17:02:46.131 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-13T17:02:46.141 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-09-13T17:02:46.326 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-13T17:02:46.326 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-13T17:02:46.360 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2024-09-13T17:02:46.361 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2024-09-13T17:02:46.518 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:02:46.520 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T17:02:46.520 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:02:46.520 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-13T17:02:46.520 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T17:02:46.520 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T17:02:46.520 INFO:teuthology.orchestra.run.smithi153.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T17:02:46.520 INFO:teuthology.orchestra.run.smithi153.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T17:02:46.520 INFO:teuthology.orchestra.run.smithi153.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T17:02:46.521 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T17:02:46.521 INFO:teuthology.orchestra.run.smithi153.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T17:02:46.522 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T17:02:46.522 INFO:teuthology.orchestra.run.smithi153.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T17:02:46.522 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-13T17:02:46.522 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-13T17:02:46.522 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-13T17:02:46.522 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-13T17:02:46.522 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-13T17:02:46.522 INFO:teuthology.orchestra.run.smithi153.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T17:02:46.522 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T17:02:46.523 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T17:02:46.523 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T17:02:46.523 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T17:02:46.523 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T17:02:46.523 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T17:02:46.523 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T17:02:46.523 INFO:teuthology.orchestra.run.smithi153.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T17:02:46.524 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-13T17:02:46.524 INFO:teuthology.orchestra.run.smithi153.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T17:02:46.524 INFO:teuthology.orchestra.run.smithi153.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T17:02:46.524 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T17:02:46.524 INFO:teuthology.orchestra.run.smithi153.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T17:02:46.524 INFO:teuthology.orchestra.run.smithi153.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T17:02:46.524 INFO:teuthology.orchestra.run.smithi153.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T17:02:46.524 INFO:teuthology.orchestra.run.smithi153.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T17:02:46.524 INFO:teuthology.orchestra.run.smithi153.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T17:02:46.524 INFO:teuthology.orchestra.run.smithi153.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T17:02:46.525 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-09-13T17:02:46.525 INFO:teuthology.orchestra.run.smithi153.stdout: btrfs-tools 2024-09-13T17:02:46.556 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:02:46.557 INFO:teuthology.orchestra.run.smithi123.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T17:02:46.557 INFO:teuthology.orchestra.run.smithi123.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:02:46.557 INFO:teuthology.orchestra.run.smithi123.stdout:The following additional packages will be installed: 2024-09-13T17:02:46.557 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T17:02:46.561 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T17:02:46.561 INFO:teuthology.orchestra.run.smithi123.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T17:02:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T17:02:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T17:02:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T17:02:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T17:02:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T17:02:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T17:02:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-13T17:02:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-13T17:02:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-13T17:02:46.562 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-13T17:02:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-13T17:02:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T17:02:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T17:02:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T17:02:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T17:02:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T17:02:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T17:02:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T17:02:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T17:02:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T17:02:46.564 INFO:teuthology.orchestra.run.smithi123.stdout:Suggested packages: 2024-09-13T17:02:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T17:02:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T17:02:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T17:02:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T17:02:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T17:02:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T17:02:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T17:02:46.564 INFO:teuthology.orchestra.run.smithi123.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T17:02:46.565 INFO:teuthology.orchestra.run.smithi123.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T17:02:46.565 INFO:teuthology.orchestra.run.smithi123.stdout:Recommended packages: 2024-09-13T17:02:46.565 INFO:teuthology.orchestra.run.smithi123.stdout: btrfs-tools 2024-09-13T17:02:46.643 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-13T17:02:46.643 INFO:teuthology.orchestra.run.smithi153.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T17:02:46.643 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T17:02:46.644 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T17:02:46.644 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-09-13T17:02:46.644 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-09-13T17:02:46.644 INFO:teuthology.orchestra.run.smithi153.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-09-13T17:02:46.644 INFO:teuthology.orchestra.run.smithi153.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-09-13T17:02:46.646 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-09-13T17:02:46.646 INFO:teuthology.orchestra.run.smithi153.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T17:02:46.646 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T17:02:46.646 INFO:teuthology.orchestra.run.smithi153.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T17:02:46.646 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-09-13T17:02:46.646 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-09-13T17:02:46.646 INFO:teuthology.orchestra.run.smithi153.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T17:02:46.646 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T17:02:46.646 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T17:02:46.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T17:02:46.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T17:02:46.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-09-13T17:02:46.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-09-13T17:02:46.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T17:02:46.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T17:02:46.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T17:02:46.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T17:02:46.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T17:02:46.647 INFO:teuthology.orchestra.run.smithi153.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-13T17:02:46.647 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-09-13T17:02:46.648 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 librbd1 2024-09-13T17:02:46.684 INFO:teuthology.orchestra.run.smithi123.stdout:The following NEW packages will be installed: 2024-09-13T17:02:46.684 INFO:teuthology.orchestra.run.smithi123.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T17:02:46.684 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T17:02:46.684 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T17:02:46.684 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-09-13T17:02:46.684 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-09-13T17:02:46.684 INFO:teuthology.orchestra.run.smithi123.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-09-13T17:02:46.685 INFO:teuthology.orchestra.run.smithi123.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-09-13T17:02:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-09-13T17:02:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T17:02:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T17:02:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T17:02:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-09-13T17:02:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-09-13T17:02:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T17:02:46.686 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T17:02:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T17:02:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T17:02:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T17:02:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-09-13T17:02:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-09-13T17:02:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T17:02:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T17:02:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T17:02:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T17:02:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T17:02:46.687 INFO:teuthology.orchestra.run.smithi123.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-13T17:02:46.688 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages will be upgraded: 2024-09-13T17:02:46.688 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 librbd1 2024-09-13T17:02:46.712 INFO:teuthology.orchestra.run.smithi153.stdout:2 upgraded, 116 newly installed, 0 to remove and 295 not upgraded. 2024-09-13T17:02:46.713 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 200 MB of archives. 2024-09-13T17:02:46.713 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 979 MB of additional disk space will be used. 2024-09-13T17:02:46.713 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-09-13T17:02:46.731 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T17:02:46.740 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-09-13T17:02:46.768 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T17:02:46.796 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T17:02:46.799 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T17:02:46.812 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T17:02:46.855 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T17:02:46.858 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T17:02:46.863 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T17:02:46.865 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T17:02:46.866 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T17:02:46.866 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T17:02:46.867 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T17:02:46.870 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T17:02:46.870 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T17:02:46.873 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T17:02:46.875 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1focal [3,453 kB] 2024-09-13T17:02:46.879 INFO:teuthology.orchestra.run.smithi123.stdout:2 upgraded, 116 newly installed, 0 to remove and 295 not upgraded. 2024-09-13T17:02:46.879 INFO:teuthology.orchestra.run.smithi123.stdout:Need to get 200 MB of archives. 2024-09-13T17:02:46.879 INFO:teuthology.orchestra.run.smithi123.stdout:After this operation, 979 MB of additional disk space will be used. 2024-09-13T17:02:46.879 INFO:teuthology.orchestra.run.smithi123.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-09-13T17:02:46.889 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T17:02:46.889 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T17:02:46.890 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T17:02:46.891 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T17:02:46.892 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T17:02:46.892 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T17:02:46.894 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T17:02:46.894 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T17:02:46.896 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T17:02:46.907 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T17:02:46.915 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T17:02:46.921 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1focal [3,453 kB] 2024-09-13T17:02:46.921 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T17:02:46.922 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T17:02:46.923 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T17:02:46.923 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T17:02:46.924 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T17:02:46.926 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T17:02:46.926 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T17:02:46.929 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T17:02:46.941 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T17:02:46.943 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T17:02:46.944 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T17:02:46.945 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T17:02:46.959 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T17:02:46.959 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T17:02:46.960 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T17:02:46.965 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T17:02:46.966 INFO:teuthology.orchestra.run.smithi153.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T17:02:46.966 INFO:teuthology.orchestra.run.smithi153.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T17:02:46.966 INFO:teuthology.orchestra.run.smithi153.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T17:02:46.976 INFO:teuthology.orchestra.run.smithi153.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T17:02:46.977 INFO:teuthology.orchestra.run.smithi153.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T17:02:46.979 INFO:teuthology.orchestra.run.smithi153.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T17:02:46.980 INFO:teuthology.orchestra.run.smithi153.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T17:02:46.993 INFO:teuthology.orchestra.run.smithi153.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T17:02:46.993 INFO:teuthology.orchestra.run.smithi153.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T17:02:46.997 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-09-13T17:02:47.076 INFO:teuthology.orchestra.run.smithi153.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T17:02:47.091 INFO:teuthology.orchestra.run.smithi153.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T17:02:47.092 INFO:teuthology.orchestra.run.smithi153.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T17:02:47.103 INFO:teuthology.orchestra.run.smithi153.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T17:02:47.104 INFO:teuthology.orchestra.run.smithi153.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T17:02:47.122 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T17:02:47.171 INFO:teuthology.orchestra.run.smithi153.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T17:02:47.171 INFO:teuthology.orchestra.run.smithi153.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T17:02:47.172 INFO:teuthology.orchestra.run.smithi153.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T17:02:47.173 INFO:teuthology.orchestra.run.smithi153.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T17:02:47.174 INFO:teuthology.orchestra.run.smithi153.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T17:02:47.176 INFO:teuthology.orchestra.run.smithi153.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T17:02:47.177 INFO:teuthology.orchestra.run.smithi153.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T17:02:47.188 INFO:teuthology.orchestra.run.smithi153.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T17:02:47.190 INFO:teuthology.orchestra.run.smithi153.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T17:02:47.192 INFO:teuthology.orchestra.run.smithi153.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T17:02:47.205 INFO:teuthology.orchestra.run.smithi153.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T17:02:47.206 INFO:teuthology.orchestra.run.smithi153.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T17:02:47.209 INFO:teuthology.orchestra.run.smithi153.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T17:02:47.213 INFO:teuthology.orchestra.run.smithi153.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-09-13T17:02:47.214 INFO:teuthology.orchestra.run.smithi153.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T17:02:47.231 INFO:teuthology.orchestra.run.smithi153.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T17:02:47.234 INFO:teuthology.orchestra.run.smithi153.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T17:02:47.235 INFO:teuthology.orchestra.run.smithi153.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T17:02:47.254 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T17:02:47.270 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T17:02:47.273 INFO:teuthology.orchestra.run.smithi153.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T17:02:47.274 INFO:teuthology.orchestra.run.smithi153.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T17:02:47.274 INFO:teuthology.orchestra.run.smithi153.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T17:02:47.275 INFO:teuthology.orchestra.run.smithi153.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T17:02:47.286 INFO:teuthology.orchestra.run.smithi153.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T17:02:47.287 INFO:teuthology.orchestra.run.smithi153.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T17:02:47.287 INFO:teuthology.orchestra.run.smithi153.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1focal [4,041 kB] 2024-09-13T17:02:47.288 INFO:teuthology.orchestra.run.smithi153.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T17:02:47.288 INFO:teuthology.orchestra.run.smithi153.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T17:02:47.288 INFO:teuthology.orchestra.run.smithi153.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T17:02:47.337 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T17:02:47.521 INFO:teuthology.orchestra.run.smithi153.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1focal [747 kB] 2024-09-13T17:02:47.534 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T17:02:47.543 INFO:teuthology.orchestra.run.smithi123.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T17:02:47.570 INFO:teuthology.orchestra.run.smithi123.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T17:02:47.574 INFO:teuthology.orchestra.run.smithi153.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1focal [388 kB] 2024-09-13T17:02:47.578 INFO:teuthology.orchestra.run.smithi123.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T17:02:47.578 INFO:teuthology.orchestra.run.smithi123.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T17:02:47.581 INFO:teuthology.orchestra.run.smithi153.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1focal [31.9 kB] 2024-09-13T17:02:47.582 INFO:teuthology.orchestra.run.smithi153.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1focal [200 kB] 2024-09-13T17:02:47.583 INFO:teuthology.orchestra.run.smithi123.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T17:02:47.583 INFO:teuthology.orchestra.run.smithi123.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T17:02:47.585 INFO:teuthology.orchestra.run.smithi153.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1focal [62.5 kB] 2024-09-13T17:02:47.585 INFO:teuthology.orchestra.run.smithi153.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1focal [368 kB] 2024-09-13T17:02:47.595 INFO:teuthology.orchestra.run.smithi123.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T17:02:47.596 INFO:teuthology.orchestra.run.smithi123.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T17:02:47.617 INFO:teuthology.orchestra.run.smithi123.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T17:02:47.635 INFO:teuthology.orchestra.run.smithi153.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1focal [6,634 kB] 2024-09-13T17:02:47.684 INFO:teuthology.orchestra.run.smithi123.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T17:02:47.684 INFO:teuthology.orchestra.run.smithi123.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T17:02:47.685 INFO:teuthology.orchestra.run.smithi123.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T17:02:47.687 INFO:teuthology.orchestra.run.smithi123.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T17:02:47.687 INFO:teuthology.orchestra.run.smithi123.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T17:02:47.688 INFO:teuthology.orchestra.run.smithi123.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T17:02:47.690 INFO:teuthology.orchestra.run.smithi123.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T17:02:47.691 INFO:teuthology.orchestra.run.smithi123.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T17:02:47.700 INFO:teuthology.orchestra.run.smithi123.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T17:02:47.715 INFO:teuthology.orchestra.run.smithi123.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1focal [4,041 kB] 2024-09-13T17:02:47.781 INFO:teuthology.orchestra.run.smithi123.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T17:02:47.781 INFO:teuthology.orchestra.run.smithi123.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T17:02:47.790 INFO:teuthology.orchestra.run.smithi123.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T17:02:47.791 INFO:teuthology.orchestra.run.smithi123.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T17:02:47.791 INFO:teuthology.orchestra.run.smithi123.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T17:02:47.792 INFO:teuthology.orchestra.run.smithi123.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T17:02:47.794 INFO:teuthology.orchestra.run.smithi123.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T17:02:47.795 INFO:teuthology.orchestra.run.smithi123.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T17:02:47.863 INFO:teuthology.orchestra.run.smithi123.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T17:02:47.868 INFO:teuthology.orchestra.run.smithi123.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T17:02:47.947 INFO:teuthology.orchestra.run.smithi123.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T17:02:47.950 INFO:teuthology.orchestra.run.smithi123.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T17:02:47.953 INFO:teuthology.orchestra.run.smithi123.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T17:02:47.954 INFO:teuthology.orchestra.run.smithi123.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T17:02:47.955 INFO:teuthology.orchestra.run.smithi123.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T17:02:47.956 INFO:teuthology.orchestra.run.smithi123.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T17:02:47.958 INFO:teuthology.orchestra.run.smithi123.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T17:02:47.958 INFO:teuthology.orchestra.run.smithi123.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T17:02:47.965 INFO:teuthology.orchestra.run.smithi153.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1focal [113 kB] 2024-09-13T17:02:47.966 INFO:teuthology.orchestra.run.smithi153.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1focal [478 kB] 2024-09-13T17:02:48.016 INFO:teuthology.orchestra.run.smithi153.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1focal [25.2 MB] 2024-09-13T17:02:48.031 INFO:teuthology.orchestra.run.smithi123.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T17:02:48.035 INFO:teuthology.orchestra.run.smithi123.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T17:02:48.113 INFO:teuthology.orchestra.run.smithi123.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T17:02:48.116 INFO:teuthology.orchestra.run.smithi123.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T17:02:48.119 INFO:teuthology.orchestra.run.smithi123.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T17:02:48.120 INFO:teuthology.orchestra.run.smithi123.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T17:02:48.122 INFO:teuthology.orchestra.run.smithi123.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T17:02:48.122 INFO:teuthology.orchestra.run.smithi123.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T17:02:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1focal [747 kB] 2024-09-13T17:02:48.409 INFO:teuthology.orchestra.run.smithi123.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1focal [388 kB] 2024-09-13T17:02:48.415 INFO:teuthology.orchestra.run.smithi123.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1focal [31.9 kB] 2024-09-13T17:02:48.417 INFO:teuthology.orchestra.run.smithi123.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1focal [200 kB] 2024-09-13T17:02:48.445 INFO:teuthology.orchestra.run.smithi123.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T17:02:48.474 INFO:teuthology.orchestra.run.smithi123.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T17:02:48.476 INFO:teuthology.orchestra.run.smithi123.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T17:02:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1focal [62.5 kB] 2024-09-13T17:02:48.482 INFO:teuthology.orchestra.run.smithi123.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1focal [368 kB] 2024-09-13T17:02:48.489 INFO:teuthology.orchestra.run.smithi123.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1focal [6,634 kB] 2024-09-13T17:02:48.545 INFO:teuthology.orchestra.run.smithi123.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T17:02:48.545 INFO:teuthology.orchestra.run.smithi123.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T17:02:48.546 INFO:teuthology.orchestra.run.smithi123.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T17:02:48.546 INFO:teuthology.orchestra.run.smithi123.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T17:02:48.546 INFO:teuthology.orchestra.run.smithi123.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T17:02:48.547 INFO:teuthology.orchestra.run.smithi123.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T17:02:48.547 INFO:teuthology.orchestra.run.smithi123.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T17:02:48.610 INFO:teuthology.orchestra.run.smithi123.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T17:02:48.611 INFO:teuthology.orchestra.run.smithi123.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T17:02:48.692 INFO:teuthology.orchestra.run.smithi123.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T17:02:48.698 INFO:teuthology.orchestra.run.smithi123.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T17:02:48.702 INFO:teuthology.orchestra.run.smithi123.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T17:02:48.706 INFO:teuthology.orchestra.run.smithi123.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T17:02:48.706 INFO:teuthology.orchestra.run.smithi123.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T17:02:48.709 INFO:teuthology.orchestra.run.smithi123.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T17:02:48.711 INFO:teuthology.orchestra.run.smithi123.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-09-13T17:02:48.711 INFO:teuthology.orchestra.run.smithi123.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T17:02:48.785 INFO:teuthology.orchestra.run.smithi123.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T17:02:48.788 INFO:teuthology.orchestra.run.smithi123.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T17:02:48.855 INFO:teuthology.orchestra.run.smithi123.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T17:02:48.966 INFO:teuthology.orchestra.run.smithi123.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T17:02:49.021 INFO:teuthology.orchestra.run.smithi123.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T17:02:49.021 INFO:teuthology.orchestra.run.smithi123.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T17:02:49.023 INFO:teuthology.orchestra.run.smithi123.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T17:02:49.039 INFO:teuthology.orchestra.run.smithi123.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T17:02:49.040 INFO:teuthology.orchestra.run.smithi123.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T17:02:49.041 INFO:teuthology.orchestra.run.smithi123.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T17:02:49.041 INFO:teuthology.orchestra.run.smithi123.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T17:02:49.041 INFO:teuthology.orchestra.run.smithi123.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T17:02:49.190 INFO:teuthology.orchestra.run.smithi123.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1focal [113 kB] 2024-09-13T17:02:49.245 INFO:teuthology.orchestra.run.smithi123.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1focal [478 kB] 2024-09-13T17:02:49.254 INFO:teuthology.orchestra.run.smithi123.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1focal [25.2 MB] 2024-09-13T17:02:49.499 INFO:teuthology.orchestra.run.smithi153.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1focal [9,609 kB] 2024-09-13T17:02:49.914 INFO:teuthology.orchestra.run.smithi153.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1focal [238 kB] 2024-09-13T17:02:49.919 INFO:teuthology.orchestra.run.smithi153.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1focal [147 kB] 2024-09-13T17:02:49.923 INFO:teuthology.orchestra.run.smithi153.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1focal [1,576 kB] 2024-09-13T17:02:49.993 INFO:teuthology.orchestra.run.smithi153.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1focal [6,641 kB] 2024-09-13T17:02:50.350 INFO:teuthology.orchestra.run.smithi153.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1focal [24.5 MB] 2024-09-13T17:02:51.803 INFO:teuthology.orchestra.run.smithi153.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1focal [13.7 kB] 2024-09-13T17:02:51.804 INFO:teuthology.orchestra.run.smithi153.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1focal [857 kB] 2024-09-13T17:02:51.817 INFO:teuthology.orchestra.run.smithi153.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1focal [2,296 kB] 2024-09-13T17:02:51.835 INFO:teuthology.orchestra.run.smithi123.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1focal [9,609 kB] 2024-09-13T17:02:52.045 INFO:teuthology.orchestra.run.smithi153.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1focal [239 kB] 2024-09-13T17:02:52.050 INFO:teuthology.orchestra.run.smithi153.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1focal [143 kB] 2024-09-13T17:02:52.054 INFO:teuthology.orchestra.run.smithi153.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1focal [7,015 kB] 2024-09-13T17:02:52.435 INFO:teuthology.orchestra.run.smithi153.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1focal [7,894 kB] 2024-09-13T17:02:52.744 INFO:teuthology.orchestra.run.smithi123.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1focal [238 kB] 2024-09-13T17:02:52.764 INFO:teuthology.orchestra.run.smithi123.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1focal [147 kB] 2024-09-13T17:02:52.767 INFO:teuthology.orchestra.run.smithi123.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1focal [1,576 kB] 2024-09-13T17:02:52.884 INFO:teuthology.orchestra.run.smithi153.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1focal [13.9 kB] 2024-09-13T17:02:52.884 INFO:teuthology.orchestra.run.smithi153.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1focal [47.1 MB] 2024-09-13T17:02:52.916 INFO:teuthology.orchestra.run.smithi123.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1focal [6,641 kB] 2024-09-13T17:02:53.561 INFO:teuthology.orchestra.run.smithi123.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1focal [24.5 MB] 2024-09-13T17:02:55.889 INFO:teuthology.orchestra.run.smithi153.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1focal [120 kB] 2024-09-13T17:02:55.891 INFO:teuthology.orchestra.run.smithi153.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1focal [271 kB] 2024-09-13T17:02:55.896 INFO:teuthology.orchestra.run.smithi153.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1focal [33.0 kB] 2024-09-13T17:02:55.897 INFO:teuthology.orchestra.run.smithi153.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1focal [22.8 kB] 2024-09-13T17:02:55.898 INFO:teuthology.orchestra.run.smithi153.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1focal [37.4 kB] 2024-09-13T17:02:55.899 INFO:teuthology.orchestra.run.smithi153.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1focal [13.5 MB] 2024-09-13T17:02:55.949 INFO:teuthology.orchestra.run.smithi123.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1focal [13.7 kB] 2024-09-13T17:02:55.949 INFO:teuthology.orchestra.run.smithi123.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1focal [857 kB] 2024-09-13T17:02:55.963 INFO:teuthology.orchestra.run.smithi123.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1focal [2,296 kB] 2024-09-13T17:02:56.176 INFO:teuthology.orchestra.run.smithi123.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1focal [239 kB] 2024-09-13T17:02:56.190 INFO:teuthology.orchestra.run.smithi123.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1focal [143 kB] 2024-09-13T17:02:56.193 INFO:teuthology.orchestra.run.smithi123.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1focal [7,015 kB] 2024-09-13T17:02:56.466 INFO:teuthology.orchestra.run.smithi153.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1focal [108 kB] 2024-09-13T17:02:56.696 INFO:teuthology.orchestra.run.smithi123.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1focal [7,894 kB] 2024-09-13T17:02:57.121 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 200 MB in 10s (20.3 MB/s) 2024-09-13T17:02:57.174 INFO:teuthology.orchestra.run.smithi123.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1focal [13.9 kB] 2024-09-13T17:02:57.174 INFO:teuthology.orchestra.run.smithi123.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1focal [47.1 MB] 2024-09-13T17:02:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T17:02:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-13T17:02:57.306 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-09-13T17:02:57.351 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-09-13T17:02:57.612 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T17:02:57.630 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T17:02:57.670 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T17:02:57.989 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T17:02:58.006 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-09-13T17:02:58.073 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-09-13T17:02:58.442 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T17:02:58.459 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T17:02:58.542 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T17:02:58.896 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T17:02:58.914 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T17:02:58.987 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T17:02:59.349 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T17:02:59.364 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T17:02:59.407 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T17:02:59.935 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T17:02:59.954 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T17:03:00.005 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:03:00.522 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T17:03:00.538 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T17:03:00.596 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:03:00.975 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T17:03:00.993 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T17:03:01.033 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:03:01.453 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T17:03:01.472 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T17:03:01.527 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T17:03:01.914 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../010-librbd1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:02.039 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T17:03:02.421 INFO:teuthology.orchestra.run.smithi123.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1focal [120 kB] 2024-09-13T17:03:02.455 INFO:teuthology.orchestra.run.smithi123.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1focal [271 kB] 2024-09-13T17:03:02.461 INFO:teuthology.orchestra.run.smithi123.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1focal [33.0 kB] 2024-09-13T17:03:02.461 INFO:teuthology.orchestra.run.smithi123.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1focal [22.8 kB] 2024-09-13T17:03:02.462 INFO:teuthology.orchestra.run.smithi123.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1focal [37.4 kB] 2024-09-13T17:03:02.463 INFO:teuthology.orchestra.run.smithi123.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1focal [13.5 MB] 2024-09-13T17:03:02.775 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:02.902 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T17:03:03.235 INFO:teuthology.orchestra.run.smithi123.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1focal [108 kB] 2024-09-13T17:03:03.672 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T17:03:03.690 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../012-libcephfs2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:03.722 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:03.891 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 200 MB in 17s (12.1 MB/s) 2024-09-13T17:03:04.038 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T17:03:04.074 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rados. 2024-09-13T17:03:04.090 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../013-python3-rados_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:04.093 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-13T17:03:04.098 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-09-13T17:03:04.132 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:04.136 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-09-13T17:03:04.464 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T17:03:04.482 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T17:03:04.522 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T17:03:04.531 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T17:03:04.549 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:04.743 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:04.825 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T17:03:04.843 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-09-13T17:03:04.883 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-09-13T17:03:05.021 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T17:03:05.038 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../015-python3-cephfs_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:05.079 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:05.211 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T17:03:05.228 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T17:03:05.294 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T17:03:05.432 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T17:03:05.450 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:05.482 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:05.658 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T17:03:05.678 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T17:03:05.717 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T17:03:05.843 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T17:03:05.862 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T17:03:05.910 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T17:03:06.086 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T17:03:06.102 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T17:03:06.144 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T17:03:06.179 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T17:03:06.198 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../018-python3-rbd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:06.237 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:06.531 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T17:03:06.548 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T17:03:06.599 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:03:06.615 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T17:03:06.633 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T17:03:06.673 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T17:03:07.076 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T17:03:07.091 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T17:03:07.126 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T17:03:07.134 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T17:03:07.142 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T17:03:07.184 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:03:07.479 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T17:03:07.495 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T17:03:07.537 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T17:03:07.537 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T17:03:07.552 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T17:03:07.595 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:03:07.915 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librgw2. 2024-09-13T17:03:07.931 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../022-librgw2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:07.948 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T17:03:07.964 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T17:03:07.989 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:08.007 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T17:03:08.368 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../010-librbd1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:08.518 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T17:03:08.850 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T17:03:08.866 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../023-python3-rgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:08.900 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:09.231 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:09.295 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liboath0. 2024-09-13T17:03:09.311 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T17:03:09.338 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T17:03:09.353 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T17:03:09.697 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T17:03:09.714 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../025-libradosstriper1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:09.755 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:10.059 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T17:03:10.076 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../012-libcephfs2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:10.117 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:10.267 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-common. 2024-09-13T17:03:10.283 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../026-ceph-common_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:10.325 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:10.470 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rados. 2024-09-13T17:03:10.490 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../013-python3-rados_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:10.528 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:10.872 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T17:03:10.888 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:10.932 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:11.191 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T17:03:11.207 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../015-python3-cephfs_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:11.241 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:11.569 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T17:03:11.584 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:11.627 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:11.955 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T17:03:11.974 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T17:03:12.013 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T17:03:12.257 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T17:03:12.275 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../018-python3-rbd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:12.315 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:12.618 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T17:03:12.636 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T17:03:12.684 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T17:03:12.914 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-base. 2024-09-13T17:03:12.930 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../027-ceph-base_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:12.999 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:13.004 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T17:03:13.020 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T17:03:13.062 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T17:03:13.398 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T17:03:13.414 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T17:03:13.465 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T17:03:13.843 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librgw2. 2024-09-13T17:03:13.860 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../022-librgw2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:13.901 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:14.193 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T17:03:14.210 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T17:03:14.259 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T17:03:14.629 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T17:03:14.646 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T17:03:14.687 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T17:03:14.762 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T17:03:14.777 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../023-python3-rgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:14.820 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:15.049 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T17:03:15.066 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T17:03:15.124 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T17:03:15.197 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liboath0. 2024-09-13T17:03:15.215 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T17:03:15.256 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T17:03:15.452 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T17:03:15.469 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T17:03:15.510 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T17:03:15.584 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T17:03:15.600 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../025-libradosstriper1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:15.645 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:15.838 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-mako. 2024-09-13T17:03:15.857 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T17:03:15.895 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T17:03:16.095 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-common. 2024-09-13T17:03:16.111 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../026-ceph-common_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:16.153 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:16.249 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T17:03:16.266 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T17:03:16.340 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:03:16.677 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T17:03:16.697 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T17:03:16.735 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T17:03:17.063 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webob. 2024-09-13T17:03:17.079 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T17:03:17.121 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T17:03:17.474 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T17:03:17.491 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T17:03:17.532 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T17:03:17.843 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T17:03:17.859 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T17:03:17.934 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T17:03:18.304 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T17:03:18.323 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T17:03:18.365 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T17:03:18.715 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T17:03:18.731 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T17:03:18.773 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T17:03:19.106 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-paste. 2024-09-13T17:03:19.129 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T17:03:19.189 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T17:03:19.459 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-base. 2024-09-13T17:03:19.476 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../027-ceph-base_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:19.527 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:19.543 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T17:03:19.561 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T17:03:19.601 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T17:03:19.937 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T17:03:19.954 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T17:03:19.995 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T17:03:20.771 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T17:03:20.788 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T17:03:20.829 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T17:03:21.157 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T17:03:21.174 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T17:03:21.176 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T17:03:21.190 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T17:03:21.215 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T17:03:21.232 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T17:03:21.509 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T17:03:21.526 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T17:03:21.535 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T17:03:21.554 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T17:03:21.567 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T17:03:21.585 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T17:03:21.863 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T17:03:21.880 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T17:03:21.921 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T17:03:21.939 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T17:03:21.955 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T17:03:21.997 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T17:03:22.241 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-mako. 2024-09-13T17:03:22.256 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T17:03:22.299 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T17:03:22.309 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T17:03:22.324 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:22.392 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:22.619 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T17:03:22.636 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T17:03:22.677 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:03:22.792 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T17:03:22.811 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:22.850 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:22.971 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T17:03:22.987 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T17:03:23.021 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T17:03:23.222 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T17:03:23.238 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T17:03:23.290 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-webob. 2024-09-13T17:03:23.307 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T17:03:23.313 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T17:03:23.348 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T17:03:23.656 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T17:03:23.676 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T17:03:23.710 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T17:03:23.714 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T17:03:23.725 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T17:03:23.768 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T17:03:24.054 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T17:03:24.069 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T17:03:24.110 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T17:03:24.127 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T17:03:24.137 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T17:03:24.168 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T17:03:24.524 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T17:03:24.540 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T17:03:24.562 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T17:03:24.579 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../051-ceph-mgr_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:24.585 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T17:03:24.620 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:24.926 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T17:03:24.944 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T17:03:24.984 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T17:03:25.174 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T17:03:25.190 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../052-ceph-mon_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:25.232 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:25.271 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-paste. 2024-09-13T17:03:25.290 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T17:03:25.329 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T17:03:25.649 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T17:03:25.667 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T17:03:25.707 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T17:03:26.014 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T17:03:26.034 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T17:03:26.088 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T17:03:26.236 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T17:03:26.254 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../053-ceph-osd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:26.294 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:26.401 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T17:03:26.417 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T17:03:26.459 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T17:03:26.795 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T17:03:26.812 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T17:03:26.853 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T17:03:27.191 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T17:03:27.210 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T17:03:27.258 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T17:03:27.569 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T17:03:27.585 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:27.627 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:28.049 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T17:03:28.067 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:28.107 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:28.443 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T17:03:28.460 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T17:03:28.480 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph. 2024-09-13T17:03:28.498 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../054-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:28.501 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T17:03:28.538 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:28.806 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T17:03:28.824 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T17:03:28.865 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T17:03:28.891 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T17:03:28.907 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../055-ceph-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:28.940 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:29.245 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T17:03:29.261 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T17:03:29.336 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T17:03:29.394 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T17:03:29.411 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../056-ceph-mds_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:29.452 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:29.662 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T17:03:29.682 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../051-ceph-mgr_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:29.720 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:30.005 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephadm. 2024-09-13T17:03:30.021 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../057-cephadm_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:30.063 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:30.224 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T17:03:30.240 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../052-ceph-mon_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:30.281 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:30.407 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T17:03:30.423 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T17:03:30.490 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T17:03:30.885 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T17:03:30.902 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T17:03:30.943 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T17:03:31.202 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T17:03:31.220 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../053-ceph-osd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:31.293 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:31.321 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T17:03:31.341 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:31.388 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:31.791 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T17:03:31.809 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T17:03:31.849 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T17:03:32.160 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-attr. 2024-09-13T17:03:32.178 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-09-13T17:03:32.218 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T17:03:32.571 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T17:03:32.587 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T17:03:32.648 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T17:03:32.992 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-py. 2024-09-13T17:03:33.007 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T17:03:33.050 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T17:03:33.420 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T17:03:33.435 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T17:03:33.455 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph. 2024-09-13T17:03:33.472 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../054-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:33.477 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T17:03:33.513 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:33.783 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T17:03:33.798 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../055-ceph-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:33.806 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T17:03:33.823 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-09-13T17:03:33.841 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:33.863 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T17:03:34.166 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T17:03:34.185 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T17:03:34.236 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T17:03:34.241 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T17:03:34.255 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../056-ceph-mds_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:34.293 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:34.603 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T17:03:34.622 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T17:03:34.661 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T17:03:34.947 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T17:03:34.963 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T17:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T17:03:35.214 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephadm. 2024-09-13T17:03:35.232 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../057-cephadm_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:35.271 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:35.307 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T17:03:35.323 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T17:03:35.365 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T17:03:35.566 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T17:03:35.584 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T17:03:35.624 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T17:03:35.735 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-routes. 2024-09-13T17:03:35.751 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-09-13T17:03:35.818 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T17:03:35.986 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T17:03:36.001 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T17:03:36.044 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T17:03:36.146 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T17:03:36.165 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:36.204 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:36.355 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T17:03:36.371 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:36.413 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:36.775 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T17:03:36.792 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T17:03:36.841 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T17:03:37.186 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-attr. 2024-09-13T17:03:37.204 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-09-13T17:03:37.244 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T17:03:37.572 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T17:03:37.588 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T17:03:37.629 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T17:03:37.851 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T17:03:37.870 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T17:03:37.909 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T17:03:37.966 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-py. 2024-09-13T17:03:37.981 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T17:03:38.024 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T17:03:38.237 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T17:03:38.252 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T17:03:38.295 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T17:03:38.352 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T17:03:38.368 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T17:03:38.410 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T17:03:38.631 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T17:03:38.647 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T17:03:38.689 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T17:03:38.729 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T17:03:38.745 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-09-13T17:03:38.788 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T17:03:39.125 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T17:03:39.143 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T17:03:39.183 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T17:03:39.545 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T17:03:39.561 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T17:03:39.603 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T17:03:39.872 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T17:03:39.888 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T17:03:39.930 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T17:03:40.048 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T17:03:40.065 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T17:03:40.106 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T17:03:40.191 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T17:03:40.210 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T17:03:40.249 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T17:03:40.602 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-routes. 2024-09-13T17:03:40.622 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-09-13T17:03:40.660 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T17:03:40.693 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T17:03:40.709 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T17:03:40.768 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T17:03:40.971 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T17:03:40.990 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:41.154 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T17:03:41.171 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T17:03:41.237 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T17:03:41.996 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T17:03:42.012 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:42.054 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:42.428 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T17:03:42.444 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T17:03:42.486 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T17:03:42.788 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T17:03:42.805 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T17:03:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T17:03:43.174 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T17:03:43.190 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T17:03:43.194 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T17:03:43.207 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T17:03:43.240 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T17:03:43.251 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T17:03:43.682 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T17:03:43.699 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T17:03:43.740 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T17:03:44.078 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T17:03:44.097 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T17:03:44.136 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T17:03:44.481 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T17:03:44.501 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-09-13T17:03:44.556 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T17:03:44.616 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T17:03:44.635 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T17:03:44.674 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T17:03:44.901 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T17:03:44.919 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T17:03:44.959 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T17:03:45.211 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T17:03:45.230 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T17:03:45.269 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T17:03:45.304 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T17:03:45.320 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T17:03:45.362 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T17:03:45.656 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T17:03:45.675 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T17:03:45.694 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T17:03:45.711 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T17:03:45.713 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T17:03:45.777 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T17:03:46.131 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T17:03:46.147 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T17:03:46.189 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T17:03:46.423 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T17:03:46.442 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:46.480 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:46.533 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T17:03:46.550 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T17:03:46.591 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T17:03:46.956 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T17:03:46.975 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T17:03:47.021 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T17:03:47.608 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T17:03:47.617 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T17:03:47.625 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T17:03:47.637 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:47.658 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T17:03:47.675 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:48.020 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T17:03:48.030 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T17:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T17:03:48.050 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T17:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T17:03:48.088 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T17:03:48.436 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T17:03:48.453 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T17:03:48.465 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T17:03:48.485 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:03:48.486 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T17:03:48.548 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:03:48.799 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T17:03:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package jq. 2024-09-13T17:03:48.816 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-09-13T17:03:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:03:48.857 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T17:03:48.884 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:03:49.161 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package socat. 2024-09-13T17:03:49.179 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T17:03:49.202 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T17:03:49.218 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T17:03:49.219 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T17:03:49.260 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T17:03:49.548 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T17:03:49.567 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T17:03:49.605 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T17:03:49.614 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T17:03:49.621 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T17:03:49.663 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T17:03:49.966 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T17:03:49.982 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T17:03:49.993 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-test. 2024-09-13T17:03:50.011 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../096-ceph-test_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:50.024 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T17:03:50.085 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:50.387 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T17:03:50.405 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T17:03:50.445 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T17:03:50.756 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T17:03:50.773 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T17:03:50.814 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T17:03:51.163 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T17:03:51.180 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T17:03:51.220 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T17:03:51.785 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T17:03:51.802 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:51.843 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:52.169 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T17:03:52.188 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T17:03:52.255 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T17:03:52.633 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T17:03:52.649 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:03:52.691 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:03:52.977 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package jq. 2024-09-13T17:03:52.993 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:03:53.026 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:03:53.280 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package socat. 2024-09-13T17:03:53.296 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T17:03:53.337 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T17:03:53.699 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T17:03:53.715 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T17:03:53.757 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T17:03:54.095 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-test. 2024-09-13T17:03:54.112 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../096-ceph-test_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:54.195 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:54.225 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T17:03:54.241 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:54.308 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:54.696 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T17:03:54.713 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:54.758 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:55.123 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T17:03:55.140 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-09-13T17:03:55.181 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-09-13T17:03:55.470 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T17:03:55.487 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../100-cephfs-shell_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:55.545 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:55.839 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T17:03:55.856 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../101-cephfs-top_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:55.897 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:56.175 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T17:03:56.193 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T17:03:56.233 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:03:56.814 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T17:03:56.830 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:56.871 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T17:03:57.318 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T17:03:57.384 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T17:03:57.721 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T17:03:57.740 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T17:03:57.770 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T17:03:58.190 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T17:03:58.210 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T17:03:58.223 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T17:03:58.243 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:58.281 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:58.281 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:03:58.652 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T17:03:58.669 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:03:58.710 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:59.072 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T17:03:59.089 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-09-13T17:03:59.130 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-09-13T17:03:59.393 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T17:03:59.411 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../100-cephfs-shell_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:59.476 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:59.721 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T17:03:59.737 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../101-cephfs-top_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T17:03:59.779 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:03:59.997 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T17:04:00.015 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T17:04:00.031 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T17:04:00.051 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T17:04:00.055 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T17:04:00.089 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:04:00.408 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T17:04:00.427 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T17:04:00.466 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T17:04:00.605 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T17:04:00.623 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:04:00.662 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:00.828 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T17:04:00.847 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T17:04:00.885 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T17:04:01.074 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T17:04:01.090 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T17:04:01.149 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T17:04:01.230 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T17:04:01.250 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T17:04:01.288 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T17:04:01.487 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T17:04:01.506 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T17:04:01.547 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T17:04:01.786 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T17:04:01.804 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T17:04:01.860 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T17:04:01.917 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T17:04:01.935 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T17:04:01.974 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:04:02.197 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T17:04:02.215 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T17:04:02.255 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T17:04:02.617 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T17:04:02.638 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T17:04:02.675 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T17:04:03.003 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T17:04:03.020 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T17:04:03.061 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T17:04:03.357 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T17:04:03.373 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T17:04:03.414 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T17:04:03.508 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T17:04:03.529 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T17:04:03.565 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T17:04:03.902 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T17:04:03.923 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T17:04:03.977 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T17:04:04.168 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package radosgw. 2024-09-13T17:04:04.187 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../116-radosgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:04:04.226 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:04.307 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T17:04:04.325 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T17:04:04.365 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T17:04:04.735 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T17:04:04.752 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T17:04:04.793 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T17:04:05.255 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T17:04:05.273 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T17:04:05.312 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T17:04:05.580 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T17:04:05.597 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../117-rbd-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:04:05.671 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:05.991 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T17:04:06.191 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T17:04:06.209 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T17:04:06.249 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T17:04:06.284 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T17:04:06.402 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T17:04:06.561 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T17:04:06.577 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T17:04:06.594 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T17:04:06.635 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T17:04:06.763 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:06.957 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T17:04:06.976 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T17:04:07.007 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T17:04:07.235 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T17:04:07.253 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T17:04:07.284 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T17:04:07.648 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user cephadm....done 2024-09-13T17:04:07.845 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:04:07.955 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package radosgw. 2024-09-13T17:04:07.973 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../116-radosgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:04:07.996 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T17:04:08.038 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:08.540 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T17:04:08.841 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:04:08.967 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T17:04:09.135 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T17:04:09.426 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T17:04:09.444 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../117-rbd-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T17:04:09.462 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T17:04:09.484 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:09.788 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T17:04:09.847 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T17:04:10.057 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T17:04:10.132 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T17:04:10.183 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T17:04:10.309 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T17:04:10.416 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-09-13T17:04:10.494 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:10.701 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T17:04:10.986 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T17:04:11.020 INFO:teuthology.orchestra.run.smithi123.stdout:Adding system user cephadm....done 2024-09-13T17:04:11.183 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:04:11.287 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:11.334 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T17:04:11.596 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T17:04:11.685 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T17:04:11.747 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-09-13T17:04:11.978 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T17:04:12.068 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T17:04:12.104 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T17:04:12.230 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T17:04:12.573 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T17:04:12.732 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T17:04:13.001 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T17:04:13.025 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T17:04:13.159 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T17:04:13.293 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T17:04:13.586 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T17:04:13.587 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-09-13T17:04:13.879 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T17:04:13.904 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T17:04:14.138 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T17:04:14.194 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T17:04:14.414 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:14.556 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T17:04:14.749 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T17:04:14.840 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T17:04:14.875 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-09-13T17:04:15.174 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T17:04:15.201 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T17:04:15.459 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T17:04:15.485 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T17:04:15.752 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T17:04:15.770 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T17:04:15.878 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T17:04:15.904 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T17:04:16.029 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T17:04:16.255 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T17:04:16.338 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T17:04:16.548 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T17:04:16.748 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-09-13T17:04:16.824 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T17:04:17.058 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T17:04:17.167 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T17:04:17.434 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T17:04:17.452 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T17:04:17.786 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T17:04:17.844 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T17:04:17.970 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:18.087 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T17:04:18.297 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:04:18.388 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T17:04:18.448 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T17:04:18.489 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T17:04:18.615 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T17:04:18.799 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T17:04:18.900 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T17:04:18.926 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T17:04:19.084 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T17:04:19.293 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-09-13T17:04:19.386 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T17:04:19.585 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T17:04:19.720 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:04:19.838 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T17:04:19.987 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T17:04:19.988 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T17:04:20.324 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T17:04:20.372 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T17:04:20.497 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:20.633 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T17:04:20.832 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:04:20.943 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T17:04:20.967 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T17:04:21.069 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:04:21.334 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T17:04:21.370 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T17:04:21.485 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T17:04:21.611 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T17:04:21.679 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T17:04:21.921 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T17:04:21.997 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T17:04:22.239 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:04:22.390 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T17:04:22.417 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T17:04:22.507 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T17:04:22.707 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T17:04:22.826 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T17:04:22.834 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T17:04:23.110 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T17:04:23.160 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T17:04:23.403 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T17:04:23.528 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T17:04:23.529 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:04:23.671 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T17:04:23.788 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T17:04:23.830 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T17:04:24.115 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T17:04:24.131 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T17:04:24.424 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T17:04:24.441 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T17:04:24.850 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T17:04:25.084 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T17:04:25.210 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T17:04:25.528 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T17:04:25.913 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T17:04:25.955 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:04:26.039 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T17:04:26.106 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T17:04:26.173 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T17:04:26.499 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T17:04:26.524 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T17:04:26.808 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T17:04:26.816 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T17:04:27.135 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:04:27.285 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T17:04:27.645 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T17:04:28.005 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T17:04:28.289 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:04:28.390 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T17:04:28.423 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T17:04:28.783 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T17:04:28.799 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T17:04:29.117 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T17:04:29.418 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T17:04:29.569 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T17:04:29.847 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T17:04:29.903 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T17:04:30.006 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T17:04:30.132 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:04:30.222 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T17:04:30.258 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T17:04:30.617 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T17:04:30.631 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T17:04:30.743 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T17:04:30.966 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T17:04:31.045 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T17:04:31.346 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T17:04:31.672 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T17:04:32.032 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:32.046 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T17:04:32.172 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T17:04:32.277 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T17:04:32.290 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T17:04:32.416 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T17:04:32.428 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:32.554 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:32.664 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:32.709 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T17:04:32.834 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T17:04:32.840 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T17:04:33.133 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:33.136 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T17:04:33.259 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T17:04:33.429 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T17:04:33.594 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:33.738 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T17:04:33.753 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:33.879 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:34.082 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:34.120 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:04:34.120 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:04:34.293 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T17:04:34.419 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:34.537 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:34.606 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:34.679 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:34.732 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:34.805 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T17:04:34.849 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:34.984 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T17:04:35.115 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:35.266 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T17:04:35.568 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:35.694 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:35.820 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:35.879 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:36.005 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:36.065 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:04:36.065 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:04:36.156 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:36.282 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:36.383 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:36.518 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:36.545 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:36.655 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:36.904 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:37.121 INFO:teuthology.orchestra.run.smithi153.stdout:Adding group ceph....done 2024-09-13T17:04:37.291 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T17:04:37.505 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user ceph....done 2024-09-13T17:04:37.701 INFO:teuthology.orchestra.run.smithi153.stdout:Setting system user ceph properties....done 2024-09-13T17:04:37.725 INFO:teuthology.orchestra.run.smithi153.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T17:04:37.880 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T17:04:38.195 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:38.198 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T17:04:38.321 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:38.438 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:38.589 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:38.662 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:38.724 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:38.849 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:38.889 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:04:38.890 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:04:39.354 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:39.385 INFO:teuthology.orchestra.run.smithi123.stdout:Adding group ceph....done 2024-09-13T17:04:39.499 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:39.737 INFO:teuthology.orchestra.run.smithi123.stdout:Adding system user ceph....done 2024-09-13T17:04:39.905 INFO:teuthology.orchestra.run.smithi123.stdout:Setting system user ceph properties....done 2024-09-13T17:04:39.926 INFO:teuthology.orchestra.run.smithi123.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T17:04:39.983 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:04:39.983 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:04:40.075 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T17:04:40.405 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T17:04:40.457 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:40.851 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:40.858 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T17:04:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:04:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:04:41.317 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:41.527 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:41.588 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:04:41.588 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:04:41.636 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:42.036 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:42.133 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:04:42.133 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:04:42.266 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:04:42.266 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:04:42.588 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:42.712 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:42.985 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T17:04:43.237 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:04:43.237 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:04:43.432 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:43.657 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:04:43.657 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:04:43.698 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:43.849 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:44.000 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:44.117 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:44.247 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:04:44.247 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:04:44.348 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:04:44.348 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:04:44.735 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:44.785 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:44.869 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:45.029 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:45.171 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:04:45.298 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:04:45.533 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T17:04:45.711 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T17:04:45.761 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:45.903 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:46.004 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T17:04:46.046 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:46.263 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:04:46.263 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:04:46.706 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:46.844 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:46.950 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:47.076 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T17:04:47.430 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T17:04:47.606 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T17:04:47.899 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T17:04:48.858 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T17:04:49.474 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:04:49.477 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T17:04:49.554 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-13T17:04:49.773 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-13T17:04:49.774 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-13T17:04:49.999 INFO:teuthology.orchestra.run.smithi153.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-09-13T17:04:49.999 INFO:teuthology.orchestra.run.smithi153.stdout:flex is already the newest version (2.6.4-6.2). 2024-09-13T17:04:49.999 INFO:teuthology.orchestra.run.smithi153.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-09-13T17:04:49.999 INFO:teuthology.orchestra.run.smithi153.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-09-13T17:04:49.999 INFO:teuthology.orchestra.run.smithi153.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-09-13T17:04:49.999 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:04:50.000 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T17:04:50.000 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:04:50.000 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-13T17:04:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-09-13T17:04:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-09-13T17:04:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-09-13T17:04:50.001 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-09-13T17:04:50.002 INFO:teuthology.orchestra.run.smithi153.stdout: usb-modeswitch-data wpasupplicant 2024-09-13T17:04:50.003 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-13T17:04:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-09-13T17:04:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-09-13T17:04:50.003 INFO:teuthology.orchestra.run.smithi153.stdout: libengine-pkcs11-openssl 2024-09-13T17:04:50.072 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-13T17:04:50.072 INFO:teuthology.orchestra.run.smithi153.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-09-13T17:04:50.073 INFO:teuthology.orchestra.run.smithi153.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-09-13T17:04:50.073 INFO:teuthology.orchestra.run.smithi153.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-09-13T17:04:50.073 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-09-13T17:04:50.073 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-09-13T17:04:50.073 INFO:teuthology.orchestra.run.smithi153.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T17:04:50.074 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-09-13T17:04:50.074 INFO:teuthology.orchestra.run.smithi153.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-09-13T17:04:50.131 INFO:teuthology.orchestra.run.smithi153.stdout:6 upgraded, 31 newly installed, 0 to remove and 289 not upgraded. 2024-09-13T17:04:50.131 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 25.4 MB of archives. 2024-09-13T17:04:50.131 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 80.0 MB of additional disk space will be used. 2024-09-13T17:04:50.131 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-09-13T17:04:50.267 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-09-13T17:04:50.269 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-09-13T17:04:50.270 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-09-13T17:04:50.276 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-09-13T17:04:50.277 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-09-13T17:04:50.294 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-09-13T17:04:50.294 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-09-13T17:04:50.295 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-09-13T17:04:50.297 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-09-13T17:04:50.297 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-09-13T17:04:50.301 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-09-13T17:04:50.302 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-09-13T17:04:50.304 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-09-13T17:04:50.304 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-09-13T17:04:50.318 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-09-13T17:04:50.319 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-09-13T17:04:50.324 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.20-0ubuntu0.20.04.1 [117 kB] 2024-09-13T17:04:50.326 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-09-13T17:04:50.335 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-09-13T17:04:50.335 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-09-13T17:04:50.348 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-09-13T17:04:50.348 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-09-13T17:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-09-13T17:04:50.366 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-09-13T17:04:50.382 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-09-13T17:04:50.384 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-09-13T17:04:50.385 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-09-13T17:04:50.385 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-09-13T17:04:50.386 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.20-0ubuntu0.20.04.1 [1,055 kB] 2024-09-13T17:04:50.394 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-09-13T17:04:50.396 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.20-0ubuntu0.20.04.1 [13.5 MB] 2024-09-13T17:04:50.505 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-09-13T17:04:50.505 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-09-13T17:04:50.583 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-09-13T17:04:50.584 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-09-13T17:04:50.584 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-09-13T17:04:50.793 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T17:04:51.003 INFO:teuthology.orchestra.run.smithi153.stdout:Preconfiguring packages ... 2024-09-13T17:04:51.200 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 25.4 MB in 1s (50.5 MB/s) 2024-09-13T17:04:51.354 INFO:teuthology.orchestra.run.smithi123.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:04:51.356 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T17:04:51.433 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-09-13T17:04:51.511 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T17:04:51.516 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T17:04:51.653 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2024-09-13T17:04:51.653 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2024-09-13T17:04:51.669 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T17:04:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-09-13T17:04:51.880 INFO:teuthology.orchestra.run.smithi123.stdout:flex is already the newest version (2.6.4-6.2). 2024-09-13T17:04:51.881 INFO:teuthology.orchestra.run.smithi123.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-09-13T17:04:51.881 INFO:teuthology.orchestra.run.smithi123.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-09-13T17:04:51.881 INFO:teuthology.orchestra.run.smithi123.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-09-13T17:04:51.881 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:04:51.881 INFO:teuthology.orchestra.run.smithi123.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T17:04:51.881 INFO:teuthology.orchestra.run.smithi123.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:04:51.882 INFO:teuthology.orchestra.run.smithi123.stdout:The following additional packages will be installed: 2024-09-13T17:04:51.882 INFO:teuthology.orchestra.run.smithi123.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-09-13T17:04:51.882 INFO:teuthology.orchestra.run.smithi123.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-09-13T17:04:51.883 INFO:teuthology.orchestra.run.smithi123.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-09-13T17:04:51.883 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-09-13T17:04:51.883 INFO:teuthology.orchestra.run.smithi123.stdout: usb-modeswitch-data wpasupplicant 2024-09-13T17:04:51.884 INFO:teuthology.orchestra.run.smithi123.stdout:Suggested packages: 2024-09-13T17:04:51.884 INFO:teuthology.orchestra.run.smithi123.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-09-13T17:04:51.884 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-09-13T17:04:51.884 INFO:teuthology.orchestra.run.smithi123.stdout: libengine-pkcs11-openssl 2024-09-13T17:04:51.948 INFO:teuthology.orchestra.run.smithi123.stdout:The following NEW packages will be installed: 2024-09-13T17:04:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-09-13T17:04:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-09-13T17:04:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-09-13T17:04:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-09-13T17:04:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-09-13T17:04:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T17:04:51.951 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages will be upgraded: 2024-09-13T17:04:51.952 INFO:teuthology.orchestra.run.smithi123.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-09-13T17:04:52.138 INFO:teuthology.orchestra.run.smithi123.stdout:6 upgraded, 31 newly installed, 0 to remove and 289 not upgraded. 2024-09-13T17:04:52.138 INFO:teuthology.orchestra.run.smithi123.stdout:Need to get 25.4 MB of archives. 2024-09-13T17:04:52.138 INFO:teuthology.orchestra.run.smithi123.stdout:After this operation, 80.0 MB of additional disk space will be used. 2024-09-13T17:04:52.138 INFO:teuthology.orchestra.run.smithi123.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-09-13T17:04:52.757 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-09-13T17:04:52.759 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-09-13T17:04:52.760 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-09-13T17:04:52.773 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-09-13T17:04:52.775 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-09-13T17:04:52.859 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-09-13T17:04:52.872 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-09-13T17:04:52.875 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-09-13T17:04:52.885 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-09-13T17:04:52.887 INFO:teuthology.orchestra.run.smithi123.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-09-13T17:04:52.887 INFO:teuthology.orchestra.run.smithi123.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-09-13T17:04:52.921 INFO:teuthology.orchestra.run.smithi123.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-09-13T17:04:52.922 INFO:teuthology.orchestra.run.smithi123.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-09-13T17:04:52.925 INFO:teuthology.orchestra.run.smithi123.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-09-13T17:04:52.926 INFO:teuthology.orchestra.run.smithi123.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-09-13T17:04:53.002 INFO:teuthology.orchestra.run.smithi123.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-09-13T17:04:53.003 INFO:teuthology.orchestra.run.smithi123.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-09-13T17:04:53.012 INFO:teuthology.orchestra.run.smithi123.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.20-0ubuntu0.20.04.1 [117 kB] 2024-09-13T17:04:53.015 INFO:teuthology.orchestra.run.smithi123.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-09-13T17:04:53.031 INFO:teuthology.orchestra.run.smithi123.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-09-13T17:04:53.031 INFO:teuthology.orchestra.run.smithi123.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-09-13T17:04:53.084 INFO:teuthology.orchestra.run.smithi123.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-09-13T17:04:53.084 INFO:teuthology.orchestra.run.smithi123.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-09-13T17:04:53.106 INFO:teuthology.orchestra.run.smithi123.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-09-13T17:04:53.135 INFO:teuthology.orchestra.run.smithi123.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-09-13T17:04:53.192 INFO:teuthology.orchestra.run.smithi123.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-09-13T17:04:53.203 INFO:teuthology.orchestra.run.smithi123.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-09-13T17:04:53.204 INFO:teuthology.orchestra.run.smithi123.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-09-13T17:04:53.205 INFO:teuthology.orchestra.run.smithi123.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-09-13T17:04:53.205 INFO:teuthology.orchestra.run.smithi123.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.20-0ubuntu0.20.04.1 [1,055 kB] 2024-09-13T17:04:53.229 INFO:teuthology.orchestra.run.smithi123.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-09-13T17:04:53.248 INFO:teuthology.orchestra.run.smithi123.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.20-0ubuntu0.20.04.1 [13.5 MB] 2024-09-13T17:04:53.679 INFO:teuthology.orchestra.run.smithi123.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-09-13T17:04:53.679 INFO:teuthology.orchestra.run.smithi123.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-09-13T17:04:53.679 INFO:teuthology.orchestra.run.smithi123.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-09-13T17:04:53.680 INFO:teuthology.orchestra.run.smithi123.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-09-13T17:04:53.680 INFO:teuthology.orchestra.run.smithi123.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-09-13T17:04:54.089 INFO:teuthology.orchestra.run.smithi123.stdout:Preconfiguring packages ... 2024-09-13T17:04:54.275 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 25.4 MB in 2s (14.7 MB/s) 2024-09-13T17:04:54.328 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T17:04:54.333 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T17:04:54.480 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T17:04:54.545 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T17:04:54.550 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T17:04:54.703 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T17:04:54.921 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T17:04:55.087 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T17:04:55.464 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T17:04:55.824 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-09-13T17:04:55.876 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T17:04:55.881 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T17:04:56.037 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T17:04:56.503 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T17:04:56.666 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T17:04:57.121 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T17:04:57.213 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T17:04:57.218 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T17:04:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-09-13T17:04:57.333 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T17:04:57.858 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T17:04:57.878 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-09-13T17:04:57.916 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-09-13T17:04:58.275 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T17:04:58.302 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package dump. 2024-09-13T17:04:58.322 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-09-13T17:04:58.360 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking dump (0.4b46-6) ... 2024-09-13T17:04:58.424 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T17:04:58.724 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T17:04:58.747 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package indent. 2024-09-13T17:04:58.767 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:04:59.035 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T17:04:59.185 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T17:04:59.189 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T17:04:59.323 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T17:04:59.728 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T17:04:59.861 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T17:05:00.270 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T17:05:00.286 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-09-13T17:05:00.328 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T17:05:00.333 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T17:05:00.482 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-09-13T17:05:00.656 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T17:05:00.675 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-09-13T17:05:00.714 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T17:05:00.978 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T17:05:00.999 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-09-13T17:05:01.017 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T17:05:01.035 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T17:05:01.036 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-09-13T17:05:01.075 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:05:01.397 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package dump. 2024-09-13T17:05:01.417 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-09-13T17:05:01.455 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking dump (0.4b46-6) ... 2024-09-13T17:05:01.461 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T17:05:01.478 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:05:01.519 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:05:01.784 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package indent. 2024-09-13T17:05:01.802 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:05:01.814 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T17:05:01.832 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:05:01.842 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T17:05:01.872 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:05:02.162 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T17:05:02.179 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-09-13T17:05:02.220 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T17:05:02.258 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T17:05:02.275 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:05:02.316 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:05:02.582 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T17:05:02.602 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-09-13T17:05:02.640 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T17:05:02.711 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T17:05:02.728 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-09-13T17:05:02.769 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T17:05:02.876 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T17:05:02.894 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T17:05:02.926 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:05:03.105 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T17:05:03.124 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T17:05:03.180 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T17:05:03.279 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T17:05:03.296 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:05:03.337 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:05:03.541 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T17:05:03.558 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../14-libpq5_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:05:03.599 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:05:04.002 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T17:05:04.022 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:05:04.094 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:05:04.175 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T17:05:04.192 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:05:04.233 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:05:04.446 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T17:05:04.464 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:05:04.505 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:05:04.527 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T17:05:04.544 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:05:04.577 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:05:04.740 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T17:05:04.759 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T17:05:04.790 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T17:05:04.953 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T17:05:04.971 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-09-13T17:05:05.013 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T17:05:05.310 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T17:05:05.326 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T17:05:05.360 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T17:05:05.432 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T17:05:05.449 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-09-13T17:05:05.704 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T17:05:05.723 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../14-libpq5_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:05:05.736 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-09-13T17:05:05.762 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:05:06.064 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package modemmanager. 2024-09-13T17:05:06.083 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:05:06.124 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T17:05:06.141 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:05:06.166 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:05:06.181 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:05:06.526 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T17:05:06.543 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:05:06.584 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:05:06.796 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T17:05:06.812 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T17:05:06.815 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T17:05:06.828 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-09-13T17:05:06.845 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T17:05:06.869 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T17:05:07.332 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T17:05:07.351 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-09-13T17:05:07.390 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-09-13T17:05:07.458 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package network-manager. 2024-09-13T17:05:07.479 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T17:05:07.541 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T17:05:07.726 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package modemmanager. 2024-09-13T17:05:07.743 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:05:07.787 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:05:08.256 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ppp. 2024-09-13T17:05:08.273 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-09-13T17:05:08.432 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T17:05:08.452 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-09-13T17:05:08.490 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T17:05:08.538 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T17:05:08.861 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T17:05:08.878 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-09-13T17:05:08.911 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-09-13T17:05:09.050 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package network-manager. 2024-09-13T17:05:09.071 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T17:05:09.298 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T17:05:09.316 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-09-13T17:05:09.377 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-09-13T17:05:09.387 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T17:05:09.701 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T17:05:09.719 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-09-13T17:05:09.750 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-09-13T17:05:10.072 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-client-12. 2024-09-13T17:05:10.091 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../26-postgresql-client-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:05:10.129 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:05:10.329 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ppp. 2024-09-13T17:05:10.348 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-09-13T17:05:10.617 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T17:05:10.992 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T17:05:11.012 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-09-13T17:05:11.051 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-09-13T17:05:11.137 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T17:05:11.158 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-09-13T17:05:11.427 INFO:teuthology.orchestra.run.smithi153.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T17:05:11.429 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T17:05:11.448 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-09-13T17:05:11.505 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-09-13T17:05:11.545 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-09-13T17:05:11.807 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T17:05:11.825 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-09-13T17:05:11.865 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-09-13T17:05:12.176 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-12. 2024-09-13T17:05:12.178 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-client-12. 2024-09-13T17:05:12.193 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../28-postgresql-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:05:12.198 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../26-postgresql-client-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:05:12.236 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:05:12.237 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:05:12.849 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T17:05:12.865 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-09-13T17:05:12.931 INFO:teuthology.orchestra.run.smithi123.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T17:05:12.958 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-09-13T17:05:13.464 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-12. 2024-09-13T17:05:13.481 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../28-postgresql-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T17:05:13.525 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:05:13.970 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql. 2024-09-13T17:05:13.988 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-09-13T17:05:14.028 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-09-13T17:05:14.305 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T17:05:14.325 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-09-13T17:05:14.363 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-09-13T17:05:14.624 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T17:05:14.643 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-09-13T17:05:14.682 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T17:05:14.951 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T17:05:14.968 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-09-13T17:05:15.009 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-09-13T17:05:15.366 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql. 2024-09-13T17:05:15.385 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-09-13T17:05:15.433 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-09-13T17:05:15.462 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T17:05:15.480 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-09-13T17:05:15.531 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T17:05:15.660 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T17:05:15.680 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-09-13T17:05:15.718 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-09-13T17:05:15.843 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-09-13T17:05:15.995 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T17:05:16.013 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-09-13T17:05:16.051 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T17:05:16.053 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T17:05:16.281 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T17:05:16.297 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-09-13T17:05:16.339 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-09-13T17:05:16.400 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:05:16.503 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-09-13T17:05:16.638 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T17:05:16.742 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T17:05:16.759 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-09-13T17:05:16.797 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T17:05:16.813 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T17:05:17.112 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-09-13T17:05:17.347 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T17:05:17.641 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:05:17.758 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-09-13T17:05:17.813 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:05:17.813 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:05:17.884 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T17:05:17.985 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T17:05:18.334 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:05:18.374 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:05:18.374 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:05:18.857 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:05:19.212 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T17:05:19.322 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T17:05:19.448 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-09-13T17:05:19.607 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-09-13T17:05:19.755 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T17:05:19.869 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T17:05:19.995 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-09-13T17:05:20.263 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-09-13T17:05:20.696 INFO:teuthology.orchestra.run.smithi153.stdout:Adding user postgres to group ssl-cert 2024-09-13T17:05:20.981 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:20.981 INFO:teuthology.orchestra.run.smithi153.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T17:05:21.250 INFO:teuthology.orchestra.run.smithi153.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T17:05:21.250 INFO:teuthology.orchestra.run.smithi153.stdout:Removing obsolete dictionary files: 2024-09-13T17:05:21.267 INFO:teuthology.orchestra.run.smithi123.stdout:Adding user postgres to group ssl-cert 2024-09-13T17:05:21.526 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:21.526 INFO:teuthology.orchestra.run.smithi123.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T17:05:21.577 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T17:05:21.765 INFO:teuthology.orchestra.run.smithi123.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T17:05:21.765 INFO:teuthology.orchestra.run.smithi123.stdout:Removing obsolete dictionary files: 2024-09-13T17:05:22.089 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T17:05:22.376 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T17:05:22.501 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-09-13T17:05:22.653 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T17:05:22.848 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T17:05:22.965 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-09-13T17:05:23.125 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T17:05:23.216 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T17:05:23.251 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T17:05:24.214 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-09-13T17:05:24.238 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-09-13T17:05:24.473 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up dump (0.4b46-6) ... 2024-09-13T17:05:24.484 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up dump (0.4b46-6) ... 2024-09-13T17:05:24.570 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T17:05:24.581 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T17:05:24.633 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:05:24.644 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:05:24.767 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T17:05:24.795 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T17:05:24.893 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T17:05:24.921 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T17:05:25.036 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T17:05:25.038 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T17:05:25.240 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T17:05:25.366 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:05:25.589 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T17:05:25.722 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T17:05:25.789 INFO:teuthology.orchestra.run.smithi153.stdout:Creating new PostgreSQL cluster 12/main ... 2024-09-13T17:05:25.805 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-09-13T17:05:25.861 INFO:teuthology.orchestra.run.smithi153.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T17:05:25.861 INFO:teuthology.orchestra.run.smithi153.stdout:This user must also own the server process. 2024-09-13T17:05:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:25.861 INFO:teuthology.orchestra.run.smithi153.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T17:05:25.861 INFO:teuthology.orchestra.run.smithi153.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T17:05:25.861 INFO:teuthology.orchestra.run.smithi153.stdout:The default text search configuration will be set to "english". 2024-09-13T17:05:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:25.862 INFO:teuthology.orchestra.run.smithi153.stdout:Data page checksums are disabled. 2024-09-13T17:05:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:25.862 INFO:teuthology.orchestra.run.smithi153.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-09-13T17:05:25.862 INFO:teuthology.orchestra.run.smithi153.stdout:creating subdirectories ... ok 2024-09-13T17:05:25.862 INFO:teuthology.orchestra.run.smithi153.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T17:05:25.877 INFO:teuthology.orchestra.run.smithi153.stdout:selecting default max_connections ... 100 2024-09-13T17:05:25.899 INFO:teuthology.orchestra.run.smithi153.stdout:selecting default shared_buffers ... 128MB 2024-09-13T17:05:25.905 INFO:teuthology.orchestra.run.smithi153.stdout:selecting default time zone ... Etc/UTC 2024-09-13T17:05:25.906 INFO:teuthology.orchestra.run.smithi153.stdout:creating configuration files ... ok 2024-09-13T17:05:26.009 INFO:teuthology.orchestra.run.smithi153.stdout:running bootstrap script ... ok 2024-09-13T17:05:26.095 INFO:teuthology.orchestra.run.smithi123.stdout:Creating new PostgreSQL cluster 12/main ... 2024-09-13T17:05:26.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-09-13T17:05:26.160 INFO:teuthology.orchestra.run.smithi123.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T17:05:26.161 INFO:teuthology.orchestra.run.smithi123.stdout:This user must also own the server process. 2024-09-13T17:05:26.161 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:26.161 INFO:teuthology.orchestra.run.smithi123.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T17:05:26.161 INFO:teuthology.orchestra.run.smithi123.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T17:05:26.161 INFO:teuthology.orchestra.run.smithi123.stdout:The default text search configuration will be set to "english". 2024-09-13T17:05:26.161 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:26.161 INFO:teuthology.orchestra.run.smithi123.stdout:Data page checksums are disabled. 2024-09-13T17:05:26.162 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:26.162 INFO:teuthology.orchestra.run.smithi123.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-09-13T17:05:26.162 INFO:teuthology.orchestra.run.smithi123.stdout:creating subdirectories ... ok 2024-09-13T17:05:26.162 INFO:teuthology.orchestra.run.smithi123.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T17:05:26.179 INFO:teuthology.orchestra.run.smithi123.stdout:selecting default max_connections ... 100 2024-09-13T17:05:26.204 INFO:teuthology.orchestra.run.smithi123.stdout:selecting default shared_buffers ... 128MB 2024-09-13T17:05:26.210 INFO:teuthology.orchestra.run.smithi123.stdout:selecting default time zone ... Etc/UTC 2024-09-13T17:05:26.211 INFO:teuthology.orchestra.run.smithi123.stdout:creating configuration files ... ok 2024-09-13T17:05:26.315 INFO:teuthology.orchestra.run.smithi123.stdout:running bootstrap script ... ok 2024-09-13T17:05:26.603 INFO:teuthology.orchestra.run.smithi153.stdout:performing post-bootstrap initialization ... ok 2024-09-13T17:05:26.831 INFO:teuthology.orchestra.run.smithi123.stdout:performing post-bootstrap initialization ... ok 2024-09-13T17:05:27.344 INFO:teuthology.orchestra.run.smithi153.stdout:syncing data to disk ... ok 2024-09-13T17:05:27.344 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:27.345 INFO:teuthology.orchestra.run.smithi153.stdout:Success. You can now start the database server using: 2024-09-13T17:05:27.345 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:27.345 INFO:teuthology.orchestra.run.smithi153.stdout: pg_ctlcluster 12 main start 2024-09-13T17:05:27.345 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:27.674 INFO:teuthology.orchestra.run.smithi153.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-09-13T17:05:27.674 INFO:teuthology.orchestra.run.smithi153.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-09-13T17:05:27.712 INFO:teuthology.orchestra.run.smithi123.stdout:syncing data to disk ... ok 2024-09-13T17:05:27.712 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:27.712 INFO:teuthology.orchestra.run.smithi123.stdout:Success. You can now start the database server using: 2024-09-13T17:05:27.712 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:27.712 INFO:teuthology.orchestra.run.smithi123.stdout: pg_ctlcluster 12 main start 2024-09-13T17:05:27.712 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:27.758 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T17:05:28.049 INFO:teuthology.orchestra.run.smithi123.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-09-13T17:05:28.049 INFO:teuthology.orchestra.run.smithi123.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-09-13T17:05:28.134 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T17:05:30.864 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:05:30.990 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:05:31.141 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-09-13T17:05:31.212 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:05:31.309 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:05:31.337 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:05:31.459 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-09-13T17:05:31.463 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-09-13T17:05:31.586 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T17:05:31.656 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:05:31.791 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-09-13T17:05:31.917 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T17:05:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:32.326 INFO:teuthology.orchestra.run.smithi153.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T17:05:32.326 INFO:teuthology.orchestra.run.smithi153.stdout:which means they are currently configured by ifupdown: 2024-09-13T17:05:32.326 INFO:teuthology.orchestra.run.smithi153.stdout:- enp3s0f1 2024-09-13T17:05:32.326 INFO:teuthology.orchestra.run.smithi153.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T17:05:32.326 INFO:teuthology.orchestra.run.smithi153.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T17:05:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:32.491 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T17:05:32.665 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:32.665 INFO:teuthology.orchestra.run.smithi123.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T17:05:32.666 INFO:teuthology.orchestra.run.smithi123.stdout:which means they are currently configured by ifupdown: 2024-09-13T17:05:32.666 INFO:teuthology.orchestra.run.smithi123.stdout:- enp3s0f1 2024-09-13T17:05:32.666 INFO:teuthology.orchestra.run.smithi123.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T17:05:32.666 INFO:teuthology.orchestra.run.smithi123.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T17:05:32.666 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:32.817 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T17:05:32.824 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T17:05:33.148 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T17:05:33.360 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T17:05:33.676 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T17:05:33.847 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:05:33.990 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-09-13T17:05:34.157 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:05:34.178 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T17:05:34.283 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T17:05:34.304 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-09-13T17:05:34.443 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-09-13T17:05:34.447 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T17:05:34.569 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:05:34.573 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T17:05:34.699 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-09-13T17:05:34.720 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:05:34.846 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:05:34.850 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:05:34.976 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T17:05:35.094 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T17:05:35.141 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:05:35.141 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:05:35.345 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:05:35.345 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:05:35.657 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-09-13T17:05:35.766 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T17:05:35.880 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-09-13T17:05:35.917 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T17:05:35.981 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T17:05:36.051 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T17:05:36.123 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T17:05:36.283 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T17:05:36.355 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T17:05:36.568 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T17:05:43.634 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-13T17:05:43.750 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-09-13T17:05:44.006 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-13T17:05:44.106 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-09-13T17:05:44.601 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:05:44.606 DEBUG:teuthology.parallel:result is None 2024-09-13T17:05:44.915 INFO:teuthology.orchestra.run.smithi123.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:05:44.920 DEBUG:teuthology.parallel:result is None 2024-09-13T17:05:44.920 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:05:45.101 DEBUG:teuthology.orchestra.run.smithi123:> dpkg-query -W -f '${Version}' ceph 2024-09-13T17:05:45.126 INFO:teuthology.orchestra.run.smithi123.stdout:18.2.4-860-g6c6b083f-1focal 2024-09-13T17:05:45.126 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1focal 2024-09-13T17:05:45.126 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1focal is installed. 2024-09-13T17:05:45.128 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:05:45.275 DEBUG:teuthology.orchestra.run.smithi153:> dpkg-query -W -f '${Version}' ceph 2024-09-13T17:05:45.298 INFO:teuthology.orchestra.run.smithi153.stdout:18.2.4-860-g6c6b083f-1focal 2024-09-13T17:05:45.298 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1focal 2024-09-13T17:05:45.299 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1focal is installed. 2024-09-13T17:05:45.300 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T17:05:45.301 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:05:45.301 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:05:45.318 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:05:45.318 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:05:45.333 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T17:05:45.333 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:05:45.333 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:05:45.376 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:05:45.385 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:05:45.385 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:05:45.401 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:05:45.415 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T17:05:45.415 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:05:45.415 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:05:45.428 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:05:45.487 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:05:45.487 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:05:45.501 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:05:45.515 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T17:05:45.515 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:05:45.515 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:05:45.531 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:05:45.587 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:05:45.587 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:05:45.604 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:05:45.664 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T17:05:45.740 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T17:05:45.740 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /var/log/ceph 2024-09-13T17:05:45.743 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-09-13T17:05:45.757 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T17:05:45.757 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T17:05:45.760 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T17:05:45.815 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T17:05:45.815 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T17:05:45.818 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T17:05:45.836 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T17:05:45.837 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T17:05:45.837 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T17:05:45.837 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:05:45.837 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T17:05:45.843 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T17:05:45.877 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:05:45.878 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T17:05:45.884 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T17:05:45.969 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T17:05:45.970 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T17:05:45.970 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903865', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/quota}', 'email': None, 'first_in_suite': False, 'job_id': '7903865', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi123.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_quota']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T17:05:45.970 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T17:05:45.973 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T17:05:45.980 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T17:05:45.982 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T17:05:45.998 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:05:45.998 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:05:46.005 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:05:46.005 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2024-09-13T17:05:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:05:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:46.055 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 368 Links: 1 2024-09-13T17:05:46.056 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:46.056 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-13 17:01:09.759831815 +0000 2024-09-13T17:05:46.056 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-13 17:01:09.755832131 +0000 2024-09-13T17:05:46.056 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-13 17:01:09.755832131 +0000 2024-09-13T17:05:46.056 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2024-09-13T17:05:46.056 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:05:46.069 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-13T17:05:46.069 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-13T17:05:46.069 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000426982 s, 1.2 MB/s 2024-09-13T17:05:46.070 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:05:46.081 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2024-09-13T17:05:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:05:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:46.131 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 377 Links: 1 2024-09-13T17:05:46.132 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:46.132 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-13 17:01:10.419780470 +0000 2024-09-13T17:05:46.132 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-13 17:01:10.199797421 +0000 2024-09-13T17:05:46.132 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-13 17:01:10.199797421 +0000 2024-09-13T17:05:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2024-09-13T17:05:46.132 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:05:46.147 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-13T17:05:46.147 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-13T17:05:46.147 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000406651 s, 1.3 MB/s 2024-09-13T17:05:46.149 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:05:46.157 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2024-09-13T17:05:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:05:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:46.208 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 382 Links: 1 2024-09-13T17:05:46.208 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:46.208 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-13 17:01:10.863746260 +0000 2024-09-13T17:05:46.208 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-13 17:01:10.651762595 +0000 2024-09-13T17:05:46.208 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-13 17:01:10.651762595 +0000 2024-09-13T17:05:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2024-09-13T17:05:46.208 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:05:46.220 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-13T17:05:46.220 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-13T17:05:46.220 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000425564 s, 1.2 MB/s 2024-09-13T17:05:46.221 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:05:46.230 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2024-09-13T17:05:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:05:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:46.238 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 388 Links: 1 2024-09-13T17:05:46.238 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:46.238 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-13 17:01:11.291713568 +0000 2024-09-13T17:05:46.238 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-13 17:01:11.063730909 +0000 2024-09-13T17:05:46.238 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-13 17:01:11.063730909 +0000 2024-09-13T17:05:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2024-09-13T17:05:46.238 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:05:46.295 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-13T17:05:46.295 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-13T17:05:46.295 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000365205 s, 1.4 MB/s 2024-09-13T17:05:46.296 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:05:46.304 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:05:46.304 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:05:46.304 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:05:46.311 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:05:46.311 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-09-13T17:05:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:05:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:46.319 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 361 Links: 1 2024-09-13T17:05:46.319 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:46.319 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-13 17:01:10.991598374 +0000 2024-09-13T17:05:46.319 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-13 17:01:10.775603353 +0000 2024-09-13T17:05:46.319 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-13 17:01:10.775603353 +0000 2024-09-13T17:05:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-13T17:05:46.319 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:05:46.330 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-13T17:05:46.330 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-13T17:05:46.330 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000408078 s, 1.3 MB/s 2024-09-13T17:05:46.331 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:05:46.380 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-09-13T17:05:46.387 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:05:46.387 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:46.387 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-09-13T17:05:46.387 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:46.387 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-13 17:01:11.439588048 +0000 2024-09-13T17:05:46.387 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-13 17:01:11.227592936 +0000 2024-09-13T17:05:46.387 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-13 17:01:11.227592936 +0000 2024-09-13T17:05:46.387 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-13T17:05:46.388 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:05:46.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-13T17:05:46.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-13T17:05:46.401 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000427827 s, 1.2 MB/s 2024-09-13T17:05:46.402 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:05:46.452 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-09-13T17:05:46.459 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:05:46.459 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:46.459 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 372 Links: 1 2024-09-13T17:05:46.459 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:46.459 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-13 17:01:11.859578367 +0000 2024-09-13T17:05:46.460 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-13 17:01:11.639583439 +0000 2024-09-13T17:05:46.460 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-13 17:01:11.639583439 +0000 2024-09-13T17:05:46.460 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-13T17:05:46.460 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:05:46.474 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-13T17:05:46.475 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-13T17:05:46.475 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000401188 s, 1.3 MB/s 2024-09-13T17:05:46.475 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:05:46.524 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-09-13T17:05:46.531 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:05:46.531 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:46.532 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 379 Links: 1 2024-09-13T17:05:46.532 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:46.532 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-13 17:01:12.323567673 +0000 2024-09-13T17:05:46.532 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-13 17:01:12.091573019 +0000 2024-09-13T17:05:46.532 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-13 17:01:12.091573019 +0000 2024-09-13T17:05:46.532 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-13T17:05:46.532 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:05:46.544 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-13T17:05:46.544 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-13T17:05:46.544 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000425134 s, 1.2 MB/s 2024-09-13T17:05:46.545 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:05:46.554 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:05:46.554 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T17:05:46.554 INFO:tasks.ceph:Generating config... 2024-09-13T17:05:46.555 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T17:05:46.555 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T17:05:46.555 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T17:05:46.556 INFO:tasks.ceph:[client] pid file = 2024-09-13T17:05:46.556 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T17:05:46.556 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T17:05:46.556 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T17:05:46.556 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T17:05:46.556 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T17:05:46.556 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T17:05:46.556 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T17:05:46.556 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T17:05:46.556 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T17:05:46.556 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T17:05:46.556 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T17:05:46.556 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T17:05:46.557 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T17:05:46.557 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T17:05:46.557 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T17:05:46.557 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T17:05:46.557 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T17:05:46.557 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T17:05:46.557 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T17:05:46.557 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T17:05:46.557 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T17:05:46.557 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T17:05:46.557 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T17:05:46.557 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T17:05:46.557 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T17:05:46.557 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T17:05:46.558 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T17:05:46.558 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T17:05:46.558 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T17:05:46.558 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T17:05:46.558 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T17:05:46.558 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T17:05:46.558 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T17:05:46.558 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T17:05:46.558 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T17:05:46.558 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T17:05:46.558 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T17:05:46.559 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T17:05:46.600 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T17:05:46.613 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T17:05:46.699 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:05:46.712 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.123'), ('mon.b', '172.21.15.153'), ('mon.c', '[v2:172.21.15.153:3301,v1:172.21.15.153:6790]')] 2024-09-13T17:05:46.712 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.123,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T17:05:46.713 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:05:46.713 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T17:05:46.719 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.123 --add b 172.21.15.153 --addv c '[v2:172.21.15.153:3301,v1:172.21.15.153:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:05:46.761 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:05:46.761 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: generated fsid c45759e3-62b7-46ff-ad19-917097e4c126 2024-09-13T17:05:46.761 INFO:teuthology.orchestra.run.smithi123.stdout:setting min_mon_release = pacific 2024-09-13T17:05:46.761 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 0 2024-09-13T17:05:46.761 INFO:teuthology.orchestra.run.smithi123.stdout:fsid c45759e3-62b7-46ff-ad19-917097e4c126 2024-09-13T17:05:46.761 INFO:teuthology.orchestra.run.smithi123.stdout:last_changed 2024-09-13T17:05:46.761377+0000 2024-09-13T17:05:46.761 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-09-13T17:05:46.761377+0000 2024-09-13T17:05:46.761 INFO:teuthology.orchestra.run.smithi123.stdout:min_mon_release 16 (pacific) 2024-09-13T17:05:46.762 INFO:teuthology.orchestra.run.smithi123.stdout:election_strategy: 1 2024-09-13T17:05:46.762 INFO:teuthology.orchestra.run.smithi123.stdout:0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-09-13T17:05:46.762 INFO:teuthology.orchestra.run.smithi123.stdout:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-13T17:05:46.762 INFO:teuthology.orchestra.run.smithi123.stdout:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-13T17:05:46.762 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T17:05:46.763 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T17:05:46.767 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c45759e3-62b7-46ff-ad19-917097e4c126... 2024-09-13T17:05:46.768 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:05:46.810 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:05:46.844 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-09-13T17:05:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-09-13T17:05:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:05:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-09-13T17:05:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-09-13T17:05:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-09-13T17:05:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-09-13T17:05:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-09-13T17:05:46.845 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-09-13T17:05:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-09-13T17:05:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:05:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-09-13T17:05:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:05:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:05:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-09-13T17:05:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-09-13T17:05:46.846 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-09-13T17:05:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:05:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:05:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-09-13T17:05:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:05:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-09-13T17:05:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:05:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:05:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-09-13T17:05:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:05:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-09-13T17:05:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-09-13T17:05:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-09-13T17:05:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-09-13T17:05:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-09-13T17:05:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.123,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]" 2024-09-13T17:05:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = c45759e3-62b7-46ff-ad19-917097e4c126 2024-09-13T17:05:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.848 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-09-13T17:05:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-09-13T17:05:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-09-13T17:05:46.848 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-09-13T17:05:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:05:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-09-13T17:05:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-09-13T17:05:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-09-13T17:05:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-09-13T17:05:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-09-13T17:05:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-09-13T17:05:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-09-13T17:05:46.849 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:05:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-09-13T17:05:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-09-13T17:05:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:05:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-09-13T17:05:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-09-13T17:05:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-09-13T17:05:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2024-09-13T17:05:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2024-09-13T17:05:46.850 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2024-09-13T17:05:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-09-13T17:05:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-09-13T17:05:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2024-09-13T17:05:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2024-09-13T17:05:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-13T17:05:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-09-13T17:05:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2024-09-13T17:05:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:05:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-09-13T17:05:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:05:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:05:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-09-13T17:05:46.851 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-09-13T17:05:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.852 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-09-13T17:05:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-13T17:05:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-09-13T17:05:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-13T17:05:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-13T17:05:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:05:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:05:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-09-13T17:05:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-09-13T17:05:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.852 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-09-13T17:05:46.852 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-13T17:05:46.853 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-13T17:05:46.853 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-09-13T17:05:46.853 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-13T17:05:46.853 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-09-13T17:05:46.853 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-09-13T17:05:46.853 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:05:46.853 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-09-13T17:05:46.853 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-09-13T17:05:46.853 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:05:46.853 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.853 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:05:46.853 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:05:46.853 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:05:46.854 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.854 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:05:46.854 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:05:46.854 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:05:46.854 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.854 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-09-13T17:05:46.854 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:05:46.854 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.854 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:05:46.854 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2024-09-13T17:05:46.854 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on pool no app = False 2024-09-13T17:05:46.854 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-13T17:05:46.854 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-09-13T17:05:46.854 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-09-13T17:05:46.855 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-09-13T17:05:46.855 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-09-13T17:05:46.855 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:05:46.855 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:05:46.855 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2024-09-13T17:05:46.855 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-09-13T17:05:46.855 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-13T17:05:46.855 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2024-09-13T17:05:46.855 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-09-13T17:05:46.855 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-09-13T17:05:46.855 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-09-13T17:05:46.855 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-09-13T17:05:46.855 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-09-13T17:05:46.856 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-09-13T17:05:46.856 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-09-13T17:05:46.856 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-09-13T17:05:46.856 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-09-13T17:05:46.856 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2024-09-13T17:05:46.856 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2024-09-13T17:05:46.856 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds balancer = 20 2024-09-13T17:05:46.856 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-13T17:05:46.856 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2024-09-13T17:05:46.856 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = True 2024-09-13T17:05:46.856 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2024-09-13T17:05:46.856 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = True 2024-09-13T17:05:46.856 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-09-13T17:05:46.856 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-09-13T17:05:46.857 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-09-13T17:05:46.858 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2024-09-13T17:05:46.858 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2024-09-13T17:05:46.858 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:05:46.858 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2024-09-13T17:05:46.858 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.858 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2024-09-13T17:05:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2024-09-13T17:05:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2024-09-13T17:05:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2024-09-13T17:05:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2024-09-13T17:05:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2024-09-13T17:05:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:05:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2024-09-13T17:05:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.859 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:05:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:05:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2024-09-13T17:05:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2024-09-13T17:05:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2024-09-13T17:05:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:05:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:05:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2024-09-13T17:05:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:05:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2024-09-13T17:05:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:05:46.860 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:05:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2024-09-13T17:05:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:05:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2024-09-13T17:05:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2024-09-13T17:05:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2024-09-13T17:05:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2024-09-13T17:05:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2024-09-13T17:05:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = "172.21.15.123,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]" 2024-09-13T17:05:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = c45759e3-62b7-46ff-ad19-917097e4c126 2024-09-13T17:05:46.861 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.862 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2024-09-13T17:05:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2024-09-13T17:05:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2024-09-13T17:05:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2024-09-13T17:05:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:05:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2024-09-13T17:05:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2024-09-13T17:05:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2024-09-13T17:05:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2024-09-13T17:05:46.862 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2024-09-13T17:05:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2024-09-13T17:05:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2024-09-13T17:05:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:05:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2024-09-13T17:05:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2024-09-13T17:05:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:05:46.863 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2024-09-13T17:05:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2024-09-13T17:05:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2024-09-13T17:05:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: bdev async discard = True 2024-09-13T17:05:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: bdev enable discard = True 2024-09-13T17:05:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore allocator = bitmap 2024-09-13T17:05:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2024-09-13T17:05:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2024-09-13T17:05:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 1/20 2024-09-13T17:05:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 1/20 2024-09-13T17:05:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-13T17:05:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2024-09-13T17:05:46.864 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 4/10 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:05:46.865 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2024-09-13T17:05:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-09-13T17:05:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.866 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2024-09-13T17:05:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-13T17:05:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-09-13T17:05:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2024-09-13T17:05:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-09-13T17:05:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2024-09-13T17:05:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2024-09-13T17:05:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:05:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2024-09-13T17:05:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2024-09-13T17:05:46.866 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:05:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:05:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:05:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:05:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:05:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:05:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:05:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: # 1m isn't quite enough 2024-09-13T17:05:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:05:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.867 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:05:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: mon op complaint time = 120 2024-09-13T17:05:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on pool no app = False 2024-09-13T17:05:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:05:46.868 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2024-09-13T17:05:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2024-09-13T17:05:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2024-09-13T17:05:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2024-09-13T17:05:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:05:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:05:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: client mount timeout = 600 2024-09-13T17:05:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-09-13T17:05:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-13T17:05:46.868 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = "" 2024-09-13T17:05:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-09-13T17:05:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-09-13T17:05:46.869 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2024-09-13T17:05:46.869 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.b] 2024-09-13T17:05:46.869 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.c] 2024-09-13T17:05:46.869 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2024-09-13T17:05:46.869 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2024-09-13T17:05:46.869 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2024-09-13T17:05:46.869 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2024-09-13T17:05:46.869 INFO:teuthology.orchestra.run.smithi123.stdout:[mds] 2024-09-13T17:05:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds = 20 2024-09-13T17:05:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds balancer = 20 2024-09-13T17:05:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-13T17:05:46.869 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug frag = True 2024-09-13T17:05:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug scatterstat = True 2024-09-13T17:05:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: mds op complaint time = 180 2024-09-13T17:05:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: mds verify scatter = True 2024-09-13T17:05:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-09-13T17:05:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-09-13T17:05:46.870 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-09-13T17:05:46.870 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T17:05:46.870 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T17:05:46.927 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T17:05:46.927 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:05:46.927 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T17:05:46.934 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:05:46.934 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T17:05:46.940 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:05:46.940 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:05:46.940 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T17:05:46.940 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:05:46.963 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:05:46.963 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:05:46.968 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:05:46.968 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:05:46.969 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T17:05:46.969 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:05:46.996 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:05:46.996 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:05:47.001 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T17:05:47.001 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T17:05:47.002 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T17:05:47.051 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T17:05:47.054 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T17:05:47.107 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T17:05:47.121 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T17:05:47.121 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T17:05:47.173 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T17:05:47.176 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T17:05:47.186 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T17:05:47.232 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T17:05:47.235 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T17:05:47.247 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T17:05:47.298 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T17:05:47.301 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T17:05:47.312 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T17:05:47.406 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T17:05:47.409 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T17:05:47.425 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T17:05:47.425 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T17:05:47.467 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T17:05:47.481 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-13T17:05:47.566 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-13T17:05:47.581 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T17:05:47.623 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T17:05:47.636 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-13T17:05:47.719 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-13T17:05:47.730 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T17:05:47.730 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T17:05:47.731 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T17:05:47.747 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:05:47.747 INFO:tasks.ceph:role: osd.0 2024-09-13T17:05:47.747 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:05:47.748 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T17:05:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:05:48.269 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:05:48.269 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:05:48.269 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 2024-09-13T17:05:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:05:48.269 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:05:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:05:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:05:48.269 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:05:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:05:48.271 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-09-13T17:05:48.271 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T17:05:48.362 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T17:05:48.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:05:48.374 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:05:48.374 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T17:05:48.384 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:05:48.384 INFO:tasks.ceph:role: osd.1 2024-09-13T17:05:48.384 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:05:48.384 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T17:05:48.891 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:05:48.891 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:05:48.892 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:05:48.892 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 2024-09-13T17:05:48.892 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:05:48.892 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:05:48.892 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:05:48.892 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:05:48.892 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:05:48.892 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:05:48.893 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-09-13T17:05:48.893 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T17:05:48.967 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T17:05:48.979 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:05:48.979 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:05:48.980 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T17:05:48.991 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:05:48.992 INFO:tasks.ceph:role: osd.2 2024-09-13T17:05:48.992 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:05:48.992 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T17:05:49.538 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:05:49.539 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:05:49.539 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:05:49.539 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 2024-09-13T17:05:49.539 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:05:49.539 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:05:49.539 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:05:49.539 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:05:49.539 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:05:49.539 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:05:49.540 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-09-13T17:05:49.541 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T17:05:49.596 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T17:05:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:05:49.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:05:49.608 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T17:05:49.669 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:05:49.669 INFO:tasks.ceph:role: osd.3 2024-09-13T17:05:49.669 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:05:49.669 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T17:05:50.169 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:05:50.169 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:05:50.169 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:05:50.169 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 2024-09-13T17:05:50.169 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:05:50.169 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:05:50.169 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:05:50.169 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:05:50.170 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:05:50.170 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:05:50.170 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-09-13T17:05:50.170 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T17:05:50.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T17:05:50.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:05:50.233 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:05:50.233 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:05:50.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:50.304+0000 7fb34d24c880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T17:05:50.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:50.304+0000 7fb34d24c880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T17:05:50.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:50.304+0000 7fb34d24c880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:05:50.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:50.304+0000 7fb34d24c880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:05:50.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:50.304+0000 7fb34d24c880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:05:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:50.312+0000 7fb34d24c880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T17:05:53.329 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T17:05:53.346 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:05:53.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:53.388+0000 7f7531f1b880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T17:05:53.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:53.388+0000 7f7531f1b880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T17:05:53.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:53.388+0000 7f7531f1b880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:05:53.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:53.388+0000 7f7531f1b880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:05:53.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:53.388+0000 7f7531f1b880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:05:53.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:53.388+0000 7f7531f1b880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T17:05:56.380 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T17:05:56.394 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:05:56.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:56.436+0000 7fa6bc07f880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T17:05:56.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:56.436+0000 7fa6bc07f880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T17:05:56.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:56.436+0000 7fa6bc07f880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:05:56.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:56.436+0000 7fa6bc07f880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:05:56.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:56.436+0000 7fa6bc07f880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:05:56.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:56.436+0000 7fa6bc07f880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T17:05:59.431 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T17:05:59.448 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:05:59.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:59.532+0000 7fce9f0d6880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T17:05:59.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:59.532+0000 7fce9f0d6880 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T17:05:59.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:59.532+0000 7fce9f0d6880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:05:59.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:59.532+0000 7fce9f0d6880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:05:59.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:59.532+0000 7fce9f0d6880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:05:59.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:05:59.532+0000 7fce9f0d6880 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T17:06:02.540 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T17:06:02.555 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T17:06:02.573 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:06:02.573 INFO:tasks.ceph:role: osd.4 2024-09-13T17:06:02.573 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:06:02.574 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T17:06:03.154 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:06:03.154 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:06:03.155 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:06:03.155 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 2024-09-13T17:06:03.155 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:06:03.155 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:06:03.155 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:06:03.155 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:06:03.155 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:06:03.155 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:06:03.157 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-13T17:06:03.157 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T17:06:03.246 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T17:06:03.258 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:06:03.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:06:03.259 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T17:06:03.316 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:06:03.317 INFO:tasks.ceph:role: osd.5 2024-09-13T17:06:03.317 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:06:03.317 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T17:06:03.831 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:06:03.831 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:06:03.831 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:06:03.831 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 2024-09-13T17:06:03.831 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:06:03.831 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:06:03.831 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:06:03.831 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:06:03.831 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:06:03.831 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:06:03.833 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-13T17:06:03.833 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T17:06:03.869 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T17:06:03.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:06:03.880 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:06:03.881 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T17:06:03.890 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:06:03.890 INFO:tasks.ceph:role: osd.6 2024-09-13T17:06:03.890 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:06:03.891 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T17:06:04.423 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:06:04.423 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:06:04.423 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:06:04.423 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 2024-09-13T17:06:04.423 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:06:04.423 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:06:04.423 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:06:04.423 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:06:04.424 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:06:04.424 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:06:04.425 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-13T17:06:04.425 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T17:06:04.486 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T17:06:04.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:06:04.498 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:06:04.499 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T17:06:04.509 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:06:04.509 INFO:tasks.ceph:role: osd.7 2024-09-13T17:06:04.509 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:06:04.510 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T17:06:05.026 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:06:05.026 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:06:05.026 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:06:05.026 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 2024-09-13T17:06:05.026 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:06:05.026 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:06:05.026 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:06:05.027 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:06:05.027 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:06:05.027 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:06:05.028 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-13T17:06:05.028 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T17:06:05.091 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T17:06:05.102 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:06:05.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:06:05.103 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:06:05.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:05.185+0000 7fe3c00db880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T17:06:05.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:05.189+0000 7fe3c00db880 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T17:06:05.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:05.189+0000 7fe3c00db880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:06:05.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:05.189+0000 7fe3c00db880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:06:05.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:05.189+0000 7fe3c00db880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:06:05.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:05.197+0000 7fe3c00db880 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T17:06:08.216 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T17:06:08.233 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:06:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:08.317+0000 7f0d82c20880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T17:06:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:08.317+0000 7f0d82c20880 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T17:06:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:08.317+0000 7f0d82c20880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:06:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:08.317+0000 7f0d82c20880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:06:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:08.317+0000 7f0d82c20880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:06:08.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:08.317+0000 7f0d82c20880 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T17:06:11.327 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T17:06:11.344 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:06:11.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:11.381+0000 7fa30ab86880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T17:06:11.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:11.381+0000 7fa30ab86880 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T17:06:11.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:11.381+0000 7fa30ab86880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:06:11.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:11.381+0000 7fa30ab86880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:06:11.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:11.381+0000 7fa30ab86880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:06:11.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:11.381+0000 7fa30ab86880 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T17:06:14.374 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T17:06:14.433 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:06:14.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:14.473+0000 7f509d7ea880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T17:06:14.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:14.473+0000 7f509d7ea880 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T17:06:14.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:14.473+0000 7f509d7ea880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:06:14.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:14.473+0000 7f509d7ea880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:06:14.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:14.473+0000 7f509d7ea880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:06:14.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:14.473+0000 7f509d7ea880 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T17:06:15.971 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:06:15.974 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:06:17.483 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T17:06:17.499 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T17:06:17.499 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:06:17.500 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T17:06:17.516 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:06:17.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T17:06:17.527 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:06:17.527 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T17:06:17.585 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:06:17.585 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T17:06:17.596 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:06:17.596 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T17:06:17.609 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:06:17.609 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T17:06:17.619 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:06:17.619 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T17:06:17.674 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:06:17.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T17:06:17.691 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:06:17.691 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T17:06:17.747 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:06:17.747 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T17:06:17.762 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:06:17.762 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T17:06:17.771 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:06:17.771 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T17:06:17.827 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:06:17.827 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T17:06:17.836 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:06:17.836 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T17:06:17.852 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:06:17.852 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T17:06:17.859 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:06:17.859 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-13T17:06:17.866 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:06:17.866 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T17:06:17.871 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:06:17.871 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-13T17:06:17.921 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T17:06:17.922 DEBUG:teuthology.orchestra.run.smithi123:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T17:06:17.924 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T17:06:17.935 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2024-09-13T17:06:17.935 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDrcORmLhAcAxAAHSNEbQ2dLEBPGDMMKc7dQQ== 2024-09-13T17:06:17.935 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-09-13T17:06:17.935 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDrcORmcINWChAAjEdCM4Sk1OsLUQerqFqnGg== 2024-09-13T17:06:17.935 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-09-13T17:06:17.935 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDrcORm+dvcDRAA5o6AtNdAEM2RTXMTKTuwvA== 2024-09-13T17:06:17.935 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2024-09-13T17:06:17.936 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDucORmpvNQEhAAg2TDxfqiCxv8rfzNXd8ghw== 2024-09-13T17:06:17.936 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2024-09-13T17:06:17.936 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDxcORmnAU+FxAAxjWreGRwyuQT2RRMicHAXg== 2024-09-13T17:06:17.936 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2024-09-13T17:06:17.936 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD0cORmMXQpGhAADjhpu3evLXhYS+YKeKf8WQ== 2024-09-13T17:06:17.936 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2024-09-13T17:06:17.936 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD3cORmAo7hHxAA80EcAMAxPmMPuKxUg6RYhQ== 2024-09-13T17:06:17.936 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2024-09-13T17:06:17.936 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDrcORmFSRNBhAAbI1RASXCwIZPggcjMdXynw== 2024-09-13T17:06:17.936 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-09-13T17:06:17.936 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDrcORmesC1ERAA2ZS4r6KU9vqfDLLX+0kwwg== 2024-09-13T17:06:17.936 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-09-13T17:06:17.937 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDrcORmnFIgGBAAZbqUsdKOG1nN0iHsKRqyHA== 2024-09-13T17:06:17.937 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2024-09-13T17:06:17.937 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQD9cORm2j1KCxAA57ClQVuoJdhuk76L4nPHVQ== 2024-09-13T17:06:17.937 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2024-09-13T17:06:17.937 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAAceRmu5IeExAAyUOWIVy5i703n829U0KSuw== 2024-09-13T17:06:17.937 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2024-09-13T17:06:17.937 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQADceRmhiXfFhAAt6aAa3EUOvKclLyGEl84SA== 2024-09-13T17:06:17.937 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2024-09-13T17:06:17.937 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAGceRmjYdfHBAAHn19wbVS72wMYHvMh+Cpyg== 2024-09-13T17:06:17.938 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-09-13T17:06:17.938 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDrcORmieDjGxAA9C8qfFqgRul4Kzk+0+UMTA== 2024-09-13T17:06:17.938 INFO:teuthology.orchestra.run.smithi153.stdout:[client.2] 2024-09-13T17:06:17.938 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDrcORmgbzRIRAA8VlhYQpFRQUNOo6nplFySA== 2024-09-13T17:06:17.938 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2024-09-13T17:06:17.938 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDrcORmJvUUJRAAQci63exaXrtjPfssFai1jw== 2024-09-13T17:06:17.938 INFO:teuthology.orchestra.run.smithi153.stdout:[client.3] 2024-09-13T17:06:17.938 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQDrcORmwT+9KhAASidrLfvv55brtJ3Mk+qdxA== 2024-09-13T17:06:17.939 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.y] 2024-09-13T17:06:17.940 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrcORmLhAcAxAAHSNEbQ2dLEBPGDMMKc7dQQ== 2024-09-13T17:06:17.940 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2024-09-13T17:06:17.940 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrcORmcINWChAAjEdCM4Sk1OsLUQerqFqnGg== 2024-09-13T17:06:17.940 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2024-09-13T17:06:17.940 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrcORm+dvcDRAA5o6AtNdAEM2RTXMTKTuwvA== 2024-09-13T17:06:17.940 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.0] 2024-09-13T17:06:17.940 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDucORmpvNQEhAAg2TDxfqiCxv8rfzNXd8ghw== 2024-09-13T17:06:17.940 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.1] 2024-09-13T17:06:17.940 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDxcORmnAU+FxAAxjWreGRwyuQT2RRMicHAXg== 2024-09-13T17:06:17.940 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.2] 2024-09-13T17:06:17.940 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQD0cORmMXQpGhAADjhpu3evLXhYS+YKeKf8WQ== 2024-09-13T17:06:17.940 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.3] 2024-09-13T17:06:17.941 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQD3cORmAo7hHxAA80EcAMAxPmMPuKxUg6RYhQ== 2024-09-13T17:06:17.941 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.x] 2024-09-13T17:06:17.941 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrcORmFSRNBhAAbI1RASXCwIZPggcjMdXynw== 2024-09-13T17:06:17.941 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2024-09-13T17:06:17.941 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrcORmesC1ERAA2ZS4r6KU9vqfDLLX+0kwwg== 2024-09-13T17:06:17.941 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2024-09-13T17:06:17.941 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrcORmnFIgGBAAZbqUsdKOG1nN0iHsKRqyHA== 2024-09-13T17:06:17.941 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.4] 2024-09-13T17:06:17.941 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQD9cORm2j1KCxAA57ClQVuoJdhuk76L4nPHVQ== 2024-09-13T17:06:17.941 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.5] 2024-09-13T17:06:17.941 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQAAceRmu5IeExAAyUOWIVy5i703n829U0KSuw== 2024-09-13T17:06:17.941 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.6] 2024-09-13T17:06:17.941 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQADceRmhiXfFhAAt6aAa3EUOvKclLyGEl84SA== 2024-09-13T17:06:17.942 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.7] 2024-09-13T17:06:17.942 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQAGceRmjYdfHBAAHn19wbVS72wMYHvMh+Cpyg== 2024-09-13T17:06:17.942 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-13T17:06:17.942 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrcORmieDjGxAA9C8qfFqgRul4Kzk+0+UMTA== 2024-09-13T17:06:17.942 INFO:teuthology.orchestra.run.smithi123.stdout:[client.2] 2024-09-13T17:06:17.942 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrcORmgbzRIRAA8VlhYQpFRQUNOo6nplFySA== 2024-09-13T17:06:17.942 INFO:teuthology.orchestra.run.smithi123.stdout:[client.1] 2024-09-13T17:06:17.942 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrcORmJvUUJRAAQci63exaXrtjPfssFai1jw== 2024-09-13T17:06:17.942 INFO:teuthology.orchestra.run.smithi123.stdout:[client.3] 2024-09-13T17:06:17.942 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQDrcORmwT+9KhAASidrLfvv55brtJ3Mk+qdxA== 2024-09-13T17:06:17.942 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:06:17.983 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:06:18.033 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:06:18.035 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:06:18.083 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:06:18.085 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:06:18.134 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.136 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.185 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.187 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.233 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.236 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.282 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.284 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.328 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:06:18.330 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:06:18.415 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:06:18.418 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:06:18.470 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:06:18.473 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:06:18.524 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.526 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.574 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.577 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.624 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.627 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.676 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.678 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:06:18.725 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:06:18.728 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:06:18.780 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:06:18.782 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:06:18.833 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:06:18.835 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:06:18.885 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:06:18.887 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:06:18.938 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T17:06:18.938 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T17:06:18.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:06:19.075 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T17:06:19.092 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T17:06:19.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:06:19.190 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T17:06:19.205 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T17:06:19.219 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:06:19.313 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T17:06:19.328 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:06:19.330 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:06:19.337 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T17:06:19.337 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T17:06:19.337 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T17:06:19.339 INFO:tasks.ceph.mon.a:Started 2024-09-13T17:06:19.340 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T17:06:19.340 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T17:06:19.381 INFO:tasks.ceph.mon.b:Started 2024-09-13T17:06:19.381 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T17:06:19.382 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T17:06:19.384 INFO:tasks.ceph.mon.c:Started 2024-09-13T17:06:19.384 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T17:06:19.384 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T17:06:19.384 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T17:06:19.386 INFO:tasks.ceph.mgr.y:Started 2024-09-13T17:06:19.387 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T17:06:19.387 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T17:06:19.389 INFO:tasks.ceph.mgr.x:Started 2024-09-13T17:06:19.389 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T17:06:19.389 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T17:06:19.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbad7256700 1 Processor -- start 2024-09-13T17:06:19.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbad7256700 1 -- start start 2024-09-13T17:06:19.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbad7256700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 0x7fbad00cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:19.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbad7256700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:19.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbad7256700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad0160940 con 0x7fbad00b1b90 2024-09-13T17:06:19.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbad7256700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad006b0d0 con 0x7fbad00cf450 2024-09-13T17:06:19.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbad7256700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad006b3b0 con 0x7fbad006a2f0 2024-09-13T17:06:19.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbad57f3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:19.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbad57f3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54496/0 (socket says 172.21.15.123:54496) 2024-09-13T17:06:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbad57f3700 1 -- 172.21.15.123:0/2749925775 learned_addr learned my addr 172.21.15.123:0/2749925775 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbad57f3700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 msgr2=0x7fbad015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:06:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbad57f3700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 msgr2=0x7fbad015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:06:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbad57f3700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:06:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbad57f3700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:06:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 0x7fbad00cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 msgr2=0x7fbad00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:06:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 msgr2=0x7fbad00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:06:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 0x7fbad00cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:06:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.495+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 0x7fbad00cef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:06:19.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.699+0000 7fbad57f3700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:19.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.699+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 0x7fbad00cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:19.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.699+0000 7fbad57f3700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 msgr2=0x7fbad015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:06:19.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.699+0000 7fbad57f3700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 msgr2=0x7fbad015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:06:19.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.699+0000 7fbad57f3700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:06:19.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.699+0000 7fbad57f3700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:06:19.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.699+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 msgr2=0x7fbad00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:06:19.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.699+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 msgr2=0x7fbad00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:06:19.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.699+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 0x7fbad00cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:06:19.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:19.699+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 0x7fbad00cef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:06:20.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.103+0000 7fbad57f3700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:20.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.103+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 0x7fbad00cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:20.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.103+0000 7fbad57f3700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 msgr2=0x7fbad015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:06:20.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.103+0000 7fbad57f3700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 msgr2=0x7fbad015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:06:20.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.103+0000 7fbad57f3700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:06:20.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.103+0000 7fbad57f3700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T17:06:20.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.103+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 msgr2=0x7fbad00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:06:20.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.103+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 msgr2=0x7fbad00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:06:20.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.103+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 0x7fbad00cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:06:20.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.103+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 0x7fbad00cef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T17:06:20.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.907+0000 7fbad57f3700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:20.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.907+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 0x7fbad00cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.907+0000 7fbad57f3700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 msgr2=0x7fbad015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:06:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.907+0000 7fbad57f3700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 msgr2=0x7fbad015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:06:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.907+0000 7fbad57f3700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:06:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.907+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 msgr2=0x7fbad00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:06:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.907+0000 7fbad57f3700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T17:06:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.907+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 msgr2=0x7fbad00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:06:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.907+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 0x7fbad00cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:06:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:20.907+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 0x7fbad00cef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T17:06:22.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.495+0000 7fbace7fc700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 msgr2=0x7fbad00cef10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:06:22.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.495+0000 7fbace7fc700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.153:3300/0 conn(0x7fbad006a2f0 0x7fbad00cef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:22.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.495+0000 7fbace7fc700 1 -- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 msgr2=0x7fbad015d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:06:22.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.495+0000 7fbace7fc700 1 --2- 172.21.15.123:0/2749925775 >> v2:172.21.15.123:3300/0 conn(0x7fbad00cf450 0x7fbad015d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:22.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.495+0000 7fbace7fc700 1 -- 172.21.15.123:0/2749925775 >> v1:172.21.15.153:6789/0 conn(0x7fbad00b1b90 legacy=0x7fbad00b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:22.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.495+0000 7fbace7fc700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 0x7fbab40097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:22.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.495+0000 7fbace7fc700 1 -- 172.21.15.123:0/2749925775 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad006b690 con 0x7fbab4003710 2024-09-13T17:06:22.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.495+0000 7fbace7fc700 1 -- 172.21.15.123:0/2749925775 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad006b0d0 con 0x7fbab4007360 2024-09-13T17:06:22.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.495+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 0x7fbab40097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:22.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.495+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 msgr2=0x7fbab40097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T17:06:22.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.495+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 msgr2=0x7fbab40097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:06:22.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.495+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 0x7fbab40097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:06:22.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.495+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 0x7fbab40097e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:06:22.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.699+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 0x7fbab40097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:22.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.699+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 msgr2=0x7fbab40097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T17:06:22.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.699+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 msgr2=0x7fbab40097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:06:22.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.699+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 0x7fbab40097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:06:22.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:22.699+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 0x7fbab40097e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:06:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:23.103+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 0x7fbab40097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:23.103+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 msgr2=0x7fbab40097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T17:06:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:23.103+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 msgr2=0x7fbab40097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:06:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:23.103+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 0x7fbab40097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:06:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:23.103+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 0x7fbab40097e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T17:06:23.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:23.907+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 0x7fbab40097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:23.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:23.907+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 msgr2=0x7fbab40097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T17:06:23.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:23.907+0000 7fbacffff700 1 -- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 msgr2=0x7fbab40097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:06:23.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:23.907+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 0x7fbab40097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:06:23.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:23.907+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 0x7fbab40097e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T17:06:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacf7fe700 1 -- 172.21.15.123:0/2749925775 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487489899 0 0) 0x7fbad006b690 con 0x7fbab4003710 2024-09-13T17:06:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacf7fe700 1 -- 172.21.15.123:0/2749925775 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbac00035d0 con 0x7fbab4003710 2024-09-13T17:06:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacf7fe700 1 -- 172.21.15.123:0/2749925775 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1213722706 0 0) 0x7fbac00035d0 con 0x7fbab4003710 2024-09-13T17:06:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacf7fe700 1 -- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 msgr2=0x7fbab40097e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:06:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacf7fe700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbab4007360 0x7fbab40097e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacf7fe700 1 -- 172.21.15.123:0/2749925775 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab400afa0 con 0x7fbab4003710 2024-09-13T17:06:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacf7fe700 1 -- 172.21.15.123:0/2749925775 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7fbac40016f0 con 0x7fbab4003710 2024-09-13T17:06:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacf7fe700 1 -- 172.21.15.123:0/2749925775 >> v1:172.21.15.123:6789/0 conn(0x7fbab4003710 legacy=0x7fbab4005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbad57f3700 1 -- 172.21.15.123:0/2749925775 reap_dead start 2024-09-13T17:06:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacf7fe700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbac0003a20 0x7fbac0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacf7fe700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac0004870 0x7fbac0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacf7fe700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac0005350 0x7fbac000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacf7fe700 1 -- 172.21.15.123:0/2749925775 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad006b0d0 con 0x7fbac0003a20 2024-09-13T17:06:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacf7fe700 1 -- 172.21.15.123:0/2749925775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac000c2a0 con 0x7fbac0004870 2024-09-13T17:06:24.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacf7fe700 1 -- 172.21.15.123:0/2749925775 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac000c460 con 0x7fbac0005350 2024-09-13T17:06:24.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbad4ff2700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbac0003a20 0x7fbac0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:24.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbad57f3700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac0005350 0x7fbac000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:24.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbacffff700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac0004870 0x7fbac0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:24.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbad4ff2700 1 -- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac0005350 msgr2=0x7fbac000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:24.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbad4ff2700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac0005350 0x7fbac000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:24.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbad4ff2700 1 -- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac0004870 msgr2=0x7fbac0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:24.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbad4ff2700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac0004870 0x7fbac0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:24.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbad4ff2700 1 -- 172.21.15.123:0/2749925775 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac00035d0 con 0x7fbac0003a20 2024-09-13T17:06:24.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.739+0000 7fbad4ff2700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbac0003a20 0x7fbac0003e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbac4007f90 tx=0x7fbac00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24bb7dac8fc00fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:24.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.743+0000 7fbacf7fe700 1 -- 172.21.15.123:0/2749925775 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4007a80 con 0x7fbac0003a20 2024-09-13T17:06:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.743+0000 7fbacf7fe700 1 -- 172.21.15.123:0/2749925775 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac400cc10 con 0x7fbac0003a20 2024-09-13T17:06:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.743+0000 7fbacf7fe700 1 -- 172.21.15.123:0/2749925775 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4012420 con 0x7fbac0003a20 2024-09-13T17:06:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.743+0000 7fbad7256700 1 -- 172.21.15.123:0/2749925775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbac0003a20 msgr2=0x7fbac0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.743+0000 7fbad7256700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbac0003a20 0x7fbac0003e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbac4007f90 tx=0x7fbac00058a0 comp rx=0 tx=0).stop 2024-09-13T17:06:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.743+0000 7fbad7256700 1 -- 172.21.15.123:0/2749925775 shutdown_connections 2024-09-13T17:06:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.743+0000 7fbad7256700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac0005350 0x7fbac000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.743+0000 7fbad7256700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac0004870 0x7fbac0004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.743+0000 7fbad7256700 1 --2- 172.21.15.123:0/2749925775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbac0003a20 0x7fbac0003e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.743+0000 7fbad7256700 1 -- 172.21.15.123:0/2749925775 >> 172.21.15.123:0/2749925775 conn(0x7fbad00cfde0 msgr2=0x7fbad00d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.743+0000 7fbad7256700 1 -- 172.21.15.123:0/2749925775 shutdown_connections 2024-09-13T17:06:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.743+0000 7fbad7256700 1 -- 172.21.15.123:0/2749925775 wait complete. 2024-09-13T17:06:24.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.743+0000 7fbad7256700 1 Processor -- start 2024-09-13T17:06:24.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad7256700 1 -- start start 2024-09-13T17:06:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad7256700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbac0003a20 0x7fbad00b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad7256700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac0004870 0x7fbad00b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad7256700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac0005350 0x7fbad00b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad7256700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad014aec0 con 0x7fbac0003a20 2024-09-13T17:06:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad7256700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00b4940 con 0x7fbac0005350 2024-09-13T17:06:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad7256700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad015a850 con 0x7fbac0004870 2024-09-13T17:06:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad4ff2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbac0003a20 0x7fbad00b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbacffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac0004870 0x7fbad00b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad4ff2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbac0003a20 0x7fbad00b3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37540/0 (socket says 172.21.15.123:37540) 2024-09-13T17:06:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad57f3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac0005350 0x7fbad00b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad4ff2700 1 -- 172.21.15.123:0/4218700459 learned_addr learned my addr 172.21.15.123:0/4218700459 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad4ff2700 1 -- 172.21.15.123:0/4218700459 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac0004870 msgr2=0x7fbad00b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad4ff2700 1 --2- 172.21.15.123:0/4218700459 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac0004870 0x7fbad00b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad4ff2700 1 -- 172.21.15.123:0/4218700459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac0005350 msgr2=0x7fbad00b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad4ff2700 1 --2- 172.21.15.123:0/4218700459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac0005350 0x7fbad00b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad4ff2700 1 -- 172.21.15.123:0/4218700459 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad00b4380 con 0x7fbac0003a20 2024-09-13T17:06:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad4ff2700 1 --2- 172.21.15.123:0/4218700459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbac0003a20 0x7fbad00b3950 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbac4000c00 tx=0x7fbac4001910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbacd7fa700 1 -- 172.21.15.123:0/4218700459 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4027480 con 0x7fbac0003a20 2024-09-13T17:06:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbacd7fa700 1 -- 172.21.15.123:0/4218700459 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac4020070 con 0x7fbac0003a20 2024-09-13T17:06:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad7256700 1 -- 172.21.15.123:0/4218700459 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad00b4660 con 0x7fbac0003a20 2024-09-13T17:06:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbacd7fa700 1 -- 172.21.15.123:0/4218700459 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4027820 con 0x7fbac0003a20 2024-09-13T17:06:24.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbad7256700 1 -- 172.21.15.123:0/4218700459 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad015cbd0 con 0x7fbac0003a20 2024-09-13T17:06:24.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbacd7fa700 1 -- 172.21.15.123:0/4218700459 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fbac4027c80 con 0x7fbac0003a20 2024-09-13T17:06:24.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.747+0000 7fbacd7fa700 1 -- 172.21.15.123:0/4218700459 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbac4022070 con 0x7fbac0003a20 2024-09-13T17:06:24.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.751+0000 7fbad7256700 1 -- 172.21.15.123:0/4218700459 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad00cf210 con 0x7fbac0003a20 2024-09-13T17:06:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.755+0000 7fbacd7fa700 1 -- 172.21.15.123:0/4218700459 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fbac4048e30 con 0x7fbac0003a20 2024-09-13T17:06:24.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.831+0000 7fbad7256700 1 -- 172.21.15.123:0/4218700459 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fbad00cd480 con 0x7fbac0003a20 2024-09-13T17:06:24.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.835+0000 7fbacd7fa700 1 -- 172.21.15.123:0/4218700459 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbac4037070 con 0x7fbac0003a20 2024-09-13T17:06:24.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.839+0000 7fbad7256700 1 -- 172.21.15.123:0/4218700459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbac0003a20 msgr2=0x7fbad00b3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:24.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.839+0000 7fbad7256700 1 --2- 172.21.15.123:0/4218700459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbac0003a20 0x7fbad00b3950 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbac4000c00 tx=0x7fbac4001910 comp rx=0 tx=0).stop 2024-09-13T17:06:24.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.839+0000 7fbad7256700 1 -- 172.21.15.123:0/4218700459 shutdown_connections 2024-09-13T17:06:24.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.839+0000 7fbad7256700 1 --2- 172.21.15.123:0/4218700459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac0005350 0x7fbad00b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:24.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.839+0000 7fbad7256700 1 --2- 172.21.15.123:0/4218700459 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbac0004870 0x7fbad00b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:24.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.839+0000 7fbad7256700 1 --2- 172.21.15.123:0/4218700459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbac0003a20 0x7fbad00b3950 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:24.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.839+0000 7fbad7256700 1 -- 172.21.15.123:0/4218700459 >> 172.21.15.123:0/4218700459 conn(0x7fbad00cfde0 msgr2=0x7fbad00ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:24.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.839+0000 7fbad7256700 1 -- 172.21.15.123:0/4218700459 shutdown_connections 2024-09-13T17:06:24.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:24.839+0000 7fbad7256700 1 -- 172.21.15.123:0/4218700459 wait complete. 2024-09-13T17:06:24.844 INFO:teuthology.orchestra.run.smithi123.stderr:adjusted tunables profile to default 2024-09-13T17:06:24.855 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T17:06:24.855 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T17:06:24.856 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:06:24.856 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T17:06:24.869 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:06:24.869 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T17:06:24.878 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:06:24.878 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T17:06:24.892 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:06:24.892 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T17:06:24.903 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:06:24.903 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T17:06:24.921 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:06:24.921 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T17:06:24.980 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:06:24.981 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T17:06:24.991 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:06:24.991 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T17:06:25.003 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 59c5e23d-dc55-4161-b6e2-bf8b8c70a229 0 2024-09-13T17:06:25.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 Processor -- start 2024-09-13T17:06:25.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 -- start start 2024-09-13T17:06:25.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd23c0b3990 0x7fd23c0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd23c0ccac0 0x7fd23c0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c0cb9f0 con 0x7fd23c0cb5b0 2024-09-13T17:06:25.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0ccf00 con 0x7fd23c0b3990 2024-09-13T17:06:25.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0ce180 con 0x7fd23c0ccac0 2024-09-13T17:06:25.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd241b35700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd23c0ccac0 0x7fd23c0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd241b35700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd23c0ccac0 0x7fd23c0cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:34776/0 (socket says 172.21.15.153:34776) 2024-09-13T17:06:25.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd241b35700 1 -- 172.21.15.153:0/2500585090 learned_addr learned my addr 172.21.15.153:0/2500585090 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-13T17:06:25.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd242336700 1 --2- 172.21.15.153:0/2500585090 >> v2:172.21.15.153:3300/0 conn(0x7fd23c0b3990 0x7fd23c0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd241b35700 1 -- 172.21.15.153:0/2500585090 >> v2:172.21.15.153:3300/0 conn(0x7fd23c0b3990 msgr2=0x7fd23c0cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:25.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd241b35700 1 --2- 172.21.15.153:0/2500585090 >> v2:172.21.15.153:3300/0 conn(0x7fd23c0b3990 0x7fd23c0cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd241b35700 1 -- 172.21.15.153:0/2500585090 >> v1:172.21.15.123:6789/0 conn(0x7fd23c0cb5b0 legacy=0x7fd23c15e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:25.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd241b35700 1 -- 172.21.15.153:0/2500585090 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0cd990 con 0x7fd23c0ccac0 2024-09-13T17:06:25.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd241b35700 1 --2- 172.21.15.153:0/2500585090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd23c0ccac0 0x7fd23c0cb070 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009910 tx=0x7fd22c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8ca0ffc909a4359 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:25.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd241334700 1 -- 172.21.15.153:0/2500585090 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c004230 con 0x7fd23c0ccac0 2024-09-13T17:06:25.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd241334700 1 -- 172.21.15.153:0/2500585090 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c004390 con 0x7fd23c0ccac0 2024-09-13T17:06:25.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd241334700 1 -- 172.21.15.153:0/2500585090 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0036c0 con 0x7fd23c0ccac0 2024-09-13T17:06:25.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 -- 172.21.15.153:0/2500585090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd23c0ccac0 msgr2=0x7fd23c0cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 --2- 172.21.15.153:0/2500585090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd23c0ccac0 0x7fd23c0cb070 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009910 tx=0x7fd22c009c20 comp rx=0 tx=0).stop 2024-09-13T17:06:25.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 -- 172.21.15.153:0/2500585090 shutdown_connections 2024-09-13T17:06:25.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 --2- 172.21.15.153:0/2500585090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd23c0ccac0 0x7fd23c0cb070 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 --2- 172.21.15.153:0/2500585090 >> v2:172.21.15.153:3300/0 conn(0x7fd23c0b3990 0x7fd23c0cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 -- 172.21.15.153:0/2500585090 >> 172.21.15.153:0/2500585090 conn(0x7fd23c0b01d0 msgr2=0x7fd23c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:25.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 -- 172.21.15.153:0/2500585090 shutdown_connections 2024-09-13T17:06:25.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.165+0000 7fd243338700 1 -- 172.21.15.153:0/2500585090 wait complete. 2024-09-13T17:06:25.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.169+0000 7fd243338700 1 Processor -- start 2024-09-13T17:06:25.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.169+0000 7fd243338700 1 -- start start 2024-09-13T17:06:25.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd243338700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd23c0b3990 0x7fd23c0c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd243338700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd23c0cb5b0 0x7fd23c15d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd243338700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd23c0ccac0 0x7fd23c14db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd243338700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0c6a60 con 0x7fd23c0cb5b0 2024-09-13T17:06:25.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd243338700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c15d950 con 0x7fd23c0b3990 2024-09-13T17:06:25.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd243338700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c14e050 con 0x7fd23c0ccac0 2024-09-13T17:06:25.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd242336700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd23c0b3990 0x7fd23c0c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd242336700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd23c0b3990 0x7fd23c0c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41856/0 (socket says 172.21.15.153:41856) 2024-09-13T17:06:25.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd242336700 1 -- 172.21.15.153:0/2350067627 learned_addr learned my addr 172.21.15.153:0/2350067627 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-13T17:06:25.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd242b37700 1 --2- 172.21.15.153:0/2350067627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd23c0ccac0 0x7fd23c14db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd241b35700 1 --2- 172.21.15.153:0/2350067627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd23c0cb5b0 0x7fd23c15d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd242336700 1 -- 172.21.15.153:0/2350067627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd23c0ccac0 msgr2=0x7fd23c14db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd242336700 1 --2- 172.21.15.153:0/2350067627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd23c0ccac0 0x7fd23c14db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd242336700 1 -- 172.21.15.153:0/2350067627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd23c0cb5b0 msgr2=0x7fd23c15d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd242336700 1 --2- 172.21.15.153:0/2350067627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd23c0cb5b0 0x7fd23c15d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd242336700 1 -- 172.21.15.153:0/2350067627 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c009570 con 0x7fd23c0b3990 2024-09-13T17:06:25.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd242b37700 1 --2- 172.21.15.153:0/2350067627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd23c0ccac0 0x7fd23c14db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:25.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd242336700 1 --2- 172.21.15.153:0/2350067627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd23c0b3990 0x7fd23c0c5750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd23800e840 tx=0x7fd23800eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:25.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd232ffd700 1 -- 172.21.15.153:0/2350067627 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380095a0 con 0x7fd23c0b3990 2024-09-13T17:06:25.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd232ffd700 1 -- 172.21.15.153:0/2350067627 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd238013680 con 0x7fd23c0b3990 2024-09-13T17:06:25.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd232ffd700 1 -- 172.21.15.153:0/2350067627 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380139f0 con 0x7fd23c0b3990 2024-09-13T17:06:25.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd243338700 1 -- 172.21.15.153:0/2350067627 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c0c5de0 con 0x7fd23c0b3990 2024-09-13T17:06:25.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd243338700 1 -- 172.21.15.153:0/2350067627 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c0c63a0 con 0x7fd23c0b3990 2024-09-13T17:06:25.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd232ffd700 1 -- 172.21.15.153:0/2350067627 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd238005a40 con 0x7fd23c0b3990 2024-09-13T17:06:25.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd232ffd700 1 -- 172.21.15.153:0/2350067627 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd23801c790 con 0x7fd23c0b3990 2024-09-13T17:06:25.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.173+0000 7fd243338700 1 -- 172.21.15.153:0/2350067627 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c0c6ba0 con 0x7fd23c0b3990 2024-09-13T17:06:25.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.177+0000 7fd232ffd700 1 -- 172.21.15.153:0/2350067627 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd23c0c6ba0 con 0x7fd23c0b3990 2024-09-13T17:06:25.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.257+0000 7fd243338700 1 -- 172.21.15.153:0/2350067627 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "59c5e23d-dc55-4161-b6e2-bf8b8c70a229", "id": 0} v 0) v1 -- 0x7fd23c0b3d70 con 0x7fd23c0b3990 2024-09-13T17:06:25.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.265+0000 7fd232ffd700 1 -- 172.21.15.153:0/2350067627 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "59c5e23d-dc55-4161-b6e2-bf8b8c70a229", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd238021060 con 0x7fd23c0b3990 2024-09-13T17:06:25.268 INFO:teuthology.orchestra.run.smithi153.stdout:0 2024-09-13T17:06:25.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.265+0000 7fd243338700 1 -- 172.21.15.153:0/2350067627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd23c0b3990 msgr2=0x7fd23c0c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.265+0000 7fd243338700 1 --2- 172.21.15.153:0/2350067627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd23c0b3990 0x7fd23c0c5750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd23800e840 tx=0x7fd23800eb50 comp rx=0 tx=0).stop 2024-09-13T17:06:25.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.265+0000 7fd243338700 1 -- 172.21.15.153:0/2350067627 shutdown_connections 2024-09-13T17:06:25.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.265+0000 7fd243338700 1 --2- 172.21.15.153:0/2350067627 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd23c0ccac0 0x7fd23c14db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.265+0000 7fd243338700 1 --2- 172.21.15.153:0/2350067627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd23c0cb5b0 0x7fd23c15d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.265+0000 7fd243338700 1 --2- 172.21.15.153:0/2350067627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd23c0b3990 0x7fd23c0c5750 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.265+0000 7fd243338700 1 -- 172.21.15.153:0/2350067627 >> 172.21.15.153:0/2350067627 conn(0x7fd23c0b01d0 msgr2=0x7fd23c0ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:25.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.265+0000 7fd243338700 1 -- 172.21.15.153:0/2350067627 shutdown_connections 2024-09-13T17:06:25.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.265+0000 7fd243338700 1 -- 172.21.15.153:0/2350067627 wait complete. 2024-09-13T17:06:25.282 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 4f7d4173-67dd-4f16-9411-9fdb1daaae99 1 2024-09-13T17:06:25.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7add365700 1 Processor -- start 2024-09-13T17:06:25.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7add365700 1 -- start start 2024-09-13T17:06:25.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7add365700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7ad80cb7e0 0x7f7ad80c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7add365700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad80ca750 con 0x7f7ad806bdb0 2024-09-13T17:06:25.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7add365700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad80c9210 con 0x7f7ad8072260 2024-09-13T17:06:25.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7add365700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad81617b0 con 0x7f7ad80cb7e0 2024-09-13T17:06:25.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7adcb64700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7ad8072260 0x7f7ad80cc580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33520/0 (socket says 172.21.15.153:33520) 2024-09-13T17:06:25.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7adcb64700 1 -- 172.21.15.153:0/872586018 learned_addr learned my addr 172.21.15.153:0/872586018 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-09-13T17:06:25.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7ad7fff700 1 --2- 172.21.15.153:0/872586018 >> v2:172.21.15.123:3300/0 conn(0x7f7ad80cb7e0 0x7f7ad80c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7ad6ffd700 1 -- 172.21.15.153:0/872586018 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459707319 0 0) 0x7f7ad80c9210 con 0x7f7ad8072260 2024-09-13T17:06:25.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7ad6ffd700 1 -- 172.21.15.153:0/872586018 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ac40035d0 con 0x7f7ad8072260 2024-09-13T17:06:25.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7ad7fff700 1 -- 172.21.15.153:0/872586018 >> v1:172.21.15.153:6789/0 conn(0x7f7ad8072260 legacy=0x7f7ad80cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7ad6ffd700 1 -- 172.21.15.153:0/872586018 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4034788534 0 0) 0x7f7ac40035d0 con 0x7f7ad8072260 2024-09-13T17:06:25.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7ad7fff700 1 -- 172.21.15.153:0/872586018 >> v1:172.21.15.123:6789/0 conn(0x7f7ad806bdb0 legacy=0x7f7ad8071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7ad7fff700 1 -- 172.21.15.153:0/872586018 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad80cbbc0 con 0x7f7ad80cb7e0 2024-09-13T17:06:25.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7ad7fff700 1 --2- 172.21.15.153:0/872586018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad80cb7e0 0x7f7ad80c8cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00097d0 tx=0x7f7ac0009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1917a4e25a35ec5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:25.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7ad6ffd700 1 -- 172.21.15.153:0/872586018 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0001670 con 0x7f7ad80cb7e0 2024-09-13T17:06:25.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7ad6ffd700 1 -- 172.21.15.153:0/872586018 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac000f510 con 0x7f7ad80cb7e0 2024-09-13T17:06:25.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7ad6ffd700 1 -- 172.21.15.153:0/872586018 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000f8a0 con 0x7f7ad80cb7e0 2024-09-13T17:06:25.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7add365700 1 -- 172.21.15.153:0/872586018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad80cb7e0 msgr2=0x7f7ad80c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.389+0000 7f7add365700 1 --2- 172.21.15.153:0/872586018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad80cb7e0 0x7f7ad80c8cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00097d0 tx=0x7f7ac0009ae0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7add365700 1 -- 172.21.15.153:0/872586018 shutdown_connections 2024-09-13T17:06:25.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7add365700 1 --2- 172.21.15.153:0/872586018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad80cb7e0 0x7f7ad80c8cd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7add365700 1 -- 172.21.15.153:0/872586018 >> 172.21.15.153:0/872586018 conn(0x7f7ad80b01d0 msgr2=0x7f7ad80b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:25.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7add365700 1 -- 172.21.15.153:0/872586018 shutdown_connections 2024-09-13T17:06:25.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7add365700 1 -- 172.21.15.153:0/872586018 wait complete. 2024-09-13T17:06:25.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7add365700 1 Processor -- start 2024-09-13T17:06:25.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7add365700 1 -- start start 2024-09-13T17:06:25.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7add365700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad806bdb0 0x7f7ad80c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7add365700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ad8072260 0x7f7ad8158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7add365700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ad80cb7e0 0x7f7ad8162940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7add365700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8159490 con 0x7f7ad806bdb0 2024-09-13T17:06:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7add365700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8163390 con 0x7f7ad8072260 2024-09-13T17:06:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7add365700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8163670 con 0x7f7ad80cb7e0 2024-09-13T17:06:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7ad77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ad8072260 0x7f7ad8158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7ad77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ad8072260 0x7f7ad8158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41872/0 (socket says 172.21.15.153:41872) 2024-09-13T17:06:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7ad77fe700 1 -- 172.21.15.153:0/1064603118 learned_addr learned my addr 172.21.15.153:0/1064603118 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-13T17:06:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7adcb64700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ad80cb7e0 0x7f7ad8162940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7ad7fff700 1 --2- 172.21.15.153:0/1064603118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad806bdb0 0x7f7ad80c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7ad77fe700 1 -- 172.21.15.153:0/1064603118 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ad80cb7e0 msgr2=0x7f7ad8162940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7ad77fe700 1 --2- 172.21.15.153:0/1064603118 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ad80cb7e0 0x7f7ad8162940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7ad77fe700 1 -- 172.21.15.153:0/1064603118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad806bdb0 msgr2=0x7f7ad80c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7ad77fe700 1 --2- 172.21.15.153:0/1064603118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad806bdb0 0x7f7ad80c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.393+0000 7f7ad77fe700 1 -- 172.21.15.153:0/1064603118 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac00094b0 con 0x7f7ad8072260 2024-09-13T17:06:25.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.397+0000 7f7ad77fe700 1 --2- 172.21.15.153:0/1064603118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ad8072260 0x7f7ad8158f50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800ce40 tx=0x7f7ac800a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:25.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.397+0000 7f7ad4ff9700 1 -- 172.21.15.153:0/1064603118 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8003e50 con 0x7f7ad8072260 2024-09-13T17:06:25.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.397+0000 7f7ad4ff9700 1 -- 172.21.15.153:0/1064603118 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac800a990 con 0x7f7ad8072260 2024-09-13T17:06:25.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.397+0000 7f7add365700 1 -- 172.21.15.153:0/1064603118 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad80c6e30 con 0x7f7ad8072260 2024-09-13T17:06:25.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.397+0000 7f7ad4ff9700 1 -- 172.21.15.153:0/1064603118 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac800ad40 con 0x7f7ad8072260 2024-09-13T17:06:25.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.397+0000 7f7add365700 1 -- 172.21.15.153:0/1064603118 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad80c73f0 con 0x7f7ad8072260 2024-09-13T17:06:25.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.397+0000 7f7ad4ff9700 1 -- 172.21.15.153:0/1064603118 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7ac8005370 con 0x7f7ad8072260 2024-09-13T17:06:25.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.397+0000 7f7ad4ff9700 1 -- 172.21.15.153:0/1064603118 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f7ac801bc50 con 0x7f7ad8072260 2024-09-13T17:06:25.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.397+0000 7f7add365700 1 -- 172.21.15.153:0/1064603118 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad80c7610 con 0x7f7ad8072260 2024-09-13T17:06:25.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.401+0000 7f7ad4ff9700 1 -- 172.21.15.153:0/1064603118 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f7ac801be60 con 0x7f7ad8072260 2024-09-13T17:06:25.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.477+0000 7f7add365700 1 -- 172.21.15.153:0/1064603118 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4f7d4173-67dd-4f16-9411-9fdb1daaae99", "id": 1} v 0) v1 -- 0x7f7ad80c1480 con 0x7f7ad8072260 2024-09-13T17:06:25.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.489+0000 7f7ad4ff9700 1 -- 172.21.15.153:0/1064603118 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f7d4173-67dd-4f16-9411-9fdb1daaae99", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7ac802a0b0 con 0x7f7ad8072260 2024-09-13T17:06:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-13T17:06:25.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.493+0000 7f7add365700 1 -- 172.21.15.153:0/1064603118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ad8072260 msgr2=0x7f7ad8158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.493+0000 7f7add365700 1 --2- 172.21.15.153:0/1064603118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ad8072260 0x7f7ad8158f50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800ce40 tx=0x7f7ac800a340 comp rx=0 tx=0).stop 2024-09-13T17:06:25.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.493+0000 7f7add365700 1 -- 172.21.15.153:0/1064603118 shutdown_connections 2024-09-13T17:06:25.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.493+0000 7f7add365700 1 --2- 172.21.15.153:0/1064603118 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ad80cb7e0 0x7f7ad8162940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.493+0000 7f7add365700 1 --2- 172.21.15.153:0/1064603118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ad8072260 0x7f7ad8158f50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.493+0000 7f7add365700 1 --2- 172.21.15.153:0/1064603118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad806bdb0 0x7f7ad80c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.493+0000 7f7add365700 1 -- 172.21.15.153:0/1064603118 >> 172.21.15.153:0/1064603118 conn(0x7f7ad80b01d0 msgr2=0x7f7ad80b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:25.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.493+0000 7f7add365700 1 -- 172.21.15.153:0/1064603118 shutdown_connections 2024-09-13T17:06:25.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.493+0000 7f7add365700 1 -- 172.21.15.153:0/1064603118 wait complete. 2024-09-13T17:06:25.513 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 2e5f2e54-c6da-4917-ae3a-27e990c44c46 2 2024-09-13T17:06:25.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85c5e7c700 1 Processor -- start 2024-09-13T17:06:25.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85c5e7c700 1 -- start start 2024-09-13T17:06:25.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85c5e7c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f85c0071760 0x7f85c00b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85c5e7c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c00cc030 con 0x7f85c01597c0 2024-09-13T17:06:25.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85c5e7c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c00b2e60 con 0x7f85c006dc70 2024-09-13T17:06:25.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85c5e7c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c00b17d0 con 0x7f85c0071760 2024-09-13T17:06:25.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85bffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f85c0071760 0x7f85c00b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85bffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f85c0071760 0x7f85c00b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41900/0 (socket says 172.21.15.153:41900) 2024-09-13T17:06:25.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85bffff700 1 -- 172.21.15.153:0/1746312990 learned_addr learned my addr 172.21.15.153:0/1746312990 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-13T17:06:25.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85bffff700 1 -- 172.21.15.153:0/1746312990 >> v1:172.21.15.153:6789/0 conn(0x7f85c006dc70 legacy=0x7f85c00cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85bffff700 1 -- 172.21.15.153:0/1746312990 >> v1:172.21.15.123:6789/0 conn(0x7f85c01597c0 legacy=0x7f85c0071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85bffff700 1 -- 172.21.15.153:0/1746312990 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c00b25c0 con 0x7f85c0071760 2024-09-13T17:06:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85bffff700 1 --2- 172.21.15.153:0/1746312990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c0071760 0x7f85c00b1f30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009940 tx=0x7f85b4009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94b6aab9762caa35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85bf7fe700 1 -- 172.21.15.153:0/1746312990 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4004230 con 0x7f85c0071760 2024-09-13T17:06:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85bf7fe700 1 -- 172.21.15.153:0/1746312990 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b4009e90 con 0x7f85c0071760 2024-09-13T17:06:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85bf7fe700 1 -- 172.21.15.153:0/1746312990 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b40045b0 con 0x7f85c0071760 2024-09-13T17:06:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85c5e7c700 1 -- 172.21.15.153:0/1746312990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c0071760 msgr2=0x7f85c00b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85c5e7c700 1 --2- 172.21.15.153:0/1746312990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c0071760 0x7f85c00b1f30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009940 tx=0x7f85b4009c50 comp rx=0 tx=0).stop 2024-09-13T17:06:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85c5e7c700 1 -- 172.21.15.153:0/1746312990 shutdown_connections 2024-09-13T17:06:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85c5e7c700 1 --2- 172.21.15.153:0/1746312990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c0071760 0x7f85c00b1f30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85c5e7c700 1 -- 172.21.15.153:0/1746312990 >> 172.21.15.153:0/1746312990 conn(0x7f85c006f940 msgr2=0x7f85c00b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85c5e7c700 1 -- 172.21.15.153:0/1746312990 shutdown_connections 2024-09-13T17:06:25.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.625+0000 7f85c5e7c700 1 -- 172.21.15.153:0/1746312990 wait complete. 2024-09-13T17:06:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c5e7c700 1 Processor -- start 2024-09-13T17:06:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c5e7c700 1 -- start start 2024-09-13T17:06:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c5e7c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85c006dc70 0x7f85c013c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c5e7c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c0071760 0x7f85c014ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c5e7c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c01597c0 0x7f85c01580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c5e7c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c014c9c0 con 0x7f85c01597c0 2024-09-13T17:06:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c5e7c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c014d820 con 0x7f85c0071760 2024-09-13T17:06:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c5e7c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c013ce80 con 0x7f85c006dc70 2024-09-13T17:06:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c4e7a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85c006dc70 0x7f85c013c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85bffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c0071760 0x7f85c014ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c4e7a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85c006dc70 0x7f85c013c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:34814/0 (socket says 172.21.15.153:34814) 2024-09-13T17:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c4e7a700 1 -- 172.21.15.153:0/1946197047 learned_addr learned my addr 172.21.15.153:0/1946197047 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-13T17:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c567b700 1 --2- 172.21.15.153:0/1946197047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c01597c0 0x7f85c01580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85bffff700 1 -- 172.21.15.153:0/1946197047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85c006dc70 msgr2=0x7f85c013c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85bffff700 1 --2- 172.21.15.153:0/1946197047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85c006dc70 0x7f85c013c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85bffff700 1 -- 172.21.15.153:0/1946197047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c01597c0 msgr2=0x7f85c01580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85bffff700 1 --2- 172.21.15.153:0/1946197047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c01597c0 0x7f85c01580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85bffff700 1 -- 172.21.15.153:0/1946197047 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b4009570 con 0x7f85c0071760 2024-09-13T17:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c567b700 1 --2- 172.21.15.153:0/1946197047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c01597c0 0x7f85c01580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c4e7a700 1 --2- 172.21.15.153:0/1946197047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85c006dc70 0x7f85c013c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85bffff700 1 --2- 172.21.15.153:0/1946197047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c0071760 0x7f85c014ae70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f85b4017000 tx=0x7f85b4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85bd7fa700 1 -- 172.21.15.153:0/1946197047 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b401f070 con 0x7f85c0071760 2024-09-13T17:06:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85bd7fa700 1 -- 172.21.15.153:0/1946197047 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b40038d0 con 0x7f85c0071760 2024-09-13T17:06:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c5e7c700 1 -- 172.21.15.153:0/1946197047 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c014dcb0 con 0x7f85c0071760 2024-09-13T17:06:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85bd7fa700 1 -- 172.21.15.153:0/1946197047 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4003c80 con 0x7f85c0071760 2024-09-13T17:06:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.629+0000 7f85c5e7c700 1 -- 172.21.15.153:0/1946197047 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c014cef0 con 0x7f85c0071760 2024-09-13T17:06:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.633+0000 7f85bd7fa700 1 -- 172.21.15.153:0/1946197047 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f85b4010770 con 0x7f85c0071760 2024-09-13T17:06:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.633+0000 7f85bd7fa700 1 -- 172.21.15.153:0/1946197047 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f85b4019810 con 0x7f85c0071760 2024-09-13T17:06:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.633+0000 7f85c5e7c700 1 -- 172.21.15.153:0/1946197047 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c00b1f30 con 0x7f85c0071760 2024-09-13T17:06:25.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.637+0000 7f85bd7fa700 1 -- 172.21.15.153:0/1946197047 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f85b4028070 con 0x7f85c0071760 2024-09-13T17:06:25.693 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:25.689+0000 7feaff43d2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:06:25.696 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:25.691+0000 7f72f46622c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:06:25.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.709+0000 7f85c5e7c700 1 -- 172.21.15.153:0/1946197047 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2e5f2e54-c6da-4917-ae3a-27e990c44c46", "id": 2} v 0) v1 -- 0x7f85c0157760 con 0x7f85c0071760 2024-09-13T17:06:25.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.721+0000 7f85bd7fa700 1 -- 172.21.15.153:0/1946197047 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e5f2e54-c6da-4917-ae3a-27e990c44c46", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f85b4010c00 con 0x7f85c0071760 2024-09-13T17:06:25.725 INFO:teuthology.orchestra.run.smithi153.stdout:2 2024-09-13T17:06:25.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.721+0000 7f85c5e7c700 1 -- 172.21.15.153:0/1946197047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c0071760 msgr2=0x7f85c014ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.721+0000 7f85c5e7c700 1 --2- 172.21.15.153:0/1946197047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c0071760 0x7f85c014ae70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f85b4017000 tx=0x7f85b4004770 comp rx=0 tx=0).stop 2024-09-13T17:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.721+0000 7f85c5e7c700 1 -- 172.21.15.153:0/1946197047 shutdown_connections 2024-09-13T17:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.721+0000 7f85c5e7c700 1 --2- 172.21.15.153:0/1946197047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c01597c0 0x7f85c01580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.721+0000 7f85c5e7c700 1 --2- 172.21.15.153:0/1946197047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c0071760 0x7f85c014ae70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.721+0000 7f85c5e7c700 1 --2- 172.21.15.153:0/1946197047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85c006dc70 0x7f85c013c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.721+0000 7f85c5e7c700 1 -- 172.21.15.153:0/1946197047 >> 172.21.15.153:0/1946197047 conn(0x7f85c006f940 msgr2=0x7f85c00cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.721+0000 7f85c5e7c700 1 -- 172.21.15.153:0/1946197047 shutdown_connections 2024-09-13T17:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.721+0000 7f85c5e7c700 1 -- 172.21.15.153:0/1946197047 wait complete. 2024-09-13T17:06:25.740 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 9607b19e-7c56-4054-858f-79d8ffd7c447 3 2024-09-13T17:06:25.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.845+0000 7f66a83fb700 1 Processor -- start 2024-09-13T17:06:25.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.845+0000 7f66a83fb700 1 -- start start 2024-09-13T17:06:25.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.845+0000 7f66a83fb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66a00b1b90 0x7f66a00b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.845+0000 7f66a83fb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f66a006a2f0 0x7f66a00cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a83fb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a0160940 con 0x7f66a00cf450 2024-09-13T17:06:25.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a83fb700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a00b24b0 con 0x7f66a006a2f0 2024-09-13T17:06:25.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a83fb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a006b0d0 con 0x7f66a00b1b90 2024-09-13T17:06:25.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a6998700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f66a00cf450 0x7f66a015d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33548/0 (socket says 172.21.15.153:33548) 2024-09-13T17:06:25.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a6197700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66a00b1b90 0x7f66a00b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a6998700 1 -- 172.21.15.153:0/3214376458 learned_addr learned my addr 172.21.15.153:0/3214376458 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-09-13T17:06:25.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a5996700 1 --2- 172.21.15.153:0/3214376458 >> v2:172.21.15.123:3300/0 conn(0x7f66a006a2f0 0x7f66a00cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a5195700 1 -- 172.21.15.153:0/3214376458 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852390171 0 0) 0x7f66a0160940 con 0x7f66a00cf450 2024-09-13T17:06:25.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a5195700 1 -- 172.21.15.153:0/3214376458 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f668c0035d0 con 0x7f66a00cf450 2024-09-13T17:06:25.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a6197700 1 -- 172.21.15.153:0/3214376458 >> v2:172.21.15.123:3300/0 conn(0x7f66a006a2f0 msgr2=0x7f66a00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:25.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a6197700 1 --2- 172.21.15.153:0/3214376458 >> v2:172.21.15.123:3300/0 conn(0x7f66a006a2f0 0x7f66a00cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a6197700 1 -- 172.21.15.153:0/3214376458 >> v1:172.21.15.153:6789/0 conn(0x7f66a00cf450 legacy=0x7f66a015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a6197700 1 -- 172.21.15.153:0/3214376458 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a006b3b0 con 0x7f66a00b1b90 2024-09-13T17:06:25.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a6197700 1 --2- 172.21.15.153:0/3214376458 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66a00b1b90 0x7f66a00b1f70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f669c009850 tx=0x7f669c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=212c4b8dc177e4ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:25.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a5195700 1 -- 172.21.15.153:0/3214376458 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c011830 con 0x7f66a00b1b90 2024-09-13T17:06:25.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a5195700 1 -- 172.21.15.153:0/3214376458 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c011990 con 0x7f66a00b1b90 2024-09-13T17:06:25.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a5195700 1 -- 172.21.15.153:0/3214376458 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c011d40 con 0x7f66a00b1b90 2024-09-13T17:06:25.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a83fb700 1 -- 172.21.15.153:0/3214376458 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66a00b1b90 msgr2=0x7f66a00b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a83fb700 1 --2- 172.21.15.153:0/3214376458 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66a00b1b90 0x7f66a00b1f70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f669c009850 tx=0x7f669c009b60 comp rx=0 tx=0).stop 2024-09-13T17:06:25.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a83fb700 1 -- 172.21.15.153:0/3214376458 shutdown_connections 2024-09-13T17:06:25.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a83fb700 1 --2- 172.21.15.153:0/3214376458 >> v2:172.21.15.123:3300/0 conn(0x7f66a006a2f0 0x7f66a00cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a83fb700 1 --2- 172.21.15.153:0/3214376458 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66a00b1b90 0x7f66a00b1f70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a83fb700 1 -- 172.21.15.153:0/3214376458 >> 172.21.15.153:0/3214376458 conn(0x7f66a00cfde0 msgr2=0x7f66a00d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:25.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a83fb700 1 -- 172.21.15.153:0/3214376458 shutdown_connections 2024-09-13T17:06:25.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a83fb700 1 -- 172.21.15.153:0/3214376458 wait complete. 2024-09-13T17:06:25.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a83fb700 1 Processor -- start 2024-09-13T17:06:25.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.849+0000 7f66a83fb700 1 -- start start 2024-09-13T17:06:25.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a83fb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66a006a2f0 0x7f66a01558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a83fb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66a00b1b90 0x7f66a0158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a83fb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a00cf450 0x7f66a0158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:25.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a83fb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00adfb0 con 0x7f66a00cf450 2024-09-13T17:06:25.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a83fb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00acf30 con 0x7f66a006a2f0 2024-09-13T17:06:25.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a83fb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00ad210 con 0x7f66a00b1b90 2024-09-13T17:06:25.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a5996700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66a00b1b90 0x7f66a0158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a6197700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66a006a2f0 0x7f66a01558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a5996700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66a00b1b90 0x7f66a0158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:34836/0 (socket says 172.21.15.153:34836) 2024-09-13T17:06:25.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a5996700 1 -- 172.21.15.153:0/1962762342 learned_addr learned my addr 172.21.15.153:0/1962762342 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-13T17:06:25.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a6998700 1 --2- 172.21.15.153:0/1962762342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a00cf450 0x7f66a0158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:25.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a5996700 1 -- 172.21.15.153:0/1962762342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66a006a2f0 msgr2=0x7f66a01558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a5996700 1 --2- 172.21.15.153:0/1962762342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66a006a2f0 0x7f66a01558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a5996700 1 -- 172.21.15.153:0/1962762342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a00cf450 msgr2=0x7f66a0158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a5996700 1 --2- 172.21.15.153:0/1962762342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a00cf450 0x7f66a0158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a5996700 1 -- 172.21.15.153:0/1962762342 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c0094b0 con 0x7f66a00b1b90 2024-09-13T17:06:25.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a5996700 1 --2- 172.21.15.153:0/1962762342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66a00b1b90 0x7f66a0158810 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f669000e960 tx=0x7f669000ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:25.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f6696ffd700 1 -- 172.21.15.153:0/1962762342 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900096c0 con 0x7f66a00b1b90 2024-09-13T17:06:25.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f6696ffd700 1 -- 172.21.15.153:0/1962762342 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6690013680 con 0x7f66a00b1b90 2024-09-13T17:06:25.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a83fb700 1 -- 172.21.15.153:0/1962762342 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a00ad4f0 con 0x7f66a00b1b90 2024-09-13T17:06:25.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f6696ffd700 1 -- 172.21.15.153:0/1962762342 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900139f0 con 0x7f66a00b1b90 2024-09-13T17:06:25.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f66a83fb700 1 -- 172.21.15.153:0/1962762342 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a00adab0 con 0x7f66a00b1b90 2024-09-13T17:06:25.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f6696ffd700 1 -- 172.21.15.153:0/1962762342 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6690005a40 con 0x7f66a00b1b90 2024-09-13T17:06:25.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.853+0000 7f6696ffd700 1 -- 172.21.15.153:0/1962762342 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6690006820 con 0x7f66a00b1b90 2024-09-13T17:06:25.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.857+0000 7f66a83fb700 1 -- 172.21.15.153:0/1962762342 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a00cef10 con 0x7f66a00b1b90 2024-09-13T17:06:25.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.857+0000 7f6696ffd700 1 -- 172.21.15.153:0/1962762342 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f6690021060 con 0x7f66a00b1b90 2024-09-13T17:06:25.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.929+0000 7f66a83fb700 1 -- 172.21.15.153:0/1962762342 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9607b19e-7c56-4054-858f-79d8ffd7c447", "id": 3} v 0) v1 -- 0x7f66a015d9a0 con 0x7f66a00b1b90 2024-09-13T17:06:25.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.937+0000 7f6696ffd700 1 -- 172.21.15.153:0/1962762342 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9607b19e-7c56-4054-858f-79d8ffd7c447", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6690017070 con 0x7f66a00b1b90 2024-09-13T17:06:25.942 INFO:teuthology.orchestra.run.smithi153.stdout:3 2024-09-13T17:06:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.937+0000 7f66a83fb700 1 -- 172.21.15.153:0/1962762342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66a00b1b90 msgr2=0x7f66a0158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.937+0000 7f66a83fb700 1 --2- 172.21.15.153:0/1962762342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66a00b1b90 0x7f66a0158810 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f669000e960 tx=0x7f669000ec70 comp rx=0 tx=0).stop 2024-09-13T17:06:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.937+0000 7f66a83fb700 1 -- 172.21.15.153:0/1962762342 shutdown_connections 2024-09-13T17:06:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.937+0000 7f66a83fb700 1 --2- 172.21.15.153:0/1962762342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a00cf450 0x7f66a0158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.937+0000 7f66a83fb700 1 --2- 172.21.15.153:0/1962762342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66a00b1b90 0x7f66a0158810 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.937+0000 7f66a83fb700 1 --2- 172.21.15.153:0/1962762342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66a006a2f0 0x7f66a01558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.937+0000 7f66a83fb700 1 -- 172.21.15.153:0/1962762342 >> 172.21.15.153:0/1962762342 conn(0x7f66a00cfde0 msgr2=0x7f66a006d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.937+0000 7f66a83fb700 1 -- 172.21.15.153:0/1962762342 shutdown_connections 2024-09-13T17:06:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:25.937+0000 7f66a83fb700 1 -- 172.21.15.153:0/1962762342 wait complete. 2024-09-13T17:06:25.956 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 46839187-e0d6-48e9-9eda-79f2604f3201 4 2024-09-13T17:06:26.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.057+0000 7f4e66ed0700 1 Processor -- start 2024-09-13T17:06:26.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.057+0000 7f4e66ed0700 1 -- start start 2024-09-13T17:06:26.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e66ed0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6006f990 0x7f4e600c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e66ed0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4e6015cfc0 0x7f4e600cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e66ed0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e600c9b80 con 0x7f4e6015cbe0 2024-09-13T17:06:26.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e66ed0700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e600c9db0 con 0x7f4e6015cfc0 2024-09-13T17:06:26.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e66ed0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e600cc3d0 con 0x7f4e6006f990 2024-09-13T17:06:26.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e5ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6006f990 0x7f4e600c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e5ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6006f990 0x7f4e600c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:34852/0 (socket says 172.21.15.153:34852) 2024-09-13T17:06:26.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e5ffff700 1 -- 172.21.15.153:0/2929940700 learned_addr learned my addr 172.21.15.153:0/2929940700 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-13T17:06:26.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e6546d700 1 --2- 172.21.15.153:0/2929940700 >> v2:172.21.15.123:3300/0 conn(0x7f4e6015cfc0 0x7f4e600cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e5ffff700 1 -- 172.21.15.153:0/2929940700 >> v2:172.21.15.123:3300/0 conn(0x7f4e6015cfc0 msgr2=0x7f4e600cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:26.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e5ffff700 1 --2- 172.21.15.153:0/2929940700 >> v2:172.21.15.123:3300/0 conn(0x7f4e6015cfc0 0x7f4e600cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e5ffff700 1 -- 172.21.15.153:0/2929940700 >> v1:172.21.15.123:6789/0 conn(0x7f4e6015cbe0 legacy=0x7f4e6006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e5ffff700 1 -- 172.21.15.153:0/2929940700 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e600cc6b0 con 0x7f4e6006f990 2024-09-13T17:06:26.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e5ffff700 1 --2- 172.21.15.153:0/2929940700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6006f990 0x7f4e600c9640 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009910 tx=0x7f4e54009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=778de5682b6d1d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:26.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e5f7fe700 1 -- 172.21.15.153:0/2929940700 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400ba60 con 0x7f4e6006f990 2024-09-13T17:06:26.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e5f7fe700 1 -- 172.21.15.153:0/2929940700 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5400bbc0 con 0x7f4e6006f990 2024-09-13T17:06:26.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e5f7fe700 1 -- 172.21.15.153:0/2929940700 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54009e60 con 0x7f4e6006f990 2024-09-13T17:06:26.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e66ed0700 1 -- 172.21.15.153:0/2929940700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6006f990 msgr2=0x7f4e600c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e66ed0700 1 --2- 172.21.15.153:0/2929940700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6006f990 0x7f4e600c9640 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009910 tx=0x7f4e54009c20 comp rx=0 tx=0).stop 2024-09-13T17:06:26.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e66ed0700 1 -- 172.21.15.153:0/2929940700 shutdown_connections 2024-09-13T17:06:26.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e66ed0700 1 --2- 172.21.15.153:0/2929940700 >> v2:172.21.15.123:3300/0 conn(0x7f4e6015cfc0 0x7f4e600cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e66ed0700 1 --2- 172.21.15.153:0/2929940700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6006f990 0x7f4e600c9640 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e66ed0700 1 -- 172.21.15.153:0/2929940700 >> 172.21.15.153:0/2929940700 conn(0x7f4e60073380 msgr2=0x7f4e60066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:26.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e66ed0700 1 -- 172.21.15.153:0/2929940700 shutdown_connections 2024-09-13T17:06:26.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.061+0000 7f4e66ed0700 1 -- 172.21.15.153:0/2929940700 wait complete. 2024-09-13T17:06:26.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e66ed0700 1 Processor -- start 2024-09-13T17:06:26.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e66ed0700 1 -- start start 2024-09-13T17:06:26.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e66ed0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e6006f990 0x7f4e6014c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e66ed0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e6015cbe0 0x7f4e60153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e66ed0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6015cfc0 0x7f4e60154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e66ed0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6014c670 con 0x7f4e6015cbe0 2024-09-13T17:06:26.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e66ed0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60158e00 con 0x7f4e6006f990 2024-09-13T17:06:26.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e66ed0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60158280 con 0x7f4e6015cfc0 2024-09-13T17:06:26.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e6546d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6015cfc0 0x7f4e60154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e64c6c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e6006f990 0x7f4e6014c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e6546d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6015cfc0 0x7f4e60154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:34854/0 (socket says 172.21.15.153:34854) 2024-09-13T17:06:26.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e6546d700 1 -- 172.21.15.153:0/2939959282 learned_addr learned my addr 172.21.15.153:0/2939959282 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-13T17:06:26.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e5ffff700 1 --2- 172.21.15.153:0/2939959282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e6015cbe0 0x7f4e60153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e6546d700 1 -- 172.21.15.153:0/2939959282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e6006f990 msgr2=0x7f4e6014c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e6546d700 1 --2- 172.21.15.153:0/2939959282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e6006f990 0x7f4e6014c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e6546d700 1 -- 172.21.15.153:0/2939959282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e6015cbe0 msgr2=0x7f4e60153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e6546d700 1 --2- 172.21.15.153:0/2939959282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e6015cbe0 0x7f4e60153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e6546d700 1 -- 172.21.15.153:0/2939959282 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e54009570 con 0x7f4e6015cfc0 2024-09-13T17:06:26.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e64c6c700 1 --2- 172.21.15.153:0/2939959282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e6006f990 0x7f4e6014c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:26.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e6546d700 1 --2- 172.21.15.153:0/2939959282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6015cfc0 0x7f4e60154470 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800e810 tx=0x7f4e5800eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:26.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e5d7fa700 1 -- 172.21.15.153:0/2939959282 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58013610 con 0x7f4e6015cfc0 2024-09-13T17:06:26.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e5d7fa700 1 -- 172.21.15.153:0/2939959282 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e58013770 con 0x7f4e6015cfc0 2024-09-13T17:06:26.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e66ed0700 1 -- 172.21.15.153:0/2939959282 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e60158560 con 0x7f4e6015cfc0 2024-09-13T17:06:26.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e5d7fa700 1 -- 172.21.15.153:0/2939959282 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58013b20 con 0x7f4e6015cfc0 2024-09-13T17:06:26.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e66ed0700 1 -- 172.21.15.153:0/2939959282 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e60158b20 con 0x7f4e6015cfc0 2024-09-13T17:06:26.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e5d7fa700 1 -- 172.21.15.153:0/2939959282 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4e5801c450 con 0x7f4e6015cfc0 2024-09-13T17:06:26.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.065+0000 7f4e5d7fa700 1 -- 172.21.15.153:0/2939959282 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f4e5801cc10 con 0x7f4e6015cfc0 2024-09-13T17:06:26.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.069+0000 7f4e66ed0700 1 -- 172.21.15.153:0/2939959282 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e600af0c0 con 0x7f4e6015cfc0 2024-09-13T17:06:26.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.073+0000 7f4e5d7fa700 1 -- 172.21.15.153:0/2939959282 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f4e5803be30 con 0x7f4e6015cfc0 2024-09-13T17:06:26.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.149+0000 7f4e66ed0700 1 -- 172.21.15.153:0/2939959282 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "46839187-e0d6-48e9-9eda-79f2604f3201", "id": 4} v 0) v1 -- 0x7f4e600b37c0 con 0x7f4e6015cfc0 2024-09-13T17:06:26.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.153+0000 7f4e5d7fa700 1 -- 172.21.15.153:0/2939959282 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46839187-e0d6-48e9-9eda-79f2604f3201", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4e5802a070 con 0x7f4e6015cfc0 2024-09-13T17:06:26.159 INFO:teuthology.orchestra.run.smithi153.stdout:4 2024-09-13T17:06:26.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.153+0000 7f4e66ed0700 1 -- 172.21.15.153:0/2939959282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6015cfc0 msgr2=0x7f4e60154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.153+0000 7f4e66ed0700 1 --2- 172.21.15.153:0/2939959282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6015cfc0 0x7f4e60154470 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800e810 tx=0x7f4e5800eb20 comp rx=0 tx=0).stop 2024-09-13T17:06:26.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.157+0000 7f4e66ed0700 1 -- 172.21.15.153:0/2939959282 shutdown_connections 2024-09-13T17:06:26.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.157+0000 7f4e66ed0700 1 --2- 172.21.15.153:0/2939959282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6015cfc0 0x7f4e60154470 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.157+0000 7f4e66ed0700 1 --2- 172.21.15.153:0/2939959282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e6015cbe0 0x7f4e60153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.157+0000 7f4e66ed0700 1 --2- 172.21.15.153:0/2939959282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e6006f990 0x7f4e6014c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.157+0000 7f4e66ed0700 1 -- 172.21.15.153:0/2939959282 >> 172.21.15.153:0/2939959282 conn(0x7f4e60073380 msgr2=0x7f4e600cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:26.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.157+0000 7f4e66ed0700 1 -- 172.21.15.153:0/2939959282 shutdown_connections 2024-09-13T17:06:26.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.157+0000 7f4e66ed0700 1 -- 172.21.15.153:0/2939959282 wait complete. 2024-09-13T17:06:26.172 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 38b885f1-f1d4-4f1a-8d32-d5092dd9b69c 5 2024-09-13T17:06:26.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.277+0000 7f4eb24d2700 1 Processor -- start 2024-09-13T17:06:26.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.277+0000 7f4eb24d2700 1 -- start start 2024-09-13T17:06:26.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.277+0000 7f4eb24d2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4eac1506b0 0x7f4eac0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.277+0000 7f4eb24d2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4eac0b4990 0x7f4eac15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.277+0000 7f4eb24d2700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eac0b3310 con 0x7f4eac0b37a0 2024-09-13T17:06:26.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.277+0000 7f4eb24d2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac0b4e00 con 0x7f4eac0b4990 2024-09-13T17:06:26.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.277+0000 7f4eb24d2700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac15e280 con 0x7f4eac1506b0 2024-09-13T17:06:26.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb14d0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4eac1506b0 0x7f4eac0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb14d0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4eac1506b0 0x7f4eac0b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41926/0 (socket says 172.21.15.153:41926) 2024-09-13T17:06:26.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb0ccf700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4eac0b37a0 0x7f4eac15d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33554/0 (socket says 172.21.15.153:33554) 2024-09-13T17:06:26.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb14d0700 1 -- 172.21.15.153:0/1890231897 learned_addr learned my addr 172.21.15.153:0/1890231897 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-13T17:06:26.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb1cd1700 1 --2- 172.21.15.153:0/1890231897 >> v2:172.21.15.123:3300/0 conn(0x7f4eac0b4990 0x7f4eac15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb14d0700 1 -- 172.21.15.153:0/1890231897 >> v2:172.21.15.123:3300/0 conn(0x7f4eac0b4990 msgr2=0x7f4eac15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:26.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb14d0700 1 --2- 172.21.15.153:0/1890231897 >> v2:172.21.15.123:3300/0 conn(0x7f4eac0b4990 0x7f4eac15dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb14d0700 1 -- 172.21.15.153:0/1890231897 >> v1:172.21.15.153:6789/0 conn(0x7f4eac0b37a0 legacy=0x7f4eac15d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4ea3fff700 1 -- 172.21.15.153:0/1890231897 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219684217 0 0) 0x7f4eac0b3310 con 0x7f4eac0b37a0 2024-09-13T17:06:26.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb14d0700 1 -- 172.21.15.153:0/1890231897 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0b29e0 con 0x7f4eac1506b0 2024-09-13T17:06:26.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb14d0700 1 --2- 172.21.15.153:0/1890231897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4eac1506b0 0x7f4eac0b4450 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0b4f80 tx=0x7f4ea800be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c525ce28556f6a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:26.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4ea3fff700 1 -- 172.21.15.153:0/1890231897 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea800dd30 con 0x7f4eac1506b0 2024-09-13T17:06:26.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4ea3fff700 1 -- 172.21.15.153:0/1890231897 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea800de90 con 0x7f4eac1506b0 2024-09-13T17:06:26.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4ea3fff700 1 -- 172.21.15.153:0/1890231897 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8010690 con 0x7f4eac1506b0 2024-09-13T17:06:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb24d2700 1 -- 172.21.15.153:0/1890231897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4eac1506b0 msgr2=0x7f4eac0b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb24d2700 1 --2- 172.21.15.153:0/1890231897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4eac1506b0 0x7f4eac0b4450 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0b4f80 tx=0x7f4ea800be90 comp rx=0 tx=0).stop 2024-09-13T17:06:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb24d2700 1 -- 172.21.15.153:0/1890231897 shutdown_connections 2024-09-13T17:06:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb24d2700 1 --2- 172.21.15.153:0/1890231897 >> v2:172.21.15.123:3300/0 conn(0x7f4eac0b4990 0x7f4eac15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb24d2700 1 --2- 172.21.15.153:0/1890231897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4eac1506b0 0x7f4eac0b4450 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb24d2700 1 -- 172.21.15.153:0/1890231897 >> 172.21.15.153:0/1890231897 conn(0x7f4eac066780 msgr2=0x7f4eac0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb24d2700 1 -- 172.21.15.153:0/1890231897 shutdown_connections 2024-09-13T17:06:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb24d2700 1 -- 172.21.15.153:0/1890231897 wait complete. 2024-09-13T17:06:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb24d2700 1 Processor -- start 2024-09-13T17:06:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.281+0000 7f4eb24d2700 1 -- start start 2024-09-13T17:06:26.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb24d2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4eac0b37a0 0x7f4eac154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb24d2700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4eac0b4990 0x7f4eac158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb24d2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4eac1506b0 0x7f4eac157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb24d2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac159330 con 0x7f4eac0b37a0 2024-09-13T17:06:26.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb24d2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac1eeba0 con 0x7f4eac1506b0 2024-09-13T17:06:26.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb24d2700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac14ceb0 con 0x7f4eac0b4990 2024-09-13T17:06:26.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb1cd1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4eac1506b0 0x7f4eac157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb1cd1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4eac1506b0 0x7f4eac157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41942/0 (socket says 172.21.15.153:41942) 2024-09-13T17:06:26.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb1cd1700 1 -- 172.21.15.153:0/621047751 learned_addr learned my addr 172.21.15.153:0/621047751 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-13T17:06:26.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb14d0700 1 --2- 172.21.15.153:0/621047751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4eac0b37a0 0x7f4eac154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb0ccf700 1 --2- 172.21.15.153:0/621047751 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4eac0b4990 0x7f4eac158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb1cd1700 1 -- 172.21.15.153:0/621047751 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4eac0b4990 msgr2=0x7f4eac158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb1cd1700 1 --2- 172.21.15.153:0/621047751 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4eac0b4990 0x7f4eac158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb1cd1700 1 -- 172.21.15.153:0/621047751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4eac0b37a0 msgr2=0x7f4eac154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb1cd1700 1 --2- 172.21.15.153:0/621047751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4eac0b37a0 0x7f4eac154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb1cd1700 1 -- 172.21.15.153:0/621047751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea800b810 con 0x7f4eac1506b0 2024-09-13T17:06:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb0ccf700 1 --2- 172.21.15.153:0/621047751 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4eac0b4990 0x7f4eac158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb14d0700 1 --2- 172.21.15.153:0/621047751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4eac0b37a0 0x7f4eac154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb1cd1700 1 --2- 172.21.15.153:0/621047751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4eac1506b0 0x7f4eac157940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400ec10 tx=0x7f4ea400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4ea1ffb700 1 -- 172.21.15.153:0/621047751 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea400ca00 con 0x7f4eac1506b0 2024-09-13T17:06:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4ea1ffb700 1 -- 172.21.15.153:0/621047751 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea400f040 con 0x7f4eac1506b0 2024-09-13T17:06:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb24d2700 1 -- 172.21.15.153:0/621047751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac14d190 con 0x7f4eac1506b0 2024-09-13T17:06:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4ea1ffb700 1 -- 172.21.15.153:0/621047751 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea400cda0 con 0x7f4eac1506b0 2024-09-13T17:06:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb24d2700 1 -- 172.21.15.153:0/621047751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac14d750 con 0x7f4eac1506b0 2024-09-13T17:06:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4ea1ffb700 1 -- 172.21.15.153:0/621047751 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4ea4014780 con 0x7f4eac1506b0 2024-09-13T17:06:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4ea1ffb700 1 -- 172.21.15.153:0/621047751 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f4ea4013960 con 0x7f4eac1506b0 2024-09-13T17:06:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.285+0000 7f4eb24d2700 1 -- 172.21.15.153:0/621047751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eac0b4450 con 0x7f4eac1506b0 2024-09-13T17:06:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.289+0000 7f4ea1ffb700 1 -- 172.21.15.153:0/621047751 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f4ea4018020 con 0x7f4eac1506b0 2024-09-13T17:06:26.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.365+0000 7f4eb24d2700 1 -- 172.21.15.153:0/621047751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "38b885f1-f1d4-4f1a-8d32-d5092dd9b69c", "id": 5} v 0) v1 -- 0x7f4eac157550 con 0x7f4eac1506b0 2024-09-13T17:06:26.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.369+0000 7f4ea1ffb700 1 -- 172.21.15.153:0/621047751 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "38b885f1-f1d4-4f1a-8d32-d5092dd9b69c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4ea401d400 con 0x7f4eac1506b0 2024-09-13T17:06:26.375 INFO:teuthology.orchestra.run.smithi153.stdout:5 2024-09-13T17:06:26.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.369+0000 7f4eb24d2700 1 -- 172.21.15.153:0/621047751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4eac1506b0 msgr2=0x7f4eac157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.369+0000 7f4eb24d2700 1 --2- 172.21.15.153:0/621047751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4eac1506b0 0x7f4eac157940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400ec10 tx=0x7f4ea400ef20 comp rx=0 tx=0).stop 2024-09-13T17:06:26.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.373+0000 7f4eb24d2700 1 -- 172.21.15.153:0/621047751 shutdown_connections 2024-09-13T17:06:26.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.373+0000 7f4eb24d2700 1 --2- 172.21.15.153:0/621047751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4eac1506b0 0x7f4eac157940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.373+0000 7f4eb24d2700 1 --2- 172.21.15.153:0/621047751 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4eac0b4990 0x7f4eac158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.373+0000 7f4eb24d2700 1 --2- 172.21.15.153:0/621047751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4eac0b37a0 0x7f4eac154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.373+0000 7f4eb24d2700 1 -- 172.21.15.153:0/621047751 >> 172.21.15.153:0/621047751 conn(0x7f4eac066780 msgr2=0x7f4eac14abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:26.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.373+0000 7f4eb24d2700 1 -- 172.21.15.153:0/621047751 shutdown_connections 2024-09-13T17:06:26.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.373+0000 7f4eb24d2700 1 -- 172.21.15.153:0/621047751 wait complete. 2024-09-13T17:06:26.388 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 6cee067d-ae45-45f3-9a3c-7f50be869c9a 6 2024-09-13T17:06:26.415 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:26.411+0000 7f72f46622c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:06:26.473 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:26.467+0000 7f72f46622c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:06:26.485 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:26.481+0000 7feaff43d2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:06:26.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.501+0000 7feb2f85e700 1 Processor -- start 2024-09-13T17:06:26.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.501+0000 7feb2f85e700 1 -- start start 2024-09-13T17:06:26.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.501+0000 7feb2f85e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feb2806a260 0x7feb2806a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.501+0000 7feb2f85e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2806d1d0 con 0x7feb28159830 2024-09-13T17:06:26.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.501+0000 7feb2f85e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2806d400 con 0x7feb28159c10 2024-09-13T17:06:26.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.501+0000 7feb2f85e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2806ac30 con 0x7feb2806a260 2024-09-13T17:06:26.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.501+0000 7feb2cdf9700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7feb28159c10 0x7feb280ca8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33566/0 (socket says 172.21.15.153:33566) 2024-09-13T17:06:26.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.501+0000 7feb2cdf9700 1 -- 172.21.15.153:0/2244820906 learned_addr learned my addr 172.21.15.153:0/2244820906 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-09-13T17:06:26.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2ddfb700 1 --2- 172.21.15.153:0/2244820906 >> v2:172.21.15.123:3300/0 conn(0x7feb2806a260 0x7feb2806a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930548625 0 0) 0x7feb2806d400 con 0x7feb28159c10 2024-09-13T17:06:26.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb140035d0 con 0x7feb28159c10 2024-09-13T17:06:26.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744684010 0 0) 0x7feb2806d1d0 con 0x7feb28159830 2024-09-13T17:06:26.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb2806d400 con 0x7feb28159830 2024-09-13T17:06:26.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276363798 0 0) 0x7feb140035d0 con 0x7feb28159c10 2024-09-13T17:06:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 >> v2:172.21.15.123:3300/0 conn(0x7feb2806a260 msgr2=0x7feb2806a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 --2- 172.21.15.153:0/2244820906 >> v2:172.21.15.123:3300/0 conn(0x7feb2806a260 0x7feb2806a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 >> v1:172.21.15.123:6789/0 conn(0x7feb28159830 legacy=0x7feb2806e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2806d6a0 con 0x7feb28159c10 2024-09-13T17:06:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7feb18001670 con 0x7feb28159c10 2024-09-13T17:06:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 >> v1:172.21.15.153:6789/0 conn(0x7feb28159c10 legacy=0x7feb280ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 --2- 172.21.15.153:0/2244820906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb14003bb0 0x7feb14003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 --2- 172.21.15.153:0/2244820906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb14004870 0x7feb14004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 --2- 172.21.15.153:0/2244820906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb14005230 0x7feb1400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2806ac30 con 0x7feb14005230 2024-09-13T17:06:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1400c0b0 con 0x7feb14004870 2024-09-13T17:06:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1400c270 con 0x7feb14003bb0 2024-09-13T17:06:26.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2cdf9700 1 --2- 172.21.15.153:0/2244820906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb14004870 0x7feb14004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2ddfb700 1 --2- 172.21.15.153:0/2244820906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb14005230 0x7feb1400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2d5fa700 1 --2- 172.21.15.153:0/2244820906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb14003bb0 0x7feb14003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2cdf9700 1 -- 172.21.15.153:0/2244820906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb14003bb0 msgr2=0x7feb14003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2cdf9700 1 --2- 172.21.15.153:0/2244820906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb14003bb0 0x7feb14003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2cdf9700 1 -- 172.21.15.153:0/2244820906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb14005230 msgr2=0x7feb1400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2cdf9700 1 --2- 172.21.15.153:0/2244820906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb14005230 0x7feb1400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2cdf9700 1 -- 172.21.15.153:0/2244820906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb140035d0 con 0x7feb14004870 2024-09-13T17:06:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2ddfb700 1 --2- 172.21.15.153:0/2244820906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb14005230 0x7feb1400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2ddfb700 1 -- 172.21.15.153:0/2244820906 reap_dead start 2024-09-13T17:06:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2cdf9700 1 --2- 172.21.15.153:0/2244820906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb14004870 0x7feb14004cf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feb18007fd0 tx=0x7feb140058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3088bc460015d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1800cd20 con 0x7feb14004870 2024-09-13T17:06:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb18001af0 con 0x7feb14004870 2024-09-13T17:06:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb1ffff700 1 -- 172.21.15.153:0/2244820906 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1800cea0 con 0x7feb14004870 2024-09-13T17:06:26.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2f85e700 1 -- 172.21.15.153:0/2244820906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb14004870 msgr2=0x7feb14004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2f85e700 1 --2- 172.21.15.153:0/2244820906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb14004870 0x7feb14004cf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feb18007fd0 tx=0x7feb140058a0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2f85e700 1 -- 172.21.15.153:0/2244820906 shutdown_connections 2024-09-13T17:06:26.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2f85e700 1 --2- 172.21.15.153:0/2244820906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb14004870 0x7feb14004cf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2f85e700 1 -- 172.21.15.153:0/2244820906 >> 172.21.15.153:0/2244820906 conn(0x7feb280b0eb0 msgr2=0x7feb280b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:26.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2f85e700 1 -- 172.21.15.153:0/2244820906 shutdown_connections 2024-09-13T17:06:26.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.505+0000 7feb2f85e700 1 -- 172.21.15.153:0/2244820906 wait complete. 2024-09-13T17:06:26.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2f85e700 1 Processor -- start 2024-09-13T17:06:26.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2f85e700 1 -- start start 2024-09-13T17:06:26.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2f85e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb14004870 0x7feb28151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2f85e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb28158320 0x7feb281587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2f85e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb280c81d0 0x7feb280c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2f85e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb280c8b90 con 0x7feb28158320 2024-09-13T17:06:26.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2f85e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb281f76a0 con 0x7feb14004870 2024-09-13T17:06:26.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2f85e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb281519c0 con 0x7feb280c81d0 2024-09-13T17:06:26.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2d5fa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb14004870 0x7feb28151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2d5fa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb14004870 0x7feb28151480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41964/0 (socket says 172.21.15.153:41964) 2024-09-13T17:06:26.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2d5fa700 1 -- 172.21.15.153:0/1318977085 learned_addr learned my addr 172.21.15.153:0/1318977085 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-13T17:06:26.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2ddfb700 1 --2- 172.21.15.153:0/1318977085 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb280c81d0 0x7feb280c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2cdf9700 1 --2- 172.21.15.153:0/1318977085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb28158320 0x7feb281587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2d5fa700 1 -- 172.21.15.153:0/1318977085 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb280c81d0 msgr2=0x7feb280c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2d5fa700 1 --2- 172.21.15.153:0/1318977085 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb280c81d0 0x7feb280c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2d5fa700 1 -- 172.21.15.153:0/1318977085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb28158320 msgr2=0x7feb281587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2d5fa700 1 --2- 172.21.15.153:0/1318977085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb28158320 0x7feb281587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2d5fa700 1 -- 172.21.15.153:0/1318977085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb281f67b0 con 0x7feb14004870 2024-09-13T17:06:26.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2cdf9700 1 --2- 172.21.15.153:0/1318977085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb28158320 0x7feb281587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:26.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2d5fa700 1 --2- 172.21.15.153:0/1318977085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb14004870 0x7feb28151480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7feb240092b0 tx=0x7feb240095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:26.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb1dffb700 1 -- 172.21.15.153:0/1318977085 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24005520 con 0x7feb14004870 2024-09-13T17:06:26.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb1dffb700 1 -- 172.21.15.153:0/1318977085 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb24006880 con 0x7feb14004870 2024-09-13T17:06:26.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2f85e700 1 -- 172.21.15.153:0/1318977085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb281f6a90 con 0x7feb14004870 2024-09-13T17:06:26.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb1dffb700 1 -- 172.21.15.153:0/1318977085 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24006c30 con 0x7feb14004870 2024-09-13T17:06:26.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2f85e700 1 -- 172.21.15.153:0/1318977085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb281f7050 con 0x7feb14004870 2024-09-13T17:06:26.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb1dffb700 1 -- 172.21.15.153:0/1318977085 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7feb24007030 con 0x7feb14004870 2024-09-13T17:06:26.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb1dffb700 1 -- 172.21.15.153:0/1318977085 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7feb24003830 con 0x7feb14004870 2024-09-13T17:06:26.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.509+0000 7feb2f85e700 1 -- 172.21.15.153:0/1318977085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb280c9e90 con 0x7feb14004870 2024-09-13T17:06:26.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.513+0000 7feb1dffb700 1 -- 172.21.15.153:0/1318977085 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7feb24024060 con 0x7feb14004870 2024-09-13T17:06:26.546 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:26.541+0000 7feaff43d2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:06:26.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.589+0000 7feb2f85e700 1 -- 172.21.15.153:0/1318977085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6cee067d-ae45-45f3-9a3c-7f50be869c9a", "id": 6} v 0) v1 -- 0x7feb2806a6f0 con 0x7feb14004870 2024-09-13T17:06:26.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.597+0000 7feb1dffb700 1 -- 172.21.15.153:0/1318977085 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6cee067d-ae45-45f3-9a3c-7f50be869c9a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7feb24003ad0 con 0x7feb14004870 2024-09-13T17:06:26.603 INFO:teuthology.orchestra.run.smithi153.stdout:6 2024-09-13T17:06:26.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.601+0000 7feb2f85e700 1 -- 172.21.15.153:0/1318977085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb14004870 msgr2=0x7feb28151480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.601+0000 7feb2f85e700 1 --2- 172.21.15.153:0/1318977085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb14004870 0x7feb28151480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7feb240092b0 tx=0x7feb240095c0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.601+0000 7feb2f85e700 1 -- 172.21.15.153:0/1318977085 shutdown_connections 2024-09-13T17:06:26.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.601+0000 7feb2f85e700 1 --2- 172.21.15.153:0/1318977085 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb280c81d0 0x7feb280c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.601+0000 7feb2f85e700 1 --2- 172.21.15.153:0/1318977085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb28158320 0x7feb281587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.601+0000 7feb2f85e700 1 --2- 172.21.15.153:0/1318977085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb14004870 0x7feb28151480 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.601+0000 7feb2f85e700 1 -- 172.21.15.153:0/1318977085 >> 172.21.15.153:0/1318977085 conn(0x7feb280b0eb0 msgr2=0x7feb280aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:26.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.601+0000 7feb2f85e700 1 -- 172.21.15.153:0/1318977085 shutdown_connections 2024-09-13T17:06:26.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.601+0000 7feb2f85e700 1 -- 172.21.15.153:0/1318977085 wait complete. 2024-09-13T17:06:26.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 01e1117a-c2f1-43ab-baca-2f3df0fc9e3c 7 2024-09-13T17:06:26.646 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:26.643+0000 7f72f46622c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:06:26.721 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:26.717+0000 7feaff43d2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:06:26.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.725+0000 7f6f0da3c700 1 Processor -- start 2024-09-13T17:06:26.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.725+0000 7f6f0da3c700 1 -- start start 2024-09-13T17:06:26.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0da3c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6f0815cc60 0x7f6f080d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0da3c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6f080d3600 0x7f6f080d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0da3c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f080d06b0 con 0x7f6f080b6260 2024-09-13T17:06:26.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0da3c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f080d0ec0 con 0x7f6f080d3600 2024-09-13T17:06:26.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0da3c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f080cfec0 con 0x7f6f0815cc60 2024-09-13T17:06:26.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0ca3a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6f0815cc60 0x7f6f080d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0ca3a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6f0815cc60 0x7f6f080d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41980/0 (socket says 172.21.15.153:41980) 2024-09-13T17:06:26.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0ca3a700 1 -- 172.21.15.153:0/2065157026 learned_addr learned my addr 172.21.15.153:0/2065157026 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-13T17:06:26.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f07fff700 1 --2- 172.21.15.153:0/2065157026 >> v2:172.21.15.123:3300/0 conn(0x7f6f080d3600 0x7f6f080d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0ca3a700 1 -- 172.21.15.153:0/2065157026 >> v2:172.21.15.123:3300/0 conn(0x7f6f080d3600 msgr2=0x7f6f080d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:26.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0ca3a700 1 --2- 172.21.15.153:0/2065157026 >> v2:172.21.15.123:3300/0 conn(0x7f6f080d3600 0x7f6f080d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0ca3a700 1 -- 172.21.15.153:0/2065157026 >> v1:172.21.15.123:6789/0 conn(0x7f6f080b6260 legacy=0x7f6f080b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0ca3a700 1 -- 172.21.15.153:0/2065157026 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f080d0900 con 0x7f6f0815cc60 2024-09-13T17:06:26.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0ca3a700 1 --2- 172.21.15.153:0/2065157026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0815cc60 0x7f6f080d10a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6f0808b490 tx=0x7f6efc009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd7c7ede7aeb575f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:26.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f077fe700 1 -- 172.21.15.153:0/2065157026 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc011830 con 0x7f6f0815cc60 2024-09-13T17:06:26.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f077fe700 1 -- 172.21.15.153:0/2065157026 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc011990 con 0x7f6f0815cc60 2024-09-13T17:06:26.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f077fe700 1 -- 172.21.15.153:0/2065157026 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc011d20 con 0x7f6f0815cc60 2024-09-13T17:06:26.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0da3c700 1 -- 172.21.15.153:0/2065157026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0815cc60 msgr2=0x7f6f080d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0da3c700 1 --2- 172.21.15.153:0/2065157026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0815cc60 0x7f6f080d10a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6f0808b490 tx=0x7f6efc009bf0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0da3c700 1 -- 172.21.15.153:0/2065157026 shutdown_connections 2024-09-13T17:06:26.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0da3c700 1 --2- 172.21.15.153:0/2065157026 >> v2:172.21.15.123:3300/0 conn(0x7f6f080d3600 0x7f6f080d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0da3c700 1 --2- 172.21.15.153:0/2065157026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0815cc60 0x7f6f080d10a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0da3c700 1 -- 172.21.15.153:0/2065157026 >> 172.21.15.153:0/2065157026 conn(0x7f6f080d2ae0 msgr2=0x7f6f080d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:26.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0da3c700 1 -- 172.21.15.153:0/2065157026 shutdown_connections 2024-09-13T17:06:26.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.729+0000 7f6f0da3c700 1 -- 172.21.15.153:0/2065157026 wait complete. 2024-09-13T17:06:26.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0da3c700 1 Processor -- start 2024-09-13T17:06:26.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0da3c700 1 -- start start 2024-09-13T17:06:26.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0da3c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f080b6260 0x7f6f08155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0da3c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f080d3600 0x7f6f080cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0da3c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0815cc60 0x7f6f080cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0da3c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f08156210 con 0x7f6f080d3600 2024-09-13T17:06:26.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0da3c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0809fed0 con 0x7f6f0815cc60 2024-09-13T17:06:26.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0da3c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080a0120 con 0x7f6f080b6260 2024-09-13T17:06:26.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0d23b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0815cc60 0x7f6f080cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0ca3a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f080b6260 0x7f6f08155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0d23b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0815cc60 0x7f6f080cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41992/0 (socket says 172.21.15.153:41992) 2024-09-13T17:06:26.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0ca3a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f080b6260 0x7f6f08155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:34892/0 (socket says 172.21.15.153:34892) 2024-09-13T17:06:26.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0d23b700 1 -- 172.21.15.153:0/1556559202 learned_addr learned my addr 172.21.15.153:0/1556559202 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-13T17:06:26.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f07fff700 1 --2- 172.21.15.153:0/1556559202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f080d3600 0x7f6f080cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0d23b700 1 -- 172.21.15.153:0/1556559202 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f080b6260 msgr2=0x7f6f08155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0d23b700 1 --2- 172.21.15.153:0/1556559202 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f080b6260 0x7f6f08155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0d23b700 1 -- 172.21.15.153:0/1556559202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f080d3600 msgr2=0x7f6f080cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0d23b700 1 --2- 172.21.15.153:0/1556559202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f080d3600 0x7f6f080cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0d23b700 1 -- 172.21.15.153:0/1556559202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc009570 con 0x7f6f0815cc60 2024-09-13T17:06:26.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0d23b700 1 --2- 172.21.15.153:0/1556559202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0815cc60 0x7f6f080cc040 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000cb50 tx=0x7f6f0000ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:26.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f057fa700 1 -- 172.21.15.153:0/1556559202 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00003c20 con 0x7f6f0815cc60 2024-09-13T17:06:26.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f057fa700 1 -- 172.21.15.153:0/1556559202 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f00003d80 con 0x7f6f0815cc60 2024-09-13T17:06:26.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0da3c700 1 -- 172.21.15.153:0/1556559202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f080a0400 con 0x7f6f0815cc60 2024-09-13T17:06:26.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f057fa700 1 -- 172.21.15.153:0/1556559202 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0000aa20 con 0x7f6f0815cc60 2024-09-13T17:06:26.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0da3c700 1 -- 172.21.15.153:0/1556559202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f080a09c0 con 0x7f6f0815cc60 2024-09-13T17:06:26.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f057fa700 1 -- 172.21.15.153:0/1556559202 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6f000050d0 con 0x7f6f0815cc60 2024-09-13T17:06:26.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f057fa700 1 -- 172.21.15.153:0/1556559202 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6f00012600 con 0x7f6f0815cc60 2024-09-13T17:06:26.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.733+0000 7f6f0da3c700 1 -- 172.21.15.153:0/1556559202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f080d10a0 con 0x7f6f0815cc60 2024-09-13T17:06:26.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.737+0000 7f6f057fa700 1 -- 172.21.15.153:0/1556559202 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f6f00005380 con 0x7f6f0815cc60 2024-09-13T17:06:26.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.813+0000 7f6f0da3c700 1 -- 172.21.15.153:0/1556559202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "01e1117a-c2f1-43ab-baca-2f3df0fc9e3c", "id": 7} v 0) v1 -- 0x7f6f08070900 con 0x7f6f0815cc60 2024-09-13T17:06:26.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.821+0000 7f6f057fa700 1 -- 172.21.15.153:0/1556559202 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01e1117a-c2f1-43ab-baca-2f3df0fc9e3c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6f00005520 con 0x7f6f0815cc60 2024-09-13T17:06:26.826 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-09-13T17:06:26.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.821+0000 7f6f0da3c700 1 -- 172.21.15.153:0/1556559202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0815cc60 msgr2=0x7f6f080cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.821+0000 7f6f0da3c700 1 --2- 172.21.15.153:0/1556559202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0815cc60 0x7f6f080cc040 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000cb50 tx=0x7f6f0000ce60 comp rx=0 tx=0).stop 2024-09-13T17:06:26.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.821+0000 7f6f0da3c700 1 -- 172.21.15.153:0/1556559202 shutdown_connections 2024-09-13T17:06:26.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.821+0000 7f6f0da3c700 1 --2- 172.21.15.153:0/1556559202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f0815cc60 0x7f6f080cc040 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.821+0000 7f6f0da3c700 1 --2- 172.21.15.153:0/1556559202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f080d3600 0x7f6f080cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.821+0000 7f6f0da3c700 1 --2- 172.21.15.153:0/1556559202 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f080b6260 0x7f6f08155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.821+0000 7f6f0da3c700 1 -- 172.21.15.153:0/1556559202 >> 172.21.15.153:0/1556559202 conn(0x7f6f080d2ae0 msgr2=0x7f6f08071700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:26.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.821+0000 7f6f0da3c700 1 -- 172.21.15.153:0/1556559202 shutdown_connections 2024-09-13T17:06:26.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-13T17:06:26.821+0000 7f6f0da3c700 1 -- 172.21.15.153:0/1556559202 wait complete. 2024-09-13T17:06:26.841 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T17:06:26.841 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T17:06:26.843 INFO:tasks.ceph.osd.0:Started 2024-09-13T17:06:26.844 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T17:06:26.844 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T17:06:26.846 INFO:tasks.ceph.osd.1:Started 2024-09-13T17:06:26.846 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T17:06:26.846 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T17:06:26.848 INFO:tasks.ceph.osd.2:Started 2024-09-13T17:06:26.849 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T17:06:26.849 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T17:06:26.851 INFO:tasks.ceph.osd.3:Started 2024-09-13T17:06:26.851 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T17:06:26.851 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T17:06:26.854 INFO:tasks.ceph.osd.4:Started 2024-09-13T17:06:26.854 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T17:06:26.854 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T17:06:26.856 INFO:tasks.ceph.osd.5:Started 2024-09-13T17:06:26.856 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T17:06:26.856 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T17:06:26.859 INFO:tasks.ceph.osd.6:Started 2024-09-13T17:06:26.859 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T17:06:26.859 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T17:06:26.861 INFO:tasks.ceph.osd.7:Started 2024-09-13T17:06:26.861 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:06:26.899 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:26.895+0000 7f72f46622c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:06:26.962 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:26.957+0000 7feaff43d2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:06:26.967 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:26.963+0000 7f72f46622c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:06:26.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72e5e6c700 1 Processor -- start 2024-09-13T17:06:26.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72e5e6c700 1 -- start start 2024-09-13T17:06:26.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72e5e6c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e015ed00 0x7f72e0161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72e5e6c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e0162550 con 0x7f72e0161a80 2024-09-13T17:06:26.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72e5e6c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e00cd690 con 0x7f72e015e920 2024-09-13T17:06:26.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72e5e6c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e0161f90 con 0x7f72e015ed00 2024-09-13T17:06:26.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72e566b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f72e0161a80 0x7f72e00cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47972/0 (socket says 172.21.15.123:47972) 2024-09-13T17:06:26.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72e566b700 1 -- 172.21.15.123:0/4187054817 learned_addr learned my addr 172.21.15.123:0/4187054817 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:26.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72dffff700 1 --2- 172.21.15.123:0/4187054817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e015ed00 0x7f72e0161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 -- 172.21.15.123:0/4187054817 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338608219 0 0) 0x7f72e0162550 con 0x7f72e0161a80 2024-09-13T17:06:26.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 -- 172.21.15.123:0/4187054817 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c80035d0 con 0x7f72e0161a80 2024-09-13T17:06:26.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 -- 172.21.15.123:0/4187054817 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3361437162 0 0) 0x7f72c80035d0 con 0x7f72e0161a80 2024-09-13T17:06:26.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 -- 172.21.15.123:0/4187054817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e015ed00 msgr2=0x7f72e0161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:26.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 --2- 172.21.15.123:0/4187054817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e015ed00 0x7f72e0161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 -- 172.21.15.123:0/4187054817 >> v1:172.21.15.153:6789/0 conn(0x7f72e015e920 legacy=0x7f72e00caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 -- 172.21.15.123:0/4187054817 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e0162270 con 0x7f72e0161a80 2024-09-13T17:06:26.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 -- 172.21.15.123:0/4187054817 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f72d80019f0 con 0x7f72e0161a80 2024-09-13T17:06:26.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 -- 172.21.15.123:0/4187054817 >> v1:172.21.15.123:6789/0 conn(0x7f72e0161a80 legacy=0x7f72e00cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 --2- 172.21.15.123:0/4187054817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72c8003a50 0x7f72c8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 --2- 172.21.15.123:0/4187054817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c8004400 0x7f72c80048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 --2- 172.21.15.123:0/4187054817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e015ed00 0x7f72c8005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 -- 172.21.15.123:0/4187054817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e0161f90 con 0x7f72c8004400 2024-09-13T17:06:26.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 -- 172.21.15.123:0/4187054817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c800ba60 con 0x7f72c8003a50 2024-09-13T17:06:26.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72df7fe700 1 -- 172.21.15.123:0/4187054817 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c800bc20 con 0x7f72e015ed00 2024-09-13T17:06:26.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72dffff700 1 --2- 172.21.15.123:0/4187054817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c8004400 0x7f72c80048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72e4e6a700 1 --2- 172.21.15.123:0/4187054817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72c8003a50 0x7f72c8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72e566b700 1 --2- 172.21.15.123:0/4187054817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e015ed00 0x7f72c8005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72dffff700 1 -- 172.21.15.123:0/4187054817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e015ed00 msgr2=0x7f72c8005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:26.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72dffff700 1 --2- 172.21.15.123:0/4187054817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e015ed00 0x7f72c8005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72dffff700 1 -- 172.21.15.123:0/4187054817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72c8003a50 msgr2=0x7f72c8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:26.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72dffff700 1 --2- 172.21.15.123:0/4187054817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72c8003a50 0x7f72c8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72dffff700 1 -- 172.21.15.123:0/4187054817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c80035d0 con 0x7f72c8004400 2024-09-13T17:06:26.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.979+0000 7f72e4e6a700 1 --2- 172.21.15.123:0/4187054817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72c8003a50 0x7f72c8003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:26.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.983+0000 7f72dffff700 1 --2- 172.21.15.123:0/4187054817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c8004400 0x7f72c80048d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f72e00cc740 tx=0x7f72c80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9c7cea0f28379d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:26.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.983+0000 7f72df7fe700 1 -- 172.21.15.123:0/4187054817 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d400e6c0 con 0x7f72c8004400 2024-09-13T17:06:26.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.983+0000 7f72df7fe700 1 -- 172.21.15.123:0/4187054817 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d400e820 con 0x7f72c8004400 2024-09-13T17:06:26.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.983+0000 7f72df7fe700 1 -- 172.21.15.123:0/4187054817 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d400ebb0 con 0x7f72c8004400 2024-09-13T17:06:26.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.983+0000 7f72e5e6c700 1 -- 172.21.15.123:0/4187054817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c8004400 msgr2=0x7f72c80048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.983+0000 7f72e5e6c700 1 --2- 172.21.15.123:0/4187054817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c8004400 0x7f72c80048d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f72e00cc740 tx=0x7f72c80058a0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.983+0000 7f72e566b700 1 -- 172.21.15.123:0/4187054817 reap_dead start 2024-09-13T17:06:26.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.983+0000 7f72e5e6c700 1 -- 172.21.15.123:0/4187054817 shutdown_connections 2024-09-13T17:06:26.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.983+0000 7f72e5e6c700 1 -- 172.21.15.123:0/4187054817 >> 172.21.15.123:0/4187054817 conn(0x7f72e0066150 msgr2=0x7f72e0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:26.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.983+0000 7f72e5e6c700 1 -- 172.21.15.123:0/4187054817 shutdown_connections 2024-09-13T17:06:26.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.983+0000 7f72e5e6c700 1 -- 172.21.15.123:0/4187054817 wait complete. 2024-09-13T17:06:26.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.983+0000 7f72e5e6c700 1 Processor -- start 2024-09-13T17:06:26.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.983+0000 7f72e5e6c700 1 -- start start 2024-09-13T17:06:26.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e5e6c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72c8004400 0x7f72e00c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e5e6c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e0157340 0x7f72e00c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e5e6c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00ca380 0x7f72e00b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:26.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e5e6c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e00c52b0 con 0x7f72e0157340 2024-09-13T17:06:26.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e5e6c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e00c5df0 con 0x7f72e00ca380 2024-09-13T17:06:26.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e5e6c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e00c5550 con 0x7f72c8004400 2024-09-13T17:06:26.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72dffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e0157340 0x7f72e00c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e4e6a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72c8004400 0x7f72e00c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e4e6a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72c8004400 0x7f72e00c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:51802/0 (socket says 172.21.15.123:51802) 2024-09-13T17:06:26.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e4e6a700 1 -- 172.21.15.123:0/1580316775 learned_addr learned my addr 172.21.15.123:0/1580316775 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:26.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e566b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00ca380 0x7f72e00b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:26.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72dffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e0157340 0x7f72e00c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37608/0 (socket says 172.21.15.123:37608) 2024-09-13T17:06:26.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e4e6a700 1 -- 172.21.15.123:0/1580316775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00ca380 msgr2=0x7f72e00b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e4e6a700 1 --2- 172.21.15.123:0/1580316775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00ca380 0x7f72e00b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e4e6a700 1 -- 172.21.15.123:0/1580316775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e0157340 msgr2=0x7f72e00c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:26.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e4e6a700 1 --2- 172.21.15.123:0/1580316775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e0157340 0x7f72e00c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:26.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e4e6a700 1 -- 172.21.15.123:0/1580316775 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e00c5830 con 0x7f72c8004400 2024-09-13T17:06:26.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72dffff700 1 --2- 172.21.15.123:0/1580316775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e0157340 0x7f72e00c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:26.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e4e6a700 1 --2- 172.21.15.123:0/1580316775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72c8004400 0x7f72e00c3540 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f72d000fb30 tx=0x7f72d000fe40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:26.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72dd7fa700 1 -- 172.21.15.123:0/1580316775 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0001cf0 con 0x7f72c8004400 2024-09-13T17:06:26.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72dd7fa700 1 -- 172.21.15.123:0/1580316775 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d00052e0 con 0x7f72c8004400 2024-09-13T17:06:26.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e5e6c700 1 -- 172.21.15.123:0/1580316775 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e00c5b10 con 0x7f72c8004400 2024-09-13T17:06:26.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72dd7fa700 1 -- 172.21.15.123:0/1580316775 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d00036a0 con 0x7f72c8004400 2024-09-13T17:06:26.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72e5e6c700 1 -- 172.21.15.123:0/1580316775 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e0157cd0 con 0x7f72c8004400 2024-09-13T17:06:26.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72dd7fa700 1 -- 172.21.15.123:0/1580316775 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f72d0003b00 con 0x7f72c8004400 2024-09-13T17:06:26.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.987+0000 7f72dd7fa700 1 -- 172.21.15.123:0/1580316775 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f72d0003db0 con 0x7f72c8004400 2024-09-13T17:06:26.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.991+0000 7f72e5e6c700 1 -- 172.21.15.123:0/1580316775 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e00677f0 con 0x7f72c8004400 2024-09-13T17:06:26.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:26.995+0000 7f72dd7fa700 1 -- 172.21.15.123:0/1580316775 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f72d000d640 con 0x7f72c8004400 2024-09-13T17:06:27.012 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:27.009+0000 7feaff43d2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:06:27.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:27.063+0000 7f72e5e6c700 1 -- 172.21.15.123:0/1580316775 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72e0157e90 con 0x7f72c8004400 2024-09-13T17:06:27.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:27.063+0000 7f72dd7fa700 1 -- 172.21.15.123:0/1580316775 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f72d000d7e0 con 0x7f72c8004400 2024-09-13T17:06:27.069 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:27.069 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":10,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:26.818267+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:06:27.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:27.067+0000 7f72e5e6c700 1 -- 172.21.15.123:0/1580316775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72c8004400 msgr2=0x7f72e00c3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:27.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:27.067+0000 7f72e5e6c700 1 --2- 172.21.15.123:0/1580316775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72c8004400 0x7f72e00c3540 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f72d000fb30 tx=0x7f72d000fe40 comp rx=0 tx=0).stop 2024-09-13T17:06:27.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:27.067+0000 7f72e5e6c700 1 -- 172.21.15.123:0/1580316775 shutdown_connections 2024-09-13T17:06:27.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:27.067+0000 7f72e5e6c700 1 --2- 172.21.15.123:0/1580316775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00ca380 0x7f72e00b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:27.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:27.067+0000 7f72e5e6c700 1 --2- 172.21.15.123:0/1580316775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e0157340 0x7f72e00c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:27.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:27.067+0000 7f72e5e6c700 1 --2- 172.21.15.123:0/1580316775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72c8004400 0x7f72e00c3540 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:27.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:27.067+0000 7f72e5e6c700 1 -- 172.21.15.123:0/1580316775 >> 172.21.15.123:0/1580316775 conn(0x7f72e0066150 msgr2=0x7f72e0070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:27.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:27.067+0000 7f72e5e6c700 1 -- 172.21.15.123:0/1580316775 shutdown_connections 2024-09-13T17:06:27.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:27.067+0000 7f72e5e6c700 1 -- 172.21.15.123:0/1580316775 wait complete. 2024-09-13T17:06:27.087 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T17:06:27.087 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T17:06:27.141 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:27.135+0000 7f72f46622c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:06:27.196 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:27.193+0000 7feaff43d2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:06:27.202 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:27.199+0000 7f72f46622c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:06:27.211 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-09-13T17:06:27.207+0000 7fbc0c585880 -1 Falling back to public interface 2024-09-13T17:06:27.219 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-09-13T17:06:27.215+0000 7f7086b54880 -1 Falling back to public interface 2024-09-13T17:06:27.224 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-09-13T17:06:27.219+0000 7f2efbbbe880 -1 Falling back to public interface 2024-09-13T17:06:27.230 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-13T17:06:27.225+0000 7f2bb2e12880 -1 Falling back to public interface 2024-09-13T17:06:27.241 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-13T17:06:27.237+0000 7faecb665880 -1 Falling back to public interface 2024-09-13T17:06:27.254 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-13T17:06:27.249+0000 7f3a6f854880 -1 Falling back to public interface 2024-09-13T17:06:27.256 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:27.253+0000 7feaff43d2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:06:27.265 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:27.263+0000 7f72f46622c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:06:27.321 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:27.317+0000 7feaff43d2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:06:27.479 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-09-13T17:06:27.475+0000 7f8675f55880 -1 Falling back to public interface 2024-09-13T17:06:27.482 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-13T17:06:27.477+0000 7f704e30e880 -1 Falling back to public interface 2024-09-13T17:06:27.641 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:27.635+0000 7f72f46622c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:06:27.729 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:27.725+0000 7feaff43d2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:06:27.757 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:27.751+0000 7f72f46622c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:06:27.847 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:27.841+0000 7feaff43d2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:06:27.892 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T17:06:27.992 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.987+0000 7f814359e700 1 Processor -- start 2024-09-13T17:06:27.993 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.987+0000 7f814359e700 1 -- start start 2024-09-13T17:06:27.993 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.987+0000 7f814359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f81440d3510 0x7f81440cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:27.993 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.987+0000 7f814359e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81440ce440 0x7f81440b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:27.994 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.987+0000 7f814359e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81440b5aa0 con 0x7f8144160350 2024-09-13T17:06:27.994 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.987+0000 7f814359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81440d1230 con 0x7f81440d3510 2024-09-13T17:06:27.994 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.987+0000 7f814359e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81440d1480 con 0x7f81440ce440 2024-09-13T17:06:27.994 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814259c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8144160350 0x7f81440cd7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47978/0 (socket says 172.21.15.123:47978) 2024-09-13T17:06:27.994 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814259c700 1 -- 172.21.15.123:0/561132745 learned_addr learned my addr 172.21.15.123:0/561132745 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:27.994 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f8141d9b700 1 --2- 172.21.15.123:0/561132745 >> v2:172.21.15.153:3300/0 conn(0x7f81440d3510 0x7f81440cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:27.994 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f8142d9d700 1 --2- 172.21.15.123:0/561132745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81440ce440 0x7f81440b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:27.996 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814159a700 1 -- 172.21.15.123:0/561132745 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93217114 0 0) 0x7f81440b5aa0 con 0x7f8144160350 2024-09-13T17:06:27.996 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814159a700 1 -- 172.21.15.123:0/561132745 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f812c0035d0 con 0x7f8144160350 2024-09-13T17:06:27.996 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f8141d9b700 1 -- 172.21.15.123:0/561132745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81440ce440 msgr2=0x7f81440b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:27.996 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f8141d9b700 1 --2- 172.21.15.123:0/561132745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81440ce440 0x7f81440b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:27.996 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f8141d9b700 1 -- 172.21.15.123:0/561132745 >> v1:172.21.15.123:6789/0 conn(0x7f8144160350 legacy=0x7f81440cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:27.996 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f8141d9b700 1 -- 172.21.15.123:0/561132745 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81440d1760 con 0x7f81440d3510 2024-09-13T17:06:27.996 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f8141d9b700 1 --2- 172.21.15.123:0/561132745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81440d3510 0x7f81440cdf00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8138009850 tx=0x7f8138009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0024d3e4e34b56c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:27.996 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814159a700 1 -- 172.21.15.123:0/561132745 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138011830 con 0x7f81440d3510 2024-09-13T17:06:27.996 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814159a700 1 -- 172.21.15.123:0/561132745 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8138011990 con 0x7f81440d3510 2024-09-13T17:06:27.996 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814159a700 1 -- 172.21.15.123:0/561132745 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138011d40 con 0x7f81440d3510 2024-09-13T17:06:27.997 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814359e700 1 -- 172.21.15.123:0/561132745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81440d3510 msgr2=0x7f81440cdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:27.997 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814359e700 1 --2- 172.21.15.123:0/561132745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81440d3510 0x7f81440cdf00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8138009850 tx=0x7f8138009b60 comp rx=0 tx=0).stop 2024-09-13T17:06:27.997 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814359e700 1 -- 172.21.15.123:0/561132745 shutdown_connections 2024-09-13T17:06:27.997 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814359e700 1 --2- 172.21.15.123:0/561132745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81440ce440 0x7f81440b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:27.997 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814359e700 1 --2- 172.21.15.123:0/561132745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81440d3510 0x7f81440cdf00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:27.997 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814359e700 1 -- 172.21.15.123:0/561132745 >> 172.21.15.123:0/561132745 conn(0x7f814409bf20 msgr2=0x7f81440d2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:27.997 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814359e700 1 -- 172.21.15.123:0/561132745 shutdown_connections 2024-09-13T17:06:27.997 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.991+0000 7f814359e700 1 -- 172.21.15.123:0/561132745 wait complete. 2024-09-13T17:06:27.998 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f814359e700 1 Processor -- start 2024-09-13T17:06:27.998 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f814359e700 1 -- start start 2024-09-13T17:06:28.000 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f814359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81440ce440 0x7f814409cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:28.000 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f814359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81440d3510 0x7f814409f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:28.000 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f814359e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8144160350 0x7f81440cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:28.001 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f814359e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81440a0760 con 0x7f81440d3510 2024-09-13T17:06:28.001 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f814359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814409f8f0 con 0x7f81440ce440 2024-09-13T17:06:28.001 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f814359e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814409fb50 con 0x7f8144160350 2024-09-13T17:06:28.003 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8141d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81440d3510 0x7f814409f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:28.003 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8141d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81440d3510 0x7f814409f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37614/0 (socket says 172.21.15.123:37614) 2024-09-13T17:06:28.003 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8141d9b700 1 -- 172.21.15.123:0/3079311 learned_addr learned my addr 172.21.15.123:0/3079311 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:28.004 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8142d9d700 1 --2- 172.21.15.123:0/3079311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8144160350 0x7f81440cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:28.004 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f814259c700 1 --2- 172.21.15.123:0/3079311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81440ce440 0x7f814409cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:28.004 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8141d9b700 1 -- 172.21.15.123:0/3079311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8144160350 msgr2=0x7f81440cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:28.004 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8141d9b700 1 --2- 172.21.15.123:0/3079311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8144160350 0x7f81440cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:28.004 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8141d9b700 1 -- 172.21.15.123:0/3079311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81440ce440 msgr2=0x7f814409cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:28.004 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8141d9b700 1 --2- 172.21.15.123:0/3079311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81440ce440 0x7f814409cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:28.004 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8141d9b700 1 -- 172.21.15.123:0/3079311 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81380094b0 con 0x7f81440d3510 2024-09-13T17:06:28.004 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8142d9d700 1 --2- 172.21.15.123:0/3079311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8144160350 0x7f81440cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:28.004 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8141d9b700 1 --2- 172.21.15.123:0/3079311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81440d3510 0x7f814409f3b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f81380090b0 tx=0x7f8138004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:28.004 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8132ffd700 1 -- 172.21.15.123:0/3079311 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138004380 con 0x7f81440d3510 2024-09-13T17:06:28.004 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f814359e700 1 -- 172.21.15.123:0/3079311 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814409fe30 con 0x7f81440d3510 2024-09-13T17:06:28.004 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8132ffd700 1 -- 172.21.15.123:0/3079311 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813801f070 con 0x7f81440d3510 2024-09-13T17:06:28.004 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8132ffd700 1 -- 172.21.15.123:0/3079311 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81380036c0 con 0x7f81440d3510 2024-09-13T17:06:28.005 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f814359e700 1 -- 172.21.15.123:0/3079311 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81440a03f0 con 0x7f81440d3510 2024-09-13T17:06:28.005 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8132ffd700 1 -- 172.21.15.123:0/3079311 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8138021030 con 0x7f81440d3510 2024-09-13T17:06:28.005 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f8132ffd700 1 -- 172.21.15.123:0/3079311 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8138024b00 con 0x7f81440d3510 2024-09-13T17:06:28.005 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.995+0000 7f814359e700 1 -- 172.21.15.123:0/3079311 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81440a0580 con 0x7f81440d3510 2024-09-13T17:06:28.005 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:27.999+0000 7f8132ffd700 1 -- 172.21.15.123:0/3079311 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f8138015020 con 0x7f81440d3510 2024-09-13T17:06:28.068 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:28.063+0000 7f814359e700 1 -- 172.21.15.123:0/3079311 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81440ca860 con 0x7f81440d3510 2024-09-13T17:06:28.068 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:28.063+0000 7f8132ffd700 1 -- 172.21.15.123:0/3079311 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f81440ca860 con 0x7f81440d3510 2024-09-13T17:06:28.068 INFO:teuthology.misc.health.smithi123.stdout: 2024-09-13T17:06:28.069 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":10,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:26.818267+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:06:28.070 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:28.063+0000 7f814359e700 1 -- 172.21.15.123:0/3079311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81440d3510 msgr2=0x7f814409f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:28.070 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:28.063+0000 7f814359e700 1 --2- 172.21.15.123:0/3079311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81440d3510 0x7f814409f3b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f81380090b0 tx=0x7f8138004770 comp rx=0 tx=0).stop 2024-09-13T17:06:28.070 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:28.063+0000 7f814359e700 1 -- 172.21.15.123:0/3079311 shutdown_connections 2024-09-13T17:06:28.070 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:28.063+0000 7f814359e700 1 --2- 172.21.15.123:0/3079311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8144160350 0x7f81440cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:28.070 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:28.063+0000 7f814359e700 1 --2- 172.21.15.123:0/3079311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81440d3510 0x7f814409f3b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:28.070 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:28.063+0000 7f814359e700 1 --2- 172.21.15.123:0/3079311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81440ce440 0x7f814409cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:28.070 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:28.063+0000 7f814359e700 1 -- 172.21.15.123:0/3079311 >> 172.21.15.123:0/3079311 conn(0x7f814409bf20 msgr2=0x7f81440d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:28.070 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:28.067+0000 7f814359e700 1 -- 172.21.15.123:0/3079311 shutdown_connections 2024-09-13T17:06:28.070 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:28.067+0000 7f814359e700 1 -- 172.21.15.123:0/3079311 wait complete. 2024-09-13T17:06:28.079 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T17:06:28.094 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:28.091+0000 7f72f46622c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:06:28.181 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:28.177+0000 7feaff43d2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:06:28.274 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:28.271+0000 7f72f46622c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:06:28.341 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:28.335+0000 7f72f46622c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:06:28.368 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:28.361+0000 7feaff43d2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:06:28.436 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:28.433+0000 7feaff43d2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:06:28.499 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:28.495+0000 7f72f46622c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:06:28.598 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:28.593+0000 7feaff43d2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:06:29.216 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:29.211+0000 7f72f46622c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:06:29.286 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:29.283+0000 7f72f46622c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:06:29.293 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:29.289+0000 7feaff43d2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:06:29.361 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:29.357+0000 7feaff43d2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:06:29.441 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:29.435+0000 7f72f46622c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:06:29.509 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:29.503+0000 7f72f46622c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:06:29.536 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:29.533+0000 7feaff43d2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:06:29.583 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:29.579+0000 7f72f46622c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:06:29.604 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:29.601+0000 7feaff43d2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:06:29.679 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:29.673+0000 7feaff43d2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:06:29.908 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:29.903+0000 7f72f46622c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:06:29.986 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:29.983+0000 7f72f46622c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:06:30.009 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:30.005+0000 7feaff43d2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:06:30.087 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:30.081+0000 7feaff43d2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:06:30.704 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:30.699+0000 7f72f46622c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:06:30.796 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-09-13T17:06:30.791+0000 7fbc0c585880 -1 osd.0 0 log_to_monitors true 2024-09-13T17:06:30.817 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-13T17:06:30.813+0000 7feaff43d2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:06:30.876 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-09-13T17:06:30.871+0000 7f7086b54880 -1 osd.3 0 log_to_monitors true 2024-09-13T17:06:31.064 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-09-13T17:06:31.059+0000 7f2efbbbe880 -1 osd.2 0 log_to_monitors true 2024-09-13T17:06:31.097 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-13T17:06:31.093+0000 7faecb665880 -1 osd.7 0 log_to_monitors true 2024-09-13T17:06:31.105 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-13T17:06:31.101+0000 7f3a6f854880 -1 osd.4 0 log_to_monitors true 2024-09-13T17:06:31.198 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-13T17:06:31.193+0000 7f2bb2e12880 -1 osd.5 0 log_to_monitors true 2024-09-13T17:06:31.296 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-09-13T17:06:31.291+0000 7f8675f55880 -1 osd.1 0 log_to_monitors true 2024-09-13T17:06:31.316 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-13T17:06:31.309+0000 7f704e30e880 -1 osd.6 0 log_to_monitors true 2024-09-13T17:06:31.746 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:31.743+0000 7f72db1d8700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T17:06:31.748 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-13T17:06:31.743+0000 7f72db1d8700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T17:06:34.886 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T17:06:34.966 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-13T17:06:34.961+0000 7f704992a700 -1 osd.6 0 waiting for initial osdmap 2024-09-13T17:06:34.971 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-13T17:06:34.965+0000 7f7041bff700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:06:34.984 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-09-13T17:06:34.979+0000 7f2ef8b85700 -1 osd.2 0 waiting for initial osdmap 2024-09-13T17:06:34.992 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-09-13T17:06:34.987+0000 7f2eef4af700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:06:34.995 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-09-13T17:06:34.991+0000 7f7082170700 -1 osd.3 0 waiting for initial osdmap 2024-09-13T17:06:35.000 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-09-13T17:06:34.995+0000 7f707a445700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:06:35.008 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-09-13T17:06:35.003+0000 7f8671571700 -1 osd.1 0 waiting for initial osdmap 2024-09-13T17:06:35.013 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-09-13T17:06:35.007+0000 7f8669846700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:06:35.015 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.011+0000 7ff59f59e700 1 Processor -- start 2024-09-13T17:06:35.016 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.011+0000 7ff59f59e700 1 -- start start 2024-09-13T17:06:35.018 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.011+0000 7ff59f59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff5a00af1a0 0x7ff5a00cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:35.018 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.011+0000 7ff59f59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5a00af580 0x7ff5a00ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:35.018 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.011+0000 7ff59f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff5a006b320 0x7ff5a006b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:35.018 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.011+0000 7ff59f59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a006a350 con 0x7ff5a00af1a0 2024-09-13T17:06:35.019 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.011+0000 7ff59f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a006ae90 con 0x7ff5a006b320 2024-09-13T17:06:35.019 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.011+0000 7ff59f59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00accf0 con 0x7ff5a00af580 2024-09-13T17:06:35.019 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.011+0000 7ff59dd9b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5a00af580 0x7ff5a00ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:35.019 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.011+0000 7ff59e59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff5a00af1a0 0x7ff5a00cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:35.019 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.011+0000 7ff59dd9b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5a00af580 0x7ff5a00ac7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:58342/0 (socket says 172.21.15.123:58342) 2024-09-13T17:06:35.019 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.011+0000 7ff59ed9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff5a006b320 0x7ff5a006b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:35.019 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.011+0000 7ff59dd9b700 1 -- 172.21.15.123:0/866242345 learned_addr learned my addr 172.21.15.123:0/866242345 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:35.019 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.011+0000 7ff59e59c700 1 -- 172.21.15.123:0/866242345 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5a00af580 msgr2=0x7ff5a00ac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:35.019 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59e59c700 1 --2- 172.21.15.123:0/866242345 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5a00af580 0x7ff5a00ac7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:35.019 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59e59c700 1 -- 172.21.15.123:0/866242345 >> v2:172.21.15.153:3300/0 conn(0x7ff5a006b320 msgr2=0x7ff5a006b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:35.019 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59e59c700 1 --2- 172.21.15.123:0/866242345 >> v2:172.21.15.153:3300/0 conn(0x7ff5a006b320 0x7ff5a006b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:35.019 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59e59c700 1 -- 172.21.15.123:0/866242345 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a006a560 con 0x7ff5a00af1a0 2024-09-13T17:06:35.019 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59e59c700 1 --2- 172.21.15.123:0/866242345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5a00af1a0 0x7ff5a00cb550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00af130 tx=0x7ff590009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1735cbab3cef035 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:35.020 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59d59a700 1 -- 172.21.15.123:0/866242345 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590011830 con 0x7ff5a00af1a0 2024-09-13T17:06:35.020 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59d59a700 1 -- 172.21.15.123:0/866242345 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff590011990 con 0x7ff5a00af1a0 2024-09-13T17:06:35.020 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59d59a700 1 -- 172.21.15.123:0/866242345 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590011d20 con 0x7ff5a00af1a0 2024-09-13T17:06:35.021 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59f59e700 1 -- 172.21.15.123:0/866242345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5a00af1a0 msgr2=0x7ff5a00cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:35.021 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59f59e700 1 --2- 172.21.15.123:0/866242345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5a00af1a0 0x7ff5a00cb550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00af130 tx=0x7ff590009b30 comp rx=0 tx=0).stop 2024-09-13T17:06:35.021 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59f59e700 1 -- 172.21.15.123:0/866242345 shutdown_connections 2024-09-13T17:06:35.021 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59f59e700 1 --2- 172.21.15.123:0/866242345 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5a00af580 0x7ff5a00ac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:35.021 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59f59e700 1 --2- 172.21.15.123:0/866242345 >> v2:172.21.15.153:3300/0 conn(0x7ff5a006b320 0x7ff5a006b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:35.021 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59f59e700 1 --2- 172.21.15.123:0/866242345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5a00af1a0 0x7ff5a00cb550 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:35.021 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59f59e700 1 -- 172.21.15.123:0/866242345 >> 172.21.15.123:0/866242345 conn(0x7ff5a00b23d0 msgr2=0x7ff5a00b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:35.021 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59f59e700 1 -- 172.21.15.123:0/866242345 shutdown_connections 2024-09-13T17:06:35.022 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59f59e700 1 -- 172.21.15.123:0/866242345 wait complete. 2024-09-13T17:06:35.022 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59f59e700 1 Processor -- start 2024-09-13T17:06:35.022 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.015+0000 7ff59f59e700 1 -- start start 2024-09-13T17:06:35.024 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5a006b320 0x7ff5a015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:35.024 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5a00af1a0 0x7ff5a01f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:35.024 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59f59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5a00af580 0x7ff5a014e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:35.024 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59f59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a01f3770 con 0x7ff5a006b320 2024-09-13T17:06:35.024 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00ccec0 con 0x7ff5a00af1a0 2024-09-13T17:06:35.024 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59f59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a014ecc0 con 0x7ff5a00af580 2024-09-13T17:06:35.024 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5a006b320 0x7ff5a015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:35.025 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5a006b320 0x7ff5a015ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59352/0 (socket says 172.21.15.123:59352) 2024-09-13T17:06:35.025 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59e59c700 1 -- 172.21.15.123:0/938666843 learned_addr learned my addr 172.21.15.123:0/938666843 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:35.025 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59dd9b700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5a00af1a0 0x7ff5a01f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:35.025 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59ed9d700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5a00af580 0x7ff5a014e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:35.025 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59e59c700 1 -- 172.21.15.123:0/938666843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5a00af580 msgr2=0x7ff5a014e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:35.025 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59e59c700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5a00af580 0x7ff5a014e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:35.025 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59e59c700 1 -- 172.21.15.123:0/938666843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5a00af1a0 msgr2=0x7ff5a01f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:35.025 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59e59c700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5a00af1a0 0x7ff5a01f27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:35.025 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59e59c700 1 -- 172.21.15.123:0/938666843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5900094b0 con 0x7ff5a006b320 2024-09-13T17:06:35.025 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59dd9b700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5a00af1a0 0x7ff5a01f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:35.025 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59e59c700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5a006b320 0x7ff5a015ccc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff590009b70 tx=0x7ff590004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:35.026 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff58effd700 1 -- 172.21.15.123:0/938666843 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590004510 con 0x7ff5a006b320 2024-09-13T17:06:35.026 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff58effd700 1 -- 172.21.15.123:0/938666843 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59001f070 con 0x7ff5a006b320 2024-09-13T17:06:35.026 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59f59e700 1 -- 172.21.15.123:0/938666843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a015a8e0 con 0x7ff5a006b320 2024-09-13T17:06:35.026 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff58effd700 1 -- 172.21.15.123:0/938666843 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590003900 con 0x7ff5a006b320 2024-09-13T17:06:35.026 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59f59e700 1 -- 172.21.15.123:0/938666843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a01f31b0 con 0x7ff5a006b320 2024-09-13T17:06:35.027 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.019+0000 7ff59f59e700 1 -- 172.21.15.123:0/938666843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a0159b30 con 0x7ff5a006b320 2024-09-13T17:06:35.027 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.023+0000 7ff58effd700 1 -- 172.21.15.123:0/938666843 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7ff590003a60 con 0x7ff5a006b320 2024-09-13T17:06:35.027 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.023+0000 7ff58effd700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff5800666a0 0x7ff580068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:35.027 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.023+0000 7ff58effd700 1 -- 172.21.15.123:0/938666843 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7ff590021070 con 0x7ff5a006b320 2024-09-13T17:06:35.028 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.023+0000 7ff59dd9b700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff5800666a0 0x7ff580068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:35.028 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.023+0000 7ff59dd9b700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff5800666a0 0x7ff580068b60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff5a01515a0 tx=0x7ff594008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:35.035 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.031+0000 7ff58effd700 1 -- 172.21.15.123:0/938666843 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff590052d00 con 0x7ff5a006b320 2024-09-13T17:06:35.058 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-13T17:06:35.053+0000 7f2bae42e700 -1 osd.5 0 waiting for initial osdmap 2024-09-13T17:06:35.059 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-13T17:06:35.053+0000 7faec6c81700 -1 osd.7 0 waiting for initial osdmap 2024-09-13T17:06:35.062 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-13T17:06:35.057+0000 7faebef56700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:06:35.065 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-13T17:06:35.061+0000 7f2ba6703700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:06:35.065 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-09-13T17:06:35.063+0000 7fbc07ba1700 -1 osd.0 0 waiting for initial osdmap 2024-09-13T17:06:35.069 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-09-13T17:06:35.063+0000 7fbbffe76700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:06:35.084 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-13T17:06:35.081+0000 7f3a6ae70700 -1 osd.4 0 waiting for initial osdmap 2024-09-13T17:06:35.090 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-13T17:06:35.085+0000 7f3a63145700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:06:35.211 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.207+0000 7ff59f59e700 1 -- 172.21.15.123:0/938666843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5a0070d90 con 0x7ff5a006b320 2024-09-13T17:06:35.212 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.207+0000 7ff58effd700 1 -- 172.21.15.123:0/938666843 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff590015020 con 0x7ff5a006b320 2024-09-13T17:06:35.212 INFO:teuthology.misc.health.smithi123.stdout: 2024-09-13T17:06:35.212 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":12,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:32.791074+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:06:35.214 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.211+0000 7ff59f59e700 1 -- 172.21.15.123:0/938666843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff5800666a0 msgr2=0x7ff580068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:35.214 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.211+0000 7ff59f59e700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff5800666a0 0x7ff580068b60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff5a01515a0 tx=0x7ff594008040 comp rx=0 tx=0).stop 2024-09-13T17:06:35.214 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.211+0000 7ff59f59e700 1 -- 172.21.15.123:0/938666843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5a006b320 msgr2=0x7ff5a015ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:35.214 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.211+0000 7ff59f59e700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5a006b320 0x7ff5a015ccc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff590009b70 tx=0x7ff590004770 comp rx=0 tx=0).stop 2024-09-13T17:06:35.215 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.211+0000 7ff59f59e700 1 -- 172.21.15.123:0/938666843 shutdown_connections 2024-09-13T17:06:35.215 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.211+0000 7ff59f59e700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff5800666a0 0x7ff580068b60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:35.215 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.211+0000 7ff59f59e700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5a00af580 0x7ff5a014e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:35.215 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.211+0000 7ff59f59e700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5a00af1a0 0x7ff5a01f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:35.215 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.211+0000 7ff59f59e700 1 --2- 172.21.15.123:0/938666843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5a006b320 0x7ff5a015ccc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:35.215 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.211+0000 7ff59f59e700 1 -- 172.21.15.123:0/938666843 >> 172.21.15.123:0/938666843 conn(0x7ff5a00b23d0 msgr2=0x7ff5a00cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:35.216 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.211+0000 7ff59f59e700 1 -- 172.21.15.123:0/938666843 shutdown_connections 2024-09-13T17:06:35.216 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:35.211+0000 7ff59f59e700 1 -- 172.21.15.123:0/938666843 wait complete. 2024-09-13T17:06:35.225 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T17:06:42.033 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T17:06:42.138 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 Processor -- start 2024-09-13T17:06:42.138 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 -- start start 2024-09-13T17:06:42.140 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f62f4160250 0x7f62f40cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.141 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f62f40cf8d0 0x7f62f40cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.141 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62f40c68e0 0x7f62f40c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.141 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f40d3ad0 con 0x7f62f40cf8d0 2024-09-13T17:06:42.141 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f40cea60 con 0x7f62f4160250 2024-09-13T17:06:42.141 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40d3830 con 0x7f62f40c68e0 2024-09-13T17:06:42.141 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62f9ac7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f62f40cf8d0 0x7f62f40cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.141 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62f9ac7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f62f40cf8d0 0x7f62f40cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48278/0 (socket says 172.21.15.123:48278) 2024-09-13T17:06:42.141 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62f9ac7700 1 -- 172.21.15.123:0/3364395258 learned_addr learned my addr 172.21.15.123:0/3364395258 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:42.141 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62faac9700 1 --2- 172.21.15.123:0/3364395258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62f40c68e0 0x7f62f40c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.141 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fa2c8700 1 --2- 172.21.15.123:0/3364395258 >> v2:172.21.15.153:3300/0 conn(0x7f62f4160250 0x7f62f40cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.141 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62f9ac7700 1 -- 172.21.15.123:0/3364395258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62f40c68e0 msgr2=0x7f62f40c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:42.141 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62f9ac7700 1 --2- 172.21.15.123:0/3364395258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62f40c68e0 0x7f62f40c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.142 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62f9ac7700 1 -- 172.21.15.123:0/3364395258 >> v2:172.21.15.153:3300/0 conn(0x7f62f4160250 msgr2=0x7f62f40cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:42.142 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62f9ac7700 1 --2- 172.21.15.123:0/3364395258 >> v2:172.21.15.153:3300/0 conn(0x7f62f4160250 0x7f62f40cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.142 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62f9ac7700 1 -- 172.21.15.123:0/3364395258 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f40ce3a0 con 0x7f62f40cf8d0 2024-09-13T17:06:42.142 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62f9ac7700 1 --2- 172.21.15.123:0/3364395258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f40cf8d0 0x7f62f40cfd40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f62f408bd50 tx=0x7f62f0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7396e583a1126152 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:42.142 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62f92c6700 1 -- 172.21.15.123:0/3364395258 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f000b8a0 con 0x7f62f40cf8d0 2024-09-13T17:06:42.142 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62f92c6700 1 -- 172.21.15.123:0/3364395258 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f000ba00 con 0x7f62f40cf8d0 2024-09-13T17:06:42.142 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62f92c6700 1 -- 172.21.15.123:0/3364395258 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f000bd90 con 0x7f62f40cf8d0 2024-09-13T17:06:42.143 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3364395258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f40cf8d0 msgr2=0x7f62f40cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.143 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 --2- 172.21.15.123:0/3364395258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f40cf8d0 0x7f62f40cfd40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f62f408bd50 tx=0x7f62f0009bf0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.143 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3364395258 shutdown_connections 2024-09-13T17:06:42.143 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 --2- 172.21.15.123:0/3364395258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62f40c68e0 0x7f62f40c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.143 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 --2- 172.21.15.123:0/3364395258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f40cf8d0 0x7f62f40cfd40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.143 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 --2- 172.21.15.123:0/3364395258 >> v2:172.21.15.153:3300/0 conn(0x7f62f4160250 0x7f62f40cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.143 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3364395258 >> 172.21.15.123:0/3364395258 conn(0x7f62f40d2be0 msgr2=0x7f62f40d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:42.143 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3364395258 shutdown_connections 2024-09-13T17:06:42.143 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.134+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3364395258 wait complete. 2024-09-13T17:06:42.144 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62fb2ca700 1 Processor -- start 2024-09-13T17:06:42.144 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62fb2ca700 1 -- start start 2024-09-13T17:06:42.145 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62fb2ca700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62f40c68e0 0x7f62f40b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.145 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62fb2ca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62f40cf8d0 0x7f62f4158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.145 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62fb2ca700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f4160250 0x7f62f40b8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.145 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62fb2ca700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f4159480 con 0x7f62f4160250 2024-09-13T17:06:42.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62fb2ca700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40b71f0 con 0x7f62f40cf8d0 2024-09-13T17:06:42.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62fb2ca700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40b74d0 con 0x7f62f40c68e0 2024-09-13T17:06:42.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62faac9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f4160250 0x7f62f40b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62faac9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f4160250 0x7f62f40b8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48284/0 (socket says 172.21.15.123:48284) 2024-09-13T17:06:42.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62faac9700 1 -- 172.21.15.123:0/3485998802 learned_addr learned my addr 172.21.15.123:0/3485998802 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:42.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62f9ac7700 1 --2- 172.21.15.123:0/3485998802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62f40cf8d0 0x7f62f4158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62fa2c8700 1 --2- 172.21.15.123:0/3485998802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62f40c68e0 0x7f62f40b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62faac9700 1 -- 172.21.15.123:0/3485998802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62f40c68e0 msgr2=0x7f62f40b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62faac9700 1 --2- 172.21.15.123:0/3485998802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62f40c68e0 0x7f62f40b6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62faac9700 1 -- 172.21.15.123:0/3485998802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62f40cf8d0 msgr2=0x7f62f4158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.146 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62faac9700 1 --2- 172.21.15.123:0/3485998802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62f40cf8d0 0x7f62f4158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.147 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.138+0000 7f62faac9700 1 -- 172.21.15.123:0/3485998802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0009570 con 0x7f62f4160250 2024-09-13T17:06:42.148 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.142+0000 7f62faac9700 1 --2- 172.21.15.123:0/3485998802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f4160250 0x7f62f40b8290 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62ec007e60 tx=0x7f62ec00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:42.148 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.142+0000 7f62eaffd700 1 -- 172.21.15.123:0/3485998802 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec00ed30 con 0x7f62f4160250 2024-09-13T17:06:42.148 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.142+0000 7f62eaffd700 1 -- 172.21.15.123:0/3485998802 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec014420 con 0x7f62f4160250 2024-09-13T17:06:42.148 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.142+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3485998802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f40b77b0 con 0x7f62f4160250 2024-09-13T17:06:42.148 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.142+0000 7f62eaffd700 1 -- 172.21.15.123:0/3485998802 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec0147d0 con 0x7f62f4160250 2024-09-13T17:06:42.148 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.142+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3485998802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f40b7d70 con 0x7f62f4160250 2024-09-13T17:06:42.148 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.142+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3485998802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f40cf390 con 0x7f62f4160250 2024-09-13T17:06:42.149 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.142+0000 7f62eaffd700 1 -- 172.21.15.123:0/3485998802 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f62ec014930 con 0x7f62f4160250 2024-09-13T17:06:42.149 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.142+0000 7f62eaffd700 1 --2- 172.21.15.123:0/3485998802 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f62d8066730 0x7f62d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.149 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.142+0000 7f62eaffd700 1 -- 172.21.15.123:0/3485998802 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f62ec084480 con 0x7f62f4160250 2024-09-13T17:06:42.150 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.142+0000 7f62fa2c8700 1 --2- 172.21.15.123:0/3485998802 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f62d8066730 0x7f62d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.150 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.146+0000 7f62fa2c8700 1 --2- 172.21.15.123:0/3485998802 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f62d8066730 0x7f62d8068bf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62e4007a60 tx=0x7f62e4008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:42.159 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.154+0000 7f62eaffd700 1 -- 172.21.15.123:0/3485998802 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f62ec051b50 con 0x7f62f4160250 2024-09-13T17:06:42.328 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.322+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3485998802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62f40b7f60 con 0x7f62f4160250 2024-09-13T17:06:42.330 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.326+0000 7f62eaffd700 1 -- 172.21.15.123:0/3485998802 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12898 (secure 0 0 0) 0x7f62ec055170 con 0x7f62f4160250 2024-09-13T17:06:42.330 INFO:teuthology.misc.health.smithi123.stdout: 2024-09-13T17:06:42.330 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":16,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:39.002109+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:06:42.333 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.326+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3485998802 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f62d8066730 msgr2=0x7f62d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.333 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.326+0000 7f62fb2ca700 1 --2- 172.21.15.123:0/3485998802 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f62d8066730 0x7f62d8068bf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62e4007a60 tx=0x7f62e4008040 comp rx=0 tx=0).stop 2024-09-13T17:06:42.333 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.326+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3485998802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f4160250 msgr2=0x7f62f40b8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.333 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.326+0000 7f62fb2ca700 1 --2- 172.21.15.123:0/3485998802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f4160250 0x7f62f40b8290 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62ec007e60 tx=0x7f62ec00e3c0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.333 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.326+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3485998802 shutdown_connections 2024-09-13T17:06:42.333 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.326+0000 7f62fb2ca700 1 --2- 172.21.15.123:0/3485998802 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f62d8066730 0x7f62d8068bf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.333 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.326+0000 7f62fb2ca700 1 --2- 172.21.15.123:0/3485998802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f4160250 0x7f62f40b8290 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.333 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.326+0000 7f62fb2ca700 1 --2- 172.21.15.123:0/3485998802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62f40cf8d0 0x7f62f4158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.333 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.326+0000 7f62fb2ca700 1 --2- 172.21.15.123:0/3485998802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62f40c68e0 0x7f62f40b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.334 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.326+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3485998802 >> 172.21.15.123:0/3485998802 conn(0x7f62f40d2be0 msgr2=0x7f62f40cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:42.334 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.326+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3485998802 shutdown_connections 2024-09-13T17:06:42.334 INFO:teuthology.misc.health.smithi123.stderr:2024-09-13T17:06:42.326+0000 7f62fb2ca700 1 -- 172.21.15.123:0/3485998802 wait complete. 2024-09-13T17:06:42.343 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T17:06:42.344 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T17:06:42.344 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:06:42.344 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:06:42.346 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:06:42.346 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:06:42.346 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:06:42.349 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:06:42.349 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:06:42.349 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:06:42.351 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:06:42.352 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:06:42.352 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:06:42.354 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:06:42.354 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T17:06:42.355 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:06:42.414 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-13T17:06:42.425 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-13T17:06:42.430 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-09-13T17:06:42.432 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-09-13T17:06:42.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.454+0000 7fcd0ee0c700 1 Processor -- start 2024-09-13T17:06:42.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.454+0000 7fcd0ee0c700 1 -- start start 2024-09-13T17:06:42.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.454+0000 7fcd0ee0c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd0806dee0 0x7fcd080cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.454+0000 7fcd0ee0c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcd081611a0 0x7fcd0806d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.454+0000 7fcd0ee0c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcd0806d560 0x7fcd0806a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.454+0000 7fcd0ee0c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0806ba80 con 0x7fcd081611a0 2024-09-13T17:06:42.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.454+0000 7fcd0ee0c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd08145c40 con 0x7fcd0806d560 2024-09-13T17:06:42.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.454+0000 7fcd0ee0c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0806e2c0 con 0x7fcd0806dee0 2024-09-13T17:06:42.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.454+0000 7fcd0d609700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcd081611a0 0x7fcd0806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.454+0000 7fcd0d609700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcd081611a0 0x7fcd0806d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48326/0 (socket says 172.21.15.123:48326) 2024-09-13T17:06:42.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.454+0000 7fcd0d609700 1 -- 172.21.15.123:0/3607564603 learned_addr learned my addr 172.21.15.123:0/3607564603 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:42.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.454+0000 7fcd0e60b700 1 --2- 172.21.15.123:0/3607564603 >> v2:172.21.15.153:3300/0 conn(0x7fcd0806d560 0x7fcd0806a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.454+0000 7fcd0de0a700 1 --2- 172.21.15.123:0/3607564603 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd0806dee0 0x7fcd080cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0d609700 1 -- 172.21.15.123:0/3607564603 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd0806dee0 msgr2=0x7fcd080cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:42.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0d609700 1 --2- 172.21.15.123:0/3607564603 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd0806dee0 0x7fcd080cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0d609700 1 -- 172.21.15.123:0/3607564603 >> v2:172.21.15.153:3300/0 conn(0x7fcd0806d560 msgr2=0x7fcd0806a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:42.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0d609700 1 --2- 172.21.15.123:0/3607564603 >> v2:172.21.15.153:3300/0 conn(0x7fcd0806d560 0x7fcd0806a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0d609700 1 -- 172.21.15.123:0/3607564603 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0806b500 con 0x7fcd081611a0 2024-09-13T17:06:42.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0d609700 1 --2- 172.21.15.123:0/3607564603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd081611a0 0x7fcd0806d020 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcd080aefb0 tx=0x7fccf8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3a357d1e368196 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:42.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0ce08700 1 -- 172.21.15.123:0/3607564603 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8011830 con 0x7fcd081611a0 2024-09-13T17:06:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0ce08700 1 -- 172.21.15.123:0/3607564603 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf8011990 con 0x7fcd081611a0 2024-09-13T17:06:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0ce08700 1 -- 172.21.15.123:0/3607564603 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8011d40 con 0x7fcd081611a0 2024-09-13T17:06:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/3607564603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd081611a0 msgr2=0x7fcd0806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0ee0c700 1 --2- 172.21.15.123:0/3607564603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd081611a0 0x7fcd0806d020 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcd080aefb0 tx=0x7fccf8009c20 comp rx=0 tx=0).stop 2024-09-13T17:06:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/3607564603 shutdown_connections 2024-09-13T17:06:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0ee0c700 1 --2- 172.21.15.123:0/3607564603 >> v2:172.21.15.153:3300/0 conn(0x7fcd0806d560 0x7fcd0806a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0ee0c700 1 --2- 172.21.15.123:0/3607564603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd081611a0 0x7fcd0806d020 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0ee0c700 1 --2- 172.21.15.123:0/3607564603 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd0806dee0 0x7fcd080cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/3607564603 >> 172.21.15.123:0/3607564603 conn(0x7fcd08066780 msgr2=0x7fcd080719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/3607564603 shutdown_connections 2024-09-13T17:06:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.458+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/3607564603 wait complete. 2024-09-13T17:06:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0ee0c700 1 Processor -- start 2024-09-13T17:06:42.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0ee0c700 1 -- start start 2024-09-13T17:06:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0ee0c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd0806d560 0x7fcd081f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0ee0c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd0806dee0 0x7fcd080cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0ee0c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd081611a0 0x7fcd081402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0ee0c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080b0160 con 0x7fcd0806dee0 2024-09-13T17:06:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0ee0c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080afb50 con 0x7fcd0806d560 2024-09-13T17:06:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0ee0c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080c5510 con 0x7fcd081611a0 2024-09-13T17:06:42.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0d609700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd0806dee0 0x7fcd080cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0de0a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd0806d560 0x7fcd081f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0d609700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd0806dee0 0x7fcd080cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48340/0 (socket says 172.21.15.123:48340) 2024-09-13T17:06:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0d609700 1 -- 172.21.15.123:0/2361216211 learned_addr learned my addr 172.21.15.123:0/2361216211 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0e60b700 1 --2- 172.21.15.123:0/2361216211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd081611a0 0x7fcd081402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0d609700 1 -- 172.21.15.123:0/2361216211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd081611a0 msgr2=0x7fcd081402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0d609700 1 --2- 172.21.15.123:0/2361216211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd081611a0 0x7fcd081402f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0d609700 1 -- 172.21.15.123:0/2361216211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd0806d560 msgr2=0x7fcd081f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0d609700 1 --2- 172.21.15.123:0/2361216211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd0806d560 0x7fcd081f2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0d609700 1 -- 172.21.15.123:0/2361216211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8009570 con 0x7fcd0806dee0 2024-09-13T17:06:42.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0d609700 1 --2- 172.21.15.123:0/2361216211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd0806dee0 0x7fcd080cb8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009c60 tx=0x7fccf8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fccfe7fc700 1 -- 172.21.15.123:0/2361216211 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8004520 con 0x7fcd0806dee0 2024-09-13T17:06:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fccfe7fc700 1 -- 172.21.15.123:0/2361216211 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf80036c0 con 0x7fcd0806dee0 2024-09-13T17:06:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fccfe7fc700 1 -- 172.21.15.123:0/2361216211 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8003a30 con 0x7fcd0806dee0 2024-09-13T17:06:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.462+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/2361216211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd080c57f0 con 0x7fcd0806dee0 2024-09-13T17:06:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.466+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/2361216211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0815fee0 con 0x7fcd0806dee0 2024-09-13T17:06:42.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.466+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/2361216211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd080b4e20 con 0x7fcd0806dee0 2024-09-13T17:06:42.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.466+0000 7fccfe7fc700 1 -- 172.21.15.123:0/2361216211 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fccf8021070 con 0x7fcd0806dee0 2024-09-13T17:06:42.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.466+0000 7fccfe7fc700 1 --2- 172.21.15.123:0/2361216211 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fccec066730 0x7fccec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.466+0000 7fcd0de0a700 1 --2- 172.21.15.123:0/2361216211 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fccec066730 0x7fccec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.466+0000 7fccfe7fc700 1 -- 172.21.15.123:0/2361216211 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fccf8085350 con 0x7fcd0806dee0 2024-09-13T17:06:42.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.470+0000 7fcd0de0a700 1 --2- 172.21.15.123:0/2361216211 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fccec066730 0x7fccec068bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009bf0 tx=0x7fcd04009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:42.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.474+0000 7fccfe7fc700 1 -- 172.21.15.123:0/2361216211 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fccf8052b40 con 0x7fcd0806dee0 2024-09-13T17:06:42.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.646+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/2361216211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd08161690 con 0x7fcd0806dee0 2024-09-13T17:06:42.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.646+0000 7fccfe7fc700 1 -- 172.21.15.123:0/2361216211 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12898 (secure 0 0 0) 0x7fccf8015090 con 0x7fcd0806dee0 2024-09-13T17:06:42.653 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:42.653 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":16,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:39.002109+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:06:42.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.650+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/2361216211 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fccec066730 msgr2=0x7fccec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.650+0000 7fcd0ee0c700 1 --2- 172.21.15.123:0/2361216211 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fccec066730 0x7fccec068bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009bf0 tx=0x7fcd04009240 comp rx=0 tx=0).stop 2024-09-13T17:06:42.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.650+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/2361216211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd0806dee0 msgr2=0x7fcd080cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.650+0000 7fcd0ee0c700 1 --2- 172.21.15.123:0/2361216211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd0806dee0 0x7fcd080cb8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009c60 tx=0x7fccf8004770 comp rx=0 tx=0).stop 2024-09-13T17:06:42.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.650+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/2361216211 shutdown_connections 2024-09-13T17:06:42.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.650+0000 7fcd0ee0c700 1 --2- 172.21.15.123:0/2361216211 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fccec066730 0x7fccec068bf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.650+0000 7fcd0ee0c700 1 --2- 172.21.15.123:0/2361216211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd081611a0 0x7fcd081402f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.650+0000 7fcd0ee0c700 1 --2- 172.21.15.123:0/2361216211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd0806dee0 0x7fcd080cb8f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.650+0000 7fcd0ee0c700 1 --2- 172.21.15.123:0/2361216211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd0806d560 0x7fcd081f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.650+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/2361216211 >> 172.21.15.123:0/2361216211 conn(0x7fcd08066780 msgr2=0x7fcd0806f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:42.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.650+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/2361216211 shutdown_connections 2024-09-13T17:06:42.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.650+0000 7fcd0ee0c700 1 -- 172.21.15.123:0/2361216211 wait complete. 2024-09-13T17:06:42.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:06:42.668 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:06:42.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff02d0f3700 1 Processor -- start 2024-09-13T17:06:42.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff02d0f3700 1 -- start start 2024-09-13T17:06:42.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff02d0f3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff020052d50 0x7ff0200500d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff02d0f3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0200e0020 con 0x7ff020051170 2024-09-13T17:06:42.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff02d0f3700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff020050610 con 0x7ff020006640 2024-09-13T17:06:42.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff02d0f3700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff020006220 con 0x7ff020052d50 2024-09-13T17:06:42.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff0277fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff020051170 0x7ff020053130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35728/0 (socket says 172.21.15.123:35728) 2024-09-13T17:06:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff0277fe700 1 -- 172.21.15.123:0/4193523756 learned_addr learned my addr 172.21.15.123:0/4193523756 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:42.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff027fff700 1 --2- 172.21.15.123:0/4193523756 >> v2:172.21.15.153:3300/0 conn(0x7ff020052d50 0x7ff0200500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff026ffd700 1 -- 172.21.15.123:0/4193523756 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907306009 0 0) 0x7ff0200e0020 con 0x7ff020051170 2024-09-13T17:06:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff026ffd700 1 -- 172.21.15.123:0/4193523756 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0180035d0 con 0x7ff020051170 2024-09-13T17:06:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff027fff700 1 -- 172.21.15.123:0/4193523756 >> v1:172.21.15.153:6789/0 conn(0x7ff020006640 legacy=0x7ff020006a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff027fff700 1 -- 172.21.15.123:0/4193523756 >> v1:172.21.15.123:6789/0 conn(0x7ff020051170 legacy=0x7ff020053130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff027fff700 1 -- 172.21.15.123:0/4193523756 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0200508b0 con 0x7ff020052d50 2024-09-13T17:06:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff027fff700 1 --2- 172.21.15.123:0/4193523756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff020052d50 0x7ff0200500d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff028000b60 tx=0x7ff028069900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86f06150834aa8ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff026ffd700 1 -- 172.21.15.123:0/4193523756 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0280675b0 con 0x7ff020052d50 2024-09-13T17:06:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff026ffd700 1 -- 172.21.15.123:0/4193523756 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff028073f10 con 0x7ff020052d50 2024-09-13T17:06:42.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.782+0000 7ff026ffd700 1 -- 172.21.15.123:0/4193523756 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028067710 con 0x7ff020052d50 2024-09-13T17:06:42.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.786+0000 7ff02d0f3700 1 -- 172.21.15.123:0/4193523756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff020052d50 msgr2=0x7ff0200500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.786+0000 7ff02d0f3700 1 --2- 172.21.15.123:0/4193523756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff020052d50 0x7ff0200500d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff028000b60 tx=0x7ff028069900 comp rx=0 tx=0).stop 2024-09-13T17:06:42.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.786+0000 7ff02d0f3700 1 -- 172.21.15.123:0/4193523756 shutdown_connections 2024-09-13T17:06:42.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.786+0000 7ff02d0f3700 1 --2- 172.21.15.123:0/4193523756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff020052d50 0x7ff0200500d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.786+0000 7ff02d0f3700 1 -- 172.21.15.123:0/4193523756 >> 172.21.15.123:0/4193523756 conn(0x7ff02001e240 msgr2=0x7ff020054f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:42.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.786+0000 7ff02d0f3700 1 -- 172.21.15.123:0/4193523756 shutdown_connections 2024-09-13T17:06:42.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.786+0000 7ff02d0f3700 1 -- 172.21.15.123:0/4193523756 wait complete. 2024-09-13T17:06:42.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.786+0000 7ff02d0f3700 1 Processor -- start 2024-09-13T17:06:42.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.786+0000 7ff02d0f3700 1 -- start start 2024-09-13T17:06:42.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02d0f3700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff020006640 0x7ff0200c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02d0f3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff020051170 0x7ff0200c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02d0f3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff020052d50 0x7ff02004af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02d0f3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0200d6440 con 0x7ff020052d50 2024-09-13T17:06:42.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02d0f3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0200d6650 con 0x7ff020051170 2024-09-13T17:06:42.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02d0f3700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0200d6930 con 0x7ff020006640 2024-09-13T17:06:42.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02c8f2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff020052d50 0x7ff02004af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02c8f2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff020052d50 0x7ff02004af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48356/0 (socket says 172.21.15.123:48356) 2024-09-13T17:06:42.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02c8f2700 1 -- 172.21.15.123:0/3163774619 learned_addr learned my addr 172.21.15.123:0/3163774619 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:42.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff0277fe700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff020051170 0x7ff0200c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff027fff700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff020006640 0x7ff0200c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02c8f2700 1 -- 172.21.15.123:0/3163774619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff020006640 msgr2=0x7ff0200c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02c8f2700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff020006640 0x7ff0200c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02c8f2700 1 -- 172.21.15.123:0/3163774619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff020051170 msgr2=0x7ff0200c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02c8f2700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff020051170 0x7ff0200c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02c8f2700 1 -- 172.21.15.123:0/3163774619 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02804f5c0 con 0x7ff020052d50 2024-09-13T17:06:42.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff0277fe700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff020051170 0x7ff0200c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:42.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff027fff700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff020006640 0x7ff0200c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:42.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02c8f2700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff020052d50 0x7ff02004af20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00c480 tx=0x7ff01c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:42.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff024ff9700 1 -- 172.21.15.123:0/3163774619 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c0052d0 con 0x7ff020052d50 2024-09-13T17:06:42.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02d0f3700 1 -- 172.21.15.123:0/3163774619 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0200d82f0 con 0x7ff020052d50 2024-09-13T17:06:42.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff024ff9700 1 -- 172.21.15.123:0/3163774619 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c005430 con 0x7ff020052d50 2024-09-13T17:06:42.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff024ff9700 1 -- 172.21.15.123:0/3163774619 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c0055a0 con 0x7ff020052d50 2024-09-13T17:06:42.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02d0f3700 1 -- 172.21.15.123:0/3163774619 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0200ca260 con 0x7ff020052d50 2024-09-13T17:06:42.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.790+0000 7ff02d0f3700 1 -- 172.21.15.123:0/3163774619 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0200d8810 con 0x7ff020052d50 2024-09-13T17:06:42.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.794+0000 7ff024ff9700 1 -- 172.21.15.123:0/3163774619 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff01c0038e0 con 0x7ff020052d50 2024-09-13T17:06:42.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.794+0000 7ff024ff9700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff00c066730 0x7ff00c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:42.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.794+0000 7ff024ff9700 1 -- 172.21.15.123:0/3163774619 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff01c0833e0 con 0x7ff020052d50 2024-09-13T17:06:42.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.794+0000 7ff027fff700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff00c066730 0x7ff00c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:42.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.794+0000 7ff027fff700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff00c066730 0x7ff00c068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff020054ed0 tx=0x7ff028097040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:42.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.802+0000 7ff024ff9700 1 -- 172.21.15.123:0/3163774619 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff0200d8810 con 0x7ff020052d50 2024-09-13T17:06:42.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.970+0000 7ff02d0f3700 1 -- 172.21.15.123:0/3163774619 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff0200d8810 con 0x7ff020052d50 2024-09-13T17:06:42.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.970+0000 7ff024ff9700 1 -- 172.21.15.123:0/3163774619 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0200d8810 con 0x7ff020052d50 2024-09-13T17:06:42.976 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:06:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.970+0000 7ff02d0f3700 1 -- 172.21.15.123:0/3163774619 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff00c066730 msgr2=0x7ff00c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.970+0000 7ff02d0f3700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff00c066730 0x7ff00c068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff020054ed0 tx=0x7ff028097040 comp rx=0 tx=0).stop 2024-09-13T17:06:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.970+0000 7ff02d0f3700 1 -- 172.21.15.123:0/3163774619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff020052d50 msgr2=0x7ff02004af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.970+0000 7ff02d0f3700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff020052d50 0x7ff02004af20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00c480 tx=0x7ff01c00c840 comp rx=0 tx=0).stop 2024-09-13T17:06:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.970+0000 7ff02d0f3700 1 -- 172.21.15.123:0/3163774619 shutdown_connections 2024-09-13T17:06:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.970+0000 7ff02d0f3700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff00c066730 0x7ff00c068bf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.970+0000 7ff02d0f3700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff020052d50 0x7ff02004af20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.970+0000 7ff02d0f3700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff020051170 0x7ff0200c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.970+0000 7ff02d0f3700 1 --2- 172.21.15.123:0/3163774619 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff020006640 0x7ff0200c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:42.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.970+0000 7ff02d0f3700 1 -- 172.21.15.123:0/3163774619 >> 172.21.15.123:0/3163774619 conn(0x7ff02001e240 msgr2=0x7ff0200369e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:42.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.970+0000 7ff02d0f3700 1 -- 172.21.15.123:0/3163774619 shutdown_connections 2024-09-13T17:06:42.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:42.974+0000 7ff02d0f3700 1 -- 172.21.15.123:0/3163774619 wait complete. 2024-09-13T17:06:42.989 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:06:43.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.090+0000 7f9011b8b700 1 Processor -- start 2024-09-13T17:06:43.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.090+0000 7f9011b8b700 1 -- start start 2024-09-13T17:06:43.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9011b8b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f900c0cdb70 0x7f900c0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:43.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9011b8b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900c0cb730 con 0x7f900c153770 2024-09-13T17:06:43.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9011b8b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900c0cba10 con 0x7f900c153390 2024-09-13T17:06:43.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9011b8b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c1595a0 con 0x7f900c0cdb70 2024-09-13T17:06:43.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f901138a700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f900c153770 0x7f900c0ad700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35744/0 (socket says 172.21.15.123:35744) 2024-09-13T17:06:43.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f901138a700 1 -- 172.21.15.123:0/3942580812 learned_addr learned my addr 172.21.15.123:0/3942580812 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:43.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9003fff700 1 --2- 172.21.15.123:0/3942580812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f900c0cdb70 0x7f900c0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:43.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 -- 172.21.15.123:0/3942580812 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217540472 0 0) 0x7f900c0cb730 con 0x7f900c153770 2024-09-13T17:06:43.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 -- 172.21.15.123:0/3942580812 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ff40035d0 con 0x7f900c153770 2024-09-13T17:06:43.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 -- 172.21.15.123:0/3942580812 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2463953433 0 0) 0x7f8ff40035d0 con 0x7f900c153770 2024-09-13T17:06:43.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 -- 172.21.15.123:0/3942580812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f900c0cdb70 msgr2=0x7f900c0cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:43.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 --2- 172.21.15.123:0/3942580812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f900c0cdb70 0x7f900c0cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:43.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 -- 172.21.15.123:0/3942580812 >> v1:172.21.15.153:6789/0 conn(0x7f900c153390 legacy=0x7f900c159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:43.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 -- 172.21.15.123:0/3942580812 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c159780 con 0x7f900c153770 2024-09-13T17:06:43.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 -- 172.21.15.123:0/3942580812 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f90040019f0 con 0x7f900c153770 2024-09-13T17:06:43.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 -- 172.21.15.123:0/3942580812 >> v1:172.21.15.123:6789/0 conn(0x7f900c153770 legacy=0x7f900c0ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:43.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 --2- 172.21.15.123:0/3942580812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff4003a50 0x7f8ff4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:43.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 --2- 172.21.15.123:0/3942580812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f900c0cdb70 0x7f8ff4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:43.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 --2- 172.21.15.123:0/3942580812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff4004db0 0x7f8ff4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:43.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 -- 172.21.15.123:0/3942580812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c1595a0 con 0x7f8ff4003a50 2024-09-13T17:06:43.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 -- 172.21.15.123:0/3942580812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff400bb10 con 0x7f8ff4004db0 2024-09-13T17:06:43.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 -- 172.21.15.123:0/3942580812 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff400dee0 con 0x7f900c0cdb70 2024-09-13T17:06:43.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9010b89700 1 --2- 172.21.15.123:0/3942580812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff4003a50 0x7f8ff4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:43.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9003fff700 1 --2- 172.21.15.123:0/3942580812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f900c0cdb70 0x7f8ff4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:43.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f901138a700 1 --2- 172.21.15.123:0/3942580812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff4004db0 0x7f8ff4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:43.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9010b89700 1 -- 172.21.15.123:0/3942580812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f900c0cdb70 msgr2=0x7f8ff4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:43.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9010b89700 1 --2- 172.21.15.123:0/3942580812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f900c0cdb70 0x7f8ff4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:43.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9010b89700 1 -- 172.21.15.123:0/3942580812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff4004db0 msgr2=0x7f8ff4005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:43.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9010b89700 1 --2- 172.21.15.123:0/3942580812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff4004db0 0x7f8ff4005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:43.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9010b89700 1 -- 172.21.15.123:0/3942580812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff40035d0 con 0x7f8ff4003a50 2024-09-13T17:06:43.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9010b89700 1 --2- 172.21.15.123:0/3942580812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff4003a50 0x7f8ff4003e70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f90080017e0 tx=0x7f8ff40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f3d16f64a84da8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:43.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 -- 172.21.15.123:0/3942580812 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080052d0 con 0x7f8ff4003a50 2024-09-13T17:06:43.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 -- 172.21.15.123:0/3942580812 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9008005430 con 0x7f8ff4003a50 2024-09-13T17:06:43.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f90037fe700 1 -- 172.21.15.123:0/3942580812 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080055a0 con 0x7f8ff4003a50 2024-09-13T17:06:43.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9011b8b700 1 -- 172.21.15.123:0/3942580812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff4003a50 msgr2=0x7f8ff4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:43.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9011b8b700 1 --2- 172.21.15.123:0/3942580812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff4003a50 0x7f8ff4003e70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f90080017e0 tx=0x7f8ff40058a0 comp rx=0 tx=0).stop 2024-09-13T17:06:43.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f901138a700 1 -- 172.21.15.123:0/3942580812 reap_dead start 2024-09-13T17:06:43.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9011b8b700 1 -- 172.21.15.123:0/3942580812 shutdown_connections 2024-09-13T17:06:43.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9011b8b700 1 -- 172.21.15.123:0/3942580812 >> 172.21.15.123:0/3942580812 conn(0x7f900c066150 msgr2=0x7f900c066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:43.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9011b8b700 1 -- 172.21.15.123:0/3942580812 shutdown_connections 2024-09-13T17:06:43.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.094+0000 7f9011b8b700 1 -- 172.21.15.123:0/3942580812 wait complete. 2024-09-13T17:06:43.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9011b8b700 1 Processor -- start 2024-09-13T17:06:43.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9011b8b700 1 -- start start 2024-09-13T17:06:43.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9011b8b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff4003a50 0x7f900c1ee4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:43.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9011b8b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f900c14edc0 0x7f900c150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:43.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9011b8b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f900c1513a0 0x7f900c1e1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:43.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9011b8b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c1527b0 con 0x7f8ff4003a50 2024-09-13T17:06:43.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9011b8b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c151c30 con 0x7f900c1513a0 2024-09-13T17:06:43.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9011b8b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c151f10 con 0x7f900c14edc0 2024-09-13T17:06:43.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9010b89700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff4003a50 0x7f900c1ee4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:43.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9010b89700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff4003a50 0x7f900c1ee4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48364/0 (socket says 172.21.15.123:48364) 2024-09-13T17:06:43.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9010b89700 1 -- 172.21.15.123:0/1051124178 learned_addr learned my addr 172.21.15.123:0/1051124178 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:43.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9003fff700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f900c14edc0 0x7f900c150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:43.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f901138a700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f900c1513a0 0x7f900c1e1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:43.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9010b89700 1 -- 172.21.15.123:0/1051124178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f900c14edc0 msgr2=0x7f900c150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9010b89700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f900c14edc0 0x7f900c150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9010b89700 1 -- 172.21.15.123:0/1051124178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f900c1513a0 msgr2=0x7f900c1e1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9010b89700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f900c1513a0 0x7f900c1e1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9010b89700 1 -- 172.21.15.123:0/1051124178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c1521f0 con 0x7f8ff4003a50 2024-09-13T17:06:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f901138a700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f900c1513a0 0x7f900c1e1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:06:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f9010b89700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff4003a50 0x7f900c1ee4a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9008000c00 tx=0x7f9008001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.098+0000 7f90017fa700 1 -- 172.21.15.123:0/1051124178 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080055a0 con 0x7f8ff4003a50 2024-09-13T17:06:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.102+0000 7f90017fa700 1 -- 172.21.15.123:0/1051124178 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9008007240 con 0x7f8ff4003a50 2024-09-13T17:06:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.102+0000 7f9011b8b700 1 -- 172.21.15.123:0/1051124178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900c1524d0 con 0x7f8ff4003a50 2024-09-13T17:06:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.102+0000 7f90017fa700 1 -- 172.21.15.123:0/1051124178 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080075d0 con 0x7f8ff4003a50 2024-09-13T17:06:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.102+0000 7f9011b8b700 1 -- 172.21.15.123:0/1051124178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900c151850 con 0x7f8ff4003a50 2024-09-13T17:06:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.102+0000 7f9011b8b700 1 -- 172.21.15.123:0/1051124178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900c0677f0 con 0x7f8ff4003a50 2024-09-13T17:06:43.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.102+0000 7f90017fa700 1 -- 172.21.15.123:0/1051124178 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f90080036a0 con 0x7f8ff4003a50 2024-09-13T17:06:43.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.102+0000 7f90017fa700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ff8066760 0x7f8ff8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:43.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.106+0000 7f90017fa700 1 -- 172.21.15.123:0/1051124178 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9008084de0 con 0x7f8ff4003a50 2024-09-13T17:06:43.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.106+0000 7f9003fff700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ff8066760 0x7f8ff8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:43.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.106+0000 7f9003fff700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ff8066760 0x7f8ff8068c20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f900c1e3090 tx=0x7f8ffc008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:43.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.110+0000 7f90017fa700 1 -- 172.21.15.123:0/1051124178 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9008052650 con 0x7f8ff4003a50 2024-09-13T17:06:43.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.318+0000 7f9011b8b700 1 -- 172.21.15.123:0/1051124178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f900c14c3d0 con 0x7f8ff4003a50 2024-09-13T17:06:43.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.318+0000 7f90017fa700 1 -- 172.21.15.123:0/1051124178 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7f900802c500 con 0x7f8ff4003a50 2024-09-13T17:06:43.324 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:43.324 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1472515409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1472515409},{"type":"v1","addr":"172.21.15.123:6837","nonce":1472515409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T17:06:43.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.322+0000 7f9011b8b700 1 -- 172.21.15.123:0/1051124178 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ff8066760 msgr2=0x7f8ff8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:43.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.322+0000 7f9011b8b700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ff8066760 0x7f8ff8068c20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f900c1e3090 tx=0x7f8ffc008040 comp rx=0 tx=0).stop 2024-09-13T17:06:43.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.322+0000 7f9011b8b700 1 -- 172.21.15.123:0/1051124178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff4003a50 msgr2=0x7f900c1ee4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:43.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.322+0000 7f9011b8b700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff4003a50 0x7f900c1ee4a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9008000c00 tx=0x7f9008001120 comp rx=0 tx=0).stop 2024-09-13T17:06:43.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.322+0000 7f9011b8b700 1 -- 172.21.15.123:0/1051124178 shutdown_connections 2024-09-13T17:06:43.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.322+0000 7f9011b8b700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ff8066760 0x7f8ff8068c20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:43.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.322+0000 7f9011b8b700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f900c1513a0 0x7f900c1e1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:43.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.322+0000 7f9011b8b700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f900c14edc0 0x7f900c150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:43.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.322+0000 7f9011b8b700 1 --2- 172.21.15.123:0/1051124178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff4003a50 0x7f900c1ee4a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:43.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.322+0000 7f9011b8b700 1 -- 172.21.15.123:0/1051124178 >> 172.21.15.123:0/1051124178 conn(0x7f900c066150 msgr2=0x7f900c06d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:43.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.322+0000 7f9011b8b700 1 -- 172.21.15.123:0/1051124178 shutdown_connections 2024-09-13T17:06:43.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:43.322+0000 7f9011b8b700 1 -- 172.21.15.123:0/1051124178 wait complete. 2024-09-13T17:06:43.329 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 2 2024-09-13T17:06:45.340 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:06:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66f2855700 1 Processor -- start 2024-09-13T17:06:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66f2855700 1 -- start start 2024-09-13T17:06:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66f2855700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66ec0cec90 0x7f66ec0adef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66f2855700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f66ec0ad9a0 0x7f66ec0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66f2855700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec0cf5b0 con 0x7f66ec071710 2024-09-13T17:06:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66f2855700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ec06d220 con 0x7f66ec0ad9a0 2024-09-13T17:06:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66f2855700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec06d500 con 0x7f66ec0cec90 2024-09-13T17:06:45.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66f0df2700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f66ec071710 0x7f66ec071bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:39478/0 (socket says 172.21.15.123:39478) 2024-09-13T17:06:45.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66f0df2700 1 -- 172.21.15.123:0/1836971132 learned_addr learned my addr 172.21.15.123:0/1836971132 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:45.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66eb7fe700 1 --2- 172.21.15.123:0/1836971132 >> v2:172.21.15.153:3300/0 conn(0x7f66ec0ad9a0 0x7f66ec0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66ebfff700 1 --2- 172.21.15.123:0/1836971132 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66ec0cec90 0x7f66ec0adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66eaffd700 1 -- 172.21.15.123:0/1836971132 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642168006 0 0) 0x7f66ec0cf5b0 con 0x7f66ec071710 2024-09-13T17:06:45.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66eb7fe700 1 -- 172.21.15.123:0/1836971132 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66ec0cec90 msgr2=0x7f66ec0adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:45.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66eb7fe700 1 --2- 172.21.15.123:0/1836971132 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66ec0cec90 0x7f66ec0adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66eb7fe700 1 -- 172.21.15.123:0/1836971132 >> v1:172.21.15.153:6789/0 conn(0x7f66ec071710 legacy=0x7f66ec071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.454+0000 7f66eb7fe700 1 -- 172.21.15.123:0/1836971132 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec06d7e0 con 0x7f66ec0ad9a0 2024-09-13T17:06:45.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.458+0000 7f66eb7fe700 1 --2- 172.21.15.123:0/1836971132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ec0ad9a0 0x7f66ec0cf070 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009850 tx=0x7f66d4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=117b382d1b5d9797 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.458+0000 7f66eaffd700 1 -- 172.21.15.123:0/1836971132 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4011830 con 0x7f66ec0ad9a0 2024-09-13T17:06:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.458+0000 7f66eaffd700 1 -- 172.21.15.123:0/1836971132 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d4011990 con 0x7f66ec0ad9a0 2024-09-13T17:06:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.458+0000 7f66eaffd700 1 -- 172.21.15.123:0/1836971132 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4011d40 con 0x7f66ec0ad9a0 2024-09-13T17:06:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.458+0000 7f66f2855700 1 -- 172.21.15.123:0/1836971132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ec0ad9a0 msgr2=0x7f66ec0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.458+0000 7f66f2855700 1 --2- 172.21.15.123:0/1836971132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ec0ad9a0 0x7f66ec0cf070 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009850 tx=0x7f66d4009b60 comp rx=0 tx=0).stop 2024-09-13T17:06:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.458+0000 7f66f2855700 1 -- 172.21.15.123:0/1836971132 shutdown_connections 2024-09-13T17:06:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.458+0000 7f66f2855700 1 --2- 172.21.15.123:0/1836971132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ec0ad9a0 0x7f66ec0cf070 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.458+0000 7f66f2855700 1 --2- 172.21.15.123:0/1836971132 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66ec0cec90 0x7f66ec0adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.458+0000 7f66f2855700 1 -- 172.21.15.123:0/1836971132 >> 172.21.15.123:0/1836971132 conn(0x7f66ec066570 msgr2=0x7f66ec066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.458+0000 7f66f2855700 1 -- 172.21.15.123:0/1836971132 shutdown_connections 2024-09-13T17:06:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.458+0000 7f66f2855700 1 -- 172.21.15.123:0/1836971132 wait complete. 2024-09-13T17:06:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.458+0000 7f66f2855700 1 Processor -- start 2024-09-13T17:06:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.458+0000 7f66f2855700 1 -- start start 2024-09-13T17:06:45.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f2855700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66ec071710 0x7f66ec1ec850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f2855700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ec0ad9a0 0x7f66ec0b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f2855700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66ec0cec90 0x7f66ec0b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f2855700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec15a800 con 0x7f66ec0cec90 2024-09-13T17:06:45.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f2855700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec159f10 con 0x7f66ec0ad9a0 2024-09-13T17:06:45.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f2855700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec1f02b0 con 0x7f66ec071710 2024-09-13T17:06:45.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f0df2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66ec0cec90 0x7f66ec0b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f0df2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66ec0cec90 0x7f66ec0b0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48368/0 (socket says 172.21.15.123:48368) 2024-09-13T17:06:45.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f0df2700 1 -- 172.21.15.123:0/3225051636 learned_addr learned my addr 172.21.15.123:0/3225051636 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:45.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66eb7fe700 1 --2- 172.21.15.123:0/3225051636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ec0ad9a0 0x7f66ec0b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66ebfff700 1 --2- 172.21.15.123:0/3225051636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66ec071710 0x7f66ec1ec850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f0df2700 1 -- 172.21.15.123:0/3225051636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66ec071710 msgr2=0x7f66ec1ec850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f0df2700 1 --2- 172.21.15.123:0/3225051636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66ec071710 0x7f66ec1ec850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f0df2700 1 -- 172.21.15.123:0/3225051636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ec0ad9a0 msgr2=0x7f66ec0b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f0df2700 1 --2- 172.21.15.123:0/3225051636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ec0ad9a0 0x7f66ec0b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f0df2700 1 -- 172.21.15.123:0/3225051636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d40094b0 con 0x7f66ec0cec90 2024-09-13T17:06:45.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f0df2700 1 --2- 172.21.15.123:0/3225051636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66ec0cec90 0x7f66ec0b0f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66e4002210 tx=0x7f66e400c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:45.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66e8ff9700 1 -- 172.21.15.123:0/3225051636 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e400ce00 con 0x7f66ec0cec90 2024-09-13T17:06:45.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66e8ff9700 1 -- 172.21.15.123:0/3225051636 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e40070d0 con 0x7f66ec0cec90 2024-09-13T17:06:45.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f2855700 1 -- 172.21.15.123:0/3225051636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec15a1b0 con 0x7f66ec0cec90 2024-09-13T17:06:45.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66e8ff9700 1 -- 172.21.15.123:0/3225051636 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4007480 con 0x7f66ec0cec90 2024-09-13T17:06:45.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f2855700 1 -- 172.21.15.123:0/3225051636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec1ecd90 con 0x7f66ec0cec90 2024-09-13T17:06:45.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.462+0000 7f66f2855700 1 -- 172.21.15.123:0/3225051636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ec0cf530 con 0x7f66ec0cec90 2024-09-13T17:06:45.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.466+0000 7f66e8ff9700 1 -- 172.21.15.123:0/3225051636 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f66e40075e0 con 0x7f66ec0cec90 2024-09-13T17:06:45.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.466+0000 7f66e8ff9700 1 --2- 172.21.15.123:0/3225051636 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66cc066730 0x7f66cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.466+0000 7f66ebfff700 1 --2- 172.21.15.123:0/3225051636 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66cc066730 0x7f66cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.466+0000 7f66e8ff9700 1 -- 172.21.15.123:0/3225051636 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f66e4086a60 con 0x7f66ec0cec90 2024-09-13T17:06:45.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.466+0000 7f66ebfff700 1 --2- 172.21.15.123:0/3225051636 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66cc066730 0x7f66cc068bf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009b50 tx=0x7f66dc009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:45.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.470+0000 7f66e8ff9700 1 -- 172.21.15.123:0/3225051636 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f66e4054120 con 0x7f66ec0cec90 2024-09-13T17:06:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.674+0000 7f66f2855700 1 -- 172.21.15.123:0/3225051636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66ec0adef0 con 0x7f66ec0cec90 2024-09-13T17:06:45.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.678+0000 7f66e8ff9700 1 -- 172.21.15.123:0/3225051636 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7f66e4015090 con 0x7f66ec0cec90 2024-09-13T17:06:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:45.682 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/721071800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":721071800},{"type":"v1","addr":"172.21.15.123:6835","nonce":721071800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1472515409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1472515409},{"type":"v1","addr":"172.21.15.123:6837","nonce":1472515409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3017694841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3017694841},{"type":"v1","addr":"172.21.15.153:6833","nonce":3017694841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2848393496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2848393496},{"type":"v1","addr":"172.21.15.153:6835","nonce":2848393496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T17:06:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.678+0000 7f66f2855700 1 -- 172.21.15.123:0/3225051636 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66cc066730 msgr2=0x7f66cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.678+0000 7f66f2855700 1 --2- 172.21.15.123:0/3225051636 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66cc066730 0x7f66cc068bf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009b50 tx=0x7f66dc009240 comp rx=0 tx=0).stop 2024-09-13T17:06:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.678+0000 7f66f2855700 1 -- 172.21.15.123:0/3225051636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66ec0cec90 msgr2=0x7f66ec0b0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.678+0000 7f66f2855700 1 --2- 172.21.15.123:0/3225051636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66ec0cec90 0x7f66ec0b0f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66e4002210 tx=0x7f66e400c550 comp rx=0 tx=0).stop 2024-09-13T17:06:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.678+0000 7f66f2855700 1 -- 172.21.15.123:0/3225051636 shutdown_connections 2024-09-13T17:06:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.678+0000 7f66f2855700 1 --2- 172.21.15.123:0/3225051636 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66cc066730 0x7f66cc068bf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.678+0000 7f66f2855700 1 --2- 172.21.15.123:0/3225051636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66ec0cec90 0x7f66ec0b0f40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.678+0000 7f66f2855700 1 --2- 172.21.15.123:0/3225051636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ec0ad9a0 0x7f66ec0b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.678+0000 7f66f2855700 1 --2- 172.21.15.123:0/3225051636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66ec071710 0x7f66ec1ec850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.678+0000 7f66f2855700 1 -- 172.21.15.123:0/3225051636 >> 172.21.15.123:0/3225051636 conn(0x7f66ec066570 msgr2=0x7f66ec155860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.678+0000 7f66f2855700 1 -- 172.21.15.123:0/3225051636 shutdown_connections 2024-09-13T17:06:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.678+0000 7f66f2855700 1 -- 172.21.15.123:0/3225051636 wait complete. 2024-09-13T17:06:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 3 2024-09-13T17:06:45.696 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:06:45.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.802+0000 7f678bfff700 1 Processor -- start 2024-09-13T17:06:45.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.802+0000 7f678bfff700 1 -- start start 2024-09-13T17:06:45.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.802+0000 7f678bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678c071760 0x7f678c15a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.802+0000 7f678bfff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678c15a860 con 0x7f678c1509e0 2024-09-13T17:06:45.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.802+0000 7f678bfff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678c15ab40 con 0x7f678c159da0 2024-09-13T17:06:45.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.802+0000 7f678bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678c0b3700 con 0x7f678c071760 2024-09-13T17:06:45.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.802+0000 7f678affd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f678c1509e0 0x7f678c0b3f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35756/0 (socket says 172.21.15.123:35756) 2024-09-13T17:06:45.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.802+0000 7f678affd700 1 -- 172.21.15.123:0/2680922361 learned_addr learned my addr 172.21.15.123:0/2680922361 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:45.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.802+0000 7f678b7fe700 1 --2- 172.21.15.123:0/2680922361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678c071760 0x7f678c15a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f6789ffb700 1 -- 172.21.15.123:0/2680922361 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160017895 0 0) 0x7f678c15a860 con 0x7f678c1509e0 2024-09-13T17:06:45.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f6789ffb700 1 -- 172.21.15.123:0/2680922361 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67780035d0 con 0x7f678c1509e0 2024-09-13T17:06:45.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f6789ffb700 1 -- 172.21.15.123:0/2680922361 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620228471 0 0) 0x7f678c15ab40 con 0x7f678c159da0 2024-09-13T17:06:45.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f6789ffb700 1 -- 172.21.15.123:0/2680922361 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f678c15a860 con 0x7f678c159da0 2024-09-13T17:06:45.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f678b7fe700 1 -- 172.21.15.123:0/2680922361 >> v1:172.21.15.153:6789/0 conn(0x7f678c159da0 legacy=0x7f678c071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f678b7fe700 1 -- 172.21.15.123:0/2680922361 >> v1:172.21.15.123:6789/0 conn(0x7f678c1509e0 legacy=0x7f678c0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f678b7fe700 1 -- 172.21.15.123:0/2680922361 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c0b39e0 con 0x7f678c071760 2024-09-13T17:06:45.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f678b7fe700 1 --2- 172.21.15.123:0/2680922361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678c071760 0x7f678c15a210 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6784009880 tx=0x7f6784009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=927ef0e34df86e13 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:45.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f6789ffb700 1 -- 172.21.15.123:0/2680922361 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784011830 con 0x7f678c071760 2024-09-13T17:06:45.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f6789ffb700 1 -- 172.21.15.123:0/2680922361 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6784011990 con 0x7f678c071760 2024-09-13T17:06:45.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f6789ffb700 1 -- 172.21.15.123:0/2680922361 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784011d00 con 0x7f678c071760 2024-09-13T17:06:45.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f678bfff700 1 -- 172.21.15.123:0/2680922361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678c071760 msgr2=0x7f678c15a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f678bfff700 1 --2- 172.21.15.123:0/2680922361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678c071760 0x7f678c15a210 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6784009880 tx=0x7f6784009b90 comp rx=0 tx=0).stop 2024-09-13T17:06:45.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f678bfff700 1 -- 172.21.15.123:0/2680922361 shutdown_connections 2024-09-13T17:06:45.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f678bfff700 1 --2- 172.21.15.123:0/2680922361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678c071760 0x7f678c15a210 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f678bfff700 1 -- 172.21.15.123:0/2680922361 >> 172.21.15.123:0/2680922361 conn(0x7f678c06fa10 msgr2=0x7f678c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:45.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f678bfff700 1 -- 172.21.15.123:0/2680922361 shutdown_connections 2024-09-13T17:06:45.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.806+0000 7f678bfff700 1 -- 172.21.15.123:0/2680922361 wait complete. 2024-09-13T17:06:45.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678bfff700 1 Processor -- start 2024-09-13T17:06:45.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678bfff700 1 -- start start 2024-09-13T17:06:45.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c071760 0x7f678c14fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c1509e0 0x7f678c1f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678c159da0 0x7f678c153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678bfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c0cc400 con 0x7f678c1509e0 2024-09-13T17:06:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678bfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c0cc610 con 0x7f678c071760 2024-09-13T17:06:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678c0cc8f0 con 0x7f678c159da0 2024-09-13T17:06:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c1509e0 0x7f678c1f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c1509e0 0x7f678c1f2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48378/0 (socket says 172.21.15.123:48378) 2024-09-13T17:06:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678a7fc700 1 -- 172.21.15.123:0/1685344471 learned_addr learned my addr 172.21.15.123:0/1685344471 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678b7fe700 1 --2- 172.21.15.123:0/1685344471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678c159da0 0x7f678c153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678affd700 1 --2- 172.21.15.123:0/1685344471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c071760 0x7f678c14fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678a7fc700 1 -- 172.21.15.123:0/1685344471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678c159da0 msgr2=0x7f678c153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678a7fc700 1 --2- 172.21.15.123:0/1685344471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678c159da0 0x7f678c153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678a7fc700 1 -- 172.21.15.123:0/1685344471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c071760 msgr2=0x7f678c14fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678a7fc700 1 --2- 172.21.15.123:0/1685344471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c071760 0x7f678c14fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678a7fc700 1 -- 172.21.15.123:0/1685344471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67840094b0 con 0x7f678c1509e0 2024-09-13T17:06:45.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678a7fc700 1 --2- 172.21.15.123:0/1685344471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c1509e0 0x7f678c1f2780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f677400c490 tx=0x7f677400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:45.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f6783fff700 1 -- 172.21.15.123:0/1685344471 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400cea0 con 0x7f678c1509e0 2024-09-13T17:06:45.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f6783fff700 1 -- 172.21.15.123:0/1685344471 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67740052f0 con 0x7f678c1509e0 2024-09-13T17:06:45.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678bfff700 1 -- 172.21.15.123:0/1685344471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678c0ccbd0 con 0x7f678c1509e0 2024-09-13T17:06:45.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f6783fff700 1 -- 172.21.15.123:0/1685344471 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67740036a0 con 0x7f678c1509e0 2024-09-13T17:06:45.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.810+0000 7f678bfff700 1 -- 172.21.15.123:0/1685344471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678c153ec0 con 0x7f678c1509e0 2024-09-13T17:06:45.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.814+0000 7f678bfff700 1 -- 172.21.15.123:0/1685344471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678c0cd0f0 con 0x7f678c1509e0 2024-09-13T17:06:45.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.814+0000 7f6783fff700 1 -- 172.21.15.123:0/1685344471 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6774003800 con 0x7f678c1509e0 2024-09-13T17:06:45.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.814+0000 7f6783fff700 1 --2- 172.21.15.123:0/1685344471 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f676c066760 0x7f676c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:45.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.814+0000 7f6783fff700 1 -- 172.21.15.123:0/1685344471 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6774083180 con 0x7f678c1509e0 2024-09-13T17:06:45.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.814+0000 7f678affd700 1 --2- 172.21.15.123:0/1685344471 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f676c066760 0x7f676c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:45.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.814+0000 7f678affd700 1 --2- 172.21.15.123:0/1685344471 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f676c066760 0x7f676c068c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f677c001560 tx=0x7f677c001a90 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:45.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.826+0000 7f6783fff700 1 -- 172.21.15.123:0/1685344471 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f678c0cd0f0 con 0x7f678c1509e0 2024-09-13T17:06:45.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.990+0000 7f678bfff700 1 -- 172.21.15.123:0/1685344471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f678c0cd0f0 con 0x7f678c1509e0 2024-09-13T17:06:45.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.994+0000 7f6783fff700 1 -- 172.21.15.123:0/1685344471 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12898 (secure 0 0 0) 0x7f678c0cd0f0 con 0x7f678c1509e0 2024-09-13T17:06:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:45.998 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":16,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:39.002109+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:06:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.994+0000 7f678bfff700 1 -- 172.21.15.123:0/1685344471 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f676c066760 msgr2=0x7f676c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.994+0000 7f678bfff700 1 --2- 172.21.15.123:0/1685344471 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f676c066760 0x7f676c068c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f677c001560 tx=0x7f677c001a90 comp rx=0 tx=0).stop 2024-09-13T17:06:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.994+0000 7f678bfff700 1 -- 172.21.15.123:0/1685344471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c1509e0 msgr2=0x7f678c1f2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.994+0000 7f678bfff700 1 --2- 172.21.15.123:0/1685344471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c1509e0 0x7f678c1f2780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f677400c490 tx=0x7f677400c7a0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.994+0000 7f678bfff700 1 -- 172.21.15.123:0/1685344471 shutdown_connections 2024-09-13T17:06:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.994+0000 7f678bfff700 1 --2- 172.21.15.123:0/1685344471 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f676c066760 0x7f676c068c20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.994+0000 7f678bfff700 1 --2- 172.21.15.123:0/1685344471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678c159da0 0x7f678c153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.994+0000 7f678bfff700 1 --2- 172.21.15.123:0/1685344471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f678c1509e0 0x7f678c1f2780 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.998+0000 7f678bfff700 1 --2- 172.21.15.123:0/1685344471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c071760 0x7f678c14fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.998+0000 7f678bfff700 1 -- 172.21.15.123:0/1685344471 >> 172.21.15.123:0/1685344471 conn(0x7f678c06fa10 msgr2=0x7f678c0aecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.998+0000 7f678bfff700 1 -- 172.21.15.123:0/1685344471 shutdown_connections 2024-09-13T17:06:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:45.998+0000 7f678bfff700 1 -- 172.21.15.123:0/1685344471 wait complete. 2024-09-13T17:06:46.016 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:06:46.017 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:06:46.070 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:06:46.072 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:06:46.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.126+0000 7f5a95977700 1 Processor -- start 2024-09-13T17:06:46.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.126+0000 7f5a95977700 1 -- start start 2024-09-13T17:06:46.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a95977700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5a880e3090 0x7f5a8803a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a95977700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a88036fb0 con 0x7f5a88034690 2024-09-13T17:06:46.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a95977700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a88008b60 con 0x7f5a88036ab0 2024-09-13T17:06:46.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a95977700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a88054370 con 0x7f5a880e3090 2024-09-13T17:06:46.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a8ffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5a88034690 0x7f5a8803a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35762/0 (socket says 172.21.15.123:35762) 2024-09-13T17:06:46.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a8ffff700 1 -- 172.21.15.123:0/878978265 learned_addr learned my addr 172.21.15.123:0/878978265 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:46.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a94975700 1 --2- 172.21.15.123:0/878978265 >> v2:172.21.15.153:3300/0 conn(0x7f5a880e3090 0x7f5a8803a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a8f7fe700 1 -- 172.21.15.123:0/878978265 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234890047 0 0) 0x7f5a88036fb0 con 0x7f5a88034690 2024-09-13T17:06:46.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a8f7fe700 1 -- 172.21.15.123:0/878978265 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a780035d0 con 0x7f5a88034690 2024-09-13T17:06:46.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a94975700 1 -- 172.21.15.123:0/878978265 >> v1:172.21.15.153:6789/0 conn(0x7f5a88036ab0 legacy=0x7f5a880077e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a94975700 1 -- 172.21.15.123:0/878978265 >> v1:172.21.15.123:6789/0 conn(0x7f5a88034690 legacy=0x7f5a8803a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a94975700 1 -- 172.21.15.123:0/878978265 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a88035160 con 0x7f5a880e3090 2024-09-13T17:06:46.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a94975700 1 --2- 172.21.15.123:0/878978265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a880e3090 0x7f5a8803a440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5a84009850 tx=0x7f5a84009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f2098454d594ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:46.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a8f7fe700 1 -- 172.21.15.123:0/878978265 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a84011830 con 0x7f5a880e3090 2024-09-13T17:06:46.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a8f7fe700 1 -- 172.21.15.123:0/878978265 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a84011990 con 0x7f5a880e3090 2024-09-13T17:06:46.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.130+0000 7f5a8f7fe700 1 -- 172.21.15.123:0/878978265 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a84011d40 con 0x7f5a880e3090 2024-09-13T17:06:46.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 -- 172.21.15.123:0/878978265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a880e3090 msgr2=0x7f5a8803a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 --2- 172.21.15.123:0/878978265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a880e3090 0x7f5a8803a440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5a84009850 tx=0x7f5a84009b60 comp rx=0 tx=0).stop 2024-09-13T17:06:46.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 -- 172.21.15.123:0/878978265 shutdown_connections 2024-09-13T17:06:46.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 --2- 172.21.15.123:0/878978265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a880e3090 0x7f5a8803a440 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 -- 172.21.15.123:0/878978265 >> 172.21.15.123:0/878978265 conn(0x7f5a8801eaf0 msgr2=0x7f5a88055790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:46.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 -- 172.21.15.123:0/878978265 shutdown_connections 2024-09-13T17:06:46.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 -- 172.21.15.123:0/878978265 wait complete. 2024-09-13T17:06:46.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 Processor -- start 2024-09-13T17:06:46.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 -- start start 2024-09-13T17:06:46.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a88034690 0x7f5a880d9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a88036ab0 0x7f5a8804c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a880e3090 0x7f5a880066d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8804f910 con 0x7f5a88036ab0 2024-09-13T17:06:46.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8804cda0 con 0x7f5a88034690 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8804f070 con 0x7f5a880e3090 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a8ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a88036ab0 0x7f5a8804c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a8ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a88036ab0 0x7f5a8804c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48380/0 (socket says 172.21.15.123:48380) 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a8ffff700 1 -- 172.21.15.123:0/2802223738 learned_addr learned my addr 172.21.15.123:0/2802223738 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a94975700 1 --2- 172.21.15.123:0/2802223738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a88034690 0x7f5a880d9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95176700 1 --2- 172.21.15.123:0/2802223738 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a880e3090 0x7f5a880066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a8ffff700 1 -- 172.21.15.123:0/2802223738 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a880e3090 msgr2=0x7f5a880066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a8ffff700 1 --2- 172.21.15.123:0/2802223738 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a880e3090 0x7f5a880066d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a8ffff700 1 -- 172.21.15.123:0/2802223738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a88034690 msgr2=0x7f5a880d9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a8ffff700 1 --2- 172.21.15.123:0/2802223738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a88034690 0x7f5a880d9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a8ffff700 1 -- 172.21.15.123:0/2802223738 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a840094b0 con 0x7f5a88036ab0 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a8ffff700 1 --2- 172.21.15.123:0/2802223738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a88036ab0 0x7f5a8804c860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000c430 tx=0x7f5a8000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a8d7fa700 1 -- 172.21.15.123:0/2802223738 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80005e50 con 0x7f5a88036ab0 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a8d7fa700 1 -- 172.21.15.123:0/2802223738 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a800070d0 con 0x7f5a88036ab0 2024-09-13T17:06:46.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 -- 172.21.15.123:0/2802223738 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8804f350 con 0x7f5a88036ab0 2024-09-13T17:06:46.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a8d7fa700 1 -- 172.21.15.123:0/2802223738 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80007480 con 0x7f5a88036ab0 2024-09-13T17:06:46.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.134+0000 7f5a95977700 1 -- 172.21.15.123:0/2802223738 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a881798f0 con 0x7f5a88036ab0 2024-09-13T17:06:46.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.138+0000 7f5a95977700 1 -- 172.21.15.123:0/2802223738 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a88179750 con 0x7f5a88036ab0 2024-09-13T17:06:46.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.138+0000 7f5a8d7fa700 1 -- 172.21.15.123:0/2802223738 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5a800075e0 con 0x7f5a88036ab0 2024-09-13T17:06:46.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.138+0000 7f5a8d7fa700 1 --2- 172.21.15.123:0/2802223738 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5a7c066730 0x7f5a7c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.138+0000 7f5a94975700 1 --2- 172.21.15.123:0/2802223738 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5a7c066730 0x7f5a7c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.138+0000 7f5a8d7fa700 1 -- 172.21.15.123:0/2802223738 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5a80083210 con 0x7f5a88036ab0 2024-09-13T17:06:46.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.138+0000 7f5a94975700 1 --2- 172.21.15.123:0/2802223738 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5a7c066730 0x7f5a7c068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5a840090b0 tx=0x7f5a84008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:46.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.146+0000 7f5a8d7fa700 1 -- 172.21.15.123:0/2802223738 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5a88179750 con 0x7f5a88036ab0 2024-09-13T17:06:46.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.310+0000 7f5a95977700 1 -- 172.21.15.123:0/2802223738 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a88008fd0 con 0x7f5a88036ab0 2024-09-13T17:06:46.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.314+0000 7f5a8d7fa700 1 -- 172.21.15.123:0/2802223738 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a80017020 con 0x7f5a88036ab0 2024-09-13T17:06:46.318 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:06:46.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.314+0000 7f5a95977700 1 -- 172.21.15.123:0/2802223738 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5a7c066730 msgr2=0x7f5a7c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.314+0000 7f5a95977700 1 --2- 172.21.15.123:0/2802223738 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5a7c066730 0x7f5a7c068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5a840090b0 tx=0x7f5a84008030 comp rx=0 tx=0).stop 2024-09-13T17:06:46.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.314+0000 7f5a95977700 1 -- 172.21.15.123:0/2802223738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a88036ab0 msgr2=0x7f5a8804c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.314+0000 7f5a95977700 1 --2- 172.21.15.123:0/2802223738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a88036ab0 0x7f5a8804c860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000c430 tx=0x7f5a8000c7f0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.314+0000 7f5a95977700 1 -- 172.21.15.123:0/2802223738 shutdown_connections 2024-09-13T17:06:46.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.314+0000 7f5a95977700 1 --2- 172.21.15.123:0/2802223738 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5a7c066730 0x7f5a7c068bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.314+0000 7f5a95977700 1 --2- 172.21.15.123:0/2802223738 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5a880e3090 0x7f5a880066d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.314+0000 7f5a95977700 1 --2- 172.21.15.123:0/2802223738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a88036ab0 0x7f5a8804c860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.314+0000 7f5a95977700 1 --2- 172.21.15.123:0/2802223738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a88034690 0x7f5a880d9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.314+0000 7f5a95977700 1 -- 172.21.15.123:0/2802223738 >> 172.21.15.123:0/2802223738 conn(0x7f5a8801eaf0 msgr2=0x7f5a8800beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:46.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.314+0000 7f5a95977700 1 -- 172.21.15.123:0/2802223738 shutdown_connections 2024-09-13T17:06:46.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.314+0000 7f5a95977700 1 -- 172.21.15.123:0/2802223738 wait complete. 2024-09-13T17:06:46.333 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:06:46.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f4152abc700 1 Processor -- start 2024-09-13T17:06:46.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f4152abc700 1 -- start start 2024-09-13T17:06:46.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f4152abc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f414c15e920 0x7f414c0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f4152abc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f414c15ed00 0x7f414c0cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f4152abc700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c162550 con 0x7f414c0cb020 2024-09-13T17:06:46.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f4152abc700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c0cd690 con 0x7f414c15e920 2024-09-13T17:06:46.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f4152abc700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c161f90 con 0x7f414c15ed00 2024-09-13T17:06:46.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f41522bb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f414c15ed00 0x7f414c0cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f4151aba700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f414c15e920 0x7f414c0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f41522bb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f414c15ed00 0x7f414c0cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:48586/0 (socket says 172.21.15.123:48586) 2024-09-13T17:06:46.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f41522bb700 1 -- 172.21.15.123:0/3476290083 learned_addr learned my addr 172.21.15.123:0/3476290083 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:46.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f41522bb700 1 -- 172.21.15.123:0/3476290083 >> v2:172.21.15.153:3300/0 conn(0x7f414c15e920 msgr2=0x7f414c0caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:46.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f41522bb700 1 --2- 172.21.15.123:0/3476290083 >> v2:172.21.15.153:3300/0 conn(0x7f414c15e920 0x7f414c0caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f41522bb700 1 -- 172.21.15.123:0/3476290083 >> v1:172.21.15.153:6789/0 conn(0x7f414c0cb020 legacy=0x7f414c161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.442+0000 7f41522bb700 1 -- 172.21.15.123:0/3476290083 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c162270 con 0x7f414c15ed00 2024-09-13T17:06:46.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.446+0000 7f41522bb700 1 --2- 172.21.15.123:0/3476290083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f414c15ed00 0x7f414c0cdb20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4144009910 tx=0x7f4144009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbd7196bde326b16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:46.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.446+0000 7f4150ab8700 1 -- 172.21.15.123:0/3476290083 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144011830 con 0x7f414c15ed00 2024-09-13T17:06:46.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.446+0000 7f4150ab8700 1 -- 172.21.15.123:0/3476290083 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4144011990 con 0x7f414c15ed00 2024-09-13T17:06:46.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.446+0000 7f4150ab8700 1 -- 172.21.15.123:0/3476290083 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144011d40 con 0x7f414c15ed00 2024-09-13T17:06:46.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.446+0000 7f4152abc700 1 -- 172.21.15.123:0/3476290083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f414c15ed00 msgr2=0x7f414c0cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.446+0000 7f4152abc700 1 --2- 172.21.15.123:0/3476290083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f414c15ed00 0x7f414c0cdb20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4144009910 tx=0x7f4144009c20 comp rx=0 tx=0).stop 2024-09-13T17:06:46.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.446+0000 7f4152abc700 1 -- 172.21.15.123:0/3476290083 shutdown_connections 2024-09-13T17:06:46.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.446+0000 7f4152abc700 1 --2- 172.21.15.123:0/3476290083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f414c15ed00 0x7f414c0cdb20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.446+0000 7f4152abc700 1 --2- 172.21.15.123:0/3476290083 >> v2:172.21.15.153:3300/0 conn(0x7f414c15e920 0x7f414c0caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.446+0000 7f4152abc700 1 -- 172.21.15.123:0/3476290083 >> 172.21.15.123:0/3476290083 conn(0x7f414c066150 msgr2=0x7f414c066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:46.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.446+0000 7f4152abc700 1 -- 172.21.15.123:0/3476290083 shutdown_connections 2024-09-13T17:06:46.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.446+0000 7f4152abc700 1 -- 172.21.15.123:0/3476290083 wait complete. 2024-09-13T17:06:46.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.446+0000 7f4152abc700 1 Processor -- start 2024-09-13T17:06:46.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.446+0000 7f4152abc700 1 -- start start 2024-09-13T17:06:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4152abc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f414c0cb020 0x7f414c155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4152abc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f414c15e920 0x7f414c1f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4152abc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f414c15ed00 0x7f414c157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4152abc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0c3540 con 0x7f414c0cb020 2024-09-13T17:06:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4152abc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0c3d50 con 0x7f414c15e920 2024-09-13T17:06:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4152abc700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c156190 con 0x7f414c15ed00 2024-09-13T17:06:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4151aba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f414c0cb020 0x7f414c155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4151aba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f414c0cb020 0x7f414c155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48386/0 (socket says 172.21.15.123:48386) 2024-09-13T17:06:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4151aba700 1 -- 172.21.15.123:0/4025531047 learned_addr learned my addr 172.21.15.123:0/4025531047 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f41512b9700 1 --2- 172.21.15.123:0/4025531047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f414c15e920 0x7f414c1f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f41522bb700 1 --2- 172.21.15.123:0/4025531047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f414c15ed00 0x7f414c157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4151aba700 1 -- 172.21.15.123:0/4025531047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f414c15ed00 msgr2=0x7f414c157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4151aba700 1 --2- 172.21.15.123:0/4025531047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f414c15ed00 0x7f414c157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4151aba700 1 -- 172.21.15.123:0/4025531047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f414c15e920 msgr2=0x7f414c1f6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4151aba700 1 --2- 172.21.15.123:0/4025531047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f414c15e920 0x7f414c1f6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4151aba700 1 -- 172.21.15.123:0/4025531047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4144009570 con 0x7f414c0cb020 2024-09-13T17:06:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4151aba700 1 --2- 172.21.15.123:0/4025531047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f414c0cb020 0x7f414c155c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f413c00e9d0 tx=0x7f413c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:46.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f414a7fc700 1 -- 172.21.15.123:0/4025531047 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c009720 con 0x7f414c0cb020 2024-09-13T17:06:46.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f414a7fc700 1 -- 172.21.15.123:0/4025531047 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c00ee70 con 0x7f414c0cb020 2024-09-13T17:06:46.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4152abc700 1 -- 172.21.15.123:0/4025531047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414c0c3790 con 0x7f414c0cb020 2024-09-13T17:06:46.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f414a7fc700 1 -- 172.21.15.123:0/4025531047 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c00ca50 con 0x7f414c0cb020 2024-09-13T17:06:46.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4152abc700 1 -- 172.21.15.123:0/4025531047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c158970 con 0x7f414c0cb020 2024-09-13T17:06:46.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f4152abc700 1 -- 172.21.15.123:0/4025531047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c0677f0 con 0x7f414c0cb020 2024-09-13T17:06:46.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.450+0000 7f414a7fc700 1 -- 172.21.15.123:0/4025531047 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f413c00cbb0 con 0x7f414c0cb020 2024-09-13T17:06:46.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.454+0000 7f414a7fc700 1 --2- 172.21.15.123:0/4025531047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f412c066730 0x7f412c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.454+0000 7f414a7fc700 1 -- 172.21.15.123:0/4025531047 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f413c0841a0 con 0x7f414c0cb020 2024-09-13T17:06:46.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.454+0000 7f41512b9700 1 --2- 172.21.15.123:0/4025531047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f412c066730 0x7f412c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.454+0000 7f41512b9700 1 --2- 172.21.15.123:0/4025531047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f412c066730 0x7f412c068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f414c1fa3c0 tx=0x7f4134009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:46.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.458+0000 7f414a7fc700 1 -- 172.21.15.123:0/4025531047 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f413c051870 con 0x7f414c0cb020 2024-09-13T17:06:46.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.638+0000 7f4152abc700 1 -- 172.21.15.123:0/4025531047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f414c0caae0 con 0x7f414c0cb020 2024-09-13T17:06:46.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.638+0000 7f414a7fc700 1 -- 172.21.15.123:0/4025531047 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f413c00ce60 con 0x7f414c0cb020 2024-09-13T17:06:46.643 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:46.643 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-13T17:06:46.644 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:06:46.644 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-13T17:06:46.644 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-13T17:06:46.644 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:06:46.644 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-13T17:06:46.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.642+0000 7f4152abc700 1 -- 172.21.15.123:0/4025531047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f412c066730 msgr2=0x7f412c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.642+0000 7f4152abc700 1 --2- 172.21.15.123:0/4025531047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f412c066730 0x7f412c068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f414c1fa3c0 tx=0x7f4134009040 comp rx=0 tx=0).stop 2024-09-13T17:06:46.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.642+0000 7f4152abc700 1 -- 172.21.15.123:0/4025531047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f414c0cb020 msgr2=0x7f414c155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.642+0000 7f4152abc700 1 --2- 172.21.15.123:0/4025531047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f414c0cb020 0x7f414c155c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f413c00e9d0 tx=0x7f413c00ece0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.642+0000 7f4152abc700 1 -- 172.21.15.123:0/4025531047 shutdown_connections 2024-09-13T17:06:46.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.642+0000 7f4152abc700 1 --2- 172.21.15.123:0/4025531047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f412c066730 0x7f412c068bf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.642+0000 7f4152abc700 1 --2- 172.21.15.123:0/4025531047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f414c15ed00 0x7f414c157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.642+0000 7f4152abc700 1 --2- 172.21.15.123:0/4025531047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f414c15e920 0x7f414c1f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.642+0000 7f4152abc700 1 --2- 172.21.15.123:0/4025531047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f414c0cb020 0x7f414c155c50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.642+0000 7f4152abc700 1 -- 172.21.15.123:0/4025531047 >> 172.21.15.123:0/4025531047 conn(0x7f414c066150 msgr2=0x7f414c0cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:46.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.642+0000 7f4152abc700 1 -- 172.21.15.123:0/4025531047 shutdown_connections 2024-09-13T17:06:46.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.642+0000 7f4152abc700 1 -- 172.21.15.123:0/4025531047 wait complete. 2024-09-13T17:06:46.662 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:06:46.662 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:06:46.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 Processor -- start 2024-09-13T17:06:46.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 -- start start 2024-09-13T17:06:46.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fec94161ed0 0x7fec94161380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec94070850 0x7fec94070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec94158350 con 0x7fec941625a0 2024-09-13T17:06:46.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec94071220 con 0x7fec94161ed0 2024-09-13T17:06:46.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec94162a10 con 0x7fec94070850 2024-09-13T17:06:46.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec92ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fec94161ed0 0x7fec94161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec937fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec94070850 0x7fec94070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec927fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fec941625a0 0x7fec9415f020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:39514/0 (socket says 172.21.15.123:39514) 2024-09-13T17:06:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec927fc700 1 -- 172.21.15.123:0/2951807024 learned_addr learned my addr 172.21.15.123:0/2951807024 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec92ffd700 1 --2- 172.21.15.123:0/2951807024 >> v2:172.21.15.153:3300/0 conn(0x7fec94161ed0 0x7fec94161380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:46164/0 (socket says 172.21.15.123:46164) 2024-09-13T17:06:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec937fe700 1 -- 172.21.15.123:0/2951807024 >> v2:172.21.15.153:3300/0 conn(0x7fec94161ed0 msgr2=0x7fec94161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec937fe700 1 --2- 172.21.15.123:0/2951807024 >> v2:172.21.15.153:3300/0 conn(0x7fec94161ed0 0x7fec94161380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec937fe700 1 -- 172.21.15.123:0/2951807024 >> v1:172.21.15.153:6789/0 conn(0x7fec941625a0 legacy=0x7fec9415f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec937fe700 1 -- 172.21.15.123:0/2951807024 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec94071660 con 0x7fec94070850 2024-09-13T17:06:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec937fe700 1 --2- 172.21.15.123:0/2951807024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec94070850 0x7fec94070ce0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009d90 tx=0x7fec8c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c2b5ec09606e7cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec91ffb700 1 -- 172.21.15.123:0/2951807024 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c00e070 con 0x7fec94070850 2024-09-13T17:06:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec91ffb700 1 -- 172.21.15.123:0/2951807024 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c00bb20 con 0x7fec94070850 2024-09-13T17:06:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec91ffb700 1 -- 172.21.15.123:0/2951807024 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c012430 con 0x7fec94070850 2024-09-13T17:06:46.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 -- 172.21.15.123:0/2951807024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec94070850 msgr2=0x7fec94070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 --2- 172.21.15.123:0/2951807024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec94070850 0x7fec94070ce0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009d90 tx=0x7fec8c00b330 comp rx=0 tx=0).stop 2024-09-13T17:06:46.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 -- 172.21.15.123:0/2951807024 shutdown_connections 2024-09-13T17:06:46.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 --2- 172.21.15.123:0/2951807024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec94070850 0x7fec94070ce0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 --2- 172.21.15.123:0/2951807024 >> v2:172.21.15.153:3300/0 conn(0x7fec94161ed0 0x7fec94161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 -- 172.21.15.123:0/2951807024 >> 172.21.15.123:0/2951807024 conn(0x7fec94072730 msgr2=0x7fec94066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 -- 172.21.15.123:0/2951807024 shutdown_connections 2024-09-13T17:06:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.778+0000 7fec93fff700 1 -- 172.21.15.123:0/2951807024 wait complete. 2024-09-13T17:06:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec93fff700 1 Processor -- start 2024-09-13T17:06:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec93fff700 1 -- start start 2024-09-13T17:06:46.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec93fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec94070850 0x7fec94158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec93fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec94161ed0 0x7fec941f92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec93fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec941625a0 0x7fec9415d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec93fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec941f9820 con 0x7fec94161ed0 2024-09-13T17:06:46.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec93fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec941597d0 con 0x7fec94070850 2024-09-13T17:06:46.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec93fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec941594f0 con 0x7fec941625a0 2024-09-13T17:06:46.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec927fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec94161ed0 0x7fec941f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec92ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec94070850 0x7fec94158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec92ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec94070850 0x7fec94158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:46166/0 (socket says 172.21.15.123:46166) 2024-09-13T17:06:46.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec927fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec94161ed0 0x7fec941f92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48392/0 (socket says 172.21.15.123:48392) 2024-09-13T17:06:46.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec92ffd700 1 -- 172.21.15.123:0/2344140256 learned_addr learned my addr 172.21.15.123:0/2344140256 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:46.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec937fe700 1 --2- 172.21.15.123:0/2344140256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec941625a0 0x7fec9415d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec927fc700 1 -- 172.21.15.123:0/2344140256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec941625a0 msgr2=0x7fec9415d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec927fc700 1 --2- 172.21.15.123:0/2344140256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec941625a0 0x7fec9415d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec927fc700 1 -- 172.21.15.123:0/2344140256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec94070850 msgr2=0x7fec94158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec927fc700 1 --2- 172.21.15.123:0/2344140256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec94070850 0x7fec94158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec927fc700 1 -- 172.21.15.123:0/2344140256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c009a70 con 0x7fec94161ed0 2024-09-13T17:06:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec92ffd700 1 --2- 172.21.15.123:0/2344140256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec94070850 0x7fec94158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.782+0000 7fec927fc700 1 --2- 172.21.15.123:0/2344140256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec94161ed0 0x7fec941f92e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c430 tx=0x7fec8800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.786+0000 7fec7b7fe700 1 -- 172.21.15.123:0/2344140256 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec88005d90 con 0x7fec94161ed0 2024-09-13T17:06:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.786+0000 7fec7b7fe700 1 -- 172.21.15.123:0/2344140256 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8800ce40 con 0x7fec94161ed0 2024-09-13T17:06:46.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.786+0000 7fec93fff700 1 -- 172.21.15.123:0/2344140256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9415cb70 con 0x7fec94161ed0 2024-09-13T17:06:46.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.786+0000 7fec7b7fe700 1 -- 172.21.15.123:0/2344140256 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec880072d0 con 0x7fec94161ed0 2024-09-13T17:06:46.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.786+0000 7fec93fff700 1 -- 172.21.15.123:0/2344140256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9415d130 con 0x7fec94161ed0 2024-09-13T17:06:46.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.786+0000 7fec93fff700 1 -- 172.21.15.123:0/2344140256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec940677f0 con 0x7fec94161ed0 2024-09-13T17:06:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.786+0000 7fec7b7fe700 1 -- 172.21.15.123:0/2344140256 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fec88007430 con 0x7fec94161ed0 2024-09-13T17:06:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.786+0000 7fec7b7fe700 1 --2- 172.21.15.123:0/2344140256 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec80066730 0x7fec80068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.786+0000 7fec7b7fe700 1 -- 172.21.15.123:0/2344140256 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fec88082ed0 con 0x7fec94161ed0 2024-09-13T17:06:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.786+0000 7fec92ffd700 1 --2- 172.21.15.123:0/2344140256 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec80066730 0x7fec80068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.790+0000 7fec92ffd700 1 --2- 172.21.15.123:0/2344140256 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec80066730 0x7fec80068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fec9406ddd0 tx=0x7fec84009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:46.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.798+0000 7fec7b7fe700 1 -- 172.21.15.123:0/2344140256 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fec880506d0 con 0x7fec94161ed0 2024-09-13T17:06:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:46.970+0000 7fec93fff700 1 -- 172.21.15.123:0/2344140256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fec941637b0 con 0x7fec94161ed0 2024-09-13T17:06:47.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.046+0000 7fec7b7fe700 1 -- 172.21.15.123:0/2344140256 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fec880170b0 con 0x7fec94161ed0 2024-09-13T17:06:47.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.054+0000 7fec93fff700 1 -- 172.21.15.123:0/2344140256 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec80066730 msgr2=0x7fec80068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:47.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.054+0000 7fec93fff700 1 --2- 172.21.15.123:0/2344140256 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec80066730 0x7fec80068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fec9406ddd0 tx=0x7fec84009240 comp rx=0 tx=0).stop 2024-09-13T17:06:47.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.054+0000 7fec93fff700 1 -- 172.21.15.123:0/2344140256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec94161ed0 msgr2=0x7fec941f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:47.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.054+0000 7fec93fff700 1 --2- 172.21.15.123:0/2344140256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec94161ed0 0x7fec941f92e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c430 tx=0x7fec8800c740 comp rx=0 tx=0).stop 2024-09-13T17:06:47.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.054+0000 7fec93fff700 1 -- 172.21.15.123:0/2344140256 shutdown_connections 2024-09-13T17:06:47.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.054+0000 7fec93fff700 1 --2- 172.21.15.123:0/2344140256 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec80066730 0x7fec80068bf0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fec9406ddd0 tx=0x7fec84009240 comp rx=0 tx=0).stop 2024-09-13T17:06:47.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.054+0000 7fec93fff700 1 --2- 172.21.15.123:0/2344140256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec941625a0 0x7fec9415d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:47.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.054+0000 7fec93fff700 1 --2- 172.21.15.123:0/2344140256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec94161ed0 0x7fec941f92e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:47.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.054+0000 7fec93fff700 1 --2- 172.21.15.123:0/2344140256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec94070850 0x7fec94158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:47.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.054+0000 7fec93fff700 1 -- 172.21.15.123:0/2344140256 >> 172.21.15.123:0/2344140256 conn(0x7fec94072730 msgr2=0x7fec940b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:47.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.054+0000 7fec93fff700 1 -- 172.21.15.123:0/2344140256 shutdown_connections 2024-09-13T17:06:47.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.054+0000 7fec93fff700 1 -- 172.21.15.123:0/2344140256 wait complete. 2024-09-13T17:06:47.062 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-13T17:06:47.072 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:06:47.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e7fff700 1 Processor -- start 2024-09-13T17:06:47.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e7fff700 1 -- start start 2024-09-13T17:06:47.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e7fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7e815cc60 0x7fa7e80d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:47.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e7fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e80d06b0 con 0x7fa7e80ce700 2024-09-13T17:06:47.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e7fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e80d0ec0 con 0x7fa7e80d3600 2024-09-13T17:06:47.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e7fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80cfec0 con 0x7fa7e815cc60 2024-09-13T17:06:47.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e77fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa7e80ce700 0x7fa7e80b6970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35774/0 (socket says 172.21.15.123:35774) 2024-09-13T17:06:47.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e77fe700 1 -- 172.21.15.123:0/624926521 learned_addr learned my addr 172.21.15.123:0/624926521 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:47.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e5ffb700 1 -- 172.21.15.123:0/624926521 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667168964 0 0) 0x7fa7e80d06b0 con 0x7fa7e80ce700 2024-09-13T17:06:47.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e6ffd700 1 --2- 172.21.15.123:0/624926521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7e815cc60 0x7fa7e80d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:47.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e5ffb700 1 -- 172.21.15.123:0/624926521 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d00035d0 con 0x7fa7e80ce700 2024-09-13T17:06:47.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e5ffb700 1 -- 172.21.15.123:0/624926521 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2598095883 0 0) 0x7fa7d00035d0 con 0x7fa7e80ce700 2024-09-13T17:06:47.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e5ffb700 1 -- 172.21.15.123:0/624926521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7e815cc60 msgr2=0x7fa7e80d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:47.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e5ffb700 1 --2- 172.21.15.123:0/624926521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7e815cc60 0x7fa7e80d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:47.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e5ffb700 1 -- 172.21.15.123:0/624926521 >> v1:172.21.15.153:6789/0 conn(0x7fa7e80d3600 legacy=0x7fa7e80b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e5ffb700 1 -- 172.21.15.123:0/624926521 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80d0900 con 0x7fa7e80ce700 2024-09-13T17:06:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e5ffb700 1 -- 172.21.15.123:0/624926521 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7fa7e00019f0 con 0x7fa7e80ce700 2024-09-13T17:06:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.186+0000 7fa7e5ffb700 1 -- 172.21.15.123:0/624926521 >> v1:172.21.15.123:6789/0 conn(0x7fa7e80ce700 legacy=0x7fa7e80b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e5ffb700 1 --2- 172.21.15.123:0/624926521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7e815cc60 0x7fa7d0003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e5ffb700 1 --2- 172.21.15.123:0/624926521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d0004080 0x7fa7d0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e5ffb700 1 --2- 172.21.15.123:0/624926521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0004db0 0x7fa7d0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e5ffb700 1 -- 172.21.15.123:0/624926521 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80cfec0 con 0x7fa7d0004db0 2024-09-13T17:06:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e5ffb700 1 -- 172.21.15.123:0/624926521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d000bc70 con 0x7fa7d0004080 2024-09-13T17:06:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e5ffb700 1 -- 172.21.15.123:0/624926521 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d000be30 con 0x7fa7e815cc60 2024-09-13T17:06:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e77fe700 1 --2- 172.21.15.123:0/624926521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0004db0 0x7fa7d0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e6ffd700 1 --2- 172.21.15.123:0/624926521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7e815cc60 0x7fa7d0003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e67fc700 1 --2- 172.21.15.123:0/624926521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d0004080 0x7fa7d0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e77fe700 1 -- 172.21.15.123:0/624926521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7e815cc60 msgr2=0x7fa7d0003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:47.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e77fe700 1 --2- 172.21.15.123:0/624926521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7e815cc60 0x7fa7d0003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:47.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e77fe700 1 -- 172.21.15.123:0/624926521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d0004080 msgr2=0x7fa7d0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:47.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e77fe700 1 --2- 172.21.15.123:0/624926521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d0004080 0x7fa7d0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:47.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e77fe700 1 -- 172.21.15.123:0/624926521 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d00035d0 con 0x7fa7d0004db0 2024-09-13T17:06:47.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e77fe700 1 --2- 172.21.15.123:0/624926521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0004db0 0x7fa7d0005230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000a830 tx=0x7fa7d00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a0f8f2e9efbbe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:47.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e5ffb700 1 -- 172.21.15.123:0/624926521 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000a2f0 con 0x7fa7d0004db0 2024-09-13T17:06:47.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e5ffb700 1 -- 172.21.15.123:0/624926521 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e00072f0 con 0x7fa7d0004db0 2024-09-13T17:06:47.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e5ffb700 1 -- 172.21.15.123:0/624926521 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00076a0 con 0x7fa7d0004db0 2024-09-13T17:06:47.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e7fff700 1 -- 172.21.15.123:0/624926521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0004db0 msgr2=0x7fa7d0005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:47.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e7fff700 1 --2- 172.21.15.123:0/624926521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0004db0 0x7fa7d0005230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000a830 tx=0x7fa7d00058a0 comp rx=0 tx=0).stop 2024-09-13T17:06:47.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e77fe700 1 -- 172.21.15.123:0/624926521 reap_dead start 2024-09-13T17:06:47.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e7fff700 1 -- 172.21.15.123:0/624926521 shutdown_connections 2024-09-13T17:06:47.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e7fff700 1 -- 172.21.15.123:0/624926521 >> 172.21.15.123:0/624926521 conn(0x7fa7e80d2ae0 msgr2=0x7fa7e80d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:47.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e7fff700 1 -- 172.21.15.123:0/624926521 shutdown_connections 2024-09-13T17:06:47.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e7fff700 1 -- 172.21.15.123:0/624926521 wait complete. 2024-09-13T17:06:47.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e7fff700 1 Processor -- start 2024-09-13T17:06:47.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.190+0000 7fa7e7fff700 1 -- start start 2024-09-13T17:06:47.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0004db0 0x7fa7e815d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:47.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e7fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7e8155fb0 0x7fa7e81f2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:47.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e815f7e0 0x7fa7e815fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e7fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e81f32a0 con 0x7fa7d0004db0 2024-09-13T17:06:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e7fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e815dd10 con 0x7fa7e815f7e0 2024-09-13T17:06:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e7fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e8156430 con 0x7fa7e8155fb0 2024-09-13T17:06:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0004db0 0x7fa7e815d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e67fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7e8155fb0 0x7fa7e81f2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0004db0 0x7fa7e815d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48420/0 (socket says 172.21.15.123:48420) 2024-09-13T17:06:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e6ffd700 1 -- 172.21.15.123:0/962026071 learned_addr learned my addr 172.21.15.123:0/962026071 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e77fe700 1 --2- 172.21.15.123:0/962026071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e815f7e0 0x7fa7e815fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e6ffd700 1 -- 172.21.15.123:0/962026071 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7e8155fb0 msgr2=0x7fa7e81f2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e6ffd700 1 --2- 172.21.15.123:0/962026071 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7e8155fb0 0x7fa7e81f2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e6ffd700 1 -- 172.21.15.123:0/962026071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e815f7e0 msgr2=0x7fa7e815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e6ffd700 1 --2- 172.21.15.123:0/962026071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e815f7e0 0x7fa7e815fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e6ffd700 1 -- 172.21.15.123:0/962026071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80caca0 con 0x7fa7d0004db0 2024-09-13T17:06:47.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e6ffd700 1 --2- 172.21.15.123:0/962026071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0004db0 0x7fa7e815d350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc010890 tx=0x7fa7dc010ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:47.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7cf7fe700 1 -- 172.21.15.123:0/962026071 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc015880 con 0x7fa7d0004db0 2024-09-13T17:06:47.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e7fff700 1 -- 172.21.15.123:0/962026071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e81f3480 con 0x7fa7d0004db0 2024-09-13T17:06:47.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7cf7fe700 1 -- 172.21.15.123:0/962026071 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc00c050 con 0x7fa7d0004db0 2024-09-13T17:06:47.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7cf7fe700 1 -- 172.21.15.123:0/962026071 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc015c20 con 0x7fa7d0004db0 2024-09-13T17:06:47.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.194+0000 7fa7e7fff700 1 -- 172.21.15.123:0/962026071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e80caf40 con 0x7fa7d0004db0 2024-09-13T17:06:47.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.198+0000 7fa7e7fff700 1 -- 172.21.15.123:0/962026071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e80cb100 con 0x7fa7d0004db0 2024-09-13T17:06:47.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.198+0000 7fa7cf7fe700 1 -- 172.21.15.123:0/962026071 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa7dc016420 con 0x7fa7d0004db0 2024-09-13T17:06:47.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.198+0000 7fa7cf7fe700 1 --2- 172.21.15.123:0/962026071 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa7d4066760 0x7fa7d4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:47.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.198+0000 7fa7cf7fe700 1 -- 172.21.15.123:0/962026071 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa7dc0846e0 con 0x7fa7d0004db0 2024-09-13T17:06:47.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.198+0000 7fa7e67fc700 1 --2- 172.21.15.123:0/962026071 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa7d4066760 0x7fa7d4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:47.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.198+0000 7fa7e67fc700 1 --2- 172.21.15.123:0/962026071 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa7d4066760 0x7fa7d4068c20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80b6060 tx=0x7fa7d8009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:47.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.206+0000 7fa7cf7fe700 1 -- 172.21.15.123:0/962026071 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa7dc051bc0 con 0x7fa7d0004db0 2024-09-13T17:06:47.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:47.378+0000 7fa7e7fff700 1 -- 172.21.15.123:0/962026071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa7e80d10a0 con 0x7fa7d0004db0 2024-09-13T17:06:48.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.050+0000 7fa7cf7fe700 1 -- 172.21.15.123:0/962026071 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa7dc084070 con 0x7fa7d0004db0 2024-09-13T17:06:48.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.058+0000 7fa7e7fff700 1 -- 172.21.15.123:0/962026071 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa7d4066760 msgr2=0x7fa7d4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.058+0000 7fa7e7fff700 1 --2- 172.21.15.123:0/962026071 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa7d4066760 0x7fa7d4068c20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80b6060 tx=0x7fa7d8009040 comp rx=0 tx=0).stop 2024-09-13T17:06:48.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.058+0000 7fa7e7fff700 1 -- 172.21.15.123:0/962026071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0004db0 msgr2=0x7fa7e815d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.058+0000 7fa7e7fff700 1 --2- 172.21.15.123:0/962026071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0004db0 0x7fa7e815d350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc010890 tx=0x7fa7dc010ba0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.062+0000 7fa7e7fff700 1 -- 172.21.15.123:0/962026071 shutdown_connections 2024-09-13T17:06:48.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.062+0000 7fa7e7fff700 1 --2- 172.21.15.123:0/962026071 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa7d4066760 0x7fa7d4068c20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.062+0000 7fa7e7fff700 1 --2- 172.21.15.123:0/962026071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e815f7e0 0x7fa7e815fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.062+0000 7fa7e7fff700 1 --2- 172.21.15.123:0/962026071 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7e8155fb0 0x7fa7e81f2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.062+0000 7fa7e7fff700 1 --2- 172.21.15.123:0/962026071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0004db0 0x7fa7e815d350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.062+0000 7fa7e7fff700 1 -- 172.21.15.123:0/962026071 >> 172.21.15.123:0/962026071 conn(0x7fa7e80d2ae0 msgr2=0x7fa7e80b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.062+0000 7fa7e7fff700 1 -- 172.21.15.123:0/962026071 shutdown_connections 2024-09-13T17:06:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.062+0000 7fa7e7fff700 1 -- 172.21.15.123:0/962026071 wait complete. 2024-09-13T17:06:48.070 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-13T17:06:48.086 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:06:48.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.190+0000 7f39f7fff700 1 Processor -- start 2024-09-13T17:06:48.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.190+0000 7f39f7fff700 1 -- start start 2024-09-13T17:06:48.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80d0f40 0x7f39f80d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39f80b58b0 0x7f39f80d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39f80b1100 0x7f39f80b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f80b0060 con 0x7f39f80b58b0 2024-09-13T17:06:48.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f80b0340 con 0x7f39f80b1100 2024-09-13T17:06:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f80b0620 con 0x7f39f80d0f40 2024-09-13T17:06:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f67fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39f80b58b0 0x7f39f80d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f67fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39f80b58b0 0x7f39f80d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48428/0 (socket says 172.21.15.123:48428) 2024-09-13T17:06:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f67fc700 1 -- 172.21.15.123:0/263529187 learned_addr learned my addr 172.21.15.123:0/263529187 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f77fe700 1 --2- 172.21.15.123:0/263529187 >> v2:172.21.15.153:3300/0 conn(0x7f39f80b1100 0x7f39f80b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f6ffd700 1 --2- 172.21.15.123:0/263529187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80d0f40 0x7f39f80d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f67fc700 1 -- 172.21.15.123:0/263529187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80d0f40 msgr2=0x7f39f80d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f67fc700 1 --2- 172.21.15.123:0/263529187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80d0f40 0x7f39f80d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f67fc700 1 -- 172.21.15.123:0/263529187 >> v2:172.21.15.153:3300/0 conn(0x7f39f80b1100 msgr2=0x7f39f80b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f67fc700 1 --2- 172.21.15.123:0/263529187 >> v2:172.21.15.153:3300/0 conn(0x7f39f80b1100 0x7f39f80b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f67fc700 1 -- 172.21.15.123:0/263529187 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f80b0900 con 0x7f39f80b58b0 2024-09-13T17:06:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f67fc700 1 --2- 172.21.15.123:0/263529187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f80b58b0 0x7f39f80d05a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f39f80d28f0 tx=0x7f39ec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fd69fa107ef00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f5ffb700 1 -- 172.21.15.123:0/263529187 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec011830 con 0x7f39f80b58b0 2024-09-13T17:06:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f5ffb700 1 -- 172.21.15.123:0/263529187 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec011990 con 0x7f39f80b58b0 2024-09-13T17:06:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f5ffb700 1 -- 172.21.15.123:0/263529187 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec011d20 con 0x7f39f80b58b0 2024-09-13T17:06:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 -- 172.21.15.123:0/263529187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f80b58b0 msgr2=0x7f39f80d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 --2- 172.21.15.123:0/263529187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f80b58b0 0x7f39f80d05a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f39f80d28f0 tx=0x7f39ec009bf0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 -- 172.21.15.123:0/263529187 shutdown_connections 2024-09-13T17:06:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 --2- 172.21.15.123:0/263529187 >> v2:172.21.15.153:3300/0 conn(0x7f39f80b1100 0x7f39f80b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 --2- 172.21.15.123:0/263529187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f80b58b0 0x7f39f80d05a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 --2- 172.21.15.123:0/263529187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80d0f40 0x7f39f80d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 -- 172.21.15.123:0/263529187 >> 172.21.15.123:0/263529187 conn(0x7f39f80d2a60 msgr2=0x7f39f80d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:48.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 -- 172.21.15.123:0/263529187 shutdown_connections 2024-09-13T17:06:48.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.194+0000 7f39f7fff700 1 -- 172.21.15.123:0/263529187 wait complete. 2024-09-13T17:06:48.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.198+0000 7f39f7fff700 1 Processor -- start 2024-09-13T17:06:48.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.198+0000 7f39f7fff700 1 -- start start 2024-09-13T17:06:48.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.198+0000 7f39f7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f80b1100 0x7f39f815b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.198+0000 7f39f7fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80b58b0 0x7f39f815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.198+0000 7f39f7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f80d0f40 0x7f39f80b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.198+0000 7f39f7fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f815e880 con 0x7f39f80d0f40 2024-09-13T17:06:48.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.198+0000 7f39f7fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f815dd00 con 0x7f39f80b1100 2024-09-13T17:06:48.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.198+0000 7f39f7fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f815dfe0 con 0x7f39f80b58b0 2024-09-13T17:06:48.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.198+0000 7f39f77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f80d0f40 0x7f39f80b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.198+0000 7f39f67fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80b58b0 0x7f39f815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.198+0000 7f39f77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f80d0f40 0x7f39f80b74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48430/0 (socket says 172.21.15.123:48430) 2024-09-13T17:06:48.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.198+0000 7f39f77fe700 1 -- 172.21.15.123:0/3639720524 learned_addr learned my addr 172.21.15.123:0/3639720524 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:48.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.198+0000 7f39f6ffd700 1 --2- 172.21.15.123:0/3639720524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f80b1100 0x7f39f815b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.202+0000 7f39f77fe700 1 -- 172.21.15.123:0/3639720524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80b58b0 msgr2=0x7f39f815d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.202+0000 7f39f77fe700 1 --2- 172.21.15.123:0/3639720524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80b58b0 0x7f39f815d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.202+0000 7f39f77fe700 1 -- 172.21.15.123:0/3639720524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f80b1100 msgr2=0x7f39f815b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.202+0000 7f39f77fe700 1 --2- 172.21.15.123:0/3639720524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f80b1100 0x7f39f815b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.202+0000 7f39f77fe700 1 -- 172.21.15.123:0/3639720524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec009570 con 0x7f39f80d0f40 2024-09-13T17:06:48.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.202+0000 7f39f77fe700 1 --2- 172.21.15.123:0/3639720524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f80d0f40 0x7f39f80b74d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f39f000eed0 tx=0x7f39f000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:48.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.202+0000 7f39df7fe700 1 -- 172.21.15.123:0/3639720524 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f0010040 con 0x7f39f80d0f40 2024-09-13T17:06:48.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.202+0000 7f39df7fe700 1 -- 172.21.15.123:0/3639720524 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f000b9c0 con 0x7f39f80d0f40 2024-09-13T17:06:48.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.202+0000 7f39f7fff700 1 -- 172.21.15.123:0/3639720524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f815e2c0 con 0x7f39f80d0f40 2024-09-13T17:06:48.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.202+0000 7f39df7fe700 1 -- 172.21.15.123:0/3639720524 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f000bd70 con 0x7f39f80d0f40 2024-09-13T17:06:48.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.202+0000 7f39f7fff700 1 -- 172.21.15.123:0/3639720524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f815f650 con 0x7f39f80d0f40 2024-09-13T17:06:48.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.202+0000 7f39f7fff700 1 -- 172.21.15.123:0/3639720524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f815ce70 con 0x7f39f80d0f40 2024-09-13T17:06:48.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.202+0000 7f39df7fe700 1 -- 172.21.15.123:0/3639720524 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f39f0026420 con 0x7f39f80d0f40 2024-09-13T17:06:48.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.206+0000 7f39df7fe700 1 --2- 172.21.15.123:0/3639720524 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f39e4066730 0x7f39e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.206+0000 7f39df7fe700 1 -- 172.21.15.123:0/3639720524 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f39f0084a10 con 0x7f39f80d0f40 2024-09-13T17:06:48.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.206+0000 7f39f6ffd700 1 --2- 172.21.15.123:0/3639720524 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f39e4066730 0x7f39e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.206+0000 7f39f6ffd700 1 --2- 172.21.15.123:0/3639720524 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f39e4066730 0x7f39e4068bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f39f80c99f0 tx=0x7f39e8009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:48.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.210+0000 7f39df7fe700 1 -- 172.21.15.123:0/3639720524 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f39f0051f50 con 0x7f39f80d0f40 2024-09-13T17:06:48.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.410+0000 7f39f7fff700 1 -- 172.21.15.123:0/3639720524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f39f808c250 con 0x7f39f80d0f40 2024-09-13T17:06:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.422+0000 7f39df7fe700 1 -- 172.21.15.123:0/3639720524 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f39f0018020 con 0x7f39f80d0f40 2024-09-13T17:06:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.430+0000 7f39f7fff700 1 -- 172.21.15.123:0/3639720524 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f39e4066730 msgr2=0x7f39e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.430+0000 7f39f7fff700 1 --2- 172.21.15.123:0/3639720524 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f39e4066730 0x7f39e4068bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f39f80c99f0 tx=0x7f39e8009240 comp rx=0 tx=0).stop 2024-09-13T17:06:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.430+0000 7f39f7fff700 1 -- 172.21.15.123:0/3639720524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f80d0f40 msgr2=0x7f39f80b74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.430+0000 7f39f7fff700 1 --2- 172.21.15.123:0/3639720524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f80d0f40 0x7f39f80b74d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f39f000eed0 tx=0x7f39f000ef00 comp rx=0 tx=0).stop 2024-09-13T17:06:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.430+0000 7f39f7fff700 1 -- 172.21.15.123:0/3639720524 shutdown_connections 2024-09-13T17:06:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.430+0000 7f39f7fff700 1 --2- 172.21.15.123:0/3639720524 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f39e4066730 0x7f39e4068bf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.430+0000 7f39f7fff700 1 --2- 172.21.15.123:0/3639720524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39f80d0f40 0x7f39f80b74d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.430+0000 7f39f7fff700 1 --2- 172.21.15.123:0/3639720524 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39f80b58b0 0x7f39f815d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.430+0000 7f39f7fff700 1 --2- 172.21.15.123:0/3639720524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f80b1100 0x7f39f815b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.430+0000 7f39f7fff700 1 -- 172.21.15.123:0/3639720524 >> 172.21.15.123:0/3639720524 conn(0x7f39f80d2a60 msgr2=0x7f39f80ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.430+0000 7f39f7fff700 1 -- 172.21.15.123:0/3639720524 shutdown_connections 2024-09-13T17:06:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.430+0000 7f39f7fff700 1 -- 172.21.15.123:0/3639720524 wait complete. 2024-09-13T17:06:48.436 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T17:06:48.453 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:06:48.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.550+0000 7fa3248a6700 1 Processor -- start 2024-09-13T17:06:48.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.550+0000 7fa3248a6700 1 -- start start 2024-09-13T17:06:48.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.550+0000 7fa3248a6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32015cd60 0x7fa3200cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.550+0000 7fa3248a6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa3200b1fe0 0x7fa3200cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.550+0000 7fa3248a6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3200d1780 con 0x7fa3200b1970 2024-09-13T17:06:48.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.550+0000 7fa3248a6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3200d1c10 con 0x7fa3200b1fe0 2024-09-13T17:06:48.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.550+0000 7fa3248a6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200d3670 con 0x7fa32015cd60 2024-09-13T17:06:48.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.550+0000 7fa31e59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa3200b1fe0 0x7fa3200cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.550+0000 7fa31f59e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa3200b1970 0x7fa3200af750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35776/0 (socket says 172.21.15.123:35776) 2024-09-13T17:06:48.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.550+0000 7fa31f59e700 1 -- 172.21.15.123:0/1948096392 learned_addr learned my addr 172.21.15.123:0/1948096392 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:48.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.550+0000 7fa31ed9d700 1 --2- 172.21.15.123:0/1948096392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32015cd60 0x7fa3200cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa31e59c700 1 -- 172.21.15.123:0/1948096392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32015cd60 msgr2=0x7fa3200cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:48.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa31e59c700 1 --2- 172.21.15.123:0/1948096392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32015cd60 0x7fa3200cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa31e59c700 1 -- 172.21.15.123:0/1948096392 >> v1:172.21.15.123:6789/0 conn(0x7fa3200b1970 legacy=0x7fa3200af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa31e59c700 1 -- 172.21.15.123:0/1948096392 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3200d3950 con 0x7fa3200b1fe0 2024-09-13T17:06:48.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa31dd9b700 1 -- 172.21.15.123:0/1948096392 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770382560 0 0) 0x7fa3200d1780 con 0x7fa3200b1970 2024-09-13T17:06:48.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa31ed9d700 1 --2- 172.21.15.123:0/1948096392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32015cd60 0x7fa3200cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:48.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa31e59c700 1 --2- 172.21.15.123:0/1948096392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3200b1fe0 0x7fa3200cfa80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa314009850 tx=0x7fa314009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0b703593bce2c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:48.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa31dd9b700 1 -- 172.21.15.123:0/1948096392 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314011830 con 0x7fa3200b1fe0 2024-09-13T17:06:48.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa31dd9b700 1 -- 172.21.15.123:0/1948096392 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa314011990 con 0x7fa3200b1fe0 2024-09-13T17:06:48.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa31dd9b700 1 -- 172.21.15.123:0/1948096392 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314011d20 con 0x7fa3200b1fe0 2024-09-13T17:06:48.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa3248a6700 1 -- 172.21.15.123:0/1948096392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3200b1fe0 msgr2=0x7fa3200cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa3248a6700 1 --2- 172.21.15.123:0/1948096392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3200b1fe0 0x7fa3200cfa80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa314009850 tx=0x7fa314009b60 comp rx=0 tx=0).stop 2024-09-13T17:06:48.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa3248a6700 1 -- 172.21.15.123:0/1948096392 shutdown_connections 2024-09-13T17:06:48.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa3248a6700 1 --2- 172.21.15.123:0/1948096392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3200b1fe0 0x7fa3200cfa80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa3248a6700 1 --2- 172.21.15.123:0/1948096392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32015cd60 0x7fa3200cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa3248a6700 1 -- 172.21.15.123:0/1948096392 >> 172.21.15.123:0/1948096392 conn(0x7fa3200d2b50 msgr2=0x7fa3200d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:48.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa3248a6700 1 -- 172.21.15.123:0/1948096392 shutdown_connections 2024-09-13T17:06:48.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa3248a6700 1 -- 172.21.15.123:0/1948096392 wait complete. 2024-09-13T17:06:48.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa3248a6700 1 Processor -- start 2024-09-13T17:06:48.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.554+0000 7fa3248a6700 1 -- start start 2024-09-13T17:06:48.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa3248a6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3200b1970 0x7fa3200ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa3248a6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3200b1fe0 0x7fa320152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa3248a6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32015cd60 0x7fa3200cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa3248a6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200b2ab0 con 0x7fa3200b1fe0 2024-09-13T17:06:48.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa3248a6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200cab70 con 0x7fa3200b1970 2024-09-13T17:06:48.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa3248a6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa320152590 con 0x7fa32015cd60 2024-09-13T17:06:48.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa31e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3200b1fe0 0x7fa320152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa31e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3200b1fe0 0x7fa320152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48438/0 (socket says 172.21.15.123:48438) 2024-09-13T17:06:48.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa31e59c700 1 -- 172.21.15.123:0/2932748075 learned_addr learned my addr 172.21.15.123:0/2932748075 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:48.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa31f59e700 1 --2- 172.21.15.123:0/2932748075 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32015cd60 0x7fa3200cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa31ed9d700 1 --2- 172.21.15.123:0/2932748075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3200b1970 0x7fa3200ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa31e59c700 1 -- 172.21.15.123:0/2932748075 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32015cd60 msgr2=0x7fa3200cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa31e59c700 1 --2- 172.21.15.123:0/2932748075 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32015cd60 0x7fa3200cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa31e59c700 1 -- 172.21.15.123:0/2932748075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3200b1970 msgr2=0x7fa3200ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa31e59c700 1 --2- 172.21.15.123:0/2932748075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3200b1970 0x7fa3200ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa31e59c700 1 -- 172.21.15.123:0/2932748075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3140094b0 con 0x7fa3200b1fe0 2024-09-13T17:06:48.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa31e59c700 1 --2- 172.21.15.123:0/2932748075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3200b1fe0 0x7fa320152050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa314000c00 tx=0x7fa314004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:48.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa3077fe700 1 -- 172.21.15.123:0/2932748075 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3140036c0 con 0x7fa3200b1fe0 2024-09-13T17:06:48.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa3077fe700 1 -- 172.21.15.123:0/2932748075 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa314003820 con 0x7fa3200b1fe0 2024-09-13T17:06:48.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa3077fe700 1 -- 172.21.15.123:0/2932748075 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314003bd0 con 0x7fa3200b1fe0 2024-09-13T17:06:48.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa3248a6700 1 -- 172.21.15.123:0/2932748075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3200cc530 con 0x7fa3200b1fe0 2024-09-13T17:06:48.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa3248a6700 1 -- 172.21.15.123:0/2932748075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3200cb080 con 0x7fa3200b1fe0 2024-09-13T17:06:48.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.558+0000 7fa3248a6700 1 -- 172.21.15.123:0/2932748075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3200b2bf0 con 0x7fa3200b1fe0 2024-09-13T17:06:48.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.562+0000 7fa3077fe700 1 -- 172.21.15.123:0/2932748075 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa314003d30 con 0x7fa3200b1fe0 2024-09-13T17:06:48.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.562+0000 7fa3077fe700 1 --2- 172.21.15.123:0/2932748075 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa30c066730 0x7fa30c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.562+0000 7fa3077fe700 1 -- 172.21.15.123:0/2932748075 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa314021030 con 0x7fa3200b1fe0 2024-09-13T17:06:48.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.562+0000 7fa31ed9d700 1 --2- 172.21.15.123:0/2932748075 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa30c066730 0x7fa30c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.562+0000 7fa31ed9d700 1 --2- 172.21.15.123:0/2932748075 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa30c066730 0x7fa30c068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c960 tx=0x7fa310008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:48.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.566+0000 7fa3077fe700 1 -- 172.21.15.123:0/2932748075 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa314052ea0 con 0x7fa3200b1fe0 2024-09-13T17:06:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.734+0000 7fa3248a6700 1 -- 172.21.15.123:0/2932748075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3200b2bf0 con 0x7fa3200b1fe0 2024-09-13T17:06:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.738+0000 7fa3077fe700 1 -- 172.21.15.123:0/2932748075 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16566 (secure 0 0 0) 0x7fa3200b2bf0 con 0x7fa3200b1fe0 2024-09-13T17:06:48.743 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:48.743 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":19,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:48.417532+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:06:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.738+0000 7fa3248a6700 1 -- 172.21.15.123:0/2932748075 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa30c066730 msgr2=0x7fa30c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.738+0000 7fa3248a6700 1 --2- 172.21.15.123:0/2932748075 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa30c066730 0x7fa30c068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c960 tx=0x7fa310008040 comp rx=0 tx=0).stop 2024-09-13T17:06:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.738+0000 7fa3248a6700 1 -- 172.21.15.123:0/2932748075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3200b1fe0 msgr2=0x7fa320152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.738+0000 7fa3248a6700 1 --2- 172.21.15.123:0/2932748075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3200b1fe0 0x7fa320152050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa314000c00 tx=0x7fa314004770 comp rx=0 tx=0).stop 2024-09-13T17:06:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.738+0000 7fa3248a6700 1 -- 172.21.15.123:0/2932748075 shutdown_connections 2024-09-13T17:06:48.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.738+0000 7fa3248a6700 1 --2- 172.21.15.123:0/2932748075 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa30c066730 0x7fa30c068bf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.738+0000 7fa3248a6700 1 --2- 172.21.15.123:0/2932748075 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa32015cd60 0x7fa3200cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.738+0000 7fa3248a6700 1 --2- 172.21.15.123:0/2932748075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3200b1fe0 0x7fa320152050 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.738+0000 7fa3248a6700 1 --2- 172.21.15.123:0/2932748075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3200b1970 0x7fa3200ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.738+0000 7fa3248a6700 1 -- 172.21.15.123:0/2932748075 >> 172.21.15.123:0/2932748075 conn(0x7fa3200d2b50 msgr2=0x7fa3200d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:48.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.738+0000 7fa3248a6700 1 -- 172.21.15.123:0/2932748075 shutdown_connections 2024-09-13T17:06:48.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.738+0000 7fa3248a6700 1 -- 172.21.15.123:0/2932748075 wait complete. 2024-09-13T17:06:48.757 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:06:48.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.862+0000 7f0cddf09700 1 Processor -- start 2024-09-13T17:06:48.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cddf09700 1 -- start start 2024-09-13T17:06:48.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cddf09700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0cd81602d0 0x7f0cd80d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cddf09700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cd80cf920 0x7f0cd80b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cddf09700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd80d0ea0 con 0x7f0cd80d3680 2024-09-13T17:06:48.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cddf09700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd80ceab0 con 0x7f0cd81602d0 2024-09-13T17:06:48.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cddf09700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80cff00 con 0x7f0cd80cf920 2024-09-13T17:06:48.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cdcf07700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0cd81602d0 0x7f0cd80d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cd7fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0cd80d3680 0x7f0cd80cf210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35778/0 (socket says 172.21.15.123:35778) 2024-09-13T17:06:48.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cd7fff700 1 -- 172.21.15.123:0/246654552 learned_addr learned my addr 172.21.15.123:0/246654552 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:48.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cdd708700 1 --2- 172.21.15.123:0/246654552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cd80cf920 0x7f0cd80b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cd77fe700 1 -- 172.21.15.123:0/246654552 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993109980 0 0) 0x7f0cd80d0ea0 con 0x7f0cd80d3680 2024-09-13T17:06:48.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cd77fe700 1 -- 172.21.15.123:0/246654552 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc00035d0 con 0x7f0cd80d3680 2024-09-13T17:06:48.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cdcf07700 1 -- 172.21.15.123:0/246654552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cd80cf920 msgr2=0x7f0cd80b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:48.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cdcf07700 1 --2- 172.21.15.123:0/246654552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cd80cf920 0x7f0cd80b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cdcf07700 1 -- 172.21.15.123:0/246654552 >> v1:172.21.15.123:6789/0 conn(0x7f0cd80d3680 legacy=0x7f0cd80cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cdcf07700 1 -- 172.21.15.123:0/246654552 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80d0c70 con 0x7f0cd81602d0 2024-09-13T17:06:48.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cdcf07700 1 --2- 172.21.15.123:0/246654552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd81602d0 0x7f0cd80d0730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009880 tx=0x7f0cc8009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89fdb0a4b4ecd2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:48.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cd77fe700 1 -- 172.21.15.123:0/246654552 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8011830 con 0x7f0cd81602d0 2024-09-13T17:06:48.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cd77fe700 1 -- 172.21.15.123:0/246654552 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc8011990 con 0x7f0cd81602d0 2024-09-13T17:06:48.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cd77fe700 1 -- 172.21.15.123:0/246654552 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8011d00 con 0x7f0cd81602d0 2024-09-13T17:06:48.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cddf09700 1 -- 172.21.15.123:0/246654552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd81602d0 msgr2=0x7f0cd80d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cddf09700 1 --2- 172.21.15.123:0/246654552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd81602d0 0x7f0cd80d0730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009880 tx=0x7f0cc8009b90 comp rx=0 tx=0).stop 2024-09-13T17:06:48.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cddf09700 1 -- 172.21.15.123:0/246654552 shutdown_connections 2024-09-13T17:06:48.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cddf09700 1 --2- 172.21.15.123:0/246654552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cd80cf920 0x7f0cd80b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cddf09700 1 --2- 172.21.15.123:0/246654552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd81602d0 0x7f0cd80d0730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cddf09700 1 -- 172.21.15.123:0/246654552 >> 172.21.15.123:0/246654552 conn(0x7f0cd80d2b60 msgr2=0x7f0cd80d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:48.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cddf09700 1 -- 172.21.15.123:0/246654552 shutdown_connections 2024-09-13T17:06:48.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.866+0000 7f0cddf09700 1 -- 172.21.15.123:0/246654552 wait complete. 2024-09-13T17:06:48.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cddf09700 1 Processor -- start 2024-09-13T17:06:48.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cddf09700 1 -- start start 2024-09-13T17:06:48.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cddf09700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd80cf920 0x7f0cd80cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cddf09700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cd80d3680 0x7f0cd8157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cddf09700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cd81602d0 0x7f0cd80b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cddf09700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80b0660 con 0x7f0cd80cf920 2024-09-13T17:06:48.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cddf09700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80afa50 con 0x7f0cd80d3680 2024-09-13T17:06:48.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cddf09700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80afd30 con 0x7f0cd81602d0 2024-09-13T17:06:48.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cdcf07700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd80cf920 0x7f0cd80cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cdcf07700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd80cf920 0x7f0cd80cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48464/0 (socket says 172.21.15.123:48464) 2024-09-13T17:06:48.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cdcf07700 1 -- 172.21.15.123:0/1505814779 learned_addr learned my addr 172.21.15.123:0/1505814779 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:48.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cdd708700 1 --2- 172.21.15.123:0/1505814779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cd81602d0 0x7f0cd80b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cd7fff700 1 --2- 172.21.15.123:0/1505814779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cd80d3680 0x7f0cd8157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cdcf07700 1 -- 172.21.15.123:0/1505814779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cd81602d0 msgr2=0x7f0cd80b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cdcf07700 1 --2- 172.21.15.123:0/1505814779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cd81602d0 0x7f0cd80b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cdcf07700 1 -- 172.21.15.123:0/1505814779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cd80d3680 msgr2=0x7f0cd8157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:48.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cdcf07700 1 --2- 172.21.15.123:0/1505814779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cd80d3680 0x7f0cd8157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:48.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cdcf07700 1 -- 172.21.15.123:0/1505814779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc80094b0 con 0x7f0cd80cf920 2024-09-13T17:06:48.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cdcf07700 1 --2- 172.21.15.123:0/1505814779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd80cf920 0x7f0cd80cc4a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80090b0 tx=0x7f0cc8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:48.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cd57fa700 1 -- 172.21.15.123:0/1505814779 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80036c0 con 0x7f0cd80cf920 2024-09-13T17:06:48.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.870+0000 7f0cd57fa700 1 -- 172.21.15.123:0/1505814779 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc8003820 con 0x7f0cd80cf920 2024-09-13T17:06:48.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.874+0000 7f0cddf09700 1 -- 172.21.15.123:0/1505814779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd80b0010 con 0x7f0cd80cf920 2024-09-13T17:06:48.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.874+0000 7f0cd57fa700 1 -- 172.21.15.123:0/1505814779 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8003bd0 con 0x7f0cd80cf920 2024-09-13T17:06:48.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.874+0000 7f0cddf09700 1 -- 172.21.15.123:0/1505814779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd80cc9e0 con 0x7f0cd80cf920 2024-09-13T17:06:48.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.874+0000 7f0cddf09700 1 -- 172.21.15.123:0/1505814779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd8071660 con 0x7f0cd80cf920 2024-09-13T17:06:48.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.874+0000 7f0cd57fa700 1 -- 172.21.15.123:0/1505814779 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0cc8003d30 con 0x7f0cd80cf920 2024-09-13T17:06:48.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.874+0000 7f0cd57fa700 1 --2- 172.21.15.123:0/1505814779 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0cc4066760 0x7f0cc4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:48.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.878+0000 7f0cd7fff700 1 --2- 172.21.15.123:0/1505814779 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0cc4066760 0x7f0cc4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:48.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.878+0000 7f0cd57fa700 1 -- 172.21.15.123:0/1505814779 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cc8021030 con 0x7f0cd80cf920 2024-09-13T17:06:48.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.878+0000 7f0cd7fff700 1 --2- 172.21.15.123:0/1505814779 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0cc4066760 0x7f0cc4068c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80c6430 tx=0x7f0ccc009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:48.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:48.882+0000 7f0cd57fa700 1 -- 172.21.15.123:0/1505814779 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0cc8052b60 con 0x7f0cd80cf920 2024-09-13T17:06:49.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.058+0000 7f0cddf09700 1 -- 172.21.15.123:0/1505814779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cd80d0390 con 0x7f0cd80cf920 2024-09-13T17:06:49.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.058+0000 7f0cd57fa700 1 -- 172.21.15.123:0/1505814779 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16566 (secure 0 0 0) 0x7f0cc8015090 con 0x7f0cd80cf920 2024-09-13T17:06:49.065 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:49.066 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":19,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:48.417532+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:06:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.062+0000 7f0cddf09700 1 -- 172.21.15.123:0/1505814779 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0cc4066760 msgr2=0x7f0cc4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.062+0000 7f0cddf09700 1 --2- 172.21.15.123:0/1505814779 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0cc4066760 0x7f0cc4068c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80c6430 tx=0x7f0ccc009040 comp rx=0 tx=0).stop 2024-09-13T17:06:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.062+0000 7f0cddf09700 1 -- 172.21.15.123:0/1505814779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd80cf920 msgr2=0x7f0cd80cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.062+0000 7f0cddf09700 1 --2- 172.21.15.123:0/1505814779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd80cf920 0x7f0cd80cc4a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80090b0 tx=0x7f0cc8004770 comp rx=0 tx=0).stop 2024-09-13T17:06:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.062+0000 7f0cddf09700 1 -- 172.21.15.123:0/1505814779 shutdown_connections 2024-09-13T17:06:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.062+0000 7f0cddf09700 1 --2- 172.21.15.123:0/1505814779 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0cc4066760 0x7f0cc4068c20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.062+0000 7f0cddf09700 1 --2- 172.21.15.123:0/1505814779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cd81602d0 0x7f0cd80b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.062+0000 7f0cddf09700 1 --2- 172.21.15.123:0/1505814779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cd80d3680 0x7f0cd8157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.062+0000 7f0cddf09700 1 --2- 172.21.15.123:0/1505814779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cd80cf920 0x7f0cd80cc4a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.062+0000 7f0cddf09700 1 -- 172.21.15.123:0/1505814779 >> 172.21.15.123:0/1505814779 conn(0x7f0cd80d2b60 msgr2=0x7f0cd80b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.062+0000 7f0cddf09700 1 -- 172.21.15.123:0/1505814779 shutdown_connections 2024-09-13T17:06:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.062+0000 7f0cddf09700 1 -- 172.21.15.123:0/1505814779 wait complete. 2024-09-13T17:06:49.086 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:06:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.194+0000 7f1c6d7bd700 1 Processor -- start 2024-09-13T17:06:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.194+0000 7f1c6d7bd700 1 -- start start 2024-09-13T17:06:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6d7bd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1c680cb070 0x7f1c680cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6d7bd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1c6815a2f0 0x7f1c6815a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6d7bd700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c680ce180 con 0x7f1c680b3990 2024-09-13T17:06:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6d7bd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c680cba20 con 0x7f1c6815a2f0 2024-09-13T17:06:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6d7bd700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c680cd990 con 0x7f1c680cb070 2024-09-13T17:06:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6cfbc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1c6815a2f0 0x7f1c6815a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6cfbc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1c6815a2f0 0x7f1c6815a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48480/0 (socket says 172.21.15.123:48480) 2024-09-13T17:06:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6cfbc700 1 -- 172.21.15.123:0/857558519 learned_addr learned my addr 172.21.15.123:0/857558519 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:49.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c677fe700 1 --2- 172.21.15.123:0/857558519 >> v2:172.21.15.153:3300/0 conn(0x7f1c680cb070 0x7f1c680cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6cfbc700 1 -- 172.21.15.123:0/857558519 >> v2:172.21.15.153:3300/0 conn(0x7f1c680cb070 msgr2=0x7f1c680cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6cfbc700 1 --2- 172.21.15.123:0/857558519 >> v2:172.21.15.153:3300/0 conn(0x7f1c680cb070 0x7f1c680cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6cfbc700 1 -- 172.21.15.123:0/857558519 >> v1:172.21.15.153:6789/0 conn(0x7f1c680b3990 legacy=0x7f1c680cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6cfbc700 1 -- 172.21.15.123:0/857558519 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c680cd0f0 con 0x7f1c6815a2f0 2024-09-13T17:06:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6cfbc700 1 --2- 172.21.15.123:0/857558519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c6815a2f0 0x7f1c6815a760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c6806a5c0 tx=0x7f1c58009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78538da789a56c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c66ffd700 1 -- 172.21.15.123:0/857558519 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58011830 con 0x7f1c6815a2f0 2024-09-13T17:06:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c66ffd700 1 -- 172.21.15.123:0/857558519 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c58011990 con 0x7f1c6815a2f0 2024-09-13T17:06:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c66ffd700 1 -- 172.21.15.123:0/857558519 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58011d20 con 0x7f1c6815a2f0 2024-09-13T17:06:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/857558519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c6815a2f0 msgr2=0x7f1c6815a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6d7bd700 1 --2- 172.21.15.123:0/857558519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c6815a2f0 0x7f1c6815a760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c6806a5c0 tx=0x7f1c58009bf0 comp rx=0 tx=0).stop 2024-09-13T17:06:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/857558519 shutdown_connections 2024-09-13T17:06:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6d7bd700 1 --2- 172.21.15.123:0/857558519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c6815a2f0 0x7f1c6815a760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6d7bd700 1 --2- 172.21.15.123:0/857558519 >> v2:172.21.15.153:3300/0 conn(0x7f1c680cb070 0x7f1c680cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/857558519 >> 172.21.15.123:0/857558519 conn(0x7f1c680b01d0 msgr2=0x7f1c680b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/857558519 shutdown_connections 2024-09-13T17:06:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.198+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/857558519 wait complete. 2024-09-13T17:06:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c6d7bd700 1 Processor -- start 2024-09-13T17:06:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c6d7bd700 1 -- start start 2024-09-13T17:06:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c6d7bd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c680b3990 0x7f1c6815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c6d7bd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680cb070 0x7f1c680c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c6d7bd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c6815a2f0 0x7f1c68156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:49.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c6d7bd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680c3cd0 con 0x7f1c680cb070 2024-09-13T17:06:49.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c6d7bd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680c8a60 con 0x7f1c680b3990 2024-09-13T17:06:49.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c6d7bd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6806bf90 con 0x7f1c6815a2f0 2024-09-13T17:06:49.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c677fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680cb070 0x7f1c680c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:49.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c677fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680cb070 0x7f1c680c5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48490/0 (socket says 172.21.15.123:48490) 2024-09-13T17:06:49.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c677fe700 1 -- 172.21.15.123:0/1109086378 learned_addr learned my addr 172.21.15.123:0/1109086378 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:49.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c67fff700 1 --2- 172.21.15.123:0/1109086378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c680b3990 0x7f1c6815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:49.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c6cfbc700 1 --2- 172.21.15.123:0/1109086378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c6815a2f0 0x7f1c68156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c677fe700 1 -- 172.21.15.123:0/1109086378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c6815a2f0 msgr2=0x7f1c68156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c677fe700 1 --2- 172.21.15.123:0/1109086378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c6815a2f0 0x7f1c68156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c677fe700 1 -- 172.21.15.123:0/1109086378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c680b3990 msgr2=0x7f1c6815bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c677fe700 1 --2- 172.21.15.123:0/1109086378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c680b3990 0x7f1c6815bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c677fe700 1 -- 172.21.15.123:0/1109086378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c58009570 con 0x7f1c680cb070 2024-09-13T17:06:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c677fe700 1 --2- 172.21.15.123:0/1109086378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680cb070 0x7f1c680c5aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000efc0 tx=0x7f1c6000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c64ff9700 1 -- 172.21.15.123:0/1109086378 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6000cd10 con 0x7f1c680cb070 2024-09-13T17:06:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c64ff9700 1 -- 172.21.15.123:0/1109086378 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6000f040 con 0x7f1c680cb070 2024-09-13T17:06:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/1109086378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c680c8780 con 0x7f1c680cb070 2024-09-13T17:06:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c64ff9700 1 -- 172.21.15.123:0/1109086378 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c600146a0 con 0x7f1c680cb070 2024-09-13T17:06:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.202+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/1109086378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6815f170 con 0x7f1c680cb070 2024-09-13T17:06:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.206+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/1109086378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c680cb4e0 con 0x7f1c680cb070 2024-09-13T17:06:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.206+0000 7f1c64ff9700 1 -- 172.21.15.123:0/1109086378 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c60014800 con 0x7f1c680cb070 2024-09-13T17:06:49.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.206+0000 7f1c64ff9700 1 --2- 172.21.15.123:0/1109086378 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c48066730 0x7f1c48068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:49.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.206+0000 7f1c64ff9700 1 -- 172.21.15.123:0/1109086378 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c60084940 con 0x7f1c680cb070 2024-09-13T17:06:49.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.206+0000 7f1c67fff700 1 --2- 172.21.15.123:0/1109086378 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c48066730 0x7f1c48068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:49.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.206+0000 7f1c67fff700 1 --2- 172.21.15.123:0/1109086378 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c48066730 0x7f1c48068bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c50000f60 tx=0x7f1c50009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.214+0000 7f1c64ff9700 1 -- 172.21.15.123:0/1109086378 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c60051d40 con 0x7f1c680cb070 2024-09-13T17:06:49.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:49.418+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/1109086378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1c68071f40 con 0x7f1c680cb070 2024-09-13T17:06:50.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.422+0000 7f1c64ff9700 1 -- 172.21.15.123:0/1109086378 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1c60055360 con 0x7f1c680cb070 2024-09-13T17:06:50.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.426+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/1109086378 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c48066730 msgr2=0x7f1c48068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.426+0000 7f1c6d7bd700 1 --2- 172.21.15.123:0/1109086378 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c48066730 0x7f1c48068bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c50000f60 tx=0x7f1c50009040 comp rx=0 tx=0).stop 2024-09-13T17:06:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.426+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/1109086378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680cb070 msgr2=0x7f1c680c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.426+0000 7f1c6d7bd700 1 --2- 172.21.15.123:0/1109086378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680cb070 0x7f1c680c5aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000efc0 tx=0x7f1c6000c3a0 comp rx=0 tx=0).stop 2024-09-13T17:06:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.426+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/1109086378 shutdown_connections 2024-09-13T17:06:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.426+0000 7f1c6d7bd700 1 --2- 172.21.15.123:0/1109086378 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c48066730 0x7f1c48068bf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.426+0000 7f1c6d7bd700 1 --2- 172.21.15.123:0/1109086378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c6815a2f0 0x7f1c68156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.426+0000 7f1c6d7bd700 1 --2- 172.21.15.123:0/1109086378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680cb070 0x7f1c680c5aa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.426+0000 7f1c6d7bd700 1 --2- 172.21.15.123:0/1109086378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c680b3990 0x7f1c6815bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.426+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/1109086378 >> 172.21.15.123:0/1109086378 conn(0x7f1c680b01d0 msgr2=0x7f1c680af690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.426+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/1109086378 shutdown_connections 2024-09-13T17:06:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.426+0000 7f1c6d7bd700 1 -- 172.21.15.123:0/1109086378 wait complete. 2024-09-13T17:06:50.450 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:06:50.450 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:06:50.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.570+0000 7f1cc3fff700 1 Processor -- start 2024-09-13T17:06:50.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.570+0000 7f1cc3fff700 1 -- start start 2024-09-13T17:06:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.570+0000 7f1cc3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1cc4154f20 0x7f1cc40cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.570+0000 7f1cc3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1cc40b1e50 0x7f1cc415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.570+0000 7f1cc3fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc415bbf0 con 0x7f1cc40ccf60 2024-09-13T17:06:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.570+0000 7f1cc3fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc40cd3d0 con 0x7f1cc4154f20 2024-09-13T17:06:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.570+0000 7f1cc3fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc415b000 con 0x7f1cc40b1e50 2024-09-13T17:06:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc2ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1cc4154f20 0x7f1cc40cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cba7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1cc40ccf60 0x7f1cc40b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35794/0 (socket says 172.21.15.123:35794) 2024-09-13T17:06:50.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cba7fc700 1 -- 172.21.15.123:0/2162713226 learned_addr learned my addr 172.21.15.123:0/2162713226 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:50.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc37fe700 1 --2- 172.21.15.123:0/2162713226 >> v2:172.21.15.153:3300/0 conn(0x7f1cc40b1e50 0x7f1cc415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:50.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc27fc700 1 -- 172.21.15.123:0/2162713226 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679354247 0 0) 0x7f1cc415bbf0 con 0x7f1cc40ccf60 2024-09-13T17:06:50.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc27fc700 1 -- 172.21.15.123:0/2162713226 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cb00035d0 con 0x7f1cc40ccf60 2024-09-13T17:06:50.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc2ffd700 1 -- 172.21.15.123:0/2162713226 >> v2:172.21.15.153:3300/0 conn(0x7f1cc40b1e50 msgr2=0x7f1cc415c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:50.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc2ffd700 1 --2- 172.21.15.123:0/2162713226 >> v2:172.21.15.153:3300/0 conn(0x7f1cc40b1e50 0x7f1cc415c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:50.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc2ffd700 1 -- 172.21.15.123:0/2162713226 >> v1:172.21.15.123:6789/0 conn(0x7f1cc40ccf60 legacy=0x7f1cc40b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:50.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc2ffd700 1 -- 172.21.15.123:0/2162713226 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc415b2c0 con 0x7f1cc4154f20 2024-09-13T17:06:50.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc2ffd700 1 --2- 172.21.15.123:0/2162713226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc4154f20 0x7f1cc40cca20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40b4b10 tx=0x7f1cb4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d0779cdd79a866 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:50.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc27fc700 1 -- 172.21.15.123:0/2162713226 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4011830 con 0x7f1cc4154f20 2024-09-13T17:06:50.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc27fc700 1 -- 172.21.15.123:0/2162713226 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb4011990 con 0x7f1cc4154f20 2024-09-13T17:06:50.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc27fc700 1 -- 172.21.15.123:0/2162713226 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4011d20 con 0x7f1cc4154f20 2024-09-13T17:06:50.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc3fff700 1 -- 172.21.15.123:0/2162713226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc4154f20 msgr2=0x7f1cc40cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:50.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc3fff700 1 --2- 172.21.15.123:0/2162713226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc4154f20 0x7f1cc40cca20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40b4b10 tx=0x7f1cb4009b30 comp rx=0 tx=0).stop 2024-09-13T17:06:50.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc3fff700 1 -- 172.21.15.123:0/2162713226 shutdown_connections 2024-09-13T17:06:50.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc3fff700 1 --2- 172.21.15.123:0/2162713226 >> v2:172.21.15.153:3300/0 conn(0x7f1cc40b1e50 0x7f1cc415c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:50.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc3fff700 1 --2- 172.21.15.123:0/2162713226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc4154f20 0x7f1cc40cca20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:50.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc3fff700 1 -- 172.21.15.123:0/2162713226 >> 172.21.15.123:0/2162713226 conn(0x7f1cc40735c0 msgr2=0x7f1cc4066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:50.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc3fff700 1 -- 172.21.15.123:0/2162713226 shutdown_connections 2024-09-13T17:06:50.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.574+0000 7f1cc3fff700 1 -- 172.21.15.123:0/2162713226 wait complete. 2024-09-13T17:06:50.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cc3fff700 1 Processor -- start 2024-09-13T17:06:50.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cc3fff700 1 -- start start 2024-09-13T17:06:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cc3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1cc40b1e50 0x7f1cc4151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cc3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc40ccf60 0x7f1cc41503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cc3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cc4154f20 0x7f1cc40b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cc3fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40b4910 con 0x7f1cc40ccf60 2024-09-13T17:06:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cc3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc41508f0 con 0x7f1cc4154f20 2024-09-13T17:06:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cc3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc41f3430 con 0x7f1cc40b1e50 2024-09-13T17:06:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cba7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc40ccf60 0x7f1cc41503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cba7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc40ccf60 0x7f1cc41503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48502/0 (socket says 172.21.15.123:48502) 2024-09-13T17:06:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cba7fc700 1 -- 172.21.15.123:0/3576088380 learned_addr learned my addr 172.21.15.123:0/3576088380 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cc2ffd700 1 --2- 172.21.15.123:0/3576088380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1cc40b1e50 0x7f1cc4151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cc37fe700 1 --2- 172.21.15.123:0/3576088380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cc4154f20 0x7f1cc40b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cba7fc700 1 -- 172.21.15.123:0/3576088380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1cc40b1e50 msgr2=0x7f1cc4151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cba7fc700 1 --2- 172.21.15.123:0/3576088380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1cc40b1e50 0x7f1cc4151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cba7fc700 1 -- 172.21.15.123:0/3576088380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cc4154f20 msgr2=0x7f1cc40b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cba7fc700 1 --2- 172.21.15.123:0/3576088380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cc4154f20 0x7f1cc40b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:50.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cba7fc700 1 -- 172.21.15.123:0/3576088380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb40094b0 con 0x7f1cc40ccf60 2024-09-13T17:06:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.578+0000 7f1cba7fc700 1 --2- 172.21.15.123:0/3576088380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc40ccf60 0x7f1cc41503b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00c4d0 tx=0x7f1cac00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.582+0000 7f1cbbfff700 1 -- 172.21.15.123:0/3576088380 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac005d90 con 0x7f1cc40ccf60 2024-09-13T17:06:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.582+0000 7f1cbbfff700 1 -- 172.21.15.123:0/3576088380 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac0070d0 con 0x7f1cc40ccf60 2024-09-13T17:06:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.582+0000 7f1cc3fff700 1 -- 172.21.15.123:0/3576088380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc40b3030 con 0x7f1cc40ccf60 2024-09-13T17:06:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.582+0000 7f1cbbfff700 1 -- 172.21.15.123:0/3576088380 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac007480 con 0x7f1cc40ccf60 2024-09-13T17:06:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.582+0000 7f1cc3fff700 1 -- 172.21.15.123:0/3576088380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc41f3150 con 0x7f1cc40ccf60 2024-09-13T17:06:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.582+0000 7f1cc3fff700 1 -- 172.21.15.123:0/3576088380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc415cc50 con 0x7f1cc40ccf60 2024-09-13T17:06:50.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.582+0000 7f1cbbfff700 1 -- 172.21.15.123:0/3576088380 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1cac0075e0 con 0x7f1cc40ccf60 2024-09-13T17:06:50.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.582+0000 7f1cbbfff700 1 --2- 172.21.15.123:0/3576088380 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1ca4066730 0x7f1ca4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:50.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.582+0000 7f1cbbfff700 1 -- 172.21.15.123:0/3576088380 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cac083530 con 0x7f1cc40ccf60 2024-09-13T17:06:50.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.582+0000 7f1cc2ffd700 1 --2- 172.21.15.123:0/3576088380 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1ca4066730 0x7f1ca4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:50.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.586+0000 7f1cc2ffd700 1 --2- 172.21.15.123:0/3576088380 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1ca4066730 0x7f1ca4068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40090b0 tx=0x7f1cb4008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:50.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.590+0000 7f1cbbfff700 1 -- 172.21.15.123:0/3576088380 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1cac0508a0 con 0x7f1cc40ccf60 2024-09-13T17:06:50.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:50.794+0000 7f1cc3fff700 1 -- 172.21.15.123:0/3576088380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1cc40662f0 con 0x7f1cc40ccf60 2024-09-13T17:06:51.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.434+0000 7f1cbbfff700 1 -- 172.21.15.123:0/3576088380 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1cac053ec0 con 0x7f1cc40ccf60 2024-09-13T17:06:51.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.438+0000 7f1cc3fff700 1 -- 172.21.15.123:0/3576088380 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1ca4066730 msgr2=0x7f1ca4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:51.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.438+0000 7f1cc3fff700 1 --2- 172.21.15.123:0/3576088380 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1ca4066730 0x7f1ca4068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40090b0 tx=0x7f1cb4008030 comp rx=0 tx=0).stop 2024-09-13T17:06:51.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.438+0000 7f1cc3fff700 1 -- 172.21.15.123:0/3576088380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc40ccf60 msgr2=0x7f1cc41503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:51.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.438+0000 7f1cc3fff700 1 --2- 172.21.15.123:0/3576088380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc40ccf60 0x7f1cc41503b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00c4d0 tx=0x7f1cac00c7e0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.438+0000 7f1cc3fff700 1 -- 172.21.15.123:0/3576088380 shutdown_connections 2024-09-13T17:06:51.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.438+0000 7f1cc3fff700 1 --2- 172.21.15.123:0/3576088380 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1ca4066730 0x7f1ca4068bf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.438+0000 7f1cc3fff700 1 --2- 172.21.15.123:0/3576088380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cc4154f20 0x7f1cc40b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.438+0000 7f1cc3fff700 1 --2- 172.21.15.123:0/3576088380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cc40ccf60 0x7f1cc41503b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.438+0000 7f1cc3fff700 1 --2- 172.21.15.123:0/3576088380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1cc40b1e50 0x7f1cc4151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.438+0000 7f1cc3fff700 1 -- 172.21.15.123:0/3576088380 >> 172.21.15.123:0/3576088380 conn(0x7f1cc40735c0 msgr2=0x7f1cc40cad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:51.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.438+0000 7f1cc3fff700 1 -- 172.21.15.123:0/3576088380 shutdown_connections 2024-09-13T17:06:51.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.438+0000 7f1cc3fff700 1 -- 172.21.15.123:0/3576088380 wait complete. 2024-09-13T17:06:51.461 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:06:51.461 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:06:51.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc49d779700 1 Processor -- start 2024-09-13T17:06:51.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc49d779700 1 -- start start 2024-09-13T17:06:51.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc49d779700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc498159aa0 0x7fc498159e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:51.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc49d779700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4980c4f00 0x7fc4980cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:51.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc49d779700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4980c3650 con 0x7fc4980cc720 2024-09-13T17:06:51.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc49d779700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4980ccb90 con 0x7fc498159aa0 2024-09-13T17:06:51.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc49d779700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4980cb7a0 con 0x7fc4980c4f00 2024-09-13T17:06:51.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc497fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc498159aa0 0x7fc498159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:51.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc49cf78700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc4980cc720 0x7fc4980cb090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35808/0 (socket says 172.21.15.123:35808) 2024-09-13T17:06:51.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc49cf78700 1 -- 172.21.15.123:0/3597703564 learned_addr learned my addr 172.21.15.123:0/3597703564 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:51.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc497fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc498159aa0 0x7fc498159e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48508/0 (socket says 172.21.15.123:48508) 2024-09-13T17:06:51.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc4977fe700 1 --2- 172.21.15.123:0/3597703564 >> v2:172.21.15.153:3300/0 conn(0x7fc4980c4f00 0x7fc4980cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:51.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc496ffd700 1 -- 172.21.15.123:0/3597703564 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400562068 0 0) 0x7fc4980c3650 con 0x7fc4980cc720 2024-09-13T17:06:51.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc496ffd700 1 -- 172.21.15.123:0/3597703564 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4840035d0 con 0x7fc4980cc720 2024-09-13T17:06:51.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc497fff700 1 -- 172.21.15.123:0/3597703564 >> v2:172.21.15.153:3300/0 conn(0x7fc4980c4f00 msgr2=0x7fc4980cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:51.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc497fff700 1 --2- 172.21.15.123:0/3597703564 >> v2:172.21.15.153:3300/0 conn(0x7fc4980c4f00 0x7fc4980cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc496ffd700 1 -- 172.21.15.123:0/3597703564 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 396835023 0 0) 0x7fc4840035d0 con 0x7fc4980cc720 2024-09-13T17:06:51.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.574+0000 7fc497fff700 1 -- 172.21.15.123:0/3597703564 >> v1:172.21.15.123:6789/0 conn(0x7fc4980cc720 legacy=0x7fc4980cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:51.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc497fff700 1 -- 172.21.15.123:0/3597703564 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4980c3930 con 0x7fc498159aa0 2024-09-13T17:06:51.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc497fff700 1 --2- 172.21.15.123:0/3597703564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc498159aa0 0x7fc498159e80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc4980ce5e0 tx=0x7fc480009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e2aafbdb0729a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:51.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc496ffd700 1 -- 172.21.15.123:0/3597703564 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4900019f0 con 0x7fc498159aa0 2024-09-13T17:06:51.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc496ffd700 1 -- 172.21.15.123:0/3597703564 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc480004030 con 0x7fc498159aa0 2024-09-13T17:06:51.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc496ffd700 1 -- 172.21.15.123:0/3597703564 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4800043a0 con 0x7fc498159aa0 2024-09-13T17:06:51.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc49d779700 1 -- 172.21.15.123:0/3597703564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc498159aa0 msgr2=0x7fc498159e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:51.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc49d779700 1 --2- 172.21.15.123:0/3597703564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc498159aa0 0x7fc498159e80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc4980ce5e0 tx=0x7fc480009b60 comp rx=0 tx=0).stop 2024-09-13T17:06:51.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc49d779700 1 -- 172.21.15.123:0/3597703564 shutdown_connections 2024-09-13T17:06:51.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc49d779700 1 --2- 172.21.15.123:0/3597703564 >> v2:172.21.15.153:3300/0 conn(0x7fc4980c4f00 0x7fc4980cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc49d779700 1 --2- 172.21.15.123:0/3597703564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc498159aa0 0x7fc498159e80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc49d779700 1 -- 172.21.15.123:0/3597703564 >> 172.21.15.123:0/3597703564 conn(0x7fc4980b0240 msgr2=0x7fc4980b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:51.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc49d779700 1 -- 172.21.15.123:0/3597703564 shutdown_connections 2024-09-13T17:06:51.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc49d779700 1 -- 172.21.15.123:0/3597703564 wait complete. 2024-09-13T17:06:51.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc49d779700 1 Processor -- start 2024-09-13T17:06:51.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.578+0000 7fc49d779700 1 -- start start 2024-09-13T17:06:51.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc49d779700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4980c4f00 0x7fc498157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc49d779700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4980cc720 0x7fc498158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc49d779700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc498152370 0x7fc4980c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc49d779700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4980c8010 con 0x7fc4980cc720 2024-09-13T17:06:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc49d779700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4980c82f0 con 0x7fc4980c4f00 2024-09-13T17:06:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc49d779700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4980c85d0 con 0x7fc498152370 2024-09-13T17:06:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc4977fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4980cc720 0x7fc498158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc4977fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4980cc720 0x7fc498158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48522/0 (socket says 172.21.15.123:48522) 2024-09-13T17:06:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc4977fe700 1 -- 172.21.15.123:0/1178440658 learned_addr learned my addr 172.21.15.123:0/1178440658 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc49cf78700 1 --2- 172.21.15.123:0/1178440658 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc498152370 0x7fc4980c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc497fff700 1 --2- 172.21.15.123:0/1178440658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4980c4f00 0x7fc498157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc4977fe700 1 -- 172.21.15.123:0/1178440658 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc498152370 msgr2=0x7fc4980c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:51.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc4977fe700 1 --2- 172.21.15.123:0/1178440658 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc498152370 0x7fc4980c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc4977fe700 1 -- 172.21.15.123:0/1178440658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4980c4f00 msgr2=0x7fc498157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:51.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc4977fe700 1 --2- 172.21.15.123:0/1178440658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4980c4f00 0x7fc498157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc4977fe700 1 -- 172.21.15.123:0/1178440658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4800094b0 con 0x7fc4980cc720 2024-09-13T17:06:51.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc4977fe700 1 --2- 172.21.15.123:0/1178440658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4980cc720 0x7fc498158380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc48800e9d0 tx=0x7fc48800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:51.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc494ff9700 1 -- 172.21.15.123:0/1178440658 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488009720 con 0x7fc4980cc720 2024-09-13T17:06:51.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc494ff9700 1 -- 172.21.15.123:0/1178440658 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48800ee70 con 0x7fc4980cc720 2024-09-13T17:06:51.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc494ff9700 1 -- 172.21.15.123:0/1178440658 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48800ca50 con 0x7fc4980cc720 2024-09-13T17:06:51.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc49d779700 1 -- 172.21.15.123:0/1178440658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4980c88b0 con 0x7fc4980cc720 2024-09-13T17:06:51.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.582+0000 7fc49d779700 1 -- 172.21.15.123:0/1178440658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4980c7820 con 0x7fc4980cc720 2024-09-13T17:06:51.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.586+0000 7fc49d779700 1 -- 172.21.15.123:0/1178440658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4980c46f0 con 0x7fc4980cc720 2024-09-13T17:06:51.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.586+0000 7fc494ff9700 1 -- 172.21.15.123:0/1178440658 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc48800cbb0 con 0x7fc4980cc720 2024-09-13T17:06:51.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.586+0000 7fc494ff9700 1 --2- 172.21.15.123:0/1178440658 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc478066760 0x7fc478068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:51.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.586+0000 7fc494ff9700 1 -- 172.21.15.123:0/1178440658 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4880840d0 con 0x7fc4980cc720 2024-09-13T17:06:51.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.586+0000 7fc497fff700 1 --2- 172.21.15.123:0/1178440658 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc478066760 0x7fc478068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:51.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.586+0000 7fc497fff700 1 --2- 172.21.15.123:0/1178440658 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc478066760 0x7fc478068c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc49806a920 tx=0x7fc480008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:51.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.590+0000 7fc494ff9700 1 -- 172.21.15.123:0/1178440658 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc488051430 con 0x7fc4980cc720 2024-09-13T17:06:51.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.794+0000 7fc49d779700 1 -- 172.21.15.123:0/1178440658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4980adcd0 con 0x7fc4980cc720 2024-09-13T17:06:51.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.794+0000 7fc494ff9700 1 -- 172.21.15.123:0/1178440658 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7fc48800ce60 con 0x7fc4980cc720 2024-09-13T17:06:51.801 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:51.801 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/721071800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":721071800},{"type":"v1","addr":"172.21.15.123:6835","nonce":721071800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1472515409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1472515409},{"type":"v1","addr":"172.21.15.123:6837","nonce":1472515409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3017694841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3017694841},{"type":"v1","addr":"172.21.15.153:6833","nonce":3017694841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:06:48.418287+0000","modified":"2024-09-13T17:06:51.426119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/2848393496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2848393496},{"type":"v1","addr":"172.21.15.153:6835","nonce":2848393496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:06:51.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.798+0000 7fc49d779700 1 -- 172.21.15.123:0/1178440658 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc478066760 msgr2=0x7fc478068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:51.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.798+0000 7fc49d779700 1 --2- 172.21.15.123:0/1178440658 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc478066760 0x7fc478068c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc49806a920 tx=0x7fc480008030 comp rx=0 tx=0).stop 2024-09-13T17:06:51.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.798+0000 7fc49d779700 1 -- 172.21.15.123:0/1178440658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4980cc720 msgr2=0x7fc498158380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:51.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.798+0000 7fc49d779700 1 --2- 172.21.15.123:0/1178440658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4980cc720 0x7fc498158380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc48800e9d0 tx=0x7fc48800ece0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.798+0000 7fc49d779700 1 -- 172.21.15.123:0/1178440658 shutdown_connections 2024-09-13T17:06:51.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.798+0000 7fc49d779700 1 --2- 172.21.15.123:0/1178440658 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc478066760 0x7fc478068c20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.798+0000 7fc49d779700 1 --2- 172.21.15.123:0/1178440658 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc498152370 0x7fc4980c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.798+0000 7fc49d779700 1 --2- 172.21.15.123:0/1178440658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4980cc720 0x7fc498158380 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.798+0000 7fc49d779700 1 --2- 172.21.15.123:0/1178440658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4980c4f00 0x7fc498157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.798+0000 7fc49d779700 1 -- 172.21.15.123:0/1178440658 >> 172.21.15.123:0/1178440658 conn(0x7fc4980b0240 msgr2=0x7fc498152f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:51.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.798+0000 7fc49d779700 1 -- 172.21.15.123:0/1178440658 shutdown_connections 2024-09-13T17:06:51.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.798+0000 7fc49d779700 1 -- 172.21.15.123:0/1178440658 wait complete. 2024-09-13T17:06:51.805 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 7 2024-09-13T17:06:51.817 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:06:51.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.922+0000 7fa91376e700 1 Processor -- start 2024-09-13T17:06:51.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.922+0000 7fa91376e700 1 -- start start 2024-09-13T17:06:51.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa91376e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa90c0adef0 0x7fa90c0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:51.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa91376e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90c06d220 con 0x7fa90c0ad9a0 2024-09-13T17:06:51.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa91376e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90c06d500 con 0x7fa90c0cec90 2024-09-13T17:06:51.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa91376e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90c06d7e0 con 0x7fa90c0adef0 2024-09-13T17:06:51.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa911d0b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa90c0adef0 0x7fa90c0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:51.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa910d09700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa90c0ad9a0 0x7fa90c0cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35818/0 (socket says 172.21.15.123:35818) 2024-09-13T17:06:51.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa910d09700 1 -- 172.21.15.123:0/1378338360 learned_addr learned my addr 172.21.15.123:0/1378338360 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:51.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa911d0b700 1 -- 172.21.15.123:0/1378338360 >> v1:172.21.15.153:6789/0 conn(0x7fa90c0cec90 legacy=0x7fa90c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:51.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa911d0b700 1 -- 172.21.15.123:0/1378338360 >> v1:172.21.15.123:6789/0 conn(0x7fa90c0ad9a0 legacy=0x7fa90c0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:51.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa903fff700 1 -- 172.21.15.123:0/1378338360 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206783082 0 0) 0x7fa90c06d220 con 0x7fa90c0ad9a0 2024-09-13T17:06:51.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa911d0b700 1 -- 172.21.15.123:0/1378338360 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c06dac0 con 0x7fa90c0adef0 2024-09-13T17:06:51.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa911d0b700 1 --2- 172.21.15.123:0/1378338360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa90c0adef0 0x7fa90c0cc410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa90400baf0 tx=0x7fa90400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb35eaf2b4d393d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:51.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa903fff700 1 -- 172.21.15.123:0/1378338360 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90400dd30 con 0x7fa90c0adef0 2024-09-13T17:06:51.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa903fff700 1 -- 172.21.15.123:0/1378338360 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90400de90 con 0x7fa90c0adef0 2024-09-13T17:06:51.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa903fff700 1 -- 172.21.15.123:0/1378338360 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa904010690 con 0x7fa90c0adef0 2024-09-13T17:06:51.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa91376e700 1 -- 172.21.15.123:0/1378338360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa90c0adef0 msgr2=0x7fa90c0cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:51.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa91376e700 1 --2- 172.21.15.123:0/1378338360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa90c0adef0 0x7fa90c0cc410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa90400baf0 tx=0x7fa90400be00 comp rx=0 tx=0).stop 2024-09-13T17:06:51.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa91376e700 1 -- 172.21.15.123:0/1378338360 shutdown_connections 2024-09-13T17:06:51.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa91376e700 1 --2- 172.21.15.123:0/1378338360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa90c0adef0 0x7fa90c0cc410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa91376e700 1 -- 172.21.15.123:0/1378338360 >> 172.21.15.123:0/1378338360 conn(0x7fa90c066570 msgr2=0x7fa90c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:51.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa91376e700 1 -- 172.21.15.123:0/1378338360 shutdown_connections 2024-09-13T17:06:51.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.926+0000 7fa91376e700 1 -- 172.21.15.123:0/1378338360 wait complete. 2024-09-13T17:06:51.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91376e700 1 Processor -- start 2024-09-13T17:06:51.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91376e700 1 -- start start 2024-09-13T17:06:51.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91376e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa90c0ad9a0 0x7fa90c146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:51.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91376e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa90c0adef0 0x7fa90c0b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:51.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91376e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa90c0cec90 0x7fa90c0b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:51.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91376e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c147800 con 0x7fa90c0ad9a0 2024-09-13T17:06:51.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91376e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c147360 con 0x7fa90c0adef0 2024-09-13T17:06:51.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91376e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c0c44a0 con 0x7fa90c0cec90 2024-09-13T17:06:51.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91150a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa90c0ad9a0 0x7fa90c146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:51.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91150a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa90c0ad9a0 0x7fa90c146e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48534/0 (socket says 172.21.15.123:48534) 2024-09-13T17:06:51.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91150a700 1 -- 172.21.15.123:0/97754492 learned_addr learned my addr 172.21.15.123:0/97754492 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:51.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa910d09700 1 --2- 172.21.15.123:0/97754492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa90c0adef0 0x7fa90c0b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:51.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa911d0b700 1 --2- 172.21.15.123:0/97754492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa90c0cec90 0x7fa90c0b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:51.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91150a700 1 -- 172.21.15.123:0/97754492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa90c0cec90 msgr2=0x7fa90c0b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:51.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91150a700 1 --2- 172.21.15.123:0/97754492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa90c0cec90 0x7fa90c0b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91150a700 1 -- 172.21.15.123:0/97754492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa90c0adef0 msgr2=0x7fa90c0b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:51.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91150a700 1 --2- 172.21.15.123:0/97754492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa90c0adef0 0x7fa90c0b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:51.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91150a700 1 -- 172.21.15.123:0/97754492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90400b750 con 0x7fa90c0ad9a0 2024-09-13T17:06:51.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91150a700 1 --2- 172.21.15.123:0/97754492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa90c0ad9a0 0x7fa90c146e20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c500 tx=0x7fa8fc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:51.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa901ffb700 1 -- 172.21.15.123:0/97754492 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0052d0 con 0x7fa90c0ad9a0 2024-09-13T17:06:51.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa901ffb700 1 -- 172.21.15.123:0/97754492 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc005430 con 0x7fa90c0ad9a0 2024-09-13T17:06:51.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91376e700 1 -- 172.21.15.123:0/97754492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90c147aa0 con 0x7fa90c0ad9a0 2024-09-13T17:06:51.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa901ffb700 1 -- 172.21.15.123:0/97754492 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0055a0 con 0x7fa90c0ad9a0 2024-09-13T17:06:51.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.930+0000 7fa91376e700 1 -- 172.21.15.123:0/97754492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90c148060 con 0x7fa90c0ad9a0 2024-09-13T17:06:51.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.934+0000 7fa901ffb700 1 -- 172.21.15.123:0/97754492 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa8fc0038e0 con 0x7fa90c0ad9a0 2024-09-13T17:06:51.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.934+0000 7fa91376e700 1 -- 172.21.15.123:0/97754492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90c15d0c0 con 0x7fa90c0ad9a0 2024-09-13T17:06:51.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.934+0000 7fa901ffb700 1 --2- 172.21.15.123:0/97754492 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa8f0066760 0x7fa8f0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:51.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.934+0000 7fa910d09700 1 --2- 172.21.15.123:0/97754492 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa8f0066760 0x7fa8f0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:51.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.934+0000 7fa901ffb700 1 -- 172.21.15.123:0/97754492 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8fc0834a0 con 0x7fa90c0ad9a0 2024-09-13T17:06:51.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.934+0000 7fa910d09700 1 --2- 172.21.15.123:0/97754492 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa8f0066760 0x7fa8f0068c20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa908001d90 tx=0x7fa908001d20 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:51.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:51.942+0000 7fa901ffb700 1 -- 172.21.15.123:0/97754492 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8fc050790 con 0x7fa90c0ad9a0 2024-09-13T17:06:52.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.114+0000 7fa91376e700 1 -- 172.21.15.123:0/97754492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa90c0ccd10 con 0x7fa90c0ad9a0 2024-09-13T17:06:52.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.118+0000 7fa901ffb700 1 -- 172.21.15.123:0/97754492 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7fa8fc053db0 con 0x7fa90c0ad9a0 2024-09-13T17:06:52.123 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:52.123 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:06:52.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.118+0000 7fa91376e700 1 -- 172.21.15.123:0/97754492 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa8f0066760 msgr2=0x7fa8f0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.118+0000 7fa91376e700 1 --2- 172.21.15.123:0/97754492 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa8f0066760 0x7fa8f0068c20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa908001d90 tx=0x7fa908001d20 comp rx=0 tx=0).stop 2024-09-13T17:06:52.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.118+0000 7fa91376e700 1 -- 172.21.15.123:0/97754492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa90c0ad9a0 msgr2=0x7fa90c146e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.118+0000 7fa91376e700 1 --2- 172.21.15.123:0/97754492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa90c0ad9a0 0x7fa90c146e20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c500 tx=0x7fa8fc00c810 comp rx=0 tx=0).stop 2024-09-13T17:06:52.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.118+0000 7fa91376e700 1 -- 172.21.15.123:0/97754492 shutdown_connections 2024-09-13T17:06:52.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.118+0000 7fa91376e700 1 --2- 172.21.15.123:0/97754492 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa8f0066760 0x7fa8f0068c20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.118+0000 7fa91376e700 1 --2- 172.21.15.123:0/97754492 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa90c0cec90 0x7fa90c0b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.118+0000 7fa91376e700 1 --2- 172.21.15.123:0/97754492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa90c0adef0 0x7fa90c0b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.118+0000 7fa91376e700 1 --2- 172.21.15.123:0/97754492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa90c0ad9a0 0x7fa90c146e20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.118+0000 7fa91376e700 1 -- 172.21.15.123:0/97754492 >> 172.21.15.123:0/97754492 conn(0x7fa90c066570 msgr2=0x7fa90c0cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:52.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.118+0000 7fa91376e700 1 -- 172.21.15.123:0/97754492 shutdown_connections 2024-09-13T17:06:52.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.118+0000 7fa91376e700 1 -- 172.21.15.123:0/97754492 wait complete. 2024-09-13T17:06:52.138 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:06:52.139 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:06:52.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 Processor -- start 2024-09-13T17:06:52.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 -- start start 2024-09-13T17:06:52.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe764160e30 0x7fe7640b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7640b41e0 0x7fe764071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7640b17d0 0x7fe764071770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7640b1fa0 con 0x7fe7640b17d0 2024-09-13T17:06:52.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76406dfc0 con 0x7fe764160e30 2024-09-13T17:06:52.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76406e2a0 con 0x7fe7640b41e0 2024-09-13T17:06:52.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe763fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7640b17d0 0x7fe764071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe763fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7640b17d0 0x7fe764071770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46198/0 (socket says 172.21.15.123:46198) 2024-09-13T17:06:52.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe763fff700 1 -- 172.21.15.123:0/3375934440 learned_addr learned my addr 172.21.15.123:0/3375934440 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:52.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe762ffd700 1 --2- 172.21.15.123:0/3375934440 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7640b41e0 0x7fe764071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe7637fe700 1 --2- 172.21.15.123:0/3375934440 >> v2:172.21.15.153:3300/0 conn(0x7fe764160e30 0x7fe7640b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe763fff700 1 -- 172.21.15.123:0/3375934440 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7640b41e0 msgr2=0x7fe764071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:52.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe763fff700 1 --2- 172.21.15.123:0/3375934440 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7640b41e0 0x7fe764071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe763fff700 1 -- 172.21.15.123:0/3375934440 >> v2:172.21.15.153:3300/0 conn(0x7fe764160e30 msgr2=0x7fe7640b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:52.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe763fff700 1 --2- 172.21.15.123:0/3375934440 >> v2:172.21.15.153:3300/0 conn(0x7fe764160e30 0x7fe7640b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe763fff700 1 -- 172.21.15.123:0/3375934440 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76406e580 con 0x7fe7640b17d0 2024-09-13T17:06:52.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe763fff700 1 --2- 172.21.15.123:0/3375934440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b17d0 0x7fe764071770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe764071e60 tx=0x7fe754009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213532b8d255b831 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:52.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe7627fc700 1 -- 172.21.15.123:0/3375934440 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75400b8a0 con 0x7fe7640b17d0 2024-09-13T17:06:52.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe7627fc700 1 -- 172.21.15.123:0/3375934440 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75400ba00 con 0x7fe7640b17d0 2024-09-13T17:06:52.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe7627fc700 1 -- 172.21.15.123:0/3375934440 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75400bd90 con 0x7fe7640b17d0 2024-09-13T17:06:52.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 -- 172.21.15.123:0/3375934440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b17d0 msgr2=0x7fe764071770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 --2- 172.21.15.123:0/3375934440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b17d0 0x7fe764071770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe764071e60 tx=0x7fe754009bf0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 -- 172.21.15.123:0/3375934440 shutdown_connections 2024-09-13T17:06:52.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 --2- 172.21.15.123:0/3375934440 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7640b41e0 0x7fe764071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 --2- 172.21.15.123:0/3375934440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b17d0 0x7fe764071770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 --2- 172.21.15.123:0/3375934440 >> v2:172.21.15.153:3300/0 conn(0x7fe764160e30 0x7fe7640b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 -- 172.21.15.123:0/3375934440 >> 172.21.15.123:0/3375934440 conn(0x7fe76406f460 msgr2=0x7fe76406f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:52.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 -- 172.21.15.123:0/3375934440 shutdown_connections 2024-09-13T17:06:52.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.246+0000 7fe768c4d700 1 -- 172.21.15.123:0/3375934440 wait complete. 2024-09-13T17:06:52.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe768c4d700 1 Processor -- start 2024-09-13T17:06:52.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe768c4d700 1 -- start start 2024-09-13T17:06:52.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe768c4d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b17d0 0x7fe7641fad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe768c4d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7640b41e0 0x7fe76414c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe768c4d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe764160e30 0x7fe7640711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe768c4d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641fb2b0 con 0x7fe7640b17d0 2024-09-13T17:06:52.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe768c4d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76414d090 con 0x7fe7640b41e0 2024-09-13T17:06:52.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe768c4d700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76414d370 con 0x7fe764160e30 2024-09-13T17:06:52.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe7637fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b17d0 0x7fe7641fad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe7637fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b17d0 0x7fe7641fad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46214/0 (socket says 172.21.15.123:46214) 2024-09-13T17:06:52.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe7637fe700 1 -- 172.21.15.123:0/479077364 learned_addr learned my addr 172.21.15.123:0/479077364 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:52.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe762ffd700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7640b41e0 0x7fe76414c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe763fff700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe764160e30 0x7fe7640711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe7637fe700 1 -- 172.21.15.123:0/479077364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe764160e30 msgr2=0x7fe7640711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe7637fe700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe764160e30 0x7fe7640711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe7637fe700 1 -- 172.21.15.123:0/479077364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7640b41e0 msgr2=0x7fe76414c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe7637fe700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7640b41e0 0x7fe76414c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe7637fe700 1 -- 172.21.15.123:0/479077364 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe754009570 con 0x7fe7640b17d0 2024-09-13T17:06:52.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe763fff700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe764160e30 0x7fe7640711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:52.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe7637fe700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b17d0 0x7fe7641fad70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe75c007e40 tx=0x7fe75c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:52.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe74bfff700 1 -- 172.21.15.123:0/479077364 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c00ede0 con 0x7fe7640b17d0 2024-09-13T17:06:52.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe74bfff700 1 -- 172.21.15.123:0/479077364 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c014420 con 0x7fe7640b17d0 2024-09-13T17:06:52.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe768c4d700 1 -- 172.21.15.123:0/479077364 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7640b2890 con 0x7fe7640b17d0 2024-09-13T17:06:52.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe74bfff700 1 -- 172.21.15.123:0/479077364 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0147d0 con 0x7fe7640b17d0 2024-09-13T17:06:52.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.250+0000 7fe768c4d700 1 -- 172.21.15.123:0/479077364 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76414d930 con 0x7fe7640b17d0 2024-09-13T17:06:52.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.254+0000 7fe768c4d700 1 -- 172.21.15.123:0/479077364 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7640cfd00 con 0x7fe7640b17d0 2024-09-13T17:06:52.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.254+0000 7fe74bfff700 1 -- 172.21.15.123:0/479077364 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe75c014930 con 0x7fe7640b17d0 2024-09-13T17:06:52.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.254+0000 7fe74bfff700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe750066730 0x7fe750068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.254+0000 7fe74bfff700 1 -- 172.21.15.123:0/479077364 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe75c085670 con 0x7fe7640b17d0 2024-09-13T17:06:52.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.254+0000 7fe762ffd700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe750066730 0x7fe750068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.254+0000 7fe762ffd700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe750066730 0x7fe750068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe7641591c0 tx=0x7fe758008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:52.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.262+0000 7fe74bfff700 1 -- 172.21.15.123:0/479077364 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe75c052a50 con 0x7fe7640b17d0 2024-09-13T17:06:52.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.426+0000 7fe768c4d700 1 -- 172.21.15.123:0/479077364 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7640b1540 con 0x7fe750066730 2024-09-13T17:06:52.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.438+0000 7fe74bfff700 1 -- 172.21.15.123:0/479077364 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249760 (secure 0 0 0) 0x7fe7640b1540 con 0x7fe750066730 2024-09-13T17:06:52.449 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:52.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.446+0000 7fe768c4d700 1 -- 172.21.15.123:0/479077364 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe750066730 msgr2=0x7fe750068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.446+0000 7fe768c4d700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe750066730 0x7fe750068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe7641591c0 tx=0x7fe758008040 comp rx=0 tx=0).stop 2024-09-13T17:06:52.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.446+0000 7fe768c4d700 1 -- 172.21.15.123:0/479077364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b17d0 msgr2=0x7fe7641fad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.446+0000 7fe768c4d700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b17d0 0x7fe7641fad70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe75c007e40 tx=0x7fe75c00e3c0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.446+0000 7fe768c4d700 1 -- 172.21.15.123:0/479077364 shutdown_connections 2024-09-13T17:06:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.446+0000 7fe768c4d700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe750066730 0x7fe750068bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.446+0000 7fe768c4d700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe764160e30 0x7fe7640711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.446+0000 7fe768c4d700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7640b41e0 0x7fe76414c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.446+0000 7fe768c4d700 1 --2- 172.21.15.123:0/479077364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b17d0 0x7fe7641fad70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.446+0000 7fe768c4d700 1 -- 172.21.15.123:0/479077364 >> 172.21.15.123:0/479077364 conn(0x7fe76406f460 msgr2=0x7fe76415d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.446+0000 7fe768c4d700 1 -- 172.21.15.123:0/479077364 shutdown_connections 2024-09-13T17:06:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.446+0000 7fe768c4d700 1 -- 172.21.15.123:0/479077364 wait complete. 2024-09-13T17:06:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:06:52.464 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T17:06:50.736893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218668,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756052,"statfs":{"total":773094113280,"available":772870197248,"internally_reserved":0,"allocated":2433024,"data_stored":1546584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001043"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T17:06:40.617841+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:06:40.617841+0000","last_peered":"2024-09-13T17:06:40.617841+0000","last_clean":"2024-09-13T17:06:40.617841+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:06:40.617841+0000","last_undegraded":"2024-09-13T17:06:40.617841+0000","last_fullsized":"2024-09-13T17:06:40.617841+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:48.044666+0000","last_change":"2024-09-13T17:06:48.044666+0000","last_active":"2024-09-13T17:06:48.044666+0000","last_peered":"2024-09-13T17:06:48.044666+0000","last_clean":"2024-09-13T17:06:48.044666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:48.044666+0000","last_undegraded":"2024-09-13T17:06:48.044666+0000","last_fullsized":"2024-09-13T17:06:48.044666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:06:47.035728+0000","last_change":"2024-09-13T17:06:47.035728+0000","last_active":"2024-09-13T17:06:47.035728+0000","last_peered":"2024-09-13T17:06:47.035728+0000","last_clean":"2024-09-13T17:06:47.035728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:06:47.035728+0000","last_undegraded":"2024-09-13T17:06:47.035728+0000","last_fullsized":"2024-09-13T17:06:47.035728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:06:52.468 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:06:52.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.574+0000 7ff5718df700 1 Processor -- start 2024-09-13T17:06:52.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.574+0000 7ff5718df700 1 -- start start 2024-09-13T17:06:52.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5718df700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff56c0ceda0 0x7ff56c071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5718df700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff56c0cce80 0x7ff56c070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5718df700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c15bd10 con 0x7ff56c15a9d0 2024-09-13T17:06:52.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5718df700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c070a80 con 0x7ff56c0cce80 2024-09-13T17:06:52.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5718df700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0cd2f0 con 0x7ff56c0ceda0 2024-09-13T17:06:52.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5710de700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff56c0cce80 0x7ff56c070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5710de700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff56c0cce80 0x7ff56c070540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46220/0 (socket says 172.21.15.123:46220) 2024-09-13T17:06:52.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5710de700 1 -- 172.21.15.123:0/3149028768 learned_addr learned my addr 172.21.15.123:0/3149028768 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:52.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff56bfff700 1 --2- 172.21.15.123:0/3149028768 >> v2:172.21.15.153:3300/0 conn(0x7ff56c0ceda0 0x7ff56c071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5710de700 1 -- 172.21.15.123:0/3149028768 >> v2:172.21.15.153:3300/0 conn(0x7ff56c0ceda0 msgr2=0x7ff56c071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:52.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5710de700 1 --2- 172.21.15.123:0/3149028768 >> v2:172.21.15.153:3300/0 conn(0x7ff56c0ceda0 0x7ff56c071760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5710de700 1 -- 172.21.15.123:0/3149028768 >> v1:172.21.15.153:6789/0 conn(0x7ff56c15a9d0 legacy=0x7ff56c0ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5710de700 1 -- 172.21.15.123:0/3149028768 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c15b100 con 0x7ff56c0cce80 2024-09-13T17:06:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5710de700 1 --2- 172.21.15.123:0/3149028768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff56c0cce80 0x7ff56c070540 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0caa40 tx=0x7ff564009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a93d1f4d32c7354 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff56b7fe700 1 -- 172.21.15.123:0/3149028768 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564011830 con 0x7ff56c0cce80 2024-09-13T17:06:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff56b7fe700 1 -- 172.21.15.123:0/3149028768 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff564011990 con 0x7ff56c0cce80 2024-09-13T17:06:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff56b7fe700 1 -- 172.21.15.123:0/3149028768 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564011d20 con 0x7ff56c0cce80 2024-09-13T17:06:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5718df700 1 -- 172.21.15.123:0/3149028768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff56c0cce80 msgr2=0x7ff56c070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5718df700 1 --2- 172.21.15.123:0/3149028768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff56c0cce80 0x7ff56c070540 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0caa40 tx=0x7ff564009bf0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5718df700 1 -- 172.21.15.123:0/3149028768 shutdown_connections 2024-09-13T17:06:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5718df700 1 --2- 172.21.15.123:0/3149028768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff56c0cce80 0x7ff56c070540 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5718df700 1 --2- 172.21.15.123:0/3149028768 >> v2:172.21.15.153:3300/0 conn(0x7ff56c0ceda0 0x7ff56c071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5718df700 1 -- 172.21.15.123:0/3149028768 >> 172.21.15.123:0/3149028768 conn(0x7ff56c066150 msgr2=0x7ff56c066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:52.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5718df700 1 -- 172.21.15.123:0/3149028768 shutdown_connections 2024-09-13T17:06:52.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.578+0000 7ff5718df700 1 -- 172.21.15.123:0/3149028768 wait complete. 2024-09-13T17:06:52.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5718df700 1 Processor -- start 2024-09-13T17:06:52.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5718df700 1 -- start start 2024-09-13T17:06:52.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5718df700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff56c0cce80 0x7ff56c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5718df700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff56c0ceda0 0x7ff56c147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5718df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff56c15a9d0 0x7ff56c14ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5718df700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c150d70 con 0x7ff56c15a9d0 2024-09-13T17:06:52.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5718df700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c147890 con 0x7ff56c0ceda0 2024-09-13T17:06:52.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5718df700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c153550 con 0x7ff56c0cce80 2024-09-13T17:06:52.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5710de700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff56c15a9d0 0x7ff56c14ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5710de700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff56c15a9d0 0x7ff56c14ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46230/0 (socket says 172.21.15.123:46230) 2024-09-13T17:06:52.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5710de700 1 -- 172.21.15.123:0/2722137454 learned_addr learned my addr 172.21.15.123:0/2722137454 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:52.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff56bfff700 1 --2- 172.21.15.123:0/2722137454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff56c0ceda0 0x7ff56c147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5708dd700 1 --2- 172.21.15.123:0/2722137454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff56c0cce80 0x7ff56c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5710de700 1 -- 172.21.15.123:0/2722137454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff56c0cce80 msgr2=0x7ff56c152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5710de700 1 --2- 172.21.15.123:0/2722137454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff56c0cce80 0x7ff56c152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5710de700 1 -- 172.21.15.123:0/2722137454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff56c0ceda0 msgr2=0x7ff56c147350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5710de700 1 --2- 172.21.15.123:0/2722137454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff56c0ceda0 0x7ff56c147350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5710de700 1 -- 172.21.15.123:0/2722137454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564009570 con 0x7ff56c15a9d0 2024-09-13T17:06:52.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5710de700 1 --2- 172.21.15.123:0/2722137454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff56c15a9d0 0x7ff56c14ffd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff564014040 tx=0x7ff564004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:52.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5697fa700 1 -- 172.21.15.123:0/2722137454 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564004550 con 0x7ff56c15a9d0 2024-09-13T17:06:52.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5697fa700 1 -- 172.21.15.123:0/2722137454 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56401e070 con 0x7ff56c15a9d0 2024-09-13T17:06:52.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5718df700 1 -- 172.21.15.123:0/2722137454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c150510 con 0x7ff56c15a9d0 2024-09-13T17:06:52.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5697fa700 1 -- 172.21.15.123:0/2722137454 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564003900 con 0x7ff56c15a9d0 2024-09-13T17:06:52.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.582+0000 7ff5718df700 1 -- 172.21.15.123:0/2722137454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c150a90 con 0x7ff56c15a9d0 2024-09-13T17:06:52.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.586+0000 7ff5697fa700 1 -- 172.21.15.123:0/2722137454 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff564003a60 con 0x7ff56c15a9d0 2024-09-13T17:06:52.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.586+0000 7ff5718df700 1 -- 172.21.15.123:0/2722137454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c0677f0 con 0x7ff56c15a9d0 2024-09-13T17:06:52.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.586+0000 7ff5697fa700 1 --2- 172.21.15.123:0/2722137454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff54c0667b0 0x7ff54c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.586+0000 7ff5697fa700 1 -- 172.21.15.123:0/2722137454 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff564085150 con 0x7ff56c15a9d0 2024-09-13T17:06:52.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.586+0000 7ff5708dd700 1 --2- 172.21.15.123:0/2722137454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff54c0667b0 0x7ff54c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.586+0000 7ff5708dd700 1 --2- 172.21.15.123:0/2722137454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff54c0667b0 0x7ff54c068c70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff55c000f60 tx=0x7ff55c009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:52.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.594+0000 7ff5697fa700 1 -- 172.21.15.123:0/2722137454 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5640526c0 con 0x7ff56c15a9d0 2024-09-13T17:06:52.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.758+0000 7ff5718df700 1 -- 172.21.15.123:0/2722137454 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff56c15b9a0 con 0x7ff54c0667b0 2024-09-13T17:06:52.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.774+0000 7ff5697fa700 1 -- 172.21.15.123:0/2722137454 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264525 (secure 0 0 0) 0x7ff55c0050d0 con 0x7ff54c0667b0 2024-09-13T17:06:52.783 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.782+0000 7ff5718df700 1 -- 172.21.15.123:0/2722137454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff54c0667b0 msgr2=0x7ff54c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.782+0000 7ff5718df700 1 --2- 172.21.15.123:0/2722137454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff54c0667b0 0x7ff54c068c70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff55c000f60 tx=0x7ff55c009040 comp rx=0 tx=0).stop 2024-09-13T17:06:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.782+0000 7ff5718df700 1 -- 172.21.15.123:0/2722137454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff56c15a9d0 msgr2=0x7ff56c14ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.782+0000 7ff5718df700 1 --2- 172.21.15.123:0/2722137454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff56c15a9d0 0x7ff56c14ffd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff564014040 tx=0x7ff564004770 comp rx=0 tx=0).stop 2024-09-13T17:06:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.782+0000 7ff5718df700 1 -- 172.21.15.123:0/2722137454 shutdown_connections 2024-09-13T17:06:52.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.782+0000 7ff5718df700 1 --2- 172.21.15.123:0/2722137454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff54c0667b0 0x7ff54c068c70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.782+0000 7ff5718df700 1 --2- 172.21.15.123:0/2722137454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff56c15a9d0 0x7ff56c14ffd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.782+0000 7ff5718df700 1 --2- 172.21.15.123:0/2722137454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff56c0ceda0 0x7ff56c147350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.782+0000 7ff5718df700 1 --2- 172.21.15.123:0/2722137454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff56c0cce80 0x7ff56c152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.782+0000 7ff5718df700 1 -- 172.21.15.123:0/2722137454 >> 172.21.15.123:0/2722137454 conn(0x7ff56c066150 msgr2=0x7ff56c06c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:52.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.782+0000 7ff5718df700 1 -- 172.21.15.123:0/2722137454 shutdown_connections 2024-09-13T17:06:52.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.782+0000 7ff5718df700 1 -- 172.21.15.123:0/2722137454 wait complete. 2024-09-13T17:06:52.787 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:06:52.802 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-13T17:06:52.737475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218996,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755724,"statfs":{"total":773094113280,"available":772869861376,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.689669"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436070+0000","last_change":"2024-09-13T17:06:48.461079+0000","last_active":"2024-09-13T17:06:49.436070+0000","last_peered":"2024-09-13T17:06:49.436070+0000","last_clean":"2024-09-13T17:06:49.436070+0000","last_became_active":"2024-09-13T17:06:48.460855+0000","last_became_peered":"2024-09-13T17:06:48.460855+0000","last_unstale":"2024-09-13T17:06:49.436070+0000","last_undegraded":"2024-09-13T17:06:49.436070+0000","last_fullsized":"2024-09-13T17:06:49.436070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:13.871898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436467+0000","last_change":"2024-09-13T17:06:48.450997+0000","last_active":"2024-09-13T17:06:49.436467+0000","last_peered":"2024-09-13T17:06:49.436467+0000","last_clean":"2024-09-13T17:06:49.436467+0000","last_became_active":"2024-09-13T17:06:48.450751+0000","last_became_peered":"2024-09-13T17:06:48.450751+0000","last_unstale":"2024-09-13T17:06:49.436467+0000","last_undegraded":"2024-09-13T17:06:49.436467+0000","last_fullsized":"2024-09-13T17:06:49.436467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:29.305952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407157+0000","last_change":"2024-09-13T17:06:48.438677+0000","last_active":"2024-09-13T17:06:50.407157+0000","last_peered":"2024-09-13T17:06:50.407157+0000","last_clean":"2024-09-13T17:06:50.407157+0000","last_became_active":"2024-09-13T17:06:48.438399+0000","last_became_peered":"2024-09-13T17:06:48.438399+0000","last_unstale":"2024-09-13T17:06:50.407157+0000","last_undegraded":"2024-09-13T17:06:50.407157+0000","last_fullsized":"2024-09-13T17:06:50.407157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:02.762902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407961+0000","last_change":"2024-09-13T17:06:48.456834+0000","last_active":"2024-09-13T17:06:50.407961+0000","last_peered":"2024-09-13T17:06:50.407961+0000","last_clean":"2024-09-13T17:06:50.407961+0000","last_became_active":"2024-09-13T17:06:48.452727+0000","last_became_peered":"2024-09-13T17:06:48.452727+0000","last_unstale":"2024-09-13T17:06:50.407961+0000","last_undegraded":"2024-09-13T17:06:50.407961+0000","last_fullsized":"2024-09-13T17:06:50.407961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:13.649151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435305+0000","last_change":"2024-09-13T17:06:48.451267+0000","last_active":"2024-09-13T17:06:49.435305+0000","last_peered":"2024-09-13T17:06:49.435305+0000","last_clean":"2024-09-13T17:06:49.435305+0000","last_became_active":"2024-09-13T17:06:48.450870+0000","last_became_peered":"2024-09-13T17:06:48.450870+0000","last_unstale":"2024-09-13T17:06:49.435305+0000","last_undegraded":"2024-09-13T17:06:49.435305+0000","last_fullsized":"2024-09-13T17:06:49.435305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:15.339790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408989+0000","last_change":"2024-09-13T17:06:48.450864+0000","last_active":"2024-09-13T17:06:50.408989+0000","last_peered":"2024-09-13T17:06:50.408989+0000","last_clean":"2024-09-13T17:06:50.408989+0000","last_became_active":"2024-09-13T17:06:48.450278+0000","last_became_peered":"2024-09-13T17:06:48.450278+0000","last_unstale":"2024-09-13T17:06:50.408989+0000","last_undegraded":"2024-09-13T17:06:50.408989+0000","last_fullsized":"2024-09-13T17:06:50.408989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:13.871898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435044+0000","last_change":"2024-09-13T17:06:48.439223+0000","last_active":"2024-09-13T17:06:49.435044+0000","last_peered":"2024-09-13T17:06:49.435044+0000","last_clean":"2024-09-13T17:06:49.435044+0000","last_became_active":"2024-09-13T17:06:48.438699+0000","last_became_peered":"2024-09-13T17:06:48.438699+0000","last_unstale":"2024-09-13T17:06:49.435044+0000","last_undegraded":"2024-09-13T17:06:49.435044+0000","last_fullsized":"2024-09-13T17:06:49.435044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:43.812384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434226+0000","last_change":"2024-09-13T17:06:48.451536+0000","last_active":"2024-09-13T17:06:49.434226+0000","last_peered":"2024-09-13T17:06:49.434226+0000","last_clean":"2024-09-13T17:06:49.434226+0000","last_became_active":"2024-09-13T17:06:48.451128+0000","last_became_peered":"2024-09-13T17:06:48.451128+0000","last_unstale":"2024-09-13T17:06:49.434226+0000","last_undegraded":"2024-09-13T17:06:49.434226+0000","last_fullsized":"2024-09-13T17:06:49.434226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:58.103402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436150+0000","last_change":"2024-09-13T17:06:48.450886+0000","last_active":"2024-09-13T17:06:49.436150+0000","last_peered":"2024-09-13T17:06:49.436150+0000","last_clean":"2024-09-13T17:06:49.436150+0000","last_became_active":"2024-09-13T17:06:48.450641+0000","last_became_peered":"2024-09-13T17:06:48.450641+0000","last_unstale":"2024-09-13T17:06:49.436150+0000","last_undegraded":"2024-09-13T17:06:49.436150+0000","last_fullsized":"2024-09-13T17:06:49.436150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:57.203854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.411078+0000","last_change":"2024-09-13T17:06:48.463023+0000","last_active":"2024-09-13T17:06:50.411078+0000","last_peered":"2024-09-13T17:06:50.411078+0000","last_clean":"2024-09-13T17:06:50.411078+0000","last_became_active":"2024-09-13T17:06:48.462496+0000","last_became_peered":"2024-09-13T17:06:48.462496+0000","last_unstale":"2024-09-13T17:06:50.411078+0000","last_undegraded":"2024-09-13T17:06:50.411078+0000","last_fullsized":"2024-09-13T17:06:50.411078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:59.415579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410541+0000","last_change":"2024-09-13T17:06:48.460040+0000","last_active":"2024-09-13T17:06:50.410541+0000","last_peered":"2024-09-13T17:06:50.410541+0000","last_clean":"2024-09-13T17:06:50.410541+0000","last_became_active":"2024-09-13T17:06:48.459768+0000","last_became_peered":"2024-09-13T17:06:48.459768+0000","last_unstale":"2024-09-13T17:06:50.410541+0000","last_undegraded":"2024-09-13T17:06:50.410541+0000","last_fullsized":"2024-09-13T17:06:50.410541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:36.046829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410162+0000","last_change":"2024-09-13T17:06:48.464562+0000","last_active":"2024-09-13T17:06:50.410162+0000","last_peered":"2024-09-13T17:06:50.410162+0000","last_clean":"2024-09-13T17:06:50.410162+0000","last_became_active":"2024-09-13T17:06:48.464356+0000","last_became_peered":"2024-09-13T17:06:48.464356+0000","last_unstale":"2024-09-13T17:06:50.410162+0000","last_undegraded":"2024-09-13T17:06:50.410162+0000","last_fullsized":"2024-09-13T17:06:50.410162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:41.591896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434879+0000","last_change":"2024-09-13T17:06:48.447746+0000","last_active":"2024-09-13T17:06:49.434879+0000","last_peered":"2024-09-13T17:06:49.434879+0000","last_clean":"2024-09-13T17:06:49.434879+0000","last_became_active":"2024-09-13T17:06:48.447441+0000","last_became_peered":"2024-09-13T17:06:48.447441+0000","last_unstale":"2024-09-13T17:06:49.434879+0000","last_undegraded":"2024-09-13T17:06:49.434879+0000","last_fullsized":"2024-09-13T17:06:49.434879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:15.339790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.406714+0000","last_change":"2024-09-13T17:06:48.452709+0000","last_active":"2024-09-13T17:06:50.406714+0000","last_peered":"2024-09-13T17:06:50.406714+0000","last_clean":"2024-09-13T17:06:50.406714+0000","last_became_active":"2024-09-13T17:06:48.452174+0000","last_became_peered":"2024-09-13T17:06:48.452174+0000","last_unstale":"2024-09-13T17:06:50.406714+0000","last_undegraded":"2024-09-13T17:06:50.406714+0000","last_fullsized":"2024-09-13T17:06:50.406714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:05.801080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436098+0000","last_change":"2024-09-13T17:06:48.454013+0000","last_active":"2024-09-13T17:06:49.436098+0000","last_peered":"2024-09-13T17:06:49.436098+0000","last_clean":"2024-09-13T17:06:49.436098+0000","last_became_active":"2024-09-13T17:06:48.453811+0000","last_became_peered":"2024-09-13T17:06:48.453811+0000","last_unstale":"2024-09-13T17:06:49.436098+0000","last_undegraded":"2024-09-13T17:06:49.436098+0000","last_fullsized":"2024-09-13T17:06:49.436098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:58.103402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407668+0000","last_change":"2024-09-13T17:06:48.456811+0000","last_active":"2024-09-13T17:06:50.407668+0000","last_peered":"2024-09-13T17:06:50.407668+0000","last_clean":"2024-09-13T17:06:50.407668+0000","last_became_active":"2024-09-13T17:06:48.454867+0000","last_became_peered":"2024-09-13T17:06:48.454867+0000","last_unstale":"2024-09-13T17:06:50.407668+0000","last_undegraded":"2024-09-13T17:06:50.407668+0000","last_fullsized":"2024-09-13T17:06:50.407668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:03.550409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408759+0000","last_change":"2024-09-13T17:06:48.457471+0000","last_active":"2024-09-13T17:06:50.408759+0000","last_peered":"2024-09-13T17:06:50.408759+0000","last_clean":"2024-09-13T17:06:50.408759+0000","last_became_active":"2024-09-13T17:06:48.457196+0000","last_became_peered":"2024-09-13T17:06:48.457196+0000","last_unstale":"2024-09-13T17:06:50.408759+0000","last_undegraded":"2024-09-13T17:06:50.408759+0000","last_fullsized":"2024-09-13T17:06:50.408759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:43.812384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.772355+0000","last_change":"2024-09-13T17:06:48.450031+0000","last_active":"2024-09-13T17:06:49.772355+0000","last_peered":"2024-09-13T17:06:49.772355+0000","last_clean":"2024-09-13T17:06:49.772355+0000","last_became_active":"2024-09-13T17:06:48.449823+0000","last_became_peered":"2024-09-13T17:06:48.449823+0000","last_unstale":"2024-09-13T17:06:49.772355+0000","last_undegraded":"2024-09-13T17:06:49.772355+0000","last_fullsized":"2024-09-13T17:06:49.772355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:29.778842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435878+0000","last_change":"2024-09-13T17:06:48.450057+0000","last_active":"2024-09-13T17:06:49.435878+0000","last_peered":"2024-09-13T17:06:49.435878+0000","last_clean":"2024-09-13T17:06:49.435878+0000","last_became_active":"2024-09-13T17:06:48.449798+0000","last_became_peered":"2024-09-13T17:06:48.449798+0000","last_unstale":"2024-09-13T17:06:49.435878+0000","last_undegraded":"2024-09-13T17:06:49.435878+0000","last_fullsized":"2024-09-13T17:06:49.435878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:59.415579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410060+0000","last_change":"2024-09-13T17:06:48.462782+0000","last_active":"2024-09-13T17:06:50.410060+0000","last_peered":"2024-09-13T17:06:50.410060+0000","last_clean":"2024-09-13T17:06:50.410060+0000","last_became_active":"2024-09-13T17:06:48.462113+0000","last_became_peered":"2024-09-13T17:06:48.462113+0000","last_unstale":"2024-09-13T17:06:50.410060+0000","last_undegraded":"2024-09-13T17:06:50.410060+0000","last_fullsized":"2024-09-13T17:06:50.410060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:46.353437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407153+0000","last_change":"2024-09-13T17:06:48.437728+0000","last_active":"2024-09-13T17:06:50.407153+0000","last_peered":"2024-09-13T17:06:50.407153+0000","last_clean":"2024-09-13T17:06:50.407153+0000","last_became_active":"2024-09-13T17:06:48.437291+0000","last_became_peered":"2024-09-13T17:06:48.437291+0000","last_unstale":"2024-09-13T17:06:50.407153+0000","last_undegraded":"2024-09-13T17:06:50.407153+0000","last_fullsized":"2024-09-13T17:06:50.407153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:46.353437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409183+0000","last_change":"2024-09-13T17:06:48.457755+0000","last_active":"2024-09-13T17:06:50.409183+0000","last_peered":"2024-09-13T17:06:50.409183+0000","last_clean":"2024-09-13T17:06:50.409183+0000","last_became_active":"2024-09-13T17:06:48.457460+0000","last_became_peered":"2024-09-13T17:06:48.457460+0000","last_unstale":"2024-09-13T17:06:50.409183+0000","last_undegraded":"2024-09-13T17:06:50.409183+0000","last_fullsized":"2024-09-13T17:06:50.409183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:57.203854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434366+0000","last_change":"2024-09-13T17:06:48.450031+0000","last_active":"2024-09-13T17:06:49.434366+0000","last_peered":"2024-09-13T17:06:49.434366+0000","last_clean":"2024-09-13T17:06:49.434366+0000","last_became_active":"2024-09-13T17:06:48.449802+0000","last_became_peered":"2024-09-13T17:06:48.449802+0000","last_unstale":"2024-09-13T17:06:49.434366+0000","last_undegraded":"2024-09-13T17:06:49.434366+0000","last_fullsized":"2024-09-13T17:06:49.434366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:46.353437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407946+0000","last_change":"2024-09-13T17:06:48.453317+0000","last_active":"2024-09-13T17:06:50.407946+0000","last_peered":"2024-09-13T17:06:50.407946+0000","last_clean":"2024-09-13T17:06:50.407946+0000","last_became_active":"2024-09-13T17:06:48.453009+0000","last_became_peered":"2024-09-13T17:06:48.453009+0000","last_unstale":"2024-09-13T17:06:50.407946+0000","last_undegraded":"2024-09-13T17:06:50.407946+0000","last_fullsized":"2024-09-13T17:06:50.407946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:59.415579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435883+0000","last_change":"2024-09-13T17:06:48.452096+0000","last_active":"2024-09-13T17:06:49.435883+0000","last_peered":"2024-09-13T17:06:49.435883+0000","last_clean":"2024-09-13T17:06:49.435883+0000","last_became_active":"2024-09-13T17:06:48.451615+0000","last_became_peered":"2024-09-13T17:06:48.451615+0000","last_unstale":"2024-09-13T17:06:49.435883+0000","last_undegraded":"2024-09-13T17:06:49.435883+0000","last_fullsized":"2024-09-13T17:06:49.435883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:14.109764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.411093+0000","last_change":"2024-09-13T17:06:48.462465+0000","last_active":"2024-09-13T17:06:50.411093+0000","last_peered":"2024-09-13T17:06:50.411093+0000","last_clean":"2024-09-13T17:06:50.411093+0000","last_became_active":"2024-09-13T17:06:48.460284+0000","last_became_peered":"2024-09-13T17:06:48.460284+0000","last_unstale":"2024-09-13T17:06:50.411093+0000","last_undegraded":"2024-09-13T17:06:50.411093+0000","last_fullsized":"2024-09-13T17:06:50.411093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:29.305952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436111+0000","last_change":"2024-09-13T17:06:48.450822+0000","last_active":"2024-09-13T17:06:49.436111+0000","last_peered":"2024-09-13T17:06:49.436111+0000","last_clean":"2024-09-13T17:06:49.436111+0000","last_became_active":"2024-09-13T17:06:48.450622+0000","last_became_peered":"2024-09-13T17:06:48.450622+0000","last_unstale":"2024-09-13T17:06:49.436111+0000","last_undegraded":"2024-09-13T17:06:49.436111+0000","last_fullsized":"2024-09-13T17:06:49.436111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435319+0000","last_change":"2024-09-13T17:06:48.454287+0000","last_active":"2024-09-13T17:06:49.435319+0000","last_peered":"2024-09-13T17:06:49.435319+0000","last_clean":"2024-09-13T17:06:49.435319+0000","last_became_active":"2024-09-13T17:06:48.454110+0000","last_became_peered":"2024-09-13T17:06:48.454110+0000","last_unstale":"2024-09-13T17:06:49.435319+0000","last_undegraded":"2024-09-13T17:06:49.435319+0000","last_fullsized":"2024-09-13T17:06:49.435319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:29.305952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407227+0000","last_change":"2024-09-13T17:06:48.438672+0000","last_active":"2024-09-13T17:06:50.407227+0000","last_peered":"2024-09-13T17:06:50.407227+0000","last_clean":"2024-09-13T17:06:50.407227+0000","last_became_active":"2024-09-13T17:06:48.438397+0000","last_became_peered":"2024-09-13T17:06:48.438397+0000","last_unstale":"2024-09-13T17:06:50.407227+0000","last_undegraded":"2024-09-13T17:06:50.407227+0000","last_fullsized":"2024-09-13T17:06:50.407227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:36.046829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409404+0000","last_change":"2024-09-13T17:06:48.453529+0000","last_active":"2024-09-13T17:06:50.409404+0000","last_peered":"2024-09-13T17:06:50.409404+0000","last_clean":"2024-09-13T17:06:50.409404+0000","last_became_active":"2024-09-13T17:06:48.450613+0000","last_became_peered":"2024-09-13T17:06:48.450613+0000","last_unstale":"2024-09-13T17:06:50.409404+0000","last_undegraded":"2024-09-13T17:06:50.409404+0000","last_fullsized":"2024-09-13T17:06:50.409404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:11.126023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.771974+0000","last_change":"2024-09-13T17:06:48.447764+0000","last_active":"2024-09-13T17:06:49.771974+0000","last_peered":"2024-09-13T17:06:49.771974+0000","last_clean":"2024-09-13T17:06:49.771974+0000","last_became_active":"2024-09-13T17:06:48.447487+0000","last_became_peered":"2024-09-13T17:06:48.447487+0000","last_unstale":"2024-09-13T17:06:49.771974+0000","last_undegraded":"2024-09-13T17:06:49.771974+0000","last_fullsized":"2024-09-13T17:06:49.771974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:17.894980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.406959+0000","last_change":"2024-09-13T17:06:48.461988+0000","last_active":"2024-09-13T17:06:50.406959+0000","last_peered":"2024-09-13T17:06:50.406959+0000","last_clean":"2024-09-13T17:06:50.406959+0000","last_became_active":"2024-09-13T17:06:48.459269+0000","last_became_peered":"2024-09-13T17:06:48.459269+0000","last_unstale":"2024-09-13T17:06:50.406959+0000","last_undegraded":"2024-09-13T17:06:50.406959+0000","last_fullsized":"2024-09-13T17:06:50.406959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409425+0000","last_change":"2024-09-13T17:06:48.452270+0000","last_active":"2024-09-13T17:06:50.409425+0000","last_peered":"2024-09-13T17:06:50.409425+0000","last_clean":"2024-09-13T17:06:50.409425+0000","last_became_active":"2024-09-13T17:06:48.452009+0000","last_became_peered":"2024-09-13T17:06:48.452009+0000","last_unstale":"2024-09-13T17:06:50.409425+0000","last_undegraded":"2024-09-13T17:06:50.409425+0000","last_fullsized":"2024-09-13T17:06:50.409425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:29.778842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434995+0000","last_change":"2024-09-13T17:06:48.073325+0000","last_active":"2024-09-13T17:06:49.434995+0000","last_peered":"2024-09-13T17:06:49.434995+0000","last_clean":"2024-09-13T17:06:49.434995+0000","last_became_active":"2024-09-13T17:06:48.073071+0000","last_became_peered":"2024-09-13T17:06:48.073071+0000","last_unstale":"2024-09-13T17:06:49.434995+0000","last_undegraded":"2024-09-13T17:06:49.434995+0000","last_fullsized":"2024-09-13T17:06:49.434995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:27.297703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407400+0000","last_change":"2024-09-13T17:06:48.454892+0000","last_active":"2024-09-13T17:06:50.407400+0000","last_peered":"2024-09-13T17:06:50.407400+0000","last_clean":"2024-09-13T17:06:50.407400+0000","last_became_active":"2024-09-13T17:06:48.454422+0000","last_became_peered":"2024-09-13T17:06:48.454422+0000","last_unstale":"2024-09-13T17:06:50.407400+0000","last_undegraded":"2024-09-13T17:06:50.407400+0000","last_fullsized":"2024-09-13T17:06:50.407400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:14.109764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407481+0000","last_change":"2024-09-13T17:06:48.074337+0000","last_active":"2024-09-13T17:06:50.407481+0000","last_peered":"2024-09-13T17:06:50.407481+0000","last_clean":"2024-09-13T17:06:50.407481+0000","last_became_active":"2024-09-13T17:06:48.073999+0000","last_became_peered":"2024-09-13T17:06:48.073999+0000","last_unstale":"2024-09-13T17:06:50.407481+0000","last_undegraded":"2024-09-13T17:06:50.407481+0000","last_fullsized":"2024-09-13T17:06:50.407481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:40.582958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434508+0000","last_change":"2024-09-13T17:06:48.073011+0000","last_active":"2024-09-13T17:06:49.434508+0000","last_peered":"2024-09-13T17:06:49.434508+0000","last_clean":"2024-09-13T17:06:49.434508+0000","last_became_active":"2024-09-13T17:06:48.072498+0000","last_became_peered":"2024-09-13T17:06:48.072498+0000","last_unstale":"2024-09-13T17:06:49.434508+0000","last_undegraded":"2024-09-13T17:06:49.434508+0000","last_fullsized":"2024-09-13T17:06:49.434508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:33.113560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434356+0000","last_change":"2024-09-13T17:06:48.438607+0000","last_active":"2024-09-13T17:06:49.434356+0000","last_peered":"2024-09-13T17:06:49.434356+0000","last_clean":"2024-09-13T17:06:49.434356+0000","last_became_active":"2024-09-13T17:06:48.438316+0000","last_became_peered":"2024-09-13T17:06:48.438316+0000","last_unstale":"2024-09-13T17:06:49.434356+0000","last_undegraded":"2024-09-13T17:06:49.434356+0000","last_fullsized":"2024-09-13T17:06:49.434356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:36.046829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408018+0000","last_change":"2024-09-13T17:06:48.076549+0000","last_active":"2024-09-13T17:06:50.408018+0000","last_peered":"2024-09-13T17:06:50.408018+0000","last_clean":"2024-09-13T17:06:50.408018+0000","last_became_active":"2024-09-13T17:06:48.076266+0000","last_became_peered":"2024-09-13T17:06:48.076266+0000","last_unstale":"2024-09-13T17:06:50.408018+0000","last_undegraded":"2024-09-13T17:06:50.408018+0000","last_fullsized":"2024-09-13T17:06:50.408018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:11.933089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436035+0000","last_change":"2024-09-13T17:06:48.451140+0000","last_active":"2024-09-13T17:06:49.436035+0000","last_peered":"2024-09-13T17:06:49.436035+0000","last_clean":"2024-09-13T17:06:49.436035+0000","last_became_active":"2024-09-13T17:06:48.450731+0000","last_became_peered":"2024-09-13T17:06:48.450731+0000","last_unstale":"2024-09-13T17:06:49.436035+0000","last_undegraded":"2024-09-13T17:06:49.436035+0000","last_fullsized":"2024-09-13T17:06:49.436035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:36.046829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410915+0000","last_change":"2024-09-13T17:06:48.076480+0000","last_active":"2024-09-13T17:06:50.410915+0000","last_peered":"2024-09-13T17:06:50.410915+0000","last_clean":"2024-09-13T17:06:50.410915+0000","last_became_active":"2024-09-13T17:06:48.076222+0000","last_became_peered":"2024-09-13T17:06:48.076222+0000","last_unstale":"2024-09-13T17:06:50.410915+0000","last_undegraded":"2024-09-13T17:06:50.410915+0000","last_fullsized":"2024-09-13T17:06:50.410915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:04.672617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407989+0000","last_change":"2024-09-13T17:06:48.454714+0000","last_active":"2024-09-13T17:06:50.407989+0000","last_peered":"2024-09-13T17:06:50.407989+0000","last_clean":"2024-09-13T17:06:50.407989+0000","last_became_active":"2024-09-13T17:06:48.454417+0000","last_became_peered":"2024-09-13T17:06:48.454417+0000","last_unstale":"2024-09-13T17:06:50.407989+0000","last_undegraded":"2024-09-13T17:06:50.407989+0000","last_fullsized":"2024-09-13T17:06:50.407989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:42.518633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408081+0000","last_change":"2024-09-13T17:06:48.075225+0000","last_active":"2024-09-13T17:06:50.408081+0000","last_peered":"2024-09-13T17:06:50.408081+0000","last_clean":"2024-09-13T17:06:50.408081+0000","last_became_active":"2024-09-13T17:06:48.074905+0000","last_became_peered":"2024-09-13T17:06:48.074905+0000","last_unstale":"2024-09-13T17:06:50.408081+0000","last_undegraded":"2024-09-13T17:06:50.408081+0000","last_fullsized":"2024-09-13T17:06:50.408081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:37.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407168+0000","last_change":"2024-09-13T17:06:48.453541+0000","last_active":"2024-09-13T17:06:50.407168+0000","last_peered":"2024-09-13T17:06:50.407168+0000","last_clean":"2024-09-13T17:06:50.407168+0000","last_became_active":"2024-09-13T17:06:48.452960+0000","last_became_peered":"2024-09-13T17:06:48.452960+0000","last_unstale":"2024-09-13T17:06:50.407168+0000","last_undegraded":"2024-09-13T17:06:50.407168+0000","last_fullsized":"2024-09-13T17:06:50.407168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:58.103402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436341+0000","last_change":"2024-09-13T17:06:48.076701+0000","last_active":"2024-09-13T17:06:49.436341+0000","last_peered":"2024-09-13T17:06:49.436341+0000","last_clean":"2024-09-13T17:06:49.436341+0000","last_became_active":"2024-09-13T17:06:48.076518+0000","last_became_peered":"2024-09-13T17:06:48.076518+0000","last_unstale":"2024-09-13T17:06:49.436341+0000","last_undegraded":"2024-09-13T17:06:49.436341+0000","last_fullsized":"2024-09-13T17:06:49.436341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:40.582958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410188+0000","last_change":"2024-09-13T17:06:48.455163+0000","last_active":"2024-09-13T17:06:50.410188+0000","last_peered":"2024-09-13T17:06:50.410188+0000","last_clean":"2024-09-13T17:06:50.410188+0000","last_became_active":"2024-09-13T17:06:48.454898+0000","last_became_peered":"2024-09-13T17:06:48.454898+0000","last_unstale":"2024-09-13T17:06:50.410188+0000","last_undegraded":"2024-09-13T17:06:50.410188+0000","last_fullsized":"2024-09-13T17:06:50.410188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:05.681555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410479+0000","last_change":"2024-09-13T17:06:48.077791+0000","last_active":"2024-09-13T17:06:50.410479+0000","last_peered":"2024-09-13T17:06:50.410479+0000","last_clean":"2024-09-13T17:06:50.410479+0000","last_became_active":"2024-09-13T17:06:48.077473+0000","last_became_peered":"2024-09-13T17:06:48.077473+0000","last_unstale":"2024-09-13T17:06:50.410479+0000","last_undegraded":"2024-09-13T17:06:50.410479+0000","last_fullsized":"2024-09-13T17:06:50.410479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.901813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435648+0000","last_change":"2024-09-13T17:06:48.444878+0000","last_active":"2024-09-13T17:06:49.435648+0000","last_peered":"2024-09-13T17:06:49.435648+0000","last_clean":"2024-09-13T17:06:49.435648+0000","last_became_active":"2024-09-13T17:06:48.444632+0000","last_became_peered":"2024-09-13T17:06:48.444632+0000","last_unstale":"2024-09-13T17:06:49.435648+0000","last_undegraded":"2024-09-13T17:06:49.435648+0000","last_fullsized":"2024-09-13T17:06:49.435648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:59.371861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407365+0000","last_change":"2024-09-13T17:06:48.073405+0000","last_active":"2024-09-13T17:06:50.407365+0000","last_peered":"2024-09-13T17:06:50.407365+0000","last_clean":"2024-09-13T17:06:50.407365+0000","last_became_active":"2024-09-13T17:06:48.073159+0000","last_became_peered":"2024-09-13T17:06:48.073159+0000","last_unstale":"2024-09-13T17:06:50.407365+0000","last_undegraded":"2024-09-13T17:06:50.407365+0000","last_fullsized":"2024-09-13T17:06:50.407365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:27.297703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.406804+0000","last_change":"2024-09-13T17:06:48.437235+0000","last_active":"2024-09-13T17:06:50.406804+0000","last_peered":"2024-09-13T17:06:50.406804+0000","last_clean":"2024-09-13T17:06:50.406804+0000","last_became_active":"2024-09-13T17:06:48.436958+0000","last_became_peered":"2024-09-13T17:06:48.436958+0000","last_unstale":"2024-09-13T17:06:50.406804+0000","last_undegraded":"2024-09-13T17:06:50.406804+0000","last_fullsized":"2024-09-13T17:06:50.406804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:29.305952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409543+0000","last_change":"2024-09-13T17:06:48.078856+0000","last_active":"2024-09-13T17:06:50.409543+0000","last_peered":"2024-09-13T17:06:50.409543+0000","last_clean":"2024-09-13T17:06:50.409543+0000","last_became_active":"2024-09-13T17:06:48.078488+0000","last_became_peered":"2024-09-13T17:06:48.078488+0000","last_unstale":"2024-09-13T17:06:50.409543+0000","last_undegraded":"2024-09-13T17:06:50.409543+0000","last_fullsized":"2024-09-13T17:06:50.409543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:21.835105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435397+0000","last_change":"2024-09-13T17:06:48.452018+0000","last_active":"2024-09-13T17:06:49.435397+0000","last_peered":"2024-09-13T17:06:49.435397+0000","last_clean":"2024-09-13T17:06:49.435397+0000","last_became_active":"2024-09-13T17:06:48.451696+0000","last_became_peered":"2024-09-13T17:06:48.451696+0000","last_unstale":"2024-09-13T17:06:49.435397+0000","last_undegraded":"2024-09-13T17:06:49.435397+0000","last_fullsized":"2024-09-13T17:06:49.435397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:11.126023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407239+0000","last_change":"2024-09-13T17:06:48.074283+0000","last_active":"2024-09-13T17:06:50.407239+0000","last_peered":"2024-09-13T17:06:50.407239+0000","last_clean":"2024-09-13T17:06:50.407239+0000","last_became_active":"2024-09-13T17:06:48.073951+0000","last_became_peered":"2024-09-13T17:06:48.073951+0000","last_unstale":"2024-09-13T17:06:50.407239+0000","last_undegraded":"2024-09-13T17:06:50.407239+0000","last_fullsized":"2024-09-13T17:06:50.407239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:37.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407064+0000","last_change":"2024-09-13T17:06:48.461926+0000","last_active":"2024-09-13T17:06:50.407064+0000","last_peered":"2024-09-13T17:06:50.407064+0000","last_clean":"2024-09-13T17:06:50.407064+0000","last_became_active":"2024-09-13T17:06:48.459158+0000","last_became_peered":"2024-09-13T17:06:48.459158+0000","last_unstale":"2024-09-13T17:06:50.407064+0000","last_undegraded":"2024-09-13T17:06:50.407064+0000","last_fullsized":"2024-09-13T17:06:50.407064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:14.109764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.771778+0000","last_change":"2024-09-13T17:06:48.068609+0000","last_active":"2024-09-13T17:06:49.771778+0000","last_peered":"2024-09-13T17:06:49.771778+0000","last_clean":"2024-09-13T17:06:49.771778+0000","last_became_active":"2024-09-13T17:06:48.068330+0000","last_became_peered":"2024-09-13T17:06:48.068330+0000","last_unstale":"2024-09-13T17:06:49.771778+0000","last_undegraded":"2024-09-13T17:06:49.771778+0000","last_fullsized":"2024-09-13T17:06:49.771778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:33.113560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435060+0000","last_change":"2024-09-13T17:06:48.449596+0000","last_active":"2024-09-13T17:06:49.435060+0000","last_peered":"2024-09-13T17:06:49.435060+0000","last_clean":"2024-09-13T17:06:49.435060+0000","last_became_active":"2024-09-13T17:06:48.449380+0000","last_became_peered":"2024-09-13T17:06:48.449380+0000","last_unstale":"2024-09-13T17:06:49.435060+0000","last_undegraded":"2024-09-13T17:06:49.435060+0000","last_fullsized":"2024-09-13T17:06:49.435060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:29.632832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410271+0000","last_change":"2024-09-13T17:06:48.068519+0000","last_active":"2024-09-13T17:06:50.410271+0000","last_peered":"2024-09-13T17:06:50.410271+0000","last_clean":"2024-09-13T17:06:50.410271+0000","last_became_active":"2024-09-13T17:06:48.068190+0000","last_became_peered":"2024-09-13T17:06:48.068190+0000","last_unstale":"2024-09-13T17:06:50.410271+0000","last_undegraded":"2024-09-13T17:06:50.410271+0000","last_fullsized":"2024-09-13T17:06:50.410271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:47.258496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435847+0000","last_change":"2024-09-13T17:06:48.451887+0000","last_active":"2024-09-13T17:06:49.435847+0000","last_peered":"2024-09-13T17:06:49.435847+0000","last_clean":"2024-09-13T17:06:49.435847+0000","last_became_active":"2024-09-13T17:06:48.451446+0000","last_became_peered":"2024-09-13T17:06:48.451446+0000","last_unstale":"2024-09-13T17:06:49.435847+0000","last_undegraded":"2024-09-13T17:06:49.435847+0000","last_fullsized":"2024-09-13T17:06:49.435847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:13.649151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.772275+0000","last_change":"2024-09-13T17:06:48.074131+0000","last_active":"2024-09-13T17:06:49.772275+0000","last_peered":"2024-09-13T17:06:49.772275+0000","last_clean":"2024-09-13T17:06:49.772275+0000","last_became_active":"2024-09-13T17:06:48.073870+0000","last_became_peered":"2024-09-13T17:06:48.073870+0000","last_unstale":"2024-09-13T17:06:49.772275+0000","last_undegraded":"2024-09-13T17:06:49.772275+0000","last_fullsized":"2024-09-13T17:06:49.772275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436184+0000","last_change":"2024-09-13T17:06:48.451734+0000","last_active":"2024-09-13T17:06:49.436184+0000","last_peered":"2024-09-13T17:06:49.436184+0000","last_clean":"2024-09-13T17:06:49.436184+0000","last_became_active":"2024-09-13T17:06:48.451416+0000","last_became_peered":"2024-09-13T17:06:48.451416+0000","last_unstale":"2024-09-13T17:06:49.436184+0000","last_undegraded":"2024-09-13T17:06:49.436184+0000","last_fullsized":"2024-09-13T17:06:49.436184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:03.550409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436528+0000","last_change":"2024-09-13T17:06:48.072573+0000","last_active":"2024-09-13T17:06:49.436528+0000","last_peered":"2024-09-13T17:06:49.436528+0000","last_clean":"2024-09-13T17:06:49.436528+0000","last_became_active":"2024-09-13T17:06:48.072293+0000","last_became_peered":"2024-09-13T17:06:48.072293+0000","last_unstale":"2024-09-13T17:06:49.436528+0000","last_undegraded":"2024-09-13T17:06:49.436528+0000","last_fullsized":"2024-09-13T17:06:49.436528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408292+0000","last_change":"2024-09-13T17:06:48.453923+0000","last_active":"2024-09-13T17:06:50.408292+0000","last_peered":"2024-09-13T17:06:50.408292+0000","last_clean":"2024-09-13T17:06:50.408292+0000","last_became_active":"2024-09-13T17:06:48.450683+0000","last_became_peered":"2024-09-13T17:06:48.450683+0000","last_unstale":"2024-09-13T17:06:50.408292+0000","last_undegraded":"2024-09-13T17:06:50.408292+0000","last_fullsized":"2024-09-13T17:06:50.408292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:15.339790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.772159+0000","last_change":"2024-09-13T17:06:48.076610+0000","last_active":"2024-09-13T17:06:49.772159+0000","last_peered":"2024-09-13T17:06:49.772159+0000","last_clean":"2024-09-13T17:06:49.772159+0000","last_became_active":"2024-09-13T17:06:48.076280+0000","last_became_peered":"2024-09-13T17:06:48.076280+0000","last_unstale":"2024-09-13T17:06:49.772159+0000","last_undegraded":"2024-09-13T17:06:49.772159+0000","last_fullsized":"2024-09-13T17:06:49.772159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:21.835105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435641+0000","last_change":"2024-09-13T17:06:48.457588+0000","last_active":"2024-09-13T17:06:49.435641+0000","last_peered":"2024-09-13T17:06:49.435641+0000","last_clean":"2024-09-13T17:06:49.435641+0000","last_became_active":"2024-09-13T17:06:48.457308+0000","last_became_peered":"2024-09-13T17:06:48.457308+0000","last_unstale":"2024-09-13T17:06:49.435641+0000","last_undegraded":"2024-09-13T17:06:49.435641+0000","last_fullsized":"2024-09-13T17:06:49.435641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:38.769259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T17:06:48.432560+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:06:48.432560+0000","last_peered":"2024-09-13T17:06:48.432560+0000","last_clean":"2024-09-13T17:06:48.432560+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:06:48.432560+0000","last_undegraded":"2024-09-13T17:06:48.432560+0000","last_fullsized":"2024-09-13T17:06:48.432560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407662+0000","last_change":"2024-09-13T17:06:48.077809+0000","last_active":"2024-09-13T17:06:50.407662+0000","last_peered":"2024-09-13T17:06:50.407662+0000","last_clean":"2024-09-13T17:06:50.407662+0000","last_became_active":"2024-09-13T17:06:48.077535+0000","last_became_peered":"2024-09-13T17:06:48.077535+0000","last_unstale":"2024-09-13T17:06:50.407662+0000","last_undegraded":"2024-09-13T17:06:50.407662+0000","last_fullsized":"2024-09-13T17:06:50.407662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.901813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434996+0000","last_change":"2024-09-13T17:06:48.451309+0000","last_active":"2024-09-13T17:06:49.434996+0000","last_peered":"2024-09-13T17:06:49.434996+0000","last_clean":"2024-09-13T17:06:49.434996+0000","last_became_active":"2024-09-13T17:06:48.451008+0000","last_became_peered":"2024-09-13T17:06:48.451008+0000","last_unstale":"2024-09-13T17:06:49.434996+0000","last_undegraded":"2024-09-13T17:06:49.434996+0000","last_fullsized":"2024-09-13T17:06:49.434996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434768+0000","last_change":"2024-09-13T17:06:48.071142+0000","last_active":"2024-09-13T17:06:49.434768+0000","last_peered":"2024-09-13T17:06:49.434768+0000","last_clean":"2024-09-13T17:06:49.434768+0000","last_became_active":"2024-09-13T17:06:48.070907+0000","last_became_peered":"2024-09-13T17:06:48.070907+0000","last_unstale":"2024-09-13T17:06:49.434768+0000","last_undegraded":"2024-09-13T17:06:49.434768+0000","last_fullsized":"2024-09-13T17:06:49.434768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:28.769904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407097+0000","last_change":"2024-09-13T17:06:48.449924+0000","last_active":"2024-09-13T17:06:50.407097+0000","last_peered":"2024-09-13T17:06:50.407097+0000","last_clean":"2024-09-13T17:06:50.407097+0000","last_became_active":"2024-09-13T17:06:48.449691+0000","last_became_peered":"2024-09-13T17:06:48.449691+0000","last_unstale":"2024-09-13T17:06:50.407097+0000","last_undegraded":"2024-09-13T17:06:50.407097+0000","last_fullsized":"2024-09-13T17:06:50.407097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:31.792088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.772076+0000","last_change":"2024-09-13T17:06:48.074086+0000","last_active":"2024-09-13T17:06:49.772076+0000","last_peered":"2024-09-13T17:06:49.772076+0000","last_clean":"2024-09-13T17:06:49.772076+0000","last_became_active":"2024-09-13T17:06:48.073798+0000","last_became_peered":"2024-09-13T17:06:48.073798+0000","last_unstale":"2024-09-13T17:06:49.772076+0000","last_undegraded":"2024-09-13T17:06:49.772076+0000","last_fullsized":"2024-09-13T17:06:49.772076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:37.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436043+0000","last_change":"2024-09-13T17:06:48.451852+0000","last_active":"2024-09-13T17:06:49.436043+0000","last_peered":"2024-09-13T17:06:49.436043+0000","last_clean":"2024-09-13T17:06:49.436043+0000","last_became_active":"2024-09-13T17:06:48.451614+0000","last_became_peered":"2024-09-13T17:06:48.451614+0000","last_unstale":"2024-09-13T17:06:49.436043+0000","last_undegraded":"2024-09-13T17:06:49.436043+0000","last_fullsized":"2024-09-13T17:06:49.436043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:14.109764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409598+0000","last_change":"2024-09-13T17:06:48.078024+0000","last_active":"2024-09-13T17:06:50.409598+0000","last_peered":"2024-09-13T17:06:50.409598+0000","last_clean":"2024-09-13T17:06:50.409598+0000","last_became_active":"2024-09-13T17:06:48.077753+0000","last_became_peered":"2024-09-13T17:06:48.077753+0000","last_unstale":"2024-09-13T17:06:50.409598+0000","last_undegraded":"2024-09-13T17:06:50.409598+0000","last_fullsized":"2024-09-13T17:06:50.409598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410107+0000","last_change":"2024-09-13T17:06:48.451352+0000","last_active":"2024-09-13T17:06:50.410107+0000","last_peered":"2024-09-13T17:06:50.410107+0000","last_clean":"2024-09-13T17:06:50.410107+0000","last_became_active":"2024-09-13T17:06:48.450821+0000","last_became_peered":"2024-09-13T17:06:48.450821+0000","last_unstale":"2024-09-13T17:06:50.410107+0000","last_undegraded":"2024-09-13T17:06:50.410107+0000","last_fullsized":"2024-09-13T17:06:50.410107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:17.894980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436587+0000","last_change":"2024-09-13T17:06:48.075452+0000","last_active":"2024-09-13T17:06:49.436587+0000","last_peered":"2024-09-13T17:06:49.436587+0000","last_clean":"2024-09-13T17:06:49.436587+0000","last_became_active":"2024-09-13T17:06:48.075248+0000","last_became_peered":"2024-09-13T17:06:48.075248+0000","last_unstale":"2024-09-13T17:06:49.436587+0000","last_undegraded":"2024-09-13T17:06:49.436587+0000","last_fullsized":"2024-09-13T17:06:49.436587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.901813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408460+0000","last_change":"2024-09-13T17:06:48.453207+0000","last_active":"2024-09-13T17:06:50.408460+0000","last_peered":"2024-09-13T17:06:50.408460+0000","last_clean":"2024-09-13T17:06:50.408460+0000","last_became_active":"2024-09-13T17:06:48.452962+0000","last_became_peered":"2024-09-13T17:06:48.452962+0000","last_unstale":"2024-09-13T17:06:50.408460+0000","last_undegraded":"2024-09-13T17:06:50.408460+0000","last_fullsized":"2024-09-13T17:06:50.408460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435905+0000","last_change":"2024-09-13T17:06:48.075771+0000","last_active":"2024-09-13T17:06:49.435905+0000","last_peered":"2024-09-13T17:06:49.435905+0000","last_clean":"2024-09-13T17:06:49.435905+0000","last_became_active":"2024-09-13T17:06:48.075410+0000","last_became_peered":"2024-09-13T17:06:48.075410+0000","last_unstale":"2024-09-13T17:06:49.435905+0000","last_undegraded":"2024-09-13T17:06:49.435905+0000","last_fullsized":"2024-09-13T17:06:49.435905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:40.582958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436377+0000","last_change":"2024-09-13T17:06:48.451971+0000","last_active":"2024-09-13T17:06:49.436377+0000","last_peered":"2024-09-13T17:06:49.436377+0000","last_clean":"2024-09-13T17:06:49.436377+0000","last_became_active":"2024-09-13T17:06:48.451110+0000","last_became_peered":"2024-09-13T17:06:48.451110+0000","last_unstale":"2024-09-13T17:06:49.436377+0000","last_undegraded":"2024-09-13T17:06:49.436377+0000","last_fullsized":"2024-09-13T17:06:49.436377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:46.353437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436405+0000","last_change":"2024-09-13T17:06:48.071158+0000","last_active":"2024-09-13T17:06:49.436405+0000","last_peered":"2024-09-13T17:06:49.436405+0000","last_clean":"2024-09-13T17:06:49.436405+0000","last_became_active":"2024-09-13T17:06:48.070810+0000","last_became_peered":"2024-09-13T17:06:48.070810+0000","last_unstale":"2024-09-13T17:06:49.436405+0000","last_undegraded":"2024-09-13T17:06:49.436405+0000","last_fullsized":"2024-09-13T17:06:49.436405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:37.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435802+0000","last_change":"2024-09-13T17:06:48.439765+0000","last_active":"2024-09-13T17:06:49.435802+0000","last_peered":"2024-09-13T17:06:49.435802+0000","last_clean":"2024-09-13T17:06:49.435802+0000","last_became_active":"2024-09-13T17:06:48.439486+0000","last_became_peered":"2024-09-13T17:06:48.439486+0000","last_unstale":"2024-09-13T17:06:49.435802+0000","last_undegraded":"2024-09-13T17:06:49.435802+0000","last_fullsized":"2024-09-13T17:06:49.435802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:05.681555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.411021+0000","last_change":"2024-09-13T17:06:48.072147+0000","last_active":"2024-09-13T17:06:50.411021+0000","last_peered":"2024-09-13T17:06:50.411021+0000","last_clean":"2024-09-13T17:06:50.411021+0000","last_became_active":"2024-09-13T17:06:48.070889+0000","last_became_peered":"2024-09-13T17:06:48.070889+0000","last_unstale":"2024-09-13T17:06:50.411021+0000","last_undegraded":"2024-09-13T17:06:50.411021+0000","last_fullsized":"2024-09-13T17:06:50.411021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.406902+0000","last_change":"2024-09-13T17:06:48.451274+0000","last_active":"2024-09-13T17:06:50.406902+0000","last_peered":"2024-09-13T17:06:50.406902+0000","last_clean":"2024-09-13T17:06:50.406902+0000","last_became_active":"2024-09-13T17:06:48.450991+0000","last_became_peered":"2024-09-13T17:06:48.450991+0000","last_unstale":"2024-09-13T17:06:50.406902+0000","last_undegraded":"2024-09-13T17:06:50.406902+0000","last_fullsized":"2024-09-13T17:06:50.406902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:49.807985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434636+0000","last_change":"2024-09-13T17:06:48.068959+0000","last_active":"2024-09-13T17:06:49.434636+0000","last_peered":"2024-09-13T17:06:49.434636+0000","last_clean":"2024-09-13T17:06:49.434636+0000","last_became_active":"2024-09-13T17:06:48.068731+0000","last_became_peered":"2024-09-13T17:06:48.068731+0000","last_unstale":"2024-09-13T17:06:49.434636+0000","last_undegraded":"2024-09-13T17:06:49.434636+0000","last_fullsized":"2024-09-13T17:06:49.434636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.901813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409333+0000","last_change":"2024-09-13T17:06:48.453284+0000","last_active":"2024-09-13T17:06:50.409333+0000","last_peered":"2024-09-13T17:06:50.409333+0000","last_clean":"2024-09-13T17:06:50.409333+0000","last_became_active":"2024-09-13T17:06:48.452958+0000","last_became_peered":"2024-09-13T17:06:48.452958+0000","last_unstale":"2024-09-13T17:06:50.409333+0000","last_undegraded":"2024-09-13T17:06:50.409333+0000","last_fullsized":"2024-09-13T17:06:50.409333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:47.910751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436208+0000","last_change":"2024-09-13T17:06:48.070145+0000","last_active":"2024-09-13T17:06:49.436208+0000","last_peered":"2024-09-13T17:06:49.436208+0000","last_clean":"2024-09-13T17:06:49.436208+0000","last_became_active":"2024-09-13T17:06:48.069900+0000","last_became_peered":"2024-09-13T17:06:48.069900+0000","last_unstale":"2024-09-13T17:06:49.436208+0000","last_undegraded":"2024-09-13T17:06:49.436208+0000","last_fullsized":"2024-09-13T17:06:49.436208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:04.672617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434540+0000","last_change":"2024-09-13T17:06:48.452279+0000","last_active":"2024-09-13T17:06:49.434540+0000","last_peered":"2024-09-13T17:06:49.434540+0000","last_clean":"2024-09-13T17:06:49.434540+0000","last_became_active":"2024-09-13T17:06:48.452031+0000","last_became_peered":"2024-09-13T17:06:48.452031+0000","last_unstale":"2024-09-13T17:06:49.434540+0000","last_undegraded":"2024-09-13T17:06:49.434540+0000","last_fullsized":"2024-09-13T17:06:49.434540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:05.801080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436702+0000","last_change":"2024-09-13T17:06:48.078695+0000","last_active":"2024-09-13T17:06:49.436702+0000","last_peered":"2024-09-13T17:06:49.436702+0000","last_clean":"2024-09-13T17:06:49.436702+0000","last_became_active":"2024-09-13T17:06:48.078373+0000","last_became_peered":"2024-09-13T17:06:48.078373+0000","last_unstale":"2024-09-13T17:06:49.436702+0000","last_undegraded":"2024-09-13T17:06:49.436702+0000","last_fullsized":"2024-09-13T17:06:49.436702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:21.835105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434967+0000","last_change":"2024-09-13T17:06:48.438583+0000","last_active":"2024-09-13T17:06:49.434967+0000","last_peered":"2024-09-13T17:06:49.434967+0000","last_clean":"2024-09-13T17:06:49.434967+0000","last_became_active":"2024-09-13T17:06:48.438322+0000","last_became_peered":"2024-09-13T17:06:48.438322+0000","last_unstale":"2024-09-13T17:06:49.434967+0000","last_undegraded":"2024-09-13T17:06:49.434967+0000","last_fullsized":"2024-09-13T17:06:49.434967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:59.415579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435417+0000","last_change":"2024-09-13T17:06:48.072310+0000","last_active":"2024-09-13T17:06:49.435417+0000","last_peered":"2024-09-13T17:06:49.435417+0000","last_clean":"2024-09-13T17:06:49.435417+0000","last_became_active":"2024-09-13T17:06:48.072034+0000","last_became_peered":"2024-09-13T17:06:48.072034+0000","last_unstale":"2024-09-13T17:06:49.435417+0000","last_undegraded":"2024-09-13T17:06:49.435417+0000","last_fullsized":"2024-09-13T17:06:49.435417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:21.835105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407378+0000","last_change":"2024-09-13T17:06:48.459811+0000","last_active":"2024-09-13T17:06:50.407378+0000","last_peered":"2024-09-13T17:06:50.407378+0000","last_clean":"2024-09-13T17:06:50.407378+0000","last_became_active":"2024-09-13T17:06:48.459495+0000","last_became_peered":"2024-09-13T17:06:48.459495+0000","last_unstale":"2024-09-13T17:06:50.407378+0000","last_undegraded":"2024-09-13T17:06:50.407378+0000","last_fullsized":"2024-09-13T17:06:50.407378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:58.103402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408388+0000","last_change":"2024-09-13T17:06:48.456637+0000","last_active":"2024-09-13T17:06:50.408388+0000","last_peered":"2024-09-13T17:06:50.408388+0000","last_clean":"2024-09-13T17:06:50.408388+0000","last_became_active":"2024-09-13T17:06:48.454834+0000","last_became_peered":"2024-09-13T17:06:48.454834+0000","last_unstale":"2024-09-13T17:06:50.408388+0000","last_undegraded":"2024-09-13T17:06:50.408388+0000","last_fullsized":"2024-09-13T17:06:50.408388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:29.632832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435532+0000","last_change":"2024-09-13T17:06:48.076407+0000","last_active":"2024-09-13T17:06:49.435532+0000","last_peered":"2024-09-13T17:06:49.435532+0000","last_clean":"2024-09-13T17:06:49.435532+0000","last_became_active":"2024-09-13T17:06:48.076136+0000","last_became_peered":"2024-09-13T17:06:48.076136+0000","last_unstale":"2024-09-13T17:06:49.435532+0000","last_undegraded":"2024-09-13T17:06:49.435532+0000","last_fullsized":"2024-09-13T17:06:49.435532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:04.672617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408258+0000","last_change":"2024-09-13T17:06:48.457607+0000","last_active":"2024-09-13T17:06:50.408258+0000","last_peered":"2024-09-13T17:06:50.408258+0000","last_clean":"2024-09-13T17:06:50.408258+0000","last_became_active":"2024-09-13T17:06:48.457325+0000","last_became_peered":"2024-09-13T17:06:48.457325+0000","last_unstale":"2024-09-13T17:06:50.408258+0000","last_undegraded":"2024-09-13T17:06:50.408258+0000","last_fullsized":"2024-09-13T17:06:50.408258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:59.371861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435762+0000","last_change":"2024-09-13T17:06:48.072948+0000","last_active":"2024-09-13T17:06:49.435762+0000","last_peered":"2024-09-13T17:06:49.435762+0000","last_clean":"2024-09-13T17:06:49.435762+0000","last_became_active":"2024-09-13T17:06:48.072466+0000","last_became_peered":"2024-09-13T17:06:48.072466+0000","last_unstale":"2024-09-13T17:06:49.435762+0000","last_undegraded":"2024-09-13T17:06:49.435762+0000","last_fullsized":"2024-09-13T17:06:49.435762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:16.886041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407035+0000","last_change":"2024-09-13T17:06:48.452786+0000","last_active":"2024-09-13T17:06:50.407035+0000","last_peered":"2024-09-13T17:06:50.407035+0000","last_clean":"2024-09-13T17:06:50.407035+0000","last_became_active":"2024-09-13T17:06:48.452536+0000","last_became_peered":"2024-09-13T17:06:48.452536+0000","last_unstale":"2024-09-13T17:06:50.407035+0000","last_undegraded":"2024-09-13T17:06:50.407035+0000","last_fullsized":"2024-09-13T17:06:50.407035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435770+0000","last_change":"2024-09-13T17:06:48.073581+0000","last_active":"2024-09-13T17:06:49.435770+0000","last_peered":"2024-09-13T17:06:49.435770+0000","last_clean":"2024-09-13T17:06:49.435770+0000","last_became_active":"2024-09-13T17:06:48.073283+0000","last_became_peered":"2024-09-13T17:06:48.073283+0000","last_unstale":"2024-09-13T17:06:49.435770+0000","last_undegraded":"2024-09-13T17:06:49.435770+0000","last_fullsized":"2024-09-13T17:06:49.435770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:11.933089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435693+0000","last_change":"2024-09-13T17:06:48.461028+0000","last_active":"2024-09-13T17:06:49.435693+0000","last_peered":"2024-09-13T17:06:49.435693+0000","last_clean":"2024-09-13T17:06:49.435693+0000","last_became_active":"2024-09-13T17:06:48.460777+0000","last_became_peered":"2024-09-13T17:06:48.460777+0000","last_unstale":"2024-09-13T17:06:49.435693+0000","last_undegraded":"2024-09-13T17:06:49.435693+0000","last_fullsized":"2024-09-13T17:06:49.435693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:59.371861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407296+0000","last_change":"2024-09-13T17:06:48.079106+0000","last_active":"2024-09-13T17:06:50.407296+0000","last_peered":"2024-09-13T17:06:50.407296+0000","last_clean":"2024-09-13T17:06:50.407296+0000","last_became_active":"2024-09-13T17:06:48.078850+0000","last_became_peered":"2024-09-13T17:06:48.078850+0000","last_unstale":"2024-09-13T17:06:50.407296+0000","last_undegraded":"2024-09-13T17:06:50.407296+0000","last_fullsized":"2024-09-13T17:06:50.407296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:47.258496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:06:52.806 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:06:52.807 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T17:06:52.807 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T17:06:52.807 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T17:06:52.808 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T17:06:52.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.914+0000 7f98326cb700 1 Processor -- start 2024-09-13T17:06:52.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.914+0000 7f98326cb700 1 -- start start 2024-09-13T17:06:52.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98326cb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f982c159840 0x7f982c0ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98326cb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f982c0cc290 0x7f982c0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98326cb700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c06b6a0 con 0x7f982c06a770 2024-09-13T17:06:52.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98326cb700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982c0ccc10 con 0x7f982c159840 2024-09-13T17:06:52.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98326cb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c06b3c0 con 0x7f982c0cc290 2024-09-13T17:06:52.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98316c9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f982c159840 0x7f982c0ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98316c9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f982c159840 0x7f982c0ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46244/0 (socket says 172.21.15.123:46244) 2024-09-13T17:06:52.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98316c9700 1 -- 172.21.15.123:0/2739087358 learned_addr learned my addr 172.21.15.123:0/2739087358 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:52.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f9830ec8700 1 --2- 172.21.15.123:0/2739087358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f982c0cc290 0x7f982c0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98316c9700 1 -- 172.21.15.123:0/2739087358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f982c0cc290 msgr2=0x7f982c0cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:52.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98316c9700 1 --2- 172.21.15.123:0/2739087358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f982c0cc290 0x7f982c0cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98316c9700 1 -- 172.21.15.123:0/2739087358 >> v1:172.21.15.123:6789/0 conn(0x7f982c06a770 legacy=0x7f982c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:52.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98316c9700 1 -- 172.21.15.123:0/2739087358 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c0cdeb0 con 0x7f982c159840 2024-09-13T17:06:52.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98316c9700 1 --2- 172.21.15.123:0/2739087358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c159840 0x7f982c0ce990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9828009910 tx=0x7f9828009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb647fe9188bf4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:52.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f9823fff700 1 -- 172.21.15.123:0/2739087358 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828004230 con 0x7f982c159840 2024-09-13T17:06:52.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f9823fff700 1 -- 172.21.15.123:0/2739087358 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9828004390 con 0x7f982c159840 2024-09-13T17:06:52.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f9823fff700 1 -- 172.21.15.123:0/2739087358 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98280036c0 con 0x7f982c159840 2024-09-13T17:06:52.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98326cb700 1 -- 172.21.15.123:0/2739087358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c159840 msgr2=0x7f982c0ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98326cb700 1 --2- 172.21.15.123:0/2739087358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c159840 0x7f982c0ce990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9828009910 tx=0x7f9828009c20 comp rx=0 tx=0).stop 2024-09-13T17:06:52.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98326cb700 1 -- 172.21.15.123:0/2739087358 shutdown_connections 2024-09-13T17:06:52.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98326cb700 1 --2- 172.21.15.123:0/2739087358 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f982c0cc290 0x7f982c0cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98326cb700 1 --2- 172.21.15.123:0/2739087358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c159840 0x7f982c0ce990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98326cb700 1 -- 172.21.15.123:0/2739087358 >> 172.21.15.123:0/2739087358 conn(0x7f982c066780 msgr2=0x7f982c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:52.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98326cb700 1 -- 172.21.15.123:0/2739087358 shutdown_connections 2024-09-13T17:06:52.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.918+0000 7f98326cb700 1 -- 172.21.15.123:0/2739087358 wait complete. 2024-09-13T17:06:52.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98326cb700 1 Processor -- start 2024-09-13T17:06:52.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98326cb700 1 -- start start 2024-09-13T17:06:52.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98326cb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c06a770 0x7f982c154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98326cb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f982c0cc290 0x7f982c1f0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98326cb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f982c159840 0x7f982c06f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98326cb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c153b90 con 0x7f982c06a770 2024-09-13T17:06:52.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98326cb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c152d30 con 0x7f982c159840 2024-09-13T17:06:52.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98326cb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c153010 con 0x7f982c0cc290 2024-09-13T17:06:52.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98316c9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c06a770 0x7f982c154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98316c9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c06a770 0x7f982c154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46248/0 (socket says 172.21.15.123:46248) 2024-09-13T17:06:52.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98316c9700 1 -- 172.21.15.123:0/1193257723 learned_addr learned my addr 172.21.15.123:0/1193257723 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:52.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f9830ec8700 1 --2- 172.21.15.123:0/1193257723 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f982c0cc290 0x7f982c1f0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f9831eca700 1 --2- 172.21.15.123:0/1193257723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f982c159840 0x7f982c06f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98316c9700 1 -- 172.21.15.123:0/1193257723 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f982c0cc290 msgr2=0x7f982c1f0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98316c9700 1 --2- 172.21.15.123:0/1193257723 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f982c0cc290 0x7f982c1f0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98316c9700 1 -- 172.21.15.123:0/1193257723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f982c159840 msgr2=0x7f982c06f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:52.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98316c9700 1 --2- 172.21.15.123:0/1193257723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f982c159840 0x7f982c06f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:52.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98316c9700 1 -- 172.21.15.123:0/1193257723 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9828009570 con 0x7f982c06a770 2024-09-13T17:06:52.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.922+0000 7f98316c9700 1 --2- 172.21.15.123:0/1193257723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c06a770 0x7f982c154c20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9828004000 tx=0x7f9828004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:52.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.926+0000 7f9821ffb700 1 -- 172.21.15.123:0/1193257723 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828003ea0 con 0x7f982c06a770 2024-09-13T17:06:52.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.926+0000 7f9821ffb700 1 -- 172.21.15.123:0/1193257723 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9828011830 con 0x7f982c06a770 2024-09-13T17:06:52.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.926+0000 7f98326cb700 1 -- 172.21.15.123:0/1193257723 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c159da0 con 0x7f982c06a770 2024-09-13T17:06:52.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.926+0000 7f9821ffb700 1 -- 172.21.15.123:0/1193257723 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828011be0 con 0x7f982c06a770 2024-09-13T17:06:52.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.926+0000 7f98326cb700 1 -- 172.21.15.123:0/1193257723 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c1535d0 con 0x7f982c06a770 2024-09-13T17:06:52.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.926+0000 7f98326cb700 1 -- 172.21.15.123:0/1193257723 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982c1e3680 con 0x7f982c06a770 2024-09-13T17:06:52.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.926+0000 7f9821ffb700 1 -- 172.21.15.123:0/1193257723 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9828011d40 con 0x7f982c06a770 2024-09-13T17:06:52.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.930+0000 7f9821ffb700 1 --2- 172.21.15.123:0/1193257723 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9810066730 0x7f9810068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:52.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.930+0000 7f9821ffb700 1 -- 172.21.15.123:0/1193257723 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9828085920 con 0x7f982c06a770 2024-09-13T17:06:52.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.930+0000 7f9830ec8700 1 --2- 172.21.15.123:0/1193257723 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9810066730 0x7f9810068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:52.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.930+0000 7f9830ec8700 1 --2- 172.21.15.123:0/1193257723 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9810066730 0x7f9810068bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f982c0b22b0 tx=0x7f981c008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:52.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:52.934+0000 7f9821ffb700 1 -- 172.21.15.123:0/1193257723 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9828052c80 con 0x7f982c06a770 2024-09-13T17:06:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.146+0000 7f98326cb700 1 -- 172.21.15.123:0/1193257723 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f982c0cc6d0 con 0x7f982c06a770 2024-09-13T17:06:53.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.150+0000 7f9821ffb700 1 -- 172.21.15.123:0/1193257723 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164906 (secure 0 0 0) 0x7f98280562a0 con 0x7f982c06a770 2024-09-13T17:06:53.156 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:53.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.154+0000 7f98326cb700 1 -- 172.21.15.123:0/1193257723 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9810066730 msgr2=0x7f9810068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.154+0000 7f98326cb700 1 --2- 172.21.15.123:0/1193257723 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9810066730 0x7f9810068bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f982c0b22b0 tx=0x7f981c008040 comp rx=0 tx=0).stop 2024-09-13T17:06:53.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.154+0000 7f98326cb700 1 -- 172.21.15.123:0/1193257723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c06a770 msgr2=0x7f982c154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.154+0000 7f98326cb700 1 --2- 172.21.15.123:0/1193257723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c06a770 0x7f982c154c20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9828004000 tx=0x7f9828004770 comp rx=0 tx=0).stop 2024-09-13T17:06:53.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.154+0000 7f98326cb700 1 -- 172.21.15.123:0/1193257723 shutdown_connections 2024-09-13T17:06:53.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.154+0000 7f98326cb700 1 --2- 172.21.15.123:0/1193257723 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9810066730 0x7f9810068bf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.154+0000 7f98326cb700 1 --2- 172.21.15.123:0/1193257723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f982c159840 0x7f982c06f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.154+0000 7f98326cb700 1 --2- 172.21.15.123:0/1193257723 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f982c0cc290 0x7f982c1f0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.154+0000 7f98326cb700 1 --2- 172.21.15.123:0/1193257723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f982c06a770 0x7f982c154c20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.154+0000 7f98326cb700 1 -- 172.21.15.123:0/1193257723 >> 172.21.15.123:0/1193257723 conn(0x7f982c066780 msgr2=0x7f982c1575c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:53.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.154+0000 7f98326cb700 1 -- 172.21.15.123:0/1193257723 shutdown_connections 2024-09-13T17:06:53.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.154+0000 7f98326cb700 1 -- 172.21.15.123:0/1193257723 wait complete. 2024-09-13T17:06:53.170 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":5,"flags":0,"active_gid":4128,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2143283540},{"type":"v1","addr":"172.21.15.123:6833","nonce":2143283540}]},"active_addr":"172.21.15.123:6833/2143283540","active_change":"2024-09-13T17:06:30.723130+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4112,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":163286725}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":1182985856}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":3480920750}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":3819967292}]}]} 2024-09-13T17:06:53.175 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T17:06:53.175 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T17:06:53.175 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:06:53.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f873bf6d700 1 Processor -- start 2024-09-13T17:06:53.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f873bf6d700 1 -- start start 2024-09-13T17:06:53.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f873bf6d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8734160fb0 0x7f873406de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f873bf6d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f87340cec90 0x7f87340cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f873bf6d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87340cf5f0 con 0x7f873406c050 2024-09-13T17:06:53.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f873bf6d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873406cb60 con 0x7f87340cec90 2024-09-13T17:06:53.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f873bf6d700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873406e340 con 0x7f8734160fb0 2024-09-13T17:06:53.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f873a50a700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f873406c050 0x7f873406c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49102/0 (socket says 172.21.15.123:49102) 2024-09-13T17:06:53.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f873a50a700 1 -- 172.21.15.123:0/2171802736 learned_addr learned my addr 172.21.15.123:0/2171802736 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:53.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f8739d09700 1 --2- 172.21.15.123:0/2171802736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8734160fb0 0x7f873406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f8739508700 1 --2- 172.21.15.123:0/2171802736 >> v2:172.21.15.153:3300/0 conn(0x7f87340cec90 0x7f87340cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f8738d07700 1 -- 172.21.15.123:0/2171802736 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782871993 0 0) 0x7f87340cf5f0 con 0x7f873406c050 2024-09-13T17:06:53.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f8738d07700 1 -- 172.21.15.123:0/2171802736 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87200035d0 con 0x7f873406c050 2024-09-13T17:06:53.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f8739d09700 1 -- 172.21.15.123:0/2171802736 >> v2:172.21.15.153:3300/0 conn(0x7f87340cec90 msgr2=0x7f87340cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:53.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f8739d09700 1 --2- 172.21.15.123:0/2171802736 >> v2:172.21.15.153:3300/0 conn(0x7f87340cec90 0x7f87340cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f8739d09700 1 -- 172.21.15.123:0/2171802736 >> v1:172.21.15.123:6789/0 conn(0x7f873406c050 legacy=0x7f873406c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f8739d09700 1 -- 172.21.15.123:0/2171802736 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873406cd60 con 0x7f8734160fb0 2024-09-13T17:06:53.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f8739508700 1 --2- 172.21.15.123:0/2171802736 >> v2:172.21.15.153:3300/0 conn(0x7f87340cec90 0x7f87340cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f8739d09700 1 --2- 172.21.15.123:0/2171802736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8734160fb0 0x7f873406de00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8724009850 tx=0x7f8724009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c25c7c12823cacb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f8738d07700 1 -- 172.21.15.123:0/2171802736 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724011830 con 0x7f8734160fb0 2024-09-13T17:06:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f8738d07700 1 -- 172.21.15.123:0/2171802736 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8724011990 con 0x7f8734160fb0 2024-09-13T17:06:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.282+0000 7f8738d07700 1 -- 172.21.15.123:0/2171802736 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724011d00 con 0x7f8734160fb0 2024-09-13T17:06:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 -- 172.21.15.123:0/2171802736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8734160fb0 msgr2=0x7f873406de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 --2- 172.21.15.123:0/2171802736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8734160fb0 0x7f873406de00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8724009850 tx=0x7f8724009b60 comp rx=0 tx=0).stop 2024-09-13T17:06:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 -- 172.21.15.123:0/2171802736 shutdown_connections 2024-09-13T17:06:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 --2- 172.21.15.123:0/2171802736 >> v2:172.21.15.153:3300/0 conn(0x7f87340cec90 0x7f87340cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 --2- 172.21.15.123:0/2171802736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8734160fb0 0x7f873406de00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 -- 172.21.15.123:0/2171802736 >> 172.21.15.123:0/2171802736 conn(0x7f8734066570 msgr2=0x7f8734066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 -- 172.21.15.123:0/2171802736 shutdown_connections 2024-09-13T17:06:53.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 -- 172.21.15.123:0/2171802736 wait complete. 2024-09-13T17:06:53.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 Processor -- start 2024-09-13T17:06:53.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 -- start start 2024-09-13T17:06:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873406c050 0x7f8734146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87340cec90 0x7f8734147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8734160fb0 0x7f87341f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87340a8a60 con 0x7f8734160fb0 2024-09-13T17:06:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.286+0000 7f873bf6d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87340a84a0 con 0x7f87340cec90 2024-09-13T17:06:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f873bf6d700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87340a8780 con 0x7f873406c050 2024-09-13T17:06:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f873a50a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8734160fb0 0x7f87341f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f873a50a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8734160fb0 0x7f87341f6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46250/0 (socket says 172.21.15.123:46250) 2024-09-13T17:06:53.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f873a50a700 1 -- 172.21.15.123:0/3892354322 learned_addr learned my addr 172.21.15.123:0/3892354322 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:53.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f8739d09700 1 --2- 172.21.15.123:0/3892354322 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873406c050 0x7f8734146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f8739508700 1 --2- 172.21.15.123:0/3892354322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87340cec90 0x7f8734147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f873a50a700 1 -- 172.21.15.123:0/3892354322 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873406c050 msgr2=0x7f8734146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f873a50a700 1 --2- 172.21.15.123:0/3892354322 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873406c050 0x7f8734146b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f873a50a700 1 -- 172.21.15.123:0/3892354322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87340cec90 msgr2=0x7f8734147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f873a50a700 1 --2- 172.21.15.123:0/3892354322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87340cec90 0x7f8734147090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f873a50a700 1 -- 172.21.15.123:0/3892354322 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c009a70 con 0x7f8734160fb0 2024-09-13T17:06:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f873a50a700 1 --2- 172.21.15.123:0/3892354322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8734160fb0 0x7f87341f6210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f873000c500 tx=0x7f873000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f872a7fc700 1 -- 172.21.15.123:0/3892354322 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730005d90 con 0x7f8734160fb0 2024-09-13T17:06:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f872a7fc700 1 -- 172.21.15.123:0/3892354322 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87300070d0 con 0x7f8734160fb0 2024-09-13T17:06:53.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f873bf6d700 1 -- 172.21.15.123:0/3892354322 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87240094b0 con 0x7f8734160fb0 2024-09-13T17:06:53.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f872a7fc700 1 -- 172.21.15.123:0/3892354322 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730007460 con 0x7f8734160fb0 2024-09-13T17:06:53.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f873bf6d700 1 -- 172.21.15.123:0/3892354322 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87341e8030 con 0x7f8734160fb0 2024-09-13T17:06:53.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f873bf6d700 1 -- 172.21.15.123:0/3892354322 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87340cf3d0 con 0x7f8734160fb0 2024-09-13T17:06:53.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f872a7fc700 1 -- 172.21.15.123:0/3892354322 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f87300075c0 con 0x7f8734160fb0 2024-09-13T17:06:53.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f872a7fc700 1 --2- 172.21.15.123:0/3892354322 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8718066730 0x7f8718068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f872a7fc700 1 -- 172.21.15.123:0/3892354322 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87300835d0 con 0x7f8734160fb0 2024-09-13T17:06:53.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.290+0000 7f8739d09700 1 --2- 172.21.15.123:0/3892354322 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8718066730 0x7f8718068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.294+0000 7f8739d09700 1 --2- 172.21.15.123:0/3892354322 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8718066730 0x7f8718068bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f87240090b0 tx=0x7f872401c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:53.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.302+0000 7f872a7fc700 1 -- 172.21.15.123:0/3892354322 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f87300508c0 con 0x7f8734160fb0 2024-09-13T17:06:53.459 INFO:tasks.ceph.mds.b.smithi153.stderr:2024-09-13T17:06:53.452+0000 7f93cc231700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:06:53.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.482+0000 7f873bf6d700 1 -- 172.21.15.123:0/3892354322 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f873406de00 con 0x7f8734160fb0 2024-09-13T17:06:53.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.486+0000 7f872a7fc700 1 -- 172.21.15.123:0/3892354322 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f8730053ee0 con 0x7f8734160fb0 2024-09-13T17:06:53.491 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:53.491 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:06:53.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.486+0000 7f873bf6d700 1 -- 172.21.15.123:0/3892354322 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8718066730 msgr2=0x7f8718068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.486+0000 7f873bf6d700 1 --2- 172.21.15.123:0/3892354322 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8718066730 0x7f8718068bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f87240090b0 tx=0x7f872401c040 comp rx=0 tx=0).stop 2024-09-13T17:06:53.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.486+0000 7f873bf6d700 1 -- 172.21.15.123:0/3892354322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8734160fb0 msgr2=0x7f87341f6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.486+0000 7f873bf6d700 1 --2- 172.21.15.123:0/3892354322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8734160fb0 0x7f87341f6210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f873000c500 tx=0x7f873000c810 comp rx=0 tx=0).stop 2024-09-13T17:06:53.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.486+0000 7f873bf6d700 1 -- 172.21.15.123:0/3892354322 shutdown_connections 2024-09-13T17:06:53.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.486+0000 7f873bf6d700 1 --2- 172.21.15.123:0/3892354322 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8718066730 0x7f8718068bf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.486+0000 7f873bf6d700 1 --2- 172.21.15.123:0/3892354322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8734160fb0 0x7f87341f6210 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.486+0000 7f873bf6d700 1 --2- 172.21.15.123:0/3892354322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87340cec90 0x7f8734147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.486+0000 7f873bf6d700 1 --2- 172.21.15.123:0/3892354322 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f873406c050 0x7f8734146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.486+0000 7f873bf6d700 1 -- 172.21.15.123:0/3892354322 >> 172.21.15.123:0/3892354322 conn(0x7f8734066570 msgr2=0x7f8734152020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:53.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.486+0000 7f873bf6d700 1 -- 172.21.15.123:0/3892354322 shutdown_connections 2024-09-13T17:06:53.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.486+0000 7f873bf6d700 1 -- 172.21.15.123:0/3892354322 wait complete. 2024-09-13T17:06:53.506 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T17:06:53.506 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:06:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9afd742700 1 Processor -- start 2024-09-13T17:06:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9afd742700 1 -- start start 2024-09-13T17:06:53.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9afd742700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9af806dc70 0x7f9af8071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9afd742700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9af806a260 0x7f9af806a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9afd742700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af806abf0 con 0x7f9af8155130 2024-09-13T17:06:53.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9afd742700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af80cbc50 con 0x7f9af806dc70 2024-09-13T17:06:53.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9afd742700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af806e230 con 0x7f9af806a260 2024-09-13T17:06:53.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9af77fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9af806dc70 0x7f9af8071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9af77fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9af806dc70 0x7f9af8071a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46256/0 (socket says 172.21.15.123:46256) 2024-09-13T17:06:53.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9af77fe700 1 -- 172.21.15.123:0/4234254905 learned_addr learned my addr 172.21.15.123:0/4234254905 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:53.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9af7fff700 1 --1- 172.21.15.123:0/4234254905 >> v1:172.21.15.123:6789/0 conn(0x7f9af8155130 0x7f9af80cd2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49116/0 (socket says 172.21.15.123:49116) 2024-09-13T17:06:53.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9afcf41700 1 --2- 172.21.15.123:0/4234254905 >> v2:172.21.15.153:3300/0 conn(0x7f9af806a260 0x7f9af806a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9af77fe700 1 -- 172.21.15.123:0/4234254905 >> v2:172.21.15.153:3300/0 conn(0x7f9af806a260 msgr2=0x7f9af806a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:53.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9af6ffd700 1 -- 172.21.15.123:0/4234254905 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209924725 0 0) 0x7f9af0001110 con 0x7f9af8155130 2024-09-13T17:06:53.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9af77fe700 1 --2- 172.21.15.123:0/4234254905 >> v2:172.21.15.153:3300/0 conn(0x7f9af806a260 0x7f9af806a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9af77fe700 1 -- 172.21.15.123:0/4234254905 >> v1:172.21.15.123:6789/0 conn(0x7f9af8155130 legacy=0x7f9af80cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9af77fe700 1 -- 172.21.15.123:0/4234254905 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af806e510 con 0x7f9af806dc70 2024-09-13T17:06:53.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9afcf41700 1 --2- 172.21.15.123:0/4234254905 >> v2:172.21.15.153:3300/0 conn(0x7f9af806a260 0x7f9af806a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:53.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.610+0000 7f9af77fe700 1 --2- 172.21.15.123:0/4234254905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af806dc70 0x7f9af8071a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9af815e400 tx=0x7f9ae000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641ac3ba21e670b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:53.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.614+0000 7f9af6ffd700 1 -- 172.21.15.123:0/4234254905 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae000e070 con 0x7f9af806dc70 2024-09-13T17:06:53.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.614+0000 7f9af6ffd700 1 -- 172.21.15.123:0/4234254905 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae000b9c0 con 0x7f9af806dc70 2024-09-13T17:06:53.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.614+0000 7f9af6ffd700 1 -- 172.21.15.123:0/4234254905 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae000bd70 con 0x7f9af806dc70 2024-09-13T17:06:53.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.614+0000 7f9afd742700 1 -- 172.21.15.123:0/4234254905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af806dc70 msgr2=0x7f9af8071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.614+0000 7f9afd742700 1 --2- 172.21.15.123:0/4234254905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af806dc70 0x7f9af8071a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9af815e400 tx=0x7f9ae000b330 comp rx=0 tx=0).stop 2024-09-13T17:06:53.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.614+0000 7f9afd742700 1 -- 172.21.15.123:0/4234254905 shutdown_connections 2024-09-13T17:06:53.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.614+0000 7f9afd742700 1 --2- 172.21.15.123:0/4234254905 >> v2:172.21.15.153:3300/0 conn(0x7f9af806a260 0x7f9af806a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.614+0000 7f9afd742700 1 --2- 172.21.15.123:0/4234254905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af806dc70 0x7f9af8071a60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.614+0000 7f9afd742700 1 -- 172.21.15.123:0/4234254905 >> 172.21.15.123:0/4234254905 conn(0x7f9af806fa10 msgr2=0x7f9af80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:53.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.614+0000 7f9afd742700 1 -- 172.21.15.123:0/4234254905 shutdown_connections 2024-09-13T17:06:53.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.614+0000 7f9afd742700 1 -- 172.21.15.123:0/4234254905 wait complete. 2024-09-13T17:06:53.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.614+0000 7f9afd742700 1 Processor -- start 2024-09-13T17:06:53.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.614+0000 7f9afd742700 1 -- start start 2024-09-13T17:06:53.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9afd742700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af806a260 0x7f9af81416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9afd742700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af806dc70 0x7f9af81e5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9afd742700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af8155130 0x7f9af81579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9afd742700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af81e5220 con 0x7f9af806dc70 2024-09-13T17:06:53.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9afd742700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af813e7c0 con 0x7f9af8155130 2024-09-13T17:06:53.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9afd742700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af81e4ba0 con 0x7f9af806a260 2024-09-13T17:06:53.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9af77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af806dc70 0x7f9af81e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9af77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af806dc70 0x7f9af81e5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46270/0 (socket says 172.21.15.123:46270) 2024-09-13T17:06:53.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9af77fe700 1 -- 172.21.15.123:0/3037282711 learned_addr learned my addr 172.21.15.123:0/3037282711 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:53.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9af7fff700 1 --2- 172.21.15.123:0/3037282711 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af806a260 0x7f9af81416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9afcf41700 1 --2- 172.21.15.123:0/3037282711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af8155130 0x7f9af81579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9af77fe700 1 -- 172.21.15.123:0/3037282711 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af806a260 msgr2=0x7f9af81416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9af77fe700 1 --2- 172.21.15.123:0/3037282711 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af806a260 0x7f9af81416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9af77fe700 1 -- 172.21.15.123:0/3037282711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af8155130 msgr2=0x7f9af81579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9af77fe700 1 --2- 172.21.15.123:0/3037282711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af8155130 0x7f9af81579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9af77fe700 1 -- 172.21.15.123:0/3037282711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae0009b30 con 0x7f9af806dc70 2024-09-13T17:06:53.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9af77fe700 1 --2- 172.21.15.123:0/3037282711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af806dc70 0x7f9af81e5640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000b730 tx=0x7f9ae0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:53.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9af4ff9700 1 -- 172.21.15.123:0/3037282711 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae00048b0 con 0x7f9af806dc70 2024-09-13T17:06:53.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9af4ff9700 1 -- 172.21.15.123:0/3037282711 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae00092e0 con 0x7f9af806dc70 2024-09-13T17:06:53.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9afd742700 1 -- 172.21.15.123:0/3037282711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af81e6c60 con 0x7f9af806dc70 2024-09-13T17:06:53.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9af4ff9700 1 -- 172.21.15.123:0/3037282711 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae001c680 con 0x7f9af806dc70 2024-09-13T17:06:53.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.618+0000 7f9afd742700 1 -- 172.21.15.123:0/3037282711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af81e4e40 con 0x7f9af806dc70 2024-09-13T17:06:53.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.622+0000 7f9afd742700 1 -- 172.21.15.123:0/3037282711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9adc005310 con 0x7f9af806dc70 2024-09-13T17:06:53.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.622+0000 7f9af4ff9700 1 -- 172.21.15.123:0/3037282711 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ae001c7e0 con 0x7f9af806dc70 2024-09-13T17:06:53.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.622+0000 7f9af4ff9700 1 --2- 172.21.15.123:0/3037282711 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad8066730 0x7f9ad8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.622+0000 7f9af7fff700 1 --2- 172.21.15.123:0/3037282711 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad8066730 0x7f9ad8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.622+0000 7f9af4ff9700 1 -- 172.21.15.123:0/3037282711 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ae0085970 con 0x7f9af806dc70 2024-09-13T17:06:53.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.622+0000 7f9af7fff700 1 --2- 172.21.15.123:0/3037282711 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad8066730 0x7f9ad8068bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9af0000f60 tx=0x7f9af0007e90 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:53.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.630+0000 7f9af4ff9700 1 -- 172.21.15.123:0/3037282711 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ae0052d70 con 0x7f9af806dc70 2024-09-13T17:06:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.794+0000 7f9afd742700 1 -- 172.21.15.123:0/3037282711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9adc005890 con 0x7f9af806dc70 2024-09-13T17:06:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.798+0000 7f9af4ff9700 1 -- 172.21.15.123:0/3037282711 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f9ae0056390 con 0x7f9af806dc70 2024-09-13T17:06:53.804 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:53.805 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:06:53.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.802+0000 7f9afd742700 1 -- 172.21.15.123:0/3037282711 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad8066730 msgr2=0x7f9ad8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.802+0000 7f9afd742700 1 --2- 172.21.15.123:0/3037282711 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad8066730 0x7f9ad8068bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9af0000f60 tx=0x7f9af0007e90 comp rx=0 tx=0).stop 2024-09-13T17:06:53.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.802+0000 7f9afd742700 1 -- 172.21.15.123:0/3037282711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af806dc70 msgr2=0x7f9af81e5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.802+0000 7f9afd742700 1 --2- 172.21.15.123:0/3037282711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af806dc70 0x7f9af81e5640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000b730 tx=0x7f9ae0004af0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.802+0000 7f9afd742700 1 -- 172.21.15.123:0/3037282711 shutdown_connections 2024-09-13T17:06:53.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.802+0000 7f9afd742700 1 --2- 172.21.15.123:0/3037282711 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad8066730 0x7f9ad8068bf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.802+0000 7f9afd742700 1 --2- 172.21.15.123:0/3037282711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af8155130 0x7f9af81579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.802+0000 7f9afd742700 1 --2- 172.21.15.123:0/3037282711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af806dc70 0x7f9af81e5640 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.802+0000 7f9afd742700 1 --2- 172.21.15.123:0/3037282711 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af806a260 0x7f9af81416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.802+0000 7f9afd742700 1 -- 172.21.15.123:0/3037282711 >> 172.21.15.123:0/3037282711 conn(0x7f9af806fa10 msgr2=0x7f9af80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:53.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.802+0000 7f9afd742700 1 -- 172.21.15.123:0/3037282711 shutdown_connections 2024-09-13T17:06:53.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.802+0000 7f9afd742700 1 -- 172.21.15.123:0/3037282711 wait complete. 2024-09-13T17:06:53.820 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T17:06:53.820 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T17:06:53.820 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T17:06:53.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T17:06:53.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T17:06:53.822 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T17:06:53.822 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T17:06:53.822 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T17:06:53.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f2b51d82700 1 Processor -- start 2024-09-13T17:06:53.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f4d16753700 1 Processor -- start 2024-09-13T17:06:53.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f4d16753700 1 -- start start 2024-09-13T17:06:53.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f2b51d82700 1 -- start start 2024-09-13T17:06:53.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f9803fff700 1 Processor -- start 2024-09-13T17:06:53.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f2b51d82700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b4c0ca950 0x7f2b4c0c1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f2b51d82700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c0c93b0 con 0x7f2b4c0cb090 2024-09-13T17:06:53.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f2b51d82700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c0cc580 con 0x7f2b4c0c8cd0 2024-09-13T17:06:53.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f2b51d82700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c0cd100 con 0x7f2b4c0ca950 2024-09-13T17:06:53.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f4d16753700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d100b0f40 0x7f4d10158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f2b51581700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b4c0ca950 0x7f2b4c0c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f2b51581700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b4c0ca950 0x7f2b4c0c1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46282/0 (socket says 172.21.15.123:46282) 2024-09-13T17:06:53.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f2b51581700 1 -- 172.21.15.123:0/1543559682 learned_addr learned my addr 172.21.15.123:0/1543559682 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:53.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f4d16753700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d100aecd0 con 0x7f4d100cae70 2024-09-13T17:06:53.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f4d16753700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d100c94e0 con 0x7f4d100cb700 2024-09-13T17:06:53.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f4d16753700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100c8ed0 con 0x7f4d100b0f40 2024-09-13T17:06:53.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f4d14cf0700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4d100cae70 0x7f4d10163c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49124/0 (socket says 172.21.15.123:49124) 2024-09-13T17:06:53.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f9803fff700 1 -- start start 2024-09-13T17:06:53.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.966+0000 7f4d14cf0700 1 -- 172.21.15.123:0/1210738261 learned_addr learned my addr 172.21.15.123:0/1210738261 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:53.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 -- 172.21.15.123:0/1210738261 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593343925 0 0) 0x7f4d100aecd0 con 0x7f4d100cae70 2024-09-13T17:06:53.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 -- 172.21.15.123:0/1210738261 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cf80035d0 con 0x7f4d100cae70 2024-09-13T17:06:53.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2b51581700 1 -- 172.21.15.123:0/1543559682 >> v1:172.21.15.153:6789/0 conn(0x7f2b4c0c8cd0 legacy=0x7f2b4c0c1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2b51581700 1 -- 172.21.15.123:0/1543559682 >> v1:172.21.15.123:6789/0 conn(0x7f2b4c0cb090 legacy=0x7f2b4c0cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:53.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2b51581700 1 -- 172.21.15.123:0/1543559682 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c1617b0 con 0x7f2b4c0ca950 2024-09-13T17:06:53.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 -- 172.21.15.123:0/1210738261 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3486313342 0 0) 0x7f4cf80035d0 con 0x7f4d100cae70 2024-09-13T17:06:53.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 -- 172.21.15.123:0/1210738261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d100b0f40 msgr2=0x7f4d10158ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:06:53.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 --2- 172.21.15.123:0/1210738261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d100b0f40 0x7f4d10158ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 -- 172.21.15.123:0/1210738261 >> v1:172.21.15.153:6789/0 conn(0x7f4d100cb700 legacy=0x7f4d100ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 -- 172.21.15.123:0/1210738261 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d100aef20 con 0x7f4d100cae70 2024-09-13T17:06:53.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 -- 172.21.15.123:0/1210738261 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f4d080019f0 con 0x7f4d100cae70 2024-09-13T17:06:53.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 -- 172.21.15.123:0/1210738261 >> v1:172.21.15.123:6789/0 conn(0x7f4d100cae70 legacy=0x7f4d10163c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 --2- 172.21.15.123:0/1210738261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf8003a50 0x7f4cf8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 --2- 172.21.15.123:0/1210738261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cf8004870 0x7f4cf8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 --2- 172.21.15.123:0/1210738261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf80052a0 0x7f4cf800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 -- 172.21.15.123:0/1210738261 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100c8ed0 con 0x7f4cf8003a50 2024-09-13T17:06:53.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 -- 172.21.15.123:0/1210738261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf800c160 con 0x7f4cf8004870 2024-09-13T17:06:53.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0effd700 1 -- 172.21.15.123:0/1210738261 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf800c320 con 0x7f4cf80052a0 2024-09-13T17:06:53.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2b51581700 1 --2- 172.21.15.123:0/1543559682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b4c0ca950 0x7f2b4c0c1990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009910 tx=0x7f2b3c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cb2358b7d23ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:53.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f659bfff700 1 Processor -- start 2024-09-13T17:06:53.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2ccb59e700 1 Processor -- start 2024-09-13T17:06:53.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9803fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f98040cb090 0x7f98040c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2ccb59e700 1 -- start start 2024-09-13T17:06:53.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9803fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f98040c1280 0x7f98040c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9803fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98040c93b0 con 0x7f98040ca950 2024-09-13T17:06:53.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9803fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98040cc580 con 0x7f98040cb090 2024-09-13T17:06:53.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9803fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98040cd100 con 0x7f98040c1280 2024-09-13T17:06:53.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9802ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f98040cb090 0x7f98040c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9802ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f98040cb090 0x7f98040c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46296/0 (socket says 172.21.15.123:46296) 2024-09-13T17:06:53.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9802ffd700 1 -- 172.21.15.123:0/1334093844 learned_addr learned my addr 172.21.15.123:0/1334093844 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:53.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f831cfd9700 1 Processor -- start 2024-09-13T17:06:53.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f98037fe700 1 --2- 172.21.15.123:0/1334093844 >> v2:172.21.15.153:3300/0 conn(0x7f98040c1280 0x7f98040c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0ffff700 1 --2- 172.21.15.123:0/1210738261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf8003a50 0x7f4cf8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f831cfd9700 1 -- start start 2024-09-13T17:06:53.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9802ffd700 1 -- 172.21.15.123:0/1334093844 >> v2:172.21.15.153:3300/0 conn(0x7f98040c1280 msgr2=0x7f98040c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:53.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9802ffd700 1 --2- 172.21.15.123:0/1334093844 >> v2:172.21.15.153:3300/0 conn(0x7f98040c1280 0x7f98040c1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9802ffd700 1 -- 172.21.15.123:0/1334093844 >> v1:172.21.15.153:6789/0 conn(0x7f98040ca950 legacy=0x7f98040cb470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:06:53.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d14cf0700 1 --2- 172.21.15.123:0/1210738261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf80052a0 0x7f4cf800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9802ffd700 1 -- 172.21.15.123:0/1334093844 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98041617b0 con 0x7f98040cb090 2024-09-13T17:06:53.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0ffff700 1 -- 172.21.15.123:0/1210738261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf80052a0 msgr2=0x7f4cf800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:53.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0ffff700 1 --2- 172.21.15.123:0/1210738261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf80052a0 0x7f4cf800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0ffff700 1 -- 172.21.15.123:0/1210738261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cf8004870 msgr2=0x7f4cf8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:53.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0ffff700 1 --2- 172.21.15.123:0/1210738261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cf8004870 0x7f4cf8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0ffff700 1 -- 172.21.15.123:0/1210738261 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d100aef20 con 0x7f4cf8003a50 2024-09-13T17:06:53.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9802ffd700 1 --2- 172.21.15.123:0/1334093844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98040cb090 0x7f98040c8cd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f980406e060 tx=0x7f97f4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e2a5d42c631be3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:53.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d14cf0700 1 --2- 172.21.15.123:0/1210738261 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf80052a0 0x7f4cf800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:53.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f659bfff700 1 -- start start 2024-09-13T17:06:53.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f4d0ffff700 1 --2- 172.21.15.123:0/1210738261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf8003a50 0x7f4cf8003e70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d100b1410 tx=0x7f4cf80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e2993c07eab9ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:53.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2ccb59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ccc165760 0x7f2ccc167b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2ccb59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ccc0d0cb0 con 0x7f2ccc0b58b0 2024-09-13T17:06:53.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2ccb59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ccc0b0060 con 0x7f2ccc0d0f40 2024-09-13T17:06:53.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2ccb59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0b0340 con 0x7f2ccc165760 2024-09-13T17:06:53.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2b4b7fe700 1 -- 172.21.15.123:0/1543559682 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c004230 con 0x7f2b4c0ca950 2024-09-13T17:06:53.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2b4b7fe700 1 -- 172.21.15.123:0/1543559682 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c004390 con 0x7f2b4c0ca950 2024-09-13T17:06:53.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2b4b7fe700 1 -- 172.21.15.123:0/1543559682 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c009e60 con 0x7f2b4c0ca950 2024-09-13T17:06:53.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f659bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f659c0c9110 0x7f659c0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f659bfff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659c0707d0 con 0x7f659c0c8cd0 2024-09-13T17:06:53.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f659bfff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659c0cd5e0 con 0x7f659c158fe0 2024-09-13T17:06:53.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f659bfff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659c0cd020 con 0x7f659c0c9110 2024-09-13T17:06:53.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2ccad9d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ccc165760 0x7f2ccc167b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2ccad9d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ccc165760 0x7f2ccc167b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:37502/0 (socket says 172.21.15.123:37502) 2024-09-13T17:06:53.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2ccad9d700 1 -- 172.21.15.123:0/2758512854 learned_addr learned my addr 172.21.15.123:0/2758512854 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:53.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f659affd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f659c158fe0 0x7f659c0cc580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:48352/0 (socket says 172.21.15.123:48352) 2024-09-13T17:06:53.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2cc959a700 1 -- 172.21.15.123:0/2758512854 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168980274 0 0) 0x7f2ccc0d0cb0 con 0x7f2ccc0b58b0 2024-09-13T17:06:53.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2cc959a700 1 -- 172.21.15.123:0/2758512854 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cb40035d0 con 0x7f2ccc0b58b0 2024-09-13T17:06:53.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f659affd700 1 -- 172.21.15.123:0/1983389320 learned_addr learned my addr 172.21.15.123:0/1983389320 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:53.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2ccad9d700 1 -- 172.21.15.123:0/2758512854 >> v1:172.21.15.153:6789/0 conn(0x7f2ccc0d0f40 legacy=0x7f2ccc0d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2ccad9d700 1 -- 172.21.15.123:0/2758512854 >> v1:172.21.15.123:6789/0 conn(0x7f2ccc0b58b0 legacy=0x7f2ccc0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2ccad9d700 1 -- 172.21.15.123:0/2758512854 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc0b0620 con 0x7f2ccc165760 2024-09-13T17:06:53.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f831cfd9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f83180cb090 0x7f83180cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f659b7fe700 1 --2- 172.21.15.123:0/1983389320 >> v2:172.21.15.123:3300/0 conn(0x7f659c0c9110 0x7f659c0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f831cfd9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83180c8cd0 0x7f83180cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f831cfd9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f831806bdb0 0x7f831806c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:53.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f831cfd9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83180caeb0 con 0x7f83180c8cd0 2024-09-13T17:06:53.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f831cfd9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83180cb9b0 con 0x7f83180cb090 2024-09-13T17:06:53.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f831cfd9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83180ca8f0 con 0x7f831806bdb0 2024-09-13T17:06:53.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f659b7fe700 1 -- 172.21.15.123:0/1983389320 >> v1:172.21.15.153:6789/0 conn(0x7f659c158fe0 legacy=0x7f659c0cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2b51d82700 1 -- 172.21.15.123:0/1543559682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b4c0ca950 msgr2=0x7f2b4c0c1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2b51d82700 1 --2- 172.21.15.123:0/1543559682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b4c0ca950 0x7f2b4c0c1990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009910 tx=0x7f2b3c009c20 comp rx=0 tx=0).stop 2024-09-13T17:06:53.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2ccad9d700 1 --2- 172.21.15.123:0/2758512854 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ccc165760 0x7f2ccc167b50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009e80 tx=0x7f2cc400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=655967de0c005060 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:53.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f659b7fe700 1 -- 172.21.15.123:0/1983389320 >> v1:172.21.15.123:6789/0 conn(0x7f659c0c8cd0 legacy=0x7f659c070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:53.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f659b7fe700 1 -- 172.21.15.123:0/1983389320 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c0cd300 con 0x7f659c0c9110 2024-09-13T17:06:53.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9801ffb700 1 -- 172.21.15.123:0/1334093844 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4004230 con 0x7f98040cb090 2024-09-13T17:06:53.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9801ffb700 1 -- 172.21.15.123:0/1334093844 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f4004390 con 0x7f98040cb090 2024-09-13T17:06:53.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f83177fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f83180cb090 0x7f83180cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f8316ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83180c8cd0 0x7f83180cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f83177fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f83180cb090 0x7f83180cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:37260/0 (socket says 172.21.15.123:37260) 2024-09-13T17:06:53.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f83177fe700 1 -- 172.21.15.123:0/3895349731 learned_addr learned my addr 172.21.15.123:0/3895349731 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:53.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f9801ffb700 1 -- 172.21.15.123:0/1334093844 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40036c0 con 0x7f98040cb090 2024-09-13T17:06:53.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f8317fff700 1 --2- 172.21.15.123:0/3895349731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f831806bdb0 0x7f831806c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:53.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2b51d82700 1 -- 172.21.15.123:0/1543559682 shutdown_connections 2024-09-13T17:06:53.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2b51d82700 1 --2- 172.21.15.123:0/1543559682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b4c0ca950 0x7f2b4c0c1990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.970+0000 7f2b51d82700 1 -- 172.21.15.123:0/1543559682 >> 172.21.15.123:0/1543559682 conn(0x7f2b4c0b01d0 msgr2=0x7f2b4c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:53.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f4d0effd700 1 -- 172.21.15.123:0/1210738261 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04015070 con 0x7f4cf8003a50 2024-09-13T17:06:53.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b51d82700 1 -- 172.21.15.123:0/1543559682 shutdown_connections 2024-09-13T17:06:53.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f4d0effd700 1 -- 172.21.15.123:0/1210738261 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d04011420 con 0x7f4cf8003a50 2024-09-13T17:06:53.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f4d0effd700 1 -- 172.21.15.123:0/1210738261 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d040092f0 con 0x7f4cf8003a50 2024-09-13T17:06:53.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2cc959a700 1 -- 172.21.15.123:0/2758512854 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc400e070 con 0x7f2ccc165760 2024-09-13T17:06:53.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b51d82700 1 -- 172.21.15.123:0/1543559682 wait complete. 2024-09-13T17:06:53.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2cc959a700 1 -- 172.21.15.123:0/2758512854 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc400b910 con 0x7f2ccc165760 2024-09-13T17:06:53.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2cc959a700 1 -- 172.21.15.123:0/2758512854 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc400bcc0 con 0x7f2ccc165760 2024-09-13T17:06:53.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f8317fff700 1 -- 172.21.15.123:0/3895349731 >> v2:172.21.15.153:3300/0 conn(0x7f83180cb090 msgr2=0x7f83180cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:53.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f8317fff700 1 --2- 172.21.15.123:0/3895349731 >> v2:172.21.15.153:3300/0 conn(0x7f83180cb090 0x7f83180cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f8317fff700 1 -- 172.21.15.123:0/3895349731 >> v2:172.21.15.123:3300/0 conn(0x7f83180c8cd0 msgr2=0x7f83180cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:53.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f9803fff700 1 -- 172.21.15.123:0/1334093844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98040cb090 msgr2=0x7f98040c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f9803fff700 1 --2- 172.21.15.123:0/1334093844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98040cb090 0x7f98040c8cd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f980406e060 tx=0x7f97f4009bf0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f659b7fe700 1 --2- 172.21.15.123:0/1983389320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f659c0c9110 0x7f659c0716a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f658c009260 tx=0x7f658c009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63a7935b8f0c5c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:53.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f6599ffb700 1 -- 172.21.15.123:0/1983389320 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c004230 con 0x7f659c0c9110 2024-09-13T17:06:53.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f8317fff700 1 --2- 172.21.15.123:0/3895349731 >> v2:172.21.15.123:3300/0 conn(0x7f83180c8cd0 0x7f83180cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f8317fff700 1 -- 172.21.15.123:0/3895349731 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180cabd0 con 0x7f831806bdb0 2024-09-13T17:06:53.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f8316ffd700 1 --2- 172.21.15.123:0/3895349731 >> v2:172.21.15.123:3300/0 conn(0x7f83180c8cd0 0x7f83180cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:53.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f6599ffb700 1 -- 172.21.15.123:0/1983389320 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c004390 con 0x7f659c0c9110 2024-09-13T17:06:53.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2ccb59e700 1 -- 172.21.15.123:0/2758512854 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ccc165760 msgr2=0x7f2ccc167b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2ccb59e700 1 --2- 172.21.15.123:0/2758512854 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ccc165760 0x7f2ccc167b50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009e80 tx=0x7f2cc400b330 comp rx=0 tx=0).stop 2024-09-13T17:06:53.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f6599ffb700 1 -- 172.21.15.123:0/1983389320 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c00c700 con 0x7f659c0c9110 2024-09-13T17:06:53.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f8317fff700 1 --2- 172.21.15.123:0/3895349731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f831806bdb0 0x7f831806c220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f83180b0c00 tx=0x7f8308009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bb9fb9caf867daa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:53.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f83167fc700 1 -- 172.21.15.123:0/3895349731 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8308011830 con 0x7f831806bdb0 2024-09-13T17:06:53.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f83167fc700 1 -- 172.21.15.123:0/3895349731 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8308011990 con 0x7f831806bdb0 2024-09-13T17:06:53.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f83167fc700 1 -- 172.21.15.123:0/3895349731 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8308011d20 con 0x7f831806bdb0 2024-09-13T17:06:53.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b51d82700 1 Processor -- start 2024-09-13T17:06:53.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f4d16753700 1 -- 172.21.15.123:0/1210738261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf8003a50 msgr2=0x7f4cf8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:53.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f4d16753700 1 --2- 172.21.15.123:0/1210738261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf8003a50 0x7f4cf8003e70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d100b1410 tx=0x7f4cf80058a0 comp rx=0 tx=0).stop 2024-09-13T17:06:53.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f4d14cf0700 1 -- 172.21.15.123:0/1210738261 reap_dead start 2024-09-13T17:06:53.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f4d16753700 1 -- 172.21.15.123:0/1210738261 shutdown_connections 2024-09-13T17:06:53.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f4d16753700 1 -- 172.21.15.123:0/1210738261 >> 172.21.15.123:0/1210738261 conn(0x7f4d100b0450 msgr2=0x7f4d100b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:53.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f4d16753700 1 -- 172.21.15.123:0/1210738261 shutdown_connections 2024-09-13T17:06:53.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f4d16753700 1 -- 172.21.15.123:0/1210738261 wait complete. 2024-09-13T17:06:53.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b51d82700 1 -- start start 2024-09-13T17:06:54.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f659bfff700 1 -- 172.21.15.123:0/1983389320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f659c0c9110 msgr2=0x7f659c0716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f9803fff700 1 -- 172.21.15.123:0/1334093844 shutdown_connections 2024-09-13T17:06:54.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f9803fff700 1 --2- 172.21.15.123:0/1334093844 >> v2:172.21.15.153:3300/0 conn(0x7f98040c1280 0x7f98040c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f9803fff700 1 --2- 172.21.15.123:0/1334093844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98040cb090 0x7f98040c8cd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f9803fff700 1 -- 172.21.15.123:0/1334093844 >> 172.21.15.123:0/1334093844 conn(0x7f98040b01d0 msgr2=0x7f98040b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f9803fff700 1 -- 172.21.15.123:0/1334093844 shutdown_connections 2024-09-13T17:06:54.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f659bfff700 1 --2- 172.21.15.123:0/1983389320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f659c0c9110 0x7f659c0716a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f658c009260 tx=0x7f658c009570 comp rx=0 tx=0).stop 2024-09-13T17:06:54.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f4d16753700 1 Processor -- start 2024-09-13T17:06:54.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f4d16753700 1 -- start start 2024-09-13T17:06:54.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f831cfd9700 1 -- 172.21.15.123:0/3895349731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f831806bdb0 msgr2=0x7f831806c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f831cfd9700 1 --2- 172.21.15.123:0/3895349731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f831806bdb0 0x7f831806c220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f83180b0c00 tx=0x7f8308009b30 comp rx=0 tx=0).stop 2024-09-13T17:06:54.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b51d82700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b4c0c8cd0 0x7f2b4c0b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b51d82700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b4c0ca950 0x7f2b4c1f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b51d82700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b4c0cb090 0x7f2b4c15c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b51d82700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c1f6c10 con 0x7f2b4c0c8cd0 2024-09-13T17:06:54.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b51d82700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c14c620 con 0x7f2b4c0cb090 2024-09-13T17:06:54.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b51d82700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c14d480 con 0x7f2b4c0ca950 2024-09-13T17:06:54.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f831cfd9700 1 -- 172.21.15.123:0/3895349731 shutdown_connections 2024-09-13T17:06:54.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f831cfd9700 1 --2- 172.21.15.123:0/3895349731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f831806bdb0 0x7f831806c220 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f831cfd9700 1 --2- 172.21.15.123:0/3895349731 >> v2:172.21.15.123:3300/0 conn(0x7f83180c8cd0 0x7f83180cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f831cfd9700 1 --2- 172.21.15.123:0/3895349731 >> v2:172.21.15.153:3300/0 conn(0x7f83180cb090 0x7f83180cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b50d80700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b4c0c8cd0 0x7f2b4c0b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b50d80700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b4c0c8cd0 0x7f2b4c0b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46326/0 (socket says 172.21.15.123:46326) 2024-09-13T17:06:54.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b50d80700 1 -- 172.21.15.123:0/3209225232 learned_addr learned my addr 172.21.15.123:0/3209225232 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f831cfd9700 1 -- 172.21.15.123:0/3895349731 >> 172.21.15.123:0/3895349731 conn(0x7f8318066780 msgr2=0x7f83180b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b51581700 1 --2- 172.21.15.123:0/3209225232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b4c0cb090 0x7f2b4c15c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b4bfff700 1 --2- 172.21.15.123:0/3209225232 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b4c0ca950 0x7f2b4c1f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b50d80700 1 -- 172.21.15.123:0/3209225232 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b4c0ca950 msgr2=0x7f2b4c1f66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b50d80700 1 --2- 172.21.15.123:0/3209225232 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b4c0ca950 0x7f2b4c1f66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b50d80700 1 -- 172.21.15.123:0/3209225232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b4c0cb090 msgr2=0x7f2b4c15c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b50d80700 1 --2- 172.21.15.123:0/3209225232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b4c0cb090 0x7f2b4c15c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f2b50d80700 1 -- 172.21.15.123:0/3209225232 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c009570 con 0x7f2b4c0c8cd0 2024-09-13T17:06:54.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f831cfd9700 1 -- 172.21.15.123:0/3895349731 shutdown_connections 2024-09-13T17:06:54.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f831cfd9700 1 -- 172.21.15.123:0/3895349731 wait complete. 2024-09-13T17:06:54.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.974+0000 7f9803fff700 1 -- 172.21.15.123:0/1334093844 wait complete. 2024-09-13T17:06:54.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f2b50d80700 1 --2- 172.21.15.123:0/3209225232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b4c0c8cd0 0x7f2b4c0b14d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000c4d0 tx=0x7f2b4000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d16753700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf8003a50 0x7f4d100aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d16753700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d100a8720 0x7f4d100c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d16753700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d100a8ba0 0x7f4d100c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d16753700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100c6e10 con 0x7f4d100a8720 2024-09-13T17:06:54.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d16753700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d101500f0 con 0x7f4d100a8ba0 2024-09-13T17:06:54.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d16753700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100c7060 con 0x7f4cf8003a50 2024-09-13T17:06:54.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f2ccb59e700 1 -- 172.21.15.123:0/2758512854 shutdown_connections 2024-09-13T17:06:54.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f2ccb59e700 1 --2- 172.21.15.123:0/2758512854 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ccc165760 0x7f2ccc167b50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f2ccb59e700 1 -- 172.21.15.123:0/2758512854 >> 172.21.15.123:0/2758512854 conn(0x7f2ccc0d2a60 msgr2=0x7f2ccc0d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f9803fff700 1 Processor -- start 2024-09-13T17:06:54.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f9803fff700 1 -- start start 2024-09-13T17:06:54.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d0f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d100a8720 0x7f4d100c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d0f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d100a8720 0x7f4d100c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46328/0 (socket says 172.21.15.123:46328) 2024-09-13T17:06:54.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d0f7fe700 1 -- 172.21.15.123:0/2616246519 learned_addr learned my addr 172.21.15.123:0/2616246519 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d14cf0700 1 --2- 172.21.15.123:0/2616246519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d100a8ba0 0x7f4d100c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d0f7fe700 1 -- 172.21.15.123:0/2616246519 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf8003a50 msgr2=0x7f4d100aa3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:06:54.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d0f7fe700 1 --2- 172.21.15.123:0/2616246519 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4cf8003a50 0x7f4d100aa3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d0f7fe700 1 -- 172.21.15.123:0/2616246519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d100a8ba0 msgr2=0x7f4d100c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d0f7fe700 1 --2- 172.21.15.123:0/2616246519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d100a8ba0 0x7f4d100c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d0f7fe700 1 -- 172.21.15.123:0/2616246519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d100c7340 con 0x7f4d100a8720 2024-09-13T17:06:54.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f2ccb59e700 1 -- 172.21.15.123:0/2758512854 shutdown_connections 2024-09-13T17:06:54.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f659bfff700 1 -- 172.21.15.123:0/1983389320 shutdown_connections 2024-09-13T17:06:54.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f659bfff700 1 --2- 172.21.15.123:0/1983389320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f659c0c9110 0x7f659c0716a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f659bfff700 1 -- 172.21.15.123:0/1983389320 >> 172.21.15.123:0/1983389320 conn(0x7f659c066780 msgr2=0x7f659c0b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f2b497fa700 1 -- 172.21.15.123:0/3209225232 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b400054e0 con 0x7f2b4c0c8cd0 2024-09-13T17:06:54.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f2b497fa700 1 -- 172.21.15.123:0/3209225232 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b400036a0 con 0x7f2b4c0c8cd0 2024-09-13T17:06:54.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f2b51d82700 1 -- 172.21.15.123:0/3209225232 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c14c870 con 0x7f2b4c0c8cd0 2024-09-13T17:06:54.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f2b497fa700 1 -- 172.21.15.123:0/3209225232 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40003a50 con 0x7f2b4c0c8cd0 2024-09-13T17:06:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f2ccb59e700 1 -- 172.21.15.123:0/2758512854 wait complete. 2024-09-13T17:06:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f9803fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98040c1280 0x7f9804160630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f9803fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98040ca950 0x7f9804162e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f9803fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98040cb090 0x7f980415fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f9803fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98040c28c0 con 0x7f98040cb090 2024-09-13T17:06:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f9803fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98041623b0 con 0x7f98040c1280 2024-09-13T17:06:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f9803fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98040c2b60 con 0x7f98040ca950 2024-09-13T17:06:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f9802ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98040c1280 0x7f9804160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f98037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98040cb090 0x7f980415fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f98027fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98040ca950 0x7f9804162e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f98037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98040cb090 0x7f980415fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46336/0 (socket says 172.21.15.123:46336) 2024-09-13T17:06:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f98037fe700 1 -- 172.21.15.123:0/3365567373 learned_addr learned my addr 172.21.15.123:0/3365567373 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f98037fe700 1 -- 172.21.15.123:0/3365567373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98040ca950 msgr2=0x7f9804162e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f98037fe700 1 --2- 172.21.15.123:0/3365567373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98040ca950 0x7f9804162e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f98037fe700 1 -- 172.21.15.123:0/3365567373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98040c1280 msgr2=0x7f9804160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f98037fe700 1 --2- 172.21.15.123:0/3365567373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98040c1280 0x7f9804160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f98037fe700 1 -- 172.21.15.123:0/3365567373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f4009570 con 0x7f98040cb090 2024-09-13T17:06:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d0f7fe700 1 --2- 172.21.15.123:0/2616246519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d100a8720 0x7f4d100c7e20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000c760 tx=0x7f4d0000cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d0cff9700 1 -- 172.21.15.123:0/2616246519 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d000052d0 con 0x7f4d100a8720 2024-09-13T17:06:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d0cff9700 1 -- 172.21.15.123:0/2616246519 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d00005430 con 0x7f4d100a8720 2024-09-13T17:06:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d16753700 1 -- 172.21.15.123:0/2616246519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d100c7620 con 0x7f4d100a8720 2024-09-13T17:06:54.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f831cfd9700 1 Processor -- start 2024-09-13T17:06:54.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f831cfd9700 1 -- start start 2024-09-13T17:06:54.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f659bfff700 1 -- 172.21.15.123:0/1983389320 shutdown_connections 2024-09-13T17:06:54.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f2b51d82700 1 -- 172.21.15.123:0/3209225232 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c14ce30 con 0x7f2b4c0c8cd0 2024-09-13T17:06:54.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7ffa0d66d700 1 Processor -- start 2024-09-13T17:06:54.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7ffa0d66d700 1 -- start start 2024-09-13T17:06:54.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7ffa0d66d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa080cb9a0 0x7ffa08163c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7ffa0d66d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa080aecd0 con 0x7ffa080cae70 2024-09-13T17:06:54.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7ffa0d66d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa080c94e0 con 0x7ffa08158ec0 2024-09-13T17:06:54.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7ffa0d66d700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa081592a0 con 0x7ffa080cb9a0 2024-09-13T17:06:54.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7ffa077fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa080cb9a0 0x7ffa08163c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7ffa077fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa080cb9a0 0x7ffa08163c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:37532/0 (socket says 172.21.15.123:37532) 2024-09-13T17:06:54.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7ffa077fe700 1 -- 172.21.15.123:0/2773802095 learned_addr learned my addr 172.21.15.123:0/2773802095 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f831cfd9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f831806bdb0 0x7f8318161fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f831cfd9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83180c8cd0 0x7f83180c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f831cfd9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83180cb090 0x7f8318163d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f831cfd9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83181625c0 con 0x7f83180c8cd0 2024-09-13T17:06:54.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f831cfd9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8318162f70 con 0x7f83180cb090 2024-09-13T17:06:54.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f831cfd9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8318163250 con 0x7f831806bdb0 2024-09-13T17:06:54.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f83177fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f831806bdb0 0x7f8318161fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f83177fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f831806bdb0 0x7f8318161fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:37540/0 (socket says 172.21.15.123:37540) 2024-09-13T17:06:54.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f83177fe700 1 -- 172.21.15.123:0/4182434748 learned_addr learned my addr 172.21.15.123:0/4182434748 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f2b51d82700 1 -- 172.21.15.123:0/3209225232 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b4c0cc7d0 con 0x7f2b4c0c8cd0 2024-09-13T17:06:54.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f98037fe700 1 --2- 172.21.15.123:0/3365567373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98040cb090 0x7f980415fdc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97fc007e60 tx=0x7f97fc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f8317fff700 1 --2- 172.21.15.123:0/4182434748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83180cb090 0x7f8318163d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7ffa077fe700 1 -- 172.21.15.123:0/2773802095 >> v1:172.21.15.153:6789/0 conn(0x7ffa08158ec0 legacy=0x7ffa080ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d0cff9700 1 -- 172.21.15.123:0/2616246519 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d000055a0 con 0x7f4d100a8720 2024-09-13T17:06:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f4d16753700 1 -- 172.21.15.123:0/2616246519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d100c88a0 con 0x7f4d100a8720 2024-09-13T17:06:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7ffa077fe700 1 -- 172.21.15.123:0/2773802095 >> v1:172.21.15.123:6789/0 conn(0x7ffa080cae70 legacy=0x7ffa080cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7ffa077fe700 1 -- 172.21.15.123:0/2773802095 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa080c8ed0 con 0x7ffa080cb9a0 2024-09-13T17:06:54.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f97eb7fe700 1 -- 172.21.15.123:0/3365567373 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc00ed30 con 0x7f98040cb090 2024-09-13T17:06:54.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f97eb7fe700 1 -- 172.21.15.123:0/3365567373 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc014420 con 0x7f98040cb090 2024-09-13T17:06:54.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f9803fff700 1 -- 172.21.15.123:0/3365567373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9804162670 con 0x7f98040cb090 2024-09-13T17:06:54.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f9803fff700 1 -- 172.21.15.123:0/3365567373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98040c4620 con 0x7f98040cb090 2024-09-13T17:06:54.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f8316ffd700 1 --2- 172.21.15.123:0/4182434748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83180c8cd0 0x7f83180c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f83177fe700 1 -- 172.21.15.123:0/4182434748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83180cb090 msgr2=0x7f8318163d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f83177fe700 1 --2- 172.21.15.123:0/4182434748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83180cb090 0x7f8318163d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f83177fe700 1 -- 172.21.15.123:0/4182434748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83180c8cd0 msgr2=0x7f83180c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f83177fe700 1 --2- 172.21.15.123:0/4182434748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83180c8cd0 0x7f83180c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f83177fe700 1 -- 172.21.15.123:0/4182434748 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c0094b0 con 0x7f831806bdb0 2024-09-13T17:06:54.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7ffa077fe700 1 --2- 172.21.15.123:0/2773802095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa080cb9a0 0x7ffa08163c50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00a9e0 tx=0x7ff9fc010730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4a62ce24104ae0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f2b497fa700 1 -- 172.21.15.123:0/3209225232 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b40003bb0 con 0x7f2b4c0c8cd0 2024-09-13T17:06:54.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f2b497fa700 1 --2- 172.21.15.123:0/3209225232 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2b38066800 0x7f2b38068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f2b497fa700 1 -- 172.21.15.123:0/3209225232 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b40083670 con 0x7f2b4c0c8cd0 2024-09-13T17:06:54.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f2b4bfff700 1 --2- 172.21.15.123:0/3209225232 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2b38066800 0x7f2b38068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f2ccb59e700 1 Processor -- start 2024-09-13T17:06:54.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f2b497fa700 1 --2- 172.21.15.123:0/3209225232 >> [v2:172.21.15.153:6824/2955379880,v1:172.21.15.153:6825/2955379880] conn(0x7f2b3806e9a0 0x7f2b38070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f2b497fa700 1 -- 172.21.15.123:0/3209225232 --> [v2:172.21.15.153:6824/2955379880,v1:172.21.15.153:6825/2955379880] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b38071470 con 0x7f2b3806e9a0 2024-09-13T17:06:54.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.978+0000 7f659bfff700 1 -- 172.21.15.123:0/1983389320 wait complete. 2024-09-13T17:06:54.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659bfff700 1 Processor -- start 2024-09-13T17:06:54.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659bfff700 1 -- start start 2024-09-13T17:06:54.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f83177fe700 1 --2- 172.21.15.123:0/4182434748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f831806bdb0 0x7f8318161fe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f831000efc0 tx=0x7f831000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f97eb7fe700 1 -- 172.21.15.123:0/3365567373 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc0147d0 con 0x7f98040cb090 2024-09-13T17:06:54.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f82fffff700 1 -- 172.21.15.123:0/4182434748 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000cb00 con 0x7f831806bdb0 2024-09-13T17:06:54.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f2b497fa700 1 -- 172.21.15.123:0/3209225232 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b400011e0 con 0x7f2b4c0c8cd0 2024-09-13T17:06:54.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f2b4bfff700 1 --2- 172.21.15.123:0/3209225232 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2b38066800 0x7f2b38068cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0b2d50 tx=0x7f2b44009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f82fffff700 1 -- 172.21.15.123:0/4182434748 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831000f040 con 0x7f831806bdb0 2024-09-13T17:06:54.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f82fffff700 1 -- 172.21.15.123:0/4182434748 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000ce60 con 0x7f831806bdb0 2024-09-13T17:06:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7ffa05ffb700 1 -- 172.21.15.123:0/2773802095 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc00ad30 con 0x7ffa080cb9a0 2024-09-13T17:06:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7ffa05ffb700 1 -- 172.21.15.123:0/2773802095 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc00ae90 con 0x7ffa080cb9a0 2024-09-13T17:06:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7ffa05ffb700 1 -- 172.21.15.123:0/2773802095 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc004250 con 0x7ffa080cb9a0 2024-09-13T17:06:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f2b51581700 1 --2- 172.21.15.123:0/3209225232 >> [v2:172.21.15.153:6824/2955379880,v1:172.21.15.153:6825/2955379880] conn(0x7f2b3806e9a0 0x7f2b38070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f2ccb59e700 1 -- start start 2024-09-13T17:06:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5e29e700 1 Processor -- start 2024-09-13T17:06:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5e29e700 1 -- start start 2024-09-13T17:06:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5e29e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e580cb260 0x7f3e580cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5e29e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e580c8cd0 0x7f3e580c9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5e29e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e580c9640 con 0x7f3e5815c9b0 2024-09-13T17:06:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5e29e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e580cbb80 con 0x7f3e580cb260 2024-09-13T17:06:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5e29e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5815a340 con 0x7f3e580c8cd0 2024-09-13T17:06:54.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5da9d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e580c8cd0 0x7f3e580c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5da9d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e580c8cd0 0x7f3e580c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:37546/0 (socket says 172.21.15.123:37546) 2024-09-13T17:06:54.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5da9d700 1 -- 172.21.15.123:0/385907775 learned_addr learned my addr 172.21.15.123:0/385907775 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5d29c700 1 --2- 172.21.15.123:0/385907775 >> v2:172.21.15.123:3300/0 conn(0x7f3e580cb260 0x7f3e580cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f4d0cff9700 1 -- 172.21.15.123:0/2616246519 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d000038e0 con 0x7f4d100a8720 2024-09-13T17:06:54.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f4d0cff9700 1 --2- 172.21.15.123:0/2616246519 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4cfc066800 0x7f4cfc068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f4d0cff9700 1 -- 172.21.15.123:0/2616246519 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d00083570 con 0x7f4d100a8720 2024-09-13T17:06:54.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f4d16753700 1 -- 172.21.15.123:0/2616246519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d100c71d0 con 0x7f4d100a8720 2024-09-13T17:06:54.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5da9d700 1 -- 172.21.15.123:0/385907775 >> v2:172.21.15.123:3300/0 conn(0x7f3e580cb260 msgr2=0x7f3e580cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:54.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5da9d700 1 --2- 172.21.15.123:0/385907775 >> v2:172.21.15.123:3300/0 conn(0x7f3e580cb260 0x7f3e580cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5da9d700 1 -- 172.21.15.123:0/385907775 >> v1:172.21.15.153:6789/0 conn(0x7f3e5815c9b0 legacy=0x7f3e58159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5da9d700 1 -- 172.21.15.123:0/385907775 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5815d1e0 con 0x7f3e580c8cd0 2024-09-13T17:06:54.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f2b51581700 1 --2- 172.21.15.123:0/3209225232 >> [v2:172.21.15.153:6824/2955379880,v1:172.21.15.153:6825/2955379880] conn(0x7f2b3806e9a0 0x7f2b38070dc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f4d0cff9700 1 --2- 172.21.15.123:0/2616246519 >> [v2:172.21.15.123:6816/2789168215,v1:172.21.15.123:6817/2789168215] conn(0x7f4cfc06e9a0 0x7f4cfc070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f3e5da9d700 1 --2- 172.21.15.123:0/385907775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e580c8cd0 0x7f3e580c9100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3e580b1010 tx=0x7f3e5000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e559993b25533972 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f4d0cff9700 1 -- 172.21.15.123:0/2616246519 --> [v2:172.21.15.123:6816/2789168215,v1:172.21.15.123:6817/2789168215] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4cfc071470 con 0x7f4cfc06e9a0 2024-09-13T17:06:54.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f4d0cff9700 1 -- 172.21.15.123:0/2616246519 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d000543e0 con 0x7f4d100a8720 2024-09-13T17:06:54.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7ffa0d66d700 1 -- 172.21.15.123:0/2773802095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa080cb9a0 msgr2=0x7ffa08163c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f4d0ffff700 1 --2- 172.21.15.123:0/2616246519 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4cfc066800 0x7f4cfc068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7ffa0d66d700 1 --2- 172.21.15.123:0/2773802095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa080cb9a0 0x7ffa08163c50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00a9e0 tx=0x7ff9fc010730 comp rx=0 tx=0).stop 2024-09-13T17:06:54.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f97eb7fe700 1 -- 172.21.15.123:0/3365567373 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f97fc014930 con 0x7f98040cb090 2024-09-13T17:06:54.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7ffa0d66d700 1 -- 172.21.15.123:0/2773802095 shutdown_connections 2024-09-13T17:06:54.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7ffa0d66d700 1 --2- 172.21.15.123:0/2773802095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa080cb9a0 0x7ffa08163c50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7ffa0d66d700 1 -- 172.21.15.123:0/2773802095 >> 172.21.15.123:0/2773802095 conn(0x7ffa080b0450 msgr2=0x7ffa080b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f659c0c8cd0 0x7f659c203030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f659c0c9110 0x7f659c203570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f659c158fe0 0x7f659c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659bfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c0b4260 con 0x7f659c158fe0 2024-09-13T17:06:54.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659bfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c0b3c30 con 0x7f659c0c9110 2024-09-13T17:06:54.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c0b1820 con 0x7f659c0c8cd0 2024-09-13T17:06:54.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659affd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f659c0c8cd0 0x7f659c203030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f659c158fe0 0x7f659c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659affd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f659c0c8cd0 0x7f659c203030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:37554/0 (socket says 172.21.15.123:37554) 2024-09-13T17:06:54.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659affd700 1 -- 172.21.15.123:0/4005334717 learned_addr learned my addr 172.21.15.123:0/4005334717 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659a7fc700 1 --2- 172.21.15.123:0/4005334717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f659c0c9110 0x7f659c203570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659b7fe700 1 -- 172.21.15.123:0/4005334717 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f659c0c8cd0 msgr2=0x7f659c203030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659b7fe700 1 --2- 172.21.15.123:0/4005334717 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f659c0c8cd0 0x7f659c203030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659b7fe700 1 -- 172.21.15.123:0/4005334717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f659c0c9110 msgr2=0x7f659c203570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659b7fe700 1 --2- 172.21.15.123:0/4005334717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f659c0c9110 0x7f659c203570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659b7fe700 1 -- 172.21.15.123:0/4005334717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c009d40 con 0x7f659c158fe0 2024-09-13T17:06:54.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659a7fc700 1 --2- 172.21.15.123:0/4005334717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f659c0c9110 0x7f659c203570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:54.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659b7fe700 1 --2- 172.21.15.123:0/4005334717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f659c158fe0 0x7f659c153650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f658c016000 tx=0x7f658c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f831cfd9700 1 -- 172.21.15.123:0/4182434748 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83080094b0 con 0x7f831806bdb0 2024-09-13T17:06:54.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f65837fe700 1 -- 172.21.15.123:0/4005334717 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c01d070 con 0x7f659c158fe0 2024-09-13T17:06:54.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f65837fe700 1 -- 172.21.15.123:0/4005334717 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c0041e0 con 0x7f659c158fe0 2024-09-13T17:06:54.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f65837fe700 1 -- 172.21.15.123:0/4005334717 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c006ea0 con 0x7f659c158fe0 2024-09-13T17:06:54.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7ffa0d66d700 1 -- 172.21.15.123:0/2773802095 shutdown_connections 2024-09-13T17:06:54.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f831cfd9700 1 -- 172.21.15.123:0/4182434748 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8318163810 con 0x7f831806bdb0 2024-09-13T17:06:54.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f97eb7fe700 1 --2- 172.21.15.123:0/3365567373 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97f0066780 0x7f97f0068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f97eb7fe700 1 -- 172.21.15.123:0/3365567373 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97fc084670 con 0x7f98040cb090 2024-09-13T17:06:54.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659bfff700 1 -- 172.21.15.123:0/4005334717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659c0b1b00 con 0x7f659c158fe0 2024-09-13T17:06:54.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f659bfff700 1 -- 172.21.15.123:0/4005334717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659c0b14d0 con 0x7f659c158fe0 2024-09-13T17:06:54.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f2ccb59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ccc0b58b0 0x7f2ccc155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f2ccb59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ccc0d0f40 0x7f2ccc0cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f4d14cf0700 1 --2- 172.21.15.123:0/2616246519 >> [v2:172.21.15.123:6816/2789168215,v1:172.21.15.123:6817/2789168215] conn(0x7f4cfc06e9a0 0x7f4cfc070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.982+0000 7f4d0ffff700 1 --2- 172.21.15.123:0/2616246519 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4cfc066800 0x7f4cfc068cc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4d100c4e70 tx=0x7f4d04010000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2ccb59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ccc165760 0x7f2ccc0ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2ccb59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc15d080 con 0x7f2ccc0d0f40 2024-09-13T17:06:54.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2ccb59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc15dc00 con 0x7f2ccc0b58b0 2024-09-13T17:06:54.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2ccb59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc15d2d0 con 0x7f2ccc165760 2024-09-13T17:06:54.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f9802ffd700 1 --2- 172.21.15.123:0/3365567373 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97f0066780 0x7f97f0068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f3e4ffff700 1 -- 172.21.15.123:0/385907775 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000e070 con 0x7f3e580c8cd0 2024-09-13T17:06:54.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f3e4ffff700 1 -- 172.21.15.123:0/385907775 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5000b8d0 con 0x7f3e580c8cd0 2024-09-13T17:06:54.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2cca59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ccc0b58b0 0x7f2ccc155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2cca59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ccc0b58b0 0x7f2ccc155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:37326/0 (socket says 172.21.15.123:37326) 2024-09-13T17:06:54.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2cca59c700 1 -- 172.21.15.123:0/675598386 learned_addr learned my addr 172.21.15.123:0/675598386 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2b497fa700 1 -- 172.21.15.123:0/3209225232 <== osd.6 v2:172.21.15.153:6824/2955379880 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2b38071470 con 0x7f2b3806e9a0 2024-09-13T17:06:54.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f3e4ffff700 1 -- 172.21.15.123:0/385907775 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000bc80 con 0x7f3e580c8cd0 2024-09-13T17:06:54.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2cc9d9b700 1 --2- 172.21.15.123:0/675598386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ccc0d0f40 0x7f2ccc0cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2cca59c700 1 -- 172.21.15.123:0/675598386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ccc165760 msgr2=0x7f2ccc0ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2cca59c700 1 --2- 172.21.15.123:0/675598386 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ccc165760 0x7f2ccc0ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2cca59c700 1 -- 172.21.15.123:0/675598386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ccc0d0f40 msgr2=0x7f2ccc0cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2cca59c700 1 --2- 172.21.15.123:0/675598386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ccc0d0f40 0x7f2ccc0cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2cca59c700 1 -- 172.21.15.123:0/675598386 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4009b30 con 0x7f2ccc0b58b0 2024-09-13T17:06:54.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f9803fff700 1 --2- 172.21.15.123:0/3365567373 >> [v2:172.21.15.123:6824/2043264613,v1:172.21.15.123:6825/2043264613] conn(0x7f97e40015e0 0x7f97e4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f98027fc700 1 --2- 172.21.15.123:0/3365567373 >> [v2:172.21.15.123:6824/2043264613,v1:172.21.15.123:6825/2043264613] conn(0x7f97e40015e0 0x7f97e4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f9803fff700 1 -- 172.21.15.123:0/3365567373 --> [v2:172.21.15.123:6824/2043264613,v1:172.21.15.123:6825/2043264613] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97e4006bf0 con 0x7f97e40015e0 2024-09-13T17:06:54.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f98027fc700 1 --2- 172.21.15.123:0/3365567373 >> [v2:172.21.15.123:6824/2043264613,v1:172.21.15.123:6825/2043264613] conn(0x7f97e40015e0 0x7f97e4003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f9802ffd700 1 --2- 172.21.15.123:0/3365567373 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97f0066780 0x7f97f0068c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f980406e060 tx=0x7f97f4008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f4d14cf0700 1 --2- 172.21.15.123:0/2616246519 >> [v2:172.21.15.123:6816/2789168215,v1:172.21.15.123:6817/2789168215] conn(0x7f4cfc06e9a0 0x7f4cfc070dc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f82fdffb700 1 -- 172.21.15.123:0/4182434748 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f82f0000fc0 con 0x7f831806bdb0 2024-09-13T17:06:54.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f659bfff700 1 -- 172.21.15.123:0/4005334717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f659c0c9580 con 0x7f659c158fe0 2024-09-13T17:06:54.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f3e5e29e700 1 -- 172.21.15.123:0/385907775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e580c8cd0 msgr2=0x7f3e580c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f3e5e29e700 1 --2- 172.21.15.123:0/385907775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e580c8cd0 0x7f3e580c9100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3e580b1010 tx=0x7f3e5000b330 comp rx=0 tx=0).stop 2024-09-13T17:06:54.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7ffa0d66d700 1 -- 172.21.15.123:0/2773802095 wait complete. 2024-09-13T17:06:54.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2cca59c700 1 --2- 172.21.15.123:0/675598386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ccc0b58b0 0x7f2ccc155790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00c500 tx=0x7f2cbc00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f4d0cff9700 1 -- 172.21.15.123:0/2616246519 <== osd.2 v2:172.21.15.123:6816/2789168215 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4cfc071470 con 0x7f4cfc06e9a0 2024-09-13T17:06:54.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7ffa0d66d700 1 Processor -- start 2024-09-13T17:06:54.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7ffa0d66d700 1 -- start start 2024-09-13T17:06:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f97eb7fe700 1 -- 172.21.15.123:0/3365567373 <== osd.1 v2:172.21.15.123:6824/2043264613 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f97e4006bf0 con 0x7f97e40015e0 2024-09-13T17:06:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f82fffff700 1 -- 172.21.15.123:0/4182434748 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8310014480 con 0x7f831806bdb0 2024-09-13T17:06:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f82fffff700 1 --2- 172.21.15.123:0/4182434748 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8304066780 0x7f8304068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f82fffff700 1 -- 172.21.15.123:0/4182434748 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8310084440 con 0x7f831806bdb0 2024-09-13T17:06:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f8316ffd700 1 --2- 172.21.15.123:0/4182434748 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8304066780 0x7f8304068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f82fffff700 1 --2- 172.21.15.123:0/4182434748 >> [v2:172.21.15.123:6808/2512830091,v1:172.21.15.123:6809/2512830091] conn(0x7f830406e9a0 0x7f8304070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f82fffff700 1 -- 172.21.15.123:0/4182434748 --> [v2:172.21.15.123:6808/2512830091,v1:172.21.15.123:6809/2512830091] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8304071470 con 0x7f830406e9a0 2024-09-13T17:06:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f82fffff700 1 -- 172.21.15.123:0/4182434748 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8310086b50 con 0x7f831806bdb0 2024-09-13T17:06:54.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f65837fe700 1 -- 172.21.15.123:0/4005334717 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f658c003b10 con 0x7f659c158fe0 2024-09-13T17:06:54.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2cbaffd700 1 -- 172.21.15.123:0/675598386 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc0052d0 con 0x7f2ccc0b58b0 2024-09-13T17:06:54.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f8317fff700 1 --2- 172.21.15.123:0/4182434748 >> [v2:172.21.15.123:6808/2512830091,v1:172.21.15.123:6809/2512830091] conn(0x7f830406e9a0 0x7f8304070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2cbaffd700 1 -- 172.21.15.123:0/675598386 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc005430 con 0x7f2ccc0b58b0 2024-09-13T17:06:54.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f2cbaffd700 1 -- 172.21.15.123:0/675598386 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc0055a0 con 0x7f2ccc0b58b0 2024-09-13T17:06:54.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f3e5e29e700 1 -- 172.21.15.123:0/385907775 shutdown_connections 2024-09-13T17:06:54.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f3e5e29e700 1 --2- 172.21.15.123:0/385907775 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e580c8cd0 0x7f3e580c9100 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f3e5e29e700 1 --2- 172.21.15.123:0/385907775 >> v2:172.21.15.123:3300/0 conn(0x7f3e580cb260 0x7f3e580cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f3e5e29e700 1 -- 172.21.15.123:0/385907775 >> 172.21.15.123:0/385907775 conn(0x7f3e580b01d0 msgr2=0x7f3e580b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f8316ffd700 1 --2- 172.21.15.123:0/4182434748 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8304066780 0x7f8304068c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f83180b37f0 tx=0x7f830c009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f65837fe700 1 --2- 172.21.15.123:0/4005334717 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6588066780 0x7f6588068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f2ccb59e700 1 -- 172.21.15.123:0/675598386 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ccc15d5b0 con 0x7f2ccc0b58b0 2024-09-13T17:06:54.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f8317fff700 1 --2- 172.21.15.123:0/4182434748 >> [v2:172.21.15.123:6808/2512830091,v1:172.21.15.123:6809/2512830091] conn(0x7f830406e9a0 0x7f8304070dc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f65837fe700 1 -- 172.21.15.123:0/4005334717 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f658c085870 con 0x7f659c158fe0 2024-09-13T17:06:54.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.986+0000 7f659affd700 1 --2- 172.21.15.123:0/4005334717 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6588066780 0x7f6588068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f65837fe700 1 --2- 172.21.15.123:0/4005334717 >> [v2:172.21.15.153:6816/639257190,v1:172.21.15.153:6817/639257190] conn(0x7f658806e9a0 0x7f6588070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f65837fe700 1 -- 172.21.15.123:0/4005334717 --> [v2:172.21.15.153:6816/639257190,v1:172.21.15.153:6817/639257190] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6588071470 con 0x7f658806e9a0 2024-09-13T17:06:54.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f65837fe700 1 -- 172.21.15.123:0/4005334717 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f658c085d10 con 0x7f659c158fe0 2024-09-13T17:06:54.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f2ccb59e700 1 -- 172.21.15.123:0/675598386 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ccc155cd0 con 0x7f2ccc0b58b0 2024-09-13T17:06:54.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f659affd700 1 --2- 172.21.15.123:0/4005334717 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6588066780 0x7f6588068c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6594005cb0 tx=0x7f6594009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa0d66d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa080cb9a0 0x7ffa080b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa0d66d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa08158ec0 0x7ffa082028e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa0d66d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa082030d0 0x7ffa08203560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa0d66d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa080c59e0 con 0x7ffa082030d0 2024-09-13T17:06:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa0d66d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa080b26a0 con 0x7ffa08158ec0 2024-09-13T17:06:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa0d66d700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa080b2970 con 0x7ffa080cb9a0 2024-09-13T17:06:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa077fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa082030d0 0x7ffa08203560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa077fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa082030d0 0x7ffa08203560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46394/0 (socket says 172.21.15.123:46394) 2024-09-13T17:06:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa077fe700 1 -- 172.21.15.123:0/3072871284 learned_addr learned my addr 172.21.15.123:0/3072871284 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa06ffd700 1 --2- 172.21.15.123:0/3072871284 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa080cb9a0 0x7ffa080b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa067fc700 1 --2- 172.21.15.123:0/3072871284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa08158ec0 0x7ffa082028e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa077fe700 1 -- 172.21.15.123:0/3072871284 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa080cb9a0 msgr2=0x7ffa080b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa077fe700 1 --2- 172.21.15.123:0/3072871284 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa080cb9a0 0x7ffa080b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa077fe700 1 -- 172.21.15.123:0/3072871284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa08158ec0 msgr2=0x7ffa082028e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa077fe700 1 --2- 172.21.15.123:0/3072871284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa08158ec0 0x7ffa082028e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa077fe700 1 -- 172.21.15.123:0/3072871284 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc00a610 con 0x7ffa082030d0 2024-09-13T17:06:54.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa077fe700 1 --2- 172.21.15.123:0/3072871284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa082030d0 0x7ffa08203560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00a930 tx=0x7ff9fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ff9ef7fe700 1 -- 172.21.15.123:0/3072871284 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc010070 con 0x7ffa082030d0 2024-09-13T17:06:54.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f82fffff700 1 -- 172.21.15.123:0/4182434748 <== osd.3 v2:172.21.15.123:6808/2512830091 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8304071470 con 0x7f830406e9a0 2024-09-13T17:06:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f3e5e29e700 1 -- 172.21.15.123:0/385907775 shutdown_connections 2024-09-13T17:06:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ff9ef7fe700 1 -- 172.21.15.123:0/3072871284 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc0038e0 con 0x7ffa082030d0 2024-09-13T17:06:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ff9ef7fe700 1 -- 172.21.15.123:0/3072871284 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc003c90 con 0x7ffa082030d0 2024-09-13T17:06:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f659a7fc700 1 --2- 172.21.15.123:0/4005334717 >> [v2:172.21.15.153:6816/639257190,v1:172.21.15.153:6817/639257190] conn(0x7f658806e9a0 0x7f6588070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f2cbaffd700 1 -- 172.21.15.123:0/675598386 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2cbc0038e0 con 0x7f2ccc0b58b0 2024-09-13T17:06:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f659a7fc700 1 --2- 172.21.15.123:0/4005334717 >> [v2:172.21.15.153:6816/639257190,v1:172.21.15.153:6817/639257190] conn(0x7f658806e9a0 0x7f6588070dc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f2cbaffd700 1 --2- 172.21.15.123:0/675598386 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2cac066780 0x7f2cac068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa0d66d700 1 -- 172.21.15.123:0/3072871284 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa080b2c50 con 0x7ffa082030d0 2024-09-13T17:06:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7ffa0d66d700 1 -- 172.21.15.123:0/3072871284 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa080b3210 con 0x7ffa082030d0 2024-09-13T17:06:54.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f2cbaffd700 1 -- 172.21.15.123:0/675598386 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cbc0835c0 con 0x7f2ccc0b58b0 2024-09-13T17:06:54.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.990+0000 7f3e5e29e700 1 -- 172.21.15.123:0/385907775 wait complete. 2024-09-13T17:06:54.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f2ccb59e700 1 --2- 172.21.15.123:0/675598386 >> [v2:172.21.15.123:6800/3880880552,v1:172.21.15.123:6801/3880880552] conn(0x7f2ccc152d50 0x7f2ccc1580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f2ccb59e700 1 -- 172.21.15.123:0/675598386 --> [v2:172.21.15.123:6800/3880880552,v1:172.21.15.123:6801/3880880552] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ccc0b0be0 con 0x7f2ccc152d50 2024-09-13T17:06:54.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f2ccad9d700 1 --2- 172.21.15.123:0/675598386 >> [v2:172.21.15.123:6800/3880880552,v1:172.21.15.123:6801/3880880552] conn(0x7f2ccc152d50 0x7f2ccc1580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f2ccad9d700 1 --2- 172.21.15.123:0/675598386 >> [v2:172.21.15.123:6800/3880880552,v1:172.21.15.123:6801/3880880552] conn(0x7f2ccc152d50 0x7f2ccc1580d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5e29e700 1 Processor -- start 2024-09-13T17:06:54.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f65837fe700 1 -- 172.21.15.123:0/4005334717 <== osd.4 v2:172.21.15.153:6816/639257190 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6588071470 con 0x7f658806e9a0 2024-09-13T17:06:54.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5e29e700 1 -- start start 2024-09-13T17:06:54.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f2cbaffd700 1 -- 172.21.15.123:0/675598386 <== osd.0 v2:172.21.15.123:6800/3880880552 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2cc40092e0 con 0x7f2ccc152d50 2024-09-13T17:06:54.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7ff9ef7fe700 1 -- 172.21.15.123:0/3072871284 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff9fc00b000 con 0x7ffa082030d0 2024-09-13T17:06:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5e29e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e580c8cd0 0x7f3e581530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5e29e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e580cb260 0x7f3e581fa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5e29e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e5815c9b0 0x7f3e5814faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5e29e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e581fac60 con 0x7f3e5815c9b0 2024-09-13T17:06:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5e29e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e581fb6f0 con 0x7f3e580cb260 2024-09-13T17:06:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5e29e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e581fae50 con 0x7f3e580c8cd0 2024-09-13T17:06:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5da9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e5815c9b0 0x7f3e5814faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5ca9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e580cb260 0x7f3e581fa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5da9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e5815c9b0 0x7f3e5814faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46396/0 (socket says 172.21.15.123:46396) 2024-09-13T17:06:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5da9d700 1 -- 172.21.15.123:0/551157909 learned_addr learned my addr 172.21.15.123:0/551157909 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5d29c700 1 --2- 172.21.15.123:0/551157909 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e580c8cd0 0x7f3e581530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7ff9ef7fe700 1 --2- 172.21.15.123:0/3072871284 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff9f4066800 0x7ff9f4068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7ff9ef7fe700 1 -- 172.21.15.123:0/3072871284 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9fc0852d0 con 0x7ffa082030d0 2024-09-13T17:06:54.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5ca9b700 1 -- 172.21.15.123:0/551157909 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e580c8cd0 msgr2=0x7f3e581530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5ca9b700 1 --2- 172.21.15.123:0/551157909 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e580c8cd0 0x7f3e581530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5ca9b700 1 -- 172.21.15.123:0/551157909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e5815c9b0 msgr2=0x7f3e5814faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5ca9b700 1 --2- 172.21.15.123:0/551157909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e5815c9b0 0x7f3e5814faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f3e5ca9b700 1 -- 172.21.15.123:0/551157909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50009b30 con 0x7f3e580cb260 2024-09-13T17:06:54.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f2cc9d9b700 1 --2- 172.21.15.123:0/675598386 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2cac066780 0x7f2cac068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.994+0000 7f2cc9d9b700 1 --2- 172.21.15.123:0/675598386 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2cac066780 0x7f2cac068c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0007fd0 tx=0x7f2cc0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.998+0000 7f3e5ca9b700 1 --2- 172.21.15.123:0/551157909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e580cb260 0x7f3e581fa720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800c490 tx=0x7f3e4800c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.998+0000 7ffa06ffd700 1 --2- 172.21.15.123:0/3072871284 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff9f4066800 0x7ff9f4068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.998+0000 7f3e4dffb700 1 -- 172.21.15.123:0/551157909 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4800cea0 con 0x7f3e580cb260 2024-09-13T17:06:54.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.998+0000 7f3e5e29e700 1 -- 172.21.15.123:0/551157909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e581fb130 con 0x7f3e580cb260 2024-09-13T17:06:54.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.998+0000 7f3e5e29e700 1 -- 172.21.15.123:0/551157909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e580b1650 con 0x7f3e580cb260 2024-09-13T17:06:54.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.998+0000 7f3e4dffb700 1 -- 172.21.15.123:0/551157909 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e480117b0 con 0x7f3e580cb260 2024-09-13T17:06:54.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.998+0000 7ffa06ffd700 1 --2- 172.21.15.123:0/3072871284 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff9f4066800 0x7ff9f4068cc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8009980 tx=0x7ff9f80090e0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.998+0000 7f3e4dffb700 1 -- 172.21.15.123:0/551157909 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48011b60 con 0x7f3e580cb260 2024-09-13T17:06:54.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:53.998+0000 7f3e4dffb700 1 -- 172.21.15.123:0/551157909 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e48011cc0 con 0x7f3e580cb260 2024-09-13T17:06:54.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.002+0000 7f3e5e29e700 1 -- 172.21.15.123:0/551157909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e3c000fc0 con 0x7f3e580cb260 2024-09-13T17:06:54.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.002+0000 7f3e4dffb700 1 --2- 172.21.15.123:0/551157909 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e440668d0 0x7f3e44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.002+0000 7f3e4dffb700 1 -- 172.21.15.123:0/551157909 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e48083d80 con 0x7f3e580cb260 2024-09-13T17:06:54.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.002+0000 7f3e5d29c700 1 --2- 172.21.15.123:0/551157909 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e440668d0 0x7f3e44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.002+0000 7f3e4dffb700 1 --2- 172.21.15.123:0/551157909 >> [v2:172.21.15.153:6800/1764587592,v1:172.21.15.153:6801/1764587592] conn(0x7f3e4406e900 0x7f3e44070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.002+0000 7f3e4dffb700 1 -- 172.21.15.123:0/551157909 --> [v2:172.21.15.153:6800/1764587592,v1:172.21.15.153:6801/1764587592] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e440713d0 con 0x7f3e4406e900 2024-09-13T17:06:54.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.002+0000 7f3e4dffb700 1 -- 172.21.15.123:0/551157909 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e480510f0 con 0x7f3e580cb260 2024-09-13T17:06:54.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.002+0000 7f3e5da9d700 1 --2- 172.21.15.123:0/551157909 >> [v2:172.21.15.153:6800/1764587592,v1:172.21.15.153:6801/1764587592] conn(0x7f3e4406e900 0x7f3e44070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.002+0000 7f3e5d29c700 1 --2- 172.21.15.123:0/551157909 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e440668d0 0x7f3e44068d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3e540044d0 tx=0x7f3e5400f040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.002+0000 7f3e5da9d700 1 --2- 172.21.15.123:0/551157909 >> [v2:172.21.15.153:6800/1764587592,v1:172.21.15.153:6801/1764587592] conn(0x7f3e4406e900 0x7f3e44070d20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.002+0000 7f3e4dffb700 1 -- 172.21.15.123:0/551157909 <== osd.5 v2:172.21.15.153:6800/1764587592 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3e440713d0 con 0x7f3e4406e900 2024-09-13T17:06:54.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.006+0000 7f2b51d82700 1 -- 172.21.15.123:0/3209225232 --> [v2:172.21.15.153:6824/2955379880,v1:172.21.15.153:6825/2955379880] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b4c0c9110 con 0x7f2b3806e9a0 2024-09-13T17:06:54.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.006+0000 7f2b497fa700 1 -- 172.21.15.123:0/3209225232 <== osd.6 v2:172.21.15.153:6824/2955379880 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2b3c004500 con 0x7f2b3806e9a0 2024-09-13T17:06:54.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.010+0000 7f2b51d82700 1 -- 172.21.15.123:0/3209225232 >> [v2:172.21.15.153:6824/2955379880,v1:172.21.15.153:6825/2955379880] conn(0x7f2b3806e9a0 msgr2=0x7f2b38070dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.010+0000 7f2b51d82700 1 --2- 172.21.15.123:0/3209225232 >> [v2:172.21.15.153:6824/2955379880,v1:172.21.15.153:6825/2955379880] conn(0x7f2b3806e9a0 0x7f2b38070dc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.010+0000 7f2b51d82700 1 -- 172.21.15.123:0/3209225232 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2b38066800 msgr2=0x7f2b38068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.010+0000 7f2b51d82700 1 --2- 172.21.15.123:0/3209225232 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2b38066800 0x7f2b38068cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0b2d50 tx=0x7f2b44009040 comp rx=0 tx=0).stop 2024-09-13T17:06:54.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.010+0000 7f2b51d82700 1 -- 172.21.15.123:0/3209225232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b4c0c8cd0 msgr2=0x7f2b4c0b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.010+0000 7f2b51d82700 1 --2- 172.21.15.123:0/3209225232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b4c0c8cd0 0x7f2b4c0b14d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000c4d0 tx=0x7f2b4000c890 comp rx=0 tx=0).stop 2024-09-13T17:06:54.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.010+0000 7f2b51581700 1 -- 172.21.15.123:0/3209225232 reap_dead start 2024-09-13T17:06:54.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.010+0000 7f2b51d82700 1 -- 172.21.15.123:0/3209225232 shutdown_connections 2024-09-13T17:06:54.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.010+0000 7f2b51d82700 1 -- 172.21.15.123:0/3209225232 >> 172.21.15.123:0/3209225232 conn(0x7f2b4c0b01d0 msgr2=0x7f2b4c0af410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.010+0000 7f2b51d82700 1 -- 172.21.15.123:0/3209225232 shutdown_connections 2024-09-13T17:06:54.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.010+0000 7f2b51d82700 1 -- 172.21.15.123:0/3209225232 wait complete. 2024-09-13T17:06:54.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.010+0000 7f9803fff700 1 -- 172.21.15.123:0/3365567373 --> [v2:172.21.15.123:6824/2043264613,v1:172.21.15.123:6825/2043264613] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f97e4005cd0 con 0x7f97e40015e0 2024-09-13T17:06:54.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.010+0000 7f97eb7fe700 1 -- 172.21.15.123:0/3365567373 <== osd.1 v2:172.21.15.123:6824/2043264613 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f97e4005cd0 con 0x7f97e40015e0 2024-09-13T17:06:54.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.006+0000 7ff9ed7fa700 1 --2- 172.21.15.123:0/3072871284 >> [v2:172.21.15.153:6808/1517292799,v1:172.21.15.153:6809/1517292799] conn(0x7ffa080cae70 0x7ffa080b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.006+0000 7ff9ed7fa700 1 -- 172.21.15.123:0/3072871284 --> [v2:172.21.15.153:6808/1517292799,v1:172.21.15.153:6809/1517292799] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa080af200 con 0x7ffa080cae70 2024-09-13T17:06:54.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.006+0000 7ffa067fc700 1 --2- 172.21.15.123:0/3072871284 >> [v2:172.21.15.153:6808/1517292799,v1:172.21.15.153:6809/1517292799] conn(0x7ffa080cae70 0x7ffa080b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.006+0000 7ffa067fc700 1 --2- 172.21.15.123:0/3072871284 >> [v2:172.21.15.153:6808/1517292799,v1:172.21.15.153:6809/1517292799] conn(0x7ffa080cae70 0x7ffa080b3830 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.006+0000 7ff9ef7fe700 1 -- 172.21.15.123:0/3072871284 <== osd.7 v2:172.21.15.153:6808/1517292799 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ffa00001bf0 con 0x7ffa080cae70 2024-09-13T17:06:54.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.014+0000 7f4d16753700 1 -- 172.21.15.123:0/2616246519 --> [v2:172.21.15.123:6816/2789168215,v1:172.21.15.123:6817/2789168215] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4d100c71d0 con 0x7f4cfc06e9a0 2024-09-13T17:06:54.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.014+0000 7f4d0cff9700 1 -- 172.21.15.123:0/2616246519 <== osd.2 v2:172.21.15.123:6816/2789168215 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4d100c71d0 con 0x7f4cfc06e9a0 2024-09-13T17:06:54.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.018+0000 7f82fdffb700 1 -- 172.21.15.123:0/4182434748 --> [v2:172.21.15.123:6808/2512830091,v1:172.21.15.123:6809/2512830091] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f82f0002d60 con 0x7f830406e9a0 2024-09-13T17:06:54.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.018+0000 7f4d16753700 1 -- 172.21.15.123:0/2616246519 >> [v2:172.21.15.123:6816/2789168215,v1:172.21.15.123:6817/2789168215] conn(0x7f4cfc06e9a0 msgr2=0x7f4cfc070dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.018+0000 7f4d16753700 1 --2- 172.21.15.123:0/2616246519 >> [v2:172.21.15.123:6816/2789168215,v1:172.21.15.123:6817/2789168215] conn(0x7f4cfc06e9a0 0x7f4cfc070dc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.018+0000 7f82fffff700 1 -- 172.21.15.123:0/4182434748 <== osd.3 v2:172.21.15.123:6808/2512830091 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f82f0002d60 con 0x7f830406e9a0 2024-09-13T17:06:54.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.018+0000 7f4d16753700 1 -- 172.21.15.123:0/2616246519 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4cfc066800 msgr2=0x7f4cfc068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.018+0000 7f4d16753700 1 --2- 172.21.15.123:0/2616246519 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4cfc066800 0x7f4cfc068cc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4d100c4e70 tx=0x7f4d04010000 comp rx=0 tx=0).stop 2024-09-13T17:06:54.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.018+0000 7f4d16753700 1 -- 172.21.15.123:0/2616246519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d100a8720 msgr2=0x7f4d100c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.018+0000 7f4d16753700 1 --2- 172.21.15.123:0/2616246519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d100a8720 0x7f4d100c7e20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000c760 tx=0x7f4d0000cb20 comp rx=0 tx=0).stop 2024-09-13T17:06:54.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.018+0000 7f4d14cf0700 1 -- 172.21.15.123:0/2616246519 reap_dead start 2024-09-13T17:06:54.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.018+0000 7f4d16753700 1 -- 172.21.15.123:0/2616246519 shutdown_connections 2024-09-13T17:06:54.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.018+0000 7f4d16753700 1 -- 172.21.15.123:0/2616246519 >> 172.21.15.123:0/2616246519 conn(0x7f4d100b0450 msgr2=0x7f4d100b3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.018+0000 7f4d16753700 1 -- 172.21.15.123:0/2616246519 shutdown_connections 2024-09-13T17:06:54.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.018+0000 7f4d16753700 1 -- 172.21.15.123:0/2616246519 wait complete. 2024-09-13T17:06:54.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f9803fff700 1 -- 172.21.15.123:0/3365567373 >> [v2:172.21.15.123:6824/2043264613,v1:172.21.15.123:6825/2043264613] conn(0x7f97e40015e0 msgr2=0x7f97e4003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f9803fff700 1 --2- 172.21.15.123:0/3365567373 >> [v2:172.21.15.123:6824/2043264613,v1:172.21.15.123:6825/2043264613] conn(0x7f97e40015e0 0x7f97e4003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f9803fff700 1 -- 172.21.15.123:0/3365567373 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97f0066780 msgr2=0x7f97f0068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f9803fff700 1 --2- 172.21.15.123:0/3365567373 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97f0066780 0x7f97f0068c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f980406e060 tx=0x7f97f4008030 comp rx=0 tx=0).stop 2024-09-13T17:06:54.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f9803fff700 1 -- 172.21.15.123:0/3365567373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98040cb090 msgr2=0x7f980415fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f9803fff700 1 --2- 172.21.15.123:0/3365567373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98040cb090 0x7f980415fdc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97fc007e60 tx=0x7f97fc00e3c0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f98037fe700 1 -- 172.21.15.123:0/3365567373 reap_dead start 2024-09-13T17:06:54.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f9803fff700 1 -- 172.21.15.123:0/3365567373 shutdown_connections 2024-09-13T17:06:54.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f9803fff700 1 -- 172.21.15.123:0/3365567373 >> 172.21.15.123:0/3365567373 conn(0x7f98040b01d0 msgr2=0x7f98040af940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f9803fff700 1 -- 172.21.15.123:0/3365567373 shutdown_connections 2024-09-13T17:06:54.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f9803fff700 1 -- 172.21.15.123:0/3365567373 wait complete. 2024-09-13T17:06:54.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f82fdffb700 1 -- 172.21.15.123:0/4182434748 >> [v2:172.21.15.123:6808/2512830091,v1:172.21.15.123:6809/2512830091] conn(0x7f830406e9a0 msgr2=0x7f8304070dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f82fdffb700 1 --2- 172.21.15.123:0/4182434748 >> [v2:172.21.15.123:6808/2512830091,v1:172.21.15.123:6809/2512830091] conn(0x7f830406e9a0 0x7f8304070dc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f82fdffb700 1 -- 172.21.15.123:0/4182434748 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8304066780 msgr2=0x7f8304068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f82fdffb700 1 --2- 172.21.15.123:0/4182434748 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8304066780 0x7f8304068c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f83180b37f0 tx=0x7f830c009240 comp rx=0 tx=0).stop 2024-09-13T17:06:54.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f82fdffb700 1 -- 172.21.15.123:0/4182434748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f831806bdb0 msgr2=0x7f8318161fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f82fdffb700 1 --2- 172.21.15.123:0/4182434748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f831806bdb0 0x7f8318161fe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f831000efc0 tx=0x7f831000c3a0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f8317fff700 1 -- 172.21.15.123:0/4182434748 reap_dead start 2024-09-13T17:06:54.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f659bfff700 1 -- 172.21.15.123:0/4005334717 --> [v2:172.21.15.153:6816/639257190,v1:172.21.15.153:6817/639257190] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f659c1593c0 con 0x7f658806e9a0 2024-09-13T17:06:54.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f82fdffb700 1 -- 172.21.15.123:0/4182434748 shutdown_connections 2024-09-13T17:06:54.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f82fdffb700 1 -- 172.21.15.123:0/4182434748 >> 172.21.15.123:0/4182434748 conn(0x7f8318066780 msgr2=0x7f83180ae910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f82fdffb700 1 -- 172.21.15.123:0/4182434748 shutdown_connections 2024-09-13T17:06:54.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f82fdffb700 1 -- 172.21.15.123:0/4182434748 wait complete. 2024-09-13T17:06:54.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f65837fe700 1 -- 172.21.15.123:0/4005334717 <== osd.4 v2:172.21.15.153:6816/639257190 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f65900050b0 con 0x7f658806e9a0 2024-09-13T17:06:54.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f65817fa700 1 -- 172.21.15.123:0/4005334717 >> [v2:172.21.15.153:6816/639257190,v1:172.21.15.153:6817/639257190] conn(0x7f658806e9a0 msgr2=0x7f6588070dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f65817fa700 1 --2- 172.21.15.123:0/4005334717 >> [v2:172.21.15.153:6816/639257190,v1:172.21.15.153:6817/639257190] conn(0x7f658806e9a0 0x7f6588070dc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f65817fa700 1 -- 172.21.15.123:0/4005334717 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6588066780 msgr2=0x7f6588068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f65817fa700 1 --2- 172.21.15.123:0/4005334717 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6588066780 0x7f6588068c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6594005cb0 tx=0x7f6594009040 comp rx=0 tx=0).stop 2024-09-13T17:06:54.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f65817fa700 1 -- 172.21.15.123:0/4005334717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f659c158fe0 msgr2=0x7f659c153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f65817fa700 1 --2- 172.21.15.123:0/4005334717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f659c158fe0 0x7f659c153650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f658c016000 tx=0x7f658c004770 comp rx=0 tx=0).stop 2024-09-13T17:06:54.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f659b7fe700 1 -- 172.21.15.123:0/4005334717 reap_dead start 2024-09-13T17:06:54.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f2ccb59e700 1 -- 172.21.15.123:0/675598386 --> [v2:172.21.15.123:6800/3880880552,v1:172.21.15.123:6801/3880880552] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2ccc15dd40 con 0x7f2ccc152d50 2024-09-13T17:06:54.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f65817fa700 1 -- 172.21.15.123:0/4005334717 shutdown_connections 2024-09-13T17:06:54.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f65817fa700 1 -- 172.21.15.123:0/4005334717 >> 172.21.15.123:0/4005334717 conn(0x7f659c066780 msgr2=0x7f659c0719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f65817fa700 1 -- 172.21.15.123:0/4005334717 shutdown_connections 2024-09-13T17:06:54.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.022+0000 7f65817fa700 1 -- 172.21.15.123:0/4005334717 wait complete. 2024-09-13T17:06:54.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.030+0000 7f2cbaffd700 1 -- 172.21.15.123:0/675598386 <== osd.0 v2:172.21.15.123:6800/3880880552 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2cc400bb00 con 0x7f2ccc152d50 2024-09-13T17:06:54.074 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-09-13T17:06:54.074 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T17:06:54.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.030+0000 7f2ccb59e700 1 -- 172.21.15.123:0/675598386 >> [v2:172.21.15.123:6800/3880880552,v1:172.21.15.123:6801/3880880552] conn(0x7f2ccc152d50 msgr2=0x7f2ccc1580d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.030+0000 7f2ccb59e700 1 --2- 172.21.15.123:0/675598386 >> [v2:172.21.15.123:6800/3880880552,v1:172.21.15.123:6801/3880880552] conn(0x7f2ccc152d50 0x7f2ccc1580d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.030+0000 7f2ccb59e700 1 -- 172.21.15.123:0/675598386 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2cac066780 msgr2=0x7f2cac068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.030+0000 7f2ccb59e700 1 --2- 172.21.15.123:0/675598386 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2cac066780 0x7f2cac068c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0007fd0 tx=0x7f2cc0009040 comp rx=0 tx=0).stop 2024-09-13T17:06:54.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.030+0000 7f2ccb59e700 1 -- 172.21.15.123:0/675598386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ccc0b58b0 msgr2=0x7f2ccc155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.030+0000 7f2ccb59e700 1 --2- 172.21.15.123:0/675598386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ccc0b58b0 0x7f2ccc155790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00c500 tx=0x7f2cbc00c8c0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.030+0000 7f2ccad9d700 1 -- 172.21.15.123:0/675598386 reap_dead start 2024-09-13T17:06:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.030+0000 7f2ccb59e700 1 -- 172.21.15.123:0/675598386 shutdown_connections 2024-09-13T17:06:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.030+0000 7f2ccb59e700 1 -- 172.21.15.123:0/675598386 >> 172.21.15.123:0/675598386 conn(0x7f2ccc0d2a60 msgr2=0x7f2ccc0cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.030+0000 7f2ccb59e700 1 -- 172.21.15.123:0/675598386 shutdown_connections 2024-09-13T17:06:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.030+0000 7f2ccb59e700 1 -- 172.21.15.123:0/675598386 wait complete. 2024-09-13T17:06:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.034+0000 7f3e5e29e700 1 -- 172.21.15.123:0/551157909 --> [v2:172.21.15.153:6800/1764587592,v1:172.21.15.153:6801/1764587592] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3e38000f80 con 0x7f3e4406e900 2024-09-13T17:06:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.034+0000 7f3e4dffb700 1 -- 172.21.15.123:0/551157909 <== osd.5 v2:172.21.15.153:6800/1764587592 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3e38000f80 con 0x7f3e4406e900 2024-09-13T17:06:54.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.038+0000 7ff9ed7fa700 1 -- 172.21.15.123:0/3072871284 --> [v2:172.21.15.153:6808/1517292799,v1:172.21.15.153:6809/1517292799] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffa080b0f40 con 0x7ffa080cae70 2024-09-13T17:06:54.077 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-09-13T17:06:54.078 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T17:06:54.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.038+0000 7ff9ef7fe700 1 -- 172.21.15.123:0/3072871284 <== osd.7 v2:172.21.15.153:6808/1517292799 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffa00002030 con 0x7ffa080cae70 2024-09-13T17:06:54.079 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-09-13T17:06:54.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T17:06:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.038+0000 7ff9ed7fa700 1 -- 172.21.15.123:0/3072871284 >> [v2:172.21.15.153:6808/1517292799,v1:172.21.15.153:6809/1517292799] conn(0x7ffa080cae70 msgr2=0x7ffa080b3830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.038+0000 7ff9ed7fa700 1 --2- 172.21.15.123:0/3072871284 >> [v2:172.21.15.153:6808/1517292799,v1:172.21.15.153:6809/1517292799] conn(0x7ffa080cae70 0x7ffa080b3830 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.038+0000 7ff9ed7fa700 1 -- 172.21.15.123:0/3072871284 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff9f4066800 msgr2=0x7ff9f4068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.038+0000 7ff9ed7fa700 1 --2- 172.21.15.123:0/3072871284 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff9f4066800 0x7ff9f4068cc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8009980 tx=0x7ff9f80090e0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.038+0000 7ff9ed7fa700 1 -- 172.21.15.123:0/3072871284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa082030d0 msgr2=0x7ffa08203560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.038+0000 7ff9ed7fa700 1 --2- 172.21.15.123:0/3072871284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa082030d0 0x7ffa08203560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00a930 tx=0x7ff9fc004770 comp rx=0 tx=0).stop 2024-09-13T17:06:54.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.038+0000 7ffa077fe700 1 -- 172.21.15.123:0/3072871284 reap_dead start 2024-09-13T17:06:54.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.038+0000 7ff9ed7fa700 1 -- 172.21.15.123:0/3072871284 shutdown_connections 2024-09-13T17:06:54.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.038+0000 7ff9ed7fa700 1 -- 172.21.15.123:0/3072871284 >> 172.21.15.123:0/3072871284 conn(0x7ffa080b0450 msgr2=0x7ffa0815c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.038+0000 7ff9ed7fa700 1 -- 172.21.15.123:0/3072871284 shutdown_connections 2024-09-13T17:06:54.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.038+0000 7ff9ed7fa700 1 -- 172.21.15.123:0/3072871284 wait complete. 2024-09-13T17:06:54.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.046+0000 7f3e5e29e700 1 -- 172.21.15.123:0/551157909 >> [v2:172.21.15.153:6800/1764587592,v1:172.21.15.153:6801/1764587592] conn(0x7f3e4406e900 msgr2=0x7f3e44070d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.046+0000 7f3e5e29e700 1 --2- 172.21.15.123:0/551157909 >> [v2:172.21.15.153:6800/1764587592,v1:172.21.15.153:6801/1764587592] conn(0x7f3e4406e900 0x7f3e44070d20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.046+0000 7f3e5e29e700 1 -- 172.21.15.123:0/551157909 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e440668d0 msgr2=0x7f3e44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.046+0000 7f3e5e29e700 1 --2- 172.21.15.123:0/551157909 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e440668d0 0x7f3e44068d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3e540044d0 tx=0x7f3e5400f040 comp rx=0 tx=0).stop 2024-09-13T17:06:54.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.046+0000 7f3e5e29e700 1 -- 172.21.15.123:0/551157909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e580cb260 msgr2=0x7f3e581fa720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.046+0000 7f3e5e29e700 1 --2- 172.21.15.123:0/551157909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e580cb260 0x7f3e581fa720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800c490 tx=0x7f3e4800c7a0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.046+0000 7f3e5da9d700 1 -- 172.21.15.123:0/551157909 reap_dead start 2024-09-13T17:06:54.082 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2024-09-13T17:06:54.083 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T17:06:54.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.046+0000 7f3e5e29e700 1 -- 172.21.15.123:0/551157909 shutdown_connections 2024-09-13T17:06:54.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.046+0000 7f3e5e29e700 1 -- 172.21.15.123:0/551157909 >> 172.21.15.123:0/551157909 conn(0x7f3e580b01d0 msgr2=0x7f3e58158270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.046+0000 7f3e5e29e700 1 -- 172.21.15.123:0/551157909 shutdown_connections 2024-09-13T17:06:54.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.046+0000 7f3e5e29e700 1 -- 172.21.15.123:0/551157909 wait complete. 2024-09-13T17:06:54.084 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2024-09-13T17:06:54.084 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T17:06:54.085 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2024-09-13T17:06:54.086 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T17:06:54.086 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2024-09-13T17:06:54.087 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T17:06:54.087 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2024-09-13T17:06:54.088 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T17:06:54.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7fd86e6ca700 1 Processor -- start 2024-09-13T17:06:54.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f9216ffe700 1 Processor -- start 2024-09-13T17:06:54.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f9216ffe700 1 -- start start 2024-09-13T17:06:54.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f9216ffe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f921008aab0 0x7f92100ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f9216ffe700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92100c8e70 con 0x7f92100adae0 2024-09-13T17:06:54.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f9216ffe700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92100cae60 con 0x7f92100722d0 2024-09-13T17:06:54.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f9216ffe700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92100adf40 con 0x7f921008aab0 2024-09-13T17:06:54.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f9214d9a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f921008aab0 0x7f92100ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f9214d9a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f921008aab0 0x7f92100ce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46410/0 (socket says 172.21.15.123:46410) 2024-09-13T17:06:54.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f9214d9a700 1 -- 172.21.15.123:0/2233712671 learned_addr learned my addr 172.21.15.123:0/2233712671 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f9214d9a700 1 -- 172.21.15.123:0/2233712671 >> v1:172.21.15.153:6789/0 conn(0x7f92100722d0 legacy=0x7f9210070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f9214d9a700 1 -- 172.21.15.123:0/2233712671 >> v1:172.21.15.123:6789/0 conn(0x7f92100adae0 legacy=0x7f9210071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:54.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7fd86e6ca700 1 -- start start 2024-09-13T17:06:54.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f9214d9a700 1 -- 172.21.15.123:0/2233712671 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92100c9110 con 0x7f921008aab0 2024-09-13T17:06:54.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7fd86e6ca700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd8680c8cd0 0x7fd8680c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7fd86e6ca700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd868070f90 0x7fd868071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7fd86e6ca700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8680c9650 con 0x7fd868158fe0 2024-09-13T17:06:54.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7fd86e6ca700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8680707d0 con 0x7fd868070f90 2024-09-13T17:06:54.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7fd86e6ca700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8680cd5e0 con 0x7fd8680c8cd0 2024-09-13T17:06:54.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f9214d9a700 1 --2- 172.21.15.123:0/2233712671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f921008aab0 0x7f92100ce040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f92080061e0 tx=0x7f9208007b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975e18a867d3c104 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7fd86cc67700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd868070f90 0x7fd868071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7fd86cc67700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd868070f90 0x7fd868071400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46420/0 (socket says 172.21.15.123:46420) 2024-09-13T17:06:54.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7fd86cc67700 1 -- 172.21.15.123:0/1631764085 learned_addr learned my addr 172.21.15.123:0/1631764085 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7fd8677fe700 1 --2- 172.21.15.123:0/1631764085 >> v2:172.21.15.153:3300/0 conn(0x7fd8680c8cd0 0x7fd8680c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f920f7fe700 1 -- 172.21.15.123:0/2233712671 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208011070 con 0x7f921008aab0 2024-09-13T17:06:54.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.266+0000 7f920f7fe700 1 -- 172.21.15.123:0/2233712671 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920800cc30 con 0x7f921008aab0 2024-09-13T17:06:54.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f920f7fe700 1 -- 172.21.15.123:0/2233712671 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208017420 con 0x7f921008aab0 2024-09-13T17:06:54.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd86cc67700 1 -- 172.21.15.123:0/1631764085 >> v2:172.21.15.153:3300/0 conn(0x7fd8680c8cd0 msgr2=0x7fd8680c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:54.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd86cc67700 1 --2- 172.21.15.123:0/1631764085 >> v2:172.21.15.153:3300/0 conn(0x7fd8680c8cd0 0x7fd8680c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd86cc67700 1 -- 172.21.15.123:0/1631764085 >> v1:172.21.15.153:6789/0 conn(0x7fd868158fe0 legacy=0x7fd8680cc580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:06:54.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd86cc67700 1 -- 172.21.15.123:0/1631764085 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8680cd020 con 0x7fd868070f90 2024-09-13T17:06:54.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd86cc67700 1 --2- 172.21.15.123:0/1631764085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd868070f90 0x7fd868071400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd8680ae080 tx=0x7fd858009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7805bdb021bbe9e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd866ffd700 1 -- 172.21.15.123:0/1631764085 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858004230 con 0x7fd868070f90 2024-09-13T17:06:54.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f78facb8700 1 Processor -- start 2024-09-13T17:06:54.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f9216ffe700 1 -- 172.21.15.123:0/2233712671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f921008aab0 msgr2=0x7f92100ce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f9216ffe700 1 --2- 172.21.15.123:0/2233712671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f921008aab0 0x7f92100ce040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f92080061e0 tx=0x7f9208007b30 comp rx=0 tx=0).stop 2024-09-13T17:06:54.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd866ffd700 1 -- 172.21.15.123:0/1631764085 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd858004390 con 0x7fd868070f90 2024-09-13T17:06:54.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd866ffd700 1 -- 172.21.15.123:0/1631764085 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8580036c0 con 0x7fd868070f90 2024-09-13T17:06:54.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f9216ffe700 1 -- 172.21.15.123:0/2233712671 shutdown_connections 2024-09-13T17:06:54.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f9216ffe700 1 --2- 172.21.15.123:0/2233712671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f921008aab0 0x7f92100ce040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f9216ffe700 1 -- 172.21.15.123:0/2233712671 >> 172.21.15.123:0/2233712671 conn(0x7f9210066780 msgr2=0x7f92100b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1631764085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd868070f90 msgr2=0x7fd868071400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd86e6ca700 1 --2- 172.21.15.123:0/1631764085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd868070f90 0x7fd868071400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd8680ae080 tx=0x7fd858009bf0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f9216ffe700 1 -- 172.21.15.123:0/2233712671 shutdown_connections 2024-09-13T17:06:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f9216ffe700 1 -- 172.21.15.123:0/2233712671 wait complete. 2024-09-13T17:06:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1631764085 shutdown_connections 2024-09-13T17:06:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd86e6ca700 1 --2- 172.21.15.123:0/1631764085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd868070f90 0x7fd868071400 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd86e6ca700 1 --2- 172.21.15.123:0/1631764085 >> v2:172.21.15.153:3300/0 conn(0x7fd8680c8cd0 0x7fd8680c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1631764085 >> 172.21.15.123:0/1631764085 conn(0x7fd868066780 msgr2=0x7fd8680b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f78facb8700 1 -- start start 2024-09-13T17:06:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f78facb8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78f40c8cd0 0x7f78f40c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f78facb8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f78f4070f90 0x7f78f4071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f78facb8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f40c9650 con 0x7f78f4158fe0 2024-09-13T17:06:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f78facb8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f40707d0 con 0x7f78f4070f90 2024-09-13T17:06:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f78facb8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40cd5e0 con 0x7f78f40c8cd0 2024-09-13T17:06:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f78f8a54700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f78f4158fe0 0x7f78f40cc580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49164/0 (socket says 172.21.15.123:49164) 2024-09-13T17:06:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f78f8a54700 1 -- 172.21.15.123:0/171284724 learned_addr learned my addr 172.21.15.123:0/171284724 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:54.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1631764085 shutdown_connections 2024-09-13T17:06:54.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f78f9255700 1 --2- 172.21.15.123:0/171284724 >> v2:172.21.15.123:3300/0 conn(0x7f78f4070f90 0x7f78f4071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f78f9255700 1 -- 172.21.15.123:0/171284724 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78f40c8cd0 msgr2=0x7f78f40c9110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:06:54.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f78f9255700 1 --2- 172.21.15.123:0/171284724 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78f40c8cd0 0x7f78f40c9110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f78f9255700 1 -- 172.21.15.123:0/171284724 >> v1:172.21.15.123:6789/0 conn(0x7f78f4158fe0 legacy=0x7f78f40cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f78f9255700 1 -- 172.21.15.123:0/171284724 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f40cd020 con 0x7f78f4070f90 2024-09-13T17:06:54.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7f9216ffe700 1 Processor -- start 2024-09-13T17:06:54.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f78f9255700 1 --2- 172.21.15.123:0/171284724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f4070f90 0x7f78f4071420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009850 tx=0x7f78e4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bfaba81e415e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.270+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1631764085 wait complete. 2024-09-13T17:06:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd86e6ca700 1 Processor -- start 2024-09-13T17:06:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f78f37fe700 1 -- 172.21.15.123:0/171284724 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e4004230 con 0x7f78f4070f90 2024-09-13T17:06:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f78f37fe700 1 -- 172.21.15.123:0/171284724 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e4004390 con 0x7f78f4070f90 2024-09-13T17:06:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f9216ffe700 1 -- start start 2024-09-13T17:06:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f9216ffe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92100722d0 0x7f921020b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f9216ffe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f921008aab0 0x7f921016a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f9216ffe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92100adae0 0x7f92101675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f78f37fe700 1 -- 172.21.15.123:0/171284724 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e40036c0 con 0x7f78f4070f90 2024-09-13T17:06:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f9214d9a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92100722d0 0x7f921020b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd86e6ca700 1 -- start start 2024-09-13T17:06:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f9214d9a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92100722d0 0x7f921020b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:37354/0 (socket says 172.21.15.123:37354) 2024-09-13T17:06:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd86e6ca700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd868070f90 0x7fd868152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f78facb8700 1 -- 172.21.15.123:0/171284724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f4070f90 msgr2=0x7f78f4071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f78facb8700 1 --2- 172.21.15.123:0/171284724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f4070f90 0x7f78f4071420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009850 tx=0x7f78e4009b60 comp rx=0 tx=0).stop 2024-09-13T17:06:54.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f921559b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92100adae0 0x7f92101675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f921559b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92100adae0 0x7f92101675b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46442/0 (socket says 172.21.15.123:46442) 2024-09-13T17:06:54.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f920ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f921008aab0 0x7f921016a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f920ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f921008aab0 0x7f921016a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:37606/0 (socket says 172.21.15.123:37606) 2024-09-13T17:06:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd867fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd868070f90 0x7fd868152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd867fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd868070f90 0x7fd868152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46444/0 (socket says 172.21.15.123:46444) 2024-09-13T17:06:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f78facb8700 1 -- 172.21.15.123:0/171284724 shutdown_connections 2024-09-13T17:06:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f78facb8700 1 --2- 172.21.15.123:0/171284724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f4070f90 0x7f78f4071420 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f78facb8700 1 --2- 172.21.15.123:0/171284724 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78f40c8cd0 0x7f78f40c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f78facb8700 1 -- 172.21.15.123:0/171284724 >> 172.21.15.123:0/171284724 conn(0x7f78f4066780 msgr2=0x7f78f40b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd86e6ca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8680c8cd0 0x7fd8680c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd867fff700 1 -- 172.21.15.123:0/1843891216 learned_addr learned my addr 172.21.15.123:0/1843891216 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd86e6ca700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd868158fe0 0x7fd868159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f78facb8700 1 -- 172.21.15.123:0/171284724 shutdown_connections 2024-09-13T17:06:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1843891216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8680c2800 con 0x7fd868070f90 2024-09-13T17:06:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1843891216 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8680b1670 con 0x7fd8680c8cd0 2024-09-13T17:06:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1843891216 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8680b1950 con 0x7fd868158fe0 2024-09-13T17:06:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f78facb8700 1 -- 172.21.15.123:0/171284724 wait complete. 2024-09-13T17:06:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f9216ffe700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92100c86f0 con 0x7f92100adae0 2024-09-13T17:06:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f9216ffe700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921020b5e0 con 0x7f92100722d0 2024-09-13T17:06:54.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7f9216ffe700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921016a730 con 0x7f921008aab0 2024-09-13T17:06:54.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd8677fe700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8680c8cd0 0x7fd8680c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd86cc67700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd868158fe0 0x7fd868159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd867fff700 1 -- 172.21.15.123:0/1843891216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd868158fe0 msgr2=0x7fd868159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd867fff700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd868158fe0 0x7fd868159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd867fff700 1 -- 172.21.15.123:0/1843891216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8680c8cd0 msgr2=0x7fd8680c22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd867fff700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8680c8cd0 0x7fd8680c22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd867fff700 1 -- 172.21.15.123:0/1843891216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd858009570 con 0x7fd868070f90 2024-09-13T17:06:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd867fff700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd868070f90 0x7fd868152d60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00b4a0 tx=0x7fd85c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd864ff9700 1 -- 172.21.15.123:0/1843891216 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c011830 con 0x7fd868070f90 2024-09-13T17:06:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd864ff9700 1 -- 172.21.15.123:0/1843891216 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c0119b0 con 0x7fd868070f90 2024-09-13T17:06:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd864ff9700 1 -- 172.21.15.123:0/1843891216 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c011d60 con 0x7fd868070f90 2024-09-13T17:06:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1843891216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8680b1c30 con 0x7fd868070f90 2024-09-13T17:06:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.274+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1843891216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86815a490 con 0x7fd868070f90 2024-09-13T17:06:54.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78facb8700 1 Processor -- start 2024-09-13T17:06:54.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fbf173cb700 1 Processor -- start 2024-09-13T17:06:54.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1843891216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd848005310 con 0x7fd868070f90 2024-09-13T17:06:54.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f9214d9a700 1 -- 172.21.15.123:0/3097715777 learned_addr learned my addr 172.21.15.123:0/3097715777 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff394dbb700 1 Processor -- start 2024-09-13T17:06:54.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff394dbb700 1 -- start start 2024-09-13T17:06:54.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fbf173cb700 1 -- start start 2024-09-13T17:06:54.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78facb8700 1 -- start start 2024-09-13T17:06:54.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78facb8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78f4070f90 0x7f78f4154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78facb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40c8cd0 0x7f78f40b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78facb8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f4158fe0 0x7f78f40b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78facb8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f415bf50 con 0x7f78f4158fe0 2024-09-13T17:06:54.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78facb8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40c2f60 con 0x7f78f40c8cd0 2024-09-13T17:06:54.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78facb8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40c2950 con 0x7f78f4070f90 2024-09-13T17:06:54.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78f9255700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f4158fe0 0x7f78f40b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78f9255700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f4158fe0 0x7f78f40b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46448/0 (socket says 172.21.15.123:46448) 2024-09-13T17:06:54.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78f9255700 1 -- 172.21.15.123:0/3336967747 learned_addr learned my addr 172.21.15.123:0/3336967747 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78f8a54700 1 --2- 172.21.15.123:0/3336967747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78f4070f90 0x7f78f4154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78f3fff700 1 --2- 172.21.15.123:0/3336967747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40c8cd0 0x7f78f40b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f921559b700 1 -- 172.21.15.123:0/3097715777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f921008aab0 msgr2=0x7f921016a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f921559b700 1 --2- 172.21.15.123:0/3097715777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f921008aab0 0x7f921016a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f921559b700 1 -- 172.21.15.123:0/3097715777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92100722d0 msgr2=0x7f921020b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f921559b700 1 --2- 172.21.15.123:0/3097715777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92100722d0 0x7f921020b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f921559b700 1 -- 172.21.15.123:0/3097715777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9208007530 con 0x7f92100adae0 2024-09-13T17:06:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f920ffff700 1 --2- 172.21.15.123:0/3097715777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f921008aab0 0x7f921016a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-13T17:06:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f921559b700 1 --2- 172.21.15.123:0/3097715777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92100adae0 0x7f92101675b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9200001eb0 tx=0x7f920000c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff394dbb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff38800bc70 0x7ff3880e3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff394dbb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3880507a0 0x7ff388033720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff394dbb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff388033c60 0x7ff38800a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff394dbb700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38804f9e0 con 0x7ff38800bc70 2024-09-13T17:06:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff394dbb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38804fcc0 con 0x7ff3880507a0 2024-09-13T17:06:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff394dbb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38804ffa0 con 0x7ff388033c60 2024-09-13T17:06:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff38ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff388033c60 0x7ff38800a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff38ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff388033c60 0x7ff38800a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:37648/0 (socket says 172.21.15.123:37648) 2024-09-13T17:06:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff38ffff700 1 -- 172.21.15.123:0/4004711316 learned_addr learned my addr 172.21.15.123:0/4004711316 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff38ffff700 1 -- 172.21.15.123:0/4004711316 >> v2:172.21.15.153:3300/0 conn(0x7ff3880507a0 msgr2=0x7ff388033720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:06:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff38ffff700 1 --2- 172.21.15.123:0/4004711316 >> v2:172.21.15.153:3300/0 conn(0x7ff3880507a0 0x7ff388033720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff38ffff700 1 -- 172.21.15.123:0/4004711316 >> v2:172.21.15.123:3300/0 conn(0x7ff38800bc70 msgr2=0x7ff3880e3040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:06:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff38f7fe700 1 --2- 172.21.15.123:0/4004711316 >> v2:172.21.15.123:3300/0 conn(0x7ff38800bc70 0x7ff3880e3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff38ffff700 1 --2- 172.21.15.123:0/4004711316 >> v2:172.21.15.123:3300/0 conn(0x7ff38800bc70 0x7ff3880e3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff38ffff700 1 -- 172.21.15.123:0/4004711316 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff388050280 con 0x7ff388033c60 2024-09-13T17:06:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff38f7fe700 1 --2- 172.21.15.123:0/4004711316 >> v2:172.21.15.123:3300/0 conn(0x7ff38800bc70 0x7ff3880e3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:06:54.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7ff38ffff700 1 --2- 172.21.15.123:0/4004711316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff388033c60 0x7ff38800a5b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff390064010 tx=0x7ff390069900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad4b41801a482df2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ff38e7fc700 1 -- 172.21.15.123:0/4004711316 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390073f10 con 0x7ff388033c60 2024-09-13T17:06:54.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fd864ff9700 1 -- 172.21.15.123:0/1843891216 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd85c01a410 con 0x7fd868070f90 2024-09-13T17:06:54.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fd864ff9700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd8540667b0 0x7fd854068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fd864ff9700 1 -- 172.21.15.123:0/1843891216 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd85c083b30 con 0x7fd868070f90 2024-09-13T17:06:54.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fd8677fe700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd8540667b0 0x7fd854068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fd8677fe700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd8540667b0 0x7fd854068c70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd86815b1e0 tx=0x7fd86000e040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78f8a54700 1 -- 172.21.15.123:0/3336967747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40c8cd0 msgr2=0x7f78f40b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78f8a54700 1 --2- 172.21.15.123:0/3336967747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40c8cd0 0x7f78f40b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78f8a54700 1 -- 172.21.15.123:0/3336967747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f4158fe0 msgr2=0x7f78f40b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78f8a54700 1 --2- 172.21.15.123:0/3336967747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f4158fe0 0x7f78f40b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78f8a54700 1 -- 172.21.15.123:0/3336967747 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e40094b0 con 0x7f78f4070f90 2024-09-13T17:06:54.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78f8a54700 1 --2- 172.21.15.123:0/3336967747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78f4070f90 0x7f78f4154730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00cc50 tx=0x7f78ec00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78f17fa700 1 -- 172.21.15.123:0/3336967747 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec00aa90 con 0x7f78f4070f90 2024-09-13T17:06:54.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78f17fa700 1 -- 172.21.15.123:0/3336967747 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec00abf0 con 0x7f78f4070f90 2024-09-13T17:06:54.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78f17fa700 1 -- 172.21.15.123:0/3336967747 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0070d0 con 0x7f78f4070f90 2024-09-13T17:06:54.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78facb8700 1 -- 172.21.15.123:0/3336967747 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f4154c70 con 0x7f78f4070f90 2024-09-13T17:06:54.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f78facb8700 1 -- 172.21.15.123:0/3336967747 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f40c2bf0 con 0x7f78f4070f90 2024-09-13T17:06:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fbf173cb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbf1015cf20 0x7fbf100ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fbf173cb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf10070fc0 0x7fbf100c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fbf173cb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1015d300 con 0x7fbf100ad490 2024-09-13T17:06:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fbf173cb700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf100caed0 con 0x7fbf10070fc0 2024-09-13T17:06:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fbf173cb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf100cb1a0 con 0x7fbf1015cf20 2024-09-13T17:06:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fbf14966700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbf100ad490 0x7fbf100708b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:48398/0 (socket says 172.21.15.123:48398) 2024-09-13T17:06:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7fbf14966700 1 -- 172.21.15.123:0/1856346489 learned_addr learned my addr 172.21.15.123:0/1856346489 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f920d7fa700 1 -- 172.21.15.123:0/3097715777 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92000052d0 con 0x7f92100adae0 2024-09-13T17:06:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f920d7fa700 1 -- 172.21.15.123:0/3097715777 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9200005430 con 0x7f92100adae0 2024-09-13T17:06:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f920d7fa700 1 -- 172.21.15.123:0/3097715777 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92000055a0 con 0x7f92100adae0 2024-09-13T17:06:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f9216ffe700 1 -- 172.21.15.123:0/3097715777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92100c2510 con 0x7f92100adae0 2024-09-13T17:06:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.278+0000 7f9216ffe700 1 -- 172.21.15.123:0/3097715777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92100c2ad0 con 0x7f92100adae0 2024-09-13T17:06:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ff38e7fc700 1 -- 172.21.15.123:0/4004711316 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff390074070 con 0x7ff388033c60 2024-09-13T17:06:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ff38e7fc700 1 -- 172.21.15.123:0/4004711316 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390074440 con 0x7ff388033c60 2024-09-13T17:06:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7fbf15968700 1 --2- 172.21.15.123:0/1856346489 >> v2:172.21.15.123:3300/0 conn(0x7fbf10070fc0 0x7fbf100c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7fbf15167700 1 --2- 172.21.15.123:0/1856346489 >> v2:172.21.15.153:3300/0 conn(0x7fbf1015cf20 0x7fbf100ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7fbf15968700 1 -- 172.21.15.123:0/1856346489 >> v2:172.21.15.153:3300/0 conn(0x7fbf1015cf20 msgr2=0x7fbf100ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7fbf15968700 1 --2- 172.21.15.123:0/1856346489 >> v2:172.21.15.153:3300/0 conn(0x7fbf1015cf20 0x7fbf100ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7fbf15968700 1 -- 172.21.15.123:0/1856346489 >> v1:172.21.15.153:6789/0 conn(0x7fbf100ad490 legacy=0x7fbf100708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7fbf15968700 1 -- 172.21.15.123:0/1856346489 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf100cb480 con 0x7fbf10070fc0 2024-09-13T17:06:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7fbf15167700 1 --2- 172.21.15.123:0/1856346489 >> v2:172.21.15.153:3300/0 conn(0x7fbf1015cf20 0x7fbf100ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:06:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7fbf15968700 1 --2- 172.21.15.123:0/1856346489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf10070fc0 0x7fbf100c9590 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbf08009d90 tx=0x7fbf0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc57d1c361d34e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7f9216ffe700 1 -- 172.21.15.123:0/3097715777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f0005310 con 0x7f92100adae0 2024-09-13T17:06:54.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe856700 1 Processor -- start 2024-09-13T17:06:54.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ff394dbb700 1 -- 172.21.15.123:0/4004711316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff388033c60 msgr2=0x7ff38800a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ff394dbb700 1 --2- 172.21.15.123:0/4004711316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff388033c60 0x7ff38800a5b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff390064010 tx=0x7ff390069900 comp rx=0 tx=0).stop 2024-09-13T17:06:54.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ff394dbb700 1 -- 172.21.15.123:0/4004711316 shutdown_connections 2024-09-13T17:06:54.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ff394dbb700 1 --2- 172.21.15.123:0/4004711316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff388033c60 0x7ff38800a5b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ff394dbb700 1 --2- 172.21.15.123:0/4004711316 >> v2:172.21.15.153:3300/0 conn(0x7ff3880507a0 0x7ff388033720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ff394dbb700 1 --2- 172.21.15.123:0/4004711316 >> v2:172.21.15.123:3300/0 conn(0x7ff38800bc70 0x7ff3880e3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ff394dbb700 1 -- 172.21.15.123:0/4004711316 >> 172.21.15.123:0/4004711316 conn(0x7ff388036140 msgr2=0x7ff388036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe856700 1 -- start start 2024-09-13T17:06:54.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7f78facb8700 1 -- 172.21.15.123:0/3336967747 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f40c27b0 con 0x7f78f4070f90 2024-09-13T17:06:54.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ff394dbb700 1 -- 172.21.15.123:0/4004711316 shutdown_connections 2024-09-13T17:06:54.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ff394dbb700 1 -- 172.21.15.123:0/4004711316 wait complete. 2024-09-13T17:06:54.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe856700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffaf80b3990 0x7ffaf806bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe856700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80706a0 0x7ffaf8071f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe856700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffaf80cb000 0x7ffaf80cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe856700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf80cb9d0 con 0x7ffaf80cb000 2024-09-13T17:06:54.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe856700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf815b2e0 con 0x7ffaf80b3990 2024-09-13T17:06:54.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe856700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf815b5c0 con 0x7ffaf80706a0 2024-09-13T17:06:54.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe055700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffaf80cb000 0x7ffaf80cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafd854700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffaf80b3990 0x7ffaf806bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe055700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffaf80cb000 0x7ffaf80cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46470/0 (socket says 172.21.15.123:46470) 2024-09-13T17:06:54.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe055700 1 -- 172.21.15.123:0/2850725481 learned_addr learned my addr 172.21.15.123:0/2850725481 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7f78f17fa700 1 -- 172.21.15.123:0/3336967747 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f78ec007230 con 0x7f78f4070f90 2024-09-13T17:06:54.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ff394dbb700 1 Processor -- start 2024-09-13T17:06:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafd053700 1 --2- 172.21.15.123:0/2850725481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80706a0 0x7ffaf8071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe055700 1 -- 172.21.15.123:0/2850725481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80706a0 msgr2=0x7ffaf8071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe055700 1 --2- 172.21.15.123:0/2850725481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80706a0 0x7ffaf8071f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe055700 1 -- 172.21.15.123:0/2850725481 >> v2:172.21.15.153:3300/0 conn(0x7ffaf80b3990 msgr2=0x7ffaf806bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe055700 1 --2- 172.21.15.123:0/2850725481 >> v2:172.21.15.153:3300/0 conn(0x7ffaf80b3990 0x7ffaf806bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe055700 1 -- 172.21.15.123:0/2850725481 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf815b8a0 con 0x7ffaf80cb000 2024-09-13T17:06:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7f78f17fa700 1 --2- 172.21.15.123:0/3336967747 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f78e0066730 0x7f78e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ffafe055700 1 --2- 172.21.15.123:0/2850725481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaf80cb000 0x7ffaf80cb490 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80b0e00 tx=0x7ffaf4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b0ab3e38b2e1d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7f78f17fa700 1 -- 172.21.15.123:0/3336967747 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78ec083cb0 con 0x7f78f4070f90 2024-09-13T17:06:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7f78f3fff700 1 --2- 172.21.15.123:0/3336967747 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f78e0066730 0x7f78e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.282+0000 7ff394dbb700 1 -- start start 2024-09-13T17:06:54.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff394dbb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff38800bc70 0x7ff38804ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff394dbb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff388033c60 0x7ff3880d4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff394dbb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3880507a0 0x7ff38804b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff394dbb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38804dc80 con 0x7ff38800bc70 2024-09-13T17:06:54.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff394dbb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38804d070 con 0x7ff3880507a0 2024-09-13T17:06:54.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff394dbb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38804d350 con 0x7ff388033c60 2024-09-13T17:06:54.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd32745700 1 Processor -- start 2024-09-13T17:06:54.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd32745700 1 -- start start 2024-09-13T17:06:54.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff38f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff38800bc70 0x7ff38804ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7f78f3fff700 1 --2- 172.21.15.123:0/3336967747 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f78e0066730 0x7f78e0068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78f40c1980 tx=0x7f78e8009190 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff38f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff38800bc70 0x7ff38804ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46484/0 (socket says 172.21.15.123:46484) 2024-09-13T17:06:54.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff38f7fe700 1 -- 172.21.15.123:0/1911680692 learned_addr learned my addr 172.21.15.123:0/1911680692 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7fd864ff9700 1 -- 172.21.15.123:0/1843891216 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd85c050df0 con 0x7fd868070f90 2024-09-13T17:06:54.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7fbf07fff700 1 -- 172.21.15.123:0/1856346489 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800e070 con 0x7fbf10070fc0 2024-09-13T17:06:54.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff38effd700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff388033c60 0x7ff3880d4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff38f7fe700 1 -- 172.21.15.123:0/1911680692 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff388033c60 msgr2=0x7ff3880d4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff38ffff700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3880507a0 0x7ff38804b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff38f7fe700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff388033c60 0x7ff3880d4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff38f7fe700 1 -- 172.21.15.123:0/1911680692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3880507a0 msgr2=0x7ff38804b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff38f7fe700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3880507a0 0x7ff38804b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff38f7fe700 1 -- 172.21.15.123:0/1911680692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39004f5c0 con 0x7ff38800bc70 2024-09-13T17:06:54.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff38ffff700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3880507a0 0x7ff38804b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:06:54.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7fbf07fff700 1 -- 172.21.15.123:0/1856346489 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0800bad0 con 0x7fbf10070fc0 2024-09-13T17:06:54.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7fbf07fff700 1 -- 172.21.15.123:0/1856346489 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800be60 con 0x7fbf10070fc0 2024-09-13T17:06:54.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ff38f7fe700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff38800bc70 0x7ff38804ca00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00c7f0 tx=0x7ff37c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ffafc852700 1 -- 172.21.15.123:0/2850725481 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4011830 con 0x7ffaf80cb000 2024-09-13T17:06:54.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ffafc852700 1 -- 172.21.15.123:0/2850725481 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf4011990 con 0x7ffaf80cb000 2024-09-13T17:06:54.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ffafc852700 1 -- 172.21.15.123:0/2850725481 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4011d20 con 0x7ffaf80cb000 2024-09-13T17:06:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7fbf173cb700 1 -- 172.21.15.123:0/1856346489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf10070fc0 msgr2=0x7fbf100c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7fbf173cb700 1 --2- 172.21.15.123:0/1856346489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf10070fc0 0x7fbf100c9590 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbf08009d90 tx=0x7fbf0800b330 comp rx=0 tx=0).stop 2024-09-13T17:06:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ffafe856700 1 -- 172.21.15.123:0/2850725481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaf80cb000 msgr2=0x7ffaf80cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7ffafe856700 1 --2- 172.21.15.123:0/2850725481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaf80cb000 0x7ffaf80cb490 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80b0e00 tx=0x7ffaf4009bf0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7fbf173cb700 1 -- 172.21.15.123:0/1856346489 shutdown_connections 2024-09-13T17:06:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7fbf173cb700 1 --2- 172.21.15.123:0/1856346489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf10070fc0 0x7fbf100c9590 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7fbf173cb700 1 --2- 172.21.15.123:0/1856346489 >> v2:172.21.15.153:3300/0 conn(0x7fbf1015cf20 0x7fbf100ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7fbf173cb700 1 -- 172.21.15.123:0/1856346489 >> 172.21.15.123:0/1856346489 conn(0x7fbf10066780 msgr2=0x7fbf100b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7fbf173cb700 1 -- 172.21.15.123:0/1856346489 shutdown_connections 2024-09-13T17:06:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7fbf173cb700 1 -- 172.21.15.123:0/1856346489 wait complete. 2024-09-13T17:06:54.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd32745700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efd2c15cf20 0x7efd2c0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd32745700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efd2c0ad490 0x7efd2c0708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd31f44700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7efd2c070df0 0x7efd2c160a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49176/0 (socket says 172.21.15.123:49176) 2024-09-13T17:06:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd31f44700 1 -- 172.21.15.123:0/140776881 learned_addr learned my addr 172.21.15.123:0/140776881 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd31743700 1 --2- 172.21.15.123:0/140776881 >> v2:172.21.15.123:3300/0 conn(0x7efd2c15cf20 0x7efd2c0ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd32745700 1 -- 172.21.15.123:0/140776881 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2c0ca5a0 con 0x7efd2c070df0 2024-09-13T17:06:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd30f42700 1 --2- 172.21.15.123:0/140776881 >> v2:172.21.15.153:3300/0 conn(0x7efd2c0ad490 0x7efd2c0708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd32745700 1 -- 172.21.15.123:0/140776881 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2c071280 con 0x7efd2c15cf20 2024-09-13T17:06:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd32745700 1 -- 172.21.15.123:0/140776881 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2c15d300 con 0x7efd2c0ad490 2024-09-13T17:06:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd31743700 1 -- 172.21.15.123:0/140776881 >> v2:172.21.15.153:3300/0 conn(0x7efd2c0ad490 msgr2=0x7efd2c0708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd31743700 1 --2- 172.21.15.123:0/140776881 >> v2:172.21.15.153:3300/0 conn(0x7efd2c0ad490 0x7efd2c0708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd31743700 1 -- 172.21.15.123:0/140776881 >> v1:172.21.15.123:6789/0 conn(0x7efd2c070df0 legacy=0x7efd2c160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd31743700 1 -- 172.21.15.123:0/140776881 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c0caed0 con 0x7efd2c15cf20 2024-09-13T17:06:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7efd31743700 1 --2- 172.21.15.123:0/140776881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd2c15cf20 0x7efd2c0ca990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efd28013db0 tx=0x7efd28009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46661552966cb028 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7fbf173cb700 1 Processor -- start 2024-09-13T17:06:54.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 -- 172.21.15.123:0/2850725481 shutdown_connections 2024-09-13T17:06:54.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 --2- 172.21.15.123:0/2850725481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80706a0 0x7ffaf8071f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 --2- 172.21.15.123:0/2850725481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaf80cb000 0x7ffaf80cb490 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 --2- 172.21.15.123:0/2850725481 >> v2:172.21.15.153:3300/0 conn(0x7ffaf80b3990 0x7ffaf806bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 -- 172.21.15.123:0/2850725481 >> 172.21.15.123:0/2850725481 conn(0x7ffaf8066780 msgr2=0x7ffaf80b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.286+0000 7f920d7fa700 1 -- 172.21.15.123:0/3097715777 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f92000038e0 con 0x7f92100adae0 2024-09-13T17:06:54.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 -- 172.21.15.123:0/2850725481 shutdown_connections 2024-09-13T17:06:54.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf173cb700 1 -- start start 2024-09-13T17:06:54.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 -- 172.21.15.123:0/2850725481 wait complete. 2024-09-13T17:06:54.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7f920d7fa700 1 --2- 172.21.15.123:0/3097715777 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91fc066780 0x7f91fc068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7f920d7fa700 1 -- 172.21.15.123:0/3097715777 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92000838a0 con 0x7f92100adae0 2024-09-13T17:06:54.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7f9214d9a700 1 --2- 172.21.15.123:0/3097715777 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91fc066780 0x7f91fc068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7f9214d9a700 1 --2- 172.21.15.123:0/3097715777 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91fc066780 0x7f91fc068c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9208000f80 tx=0x7f920800b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf173cb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf10070fc0 0x7fbf10148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf173cb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf100ad490 0x7fbf100b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf173cb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf1015cf20 0x7fbf100b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf173cb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1014a1b0 con 0x7fbf10070fc0 2024-09-13T17:06:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf173cb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf101492e0 con 0x7fbf100ad490 2024-09-13T17:06:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf173cb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10149530 con 0x7fbf1015cf20 2024-09-13T17:06:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf15167700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf10070fc0 0x7fbf10148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf15167700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf10070fc0 0x7fbf10148990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46508/0 (socket says 172.21.15.123:46508) 2024-09-13T17:06:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf15167700 1 -- 172.21.15.123:0/3564066381 learned_addr learned my addr 172.21.15.123:0/3564066381 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 Processor -- start 2024-09-13T17:06:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf15968700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf1015cf20 0x7fbf100b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf14966700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf100ad490 0x7fbf100b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf15167700 1 -- 172.21.15.123:0/3564066381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf1015cf20 msgr2=0x7fbf100b2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf15167700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf1015cf20 0x7fbf100b2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf15167700 1 -- 172.21.15.123:0/3564066381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf100ad490 msgr2=0x7fbf100b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf15167700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf100ad490 0x7fbf100b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf15167700 1 -- 172.21.15.123:0/3564066381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf08009a70 con 0x7fbf10070fc0 2024-09-13T17:06:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf14966700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf100ad490 0x7fbf100b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:06:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7fbf15167700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf10070fc0 0x7fbf10148990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00c7f0 tx=0x7fbf0c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 -- start start 2024-09-13T17:06:54.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaf80706a0 0x7ffaf80c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80b3990 0x7ffaf80af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaf80cb000 0x7ffaf8159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80aebd0 con 0x7ffaf80706a0 2024-09-13T17:06:54.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80aee70 con 0x7ffaf80cb000 2024-09-13T17:06:54.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe856700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80af150 con 0x7ffaf80b3990 2024-09-13T17:06:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafd854700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaf80706a0 0x7ffaf80c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafd854700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaf80706a0 0x7ffaf80c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46524/0 (socket says 172.21.15.123:46524) 2024-09-13T17:06:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafd854700 1 -- 172.21.15.123:0/4017317850 learned_addr learned my addr 172.21.15.123:0/4017317850 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafe055700 1 --2- 172.21.15.123:0/4017317850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaf80cb000 0x7ffaf8159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafd053700 1 --2- 172.21.15.123:0/4017317850 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80b3990 0x7ffaf80af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafd854700 1 -- 172.21.15.123:0/4017317850 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80b3990 msgr2=0x7ffaf80af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafd854700 1 --2- 172.21.15.123:0/4017317850 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80b3990 0x7ffaf80af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafd854700 1 -- 172.21.15.123:0/4017317850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaf80cb000 msgr2=0x7ffaf8159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafd854700 1 --2- 172.21.15.123:0/4017317850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaf80cb000 0x7ffaf8159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafd854700 1 -- 172.21.15.123:0/4017317850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf4009570 con 0x7ffaf80706a0 2024-09-13T17:06:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7f78f17fa700 1 -- 172.21.15.123:0/3336967747 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f78ec051090 con 0x7f78f4070f90 2024-09-13T17:06:54.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7ffafd854700 1 --2- 172.21.15.123:0/4017317850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaf80706a0 0x7ffaf80c5750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000efc0 tx=0x7ffaf000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7f1115554700 1 Processor -- start 2024-09-13T17:06:54.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.290+0000 7f1115554700 1 -- start start 2024-09-13T17:06:54.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f1115554700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1110070fc0 0x7f1110167d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f1115554700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11100ca5a0 con 0x7f11100ad490 2024-09-13T17:06:54.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f1115554700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111015d300 con 0x7f111015cf20 2024-09-13T17:06:54.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f1115554700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11100cb1a0 con 0x7f1110070fc0 2024-09-13T17:06:54.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110f7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f11100ad490 0x7f11100708b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49182/0 (socket says 172.21.15.123:49182) 2024-09-13T17:06:54.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110f7fe700 1 -- 172.21.15.123:0/457654167 learned_addr learned my addr 172.21.15.123:0/457654167 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f1114d53700 1 --2- 172.21.15.123:0/457654167 >> v2:172.21.15.153:3300/0 conn(0x7f1110070fc0 0x7f1110167d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 -- 172.21.15.123:0/457654167 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697309008 0 0) 0x7f111015d300 con 0x7f111015cf20 2024-09-13T17:06:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 -- 172.21.15.123:0/457654167 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f80035d0 con 0x7f111015cf20 2024-09-13T17:06:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 -- 172.21.15.123:0/457654167 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3948284752 0 0) 0x7f10f80035d0 con 0x7f111015cf20 2024-09-13T17:06:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 -- 172.21.15.123:0/457654167 >> v2:172.21.15.153:3300/0 conn(0x7f1110070fc0 msgr2=0x7f1110167d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 --2- 172.21.15.123:0/457654167 >> v2:172.21.15.153:3300/0 conn(0x7f1110070fc0 0x7f1110167d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 -- 172.21.15.123:0/457654167 >> v1:172.21.15.123:6789/0 conn(0x7f11100ad490 legacy=0x7f11100708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 -- 172.21.15.123:0/457654167 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11100cb480 con 0x7f111015cf20 2024-09-13T17:06:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 -- 172.21.15.123:0/457654167 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f1100001670 con 0x7f111015cf20 2024-09-13T17:06:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7ff37bfff700 1 -- 172.21.15.123:0/1911680692 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c011800 con 0x7ff38800bc70 2024-09-13T17:06:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7ff394dbb700 1 -- 172.21.15.123:0/1911680692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38804d630 con 0x7ff38800bc70 2024-09-13T17:06:54.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 -- 172.21.15.123:0/457654167 >> v1:172.21.15.153:6789/0 conn(0x7f111015cf20 legacy=0x7f11100ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f920d7fa700 1 -- 172.21.15.123:0/3097715777 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9200050bf0 con 0x7f92100adae0 2024-09-13T17:06:54.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7ff394dbb700 1 -- 172.21.15.123:0/1911680692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff388038c10 con 0x7ff38800bc70 2024-09-13T17:06:54.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 --2- 172.21.15.123:0/457654167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10f8003a20 0x7f10f8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 --2- 172.21.15.123:0/457654167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10f8004420 0x7f10f80048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 --2- 172.21.15.123:0/457654167 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f80050f0 0x7f10f800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 -- 172.21.15.123:0/457654167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11100cb1a0 con 0x7f10f8004420 2024-09-13T17:06:54.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 -- 172.21.15.123:0/457654167 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f800c050 con 0x7f10f8003a20 2024-09-13T17:06:54.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 -- 172.21.15.123:0/457654167 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f800c210 con 0x7f10f80050f0 2024-09-13T17:06:54.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7ff37bfff700 1 -- 172.21.15.123:0/1911680692 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c011960 con 0x7ff38800bc70 2024-09-13T17:06:54.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7ff37bfff700 1 -- 172.21.15.123:0/1911680692 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c011cd0 con 0x7ff38800bc70 2024-09-13T17:06:54.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110f7fe700 1 --2- 172.21.15.123:0/457654167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10f8004420 0x7f10f80048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7efd23fff700 1 -- 172.21.15.123:0/140776881 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28009e20 con 0x7efd2c15cf20 2024-09-13T17:06:54.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f1114d53700 1 --2- 172.21.15.123:0/457654167 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f80050f0 0x7f10f800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110ffff700 1 --2- 172.21.15.123:0/457654167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10f8003a20 0x7f10f8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7efd23fff700 1 -- 172.21.15.123:0/140776881 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2801b410 con 0x7efd2c15cf20 2024-09-13T17:06:54.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110f7fe700 1 -- 172.21.15.123:0/457654167 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f80050f0 msgr2=0x7f10f800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:54.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110f7fe700 1 --2- 172.21.15.123:0/457654167 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f80050f0 0x7f10f800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110f7fe700 1 -- 172.21.15.123:0/457654167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10f8003a20 msgr2=0x7f10f8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:54.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110f7fe700 1 --2- 172.21.15.123:0/457654167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10f8003a20 0x7f10f8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110f7fe700 1 -- 172.21.15.123:0/457654167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f80035d0 con 0x7f10f8004420 2024-09-13T17:06:54.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f1114d53700 1 -- 172.21.15.123:0/457654167 reap_dead start 2024-09-13T17:06:54.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7efd23fff700 1 -- 172.21.15.123:0/140776881 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2801b7a0 con 0x7efd2c15cf20 2024-09-13T17:06:54.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110f7fe700 1 --2- 172.21.15.123:0/457654167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10f8004420 0x7f10f80048f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f11040018f0 tx=0x7f10f80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fc011a796c3dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 -- 172.21.15.123:0/457654167 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104004b50 con 0x7f10f8004420 2024-09-13T17:06:54.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 -- 172.21.15.123:0/457654167 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1104004cb0 con 0x7f10f8004420 2024-09-13T17:06:54.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7f110effd700 1 -- 172.21.15.123:0/457654167 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040072f0 con 0x7f10f8004420 2024-09-13T17:06:54.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7efd32745700 1 -- 172.21.15.123:0/140776881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd2c15cf20 msgr2=0x7efd2c0ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.294+0000 7efd32745700 1 --2- 172.21.15.123:0/140776881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd2c15cf20 0x7efd2c0ca990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efd28013db0 tx=0x7efd28009670 comp rx=0 tx=0).stop 2024-09-13T17:06:54.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7fbf05ffb700 1 -- 172.21.15.123:0/3564066381 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c011800 con 0x7fbf10070fc0 2024-09-13T17:06:54.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7fbf05ffb700 1 -- 172.21.15.123:0/3564066381 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c011960 con 0x7fbf10070fc0 2024-09-13T17:06:54.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7fbf173cb700 1 -- 172.21.15.123:0/3564066381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf10149810 con 0x7fbf10070fc0 2024-09-13T17:06:54.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7f1115554700 1 -- 172.21.15.123:0/457654167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10f8004420 msgr2=0x7f10f80048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7f1115554700 1 --2- 172.21.15.123:0/457654167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10f8004420 0x7f10f80048f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f11040018f0 tx=0x7f10f80058a0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7f1115554700 1 -- 172.21.15.123:0/457654167 shutdown_connections 2024-09-13T17:06:54.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7f1115554700 1 --2- 172.21.15.123:0/457654167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10f8004420 0x7f10f80048f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7f1115554700 1 -- 172.21.15.123:0/457654167 >> 172.21.15.123:0/457654167 conn(0x7f1110066780 msgr2=0x7f11100b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7ff37bfff700 1 -- 172.21.15.123:0/1911680692 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff37c01a450 con 0x7ff38800bc70 2024-09-13T17:06:54.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7ff37bfff700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff374066760 0x7ff374068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7ff37bfff700 1 -- 172.21.15.123:0/1911680692 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff37c084190 con 0x7ff38800bc70 2024-09-13T17:06:54.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7ff38effd700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff374066760 0x7ff374068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7efd32745700 1 -- 172.21.15.123:0/140776881 shutdown_connections 2024-09-13T17:06:54.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7efd32745700 1 --2- 172.21.15.123:0/140776881 >> v2:172.21.15.153:3300/0 conn(0x7efd2c0ad490 0x7efd2c0708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7efd32745700 1 --2- 172.21.15.123:0/140776881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd2c15cf20 0x7efd2c0ca990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7efd32745700 1 -- 172.21.15.123:0/140776881 >> 172.21.15.123:0/140776881 conn(0x7efd2c066780 msgr2=0x7efd2c0b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7fbf05ffb700 1 -- 172.21.15.123:0/3564066381 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c011d10 con 0x7fbf10070fc0 2024-09-13T17:06:54.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7fbf173cb700 1 -- 172.21.15.123:0/3564066381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf10149dd0 con 0x7fbf10070fc0 2024-09-13T17:06:54.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7fbf173cb700 1 -- 172.21.15.123:0/3564066381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1014a420 con 0x7fbf10070fc0 2024-09-13T17:06:54.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7ff38effd700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff374066760 0x7ff374068c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff38804e720 tx=0x7ff384008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7fbf05ffb700 1 -- 172.21.15.123:0/3564066381 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbf0c021350 con 0x7fbf10070fc0 2024-09-13T17:06:54.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7efd32745700 1 -- 172.21.15.123:0/140776881 shutdown_connections 2024-09-13T17:06:54.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7efd32745700 1 -- 172.21.15.123:0/140776881 wait complete. 2024-09-13T17:06:54.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7efd32745700 1 Processor -- start 2024-09-13T17:06:54.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7f1115554700 1 -- 172.21.15.123:0/457654167 shutdown_connections 2024-09-13T17:06:54.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7efd32745700 1 -- start start 2024-09-13T17:06:54.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7f1115554700 1 -- 172.21.15.123:0/457654167 wait complete. 2024-09-13T17:06:54.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7fbf05ffb700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbef4066780 0x7fbef4068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7fbf05ffb700 1 -- 172.21.15.123:0/3564066381 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf0c084080 con 0x7fbf10070fc0 2024-09-13T17:06:54.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.298+0000 7fbf14966700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbef4066780 0x7fbef4068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7fbf14966700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbef4066780 0x7fbef4068c40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbf100c4dc0 tx=0x7fbf00009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f1115554700 1 Processor -- start 2024-09-13T17:06:54.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f1115554700 1 -- start start 2024-09-13T17:06:54.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f1115554700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f8004420 0x7f11100c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f1115554700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1110151790 0x7f111006c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f1115554700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1110151220 0x7f111006ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f1115554700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11101e8830 con 0x7f1110151790 2024-09-13T17:06:54.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f1115554700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11100c5a30 con 0x7f1110151220 2024-09-13T17:06:54.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f1115554700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11101e8550 con 0x7f10f8004420 2024-09-13T17:06:54.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd32745700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c070df0 0x7efd2c15d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd32745700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd2c0ad490 0x7efd2c1fee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd32745700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd2c15cf20 0x7efd2c202c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd32745700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c0b2ec0 con 0x7efd2c0ad490 2024-09-13T17:06:54.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd32745700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c15dd80 con 0x7efd2c070df0 2024-09-13T17:06:54.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd32745700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c0b3180 con 0x7efd2c15cf20 2024-09-13T17:06:54.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd30f42700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd2c0ad490 0x7efd2c1fee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd30f42700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd2c0ad490 0x7efd2c1fee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46540/0 (socket says 172.21.15.123:46540) 2024-09-13T17:06:54.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd30f42700 1 -- 172.21.15.123:0/1605437817 learned_addr learned my addr 172.21.15.123:0/1605437817 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd31743700 1 --2- 172.21.15.123:0/1605437817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c070df0 0x7efd2c15d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd30f42700 1 -- 172.21.15.123:0/1605437817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd2c15cf20 msgr2=0x7efd2c202c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:06:54.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd30f42700 1 --2- 172.21.15.123:0/1605437817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd2c15cf20 0x7efd2c202c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd30f42700 1 -- 172.21.15.123:0/1605437817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c070df0 msgr2=0x7efd2c15d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd30f42700 1 --2- 172.21.15.123:0/1605437817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c070df0 0x7efd2c15d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7efd30f42700 1 -- 172.21.15.123:0/1605437817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd28013a10 con 0x7efd2c0ad490 2024-09-13T17:06:54.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f110f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1110151790 0x7f111006c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f110f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1110151790 0x7f111006c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46544/0 (socket says 172.21.15.123:46544) 2024-09-13T17:06:54.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f110f7fe700 1 -- 172.21.15.123:0/3531442006 learned_addr learned my addr 172.21.15.123:0/3531442006 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:54.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f110ffff700 1 --2- 172.21.15.123:0/3531442006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f8004420 0x7f11100c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f1114d53700 1 --2- 172.21.15.123:0/3531442006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1110151220 0x7f111006ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f110f7fe700 1 -- 172.21.15.123:0/3531442006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f8004420 msgr2=0x7f11100c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f110f7fe700 1 --2- 172.21.15.123:0/3531442006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f8004420 0x7f11100c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f110f7fe700 1 -- 172.21.15.123:0/3531442006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1110151220 msgr2=0x7f111006ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f110f7fe700 1 --2- 172.21.15.123:0/3531442006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1110151220 0x7f111006ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f110f7fe700 1 -- 172.21.15.123:0/3531442006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11100b1600 con 0x7f1110151790 2024-09-13T17:06:54.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7f110f7fe700 1 --2- 172.21.15.123:0/3531442006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1110151790 0x7f111006c780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1104007fd0 tx=0x7f1104001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7ff394dbb700 1 -- 172.21.15.123:0/1911680692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36c005310 con 0x7ff38800bc70 2024-09-13T17:06:54.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.306+0000 7efd30f42700 1 --2- 172.21.15.123:0/1605437817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd2c0ad490 0x7efd2c1fee40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00e840 tx=0x7efd1c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.306+0000 7fbf05ffb700 1 -- 172.21.15.123:0/3564066381 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbf0c051480 con 0x7fbf10070fc0 2024-09-13T17:06:54.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7ffaee7fc700 1 -- 172.21.15.123:0/4017317850 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf000cd10 con 0x7ffaf80706a0 2024-09-13T17:06:54.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7ffaee7fc700 1 -- 172.21.15.123:0/4017317850 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf000f040 con 0x7ffaf80706a0 2024-09-13T17:06:54.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.302+0000 7ffaee7fc700 1 -- 172.21.15.123:0/4017317850 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf00146a0 con 0x7ffaf80706a0 2024-09-13T17:06:54.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.310+0000 7ffafe856700 1 -- 172.21.15.123:0/4017317850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf80af430 con 0x7ffaf80706a0 2024-09-13T17:06:54.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.310+0000 7ffafe856700 1 -- 172.21.15.123:0/4017317850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf81f9f30 con 0x7ffaf80706a0 2024-09-13T17:06:54.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.314+0000 7f110cff9700 1 -- 172.21.15.123:0/3531442006 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104001350 con 0x7f1110151790 2024-09-13T17:06:54.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.314+0000 7ff37bfff700 1 -- 172.21.15.123:0/1911680692 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff37c054f00 con 0x7ff38800bc70 2024-09-13T17:06:54.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.314+0000 7efd21ffb700 1 -- 172.21.15.123:0/1605437817 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c013680 con 0x7efd2c0ad490 2024-09-13T17:06:54.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.314+0000 7ffafe856700 1 -- 172.21.15.123:0/4017317850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf8071f30 con 0x7ffaf80706a0 2024-09-13T17:06:54.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.314+0000 7efd32745700 1 -- 172.21.15.123:0/1605437817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd2c0b3460 con 0x7efd2c0ad490 2024-09-13T17:06:54.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.314+0000 7f1115554700 1 -- 172.21.15.123:0/3531442006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11100b18e0 con 0x7f1110151790 2024-09-13T17:06:54.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.318+0000 7f1115554700 1 -- 172.21.15.123:0/3531442006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11101e8170 con 0x7f1110151790 2024-09-13T17:06:54.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.314+0000 7efd32745700 1 -- 172.21.15.123:0/1605437817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2c0b3a20 con 0x7efd2c0ad490 2024-09-13T17:06:54.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.318+0000 7ffaee7fc700 1 -- 172.21.15.123:0/4017317850 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffaf0014800 con 0x7ffaf80706a0 2024-09-13T17:06:54.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.318+0000 7f110cff9700 1 -- 172.21.15.123:0/3531442006 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1104004e20 con 0x7f1110151790 2024-09-13T17:06:54.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.318+0000 7f110cff9700 1 -- 172.21.15.123:0/3531442006 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110401f680 con 0x7f1110151790 2024-09-13T17:06:54.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.318+0000 7efd32745700 1 -- 172.21.15.123:0/1605437817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2c0c9020 con 0x7efd2c0ad490 2024-09-13T17:06:54.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.318+0000 7ffaee7fc700 1 --2- 172.21.15.123:0/4017317850 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffadc066780 0x7ffadc068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.318+0000 7efd21ffb700 1 -- 172.21.15.123:0/1605437817 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c005a40 con 0x7efd2c0ad490 2024-09-13T17:06:54.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.318+0000 7ffafd053700 1 --2- 172.21.15.123:0/4017317850 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffadc066780 0x7ffadc068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.318+0000 7ffaee7fc700 1 -- 172.21.15.123:0/4017317850 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffaf0084fb0 con 0x7ffaf80706a0 2024-09-13T17:06:54.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.318+0000 7ffafd053700 1 --2- 172.21.15.123:0/4017317850 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffadc066780 0x7ffadc068c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffaf81f9e90 tx=0x7ffae8008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.318+0000 7efd21ffb700 1 -- 172.21.15.123:0/1605437817 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c005db0 con 0x7efd2c0ad490 2024-09-13T17:06:54.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.322+0000 7efd21ffb700 1 -- 172.21.15.123:0/1605437817 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efd1c0137e0 con 0x7efd2c0ad490 2024-09-13T17:06:54.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.322+0000 7f110cff9700 1 -- 172.21.15.123:0/3531442006 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f110401f7e0 con 0x7f1110151790 2024-09-13T17:06:54.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.322+0000 7f110cff9700 1 --2- 172.21.15.123:0/3531442006 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f10f8068240 0x7f10f806a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.322+0000 7f110ffff700 1 --2- 172.21.15.123:0/3531442006 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f10f8068240 0x7f10f806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.322+0000 7efd21ffb700 1 --2- 172.21.15.123:0/1605437817 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efd10066760 0x7efd10068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:54.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.322+0000 7efd31743700 1 --2- 172.21.15.123:0/1605437817 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efd10066760 0x7efd10068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:54.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.322+0000 7f110ffff700 1 --2- 172.21.15.123:0/3531442006 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f10f8068240 0x7f10f806a700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1100001aa0 tx=0x7f1100008990 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.322+0000 7f1115554700 1 -- 172.21.15.123:0/3531442006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f0005310 con 0x7f1110151790 2024-09-13T17:06:54.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.326+0000 7efd31743700 1 --2- 172.21.15.123:0/1605437817 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efd10066760 0x7efd10068c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efd280096b0 tx=0x7efd28018000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:54.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.330+0000 7efd21ffb700 1 -- 172.21.15.123:0/1605437817 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd1c055bb0 con 0x7efd2c0ad490 2024-09-13T17:06:54.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.330+0000 7f110cff9700 1 -- 172.21.15.123:0/3531442006 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1104056dd0 con 0x7f1110151790 2024-09-13T17:06:54.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.330+0000 7ffaee7fc700 1 -- 172.21.15.123:0/4017317850 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffaf0052490 con 0x7ffaf80706a0 2024-09-13T17:06:54.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.338+0000 7efd21ffb700 1 -- 172.21.15.123:0/1605437817 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efd1c0517f0 con 0x7efd2c0ad490 2024-09-13T17:06:54.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.346+0000 7f110cff9700 1 -- 172.21.15.123:0/3531442006 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1104052a10 con 0x7f1110151790 2024-09-13T17:06:54.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.606+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1843891216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd8480055c0 con 0x7fd868070f90 2024-09-13T17:06:54.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.606+0000 7fd864ff9700 1 -- 172.21.15.123:0/1843891216 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd85c015090 con 0x7fd868070f90 2024-09-13T17:06:54.611 INFO:teuthology.orchestra.run.smithi123.stdout:55834574853 2024-09-13T17:06:54.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.606+0000 7f78facb8700 1 -- 172.21.15.123:0/3336967747 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f78f40c27b0 con 0x7f78f4070f90 2024-09-13T17:06:54.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.606+0000 7f78f17fa700 1 -- 172.21.15.123:0/3336967747 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78f40c27b0 con 0x7f78f4070f90 2024-09-13T17:06:54.613 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2024-09-13T17:06:54.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1843891216 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd8540667b0 msgr2=0x7fd854068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7fd86e6ca700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd8540667b0 0x7fd854068c70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd86815b1e0 tx=0x7fd86000e040 comp rx=0 tx=0).stop 2024-09-13T17:06:54.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1843891216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd868070f90 msgr2=0x7fd868152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7fd86e6ca700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd868070f90 0x7fd868152d60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00b4a0 tx=0x7fd85c00b7b0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1843891216 shutdown_connections 2024-09-13T17:06:54.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7fd86e6ca700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd8540667b0 0x7fd854068c70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7fd86e6ca700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd868158fe0 0x7fd868159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7fd86e6ca700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8680c8cd0 0x7fd8680c22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7fd86e6ca700 1 --2- 172.21.15.123:0/1843891216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd868070f90 0x7fd868152d60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1843891216 >> 172.21.15.123:0/1843891216 conn(0x7fd868066780 msgr2=0x7fd86806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1843891216 shutdown_connections 2024-09-13T17:06:54.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7fd86e6ca700 1 -- 172.21.15.123:0/1843891216 wait complete. 2024-09-13T17:06:54.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7f78daffd700 1 -- 172.21.15.123:0/3336967747 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f78e0066730 msgr2=0x7f78e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7f78daffd700 1 --2- 172.21.15.123:0/3336967747 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f78e0066730 0x7f78e0068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78f40c1980 tx=0x7f78e8009190 comp rx=0 tx=0).stop 2024-09-13T17:06:54.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7f78daffd700 1 -- 172.21.15.123:0/3336967747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78f4070f90 msgr2=0x7f78f4154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7f78daffd700 1 --2- 172.21.15.123:0/3336967747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78f4070f90 0x7f78f4154730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00cc50 tx=0x7f78ec00cf60 comp rx=0 tx=0).stop 2024-09-13T17:06:54.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7f78daffd700 1 -- 172.21.15.123:0/3336967747 shutdown_connections 2024-09-13T17:06:54.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7f78daffd700 1 --2- 172.21.15.123:0/3336967747 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f78e0066730 0x7f78e0068bf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7f78daffd700 1 --2- 172.21.15.123:0/3336967747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78f4158fe0 0x7f78f40b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7f78daffd700 1 --2- 172.21.15.123:0/3336967747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40c8cd0 0x7f78f40b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7f78daffd700 1 --2- 172.21.15.123:0/3336967747 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78f4070f90 0x7f78f4154730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7f78daffd700 1 -- 172.21.15.123:0/3336967747 >> 172.21.15.123:0/3336967747 conn(0x7f78f4066780 msgr2=0x7f78f40ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7f78daffd700 1 -- 172.21.15.123:0/3336967747 shutdown_connections 2024-09-13T17:06:54.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.610+0000 7f78daffd700 1 -- 172.21.15.123:0/3336967747 wait complete. 2024-09-13T17:06:54.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.626+0000 7fbf173cb700 1 -- 172.21.15.123:0/3564066381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbf100ca990 con 0x7fbf10070fc0 2024-09-13T17:06:54.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.626+0000 7fbf05ffb700 1 -- 172.21.15.123:0/3564066381 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf0c054aa0 con 0x7fbf10070fc0 2024-09-13T17:06:54.633 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-09-13T17:06:54.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-09-13T17:06:54.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.626+0000 7fbf173cb700 1 -- 172.21.15.123:0/3564066381 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbef4066780 msgr2=0x7fbef4068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.626+0000 7fbf173cb700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbef4066780 0x7fbef4068c40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbf100c4dc0 tx=0x7fbf00009040 comp rx=0 tx=0).stop 2024-09-13T17:06:54.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-09-13T17:06:54.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.626+0000 7fbf173cb700 1 -- 172.21.15.123:0/3564066381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf10070fc0 msgr2=0x7fbf10148990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.626+0000 7fbf173cb700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf10070fc0 0x7fbf10148990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00c7f0 tx=0x7fbf0c00cbb0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7fbf173cb700 1 -- 172.21.15.123:0/3564066381 shutdown_connections 2024-09-13T17:06:54.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7fbf173cb700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbef4066780 0x7fbef4068c40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7fbf173cb700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf1015cf20 0x7fbf100b2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7fbf173cb700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf100ad490 0x7fbf100b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7fbf173cb700 1 --2- 172.21.15.123:0/3564066381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf10070fc0 0x7fbf10148990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7fbf173cb700 1 -- 172.21.15.123:0/3564066381 >> 172.21.15.123:0/3564066381 conn(0x7fbf10066780 msgr2=0x7fbf100ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7f9216ffe700 1 -- 172.21.15.123:0/3097715777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f91f0005890 con 0x7f92100adae0 2024-09-13T17:06:54.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7fbf173cb700 1 -- 172.21.15.123:0/3564066381 shutdown_connections 2024-09-13T17:06:54.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7fbf173cb700 1 -- 172.21.15.123:0/3564066381 wait complete. 2024-09-13T17:06:54.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7f920d7fa700 1 -- 172.21.15.123:0/3097715777 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9200054210 con 0x7f92100adae0 2024-09-13T17:06:54.638 INFO:teuthology.orchestra.run.smithi123.stdout:55834574853 2024-09-13T17:06:54.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7f9216ffe700 1 -- 172.21.15.123:0/3097715777 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91fc066780 msgr2=0x7f91fc068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7f9216ffe700 1 --2- 172.21.15.123:0/3097715777 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91fc066780 0x7f91fc068c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9208000f80 tx=0x7f920800b040 comp rx=0 tx=0).stop 2024-09-13T17:06:54.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7f9216ffe700 1 -- 172.21.15.123:0/3097715777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92100adae0 msgr2=0x7f92101675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7f9216ffe700 1 --2- 172.21.15.123:0/3097715777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92100adae0 0x7f92101675b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9200001eb0 tx=0x7f920000c6e0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7f9216ffe700 1 -- 172.21.15.123:0/3097715777 shutdown_connections 2024-09-13T17:06:54.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7f9216ffe700 1 --2- 172.21.15.123:0/3097715777 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91fc066780 0x7f91fc068c40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7f9216ffe700 1 --2- 172.21.15.123:0/3097715777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92100adae0 0x7f92101675b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7f9216ffe700 1 --2- 172.21.15.123:0/3097715777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f921008aab0 0x7f921016a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7f9216ffe700 1 --2- 172.21.15.123:0/3097715777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92100722d0 0x7f921020b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7f9216ffe700 1 -- 172.21.15.123:0/3097715777 >> 172.21.15.123:0/3097715777 conn(0x7f9210066780 msgr2=0x7f9210071ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7f9216ffe700 1 -- 172.21.15.123:0/3097715777 shutdown_connections 2024-09-13T17:06:54.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.630+0000 7f9216ffe700 1 -- 172.21.15.123:0/3097715777 wait complete. 2024-09-13T17:06:54.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.634+0000 7ffafe856700 1 -- 172.21.15.123:0/4017317850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffaf8067da0 con 0x7ffaf80706a0 2024-09-13T17:06:54.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.634+0000 7ffaee7fc700 1 -- 172.21.15.123:0/4017317850 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffaf0055ab0 con 0x7ffaf80706a0 2024-09-13T17:06:54.641 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2024-09-13T17:06:54.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.634+0000 7ff394dbb700 1 -- 172.21.15.123:0/1911680692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff36c0055c0 con 0x7ff38800bc70 2024-09-13T17:06:54.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.634+0000 7ff37bfff700 1 -- 172.21.15.123:0/1911680692 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff37c01f020 con 0x7ff38800bc70 2024-09-13T17:06:54.642 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2024-09-13T17:06:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.638+0000 7ffafe856700 1 -- 172.21.15.123:0/4017317850 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffadc066780 msgr2=0x7ffadc068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.638+0000 7ffafe856700 1 --2- 172.21.15.123:0/4017317850 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffadc066780 0x7ffadc068c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffaf81f9e90 tx=0x7ffae8008040 comp rx=0 tx=0).stop 2024-09-13T17:06:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.638+0000 7ffafe856700 1 -- 172.21.15.123:0/4017317850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaf80706a0 msgr2=0x7ffaf80c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.638+0000 7ffafe856700 1 --2- 172.21.15.123:0/4017317850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaf80706a0 0x7ffaf80c5750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000efc0 tx=0x7ffaf000c3a0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.638+0000 7ffafe856700 1 -- 172.21.15.123:0/4017317850 shutdown_connections 2024-09-13T17:06:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.638+0000 7ffafe856700 1 --2- 172.21.15.123:0/4017317850 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffadc066780 0x7ffadc068c40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.638+0000 7ffafe856700 1 --2- 172.21.15.123:0/4017317850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaf80cb000 0x7ffaf8159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.638+0000 7ffafe856700 1 --2- 172.21.15.123:0/4017317850 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffaf80b3990 0x7ffaf80af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.638+0000 7ffafe856700 1 --2- 172.21.15.123:0/4017317850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaf80706a0 0x7ffaf80c5750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.638+0000 7ffafe856700 1 -- 172.21.15.123:0/4017317850 >> 172.21.15.123:0/4017317850 conn(0x7ffaf8066780 msgr2=0x7ffaf80acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.638+0000 7ffafe856700 1 -- 172.21.15.123:0/4017317850 shutdown_connections 2024-09-13T17:06:54.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.638+0000 7ffafe856700 1 -- 172.21.15.123:0/4017317850 wait complete. 2024-09-13T17:06:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.642+0000 7ff394dbb700 1 -- 172.21.15.123:0/1911680692 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff374066760 msgr2=0x7ff374068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.642+0000 7ff394dbb700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff374066760 0x7ff374068c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff38804e720 tx=0x7ff384008040 comp rx=0 tx=0).stop 2024-09-13T17:06:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.642+0000 7ff394dbb700 1 -- 172.21.15.123:0/1911680692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff38800bc70 msgr2=0x7ff38804ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.642+0000 7ff394dbb700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff38800bc70 0x7ff38804ca00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00c7f0 tx=0x7ff37c00cbb0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.642+0000 7ff394dbb700 1 -- 172.21.15.123:0/1911680692 shutdown_connections 2024-09-13T17:06:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.642+0000 7ff394dbb700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff374066760 0x7ff374068c20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.642+0000 7ff394dbb700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3880507a0 0x7ff38804b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.642+0000 7ff394dbb700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff388033c60 0x7ff3880d4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.642+0000 7ff394dbb700 1 --2- 172.21.15.123:0/1911680692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff38800bc70 0x7ff38804ca00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.642+0000 7ff394dbb700 1 -- 172.21.15.123:0/1911680692 >> 172.21.15.123:0/1911680692 conn(0x7ff388036140 msgr2=0x7ff38801c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.642+0000 7ff394dbb700 1 -- 172.21.15.123:0/1911680692 shutdown_connections 2024-09-13T17:06:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.642+0000 7ff394dbb700 1 -- 172.21.15.123:0/1911680692 wait complete. 2024-09-13T17:06:54.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-09-13T17:06:54.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-09-13T17:06:54.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-09-13T17:06:54.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.654+0000 7f1115554700 1 -- 172.21.15.123:0/3531442006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f10f00055c0 con 0x7f1110151790 2024-09-13T17:06:54.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.654+0000 7f110cff9700 1 -- 172.21.15.123:0/3531442006 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1104056030 con 0x7f1110151790 2024-09-13T17:06:54.659 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-09-13T17:06:54.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.654+0000 7f1115554700 1 -- 172.21.15.123:0/3531442006 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f10f8068240 msgr2=0x7f10f806a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.654+0000 7f1115554700 1 --2- 172.21.15.123:0/3531442006 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f10f8068240 0x7f10f806a700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1100001aa0 tx=0x7f1100008990 comp rx=0 tx=0).stop 2024-09-13T17:06:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.654+0000 7f1115554700 1 -- 172.21.15.123:0/3531442006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1110151790 msgr2=0x7f111006c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.654+0000 7f1115554700 1 --2- 172.21.15.123:0/3531442006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1110151790 0x7f111006c780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1104007fd0 tx=0x7f1104001120 comp rx=0 tx=0).stop 2024-09-13T17:06:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.654+0000 7f1115554700 1 -- 172.21.15.123:0/3531442006 shutdown_connections 2024-09-13T17:06:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.654+0000 7f1115554700 1 --2- 172.21.15.123:0/3531442006 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f10f8068240 0x7f10f806a700 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.654+0000 7f1115554700 1 --2- 172.21.15.123:0/3531442006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1110151220 0x7f111006ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.654+0000 7f1115554700 1 --2- 172.21.15.123:0/3531442006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1110151790 0x7f111006c780 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.654+0000 7f1115554700 1 --2- 172.21.15.123:0/3531442006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10f8004420 0x7f11100c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.654+0000 7f1115554700 1 -- 172.21.15.123:0/3531442006 >> 172.21.15.123:0/3531442006 conn(0x7f1110066780 msgr2=0x7f11100b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.654+0000 7f1115554700 1 -- 172.21.15.123:0/3531442006 shutdown_connections 2024-09-13T17:06:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.654+0000 7f1115554700 1 -- 172.21.15.123:0/3531442006 wait complete. 2024-09-13T17:06:54.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.658+0000 7efd32745700 1 -- 172.21.15.123:0/1605437817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efd2c0b4600 con 0x7efd2c0ad490 2024-09-13T17:06:54.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2024-09-13T17:06:54.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.658+0000 7efd21ffb700 1 -- 172.21.15.123:0/1605437817 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd1c021020 con 0x7efd2c0ad490 2024-09-13T17:06:54.664 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-09-13T17:06:54.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.658+0000 7efd32745700 1 -- 172.21.15.123:0/1605437817 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efd10066760 msgr2=0x7efd10068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.658+0000 7efd32745700 1 --2- 172.21.15.123:0/1605437817 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efd10066760 0x7efd10068c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efd280096b0 tx=0x7efd28018000 comp rx=0 tx=0).stop 2024-09-13T17:06:54.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.658+0000 7efd32745700 1 -- 172.21.15.123:0/1605437817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd2c0ad490 msgr2=0x7efd2c1fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:54.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.658+0000 7efd32745700 1 --2- 172.21.15.123:0/1605437817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd2c0ad490 0x7efd2c1fee40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00e840 tx=0x7efd1c00eb50 comp rx=0 tx=0).stop 2024-09-13T17:06:54.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.658+0000 7efd32745700 1 -- 172.21.15.123:0/1605437817 shutdown_connections 2024-09-13T17:06:54.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.658+0000 7efd32745700 1 --2- 172.21.15.123:0/1605437817 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efd10066760 0x7efd10068c20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.658+0000 7efd32745700 1 --2- 172.21.15.123:0/1605437817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efd2c15cf20 0x7efd2c202c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.658+0000 7efd32745700 1 --2- 172.21.15.123:0/1605437817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd2c0ad490 0x7efd2c1fee40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.658+0000 7efd32745700 1 --2- 172.21.15.123:0/1605437817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c070df0 0x7efd2c15d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:54.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.658+0000 7efd32745700 1 -- 172.21.15.123:0/1605437817 >> 172.21.15.123:0/1605437817 conn(0x7efd2c066780 msgr2=0x7efd2c0ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:54.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.658+0000 7efd32745700 1 -- 172.21.15.123:0/1605437817 shutdown_connections 2024-09-13T17:06:54.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:54.658+0000 7efd32745700 1 -- 172.21.15.123:0/1605437817 wait complete. 2024-09-13T17:06:54.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2024-09-13T17:06:54.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2024-09-13T17:06:55.635 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T17:06:55.635 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T17:06:55.652 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T17:06:55.654 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T17:06:55.656 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T17:06:55.664 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T17:06:55.673 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T17:06:55.676 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T17:06:55.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.762+0000 7fdcd9f79700 1 Processor -- start 2024-09-13T17:06:55.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.762+0000 7fdcd9f79700 1 -- start start 2024-09-13T17:06:55.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd9f79700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdcd4071d80 0x7fdcd406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd9f79700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdcd40706a0 0x7fdcd4070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd9f79700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd4072590 con 0x7fdcd406d600 2024-09-13T17:06:55.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd9f79700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd4071090 con 0x7fdcd4071d80 2024-09-13T17:06:55.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd9f79700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd40ce2c0 con 0x7fdcd40706a0 2024-09-13T17:06:55.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd37fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdcd406d600 0x7fdcd40c8cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49196/0 (socket says 172.21.15.123:49196) 2024-09-13T17:06:55.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd37fe700 1 -- 172.21.15.123:0/2357085832 learned_addr learned my addr 172.21.15.123:0/2357085832 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:55.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd3fff700 1 --2- 172.21.15.123:0/2357085832 >> v2:172.21.15.153:3300/0 conn(0x7fdcd40706a0 0x7fdcd4070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd2ffd700 1 --2- 172.21.15.123:0/2357085832 >> v2:172.21.15.123:3300/0 conn(0x7fdcd4071d80 0x7fdcd406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd2ffd700 1 -- 172.21.15.123:0/2357085832 >> v2:172.21.15.153:3300/0 conn(0x7fdcd40706a0 msgr2=0x7fdcd4070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:55.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd2ffd700 1 --2- 172.21.15.123:0/2357085832 >> v2:172.21.15.153:3300/0 conn(0x7fdcd40706a0 0x7fdcd4070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd2ffd700 1 -- 172.21.15.123:0/2357085832 >> v1:172.21.15.123:6789/0 conn(0x7fdcd406d600 legacy=0x7fdcd40c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd2ffd700 1 -- 172.21.15.123:0/2357085832 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd40722b0 con 0x7fdcd4071d80 2024-09-13T17:06:55.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd2ffd700 1 --2- 172.21.15.123:0/2357085832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcd4071d80 0x7fdcd406d9e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40c8c60 tx=0x7fdcc8009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20561b85692beb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd27fc700 1 -- 172.21.15.123:0/2357085832 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8004230 con 0x7fdcd4071d80 2024-09-13T17:06:55.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.766+0000 7fdcd27fc700 1 -- 172.21.15.123:0/2357085832 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc8004390 con 0x7fdcd4071d80 2024-09-13T17:06:55.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.770+0000 7fdcd9f79700 1 -- 172.21.15.123:0/2357085832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcd4071d80 msgr2=0x7fdcd406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.770+0000 7fdcd9f79700 1 --2- 172.21.15.123:0/2357085832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcd4071d80 0x7fdcd406d9e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40c8c60 tx=0x7fdcc8009d90 comp rx=0 tx=0).stop 2024-09-13T17:06:55.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.770+0000 7fdcd9f79700 1 -- 172.21.15.123:0/2357085832 shutdown_connections 2024-09-13T17:06:55.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.770+0000 7fdcd9f79700 1 --2- 172.21.15.123:0/2357085832 >> v2:172.21.15.153:3300/0 conn(0x7fdcd40706a0 0x7fdcd4070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.770+0000 7fdcd9f79700 1 --2- 172.21.15.123:0/2357085832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcd4071d80 0x7fdcd406d9e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.770+0000 7fdcd9f79700 1 -- 172.21.15.123:0/2357085832 >> 172.21.15.123:0/2357085832 conn(0x7fdcd4066780 msgr2=0x7fdcd40b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:55.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.770+0000 7fdcd9f79700 1 -- 172.21.15.123:0/2357085832 shutdown_connections 2024-09-13T17:06:55.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.770+0000 7fdcd9f79700 1 -- 172.21.15.123:0/2357085832 wait complete. 2024-09-13T17:06:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.770+0000 7fdcd9f79700 1 Processor -- start 2024-09-13T17:06:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.770+0000 7fdcd9f79700 1 -- start start 2024-09-13T17:06:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd9f79700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcd406d600 0x7fdcd40c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd9f79700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcd40706a0 0x7fdcd40af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd9f79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd4071d80 0x7fdcd414d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcd406d600 0x7fdcd40c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcd406d600 0x7fdcd40c6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46574/0 (socket says 172.21.15.123:46574) 2024-09-13T17:06:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd9f79700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd414d2a0 con 0x7fdcd406d600 2024-09-13T17:06:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd9f79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd414f630 con 0x7fdcd4071d80 2024-09-13T17:06:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd9f79700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd414cf50 con 0x7fdcd40706a0 2024-09-13T17:06:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd37fe700 1 -- 172.21.15.123:0/4238391292 learned_addr learned my addr 172.21.15.123:0/4238391292 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd3fff700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd4071d80 0x7fdcd414d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd37fe700 1 -- 172.21.15.123:0/4238391292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcd40706a0 msgr2=0x7fdcd40af900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:06:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd2ffd700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcd40706a0 0x7fdcd40af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd37fe700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcd40706a0 0x7fdcd40af900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd37fe700 1 -- 172.21.15.123:0/4238391292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd4071d80 msgr2=0x7fdcd414d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd37fe700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd4071d80 0x7fdcd414d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd37fe700 1 -- 172.21.15.123:0/4238391292 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc80094b0 con 0x7fdcd406d600 2024-09-13T17:06:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd3fff700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd4071d80 0x7fdcd414d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd37fe700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcd406d600 0x7fdcd40c6fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400c7b0 tx=0x7fdcc400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd2ffd700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcd40706a0 0x7fdcd40af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:06:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcbbfff700 1 -- 172.21.15.123:0/4238391292 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4004ca0 con 0x7fdcd406d600 2024-09-13T17:06:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd9f79700 1 -- 172.21.15.123:0/4238391292 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd414f880 con 0x7fdcd406d600 2024-09-13T17:06:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.774+0000 7fdcd9f79700 1 -- 172.21.15.123:0/4238391292 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd414fe40 con 0x7fdcd406d600 2024-09-13T17:06:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.778+0000 7fdcbbfff700 1 -- 172.21.15.123:0/4238391292 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc4004e00 con 0x7fdcd406d600 2024-09-13T17:06:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.778+0000 7fdcbbfff700 1 -- 172.21.15.123:0/4238391292 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4007310 con 0x7fdcd406d600 2024-09-13T17:06:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.778+0000 7fdcbbfff700 1 -- 172.21.15.123:0/4238391292 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdcc40074b0 con 0x7fdcd406d600 2024-09-13T17:06:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.778+0000 7fdcbbfff700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdcc0066880 0x7fdcc0068d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.778+0000 7fdcd2ffd700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdcc0066880 0x7fdcc0068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.778+0000 7fdcd2ffd700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdcc0066880 0x7fdcc0068d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40c8c60 tx=0x7fdcc8008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.778+0000 7fdcbbfff700 1 -- 172.21.15.123:0/4238391292 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcc4084030 con 0x7fdcd406d600 2024-09-13T17:06:55.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.782+0000 7fdcd9f79700 1 -- 172.21.15.123:0/4238391292 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd4150030 con 0x7fdcd406d600 2024-09-13T17:06:55.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.782+0000 7f4f9b89c700 1 Processor -- start 2024-09-13T17:06:55.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.782+0000 7f4f9b89c700 1 -- start start 2024-09-13T17:06:55.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.786+0000 7f4f9b89c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4f940c93e0 0x7f4f94158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.786+0000 7f4f9b89c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f940cc580 0x7f4f940cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.786+0000 7f4f9b89c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940707d0 con 0x7f4f94066b90 2024-09-13T17:06:55.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.786+0000 7f4f9b89c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f940cd5e0 con 0x7f4f940c93e0 2024-09-13T17:06:55.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.786+0000 7f4f9b89c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940cd020 con 0x7f4f940cc580 2024-09-13T17:06:55.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.786+0000 7f4f98e37700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4f940c93e0 0x7f4f94158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.786+0000 7f4f98e37700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4f940c93e0 0x7f4f94158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46584/0 (socket says 172.21.15.123:46584) 2024-09-13T17:06:55.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.786+0000 7f4f98e37700 1 -- 172.21.15.123:0/677200239 learned_addr learned my addr 172.21.15.123:0/677200239 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:55.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.786+0000 7f4f98e37700 1 -- 172.21.15.123:0/677200239 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f940cc580 msgr2=0x7f4f940cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:55.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.786+0000 7f4f98e37700 1 --2- 172.21.15.123:0/677200239 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f940cc580 0x7f4f940cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.786+0000 7f4f98e37700 1 -- 172.21.15.123:0/677200239 >> v1:172.21.15.153:6789/0 conn(0x7f4f94066b90 legacy=0x7f4f940c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.786+0000 7f4f98e37700 1 -- 172.21.15.123:0/677200239 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f940cd300 con 0x7f4f940c93e0 2024-09-13T17:06:55.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.786+0000 7f4f98e37700 1 --2- 172.21.15.123:0/677200239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f940c93e0 0x7f4f94158fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009e50 tx=0x7f4f8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559f10e125a1f30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.790+0000 7f4f8bfff700 1 -- 172.21.15.123:0/677200239 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00e070 con 0x7f4f940c93e0 2024-09-13T17:06:55.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.790+0000 7fdcbbfff700 1 -- 172.21.15.123:0/4238391292 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdcc4051380 con 0x7fdcd406d600 2024-09-13T17:06:55.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.790+0000 7f4f8bfff700 1 -- 172.21.15.123:0/677200239 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c00b9c0 con 0x7f4f940c93e0 2024-09-13T17:06:55.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.790+0000 7f4f8bfff700 1 -- 172.21.15.123:0/677200239 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00bd30 con 0x7f4f940c93e0 2024-09-13T17:06:55.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.790+0000 7f4f9b89c700 1 -- 172.21.15.123:0/677200239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f940c93e0 msgr2=0x7f4f94158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.790+0000 7f4f9b89c700 1 --2- 172.21.15.123:0/677200239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f940c93e0 0x7f4f94158fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009e50 tx=0x7f4f8c00b330 comp rx=0 tx=0).stop 2024-09-13T17:06:55.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.790+0000 7f4f9b89c700 1 -- 172.21.15.123:0/677200239 shutdown_connections 2024-09-13T17:06:55.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.790+0000 7f4f9b89c700 1 --2- 172.21.15.123:0/677200239 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f940cc580 0x7f4f940cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.790+0000 7f4f9b89c700 1 --2- 172.21.15.123:0/677200239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f940c93e0 0x7f4f94158fe0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.790+0000 7f4f9b89c700 1 -- 172.21.15.123:0/677200239 >> 172.21.15.123:0/677200239 conn(0x7f4f94066780 msgr2=0x7f4f940b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:55.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.790+0000 7f4f9b89c700 1 -- 172.21.15.123:0/677200239 shutdown_connections 2024-09-13T17:06:55.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.790+0000 7f4f9b89c700 1 -- 172.21.15.123:0/677200239 wait complete. 2024-09-13T17:06:55.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f9b89c700 1 Processor -- start 2024-09-13T17:06:55.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f9b89c700 1 -- start start 2024-09-13T17:06:55.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f9b89c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f94066b90 0x7f4f940b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f9b89c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f940c93e0 0x7f4f940c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f9b89c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940cc580 0x7f4f9414ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f9b89c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9414cf60 con 0x7f4f940c93e0 2024-09-13T17:06:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f9b89c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9414efb0 con 0x7f4f940cc580 2024-09-13T17:06:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f9b89c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940b1ab0 con 0x7f4f94066b90 2024-09-13T17:06:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f99638700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f94066b90 0x7f4f940b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f99e39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940cc580 0x7f4f9414ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f99e39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940cc580 0x7f4f9414ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:37468/0 (socket says 172.21.15.123:37468) 2024-09-13T17:06:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f99e39700 1 -- 172.21.15.123:0/2152040396 learned_addr learned my addr 172.21.15.123:0/2152040396 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f99e39700 1 -- 172.21.15.123:0/2152040396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f94066b90 msgr2=0x7f4f940b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f99e39700 1 --2- 172.21.15.123:0/2152040396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f94066b90 0x7f4f940b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f99e39700 1 -- 172.21.15.123:0/2152040396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f940c93e0 msgr2=0x7f4f940c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f99e39700 1 --2- 172.21.15.123:0/2152040396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f940c93e0 0x7f4f940c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f99e39700 1 -- 172.21.15.123:0/2152040396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c009b30 con 0x7f4f940cc580 2024-09-13T17:06:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.794+0000 7f4f99e39700 1 --2- 172.21.15.123:0/2152040396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940cc580 0x7f4f9414ea70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000b430 tx=0x7f4f9000b740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.802+0000 7f4f89ffb700 1 -- 172.21.15.123:0/2152040396 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90011830 con 0x7f4f940cc580 2024-09-13T17:06:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.802+0000 7f4f89ffb700 1 -- 172.21.15.123:0/2152040396 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f90011990 con 0x7f4f940cc580 2024-09-13T17:06:55.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.802+0000 7f4f9b89c700 1 -- 172.21.15.123:0/2152040396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f940b1d90 con 0x7f4f940cc580 2024-09-13T17:06:55.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.802+0000 7f4f9b89c700 1 -- 172.21.15.123:0/2152040396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f940b2350 con 0x7f4f940cc580 2024-09-13T17:06:55.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.802+0000 7f4f89ffb700 1 -- 172.21.15.123:0/2152040396 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90011d20 con 0x7f4f940cc580 2024-09-13T17:06:55.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.802+0000 7f4f89ffb700 1 -- 172.21.15.123:0/2152040396 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f9001a400 con 0x7f4f940cc580 2024-09-13T17:06:55.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.806+0000 7f4f89ffb700 1 --2- 172.21.15.123:0/2152040396 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4f78066800 0x7f4f78068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.806+0000 7f4f99638700 1 --2- 172.21.15.123:0/2152040396 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4f78066800 0x7f4f78068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.806+0000 7f4f89ffb700 1 -- 172.21.15.123:0/2152040396 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f90084020 con 0x7f4f940cc580 2024-09-13T17:06:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.806+0000 7f4f9b89c700 1 -- 172.21.15.123:0/2152040396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f74005310 con 0x7f4f940cc580 2024-09-13T17:06:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.806+0000 7f4f99638700 1 --2- 172.21.15.123:0/2152040396 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4f78066800 0x7f4f78068cc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f84000f60 tx=0x7f4f84009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f0405d14700 1 Processor -- start 2024-09-13T17:06:55.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f0405d14700 1 -- start start 2024-09-13T17:06:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f0405d14700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04000c8cd0 0x7f04000cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f0405d14700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f040006bdb0 0x7f040006c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f0405d14700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04000caeb0 con 0x7f04000cb090 2024-09-13T17:06:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f0405d14700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04000ca8f0 con 0x7f040006bdb0 2024-09-13T17:06:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f0405d14700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04000cabd0 con 0x7f04000c8cd0 2024-09-13T17:06:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f03fffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04000c8cd0 0x7f04000cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f0405513700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f040006bdb0 0x7f040006c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f0405513700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f040006bdb0 0x7f040006c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:37478/0 (socket says 172.21.15.123:37478) 2024-09-13T17:06:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f0405513700 1 -- 172.21.15.123:0/621746403 learned_addr learned my addr 172.21.15.123:0/621746403 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f03fffff700 1 -- 172.21.15.123:0/621746403 >> v2:172.21.15.153:3300/0 conn(0x7f040006bdb0 msgr2=0x7f040006c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f03fffff700 1 --2- 172.21.15.123:0/621746403 >> v2:172.21.15.153:3300/0 conn(0x7f040006bdb0 0x7f040006c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f03fffff700 1 -- 172.21.15.123:0/621746403 >> v1:172.21.15.153:6789/0 conn(0x7f04000cb090 legacy=0x7f04000cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f03fffff700 1 -- 172.21.15.123:0/621746403 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04000cc620 con 0x7f04000c8cd0 2024-09-13T17:06:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f03fffff700 1 --2- 172.21.15.123:0/621746403 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04000c8cd0 0x7f04000cdfd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009850 tx=0x7f03f4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a17da6b1fab3687 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f4f89ffb700 1 -- 172.21.15.123:0/2152040396 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4f90015080 con 0x7f4f940cc580 2024-09-13T17:06:55.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f03ff7fe700 1 -- 172.21.15.123:0/621746403 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f4011830 con 0x7f04000c8cd0 2024-09-13T17:06:55.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f03ff7fe700 1 -- 172.21.15.123:0/621746403 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f4011990 con 0x7f04000c8cd0 2024-09-13T17:06:55.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f03ff7fe700 1 -- 172.21.15.123:0/621746403 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f4011d40 con 0x7f04000c8cd0 2024-09-13T17:06:55.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f4d85621700 1 Processor -- start 2024-09-13T17:06:55.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.818+0000 7f4d85621700 1 -- start start 2024-09-13T17:06:55.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d85621700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4d8015aa00 0x7f4d800cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d85621700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d800afc90 0x7f4d800cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d85621700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d800af590 0x7f4d800c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d85621700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8006e360 con 0x7f4d8015aa00 2024-09-13T17:06:55.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d85621700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8006dac0 con 0x7f4d800af590 2024-09-13T17:06:55.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d85621700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8006dda0 con 0x7f4d800afc90 2024-09-13T17:06:55.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d7e7fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d800afc90 0x7f4d800cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d7e7fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d800afc90 0x7f4d800cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:37744/0 (socket says 172.21.15.123:37744) 2024-09-13T17:06:55.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d7e7fc700 1 -- 172.21.15.123:0/190325394 learned_addr learned my addr 172.21.15.123:0/190325394 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:55.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d7effd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4d8015aa00 0x7f4d800cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d7f7fe700 1 --2- 172.21.15.123:0/190325394 >> v2:172.21.15.153:3300/0 conn(0x7f4d800af590 0x7f4d800c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f0405d14700 1 -- 172.21.15.123:0/621746403 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04000c8cd0 msgr2=0x7f04000cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f0405d14700 1 --2- 172.21.15.123:0/621746403 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04000c8cd0 0x7f04000cdfd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009850 tx=0x7f03f4009b60 comp rx=0 tx=0).stop 2024-09-13T17:06:55.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f0405d14700 1 -- 172.21.15.123:0/621746403 shutdown_connections 2024-09-13T17:06:55.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f0405d14700 1 --2- 172.21.15.123:0/621746403 >> v2:172.21.15.153:3300/0 conn(0x7f040006bdb0 0x7f040006c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f0405d14700 1 --2- 172.21.15.123:0/621746403 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04000c8cd0 0x7f04000cdfd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f0405d14700 1 -- 172.21.15.123:0/621746403 >> 172.21.15.123:0/621746403 conn(0x7f0400066780 msgr2=0x7f04000b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:55.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d7e7fc700 1 -- 172.21.15.123:0/190325394 >> v2:172.21.15.153:3300/0 conn(0x7f4d800af590 msgr2=0x7f4d800c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:55.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d7e7fc700 1 --2- 172.21.15.123:0/190325394 >> v2:172.21.15.153:3300/0 conn(0x7f4d800af590 0x7f4d800c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d7e7fc700 1 -- 172.21.15.123:0/190325394 >> v2:172.21.15.123:3300/0 conn(0x7f4d8015aa00 msgr2=0x7f4d800cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:55.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d7e7fc700 1 --2- 172.21.15.123:0/190325394 >> v2:172.21.15.123:3300/0 conn(0x7f4d8015aa00 0x7f4d800cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d7e7fc700 1 -- 172.21.15.123:0/190325394 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8006e080 con 0x7f4d800afc90 2024-09-13T17:06:55.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f0405d14700 1 -- 172.21.15.123:0/621746403 shutdown_connections 2024-09-13T17:06:55.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d7e7fc700 1 --2- 172.21.15.123:0/190325394 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d800afc90 0x7f4d800cb7d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4d800c8dd0 tx=0x7f4d7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b181db0e42a480f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f0405d14700 1 -- 172.21.15.123:0/621746403 wait complete. 2024-09-13T17:06:55.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f0405d14700 1 Processor -- start 2024-09-13T17:06:55.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f0405d14700 1 -- start start 2024-09-13T17:06:55.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d7dffb700 1 -- 172.21.15.123:0/190325394 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800bb10 con 0x7f4d800afc90 2024-09-13T17:06:55.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d7dffb700 1 -- 172.21.15.123:0/190325394 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7800bc70 con 0x7f4d800afc90 2024-09-13T17:06:55.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f4d7dffb700 1 -- 172.21.15.123:0/190325394 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780104d0 con 0x7f4d800afc90 2024-09-13T17:06:55.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f0405d14700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f040006bdb0 0x7f040015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f0405d14700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04000c8cd0 0x7f0400162500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.822+0000 7f0405d14700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04000cb090 0x7f04000c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f0405d14700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04000c4eb0 con 0x7f04000c8cd0 2024-09-13T17:06:55.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f0405d14700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04000c5750 con 0x7f04000cb090 2024-09-13T17:06:55.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f0405d14700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04000c5ff0 con 0x7f040006bdb0 2024-09-13T17:06:55.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f03fffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04000c8cd0 0x7f0400162500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f03fffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04000c8cd0 0x7f0400162500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46610/0 (socket says 172.21.15.123:46610) 2024-09-13T17:06:55.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f03fffff700 1 -- 172.21.15.123:0/1254009040 learned_addr learned my addr 172.21.15.123:0/1254009040 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:55.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f0404d12700 1 --2- 172.21.15.123:0/1254009040 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f040006bdb0 0x7f040015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f0405513700 1 --2- 172.21.15.123:0/1254009040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04000cb090 0x7f04000c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f4d85621700 1 -- 172.21.15.123:0/190325394 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d800afc90 msgr2=0x7f4d800cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f4d85621700 1 --2- 172.21.15.123:0/190325394 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d800afc90 0x7f4d800cb7d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4d800c8dd0 tx=0x7f4d7800b330 comp rx=0 tx=0).stop 2024-09-13T17:06:55.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f4d85621700 1 -- 172.21.15.123:0/190325394 shutdown_connections 2024-09-13T17:06:55.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f4d85621700 1 --2- 172.21.15.123:0/190325394 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d800afc90 0x7f4d800cb7d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f4d85621700 1 --2- 172.21.15.123:0/190325394 >> v2:172.21.15.153:3300/0 conn(0x7f4d800af590 0x7f4d800c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f4d85621700 1 --2- 172.21.15.123:0/190325394 >> v2:172.21.15.123:3300/0 conn(0x7f4d8015aa00 0x7f4d800cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f4d85621700 1 -- 172.21.15.123:0/190325394 >> 172.21.15.123:0/190325394 conn(0x7f4d800b0450 msgr2=0x7f4d800b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:55.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f4d85621700 1 -- 172.21.15.123:0/190325394 shutdown_connections 2024-09-13T17:06:55.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f03fffff700 1 -- 172.21.15.123:0/1254009040 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f040006bdb0 msgr2=0x7f040015ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f03fffff700 1 --2- 172.21.15.123:0/1254009040 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f040006bdb0 0x7f040015ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f03fffff700 1 -- 172.21.15.123:0/1254009040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04000cb090 msgr2=0x7f04000c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f03fffff700 1 --2- 172.21.15.123:0/1254009040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04000cb090 0x7f04000c4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f03fffff700 1 -- 172.21.15.123:0/1254009040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f40094b0 con 0x7f04000c8cd0 2024-09-13T17:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f03fffff700 1 --2- 172.21.15.123:0/1254009040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04000c8cd0 0x7f0400162500 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f03f4013000 tx=0x7f03f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f03fd7fa700 1 -- 172.21.15.123:0/1254009040 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f4004480 con 0x7f04000c8cd0 2024-09-13T17:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f03fd7fa700 1 -- 172.21.15.123:0/1254009040 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f401f070 con 0x7f04000c8cd0 2024-09-13T17:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f0405d14700 1 -- 172.21.15.123:0/1254009040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040015f480 con 0x7f04000c8cd0 2024-09-13T17:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f0405d14700 1 -- 172.21.15.123:0/1254009040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04001fa9d0 con 0x7f04000c8cd0 2024-09-13T17:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f03fd7fa700 1 -- 172.21.15.123:0/1254009040 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f4003900 con 0x7f04000c8cd0 2024-09-13T17:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f0405d14700 1 -- 172.21.15.123:0/1254009040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e0005310 con 0x7f04000c8cd0 2024-09-13T17:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f4d85621700 1 -- 172.21.15.123:0/190325394 wait complete. 2024-09-13T17:06:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f4d85621700 1 Processor -- start 2024-09-13T17:06:55.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f03fd7fa700 1 -- 172.21.15.123:0/1254009040 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f03f4021030 con 0x7f04000c8cd0 2024-09-13T17:06:55.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f03fd7fa700 1 --2- 172.21.15.123:0/1254009040 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f03ec066730 0x7f03ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.826+0000 7f4d85621700 1 -- start start 2024-09-13T17:06:55.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f03fd7fa700 1 -- 172.21.15.123:0/1254009040 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03f4085570 con 0x7f04000c8cd0 2024-09-13T17:06:55.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa579e51700 1 Processor -- start 2024-09-13T17:06:55.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa579e51700 1 -- start start 2024-09-13T17:06:55.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d85621700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d800af590 0x7f4d801fed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d85621700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d800afc90 0x7f4d800b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d85621700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d8015aa00 0x7f4d800b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d85621700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801ff260 con 0x7f4d8015aa00 2024-09-13T17:06:55.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d85621700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800c6ae0 con 0x7f4d800afc90 2024-09-13T17:06:55.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d85621700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800c6dc0 con 0x7f4d800af590 2024-09-13T17:06:55.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d7f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d8015aa00 0x7f4d800b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d7f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d8015aa00 0x7f4d800b1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46618/0 (socket says 172.21.15.123:46618) 2024-09-13T17:06:55.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d7f7fe700 1 -- 172.21.15.123:0/2408692214 learned_addr learned my addr 172.21.15.123:0/2408692214 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:55.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d7e7fc700 1 --2- 172.21.15.123:0/2408692214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d800afc90 0x7f4d800b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d7effd700 1 --2- 172.21.15.123:0/2408692214 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d800af590 0x7f4d801fed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d7f7fe700 1 -- 172.21.15.123:0/2408692214 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d800af590 msgr2=0x7f4d801fed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d7f7fe700 1 --2- 172.21.15.123:0/2408692214 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d800af590 0x7f4d801fed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d7f7fe700 1 -- 172.21.15.123:0/2408692214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d800afc90 msgr2=0x7f4d800b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d7f7fe700 1 --2- 172.21.15.123:0/2408692214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d800afc90 0x7f4d800b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d7f7fe700 1 -- 172.21.15.123:0/2408692214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d78009b30 con 0x7f4d8015aa00 2024-09-13T17:06:55.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa579e51700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5740ad490 0x7fa5740708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa579e51700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa57415d300 con 0x7fa574070df0 2024-09-13T17:06:55.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa579e51700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5740cb1a0 con 0x7fa57415cf20 2024-09-13T17:06:55.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa579e51700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa574071280 con 0x7fa5740ad490 2024-09-13T17:06:55.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7f4d7f7fe700 1 --2- 172.21.15.123:0/2408692214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d8015aa00 0x7f4d800b1f40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4d7000e880 tx=0x7f4d7000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa579650700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa574070df0 0x7fa5740c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49200/0 (socket says 172.21.15.123:49200) 2024-09-13T17:06:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa579650700 1 -- 172.21.15.123:0/113817379 learned_addr learned my addr 172.21.15.123:0/113817379 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa573fff700 1 --2- 172.21.15.123:0/113817379 >> v2:172.21.15.153:3300/0 conn(0x7fa5740ad490 0x7fa5740708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa573fff700 1 -- 172.21.15.123:0/113817379 >> v1:172.21.15.153:6789/0 conn(0x7fa57415cf20 legacy=0x7fa5740ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa573fff700 1 -- 172.21.15.123:0/113817379 >> v1:172.21.15.123:6789/0 conn(0x7fa574070df0 legacy=0x7fa5740c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa573fff700 1 -- 172.21.15.123:0/113817379 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5740cb480 con 0x7fa5740ad490 2024-09-13T17:06:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa573fff700 1 --2- 172.21.15.123:0/113817379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5740ad490 0x7fa5740708b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa568009880 tx=0x7fa568009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89534324cd6f6e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa5737fe700 1 -- 172.21.15.123:0/113817379 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa568011830 con 0x7fa5740ad490 2024-09-13T17:06:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa5737fe700 1 -- 172.21.15.123:0/113817379 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa568011990 con 0x7fa5740ad490 2024-09-13T17:06:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.830+0000 7fa5737fe700 1 -- 172.21.15.123:0/113817379 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa568011d20 con 0x7fa5740ad490 2024-09-13T17:06:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 -- 172.21.15.123:0/113817379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5740ad490 msgr2=0x7fa5740708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 --2- 172.21.15.123:0/113817379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5740ad490 0x7fa5740708b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa568009880 tx=0x7fa568009b90 comp rx=0 tx=0).stop 2024-09-13T17:06:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 -- 172.21.15.123:0/113817379 shutdown_connections 2024-09-13T17:06:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 --2- 172.21.15.123:0/113817379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5740ad490 0x7fa5740708b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 -- 172.21.15.123:0/113817379 >> 172.21.15.123:0/113817379 conn(0x7fa574066780 msgr2=0x7fa5740b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 -- 172.21.15.123:0/113817379 shutdown_connections 2024-09-13T17:06:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 -- 172.21.15.123:0/113817379 wait complete. 2024-09-13T17:06:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7f0404d12700 1 --2- 172.21.15.123:0/1254009040 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f03ec066730 0x7f03ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7f03fd7fa700 1 -- 172.21.15.123:0/1254009040 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f03f40529f0 con 0x7f04000c8cd0 2024-09-13T17:06:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7f0404d12700 1 --2- 172.21.15.123:0/1254009040 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f03ec066730 0x7f03ec068bf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f03f0000f60 tx=0x7f03f0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7f0cc7d5b700 1 Processor -- start 2024-09-13T17:06:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7f4d677fe700 1 -- 172.21.15.123:0/2408692214 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70013680 con 0x7f4d8015aa00 2024-09-13T17:06:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7f4d677fe700 1 -- 172.21.15.123:0/2408692214 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d700137e0 con 0x7f4d8015aa00 2024-09-13T17:06:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7f4d677fe700 1 -- 172.21.15.123:0/2408692214 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70013b70 con 0x7f4d8015aa00 2024-09-13T17:06:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7f4d85621700 1 -- 172.21.15.123:0/2408692214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d800c70a0 con 0x7f4d8015aa00 2024-09-13T17:06:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7f4d85621700 1 -- 172.21.15.123:0/2408692214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d800c7660 con 0x7f4d8015aa00 2024-09-13T17:06:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 Processor -- start 2024-09-13T17:06:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 -- start start 2024-09-13T17:06:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa574070df0 0x7fa574151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5740ad490 0x7fa5740c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa57415cf20 0x7fa5740c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa574154e30 con 0x7fa5740ad490 2024-09-13T17:06:55.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740c6200 con 0x7fa57415cf20 2024-09-13T17:06:55.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.834+0000 7fa579e51700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa574155350 con 0x7fa574070df0 2024-09-13T17:06:55.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f0cc7d5b700 1 -- start start 2024-09-13T17:06:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7fa578e4f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa574070df0 0x7fa574151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7fa578e4f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa574070df0 0x7fa574151ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:37752/0 (socket says 172.21.15.123:37752) 2024-09-13T17:06:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7fa578e4f700 1 -- 172.21.15.123:0/1684526355 learned_addr learned my addr 172.21.15.123:0/1684526355 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7fa579650700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa57415cf20 0x7fa5740c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7fa573fff700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5740ad490 0x7fa5740c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7fa579650700 1 -- 172.21.15.123:0/1684526355 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa574070df0 msgr2=0x7fa574151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7fa579650700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa574070df0 0x7fa574151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7fa579650700 1 -- 172.21.15.123:0/1684526355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5740ad490 msgr2=0x7fa5740c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7fa579650700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5740ad490 0x7fa5740c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7fa579650700 1 -- 172.21.15.123:0/1684526355 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5680094b0 con 0x7fa57415cf20 2024-09-13T17:06:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7fa573fff700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5740ad490 0x7fa5740c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f0cc7d5b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0cc015cc40 0x7f0cc00ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7fa579650700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa57415cf20 0x7fa5740c8010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00caa0 tx=0x7fa56c00cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f0cc7d5b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cc00cb870 0x7f0cc00ad220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f0cc7d5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc00afda0 con 0x7f0cc00cc450 2024-09-13T17:06:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f0cc7d5b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc00b02d0 con 0x7f0cc015cc40 2024-09-13T17:06:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f0cc7d5b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00aca60 con 0x7f0cc00cb870 2024-09-13T17:06:55.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f0cc5af7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0cc015cc40 0x7f0cc00ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f0cc5af7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0cc015cc40 0x7f0cc00ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46630/0 (socket says 172.21.15.123:46630) 2024-09-13T17:06:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f0cc5af7700 1 -- 172.21.15.123:0/3897126628 learned_addr learned my addr 172.21.15.123:0/3897126628 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f0cc5af7700 1 -- 172.21.15.123:0/3897126628 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cc00cb870 msgr2=0x7f0cc00ad220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:06:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f0cc5af7700 1 --2- 172.21.15.123:0/3897126628 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cc00cb870 0x7f0cc00ad220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f0cc5af7700 1 -- 172.21.15.123:0/3897126628 >> v1:172.21.15.153:6789/0 conn(0x7f0cc00cc450 legacy=0x7f0cc01608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f0cc5af7700 1 -- 172.21.15.123:0/3897126628 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00afff0 con 0x7f0cc015cc40 2024-09-13T17:06:55.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f0cc5af7700 1 --2- 172.21.15.123:0/3897126628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc015cc40 0x7f0cc00ae2c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009e50 tx=0x7f0cb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c89efee55a6c55e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f4d677fe700 1 -- 172.21.15.123:0/2408692214 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d70013cd0 con 0x7f4d8015aa00 2024-09-13T17:06:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f4d677fe700 1 --2- 172.21.15.123:0/2408692214 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4d6c066800 0x7f4d6c068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f4d7effd700 1 --2- 172.21.15.123:0/2408692214 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4d6c066800 0x7f4d6c068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f4d677fe700 1 -- 172.21.15.123:0/2408692214 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d70084150 con 0x7f4d8015aa00 2024-09-13T17:06:55.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.838+0000 7f4d7effd700 1 --2- 172.21.15.123:0/2408692214 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4d6c066800 0x7f4d6c068cc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400b9d0 tx=0x7f4d74008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fa5717fa700 1 -- 172.21.15.123:0/1684526355 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c007480 con 0x7fa57415cf20 2024-09-13T17:06:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fa5717fa700 1 -- 172.21.15.123:0/1684526355 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c0075e0 con 0x7fa57415cf20 2024-09-13T17:06:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fa5717fa700 1 -- 172.21.15.123:0/1684526355 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c007950 con 0x7fa57415cf20 2024-09-13T17:06:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fa579e51700 1 -- 172.21.15.123:0/1684526355 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa574155630 con 0x7fa57415cf20 2024-09-13T17:06:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fa579e51700 1 -- 172.21.15.123:0/1684526355 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa574152000 con 0x7fa57415cf20 2024-09-13T17:06:55.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7f4d85621700 1 -- 172.21.15.123:0/2408692214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d800cb290 con 0x7f4d8015aa00 2024-09-13T17:06:55.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fbcce0ef700 1 Processor -- start 2024-09-13T17:06:55.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fbcce0ef700 1 -- start start 2024-09-13T17:06:55.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fa5717fa700 1 -- 172.21.15.123:0/1684526355 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa56c01b3b0 con 0x7fa57415cf20 2024-09-13T17:06:55.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fa5717fa700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa55c066870 0x7fa55c068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fa5717fa700 1 -- 172.21.15.123:0/1684526355 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa56c083890 con 0x7fa57415cf20 2024-09-13T17:06:55.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fbcce0ef700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcc815c9b0 0x7fbcc80cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fbcce0ef700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbcc80c9530 0x7fbcc80715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fbcce0ef700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc80cdaa0 con 0x7fbcc80cc580 2024-09-13T17:06:55.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fbcce0ef700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc815cd90 con 0x7fbcc815c9b0 2024-09-13T17:06:55.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fbcce0ef700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc8070bb0 con 0x7fbcc80c9530 2024-09-13T17:06:55.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fa578e4f700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa55c066870 0x7fa55c068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fbccd0ed700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcc815c9b0 0x7fbcc80cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fbccd0ed700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcc815c9b0 0x7fbcc80cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46638/0 (socket says 172.21.15.123:46638) 2024-09-13T17:06:55.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fbccd0ed700 1 -- 172.21.15.123:0/2009136337 learned_addr learned my addr 172.21.15.123:0/2009136337 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:55.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.842+0000 7fbccd8ee700 1 --2- 172.21.15.123:0/2009136337 >> v2:172.21.15.153:3300/0 conn(0x7fbcc80c9530 0x7fbcc80715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.846+0000 7fbccd0ed700 1 -- 172.21.15.123:0/2009136337 >> v2:172.21.15.153:3300/0 conn(0x7fbcc80c9530 msgr2=0x7fbcc80715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:55.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.846+0000 7fbccd0ed700 1 --2- 172.21.15.123:0/2009136337 >> v2:172.21.15.153:3300/0 conn(0x7fbcc80c9530 0x7fbcc80715c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.846+0000 7fbccd0ed700 1 -- 172.21.15.123:0/2009136337 >> v1:172.21.15.123:6789/0 conn(0x7fbcc80cc580 legacy=0x7fbcc80c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.846+0000 7fbccd0ed700 1 -- 172.21.15.123:0/2009136337 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc80cdd80 con 0x7fbcc815c9b0 2024-09-13T17:06:55.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.846+0000 7fbccd8ee700 1 --2- 172.21.15.123:0/2009136337 >> v2:172.21.15.153:3300/0 conn(0x7fbcc80c9530 0x7fbcc80715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:55.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.846+0000 7fa578e4f700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa55c066870 0x7fa55c068d30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa5740b4040 tx=0x7fa564009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.846+0000 7fbccd0ed700 1 --2- 172.21.15.123:0/2009136337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc815c9b0 0x7fbcc80cd4a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80b0ab0 tx=0x7fbcc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0b1ea9f7eaa72a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.846+0000 7f4d677fe700 1 -- 172.21.15.123:0/2408692214 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4d700514a0 con 0x7f4d8015aa00 2024-09-13T17:06:55.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7fbcc7fff700 1 -- 172.21.15.123:0/2009136337 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000e070 con 0x7fbcc815c9b0 2024-09-13T17:06:55.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7fbcc7fff700 1 -- 172.21.15.123:0/2009136337 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc000b9c0 con 0x7fbcc815c9b0 2024-09-13T17:06:55.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7fbcc7fff700 1 -- 172.21.15.123:0/2009136337 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000bd70 con 0x7fbcc815c9b0 2024-09-13T17:06:55.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2009136337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc815c9b0 msgr2=0x7fbcc80cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7fbcce0ef700 1 --2- 172.21.15.123:0/2009136337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc815c9b0 0x7fbcc80cd4a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80b0ab0 tx=0x7fbcc000b330 comp rx=0 tx=0).stop 2024-09-13T17:06:55.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2009136337 shutdown_connections 2024-09-13T17:06:55.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7fbcce0ef700 1 --2- 172.21.15.123:0/2009136337 >> v2:172.21.15.153:3300/0 conn(0x7fbcc80c9530 0x7fbcc80715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7fbcce0ef700 1 --2- 172.21.15.123:0/2009136337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc815c9b0 0x7fbcc80cd4a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2009136337 >> 172.21.15.123:0/2009136337 conn(0x7fbcc8066780 msgr2=0x7fbcc80b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:55.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2009136337 shutdown_connections 2024-09-13T17:06:55.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2009136337 wait complete. 2024-09-13T17:06:55.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7fa579e51700 1 -- 172.21.15.123:0/1684526355 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa550005310 con 0x7fa57415cf20 2024-09-13T17:06:55.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7fbcce0ef700 1 Processor -- start 2024-09-13T17:06:55.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7fbcce0ef700 1 -- start start 2024-09-13T17:06:55.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbcce0ef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc80c9530 0x7fbcc81f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbcce0ef700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbcc80cc580 0x7fbcc80c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbcce0ef700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcc815c9b0 0x7fbcc81f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbcce0ef700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc80c6310 con 0x7fbcc80c9530 2024-09-13T17:06:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbccd0ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc80c9530 0x7fbcc81f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbcce0ef700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc80c8000 con 0x7fbcc815c9b0 2024-09-13T17:06:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbcce0ef700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc80c82e0 con 0x7fbcc80cc580 2024-09-13T17:06:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbccd0ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc80c9530 0x7fbcc81f2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46658/0 (socket says 172.21.15.123:46658) 2024-09-13T17:06:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbccd0ed700 1 -- 172.21.15.123:0/2068878460 learned_addr learned my addr 172.21.15.123:0/2068878460 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbccc8ec700 1 --2- 172.21.15.123:0/2068878460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbcc80cc580 0x7fbcc80c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbccd8ee700 1 --2- 172.21.15.123:0/2068878460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcc815c9b0 0x7fbcc81f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbccd0ed700 1 -- 172.21.15.123:0/2068878460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbcc80cc580 msgr2=0x7fbcc80c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbccd0ed700 1 --2- 172.21.15.123:0/2068878460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbcc80cc580 0x7fbcc80c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbccd0ed700 1 -- 172.21.15.123:0/2068878460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcc815c9b0 msgr2=0x7fbcc81f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbccd0ed700 1 --2- 172.21.15.123:0/2068878460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcc815c9b0 0x7fbcc81f6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbccd0ed700 1 -- 172.21.15.123:0/2068878460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc0009b30 con 0x7fbcc80c9530 2024-09-13T17:06:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7fbccd0ed700 1 --2- 172.21.15.123:0/2068878460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc80c9530 0x7fbcc81f2540 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80ce1d0 tx=0x7fbcc0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7f0cc4af5700 1 -- 172.21.15.123:0/3897126628 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb800e070 con 0x7f0cc015cc40 2024-09-13T17:06:55.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7f0cc4af5700 1 -- 172.21.15.123:0/3897126628 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb800b9c0 con 0x7f0cc015cc40 2024-09-13T17:06:55.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7f0cc4af5700 1 -- 172.21.15.123:0/3897126628 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb800bd70 con 0x7f0cc015cc40 2024-09-13T17:06:55.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/3897126628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc015cc40 msgr2=0x7f0cc00ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7f0cc7d5b700 1 --2- 172.21.15.123:0/3897126628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc015cc40 0x7f0cc00ae2c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009e50 tx=0x7f0cb800b330 comp rx=0 tx=0).stop 2024-09-13T17:06:55.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/3897126628 shutdown_connections 2024-09-13T17:06:55.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7f0cc7d5b700 1 --2- 172.21.15.123:0/3897126628 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cc00cb870 0x7f0cc00ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7f0cc7d5b700 1 --2- 172.21.15.123:0/3897126628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc015cc40 0x7f0cc00ae2c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/3897126628 >> 172.21.15.123:0/3897126628 conn(0x7f0cc00b0450 msgr2=0x7f0cc00b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/3897126628 shutdown_connections 2024-09-13T17:06:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/3897126628 wait complete. 2024-09-13T17:06:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7f0cc7d5b700 1 Processor -- start 2024-09-13T17:06:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.850+0000 7f0cc7d5b700 1 -- start start 2024-09-13T17:06:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc7d5b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cc00cb870 0x7f0cc0203830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc7d5b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc00cc450 0x7f0cc00c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc7d5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cc015cc40 0x7f0cc00c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc7d5b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00c7fc0 con 0x7f0cc00cc450 2024-09-13T17:06:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc7d5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0203d70 con 0x7f0cc015cc40 2024-09-13T17:06:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc7d5b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00c5950 con 0x7f0cc00cb870 2024-09-13T17:06:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc52f6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc00cc450 0x7f0cc00c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82d5999700 1 Processor -- start 2024-09-13T17:06:55.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc52f6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc00cc450 0x7f0cc00c6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46648/0 (socket says 172.21.15.123:46648) 2024-09-13T17:06:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc52f6700 1 -- 172.21.15.123:0/730017365 learned_addr learned my addr 172.21.15.123:0/730017365 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc5af7700 1 --2- 172.21.15.123:0/730017365 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cc00cb870 0x7f0cc0203830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc62f8700 1 --2- 172.21.15.123:0/730017365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cc015cc40 0x7f0cc00c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc52f6700 1 -- 172.21.15.123:0/730017365 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cc00cb870 msgr2=0x7f0cc0203830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc52f6700 1 --2- 172.21.15.123:0/730017365 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cc00cb870 0x7f0cc0203830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc52f6700 1 -- 172.21.15.123:0/730017365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cc015cc40 msgr2=0x7f0cc00c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc52f6700 1 --2- 172.21.15.123:0/730017365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cc015cc40 0x7f0cc00c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc52f6700 1 -- 172.21.15.123:0/730017365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8009b30 con 0x7f0cc00cc450 2024-09-13T17:06:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc52f6700 1 --2- 172.21.15.123:0/730017365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc00cc450 0x7f0cc00c6e90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00b4a0 tx=0x7f0cbc00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cb67fc700 1 -- 172.21.15.123:0/730017365 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc011830 con 0x7f0cc00cc450 2024-09-13T17:06:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/730017365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc015a690 con 0x7f0cc00cc450 2024-09-13T17:06:55.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cb67fc700 1 -- 172.21.15.123:0/730017365 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc0119b0 con 0x7f0cc00cc450 2024-09-13T17:06:55.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cb67fc700 1 -- 172.21.15.123:0/730017365 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc011d20 con 0x7f0cc00cc450 2024-09-13T17:06:55.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/730017365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc00c7ab0 con 0x7f0cc00cc450 2024-09-13T17:06:55.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.854+0000 7f0cb67fc700 1 -- 172.21.15.123:0/730017365 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0cbc01a400 con 0x7f0cc00cc450 2024-09-13T17:06:55.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7f0cb67fc700 1 --2- 172.21.15.123:0/730017365 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0cac0668f0 0x7f0cac068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7f0cb67fc700 1 -- 172.21.15.123:0/730017365 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cbc0832f0 con 0x7f0cc00cc450 2024-09-13T17:06:55.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7f0cc5af7700 1 --2- 172.21.15.123:0/730017365 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0cac0668f0 0x7f0cac068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/730017365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc00ad220 con 0x7f0cc00cc450 2024-09-13T17:06:55.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.858+0000 7f0cc5af7700 1 --2- 172.21.15.123:0/730017365 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0cac0668f0 0x7f0cac068db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8000f80 tx=0x7f0cb8009000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82d5999700 1 -- start start 2024-09-13T17:06:55.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82d5999700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f82d0159210 0x7f82d0070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82d5999700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f82d01595f0 0x7f82d00c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82d5999700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d00cbb40 0x7f82d00c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82d5999700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d0071400 con 0x7f82d01595f0 2024-09-13T17:06:55.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82d5999700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d00716e0 con 0x7f82d0159210 2024-09-13T17:06:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82d5999700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00719c0 con 0x7f82d00cbb40 2024-09-13T17:06:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82ce7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f82d01595f0 0x7f82d00c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82ce7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f82d01595f0 0x7f82d00c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46670/0 (socket says 172.21.15.123:46670) 2024-09-13T17:06:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82ce7fc700 1 -- 172.21.15.123:0/73493900 learned_addr learned my addr 172.21.15.123:0/73493900 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82ceffd700 1 --2- 172.21.15.123:0/73493900 >> v2:172.21.15.153:3300/0 conn(0x7f82d0159210 0x7f82d0070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82cf7fe700 1 --2- 172.21.15.123:0/73493900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d00cbb40 0x7f82d00c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82ce7fc700 1 -- 172.21.15.123:0/73493900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d00cbb40 msgr2=0x7f82d00c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82ce7fc700 1 --2- 172.21.15.123:0/73493900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d00cbb40 0x7f82d00c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82ce7fc700 1 -- 172.21.15.123:0/73493900 >> v2:172.21.15.153:3300/0 conn(0x7f82d0159210 msgr2=0x7f82d0070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82ce7fc700 1 --2- 172.21.15.123:0/73493900 >> v2:172.21.15.153:3300/0 conn(0x7f82d0159210 0x7f82d0070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82ce7fc700 1 -- 172.21.15.123:0/73493900 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d0071ca0 con 0x7f82d01595f0 2024-09-13T17:06:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.862+0000 7f82ce7fc700 1 --2- 172.21.15.123:0/73493900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d01595f0 0x7f82d00c8ee0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009e80 tx=0x7f82c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441e594738766ffe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.866+0000 7f0cb67fc700 1 -- 172.21.15.123:0/730017365 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0cbc050670 con 0x7f0cc00cc450 2024-09-13T17:06:55.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.866+0000 7fbcc5ffb700 1 -- 172.21.15.123:0/2068878460 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0004450 con 0x7fbcc80c9530 2024-09-13T17:06:55.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.866+0000 7fbcc5ffb700 1 -- 172.21.15.123:0/2068878460 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc00045d0 con 0x7fbcc80c9530 2024-09-13T17:06:55.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.866+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2068878460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc80c85c0 con 0x7fbcc80c9530 2024-09-13T17:06:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.866+0000 7fa5717fa700 1 -- 172.21.15.123:0/1684526355 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa56c050d90 con 0x7fa57415cf20 2024-09-13T17:06:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.866+0000 7f82cdffb700 1 -- 172.21.15.123:0/73493900 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c800e070 con 0x7f82d01595f0 2024-09-13T17:06:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.866+0000 7f82cdffb700 1 -- 172.21.15.123:0/73493900 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c800b940 con 0x7f82d01595f0 2024-09-13T17:06:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.866+0000 7f82cdffb700 1 -- 172.21.15.123:0/73493900 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c800bcf0 con 0x7f82d01595f0 2024-09-13T17:06:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.866+0000 7f82d5999700 1 -- 172.21.15.123:0/73493900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d01595f0 msgr2=0x7f82d00c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.866+0000 7f82d5999700 1 --2- 172.21.15.123:0/73493900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d01595f0 0x7f82d00c8ee0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009e80 tx=0x7f82c800b330 comp rx=0 tx=0).stop 2024-09-13T17:06:55.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.874+0000 7f82d5999700 1 -- 172.21.15.123:0/73493900 shutdown_connections 2024-09-13T17:06:55.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.874+0000 7f82d5999700 1 --2- 172.21.15.123:0/73493900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d00cbb40 0x7f82d00c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.874+0000 7f82d5999700 1 --2- 172.21.15.123:0/73493900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d01595f0 0x7f82d00c8ee0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.874+0000 7f82d5999700 1 --2- 172.21.15.123:0/73493900 >> v2:172.21.15.153:3300/0 conn(0x7f82d0159210 0x7f82d0070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.874+0000 7f82d5999700 1 -- 172.21.15.123:0/73493900 >> 172.21.15.123:0/73493900 conn(0x7f82d0066780 msgr2=0x7f82d00b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:55.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.866+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2068878460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc81f6570 con 0x7fbcc80c9530 2024-09-13T17:06:55.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.866+0000 7fbcc5ffb700 1 -- 172.21.15.123:0/2068878460 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0004980 con 0x7fbcc80c9530 2024-09-13T17:06:55.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.866+0000 7fbcc5ffb700 1 -- 172.21.15.123:0/2068878460 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbcc001c410 con 0x7fbcc80c9530 2024-09-13T17:06:55.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.870+0000 7fbcc5ffb700 1 --2- 172.21.15.123:0/2068878460 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbcb4066780 0x7fbcb4068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.870+0000 7fbcc5ffb700 1 -- 172.21.15.123:0/2068878460 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbcc0084ff0 con 0x7fbcc80c9530 2024-09-13T17:06:55.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.870+0000 7fbccc8ec700 1 --2- 172.21.15.123:0/2068878460 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbcb4066780 0x7fbcb4068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.870+0000 7fbccc8ec700 1 --2- 172.21.15.123:0/2068878460 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbcb4066780 0x7fbcb4068c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8152ea0 tx=0x7fbcb8009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.878+0000 7f82d5999700 1 -- 172.21.15.123:0/73493900 shutdown_connections 2024-09-13T17:06:55.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.878+0000 7f82d5999700 1 -- 172.21.15.123:0/73493900 wait complete. 2024-09-13T17:06:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.878+0000 7f82d5999700 1 Processor -- start 2024-09-13T17:06:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.878+0000 7f82d5999700 1 -- start start 2024-09-13T17:06:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.878+0000 7f82d5999700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d00cbb40 0x7f82d014ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.878+0000 7f82d5999700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d0159210 0x7f82d00b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.878+0000 7f82d5999700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d01595f0 0x7f82d00b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.878+0000 7f82d5999700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0165e30 con 0x7f82d01595f0 2024-09-13T17:06:55.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.878+0000 7f82d5999700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00c8a10 con 0x7f82d0159210 2024-09-13T17:06:55.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.878+0000 7f82d5999700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00c8730 con 0x7f82d00cbb40 2024-09-13T17:06:55.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.878+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2068878460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc80b4600 con 0x7fbcc80c9530 2024-09-13T17:06:55.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.878+0000 7f82cf7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d01595f0 0x7f82d00b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.882+0000 7f82cf7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d01595f0 0x7f82d00b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46684/0 (socket says 172.21.15.123:46684) 2024-09-13T17:06:55.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.882+0000 7f82cf7fe700 1 -- 172.21.15.123:0/2648414769 learned_addr learned my addr 172.21.15.123:0/2648414769 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:55.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.882+0000 7f82ce7fc700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d0159210 0x7f82d00b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.882+0000 7f82ceffd700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d00cbb40 0x7f82d014ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.882+0000 7f82cf7fe700 1 -- 172.21.15.123:0/2648414769 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d00cbb40 msgr2=0x7f82d014ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.882+0000 7f82cf7fe700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d00cbb40 0x7f82d014ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.882+0000 7f82cf7fe700 1 -- 172.21.15.123:0/2648414769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d0159210 msgr2=0x7f82d00b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:55.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.882+0000 7f82cf7fe700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d0159210 0x7f82d00b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:55.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.882+0000 7f82cf7fe700 1 -- 172.21.15.123:0/2648414769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c8009b30 con 0x7f82d01595f0 2024-09-13T17:06:55.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.882+0000 7f82ce7fc700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d0159210 0x7f82d00b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:55.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.882+0000 7f82cf7fe700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d01595f0 0x7f82d00b1a10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f82c400e810 tx=0x7f82c400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.890+0000 7f82bffff700 1 -- 172.21.15.123:0/2648414769 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c400c070 con 0x7f82d01595f0 2024-09-13T17:06:55.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.890+0000 7fbcc5ffb700 1 -- 172.21.15.123:0/2068878460 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbcc008a060 con 0x7fbcc80c9530 2024-09-13T17:06:55.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.890+0000 7f82d5999700 1 -- 172.21.15.123:0/2648414769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d00b2900 con 0x7f82d01595f0 2024-09-13T17:06:55.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.890+0000 7f82d5999700 1 -- 172.21.15.123:0/2648414769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d00b2ec0 con 0x7f82d01595f0 2024-09-13T17:06:55.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.898+0000 7f82d5999700 1 -- 172.21.15.123:0/2648414769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d00b3100 con 0x7f82d01595f0 2024-09-13T17:06:55.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.898+0000 7f82bffff700 1 -- 172.21.15.123:0/2648414769 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c40093e0 con 0x7f82d01595f0 2024-09-13T17:06:55.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.898+0000 7f82bffff700 1 -- 172.21.15.123:0/2648414769 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4005c40 con 0x7f82d01595f0 2024-09-13T17:06:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.902+0000 7f82bffff700 1 -- 172.21.15.123:0/2648414769 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f82c4013610 con 0x7f82d01595f0 2024-09-13T17:06:55.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.902+0000 7f82bffff700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82b4066730 0x7f82b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:55.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.902+0000 7f82ceffd700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82b4066730 0x7f82b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:55.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.902+0000 7f82ceffd700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82b4066730 0x7f82b4068bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f82d00c98c0 tx=0x7f82c0008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:55.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.902+0000 7f82bffff700 1 -- 172.21.15.123:0/2648414769 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82c4083fe0 con 0x7f82d01595f0 2024-09-13T17:06:55.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:55.910+0000 7f82bffff700 1 -- 172.21.15.123:0/2648414769 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82c4051340 con 0x7f82d01595f0 2024-09-13T17:06:56.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.074+0000 7fdcd9f79700 1 -- 172.21.15.123:0/4238391292 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fdcd4070b50 con 0x7fdcd406d600 2024-09-13T17:06:56.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.074+0000 7fdcbbfff700 1 -- 172.21.15.123:0/4238391292 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdcc4007760 con 0x7fdcd406d600 2024-09-13T17:06:56.081 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-09-13T17:06:56.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.078+0000 7fdcb9ffb700 1 -- 172.21.15.123:0/4238391292 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdcc0066880 msgr2=0x7fdcc0068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.078+0000 7fdcb9ffb700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdcc0066880 0x7fdcc0068d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40c8c60 tx=0x7fdcc8008030 comp rx=0 tx=0).stop 2024-09-13T17:06:56.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.078+0000 7fdcb9ffb700 1 -- 172.21.15.123:0/4238391292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcd406d600 msgr2=0x7fdcd40c6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.078+0000 7fdcb9ffb700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcd406d600 0x7fdcd40c6fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400c7b0 tx=0x7fdcc400cb70 comp rx=0 tx=0).stop 2024-09-13T17:06:56.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.078+0000 7fdcb9ffb700 1 -- 172.21.15.123:0/4238391292 shutdown_connections 2024-09-13T17:06:56.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.078+0000 7fdcb9ffb700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdcc0066880 0x7fdcc0068d40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.078+0000 7fdcb9ffb700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd4071d80 0x7fdcd414d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.078+0000 7fdcb9ffb700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcd40706a0 0x7fdcd40af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.078+0000 7fdcb9ffb700 1 --2- 172.21.15.123:0/4238391292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcd406d600 0x7fdcd40c6fe0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.078+0000 7fdcb9ffb700 1 -- 172.21.15.123:0/4238391292 >> 172.21.15.123:0/4238391292 conn(0x7fdcd4066780 msgr2=0x7fdcd40b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:56.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.078+0000 7fdcb9ffb700 1 -- 172.21.15.123:0/4238391292 shutdown_connections 2024-09-13T17:06:56.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.078+0000 7fdcb9ffb700 1 -- 172.21.15.123:0/4238391292 wait complete. 2024-09-13T17:06:56.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-09-13T17:06:56.100 DEBUG:teuthology.parallel:result is None 2024-09-13T17:06:56.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.130+0000 7f4f9b89c700 1 -- 172.21.15.123:0/2152040396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4f740055c0 con 0x7f4f940cc580 2024-09-13T17:06:56.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.130+0000 7f4f89ffb700 1 -- 172.21.15.123:0/2152040396 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f90051400 con 0x7f4f940cc580 2024-09-13T17:06:56.136 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2024-09-13T17:06:56.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.130+0000 7f0405d14700 1 -- 172.21.15.123:0/1254009040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f03e00055c0 con 0x7f04000c8cd0 2024-09-13T17:06:56.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.130+0000 7f03fd7fa700 1 -- 172.21.15.123:0/1254009040 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f03f4056010 con 0x7f04000c8cd0 2024-09-13T17:06:56.137 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2024-09-13T17:06:56.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f4f9b89c700 1 -- 172.21.15.123:0/2152040396 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4f78066800 msgr2=0x7f4f78068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f4f9b89c700 1 --2- 172.21.15.123:0/2152040396 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4f78066800 0x7f4f78068cc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f84000f60 tx=0x7f4f84009040 comp rx=0 tx=0).stop 2024-09-13T17:06:56.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f4f9b89c700 1 -- 172.21.15.123:0/2152040396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940cc580 msgr2=0x7f4f9414ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f4f9b89c700 1 --2- 172.21.15.123:0/2152040396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940cc580 0x7f4f9414ea70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000b430 tx=0x7f4f9000b740 comp rx=0 tx=0).stop 2024-09-13T17:06:56.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f4f9b89c700 1 -- 172.21.15.123:0/2152040396 shutdown_connections 2024-09-13T17:06:56.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f4f9b89c700 1 --2- 172.21.15.123:0/2152040396 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4f78066800 0x7f4f78068cc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f4f9b89c700 1 --2- 172.21.15.123:0/2152040396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940cc580 0x7f4f9414ea70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f4f9b89c700 1 --2- 172.21.15.123:0/2152040396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f940c93e0 0x7f4f940c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f4f9b89c700 1 --2- 172.21.15.123:0/2152040396 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f94066b90 0x7f4f940b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f4f9b89c700 1 -- 172.21.15.123:0/2152040396 >> 172.21.15.123:0/2152040396 conn(0x7f4f94066780 msgr2=0x7f4f9406d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:56.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f4f9b89c700 1 -- 172.21.15.123:0/2152040396 shutdown_connections 2024-09-13T17:06:56.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f4f9b89c700 1 -- 172.21.15.123:0/2152040396 wait complete. 2024-09-13T17:06:56.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f0405d14700 1 -- 172.21.15.123:0/1254009040 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f03ec066730 msgr2=0x7f03ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f0405d14700 1 --2- 172.21.15.123:0/1254009040 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f03ec066730 0x7f03ec068bf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f03f0000f60 tx=0x7f03f0009040 comp rx=0 tx=0).stop 2024-09-13T17:06:56.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f0405d14700 1 -- 172.21.15.123:0/1254009040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04000c8cd0 msgr2=0x7f0400162500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f0405d14700 1 --2- 172.21.15.123:0/1254009040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04000c8cd0 0x7f0400162500 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f03f4013000 tx=0x7f03f4004770 comp rx=0 tx=0).stop 2024-09-13T17:06:56.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f0405d14700 1 -- 172.21.15.123:0/1254009040 shutdown_connections 2024-09-13T17:06:56.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f0405d14700 1 --2- 172.21.15.123:0/1254009040 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f03ec066730 0x7f03ec068bf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f0405d14700 1 --2- 172.21.15.123:0/1254009040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04000cb090 0x7f04000c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f0405d14700 1 --2- 172.21.15.123:0/1254009040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04000c8cd0 0x7f0400162500 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f0405d14700 1 --2- 172.21.15.123:0/1254009040 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f040006bdb0 0x7f040015ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f0405d14700 1 -- 172.21.15.123:0/1254009040 >> 172.21.15.123:0/1254009040 conn(0x7f0400066780 msgr2=0x7f04000aeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:56.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f0405d14700 1 -- 172.21.15.123:0/1254009040 shutdown_connections 2024-09-13T17:06:56.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.134+0000 7f0405d14700 1 -- 172.21.15.123:0/1254009040 wait complete. 2024-09-13T17:06:56.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-09-13T17:06:56.156 DEBUG:teuthology.parallel:result is None 2024-09-13T17:06:56.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-09-13T17:06:56.156 DEBUG:teuthology.parallel:result is None 2024-09-13T17:06:56.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.154+0000 7f4d85621700 1 -- 172.21.15.123:0/2408692214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4d800ca900 con 0x7f4d8015aa00 2024-09-13T17:06:56.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.154+0000 7f4d677fe700 1 -- 172.21.15.123:0/2408692214 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d70021020 con 0x7f4d8015aa00 2024-09-13T17:06:56.160 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2024-09-13T17:06:56.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.158+0000 7f4d85621700 1 -- 172.21.15.123:0/2408692214 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4d6c066800 msgr2=0x7f4d6c068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.158+0000 7f4d85621700 1 --2- 172.21.15.123:0/2408692214 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4d6c066800 0x7f4d6c068cc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400b9d0 tx=0x7f4d74008040 comp rx=0 tx=0).stop 2024-09-13T17:06:56.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.158+0000 7f4d85621700 1 -- 172.21.15.123:0/2408692214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d8015aa00 msgr2=0x7f4d800b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.158+0000 7f4d85621700 1 --2- 172.21.15.123:0/2408692214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d8015aa00 0x7f4d800b1f40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4d7000e880 tx=0x7f4d7000eb90 comp rx=0 tx=0).stop 2024-09-13T17:06:56.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.158+0000 7f4d85621700 1 -- 172.21.15.123:0/2408692214 shutdown_connections 2024-09-13T17:06:56.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.158+0000 7f4d85621700 1 --2- 172.21.15.123:0/2408692214 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4d6c066800 0x7f4d6c068cc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.158+0000 7f4d85621700 1 --2- 172.21.15.123:0/2408692214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d8015aa00 0x7f4d800b1f40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.158+0000 7f4d85621700 1 --2- 172.21.15.123:0/2408692214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d800afc90 0x7f4d800b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.158+0000 7f4d85621700 1 --2- 172.21.15.123:0/2408692214 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d800af590 0x7f4d801fed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.158+0000 7f4d85621700 1 -- 172.21.15.123:0/2408692214 >> 172.21.15.123:0/2408692214 conn(0x7f4d800b0450 msgr2=0x7f4d800709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:56.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.158+0000 7f4d85621700 1 -- 172.21.15.123:0/2408692214 shutdown_connections 2024-09-13T17:06:56.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.158+0000 7f4d85621700 1 -- 172.21.15.123:0/2408692214 wait complete. 2024-09-13T17:06:56.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f82d5999700 1 -- 172.21.15.123:0/2648414769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f82d00cb530 con 0x7f82d01595f0 2024-09-13T17:06:56.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f82bffff700 1 -- 172.21.15.123:0/2648414769 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f82c4054960 con 0x7f82d01595f0 2024-09-13T17:06:56.171 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2024-09-13T17:06:56.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/730017365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0cc00c55d0 con 0x7f0cc00cc450 2024-09-13T17:06:56.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f0cb67fc700 1 -- 172.21.15.123:0/730017365 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0cbc053c90 con 0x7f0cc00cc450 2024-09-13T17:06:56.172 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-09-13T17:06:56.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f82d5999700 1 -- 172.21.15.123:0/2648414769 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82b4066730 msgr2=0x7f82b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f82d5999700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82b4066730 0x7f82b4068bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f82d00c98c0 tx=0x7f82c0008040 comp rx=0 tx=0).stop 2024-09-13T17:06:56.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f82d5999700 1 -- 172.21.15.123:0/2648414769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d01595f0 msgr2=0x7f82d00b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f82d5999700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d01595f0 0x7f82d00b1a10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f82c400e810 tx=0x7f82c400eb20 comp rx=0 tx=0).stop 2024-09-13T17:06:56.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f82d5999700 1 -- 172.21.15.123:0/2648414769 shutdown_connections 2024-09-13T17:06:56.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f82d5999700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82b4066730 0x7f82b4068bf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f82d5999700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d01595f0 0x7f82d00b1a10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f82d5999700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d0159210 0x7f82d00b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f82d5999700 1 --2- 172.21.15.123:0/2648414769 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d00cbb40 0x7f82d014ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f82d5999700 1 -- 172.21.15.123:0/2648414769 >> 172.21.15.123:0/2648414769 conn(0x7f82d0066780 msgr2=0x7f82d006c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:56.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f82d5999700 1 -- 172.21.15.123:0/2648414769 shutdown_connections 2024-09-13T17:06:56.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f82d5999700 1 -- 172.21.15.123:0/2648414769 wait complete. 2024-09-13T17:06:56.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/730017365 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0cac0668f0 msgr2=0x7f0cac068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f0cc7d5b700 1 --2- 172.21.15.123:0/730017365 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0cac0668f0 0x7f0cac068db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8000f80 tx=0x7f0cb8009000 comp rx=0 tx=0).stop 2024-09-13T17:06:56.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/730017365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc00cc450 msgr2=0x7f0cc00c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f0cc7d5b700 1 --2- 172.21.15.123:0/730017365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc00cc450 0x7f0cc00c6e90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00b4a0 tx=0x7f0cbc00b7b0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/730017365 shutdown_connections 2024-09-13T17:06:56.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f0cc7d5b700 1 --2- 172.21.15.123:0/730017365 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0cac0668f0 0x7f0cac068db0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f0cc7d5b700 1 --2- 172.21.15.123:0/730017365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cc015cc40 0x7f0cc00c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f0cc7d5b700 1 --2- 172.21.15.123:0/730017365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc00cc450 0x7f0cc00c6e90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f0cc7d5b700 1 --2- 172.21.15.123:0/730017365 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0cc00cb870 0x7f0cc0203830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.166+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/730017365 >> 172.21.15.123:0/730017365 conn(0x7f0cc00b0450 msgr2=0x7f0cc00caaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:56.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.170+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/730017365 shutdown_connections 2024-09-13T17:06:56.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.170+0000 7f0cc7d5b700 1 -- 172.21.15.123:0/730017365 wait complete. 2024-09-13T17:06:56.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-09-13T17:06:56.179 DEBUG:teuthology.parallel:result is None 2024-09-13T17:06:56.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.178+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2068878460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbcc8152ed0 con 0x7fbcc80c9530 2024-09-13T17:06:56.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.178+0000 7fbcc5ffb700 1 -- 172.21.15.123:0/2068878460 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbcc00523f0 con 0x7fbcc80c9530 2024-09-13T17:06:56.185 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-09-13T17:06:56.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.182+0000 7fa579e51700 1 -- 172.21.15.123:0/1684526355 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa550005890 con 0x7fa57415cf20 2024-09-13T17:06:56.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.182+0000 7fa5717fa700 1 -- 172.21.15.123:0/1684526355 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa56c017090 con 0x7fa57415cf20 2024-09-13T17:06:56.188 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2024-09-13T17:06:56.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.182+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2068878460 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbcb4066780 msgr2=0x7fbcb4068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.182+0000 7fbcce0ef700 1 --2- 172.21.15.123:0/2068878460 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbcb4066780 0x7fbcb4068c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8152ea0 tx=0x7fbcb8009040 comp rx=0 tx=0).stop 2024-09-13T17:06:56.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.182+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2068878460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc80c9530 msgr2=0x7fbcc81f2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.182+0000 7fbcce0ef700 1 --2- 172.21.15.123:0/2068878460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc80c9530 0x7fbcc81f2540 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80ce1d0 tx=0x7fbcc0004af0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-09-13T17:06:56.190 DEBUG:teuthology.parallel:result is None 2024-09-13T17:06:56.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-09-13T17:06:56.191 DEBUG:teuthology.parallel:result is None 2024-09-13T17:06:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.182+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2068878460 shutdown_connections 2024-09-13T17:06:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.182+0000 7fbcce0ef700 1 --2- 172.21.15.123:0/2068878460 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbcb4066780 0x7fbcb4068c40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.182+0000 7fbcce0ef700 1 --2- 172.21.15.123:0/2068878460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcc815c9b0 0x7fbcc81f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.182+0000 7fbcce0ef700 1 --2- 172.21.15.123:0/2068878460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbcc80cc580 0x7fbcc80c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.182+0000 7fbcce0ef700 1 --2- 172.21.15.123:0/2068878460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcc80c9530 0x7fbcc81f2540 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.182+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2068878460 >> 172.21.15.123:0/2068878460 conn(0x7fbcc8066780 msgr2=0x7fbcc815d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.182+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2068878460 shutdown_connections 2024-09-13T17:06:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.182+0000 7fbcce0ef700 1 -- 172.21.15.123:0/2068878460 wait complete. 2024-09-13T17:06:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.186+0000 7fa579e51700 1 -- 172.21.15.123:0/1684526355 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa55c066870 msgr2=0x7fa55c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.186+0000 7fa579e51700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa55c066870 0x7fa55c068d30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa5740b4040 tx=0x7fa564009040 comp rx=0 tx=0).stop 2024-09-13T17:06:56.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.186+0000 7fa579e51700 1 -- 172.21.15.123:0/1684526355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa57415cf20 msgr2=0x7fa5740c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.186+0000 7fa579e51700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa57415cf20 0x7fa5740c8010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00caa0 tx=0x7fa56c00cad0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.186+0000 7fa579e51700 1 -- 172.21.15.123:0/1684526355 shutdown_connections 2024-09-13T17:06:56.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.186+0000 7fa579e51700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa55c066870 0x7fa55c068d30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.186+0000 7fa579e51700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa57415cf20 0x7fa5740c8010 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.186+0000 7fa579e51700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5740ad490 0x7fa5740c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.186+0000 7fa579e51700 1 --2- 172.21.15.123:0/1684526355 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa574070df0 0x7fa574151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.186+0000 7fa579e51700 1 -- 172.21.15.123:0/1684526355 >> 172.21.15.123:0/1684526355 conn(0x7fa574066780 msgr2=0x7fa574158000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:56.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.186+0000 7fa579e51700 1 -- 172.21.15.123:0/1684526355 shutdown_connections 2024-09-13T17:06:56.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.186+0000 7fa579e51700 1 -- 172.21.15.123:0/1684526355 wait complete. 2024-09-13T17:06:56.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-09-13T17:06:56.199 DEBUG:teuthology.parallel:result is None 2024-09-13T17:06:56.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-09-13T17:06:56.202 DEBUG:teuthology.parallel:result is None 2024-09-13T17:06:56.202 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T17:06:56.202 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:06:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75de7b9700 1 Processor -- start 2024-09-13T17:06:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75de7b9700 1 -- start start 2024-09-13T17:06:56.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75de7b9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75d815ed00 0x7f75d8161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75de7b9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75d8161a80 0x7f75d80cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75de7b9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d8162550 con 0x7f75d815e920 2024-09-13T17:06:56.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75de7b9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d80cd690 con 0x7f75d815ed00 2024-09-13T17:06:56.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75de7b9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8161f90 con 0x7f75d8161a80 2024-09-13T17:06:56.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75dcfb6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75d815ed00 0x7f75d8161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75dcfb6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75d815ed00 0x7f75d8161540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46700/0 (socket says 172.21.15.123:46700) 2024-09-13T17:06:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75dcfb6700 1 -- 172.21.15.123:0/3424629292 learned_addr learned my addr 172.21.15.123:0/3424629292 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75ddfb8700 1 --2- 172.21.15.123:0/3424629292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75d8161a80 0x7f75d80cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75dcfb6700 1 -- 172.21.15.123:0/3424629292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75d8161a80 msgr2=0x7f75d80cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75dcfb6700 1 --2- 172.21.15.123:0/3424629292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75d8161a80 0x7f75d80cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75d7fff700 1 -- 172.21.15.123:0/3424629292 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920720252 0 0) 0x7f75d8162550 con 0x7f75d815e920 2024-09-13T17:06:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75dcfb6700 1 -- 172.21.15.123:0/3424629292 >> v1:172.21.15.123:6789/0 conn(0x7f75d815e920 legacy=0x7f75d80caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75dcfb6700 1 -- 172.21.15.123:0/3424629292 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d8162270 con 0x7f75d815ed00 2024-09-13T17:06:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75ddfb8700 1 --2- 172.21.15.123:0/3424629292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75d8161a80 0x7f75d80cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:06:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75dcfb6700 1 --2- 172.21.15.123:0/3424629292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d815ed00 0x7f75d8161540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009e50 tx=0x7f75cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fec050c00f21dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75d7fff700 1 -- 172.21.15.123:0/3424629292 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00e070 con 0x7f75d815ed00 2024-09-13T17:06:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75d7fff700 1 -- 172.21.15.123:0/3424629292 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc00b9c0 con 0x7f75d815ed00 2024-09-13T17:06:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75d7fff700 1 -- 172.21.15.123:0/3424629292 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00bd70 con 0x7f75d815ed00 2024-09-13T17:06:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75de7b9700 1 -- 172.21.15.123:0/3424629292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d815ed00 msgr2=0x7f75d8161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.294+0000 7f75de7b9700 1 --2- 172.21.15.123:0/3424629292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d815ed00 0x7f75d8161540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009e50 tx=0x7f75cc00b330 comp rx=0 tx=0).stop 2024-09-13T17:06:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75de7b9700 1 -- 172.21.15.123:0/3424629292 shutdown_connections 2024-09-13T17:06:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75de7b9700 1 --2- 172.21.15.123:0/3424629292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75d8161a80 0x7f75d80cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75de7b9700 1 --2- 172.21.15.123:0/3424629292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d815ed00 0x7f75d8161540 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75de7b9700 1 -- 172.21.15.123:0/3424629292 >> 172.21.15.123:0/3424629292 conn(0x7f75d8066150 msgr2=0x7f75d8066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75de7b9700 1 -- 172.21.15.123:0/3424629292 shutdown_connections 2024-09-13T17:06:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75de7b9700 1 -- 172.21.15.123:0/3424629292 wait complete. 2024-09-13T17:06:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75de7b9700 1 Processor -- start 2024-09-13T17:06:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75de7b9700 1 -- start start 2024-09-13T17:06:56.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75de7b9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d815e920 0x7f75d80abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75de7b9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75d815ed00 0x7f75d815c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75de7b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75d8161a80 0x7f75d81f9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75de7b9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d815d7d0 con 0x7f75d815e920 2024-09-13T17:06:56.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75de7b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d815d210 con 0x7f75d8161a80 2024-09-13T17:06:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75de7b9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d815d4f0 con 0x7f75d815ed00 2024-09-13T17:06:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75dd7b7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d815e920 0x7f75d80abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75dd7b7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d815e920 0x7f75d80abb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46704/0 (socket says 172.21.15.123:46704) 2024-09-13T17:06:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.298+0000 7f75dd7b7700 1 -- 172.21.15.123:0/2676040999 learned_addr learned my addr 172.21.15.123:0/2676040999 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75dcfb6700 1 --2- 172.21.15.123:0/2676040999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75d815ed00 0x7f75d815c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75ddfb8700 1 --2- 172.21.15.123:0/2676040999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75d8161a80 0x7f75d81f9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75dd7b7700 1 -- 172.21.15.123:0/2676040999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75d815ed00 msgr2=0x7f75d815c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75dd7b7700 1 --2- 172.21.15.123:0/2676040999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75d815ed00 0x7f75d815c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75dd7b7700 1 -- 172.21.15.123:0/2676040999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75d8161a80 msgr2=0x7f75d81f9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75dd7b7700 1 --2- 172.21.15.123:0/2676040999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75d8161a80 0x7f75d81f9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75dd7b7700 1 -- 172.21.15.123:0/2676040999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc009b30 con 0x7f75d815e920 2024-09-13T17:06:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75dd7b7700 1 --2- 172.21.15.123:0/2676040999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d815e920 0x7f75d80abb70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f75c80011e0 tx=0x7f75c800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:56.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75d5ffb700 1 -- 172.21.15.123:0/2676040999 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c80054e0 con 0x7f75d815e920 2024-09-13T17:06:56.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75d5ffb700 1 -- 172.21.15.123:0/2676040999 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c80036a0 con 0x7f75d815e920 2024-09-13T17:06:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75de7b9700 1 -- 172.21.15.123:0/2676040999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d80a9360 con 0x7f75d815e920 2024-09-13T17:06:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75d5ffb700 1 -- 172.21.15.123:0/2676040999 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8003a50 con 0x7f75d815e920 2024-09-13T17:06:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75de7b9700 1 -- 172.21.15.123:0/2676040999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d80a96f0 con 0x7f75d815e920 2024-09-13T17:06:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75de7b9700 1 -- 172.21.15.123:0/2676040999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d80677f0 con 0x7f75d815e920 2024-09-13T17:06:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75d5ffb700 1 -- 172.21.15.123:0/2676040999 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f75c8003bb0 con 0x7f75d815e920 2024-09-13T17:06:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75d5ffb700 1 --2- 172.21.15.123:0/2676040999 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f75c4066730 0x7f75c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75d5ffb700 1 -- 172.21.15.123:0/2676040999 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75c80837c0 con 0x7f75d815e920 2024-09-13T17:06:56.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.302+0000 7f75dcfb6700 1 --2- 172.21.15.123:0/2676040999 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f75c4066730 0x7f75c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.306+0000 7f75dcfb6700 1 --2- 172.21.15.123:0/2676040999 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f75c4066730 0x7f75c4068bf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f75cc000f80 tx=0x7f75cc009000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:56.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.310+0000 7f75d5ffb700 1 -- 172.21.15.123:0/2676040999 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f75c8050a20 con 0x7f75d815e920 2024-09-13T17:06:56.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.466+0000 7f75de7b9700 1 -- 172.21.15.123:0/2676040999 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75d80cb1f0 con 0x7f75c4066730 2024-09-13T17:06:56.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.478+0000 7f75d5ffb700 1 -- 172.21.15.123:0/2676040999 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264520 (secure 0 0 0) 0x7f75cc003a40 con 0x7f75c4066730 2024-09-13T17:06:56.491 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:56.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.482+0000 7f75de7b9700 1 -- 172.21.15.123:0/2676040999 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f75c4066730 msgr2=0x7f75c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.482+0000 7f75de7b9700 1 --2- 172.21.15.123:0/2676040999 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f75c4066730 0x7f75c4068bf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f75cc000f80 tx=0x7f75cc009000 comp rx=0 tx=0).stop 2024-09-13T17:06:56.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.482+0000 7f75de7b9700 1 -- 172.21.15.123:0/2676040999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d815e920 msgr2=0x7f75d80abb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.482+0000 7f75de7b9700 1 --2- 172.21.15.123:0/2676040999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d815e920 0x7f75d80abb70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f75c80011e0 tx=0x7f75c800cae0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.482+0000 7f75de7b9700 1 -- 172.21.15.123:0/2676040999 shutdown_connections 2024-09-13T17:06:56.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.482+0000 7f75de7b9700 1 --2- 172.21.15.123:0/2676040999 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f75c4066730 0x7f75c4068bf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.482+0000 7f75de7b9700 1 --2- 172.21.15.123:0/2676040999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75d8161a80 0x7f75d81f9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.482+0000 7f75de7b9700 1 --2- 172.21.15.123:0/2676040999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75d815ed00 0x7f75d815c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.482+0000 7f75de7b9700 1 --2- 172.21.15.123:0/2676040999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75d815e920 0x7f75d80abb70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.482+0000 7f75de7b9700 1 -- 172.21.15.123:0/2676040999 >> 172.21.15.123:0/2676040999 conn(0x7f75d8066150 msgr2=0x7f75d8071b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:56.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.482+0000 7f75de7b9700 1 -- 172.21.15.123:0/2676040999 shutdown_connections 2024-09-13T17:06:56.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.482+0000 7f75de7b9700 1 -- 172.21.15.123:0/2676040999 wait complete. 2024-09-13T17:06:56.494 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:06:56.502 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T17:06:54.738353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218996,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755724,"statfs":{"total":773094113280,"available":772869861376,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.688003"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436070+0000","last_change":"2024-09-13T17:06:48.461079+0000","last_active":"2024-09-13T17:06:49.436070+0000","last_peered":"2024-09-13T17:06:49.436070+0000","last_clean":"2024-09-13T17:06:49.436070+0000","last_became_active":"2024-09-13T17:06:48.460855+0000","last_became_peered":"2024-09-13T17:06:48.460855+0000","last_unstale":"2024-09-13T17:06:49.436070+0000","last_undegraded":"2024-09-13T17:06:49.436070+0000","last_fullsized":"2024-09-13T17:06:49.436070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:13.871898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436467+0000","last_change":"2024-09-13T17:06:48.450997+0000","last_active":"2024-09-13T17:06:49.436467+0000","last_peered":"2024-09-13T17:06:49.436467+0000","last_clean":"2024-09-13T17:06:49.436467+0000","last_became_active":"2024-09-13T17:06:48.450751+0000","last_became_peered":"2024-09-13T17:06:48.450751+0000","last_unstale":"2024-09-13T17:06:49.436467+0000","last_undegraded":"2024-09-13T17:06:49.436467+0000","last_fullsized":"2024-09-13T17:06:49.436467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:29.305952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407157+0000","last_change":"2024-09-13T17:06:48.438677+0000","last_active":"2024-09-13T17:06:50.407157+0000","last_peered":"2024-09-13T17:06:50.407157+0000","last_clean":"2024-09-13T17:06:50.407157+0000","last_became_active":"2024-09-13T17:06:48.438399+0000","last_became_peered":"2024-09-13T17:06:48.438399+0000","last_unstale":"2024-09-13T17:06:50.407157+0000","last_undegraded":"2024-09-13T17:06:50.407157+0000","last_fullsized":"2024-09-13T17:06:50.407157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:02.762902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407961+0000","last_change":"2024-09-13T17:06:48.456834+0000","last_active":"2024-09-13T17:06:50.407961+0000","last_peered":"2024-09-13T17:06:50.407961+0000","last_clean":"2024-09-13T17:06:50.407961+0000","last_became_active":"2024-09-13T17:06:48.452727+0000","last_became_peered":"2024-09-13T17:06:48.452727+0000","last_unstale":"2024-09-13T17:06:50.407961+0000","last_undegraded":"2024-09-13T17:06:50.407961+0000","last_fullsized":"2024-09-13T17:06:50.407961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:13.649151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435305+0000","last_change":"2024-09-13T17:06:48.451267+0000","last_active":"2024-09-13T17:06:49.435305+0000","last_peered":"2024-09-13T17:06:49.435305+0000","last_clean":"2024-09-13T17:06:49.435305+0000","last_became_active":"2024-09-13T17:06:48.450870+0000","last_became_peered":"2024-09-13T17:06:48.450870+0000","last_unstale":"2024-09-13T17:06:49.435305+0000","last_undegraded":"2024-09-13T17:06:49.435305+0000","last_fullsized":"2024-09-13T17:06:49.435305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:15.339790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408989+0000","last_change":"2024-09-13T17:06:48.450864+0000","last_active":"2024-09-13T17:06:50.408989+0000","last_peered":"2024-09-13T17:06:50.408989+0000","last_clean":"2024-09-13T17:06:50.408989+0000","last_became_active":"2024-09-13T17:06:48.450278+0000","last_became_peered":"2024-09-13T17:06:48.450278+0000","last_unstale":"2024-09-13T17:06:50.408989+0000","last_undegraded":"2024-09-13T17:06:50.408989+0000","last_fullsized":"2024-09-13T17:06:50.408989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:13.871898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435044+0000","last_change":"2024-09-13T17:06:48.439223+0000","last_active":"2024-09-13T17:06:49.435044+0000","last_peered":"2024-09-13T17:06:49.435044+0000","last_clean":"2024-09-13T17:06:49.435044+0000","last_became_active":"2024-09-13T17:06:48.438699+0000","last_became_peered":"2024-09-13T17:06:48.438699+0000","last_unstale":"2024-09-13T17:06:49.435044+0000","last_undegraded":"2024-09-13T17:06:49.435044+0000","last_fullsized":"2024-09-13T17:06:49.435044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:43.812384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434226+0000","last_change":"2024-09-13T17:06:48.451536+0000","last_active":"2024-09-13T17:06:49.434226+0000","last_peered":"2024-09-13T17:06:49.434226+0000","last_clean":"2024-09-13T17:06:49.434226+0000","last_became_active":"2024-09-13T17:06:48.451128+0000","last_became_peered":"2024-09-13T17:06:48.451128+0000","last_unstale":"2024-09-13T17:06:49.434226+0000","last_undegraded":"2024-09-13T17:06:49.434226+0000","last_fullsized":"2024-09-13T17:06:49.434226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:58.103402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436150+0000","last_change":"2024-09-13T17:06:48.450886+0000","last_active":"2024-09-13T17:06:49.436150+0000","last_peered":"2024-09-13T17:06:49.436150+0000","last_clean":"2024-09-13T17:06:49.436150+0000","last_became_active":"2024-09-13T17:06:48.450641+0000","last_became_peered":"2024-09-13T17:06:48.450641+0000","last_unstale":"2024-09-13T17:06:49.436150+0000","last_undegraded":"2024-09-13T17:06:49.436150+0000","last_fullsized":"2024-09-13T17:06:49.436150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:57.203854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.411078+0000","last_change":"2024-09-13T17:06:48.463023+0000","last_active":"2024-09-13T17:06:50.411078+0000","last_peered":"2024-09-13T17:06:50.411078+0000","last_clean":"2024-09-13T17:06:50.411078+0000","last_became_active":"2024-09-13T17:06:48.462496+0000","last_became_peered":"2024-09-13T17:06:48.462496+0000","last_unstale":"2024-09-13T17:06:50.411078+0000","last_undegraded":"2024-09-13T17:06:50.411078+0000","last_fullsized":"2024-09-13T17:06:50.411078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:59.415579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410541+0000","last_change":"2024-09-13T17:06:48.460040+0000","last_active":"2024-09-13T17:06:50.410541+0000","last_peered":"2024-09-13T17:06:50.410541+0000","last_clean":"2024-09-13T17:06:50.410541+0000","last_became_active":"2024-09-13T17:06:48.459768+0000","last_became_peered":"2024-09-13T17:06:48.459768+0000","last_unstale":"2024-09-13T17:06:50.410541+0000","last_undegraded":"2024-09-13T17:06:50.410541+0000","last_fullsized":"2024-09-13T17:06:50.410541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:36.046829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410162+0000","last_change":"2024-09-13T17:06:48.464562+0000","last_active":"2024-09-13T17:06:50.410162+0000","last_peered":"2024-09-13T17:06:50.410162+0000","last_clean":"2024-09-13T17:06:50.410162+0000","last_became_active":"2024-09-13T17:06:48.464356+0000","last_became_peered":"2024-09-13T17:06:48.464356+0000","last_unstale":"2024-09-13T17:06:50.410162+0000","last_undegraded":"2024-09-13T17:06:50.410162+0000","last_fullsized":"2024-09-13T17:06:50.410162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:41.591896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434879+0000","last_change":"2024-09-13T17:06:48.447746+0000","last_active":"2024-09-13T17:06:49.434879+0000","last_peered":"2024-09-13T17:06:49.434879+0000","last_clean":"2024-09-13T17:06:49.434879+0000","last_became_active":"2024-09-13T17:06:48.447441+0000","last_became_peered":"2024-09-13T17:06:48.447441+0000","last_unstale":"2024-09-13T17:06:49.434879+0000","last_undegraded":"2024-09-13T17:06:49.434879+0000","last_fullsized":"2024-09-13T17:06:49.434879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:15.339790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.406714+0000","last_change":"2024-09-13T17:06:48.452709+0000","last_active":"2024-09-13T17:06:50.406714+0000","last_peered":"2024-09-13T17:06:50.406714+0000","last_clean":"2024-09-13T17:06:50.406714+0000","last_became_active":"2024-09-13T17:06:48.452174+0000","last_became_peered":"2024-09-13T17:06:48.452174+0000","last_unstale":"2024-09-13T17:06:50.406714+0000","last_undegraded":"2024-09-13T17:06:50.406714+0000","last_fullsized":"2024-09-13T17:06:50.406714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:05.801080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436098+0000","last_change":"2024-09-13T17:06:48.454013+0000","last_active":"2024-09-13T17:06:49.436098+0000","last_peered":"2024-09-13T17:06:49.436098+0000","last_clean":"2024-09-13T17:06:49.436098+0000","last_became_active":"2024-09-13T17:06:48.453811+0000","last_became_peered":"2024-09-13T17:06:48.453811+0000","last_unstale":"2024-09-13T17:06:49.436098+0000","last_undegraded":"2024-09-13T17:06:49.436098+0000","last_fullsized":"2024-09-13T17:06:49.436098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:58.103402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407668+0000","last_change":"2024-09-13T17:06:48.456811+0000","last_active":"2024-09-13T17:06:50.407668+0000","last_peered":"2024-09-13T17:06:50.407668+0000","last_clean":"2024-09-13T17:06:50.407668+0000","last_became_active":"2024-09-13T17:06:48.454867+0000","last_became_peered":"2024-09-13T17:06:48.454867+0000","last_unstale":"2024-09-13T17:06:50.407668+0000","last_undegraded":"2024-09-13T17:06:50.407668+0000","last_fullsized":"2024-09-13T17:06:50.407668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:03.550409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408759+0000","last_change":"2024-09-13T17:06:48.457471+0000","last_active":"2024-09-13T17:06:50.408759+0000","last_peered":"2024-09-13T17:06:50.408759+0000","last_clean":"2024-09-13T17:06:50.408759+0000","last_became_active":"2024-09-13T17:06:48.457196+0000","last_became_peered":"2024-09-13T17:06:48.457196+0000","last_unstale":"2024-09-13T17:06:50.408759+0000","last_undegraded":"2024-09-13T17:06:50.408759+0000","last_fullsized":"2024-09-13T17:06:50.408759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:43.812384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.772355+0000","last_change":"2024-09-13T17:06:48.450031+0000","last_active":"2024-09-13T17:06:49.772355+0000","last_peered":"2024-09-13T17:06:49.772355+0000","last_clean":"2024-09-13T17:06:49.772355+0000","last_became_active":"2024-09-13T17:06:48.449823+0000","last_became_peered":"2024-09-13T17:06:48.449823+0000","last_unstale":"2024-09-13T17:06:49.772355+0000","last_undegraded":"2024-09-13T17:06:49.772355+0000","last_fullsized":"2024-09-13T17:06:49.772355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:29.778842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435878+0000","last_change":"2024-09-13T17:06:48.450057+0000","last_active":"2024-09-13T17:06:49.435878+0000","last_peered":"2024-09-13T17:06:49.435878+0000","last_clean":"2024-09-13T17:06:49.435878+0000","last_became_active":"2024-09-13T17:06:48.449798+0000","last_became_peered":"2024-09-13T17:06:48.449798+0000","last_unstale":"2024-09-13T17:06:49.435878+0000","last_undegraded":"2024-09-13T17:06:49.435878+0000","last_fullsized":"2024-09-13T17:06:49.435878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:59.415579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410060+0000","last_change":"2024-09-13T17:06:48.462782+0000","last_active":"2024-09-13T17:06:50.410060+0000","last_peered":"2024-09-13T17:06:50.410060+0000","last_clean":"2024-09-13T17:06:50.410060+0000","last_became_active":"2024-09-13T17:06:48.462113+0000","last_became_peered":"2024-09-13T17:06:48.462113+0000","last_unstale":"2024-09-13T17:06:50.410060+0000","last_undegraded":"2024-09-13T17:06:50.410060+0000","last_fullsized":"2024-09-13T17:06:50.410060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:46.353437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407153+0000","last_change":"2024-09-13T17:06:48.437728+0000","last_active":"2024-09-13T17:06:50.407153+0000","last_peered":"2024-09-13T17:06:50.407153+0000","last_clean":"2024-09-13T17:06:50.407153+0000","last_became_active":"2024-09-13T17:06:48.437291+0000","last_became_peered":"2024-09-13T17:06:48.437291+0000","last_unstale":"2024-09-13T17:06:50.407153+0000","last_undegraded":"2024-09-13T17:06:50.407153+0000","last_fullsized":"2024-09-13T17:06:50.407153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:46.353437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409183+0000","last_change":"2024-09-13T17:06:48.457755+0000","last_active":"2024-09-13T17:06:50.409183+0000","last_peered":"2024-09-13T17:06:50.409183+0000","last_clean":"2024-09-13T17:06:50.409183+0000","last_became_active":"2024-09-13T17:06:48.457460+0000","last_became_peered":"2024-09-13T17:06:48.457460+0000","last_unstale":"2024-09-13T17:06:50.409183+0000","last_undegraded":"2024-09-13T17:06:50.409183+0000","last_fullsized":"2024-09-13T17:06:50.409183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:57.203854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434366+0000","last_change":"2024-09-13T17:06:48.450031+0000","last_active":"2024-09-13T17:06:49.434366+0000","last_peered":"2024-09-13T17:06:49.434366+0000","last_clean":"2024-09-13T17:06:49.434366+0000","last_became_active":"2024-09-13T17:06:48.449802+0000","last_became_peered":"2024-09-13T17:06:48.449802+0000","last_unstale":"2024-09-13T17:06:49.434366+0000","last_undegraded":"2024-09-13T17:06:49.434366+0000","last_fullsized":"2024-09-13T17:06:49.434366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:46.353437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407946+0000","last_change":"2024-09-13T17:06:48.453317+0000","last_active":"2024-09-13T17:06:50.407946+0000","last_peered":"2024-09-13T17:06:50.407946+0000","last_clean":"2024-09-13T17:06:50.407946+0000","last_became_active":"2024-09-13T17:06:48.453009+0000","last_became_peered":"2024-09-13T17:06:48.453009+0000","last_unstale":"2024-09-13T17:06:50.407946+0000","last_undegraded":"2024-09-13T17:06:50.407946+0000","last_fullsized":"2024-09-13T17:06:50.407946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:59.415579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435883+0000","last_change":"2024-09-13T17:06:48.452096+0000","last_active":"2024-09-13T17:06:49.435883+0000","last_peered":"2024-09-13T17:06:49.435883+0000","last_clean":"2024-09-13T17:06:49.435883+0000","last_became_active":"2024-09-13T17:06:48.451615+0000","last_became_peered":"2024-09-13T17:06:48.451615+0000","last_unstale":"2024-09-13T17:06:49.435883+0000","last_undegraded":"2024-09-13T17:06:49.435883+0000","last_fullsized":"2024-09-13T17:06:49.435883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:14.109764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.411093+0000","last_change":"2024-09-13T17:06:48.462465+0000","last_active":"2024-09-13T17:06:50.411093+0000","last_peered":"2024-09-13T17:06:50.411093+0000","last_clean":"2024-09-13T17:06:50.411093+0000","last_became_active":"2024-09-13T17:06:48.460284+0000","last_became_peered":"2024-09-13T17:06:48.460284+0000","last_unstale":"2024-09-13T17:06:50.411093+0000","last_undegraded":"2024-09-13T17:06:50.411093+0000","last_fullsized":"2024-09-13T17:06:50.411093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:29.305952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436111+0000","last_change":"2024-09-13T17:06:48.450822+0000","last_active":"2024-09-13T17:06:49.436111+0000","last_peered":"2024-09-13T17:06:49.436111+0000","last_clean":"2024-09-13T17:06:49.436111+0000","last_became_active":"2024-09-13T17:06:48.450622+0000","last_became_peered":"2024-09-13T17:06:48.450622+0000","last_unstale":"2024-09-13T17:06:49.436111+0000","last_undegraded":"2024-09-13T17:06:49.436111+0000","last_fullsized":"2024-09-13T17:06:49.436111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435319+0000","last_change":"2024-09-13T17:06:48.454287+0000","last_active":"2024-09-13T17:06:49.435319+0000","last_peered":"2024-09-13T17:06:49.435319+0000","last_clean":"2024-09-13T17:06:49.435319+0000","last_became_active":"2024-09-13T17:06:48.454110+0000","last_became_peered":"2024-09-13T17:06:48.454110+0000","last_unstale":"2024-09-13T17:06:49.435319+0000","last_undegraded":"2024-09-13T17:06:49.435319+0000","last_fullsized":"2024-09-13T17:06:49.435319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:29.305952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407227+0000","last_change":"2024-09-13T17:06:48.438672+0000","last_active":"2024-09-13T17:06:50.407227+0000","last_peered":"2024-09-13T17:06:50.407227+0000","last_clean":"2024-09-13T17:06:50.407227+0000","last_became_active":"2024-09-13T17:06:48.438397+0000","last_became_peered":"2024-09-13T17:06:48.438397+0000","last_unstale":"2024-09-13T17:06:50.407227+0000","last_undegraded":"2024-09-13T17:06:50.407227+0000","last_fullsized":"2024-09-13T17:06:50.407227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:36.046829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409404+0000","last_change":"2024-09-13T17:06:48.453529+0000","last_active":"2024-09-13T17:06:50.409404+0000","last_peered":"2024-09-13T17:06:50.409404+0000","last_clean":"2024-09-13T17:06:50.409404+0000","last_became_active":"2024-09-13T17:06:48.450613+0000","last_became_peered":"2024-09-13T17:06:48.450613+0000","last_unstale":"2024-09-13T17:06:50.409404+0000","last_undegraded":"2024-09-13T17:06:50.409404+0000","last_fullsized":"2024-09-13T17:06:50.409404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:11.126023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.771974+0000","last_change":"2024-09-13T17:06:48.447764+0000","last_active":"2024-09-13T17:06:49.771974+0000","last_peered":"2024-09-13T17:06:49.771974+0000","last_clean":"2024-09-13T17:06:49.771974+0000","last_became_active":"2024-09-13T17:06:48.447487+0000","last_became_peered":"2024-09-13T17:06:48.447487+0000","last_unstale":"2024-09-13T17:06:49.771974+0000","last_undegraded":"2024-09-13T17:06:49.771974+0000","last_fullsized":"2024-09-13T17:06:49.771974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:17.894980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.406959+0000","last_change":"2024-09-13T17:06:48.461988+0000","last_active":"2024-09-13T17:06:50.406959+0000","last_peered":"2024-09-13T17:06:50.406959+0000","last_clean":"2024-09-13T17:06:50.406959+0000","last_became_active":"2024-09-13T17:06:48.459269+0000","last_became_peered":"2024-09-13T17:06:48.459269+0000","last_unstale":"2024-09-13T17:06:50.406959+0000","last_undegraded":"2024-09-13T17:06:50.406959+0000","last_fullsized":"2024-09-13T17:06:50.406959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409425+0000","last_change":"2024-09-13T17:06:48.452270+0000","last_active":"2024-09-13T17:06:50.409425+0000","last_peered":"2024-09-13T17:06:50.409425+0000","last_clean":"2024-09-13T17:06:50.409425+0000","last_became_active":"2024-09-13T17:06:48.452009+0000","last_became_peered":"2024-09-13T17:06:48.452009+0000","last_unstale":"2024-09-13T17:06:50.409425+0000","last_undegraded":"2024-09-13T17:06:50.409425+0000","last_fullsized":"2024-09-13T17:06:50.409425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:29.778842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434995+0000","last_change":"2024-09-13T17:06:48.073325+0000","last_active":"2024-09-13T17:06:49.434995+0000","last_peered":"2024-09-13T17:06:49.434995+0000","last_clean":"2024-09-13T17:06:49.434995+0000","last_became_active":"2024-09-13T17:06:48.073071+0000","last_became_peered":"2024-09-13T17:06:48.073071+0000","last_unstale":"2024-09-13T17:06:49.434995+0000","last_undegraded":"2024-09-13T17:06:49.434995+0000","last_fullsized":"2024-09-13T17:06:49.434995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:27.297703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407400+0000","last_change":"2024-09-13T17:06:48.454892+0000","last_active":"2024-09-13T17:06:50.407400+0000","last_peered":"2024-09-13T17:06:50.407400+0000","last_clean":"2024-09-13T17:06:50.407400+0000","last_became_active":"2024-09-13T17:06:48.454422+0000","last_became_peered":"2024-09-13T17:06:48.454422+0000","last_unstale":"2024-09-13T17:06:50.407400+0000","last_undegraded":"2024-09-13T17:06:50.407400+0000","last_fullsized":"2024-09-13T17:06:50.407400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:14.109764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407481+0000","last_change":"2024-09-13T17:06:48.074337+0000","last_active":"2024-09-13T17:06:50.407481+0000","last_peered":"2024-09-13T17:06:50.407481+0000","last_clean":"2024-09-13T17:06:50.407481+0000","last_became_active":"2024-09-13T17:06:48.073999+0000","last_became_peered":"2024-09-13T17:06:48.073999+0000","last_unstale":"2024-09-13T17:06:50.407481+0000","last_undegraded":"2024-09-13T17:06:50.407481+0000","last_fullsized":"2024-09-13T17:06:50.407481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:40.582958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434508+0000","last_change":"2024-09-13T17:06:48.073011+0000","last_active":"2024-09-13T17:06:49.434508+0000","last_peered":"2024-09-13T17:06:49.434508+0000","last_clean":"2024-09-13T17:06:49.434508+0000","last_became_active":"2024-09-13T17:06:48.072498+0000","last_became_peered":"2024-09-13T17:06:48.072498+0000","last_unstale":"2024-09-13T17:06:49.434508+0000","last_undegraded":"2024-09-13T17:06:49.434508+0000","last_fullsized":"2024-09-13T17:06:49.434508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:33.113560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434356+0000","last_change":"2024-09-13T17:06:48.438607+0000","last_active":"2024-09-13T17:06:49.434356+0000","last_peered":"2024-09-13T17:06:49.434356+0000","last_clean":"2024-09-13T17:06:49.434356+0000","last_became_active":"2024-09-13T17:06:48.438316+0000","last_became_peered":"2024-09-13T17:06:48.438316+0000","last_unstale":"2024-09-13T17:06:49.434356+0000","last_undegraded":"2024-09-13T17:06:49.434356+0000","last_fullsized":"2024-09-13T17:06:49.434356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:36.046829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408018+0000","last_change":"2024-09-13T17:06:48.076549+0000","last_active":"2024-09-13T17:06:50.408018+0000","last_peered":"2024-09-13T17:06:50.408018+0000","last_clean":"2024-09-13T17:06:50.408018+0000","last_became_active":"2024-09-13T17:06:48.076266+0000","last_became_peered":"2024-09-13T17:06:48.076266+0000","last_unstale":"2024-09-13T17:06:50.408018+0000","last_undegraded":"2024-09-13T17:06:50.408018+0000","last_fullsized":"2024-09-13T17:06:50.408018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:11.933089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436035+0000","last_change":"2024-09-13T17:06:48.451140+0000","last_active":"2024-09-13T17:06:49.436035+0000","last_peered":"2024-09-13T17:06:49.436035+0000","last_clean":"2024-09-13T17:06:49.436035+0000","last_became_active":"2024-09-13T17:06:48.450731+0000","last_became_peered":"2024-09-13T17:06:48.450731+0000","last_unstale":"2024-09-13T17:06:49.436035+0000","last_undegraded":"2024-09-13T17:06:49.436035+0000","last_fullsized":"2024-09-13T17:06:49.436035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:36.046829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410915+0000","last_change":"2024-09-13T17:06:48.076480+0000","last_active":"2024-09-13T17:06:50.410915+0000","last_peered":"2024-09-13T17:06:50.410915+0000","last_clean":"2024-09-13T17:06:50.410915+0000","last_became_active":"2024-09-13T17:06:48.076222+0000","last_became_peered":"2024-09-13T17:06:48.076222+0000","last_unstale":"2024-09-13T17:06:50.410915+0000","last_undegraded":"2024-09-13T17:06:50.410915+0000","last_fullsized":"2024-09-13T17:06:50.410915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:04.672617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407989+0000","last_change":"2024-09-13T17:06:48.454714+0000","last_active":"2024-09-13T17:06:50.407989+0000","last_peered":"2024-09-13T17:06:50.407989+0000","last_clean":"2024-09-13T17:06:50.407989+0000","last_became_active":"2024-09-13T17:06:48.454417+0000","last_became_peered":"2024-09-13T17:06:48.454417+0000","last_unstale":"2024-09-13T17:06:50.407989+0000","last_undegraded":"2024-09-13T17:06:50.407989+0000","last_fullsized":"2024-09-13T17:06:50.407989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:42.518633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408081+0000","last_change":"2024-09-13T17:06:48.075225+0000","last_active":"2024-09-13T17:06:50.408081+0000","last_peered":"2024-09-13T17:06:50.408081+0000","last_clean":"2024-09-13T17:06:50.408081+0000","last_became_active":"2024-09-13T17:06:48.074905+0000","last_became_peered":"2024-09-13T17:06:48.074905+0000","last_unstale":"2024-09-13T17:06:50.408081+0000","last_undegraded":"2024-09-13T17:06:50.408081+0000","last_fullsized":"2024-09-13T17:06:50.408081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:37.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407168+0000","last_change":"2024-09-13T17:06:48.453541+0000","last_active":"2024-09-13T17:06:50.407168+0000","last_peered":"2024-09-13T17:06:50.407168+0000","last_clean":"2024-09-13T17:06:50.407168+0000","last_became_active":"2024-09-13T17:06:48.452960+0000","last_became_peered":"2024-09-13T17:06:48.452960+0000","last_unstale":"2024-09-13T17:06:50.407168+0000","last_undegraded":"2024-09-13T17:06:50.407168+0000","last_fullsized":"2024-09-13T17:06:50.407168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:58.103402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436341+0000","last_change":"2024-09-13T17:06:48.076701+0000","last_active":"2024-09-13T17:06:49.436341+0000","last_peered":"2024-09-13T17:06:49.436341+0000","last_clean":"2024-09-13T17:06:49.436341+0000","last_became_active":"2024-09-13T17:06:48.076518+0000","last_became_peered":"2024-09-13T17:06:48.076518+0000","last_unstale":"2024-09-13T17:06:49.436341+0000","last_undegraded":"2024-09-13T17:06:49.436341+0000","last_fullsized":"2024-09-13T17:06:49.436341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:40.582958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410188+0000","last_change":"2024-09-13T17:06:48.455163+0000","last_active":"2024-09-13T17:06:50.410188+0000","last_peered":"2024-09-13T17:06:50.410188+0000","last_clean":"2024-09-13T17:06:50.410188+0000","last_became_active":"2024-09-13T17:06:48.454898+0000","last_became_peered":"2024-09-13T17:06:48.454898+0000","last_unstale":"2024-09-13T17:06:50.410188+0000","last_undegraded":"2024-09-13T17:06:50.410188+0000","last_fullsized":"2024-09-13T17:06:50.410188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:05.681555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410479+0000","last_change":"2024-09-13T17:06:48.077791+0000","last_active":"2024-09-13T17:06:50.410479+0000","last_peered":"2024-09-13T17:06:50.410479+0000","last_clean":"2024-09-13T17:06:50.410479+0000","last_became_active":"2024-09-13T17:06:48.077473+0000","last_became_peered":"2024-09-13T17:06:48.077473+0000","last_unstale":"2024-09-13T17:06:50.410479+0000","last_undegraded":"2024-09-13T17:06:50.410479+0000","last_fullsized":"2024-09-13T17:06:50.410479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.901813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435648+0000","last_change":"2024-09-13T17:06:48.444878+0000","last_active":"2024-09-13T17:06:49.435648+0000","last_peered":"2024-09-13T17:06:49.435648+0000","last_clean":"2024-09-13T17:06:49.435648+0000","last_became_active":"2024-09-13T17:06:48.444632+0000","last_became_peered":"2024-09-13T17:06:48.444632+0000","last_unstale":"2024-09-13T17:06:49.435648+0000","last_undegraded":"2024-09-13T17:06:49.435648+0000","last_fullsized":"2024-09-13T17:06:49.435648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:59.371861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407365+0000","last_change":"2024-09-13T17:06:48.073405+0000","last_active":"2024-09-13T17:06:50.407365+0000","last_peered":"2024-09-13T17:06:50.407365+0000","last_clean":"2024-09-13T17:06:50.407365+0000","last_became_active":"2024-09-13T17:06:48.073159+0000","last_became_peered":"2024-09-13T17:06:48.073159+0000","last_unstale":"2024-09-13T17:06:50.407365+0000","last_undegraded":"2024-09-13T17:06:50.407365+0000","last_fullsized":"2024-09-13T17:06:50.407365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:27.297703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.406804+0000","last_change":"2024-09-13T17:06:48.437235+0000","last_active":"2024-09-13T17:06:50.406804+0000","last_peered":"2024-09-13T17:06:50.406804+0000","last_clean":"2024-09-13T17:06:50.406804+0000","last_became_active":"2024-09-13T17:06:48.436958+0000","last_became_peered":"2024-09-13T17:06:48.436958+0000","last_unstale":"2024-09-13T17:06:50.406804+0000","last_undegraded":"2024-09-13T17:06:50.406804+0000","last_fullsized":"2024-09-13T17:06:50.406804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:29.305952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409543+0000","last_change":"2024-09-13T17:06:48.078856+0000","last_active":"2024-09-13T17:06:50.409543+0000","last_peered":"2024-09-13T17:06:50.409543+0000","last_clean":"2024-09-13T17:06:50.409543+0000","last_became_active":"2024-09-13T17:06:48.078488+0000","last_became_peered":"2024-09-13T17:06:48.078488+0000","last_unstale":"2024-09-13T17:06:50.409543+0000","last_undegraded":"2024-09-13T17:06:50.409543+0000","last_fullsized":"2024-09-13T17:06:50.409543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:21.835105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435397+0000","last_change":"2024-09-13T17:06:48.452018+0000","last_active":"2024-09-13T17:06:49.435397+0000","last_peered":"2024-09-13T17:06:49.435397+0000","last_clean":"2024-09-13T17:06:49.435397+0000","last_became_active":"2024-09-13T17:06:48.451696+0000","last_became_peered":"2024-09-13T17:06:48.451696+0000","last_unstale":"2024-09-13T17:06:49.435397+0000","last_undegraded":"2024-09-13T17:06:49.435397+0000","last_fullsized":"2024-09-13T17:06:49.435397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:11.126023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407239+0000","last_change":"2024-09-13T17:06:48.074283+0000","last_active":"2024-09-13T17:06:50.407239+0000","last_peered":"2024-09-13T17:06:50.407239+0000","last_clean":"2024-09-13T17:06:50.407239+0000","last_became_active":"2024-09-13T17:06:48.073951+0000","last_became_peered":"2024-09-13T17:06:48.073951+0000","last_unstale":"2024-09-13T17:06:50.407239+0000","last_undegraded":"2024-09-13T17:06:50.407239+0000","last_fullsized":"2024-09-13T17:06:50.407239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:37.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407064+0000","last_change":"2024-09-13T17:06:48.461926+0000","last_active":"2024-09-13T17:06:50.407064+0000","last_peered":"2024-09-13T17:06:50.407064+0000","last_clean":"2024-09-13T17:06:50.407064+0000","last_became_active":"2024-09-13T17:06:48.459158+0000","last_became_peered":"2024-09-13T17:06:48.459158+0000","last_unstale":"2024-09-13T17:06:50.407064+0000","last_undegraded":"2024-09-13T17:06:50.407064+0000","last_fullsized":"2024-09-13T17:06:50.407064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:14.109764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.771778+0000","last_change":"2024-09-13T17:06:48.068609+0000","last_active":"2024-09-13T17:06:49.771778+0000","last_peered":"2024-09-13T17:06:49.771778+0000","last_clean":"2024-09-13T17:06:49.771778+0000","last_became_active":"2024-09-13T17:06:48.068330+0000","last_became_peered":"2024-09-13T17:06:48.068330+0000","last_unstale":"2024-09-13T17:06:49.771778+0000","last_undegraded":"2024-09-13T17:06:49.771778+0000","last_fullsized":"2024-09-13T17:06:49.771778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:33.113560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435060+0000","last_change":"2024-09-13T17:06:48.449596+0000","last_active":"2024-09-13T17:06:49.435060+0000","last_peered":"2024-09-13T17:06:49.435060+0000","last_clean":"2024-09-13T17:06:49.435060+0000","last_became_active":"2024-09-13T17:06:48.449380+0000","last_became_peered":"2024-09-13T17:06:48.449380+0000","last_unstale":"2024-09-13T17:06:49.435060+0000","last_undegraded":"2024-09-13T17:06:49.435060+0000","last_fullsized":"2024-09-13T17:06:49.435060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:29.632832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410271+0000","last_change":"2024-09-13T17:06:48.068519+0000","last_active":"2024-09-13T17:06:50.410271+0000","last_peered":"2024-09-13T17:06:50.410271+0000","last_clean":"2024-09-13T17:06:50.410271+0000","last_became_active":"2024-09-13T17:06:48.068190+0000","last_became_peered":"2024-09-13T17:06:48.068190+0000","last_unstale":"2024-09-13T17:06:50.410271+0000","last_undegraded":"2024-09-13T17:06:50.410271+0000","last_fullsized":"2024-09-13T17:06:50.410271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:47.258496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435847+0000","last_change":"2024-09-13T17:06:48.451887+0000","last_active":"2024-09-13T17:06:49.435847+0000","last_peered":"2024-09-13T17:06:49.435847+0000","last_clean":"2024-09-13T17:06:49.435847+0000","last_became_active":"2024-09-13T17:06:48.451446+0000","last_became_peered":"2024-09-13T17:06:48.451446+0000","last_unstale":"2024-09-13T17:06:49.435847+0000","last_undegraded":"2024-09-13T17:06:49.435847+0000","last_fullsized":"2024-09-13T17:06:49.435847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:13.649151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.772275+0000","last_change":"2024-09-13T17:06:48.074131+0000","last_active":"2024-09-13T17:06:49.772275+0000","last_peered":"2024-09-13T17:06:49.772275+0000","last_clean":"2024-09-13T17:06:49.772275+0000","last_became_active":"2024-09-13T17:06:48.073870+0000","last_became_peered":"2024-09-13T17:06:48.073870+0000","last_unstale":"2024-09-13T17:06:49.772275+0000","last_undegraded":"2024-09-13T17:06:49.772275+0000","last_fullsized":"2024-09-13T17:06:49.772275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436184+0000","last_change":"2024-09-13T17:06:48.451734+0000","last_active":"2024-09-13T17:06:49.436184+0000","last_peered":"2024-09-13T17:06:49.436184+0000","last_clean":"2024-09-13T17:06:49.436184+0000","last_became_active":"2024-09-13T17:06:48.451416+0000","last_became_peered":"2024-09-13T17:06:48.451416+0000","last_unstale":"2024-09-13T17:06:49.436184+0000","last_undegraded":"2024-09-13T17:06:49.436184+0000","last_fullsized":"2024-09-13T17:06:49.436184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:03.550409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436528+0000","last_change":"2024-09-13T17:06:48.072573+0000","last_active":"2024-09-13T17:06:49.436528+0000","last_peered":"2024-09-13T17:06:49.436528+0000","last_clean":"2024-09-13T17:06:49.436528+0000","last_became_active":"2024-09-13T17:06:48.072293+0000","last_became_peered":"2024-09-13T17:06:48.072293+0000","last_unstale":"2024-09-13T17:06:49.436528+0000","last_undegraded":"2024-09-13T17:06:49.436528+0000","last_fullsized":"2024-09-13T17:06:49.436528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408292+0000","last_change":"2024-09-13T17:06:48.453923+0000","last_active":"2024-09-13T17:06:50.408292+0000","last_peered":"2024-09-13T17:06:50.408292+0000","last_clean":"2024-09-13T17:06:50.408292+0000","last_became_active":"2024-09-13T17:06:48.450683+0000","last_became_peered":"2024-09-13T17:06:48.450683+0000","last_unstale":"2024-09-13T17:06:50.408292+0000","last_undegraded":"2024-09-13T17:06:50.408292+0000","last_fullsized":"2024-09-13T17:06:50.408292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:15.339790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.772159+0000","last_change":"2024-09-13T17:06:48.076610+0000","last_active":"2024-09-13T17:06:49.772159+0000","last_peered":"2024-09-13T17:06:49.772159+0000","last_clean":"2024-09-13T17:06:49.772159+0000","last_became_active":"2024-09-13T17:06:48.076280+0000","last_became_peered":"2024-09-13T17:06:48.076280+0000","last_unstale":"2024-09-13T17:06:49.772159+0000","last_undegraded":"2024-09-13T17:06:49.772159+0000","last_fullsized":"2024-09-13T17:06:49.772159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:21.835105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435641+0000","last_change":"2024-09-13T17:06:48.457588+0000","last_active":"2024-09-13T17:06:49.435641+0000","last_peered":"2024-09-13T17:06:49.435641+0000","last_clean":"2024-09-13T17:06:49.435641+0000","last_became_active":"2024-09-13T17:06:48.457308+0000","last_became_peered":"2024-09-13T17:06:48.457308+0000","last_unstale":"2024-09-13T17:06:49.435641+0000","last_undegraded":"2024-09-13T17:06:49.435641+0000","last_fullsized":"2024-09-13T17:06:49.435641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:38.769259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T17:06:48.432560+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:06:48.432560+0000","last_peered":"2024-09-13T17:06:48.432560+0000","last_clean":"2024-09-13T17:06:48.432560+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:06:48.432560+0000","last_undegraded":"2024-09-13T17:06:48.432560+0000","last_fullsized":"2024-09-13T17:06:48.432560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407662+0000","last_change":"2024-09-13T17:06:48.077809+0000","last_active":"2024-09-13T17:06:50.407662+0000","last_peered":"2024-09-13T17:06:50.407662+0000","last_clean":"2024-09-13T17:06:50.407662+0000","last_became_active":"2024-09-13T17:06:48.077535+0000","last_became_peered":"2024-09-13T17:06:48.077535+0000","last_unstale":"2024-09-13T17:06:50.407662+0000","last_undegraded":"2024-09-13T17:06:50.407662+0000","last_fullsized":"2024-09-13T17:06:50.407662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.901813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434996+0000","last_change":"2024-09-13T17:06:48.451309+0000","last_active":"2024-09-13T17:06:49.434996+0000","last_peered":"2024-09-13T17:06:49.434996+0000","last_clean":"2024-09-13T17:06:49.434996+0000","last_became_active":"2024-09-13T17:06:48.451008+0000","last_became_peered":"2024-09-13T17:06:48.451008+0000","last_unstale":"2024-09-13T17:06:49.434996+0000","last_undegraded":"2024-09-13T17:06:49.434996+0000","last_fullsized":"2024-09-13T17:06:49.434996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434768+0000","last_change":"2024-09-13T17:06:48.071142+0000","last_active":"2024-09-13T17:06:49.434768+0000","last_peered":"2024-09-13T17:06:49.434768+0000","last_clean":"2024-09-13T17:06:49.434768+0000","last_became_active":"2024-09-13T17:06:48.070907+0000","last_became_peered":"2024-09-13T17:06:48.070907+0000","last_unstale":"2024-09-13T17:06:49.434768+0000","last_undegraded":"2024-09-13T17:06:49.434768+0000","last_fullsized":"2024-09-13T17:06:49.434768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:28.769904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407097+0000","last_change":"2024-09-13T17:06:48.449924+0000","last_active":"2024-09-13T17:06:50.407097+0000","last_peered":"2024-09-13T17:06:50.407097+0000","last_clean":"2024-09-13T17:06:50.407097+0000","last_became_active":"2024-09-13T17:06:48.449691+0000","last_became_peered":"2024-09-13T17:06:48.449691+0000","last_unstale":"2024-09-13T17:06:50.407097+0000","last_undegraded":"2024-09-13T17:06:50.407097+0000","last_fullsized":"2024-09-13T17:06:50.407097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:31.792088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.772076+0000","last_change":"2024-09-13T17:06:48.074086+0000","last_active":"2024-09-13T17:06:49.772076+0000","last_peered":"2024-09-13T17:06:49.772076+0000","last_clean":"2024-09-13T17:06:49.772076+0000","last_became_active":"2024-09-13T17:06:48.073798+0000","last_became_peered":"2024-09-13T17:06:48.073798+0000","last_unstale":"2024-09-13T17:06:49.772076+0000","last_undegraded":"2024-09-13T17:06:49.772076+0000","last_fullsized":"2024-09-13T17:06:49.772076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:37.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436043+0000","last_change":"2024-09-13T17:06:48.451852+0000","last_active":"2024-09-13T17:06:49.436043+0000","last_peered":"2024-09-13T17:06:49.436043+0000","last_clean":"2024-09-13T17:06:49.436043+0000","last_became_active":"2024-09-13T17:06:48.451614+0000","last_became_peered":"2024-09-13T17:06:48.451614+0000","last_unstale":"2024-09-13T17:06:49.436043+0000","last_undegraded":"2024-09-13T17:06:49.436043+0000","last_fullsized":"2024-09-13T17:06:49.436043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:14.109764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409598+0000","last_change":"2024-09-13T17:06:48.078024+0000","last_active":"2024-09-13T17:06:50.409598+0000","last_peered":"2024-09-13T17:06:50.409598+0000","last_clean":"2024-09-13T17:06:50.409598+0000","last_became_active":"2024-09-13T17:06:48.077753+0000","last_became_peered":"2024-09-13T17:06:48.077753+0000","last_unstale":"2024-09-13T17:06:50.409598+0000","last_undegraded":"2024-09-13T17:06:50.409598+0000","last_fullsized":"2024-09-13T17:06:50.409598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410107+0000","last_change":"2024-09-13T17:06:48.451352+0000","last_active":"2024-09-13T17:06:50.410107+0000","last_peered":"2024-09-13T17:06:50.410107+0000","last_clean":"2024-09-13T17:06:50.410107+0000","last_became_active":"2024-09-13T17:06:48.450821+0000","last_became_peered":"2024-09-13T17:06:48.450821+0000","last_unstale":"2024-09-13T17:06:50.410107+0000","last_undegraded":"2024-09-13T17:06:50.410107+0000","last_fullsized":"2024-09-13T17:06:50.410107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:17.894980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436587+0000","last_change":"2024-09-13T17:06:48.075452+0000","last_active":"2024-09-13T17:06:49.436587+0000","last_peered":"2024-09-13T17:06:49.436587+0000","last_clean":"2024-09-13T17:06:49.436587+0000","last_became_active":"2024-09-13T17:06:48.075248+0000","last_became_peered":"2024-09-13T17:06:48.075248+0000","last_unstale":"2024-09-13T17:06:49.436587+0000","last_undegraded":"2024-09-13T17:06:49.436587+0000","last_fullsized":"2024-09-13T17:06:49.436587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.901813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408460+0000","last_change":"2024-09-13T17:06:48.453207+0000","last_active":"2024-09-13T17:06:50.408460+0000","last_peered":"2024-09-13T17:06:50.408460+0000","last_clean":"2024-09-13T17:06:50.408460+0000","last_became_active":"2024-09-13T17:06:48.452962+0000","last_became_peered":"2024-09-13T17:06:48.452962+0000","last_unstale":"2024-09-13T17:06:50.408460+0000","last_undegraded":"2024-09-13T17:06:50.408460+0000","last_fullsized":"2024-09-13T17:06:50.408460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435905+0000","last_change":"2024-09-13T17:06:48.075771+0000","last_active":"2024-09-13T17:06:49.435905+0000","last_peered":"2024-09-13T17:06:49.435905+0000","last_clean":"2024-09-13T17:06:49.435905+0000","last_became_active":"2024-09-13T17:06:48.075410+0000","last_became_peered":"2024-09-13T17:06:48.075410+0000","last_unstale":"2024-09-13T17:06:49.435905+0000","last_undegraded":"2024-09-13T17:06:49.435905+0000","last_fullsized":"2024-09-13T17:06:49.435905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:40.582958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436377+0000","last_change":"2024-09-13T17:06:48.451971+0000","last_active":"2024-09-13T17:06:49.436377+0000","last_peered":"2024-09-13T17:06:49.436377+0000","last_clean":"2024-09-13T17:06:49.436377+0000","last_became_active":"2024-09-13T17:06:48.451110+0000","last_became_peered":"2024-09-13T17:06:48.451110+0000","last_unstale":"2024-09-13T17:06:49.436377+0000","last_undegraded":"2024-09-13T17:06:49.436377+0000","last_fullsized":"2024-09-13T17:06:49.436377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:46.353437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:51.811326+0000","last_change":"2024-09-13T17:06:48.071158+0000","last_active":"2024-09-13T17:06:51.811326+0000","last_peered":"2024-09-13T17:06:51.811326+0000","last_clean":"2024-09-13T17:06:51.811326+0000","last_became_active":"2024-09-13T17:06:48.070810+0000","last_became_peered":"2024-09-13T17:06:48.070810+0000","last_unstale":"2024-09-13T17:06:51.811326+0000","last_undegraded":"2024-09-13T17:06:51.811326+0000","last_fullsized":"2024-09-13T17:06:51.811326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:37.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435802+0000","last_change":"2024-09-13T17:06:48.439765+0000","last_active":"2024-09-13T17:06:49.435802+0000","last_peered":"2024-09-13T17:06:49.435802+0000","last_clean":"2024-09-13T17:06:49.435802+0000","last_became_active":"2024-09-13T17:06:48.439486+0000","last_became_peered":"2024-09-13T17:06:48.439486+0000","last_unstale":"2024-09-13T17:06:49.435802+0000","last_undegraded":"2024-09-13T17:06:49.435802+0000","last_fullsized":"2024-09-13T17:06:49.435802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:05.681555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.411021+0000","last_change":"2024-09-13T17:06:48.072147+0000","last_active":"2024-09-13T17:06:50.411021+0000","last_peered":"2024-09-13T17:06:50.411021+0000","last_clean":"2024-09-13T17:06:50.411021+0000","last_became_active":"2024-09-13T17:06:48.070889+0000","last_became_peered":"2024-09-13T17:06:48.070889+0000","last_unstale":"2024-09-13T17:06:50.411021+0000","last_undegraded":"2024-09-13T17:06:50.411021+0000","last_fullsized":"2024-09-13T17:06:50.411021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.406902+0000","last_change":"2024-09-13T17:06:48.451274+0000","last_active":"2024-09-13T17:06:50.406902+0000","last_peered":"2024-09-13T17:06:50.406902+0000","last_clean":"2024-09-13T17:06:50.406902+0000","last_became_active":"2024-09-13T17:06:48.450991+0000","last_became_peered":"2024-09-13T17:06:48.450991+0000","last_unstale":"2024-09-13T17:06:50.406902+0000","last_undegraded":"2024-09-13T17:06:50.406902+0000","last_fullsized":"2024-09-13T17:06:50.406902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:49.807985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434636+0000","last_change":"2024-09-13T17:06:48.068959+0000","last_active":"2024-09-13T17:06:49.434636+0000","last_peered":"2024-09-13T17:06:49.434636+0000","last_clean":"2024-09-13T17:06:49.434636+0000","last_became_active":"2024-09-13T17:06:48.068731+0000","last_became_peered":"2024-09-13T17:06:48.068731+0000","last_unstale":"2024-09-13T17:06:49.434636+0000","last_undegraded":"2024-09-13T17:06:49.434636+0000","last_fullsized":"2024-09-13T17:06:49.434636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.901813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409333+0000","last_change":"2024-09-13T17:06:48.453284+0000","last_active":"2024-09-13T17:06:50.409333+0000","last_peered":"2024-09-13T17:06:50.409333+0000","last_clean":"2024-09-13T17:06:50.409333+0000","last_became_active":"2024-09-13T17:06:48.452958+0000","last_became_peered":"2024-09-13T17:06:48.452958+0000","last_unstale":"2024-09-13T17:06:50.409333+0000","last_undegraded":"2024-09-13T17:06:50.409333+0000","last_fullsized":"2024-09-13T17:06:50.409333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:47.910751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436208+0000","last_change":"2024-09-13T17:06:48.070145+0000","last_active":"2024-09-13T17:06:49.436208+0000","last_peered":"2024-09-13T17:06:49.436208+0000","last_clean":"2024-09-13T17:06:49.436208+0000","last_became_active":"2024-09-13T17:06:48.069900+0000","last_became_peered":"2024-09-13T17:06:48.069900+0000","last_unstale":"2024-09-13T17:06:49.436208+0000","last_undegraded":"2024-09-13T17:06:49.436208+0000","last_fullsized":"2024-09-13T17:06:49.436208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:04.672617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434540+0000","last_change":"2024-09-13T17:06:48.452279+0000","last_active":"2024-09-13T17:06:49.434540+0000","last_peered":"2024-09-13T17:06:49.434540+0000","last_clean":"2024-09-13T17:06:49.434540+0000","last_became_active":"2024-09-13T17:06:48.452031+0000","last_became_peered":"2024-09-13T17:06:48.452031+0000","last_unstale":"2024-09-13T17:06:49.434540+0000","last_undegraded":"2024-09-13T17:06:49.434540+0000","last_fullsized":"2024-09-13T17:06:49.434540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:05.801080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436702+0000","last_change":"2024-09-13T17:06:48.078695+0000","last_active":"2024-09-13T17:06:49.436702+0000","last_peered":"2024-09-13T17:06:49.436702+0000","last_clean":"2024-09-13T17:06:49.436702+0000","last_became_active":"2024-09-13T17:06:48.078373+0000","last_became_peered":"2024-09-13T17:06:48.078373+0000","last_unstale":"2024-09-13T17:06:49.436702+0000","last_undegraded":"2024-09-13T17:06:49.436702+0000","last_fullsized":"2024-09-13T17:06:49.436702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:21.835105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434967+0000","last_change":"2024-09-13T17:06:48.438583+0000","last_active":"2024-09-13T17:06:49.434967+0000","last_peered":"2024-09-13T17:06:49.434967+0000","last_clean":"2024-09-13T17:06:49.434967+0000","last_became_active":"2024-09-13T17:06:48.438322+0000","last_became_peered":"2024-09-13T17:06:48.438322+0000","last_unstale":"2024-09-13T17:06:49.434967+0000","last_undegraded":"2024-09-13T17:06:49.434967+0000","last_fullsized":"2024-09-13T17:06:49.434967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:59.415579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435417+0000","last_change":"2024-09-13T17:06:48.072310+0000","last_active":"2024-09-13T17:06:49.435417+0000","last_peered":"2024-09-13T17:06:49.435417+0000","last_clean":"2024-09-13T17:06:49.435417+0000","last_became_active":"2024-09-13T17:06:48.072034+0000","last_became_peered":"2024-09-13T17:06:48.072034+0000","last_unstale":"2024-09-13T17:06:49.435417+0000","last_undegraded":"2024-09-13T17:06:49.435417+0000","last_fullsized":"2024-09-13T17:06:49.435417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:21.835105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407378+0000","last_change":"2024-09-13T17:06:48.459811+0000","last_active":"2024-09-13T17:06:50.407378+0000","last_peered":"2024-09-13T17:06:50.407378+0000","last_clean":"2024-09-13T17:06:50.407378+0000","last_became_active":"2024-09-13T17:06:48.459495+0000","last_became_peered":"2024-09-13T17:06:48.459495+0000","last_unstale":"2024-09-13T17:06:50.407378+0000","last_undegraded":"2024-09-13T17:06:50.407378+0000","last_fullsized":"2024-09-13T17:06:50.407378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:58.103402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408388+0000","last_change":"2024-09-13T17:06:48.456637+0000","last_active":"2024-09-13T17:06:50.408388+0000","last_peered":"2024-09-13T17:06:50.408388+0000","last_clean":"2024-09-13T17:06:50.408388+0000","last_became_active":"2024-09-13T17:06:48.454834+0000","last_became_peered":"2024-09-13T17:06:48.454834+0000","last_unstale":"2024-09-13T17:06:50.408388+0000","last_undegraded":"2024-09-13T17:06:50.408388+0000","last_fullsized":"2024-09-13T17:06:50.408388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:29.632832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435532+0000","last_change":"2024-09-13T17:06:48.076407+0000","last_active":"2024-09-13T17:06:49.435532+0000","last_peered":"2024-09-13T17:06:49.435532+0000","last_clean":"2024-09-13T17:06:49.435532+0000","last_became_active":"2024-09-13T17:06:48.076136+0000","last_became_peered":"2024-09-13T17:06:48.076136+0000","last_unstale":"2024-09-13T17:06:49.435532+0000","last_undegraded":"2024-09-13T17:06:49.435532+0000","last_fullsized":"2024-09-13T17:06:49.435532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:04.672617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408258+0000","last_change":"2024-09-13T17:06:48.457607+0000","last_active":"2024-09-13T17:06:50.408258+0000","last_peered":"2024-09-13T17:06:50.408258+0000","last_clean":"2024-09-13T17:06:50.408258+0000","last_became_active":"2024-09-13T17:06:48.457325+0000","last_became_peered":"2024-09-13T17:06:48.457325+0000","last_unstale":"2024-09-13T17:06:50.408258+0000","last_undegraded":"2024-09-13T17:06:50.408258+0000","last_fullsized":"2024-09-13T17:06:50.408258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:59.371861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435762+0000","last_change":"2024-09-13T17:06:48.072948+0000","last_active":"2024-09-13T17:06:49.435762+0000","last_peered":"2024-09-13T17:06:49.435762+0000","last_clean":"2024-09-13T17:06:49.435762+0000","last_became_active":"2024-09-13T17:06:48.072466+0000","last_became_peered":"2024-09-13T17:06:48.072466+0000","last_unstale":"2024-09-13T17:06:49.435762+0000","last_undegraded":"2024-09-13T17:06:49.435762+0000","last_fullsized":"2024-09-13T17:06:49.435762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:16.886041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407035+0000","last_change":"2024-09-13T17:06:48.452786+0000","last_active":"2024-09-13T17:06:50.407035+0000","last_peered":"2024-09-13T17:06:50.407035+0000","last_clean":"2024-09-13T17:06:50.407035+0000","last_became_active":"2024-09-13T17:06:48.452536+0000","last_became_peered":"2024-09-13T17:06:48.452536+0000","last_unstale":"2024-09-13T17:06:50.407035+0000","last_undegraded":"2024-09-13T17:06:50.407035+0000","last_fullsized":"2024-09-13T17:06:50.407035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435770+0000","last_change":"2024-09-13T17:06:48.073581+0000","last_active":"2024-09-13T17:06:49.435770+0000","last_peered":"2024-09-13T17:06:49.435770+0000","last_clean":"2024-09-13T17:06:49.435770+0000","last_became_active":"2024-09-13T17:06:48.073283+0000","last_became_peered":"2024-09-13T17:06:48.073283+0000","last_unstale":"2024-09-13T17:06:49.435770+0000","last_undegraded":"2024-09-13T17:06:49.435770+0000","last_fullsized":"2024-09-13T17:06:49.435770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:11.933089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435693+0000","last_change":"2024-09-13T17:06:48.461028+0000","last_active":"2024-09-13T17:06:49.435693+0000","last_peered":"2024-09-13T17:06:49.435693+0000","last_clean":"2024-09-13T17:06:49.435693+0000","last_became_active":"2024-09-13T17:06:48.460777+0000","last_became_peered":"2024-09-13T17:06:48.460777+0000","last_unstale":"2024-09-13T17:06:49.435693+0000","last_undegraded":"2024-09-13T17:06:49.435693+0000","last_fullsized":"2024-09-13T17:06:49.435693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:59.371861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407296+0000","last_change":"2024-09-13T17:06:48.079106+0000","last_active":"2024-09-13T17:06:50.407296+0000","last_peered":"2024-09-13T17:06:50.407296+0000","last_clean":"2024-09-13T17:06:50.407296+0000","last_became_active":"2024-09-13T17:06:48.078850+0000","last_became_peered":"2024-09-13T17:06:48.078850+0000","last_unstale":"2024-09-13T17:06:50.407296+0000","last_undegraded":"2024-09-13T17:06:50.407296+0000","last_fullsized":"2024-09-13T17:06:50.407296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:47.258496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:06:56.506 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:06:56.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.602+0000 7fb7af59e700 1 Processor -- start 2024-09-13T17:06:56.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.602+0000 7fb7af59e700 1 -- start start 2024-09-13T17:06:56.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.602+0000 7fb7af59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7b00d3680 0x7fb7b00d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.602+0000 7fb7af59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b00d0ea0 con 0x7fb7b00cf920 2024-09-13T17:06:56.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.602+0000 7fb7af59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b00d0c70 con 0x7fb7b01602d0 2024-09-13T17:06:56.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.602+0000 7fb7af59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00ceab0 con 0x7fb7b00d3680 2024-09-13T17:06:56.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.602+0000 7fb7add9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb7b00cf920 0x7fb7b00b59b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49244/0 (socket says 172.21.15.123:49244) 2024-09-13T17:06:56.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.602+0000 7fb7add9b700 1 -- 172.21.15.123:0/3514510357 learned_addr learned my addr 172.21.15.123:0/3514510357 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:56.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.602+0000 7fb7aed9d700 1 --2- 172.21.15.123:0/3514510357 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7b00d3680 0x7fb7b00d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7ad59a700 1 -- 172.21.15.123:0/3514510357 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839030205 0 0) 0x7fb7b00d0ea0 con 0x7fb7b00cf920 2024-09-13T17:06:56.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7ad59a700 1 -- 172.21.15.123:0/3514510357 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7980035d0 con 0x7fb7b00cf920 2024-09-13T17:06:56.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7ad59a700 1 -- 172.21.15.123:0/3514510357 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315212195 0 0) 0x7fb7b00d0c70 con 0x7fb7b01602d0 2024-09-13T17:06:56.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7ad59a700 1 -- 172.21.15.123:0/3514510357 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7b00d0ea0 con 0x7fb7b01602d0 2024-09-13T17:06:56.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7aed9d700 1 -- 172.21.15.123:0/3514510357 >> v1:172.21.15.153:6789/0 conn(0x7fb7b01602d0 legacy=0x7fb7b00cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7aed9d700 1 -- 172.21.15.123:0/3514510357 >> v1:172.21.15.123:6789/0 conn(0x7fb7b00cf920 legacy=0x7fb7b00b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7aed9d700 1 -- 172.21.15.123:0/3514510357 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b00cff00 con 0x7fb7b00d3680 2024-09-13T17:06:56.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7aed9d700 1 --2- 172.21.15.123:0/3514510357 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7b00d3680 0x7fb7b00d0730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009df0 tx=0x7fb7a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=722584ccb1cec5f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:56.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7ad59a700 1 -- 172.21.15.123:0/3514510357 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800e070 con 0x7fb7b00d3680 2024-09-13T17:06:56.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7ad59a700 1 -- 172.21.15.123:0/3514510357 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a800bae0 con 0x7fb7b00d3680 2024-09-13T17:06:56.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7ad59a700 1 -- 172.21.15.123:0/3514510357 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800be50 con 0x7fb7b00d3680 2024-09-13T17:06:56.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7af59e700 1 -- 172.21.15.123:0/3514510357 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7b00d3680 msgr2=0x7fb7b00d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7af59e700 1 --2- 172.21.15.123:0/3514510357 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7b00d3680 0x7fb7b00d0730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009df0 tx=0x7fb7a800b330 comp rx=0 tx=0).stop 2024-09-13T17:06:56.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7af59e700 1 -- 172.21.15.123:0/3514510357 shutdown_connections 2024-09-13T17:06:56.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7af59e700 1 --2- 172.21.15.123:0/3514510357 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7b00d3680 0x7fb7b00d0730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7af59e700 1 -- 172.21.15.123:0/3514510357 >> 172.21.15.123:0/3514510357 conn(0x7fb7b00d2b60 msgr2=0x7fb7b00d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:56.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7af59e700 1 -- 172.21.15.123:0/3514510357 shutdown_connections 2024-09-13T17:06:56.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7af59e700 1 -- 172.21.15.123:0/3514510357 wait complete. 2024-09-13T17:06:56.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7af59e700 1 Processor -- start 2024-09-13T17:06:56.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.606+0000 7fb7af59e700 1 -- start start 2024-09-13T17:06:56.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7af59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7b00cf920 0x7fb7b00cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7af59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7b00d3680 0x7fb7b0158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7af59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7b01602d0 0x7fb7b015d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7af59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00cb260 con 0x7fb7b00d3680 2024-09-13T17:06:56.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7af59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00cb540 con 0x7fb7b01602d0 2024-09-13T17:06:56.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7af59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00cb820 con 0x7fb7b00cf920 2024-09-13T17:06:56.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7add9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7b00d3680 0x7fb7b0158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7add9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7b00d3680 0x7fb7b0158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46712/0 (socket says 172.21.15.123:46712) 2024-09-13T17:06:56.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7add9b700 1 -- 172.21.15.123:0/2368058208 learned_addr learned my addr 172.21.15.123:0/2368058208 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:56.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7ae59c700 1 --2- 172.21.15.123:0/2368058208 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7b00cf920 0x7fb7b00cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7aed9d700 1 --2- 172.21.15.123:0/2368058208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7b01602d0 0x7fb7b015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7add9b700 1 -- 172.21.15.123:0/2368058208 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7b00cf920 msgr2=0x7fb7b00cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7add9b700 1 --2- 172.21.15.123:0/2368058208 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7b00cf920 0x7fb7b00cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7add9b700 1 -- 172.21.15.123:0/2368058208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7b01602d0 msgr2=0x7fb7b015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7add9b700 1 --2- 172.21.15.123:0/2368058208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7b01602d0 0x7fb7b015d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7add9b700 1 -- 172.21.15.123:0/2368058208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a8009a70 con 0x7fb7b00d3680 2024-09-13T17:06:56.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7add9b700 1 --2- 172.21.15.123:0/2368058208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7b00d3680 0x7fb7b0158270 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400c700 tx=0x7fb7a400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:56.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb79effd700 1 -- 172.21.15.123:0/2368058208 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4005d90 con 0x7fb7b00d3680 2024-09-13T17:06:56.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb79effd700 1 -- 172.21.15.123:0/2368058208 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a40070d0 con 0x7fb7b00d3680 2024-09-13T17:06:56.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7af59e700 1 -- 172.21.15.123:0/2368058208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b00cbb00 con 0x7fb7b00d3680 2024-09-13T17:06:56.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb79effd700 1 -- 172.21.15.123:0/2368058208 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4007480 con 0x7fb7b00d3680 2024-09-13T17:06:56.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7af59e700 1 -- 172.21.15.123:0/2368058208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b01599b0 con 0x7fb7b00d3680 2024-09-13T17:06:56.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb7af59e700 1 -- 172.21.15.123:0/2368058208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b0159c40 con 0x7fb7b00d3680 2024-09-13T17:06:56.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.610+0000 7fb79effd700 1 -- 172.21.15.123:0/2368058208 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7a40075e0 con 0x7fb7b00d3680 2024-09-13T17:06:56.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.614+0000 7fb79effd700 1 --2- 172.21.15.123:0/2368058208 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb790066760 0x7fb790068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.614+0000 7fb7ae59c700 1 --2- 172.21.15.123:0/2368058208 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb790066760 0x7fb790068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.614+0000 7fb79effd700 1 -- 172.21.15.123:0/2368058208 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7a4083570 con 0x7fb7b00d3680 2024-09-13T17:06:56.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.614+0000 7fb7ae59c700 1 --2- 172.21.15.123:0/2368058208 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb790066760 0x7fb790068c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb7b015dc50 tx=0x7fb7a0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:56.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.618+0000 7fb79effd700 1 -- 172.21.15.123:0/2368058208 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb7b0159c40 con 0x7fb7b00d3680 2024-09-13T17:06:56.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.774+0000 7fb7af59e700 1 -- 172.21.15.123:0/2368058208 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb7b00c9540 con 0x7fb790066760 2024-09-13T17:06:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.782+0000 7fb79effd700 1 -- 172.21.15.123:0/2368058208 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264520 (secure 0 0 0) 0x7fb7b00c9540 con 0x7fb790066760 2024-09-13T17:06:56.792 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:56.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.786+0000 7fb7af59e700 1 -- 172.21.15.123:0/2368058208 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb790066760 msgr2=0x7fb790068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.786+0000 7fb7af59e700 1 --2- 172.21.15.123:0/2368058208 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb790066760 0x7fb790068c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb7b015dc50 tx=0x7fb7a0009040 comp rx=0 tx=0).stop 2024-09-13T17:06:56.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.786+0000 7fb7af59e700 1 -- 172.21.15.123:0/2368058208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7b00d3680 msgr2=0x7fb7b0158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.786+0000 7fb7af59e700 1 --2- 172.21.15.123:0/2368058208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7b00d3680 0x7fb7b0158270 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400c700 tx=0x7fb7a400ca10 comp rx=0 tx=0).stop 2024-09-13T17:06:56.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.786+0000 7fb7af59e700 1 -- 172.21.15.123:0/2368058208 shutdown_connections 2024-09-13T17:06:56.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.786+0000 7fb7af59e700 1 --2- 172.21.15.123:0/2368058208 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb790066760 0x7fb790068c20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.786+0000 7fb7af59e700 1 --2- 172.21.15.123:0/2368058208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7b01602d0 0x7fb7b015d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.786+0000 7fb7af59e700 1 --2- 172.21.15.123:0/2368058208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7b00d3680 0x7fb7b0158270 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.786+0000 7fb7af59e700 1 --2- 172.21.15.123:0/2368058208 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7b00cf920 0x7fb7b00cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.786+0000 7fb7af59e700 1 -- 172.21.15.123:0/2368058208 >> 172.21.15.123:0/2368058208 conn(0x7fb7b00d2b60 msgr2=0x7fb7b00b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:56.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.786+0000 7fb7af59e700 1 -- 172.21.15.123:0/2368058208 shutdown_connections 2024-09-13T17:06:56.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.786+0000 7fb7af59e700 1 -- 172.21.15.123:0/2368058208 wait complete. 2024-09-13T17:06:56.795 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:06:56.805 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-13T17:06:56.739270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218996,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755724,"statfs":{"total":773094113280,"available":772869861376,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.315424"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436070+0000","last_change":"2024-09-13T17:06:48.461079+0000","last_active":"2024-09-13T17:06:49.436070+0000","last_peered":"2024-09-13T17:06:49.436070+0000","last_clean":"2024-09-13T17:06:49.436070+0000","last_became_active":"2024-09-13T17:06:48.460855+0000","last_became_peered":"2024-09-13T17:06:48.460855+0000","last_unstale":"2024-09-13T17:06:49.436070+0000","last_undegraded":"2024-09-13T17:06:49.436070+0000","last_fullsized":"2024-09-13T17:06:49.436070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:13.871898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436467+0000","last_change":"2024-09-13T17:06:48.450997+0000","last_active":"2024-09-13T17:06:49.436467+0000","last_peered":"2024-09-13T17:06:49.436467+0000","last_clean":"2024-09-13T17:06:49.436467+0000","last_became_active":"2024-09-13T17:06:48.450751+0000","last_became_peered":"2024-09-13T17:06:48.450751+0000","last_unstale":"2024-09-13T17:06:49.436467+0000","last_undegraded":"2024-09-13T17:06:49.436467+0000","last_fullsized":"2024-09-13T17:06:49.436467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:29.305952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407157+0000","last_change":"2024-09-13T17:06:48.438677+0000","last_active":"2024-09-13T17:06:50.407157+0000","last_peered":"2024-09-13T17:06:50.407157+0000","last_clean":"2024-09-13T17:06:50.407157+0000","last_became_active":"2024-09-13T17:06:48.438399+0000","last_became_peered":"2024-09-13T17:06:48.438399+0000","last_unstale":"2024-09-13T17:06:50.407157+0000","last_undegraded":"2024-09-13T17:06:50.407157+0000","last_fullsized":"2024-09-13T17:06:50.407157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:02.762902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407961+0000","last_change":"2024-09-13T17:06:48.456834+0000","last_active":"2024-09-13T17:06:50.407961+0000","last_peered":"2024-09-13T17:06:50.407961+0000","last_clean":"2024-09-13T17:06:50.407961+0000","last_became_active":"2024-09-13T17:06:48.452727+0000","last_became_peered":"2024-09-13T17:06:48.452727+0000","last_unstale":"2024-09-13T17:06:50.407961+0000","last_undegraded":"2024-09-13T17:06:50.407961+0000","last_fullsized":"2024-09-13T17:06:50.407961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:13.649151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435305+0000","last_change":"2024-09-13T17:06:48.451267+0000","last_active":"2024-09-13T17:06:49.435305+0000","last_peered":"2024-09-13T17:06:49.435305+0000","last_clean":"2024-09-13T17:06:49.435305+0000","last_became_active":"2024-09-13T17:06:48.450870+0000","last_became_peered":"2024-09-13T17:06:48.450870+0000","last_unstale":"2024-09-13T17:06:49.435305+0000","last_undegraded":"2024-09-13T17:06:49.435305+0000","last_fullsized":"2024-09-13T17:06:49.435305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:15.339790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408989+0000","last_change":"2024-09-13T17:06:48.450864+0000","last_active":"2024-09-13T17:06:50.408989+0000","last_peered":"2024-09-13T17:06:50.408989+0000","last_clean":"2024-09-13T17:06:50.408989+0000","last_became_active":"2024-09-13T17:06:48.450278+0000","last_became_peered":"2024-09-13T17:06:48.450278+0000","last_unstale":"2024-09-13T17:06:50.408989+0000","last_undegraded":"2024-09-13T17:06:50.408989+0000","last_fullsized":"2024-09-13T17:06:50.408989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:13.871898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435044+0000","last_change":"2024-09-13T17:06:48.439223+0000","last_active":"2024-09-13T17:06:49.435044+0000","last_peered":"2024-09-13T17:06:49.435044+0000","last_clean":"2024-09-13T17:06:49.435044+0000","last_became_active":"2024-09-13T17:06:48.438699+0000","last_became_peered":"2024-09-13T17:06:48.438699+0000","last_unstale":"2024-09-13T17:06:49.435044+0000","last_undegraded":"2024-09-13T17:06:49.435044+0000","last_fullsized":"2024-09-13T17:06:49.435044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:43.812384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434226+0000","last_change":"2024-09-13T17:06:48.451536+0000","last_active":"2024-09-13T17:06:49.434226+0000","last_peered":"2024-09-13T17:06:49.434226+0000","last_clean":"2024-09-13T17:06:49.434226+0000","last_became_active":"2024-09-13T17:06:48.451128+0000","last_became_peered":"2024-09-13T17:06:48.451128+0000","last_unstale":"2024-09-13T17:06:49.434226+0000","last_undegraded":"2024-09-13T17:06:49.434226+0000","last_fullsized":"2024-09-13T17:06:49.434226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:58.103402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436150+0000","last_change":"2024-09-13T17:06:48.450886+0000","last_active":"2024-09-13T17:06:49.436150+0000","last_peered":"2024-09-13T17:06:49.436150+0000","last_clean":"2024-09-13T17:06:49.436150+0000","last_became_active":"2024-09-13T17:06:48.450641+0000","last_became_peered":"2024-09-13T17:06:48.450641+0000","last_unstale":"2024-09-13T17:06:49.436150+0000","last_undegraded":"2024-09-13T17:06:49.436150+0000","last_fullsized":"2024-09-13T17:06:49.436150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:57.203854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.411078+0000","last_change":"2024-09-13T17:06:48.463023+0000","last_active":"2024-09-13T17:06:50.411078+0000","last_peered":"2024-09-13T17:06:50.411078+0000","last_clean":"2024-09-13T17:06:50.411078+0000","last_became_active":"2024-09-13T17:06:48.462496+0000","last_became_peered":"2024-09-13T17:06:48.462496+0000","last_unstale":"2024-09-13T17:06:50.411078+0000","last_undegraded":"2024-09-13T17:06:50.411078+0000","last_fullsized":"2024-09-13T17:06:50.411078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:59.415579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410541+0000","last_change":"2024-09-13T17:06:48.460040+0000","last_active":"2024-09-13T17:06:50.410541+0000","last_peered":"2024-09-13T17:06:50.410541+0000","last_clean":"2024-09-13T17:06:50.410541+0000","last_became_active":"2024-09-13T17:06:48.459768+0000","last_became_peered":"2024-09-13T17:06:48.459768+0000","last_unstale":"2024-09-13T17:06:50.410541+0000","last_undegraded":"2024-09-13T17:06:50.410541+0000","last_fullsized":"2024-09-13T17:06:50.410541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:36.046829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410162+0000","last_change":"2024-09-13T17:06:48.464562+0000","last_active":"2024-09-13T17:06:50.410162+0000","last_peered":"2024-09-13T17:06:50.410162+0000","last_clean":"2024-09-13T17:06:50.410162+0000","last_became_active":"2024-09-13T17:06:48.464356+0000","last_became_peered":"2024-09-13T17:06:48.464356+0000","last_unstale":"2024-09-13T17:06:50.410162+0000","last_undegraded":"2024-09-13T17:06:50.410162+0000","last_fullsized":"2024-09-13T17:06:50.410162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:41.591896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434879+0000","last_change":"2024-09-13T17:06:48.447746+0000","last_active":"2024-09-13T17:06:49.434879+0000","last_peered":"2024-09-13T17:06:49.434879+0000","last_clean":"2024-09-13T17:06:49.434879+0000","last_became_active":"2024-09-13T17:06:48.447441+0000","last_became_peered":"2024-09-13T17:06:48.447441+0000","last_unstale":"2024-09-13T17:06:49.434879+0000","last_undegraded":"2024-09-13T17:06:49.434879+0000","last_fullsized":"2024-09-13T17:06:49.434879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:15.339790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.406714+0000","last_change":"2024-09-13T17:06:48.452709+0000","last_active":"2024-09-13T17:06:50.406714+0000","last_peered":"2024-09-13T17:06:50.406714+0000","last_clean":"2024-09-13T17:06:50.406714+0000","last_became_active":"2024-09-13T17:06:48.452174+0000","last_became_peered":"2024-09-13T17:06:48.452174+0000","last_unstale":"2024-09-13T17:06:50.406714+0000","last_undegraded":"2024-09-13T17:06:50.406714+0000","last_fullsized":"2024-09-13T17:06:50.406714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:05.801080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436098+0000","last_change":"2024-09-13T17:06:48.454013+0000","last_active":"2024-09-13T17:06:49.436098+0000","last_peered":"2024-09-13T17:06:49.436098+0000","last_clean":"2024-09-13T17:06:49.436098+0000","last_became_active":"2024-09-13T17:06:48.453811+0000","last_became_peered":"2024-09-13T17:06:48.453811+0000","last_unstale":"2024-09-13T17:06:49.436098+0000","last_undegraded":"2024-09-13T17:06:49.436098+0000","last_fullsized":"2024-09-13T17:06:49.436098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:58.103402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407668+0000","last_change":"2024-09-13T17:06:48.456811+0000","last_active":"2024-09-13T17:06:50.407668+0000","last_peered":"2024-09-13T17:06:50.407668+0000","last_clean":"2024-09-13T17:06:50.407668+0000","last_became_active":"2024-09-13T17:06:48.454867+0000","last_became_peered":"2024-09-13T17:06:48.454867+0000","last_unstale":"2024-09-13T17:06:50.407668+0000","last_undegraded":"2024-09-13T17:06:50.407668+0000","last_fullsized":"2024-09-13T17:06:50.407668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:03.550409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408759+0000","last_change":"2024-09-13T17:06:48.457471+0000","last_active":"2024-09-13T17:06:50.408759+0000","last_peered":"2024-09-13T17:06:50.408759+0000","last_clean":"2024-09-13T17:06:50.408759+0000","last_became_active":"2024-09-13T17:06:48.457196+0000","last_became_peered":"2024-09-13T17:06:48.457196+0000","last_unstale":"2024-09-13T17:06:50.408759+0000","last_undegraded":"2024-09-13T17:06:50.408759+0000","last_fullsized":"2024-09-13T17:06:50.408759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:43.812384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.772355+0000","last_change":"2024-09-13T17:06:48.450031+0000","last_active":"2024-09-13T17:06:49.772355+0000","last_peered":"2024-09-13T17:06:49.772355+0000","last_clean":"2024-09-13T17:06:49.772355+0000","last_became_active":"2024-09-13T17:06:48.449823+0000","last_became_peered":"2024-09-13T17:06:48.449823+0000","last_unstale":"2024-09-13T17:06:49.772355+0000","last_undegraded":"2024-09-13T17:06:49.772355+0000","last_fullsized":"2024-09-13T17:06:49.772355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:29.778842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435878+0000","last_change":"2024-09-13T17:06:48.450057+0000","last_active":"2024-09-13T17:06:49.435878+0000","last_peered":"2024-09-13T17:06:49.435878+0000","last_clean":"2024-09-13T17:06:49.435878+0000","last_became_active":"2024-09-13T17:06:48.449798+0000","last_became_peered":"2024-09-13T17:06:48.449798+0000","last_unstale":"2024-09-13T17:06:49.435878+0000","last_undegraded":"2024-09-13T17:06:49.435878+0000","last_fullsized":"2024-09-13T17:06:49.435878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:59.415579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410060+0000","last_change":"2024-09-13T17:06:48.462782+0000","last_active":"2024-09-13T17:06:50.410060+0000","last_peered":"2024-09-13T17:06:50.410060+0000","last_clean":"2024-09-13T17:06:50.410060+0000","last_became_active":"2024-09-13T17:06:48.462113+0000","last_became_peered":"2024-09-13T17:06:48.462113+0000","last_unstale":"2024-09-13T17:06:50.410060+0000","last_undegraded":"2024-09-13T17:06:50.410060+0000","last_fullsized":"2024-09-13T17:06:50.410060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:46.353437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407153+0000","last_change":"2024-09-13T17:06:48.437728+0000","last_active":"2024-09-13T17:06:50.407153+0000","last_peered":"2024-09-13T17:06:50.407153+0000","last_clean":"2024-09-13T17:06:50.407153+0000","last_became_active":"2024-09-13T17:06:48.437291+0000","last_became_peered":"2024-09-13T17:06:48.437291+0000","last_unstale":"2024-09-13T17:06:50.407153+0000","last_undegraded":"2024-09-13T17:06:50.407153+0000","last_fullsized":"2024-09-13T17:06:50.407153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:46.353437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409183+0000","last_change":"2024-09-13T17:06:48.457755+0000","last_active":"2024-09-13T17:06:50.409183+0000","last_peered":"2024-09-13T17:06:50.409183+0000","last_clean":"2024-09-13T17:06:50.409183+0000","last_became_active":"2024-09-13T17:06:48.457460+0000","last_became_peered":"2024-09-13T17:06:48.457460+0000","last_unstale":"2024-09-13T17:06:50.409183+0000","last_undegraded":"2024-09-13T17:06:50.409183+0000","last_fullsized":"2024-09-13T17:06:50.409183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:57.203854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434366+0000","last_change":"2024-09-13T17:06:48.450031+0000","last_active":"2024-09-13T17:06:49.434366+0000","last_peered":"2024-09-13T17:06:49.434366+0000","last_clean":"2024-09-13T17:06:49.434366+0000","last_became_active":"2024-09-13T17:06:48.449802+0000","last_became_peered":"2024-09-13T17:06:48.449802+0000","last_unstale":"2024-09-13T17:06:49.434366+0000","last_undegraded":"2024-09-13T17:06:49.434366+0000","last_fullsized":"2024-09-13T17:06:49.434366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:46.353437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407946+0000","last_change":"2024-09-13T17:06:48.453317+0000","last_active":"2024-09-13T17:06:50.407946+0000","last_peered":"2024-09-13T17:06:50.407946+0000","last_clean":"2024-09-13T17:06:50.407946+0000","last_became_active":"2024-09-13T17:06:48.453009+0000","last_became_peered":"2024-09-13T17:06:48.453009+0000","last_unstale":"2024-09-13T17:06:50.407946+0000","last_undegraded":"2024-09-13T17:06:50.407946+0000","last_fullsized":"2024-09-13T17:06:50.407946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:59.415579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435883+0000","last_change":"2024-09-13T17:06:48.452096+0000","last_active":"2024-09-13T17:06:49.435883+0000","last_peered":"2024-09-13T17:06:49.435883+0000","last_clean":"2024-09-13T17:06:49.435883+0000","last_became_active":"2024-09-13T17:06:48.451615+0000","last_became_peered":"2024-09-13T17:06:48.451615+0000","last_unstale":"2024-09-13T17:06:49.435883+0000","last_undegraded":"2024-09-13T17:06:49.435883+0000","last_fullsized":"2024-09-13T17:06:49.435883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:14.109764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.411093+0000","last_change":"2024-09-13T17:06:48.462465+0000","last_active":"2024-09-13T17:06:50.411093+0000","last_peered":"2024-09-13T17:06:50.411093+0000","last_clean":"2024-09-13T17:06:50.411093+0000","last_became_active":"2024-09-13T17:06:48.460284+0000","last_became_peered":"2024-09-13T17:06:48.460284+0000","last_unstale":"2024-09-13T17:06:50.411093+0000","last_undegraded":"2024-09-13T17:06:50.411093+0000","last_fullsized":"2024-09-13T17:06:50.411093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:29.305952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436111+0000","last_change":"2024-09-13T17:06:48.450822+0000","last_active":"2024-09-13T17:06:49.436111+0000","last_peered":"2024-09-13T17:06:49.436111+0000","last_clean":"2024-09-13T17:06:49.436111+0000","last_became_active":"2024-09-13T17:06:48.450622+0000","last_became_peered":"2024-09-13T17:06:48.450622+0000","last_unstale":"2024-09-13T17:06:49.436111+0000","last_undegraded":"2024-09-13T17:06:49.436111+0000","last_fullsized":"2024-09-13T17:06:49.436111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435319+0000","last_change":"2024-09-13T17:06:48.454287+0000","last_active":"2024-09-13T17:06:49.435319+0000","last_peered":"2024-09-13T17:06:49.435319+0000","last_clean":"2024-09-13T17:06:49.435319+0000","last_became_active":"2024-09-13T17:06:48.454110+0000","last_became_peered":"2024-09-13T17:06:48.454110+0000","last_unstale":"2024-09-13T17:06:49.435319+0000","last_undegraded":"2024-09-13T17:06:49.435319+0000","last_fullsized":"2024-09-13T17:06:49.435319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:29.305952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407227+0000","last_change":"2024-09-13T17:06:48.438672+0000","last_active":"2024-09-13T17:06:50.407227+0000","last_peered":"2024-09-13T17:06:50.407227+0000","last_clean":"2024-09-13T17:06:50.407227+0000","last_became_active":"2024-09-13T17:06:48.438397+0000","last_became_peered":"2024-09-13T17:06:48.438397+0000","last_unstale":"2024-09-13T17:06:50.407227+0000","last_undegraded":"2024-09-13T17:06:50.407227+0000","last_fullsized":"2024-09-13T17:06:50.407227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:36.046829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409404+0000","last_change":"2024-09-13T17:06:48.453529+0000","last_active":"2024-09-13T17:06:50.409404+0000","last_peered":"2024-09-13T17:06:50.409404+0000","last_clean":"2024-09-13T17:06:50.409404+0000","last_became_active":"2024-09-13T17:06:48.450613+0000","last_became_peered":"2024-09-13T17:06:48.450613+0000","last_unstale":"2024-09-13T17:06:50.409404+0000","last_undegraded":"2024-09-13T17:06:50.409404+0000","last_fullsized":"2024-09-13T17:06:50.409404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:11.126023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.771974+0000","last_change":"2024-09-13T17:06:48.447764+0000","last_active":"2024-09-13T17:06:49.771974+0000","last_peered":"2024-09-13T17:06:49.771974+0000","last_clean":"2024-09-13T17:06:49.771974+0000","last_became_active":"2024-09-13T17:06:48.447487+0000","last_became_peered":"2024-09-13T17:06:48.447487+0000","last_unstale":"2024-09-13T17:06:49.771974+0000","last_undegraded":"2024-09-13T17:06:49.771974+0000","last_fullsized":"2024-09-13T17:06:49.771974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:17.894980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.406959+0000","last_change":"2024-09-13T17:06:48.461988+0000","last_active":"2024-09-13T17:06:50.406959+0000","last_peered":"2024-09-13T17:06:50.406959+0000","last_clean":"2024-09-13T17:06:50.406959+0000","last_became_active":"2024-09-13T17:06:48.459269+0000","last_became_peered":"2024-09-13T17:06:48.459269+0000","last_unstale":"2024-09-13T17:06:50.406959+0000","last_undegraded":"2024-09-13T17:06:50.406959+0000","last_fullsized":"2024-09-13T17:06:50.406959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409425+0000","last_change":"2024-09-13T17:06:48.452270+0000","last_active":"2024-09-13T17:06:50.409425+0000","last_peered":"2024-09-13T17:06:50.409425+0000","last_clean":"2024-09-13T17:06:50.409425+0000","last_became_active":"2024-09-13T17:06:48.452009+0000","last_became_peered":"2024-09-13T17:06:48.452009+0000","last_unstale":"2024-09-13T17:06:50.409425+0000","last_undegraded":"2024-09-13T17:06:50.409425+0000","last_fullsized":"2024-09-13T17:06:50.409425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:29.778842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434995+0000","last_change":"2024-09-13T17:06:48.073325+0000","last_active":"2024-09-13T17:06:49.434995+0000","last_peered":"2024-09-13T17:06:49.434995+0000","last_clean":"2024-09-13T17:06:49.434995+0000","last_became_active":"2024-09-13T17:06:48.073071+0000","last_became_peered":"2024-09-13T17:06:48.073071+0000","last_unstale":"2024-09-13T17:06:49.434995+0000","last_undegraded":"2024-09-13T17:06:49.434995+0000","last_fullsized":"2024-09-13T17:06:49.434995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:27.297703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407400+0000","last_change":"2024-09-13T17:06:48.454892+0000","last_active":"2024-09-13T17:06:50.407400+0000","last_peered":"2024-09-13T17:06:50.407400+0000","last_clean":"2024-09-13T17:06:50.407400+0000","last_became_active":"2024-09-13T17:06:48.454422+0000","last_became_peered":"2024-09-13T17:06:48.454422+0000","last_unstale":"2024-09-13T17:06:50.407400+0000","last_undegraded":"2024-09-13T17:06:50.407400+0000","last_fullsized":"2024-09-13T17:06:50.407400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:14.109764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407481+0000","last_change":"2024-09-13T17:06:48.074337+0000","last_active":"2024-09-13T17:06:50.407481+0000","last_peered":"2024-09-13T17:06:50.407481+0000","last_clean":"2024-09-13T17:06:50.407481+0000","last_became_active":"2024-09-13T17:06:48.073999+0000","last_became_peered":"2024-09-13T17:06:48.073999+0000","last_unstale":"2024-09-13T17:06:50.407481+0000","last_undegraded":"2024-09-13T17:06:50.407481+0000","last_fullsized":"2024-09-13T17:06:50.407481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:40.582958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434508+0000","last_change":"2024-09-13T17:06:48.073011+0000","last_active":"2024-09-13T17:06:49.434508+0000","last_peered":"2024-09-13T17:06:49.434508+0000","last_clean":"2024-09-13T17:06:49.434508+0000","last_became_active":"2024-09-13T17:06:48.072498+0000","last_became_peered":"2024-09-13T17:06:48.072498+0000","last_unstale":"2024-09-13T17:06:49.434508+0000","last_undegraded":"2024-09-13T17:06:49.434508+0000","last_fullsized":"2024-09-13T17:06:49.434508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:33.113560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434356+0000","last_change":"2024-09-13T17:06:48.438607+0000","last_active":"2024-09-13T17:06:49.434356+0000","last_peered":"2024-09-13T17:06:49.434356+0000","last_clean":"2024-09-13T17:06:49.434356+0000","last_became_active":"2024-09-13T17:06:48.438316+0000","last_became_peered":"2024-09-13T17:06:48.438316+0000","last_unstale":"2024-09-13T17:06:49.434356+0000","last_undegraded":"2024-09-13T17:06:49.434356+0000","last_fullsized":"2024-09-13T17:06:49.434356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:36.046829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408018+0000","last_change":"2024-09-13T17:06:48.076549+0000","last_active":"2024-09-13T17:06:50.408018+0000","last_peered":"2024-09-13T17:06:50.408018+0000","last_clean":"2024-09-13T17:06:50.408018+0000","last_became_active":"2024-09-13T17:06:48.076266+0000","last_became_peered":"2024-09-13T17:06:48.076266+0000","last_unstale":"2024-09-13T17:06:50.408018+0000","last_undegraded":"2024-09-13T17:06:50.408018+0000","last_fullsized":"2024-09-13T17:06:50.408018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:11.933089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436035+0000","last_change":"2024-09-13T17:06:48.451140+0000","last_active":"2024-09-13T17:06:49.436035+0000","last_peered":"2024-09-13T17:06:49.436035+0000","last_clean":"2024-09-13T17:06:49.436035+0000","last_became_active":"2024-09-13T17:06:48.450731+0000","last_became_peered":"2024-09-13T17:06:48.450731+0000","last_unstale":"2024-09-13T17:06:49.436035+0000","last_undegraded":"2024-09-13T17:06:49.436035+0000","last_fullsized":"2024-09-13T17:06:49.436035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:36.046829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410915+0000","last_change":"2024-09-13T17:06:48.076480+0000","last_active":"2024-09-13T17:06:50.410915+0000","last_peered":"2024-09-13T17:06:50.410915+0000","last_clean":"2024-09-13T17:06:50.410915+0000","last_became_active":"2024-09-13T17:06:48.076222+0000","last_became_peered":"2024-09-13T17:06:48.076222+0000","last_unstale":"2024-09-13T17:06:50.410915+0000","last_undegraded":"2024-09-13T17:06:50.410915+0000","last_fullsized":"2024-09-13T17:06:50.410915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:04.672617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407989+0000","last_change":"2024-09-13T17:06:48.454714+0000","last_active":"2024-09-13T17:06:50.407989+0000","last_peered":"2024-09-13T17:06:50.407989+0000","last_clean":"2024-09-13T17:06:50.407989+0000","last_became_active":"2024-09-13T17:06:48.454417+0000","last_became_peered":"2024-09-13T17:06:48.454417+0000","last_unstale":"2024-09-13T17:06:50.407989+0000","last_undegraded":"2024-09-13T17:06:50.407989+0000","last_fullsized":"2024-09-13T17:06:50.407989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:42.518633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408081+0000","last_change":"2024-09-13T17:06:48.075225+0000","last_active":"2024-09-13T17:06:50.408081+0000","last_peered":"2024-09-13T17:06:50.408081+0000","last_clean":"2024-09-13T17:06:50.408081+0000","last_became_active":"2024-09-13T17:06:48.074905+0000","last_became_peered":"2024-09-13T17:06:48.074905+0000","last_unstale":"2024-09-13T17:06:50.408081+0000","last_undegraded":"2024-09-13T17:06:50.408081+0000","last_fullsized":"2024-09-13T17:06:50.408081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:37.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407168+0000","last_change":"2024-09-13T17:06:48.453541+0000","last_active":"2024-09-13T17:06:50.407168+0000","last_peered":"2024-09-13T17:06:50.407168+0000","last_clean":"2024-09-13T17:06:50.407168+0000","last_became_active":"2024-09-13T17:06:48.452960+0000","last_became_peered":"2024-09-13T17:06:48.452960+0000","last_unstale":"2024-09-13T17:06:50.407168+0000","last_undegraded":"2024-09-13T17:06:50.407168+0000","last_fullsized":"2024-09-13T17:06:50.407168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:58.103402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436341+0000","last_change":"2024-09-13T17:06:48.076701+0000","last_active":"2024-09-13T17:06:49.436341+0000","last_peered":"2024-09-13T17:06:49.436341+0000","last_clean":"2024-09-13T17:06:49.436341+0000","last_became_active":"2024-09-13T17:06:48.076518+0000","last_became_peered":"2024-09-13T17:06:48.076518+0000","last_unstale":"2024-09-13T17:06:49.436341+0000","last_undegraded":"2024-09-13T17:06:49.436341+0000","last_fullsized":"2024-09-13T17:06:49.436341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:40.582958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410188+0000","last_change":"2024-09-13T17:06:48.455163+0000","last_active":"2024-09-13T17:06:50.410188+0000","last_peered":"2024-09-13T17:06:50.410188+0000","last_clean":"2024-09-13T17:06:50.410188+0000","last_became_active":"2024-09-13T17:06:48.454898+0000","last_became_peered":"2024-09-13T17:06:48.454898+0000","last_unstale":"2024-09-13T17:06:50.410188+0000","last_undegraded":"2024-09-13T17:06:50.410188+0000","last_fullsized":"2024-09-13T17:06:50.410188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:05.681555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410479+0000","last_change":"2024-09-13T17:06:48.077791+0000","last_active":"2024-09-13T17:06:50.410479+0000","last_peered":"2024-09-13T17:06:50.410479+0000","last_clean":"2024-09-13T17:06:50.410479+0000","last_became_active":"2024-09-13T17:06:48.077473+0000","last_became_peered":"2024-09-13T17:06:48.077473+0000","last_unstale":"2024-09-13T17:06:50.410479+0000","last_undegraded":"2024-09-13T17:06:50.410479+0000","last_fullsized":"2024-09-13T17:06:50.410479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.901813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435648+0000","last_change":"2024-09-13T17:06:48.444878+0000","last_active":"2024-09-13T17:06:49.435648+0000","last_peered":"2024-09-13T17:06:49.435648+0000","last_clean":"2024-09-13T17:06:49.435648+0000","last_became_active":"2024-09-13T17:06:48.444632+0000","last_became_peered":"2024-09-13T17:06:48.444632+0000","last_unstale":"2024-09-13T17:06:49.435648+0000","last_undegraded":"2024-09-13T17:06:49.435648+0000","last_fullsized":"2024-09-13T17:06:49.435648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:59.371861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407365+0000","last_change":"2024-09-13T17:06:48.073405+0000","last_active":"2024-09-13T17:06:50.407365+0000","last_peered":"2024-09-13T17:06:50.407365+0000","last_clean":"2024-09-13T17:06:50.407365+0000","last_became_active":"2024-09-13T17:06:48.073159+0000","last_became_peered":"2024-09-13T17:06:48.073159+0000","last_unstale":"2024-09-13T17:06:50.407365+0000","last_undegraded":"2024-09-13T17:06:50.407365+0000","last_fullsized":"2024-09-13T17:06:50.407365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:27.297703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.406804+0000","last_change":"2024-09-13T17:06:48.437235+0000","last_active":"2024-09-13T17:06:50.406804+0000","last_peered":"2024-09-13T17:06:50.406804+0000","last_clean":"2024-09-13T17:06:50.406804+0000","last_became_active":"2024-09-13T17:06:48.436958+0000","last_became_peered":"2024-09-13T17:06:48.436958+0000","last_unstale":"2024-09-13T17:06:50.406804+0000","last_undegraded":"2024-09-13T17:06:50.406804+0000","last_fullsized":"2024-09-13T17:06:50.406804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:29.305952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409543+0000","last_change":"2024-09-13T17:06:48.078856+0000","last_active":"2024-09-13T17:06:50.409543+0000","last_peered":"2024-09-13T17:06:50.409543+0000","last_clean":"2024-09-13T17:06:50.409543+0000","last_became_active":"2024-09-13T17:06:48.078488+0000","last_became_peered":"2024-09-13T17:06:48.078488+0000","last_unstale":"2024-09-13T17:06:50.409543+0000","last_undegraded":"2024-09-13T17:06:50.409543+0000","last_fullsized":"2024-09-13T17:06:50.409543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:21.835105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435397+0000","last_change":"2024-09-13T17:06:48.452018+0000","last_active":"2024-09-13T17:06:49.435397+0000","last_peered":"2024-09-13T17:06:49.435397+0000","last_clean":"2024-09-13T17:06:49.435397+0000","last_became_active":"2024-09-13T17:06:48.451696+0000","last_became_peered":"2024-09-13T17:06:48.451696+0000","last_unstale":"2024-09-13T17:06:49.435397+0000","last_undegraded":"2024-09-13T17:06:49.435397+0000","last_fullsized":"2024-09-13T17:06:49.435397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:11.126023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407239+0000","last_change":"2024-09-13T17:06:48.074283+0000","last_active":"2024-09-13T17:06:50.407239+0000","last_peered":"2024-09-13T17:06:50.407239+0000","last_clean":"2024-09-13T17:06:50.407239+0000","last_became_active":"2024-09-13T17:06:48.073951+0000","last_became_peered":"2024-09-13T17:06:48.073951+0000","last_unstale":"2024-09-13T17:06:50.407239+0000","last_undegraded":"2024-09-13T17:06:50.407239+0000","last_fullsized":"2024-09-13T17:06:50.407239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:37.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407064+0000","last_change":"2024-09-13T17:06:48.461926+0000","last_active":"2024-09-13T17:06:50.407064+0000","last_peered":"2024-09-13T17:06:50.407064+0000","last_clean":"2024-09-13T17:06:50.407064+0000","last_became_active":"2024-09-13T17:06:48.459158+0000","last_became_peered":"2024-09-13T17:06:48.459158+0000","last_unstale":"2024-09-13T17:06:50.407064+0000","last_undegraded":"2024-09-13T17:06:50.407064+0000","last_fullsized":"2024-09-13T17:06:50.407064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:14.109764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.771778+0000","last_change":"2024-09-13T17:06:48.068609+0000","last_active":"2024-09-13T17:06:49.771778+0000","last_peered":"2024-09-13T17:06:49.771778+0000","last_clean":"2024-09-13T17:06:49.771778+0000","last_became_active":"2024-09-13T17:06:48.068330+0000","last_became_peered":"2024-09-13T17:06:48.068330+0000","last_unstale":"2024-09-13T17:06:49.771778+0000","last_undegraded":"2024-09-13T17:06:49.771778+0000","last_fullsized":"2024-09-13T17:06:49.771778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:33.113560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435060+0000","last_change":"2024-09-13T17:06:48.449596+0000","last_active":"2024-09-13T17:06:49.435060+0000","last_peered":"2024-09-13T17:06:49.435060+0000","last_clean":"2024-09-13T17:06:49.435060+0000","last_became_active":"2024-09-13T17:06:48.449380+0000","last_became_peered":"2024-09-13T17:06:48.449380+0000","last_unstale":"2024-09-13T17:06:49.435060+0000","last_undegraded":"2024-09-13T17:06:49.435060+0000","last_fullsized":"2024-09-13T17:06:49.435060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:29.632832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410271+0000","last_change":"2024-09-13T17:06:48.068519+0000","last_active":"2024-09-13T17:06:50.410271+0000","last_peered":"2024-09-13T17:06:50.410271+0000","last_clean":"2024-09-13T17:06:50.410271+0000","last_became_active":"2024-09-13T17:06:48.068190+0000","last_became_peered":"2024-09-13T17:06:48.068190+0000","last_unstale":"2024-09-13T17:06:50.410271+0000","last_undegraded":"2024-09-13T17:06:50.410271+0000","last_fullsized":"2024-09-13T17:06:50.410271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:47.258496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435847+0000","last_change":"2024-09-13T17:06:48.451887+0000","last_active":"2024-09-13T17:06:49.435847+0000","last_peered":"2024-09-13T17:06:49.435847+0000","last_clean":"2024-09-13T17:06:49.435847+0000","last_became_active":"2024-09-13T17:06:48.451446+0000","last_became_peered":"2024-09-13T17:06:48.451446+0000","last_unstale":"2024-09-13T17:06:49.435847+0000","last_undegraded":"2024-09-13T17:06:49.435847+0000","last_fullsized":"2024-09-13T17:06:49.435847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:13.649151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.772275+0000","last_change":"2024-09-13T17:06:48.074131+0000","last_active":"2024-09-13T17:06:49.772275+0000","last_peered":"2024-09-13T17:06:49.772275+0000","last_clean":"2024-09-13T17:06:49.772275+0000","last_became_active":"2024-09-13T17:06:48.073870+0000","last_became_peered":"2024-09-13T17:06:48.073870+0000","last_unstale":"2024-09-13T17:06:49.772275+0000","last_undegraded":"2024-09-13T17:06:49.772275+0000","last_fullsized":"2024-09-13T17:06:49.772275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436184+0000","last_change":"2024-09-13T17:06:48.451734+0000","last_active":"2024-09-13T17:06:49.436184+0000","last_peered":"2024-09-13T17:06:49.436184+0000","last_clean":"2024-09-13T17:06:49.436184+0000","last_became_active":"2024-09-13T17:06:48.451416+0000","last_became_peered":"2024-09-13T17:06:48.451416+0000","last_unstale":"2024-09-13T17:06:49.436184+0000","last_undegraded":"2024-09-13T17:06:49.436184+0000","last_fullsized":"2024-09-13T17:06:49.436184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:03.550409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436528+0000","last_change":"2024-09-13T17:06:48.072573+0000","last_active":"2024-09-13T17:06:49.436528+0000","last_peered":"2024-09-13T17:06:49.436528+0000","last_clean":"2024-09-13T17:06:49.436528+0000","last_became_active":"2024-09-13T17:06:48.072293+0000","last_became_peered":"2024-09-13T17:06:48.072293+0000","last_unstale":"2024-09-13T17:06:49.436528+0000","last_undegraded":"2024-09-13T17:06:49.436528+0000","last_fullsized":"2024-09-13T17:06:49.436528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408292+0000","last_change":"2024-09-13T17:06:48.453923+0000","last_active":"2024-09-13T17:06:50.408292+0000","last_peered":"2024-09-13T17:06:50.408292+0000","last_clean":"2024-09-13T17:06:50.408292+0000","last_became_active":"2024-09-13T17:06:48.450683+0000","last_became_peered":"2024-09-13T17:06:48.450683+0000","last_unstale":"2024-09-13T17:06:50.408292+0000","last_undegraded":"2024-09-13T17:06:50.408292+0000","last_fullsized":"2024-09-13T17:06:50.408292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:15.339790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.772159+0000","last_change":"2024-09-13T17:06:48.076610+0000","last_active":"2024-09-13T17:06:49.772159+0000","last_peered":"2024-09-13T17:06:49.772159+0000","last_clean":"2024-09-13T17:06:49.772159+0000","last_became_active":"2024-09-13T17:06:48.076280+0000","last_became_peered":"2024-09-13T17:06:48.076280+0000","last_unstale":"2024-09-13T17:06:49.772159+0000","last_undegraded":"2024-09-13T17:06:49.772159+0000","last_fullsized":"2024-09-13T17:06:49.772159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:21.835105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435641+0000","last_change":"2024-09-13T17:06:48.457588+0000","last_active":"2024-09-13T17:06:49.435641+0000","last_peered":"2024-09-13T17:06:49.435641+0000","last_clean":"2024-09-13T17:06:49.435641+0000","last_became_active":"2024-09-13T17:06:48.457308+0000","last_became_peered":"2024-09-13T17:06:48.457308+0000","last_unstale":"2024-09-13T17:06:49.435641+0000","last_undegraded":"2024-09-13T17:06:49.435641+0000","last_fullsized":"2024-09-13T17:06:49.435641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:38.769259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T17:06:48.432560+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:06:48.432560+0000","last_peered":"2024-09-13T17:06:48.432560+0000","last_clean":"2024-09-13T17:06:48.432560+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:06:48.432560+0000","last_undegraded":"2024-09-13T17:06:48.432560+0000","last_fullsized":"2024-09-13T17:06:48.432560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407662+0000","last_change":"2024-09-13T17:06:48.077809+0000","last_active":"2024-09-13T17:06:50.407662+0000","last_peered":"2024-09-13T17:06:50.407662+0000","last_clean":"2024-09-13T17:06:50.407662+0000","last_became_active":"2024-09-13T17:06:48.077535+0000","last_became_peered":"2024-09-13T17:06:48.077535+0000","last_unstale":"2024-09-13T17:06:50.407662+0000","last_undegraded":"2024-09-13T17:06:50.407662+0000","last_fullsized":"2024-09-13T17:06:50.407662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.901813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434996+0000","last_change":"2024-09-13T17:06:48.451309+0000","last_active":"2024-09-13T17:06:49.434996+0000","last_peered":"2024-09-13T17:06:49.434996+0000","last_clean":"2024-09-13T17:06:49.434996+0000","last_became_active":"2024-09-13T17:06:48.451008+0000","last_became_peered":"2024-09-13T17:06:48.451008+0000","last_unstale":"2024-09-13T17:06:49.434996+0000","last_undegraded":"2024-09-13T17:06:49.434996+0000","last_fullsized":"2024-09-13T17:06:49.434996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434768+0000","last_change":"2024-09-13T17:06:48.071142+0000","last_active":"2024-09-13T17:06:49.434768+0000","last_peered":"2024-09-13T17:06:49.434768+0000","last_clean":"2024-09-13T17:06:49.434768+0000","last_became_active":"2024-09-13T17:06:48.070907+0000","last_became_peered":"2024-09-13T17:06:48.070907+0000","last_unstale":"2024-09-13T17:06:49.434768+0000","last_undegraded":"2024-09-13T17:06:49.434768+0000","last_fullsized":"2024-09-13T17:06:49.434768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:28.769904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407097+0000","last_change":"2024-09-13T17:06:48.449924+0000","last_active":"2024-09-13T17:06:50.407097+0000","last_peered":"2024-09-13T17:06:50.407097+0000","last_clean":"2024-09-13T17:06:50.407097+0000","last_became_active":"2024-09-13T17:06:48.449691+0000","last_became_peered":"2024-09-13T17:06:48.449691+0000","last_unstale":"2024-09-13T17:06:50.407097+0000","last_undegraded":"2024-09-13T17:06:50.407097+0000","last_fullsized":"2024-09-13T17:06:50.407097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:31.792088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.772076+0000","last_change":"2024-09-13T17:06:48.074086+0000","last_active":"2024-09-13T17:06:49.772076+0000","last_peered":"2024-09-13T17:06:49.772076+0000","last_clean":"2024-09-13T17:06:49.772076+0000","last_became_active":"2024-09-13T17:06:48.073798+0000","last_became_peered":"2024-09-13T17:06:48.073798+0000","last_unstale":"2024-09-13T17:06:49.772076+0000","last_undegraded":"2024-09-13T17:06:49.772076+0000","last_fullsized":"2024-09-13T17:06:49.772076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:37.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436043+0000","last_change":"2024-09-13T17:06:48.451852+0000","last_active":"2024-09-13T17:06:49.436043+0000","last_peered":"2024-09-13T17:06:49.436043+0000","last_clean":"2024-09-13T17:06:49.436043+0000","last_became_active":"2024-09-13T17:06:48.451614+0000","last_became_peered":"2024-09-13T17:06:48.451614+0000","last_unstale":"2024-09-13T17:06:49.436043+0000","last_undegraded":"2024-09-13T17:06:49.436043+0000","last_fullsized":"2024-09-13T17:06:49.436043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:14.109764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409598+0000","last_change":"2024-09-13T17:06:48.078024+0000","last_active":"2024-09-13T17:06:50.409598+0000","last_peered":"2024-09-13T17:06:50.409598+0000","last_clean":"2024-09-13T17:06:50.409598+0000","last_became_active":"2024-09-13T17:06:48.077753+0000","last_became_peered":"2024-09-13T17:06:48.077753+0000","last_unstale":"2024-09-13T17:06:50.409598+0000","last_undegraded":"2024-09-13T17:06:50.409598+0000","last_fullsized":"2024-09-13T17:06:50.409598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.410107+0000","last_change":"2024-09-13T17:06:48.451352+0000","last_active":"2024-09-13T17:06:50.410107+0000","last_peered":"2024-09-13T17:06:50.410107+0000","last_clean":"2024-09-13T17:06:50.410107+0000","last_became_active":"2024-09-13T17:06:48.450821+0000","last_became_peered":"2024-09-13T17:06:48.450821+0000","last_unstale":"2024-09-13T17:06:50.410107+0000","last_undegraded":"2024-09-13T17:06:50.410107+0000","last_fullsized":"2024-09-13T17:06:50.410107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:17.894980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436587+0000","last_change":"2024-09-13T17:06:48.075452+0000","last_active":"2024-09-13T17:06:49.436587+0000","last_peered":"2024-09-13T17:06:49.436587+0000","last_clean":"2024-09-13T17:06:49.436587+0000","last_became_active":"2024-09-13T17:06:48.075248+0000","last_became_peered":"2024-09-13T17:06:48.075248+0000","last_unstale":"2024-09-13T17:06:49.436587+0000","last_undegraded":"2024-09-13T17:06:49.436587+0000","last_fullsized":"2024-09-13T17:06:49.436587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.901813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408460+0000","last_change":"2024-09-13T17:06:48.453207+0000","last_active":"2024-09-13T17:06:50.408460+0000","last_peered":"2024-09-13T17:06:50.408460+0000","last_clean":"2024-09-13T17:06:50.408460+0000","last_became_active":"2024-09-13T17:06:48.452962+0000","last_became_peered":"2024-09-13T17:06:48.452962+0000","last_unstale":"2024-09-13T17:06:50.408460+0000","last_undegraded":"2024-09-13T17:06:50.408460+0000","last_fullsized":"2024-09-13T17:06:50.408460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435905+0000","last_change":"2024-09-13T17:06:48.075771+0000","last_active":"2024-09-13T17:06:49.435905+0000","last_peered":"2024-09-13T17:06:49.435905+0000","last_clean":"2024-09-13T17:06:49.435905+0000","last_became_active":"2024-09-13T17:06:48.075410+0000","last_became_peered":"2024-09-13T17:06:48.075410+0000","last_unstale":"2024-09-13T17:06:49.435905+0000","last_undegraded":"2024-09-13T17:06:49.435905+0000","last_fullsized":"2024-09-13T17:06:49.435905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:40.582958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436377+0000","last_change":"2024-09-13T17:06:48.451971+0000","last_active":"2024-09-13T17:06:49.436377+0000","last_peered":"2024-09-13T17:06:49.436377+0000","last_clean":"2024-09-13T17:06:49.436377+0000","last_became_active":"2024-09-13T17:06:48.451110+0000","last_became_peered":"2024-09-13T17:06:48.451110+0000","last_unstale":"2024-09-13T17:06:49.436377+0000","last_undegraded":"2024-09-13T17:06:49.436377+0000","last_fullsized":"2024-09-13T17:06:49.436377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:46.353437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:51.811326+0000","last_change":"2024-09-13T17:06:48.071158+0000","last_active":"2024-09-13T17:06:51.811326+0000","last_peered":"2024-09-13T17:06:51.811326+0000","last_clean":"2024-09-13T17:06:51.811326+0000","last_became_active":"2024-09-13T17:06:48.070810+0000","last_became_peered":"2024-09-13T17:06:48.070810+0000","last_unstale":"2024-09-13T17:06:51.811326+0000","last_undegraded":"2024-09-13T17:06:51.811326+0000","last_fullsized":"2024-09-13T17:06:51.811326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:37.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435802+0000","last_change":"2024-09-13T17:06:48.439765+0000","last_active":"2024-09-13T17:06:49.435802+0000","last_peered":"2024-09-13T17:06:49.435802+0000","last_clean":"2024-09-13T17:06:49.435802+0000","last_became_active":"2024-09-13T17:06:48.439486+0000","last_became_peered":"2024-09-13T17:06:48.439486+0000","last_unstale":"2024-09-13T17:06:49.435802+0000","last_undegraded":"2024-09-13T17:06:49.435802+0000","last_fullsized":"2024-09-13T17:06:49.435802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:05.681555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.411021+0000","last_change":"2024-09-13T17:06:48.072147+0000","last_active":"2024-09-13T17:06:50.411021+0000","last_peered":"2024-09-13T17:06:50.411021+0000","last_clean":"2024-09-13T17:06:50.411021+0000","last_became_active":"2024-09-13T17:06:48.070889+0000","last_became_peered":"2024-09-13T17:06:48.070889+0000","last_unstale":"2024-09-13T17:06:50.411021+0000","last_undegraded":"2024-09-13T17:06:50.411021+0000","last_fullsized":"2024-09-13T17:06:50.411021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:32.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.406902+0000","last_change":"2024-09-13T17:06:48.451274+0000","last_active":"2024-09-13T17:06:50.406902+0000","last_peered":"2024-09-13T17:06:50.406902+0000","last_clean":"2024-09-13T17:06:50.406902+0000","last_became_active":"2024-09-13T17:06:48.450991+0000","last_became_peered":"2024-09-13T17:06:48.450991+0000","last_unstale":"2024-09-13T17:06:50.406902+0000","last_undegraded":"2024-09-13T17:06:50.406902+0000","last_fullsized":"2024-09-13T17:06:50.406902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:49.807985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434636+0000","last_change":"2024-09-13T17:06:48.068959+0000","last_active":"2024-09-13T17:06:49.434636+0000","last_peered":"2024-09-13T17:06:49.434636+0000","last_clean":"2024-09-13T17:06:49.434636+0000","last_became_active":"2024-09-13T17:06:48.068731+0000","last_became_peered":"2024-09-13T17:06:48.068731+0000","last_unstale":"2024-09-13T17:06:49.434636+0000","last_undegraded":"2024-09-13T17:06:49.434636+0000","last_fullsized":"2024-09-13T17:06:49.434636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.901813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.409333+0000","last_change":"2024-09-13T17:06:48.453284+0000","last_active":"2024-09-13T17:06:50.409333+0000","last_peered":"2024-09-13T17:06:50.409333+0000","last_clean":"2024-09-13T17:06:50.409333+0000","last_became_active":"2024-09-13T17:06:48.452958+0000","last_became_peered":"2024-09-13T17:06:48.452958+0000","last_unstale":"2024-09-13T17:06:50.409333+0000","last_undegraded":"2024-09-13T17:06:50.409333+0000","last_fullsized":"2024-09-13T17:06:50.409333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:47.910751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436208+0000","last_change":"2024-09-13T17:06:48.070145+0000","last_active":"2024-09-13T17:06:49.436208+0000","last_peered":"2024-09-13T17:06:49.436208+0000","last_clean":"2024-09-13T17:06:49.436208+0000","last_became_active":"2024-09-13T17:06:48.069900+0000","last_became_peered":"2024-09-13T17:06:48.069900+0000","last_unstale":"2024-09-13T17:06:49.436208+0000","last_undegraded":"2024-09-13T17:06:49.436208+0000","last_fullsized":"2024-09-13T17:06:49.436208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:04.672617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434540+0000","last_change":"2024-09-13T17:06:48.452279+0000","last_active":"2024-09-13T17:06:49.434540+0000","last_peered":"2024-09-13T17:06:49.434540+0000","last_clean":"2024-09-13T17:06:49.434540+0000","last_became_active":"2024-09-13T17:06:48.452031+0000","last_became_peered":"2024-09-13T17:06:48.452031+0000","last_unstale":"2024-09-13T17:06:49.434540+0000","last_undegraded":"2024-09-13T17:06:49.434540+0000","last_fullsized":"2024-09-13T17:06:49.434540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:05.801080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.436702+0000","last_change":"2024-09-13T17:06:48.078695+0000","last_active":"2024-09-13T17:06:49.436702+0000","last_peered":"2024-09-13T17:06:49.436702+0000","last_clean":"2024-09-13T17:06:49.436702+0000","last_became_active":"2024-09-13T17:06:48.078373+0000","last_became_peered":"2024-09-13T17:06:48.078373+0000","last_unstale":"2024-09-13T17:06:49.436702+0000","last_undegraded":"2024-09-13T17:06:49.436702+0000","last_fullsized":"2024-09-13T17:06:49.436702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:21.835105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.434967+0000","last_change":"2024-09-13T17:06:48.438583+0000","last_active":"2024-09-13T17:06:49.434967+0000","last_peered":"2024-09-13T17:06:49.434967+0000","last_clean":"2024-09-13T17:06:49.434967+0000","last_became_active":"2024-09-13T17:06:48.438322+0000","last_became_peered":"2024-09-13T17:06:48.438322+0000","last_unstale":"2024-09-13T17:06:49.434967+0000","last_undegraded":"2024-09-13T17:06:49.434967+0000","last_fullsized":"2024-09-13T17:06:49.434967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:59.415579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435417+0000","last_change":"2024-09-13T17:06:48.072310+0000","last_active":"2024-09-13T17:06:49.435417+0000","last_peered":"2024-09-13T17:06:49.435417+0000","last_clean":"2024-09-13T17:06:49.435417+0000","last_became_active":"2024-09-13T17:06:48.072034+0000","last_became_peered":"2024-09-13T17:06:48.072034+0000","last_unstale":"2024-09-13T17:06:49.435417+0000","last_undegraded":"2024-09-13T17:06:49.435417+0000","last_fullsized":"2024-09-13T17:06:49.435417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:21.835105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407378+0000","last_change":"2024-09-13T17:06:48.459811+0000","last_active":"2024-09-13T17:06:50.407378+0000","last_peered":"2024-09-13T17:06:50.407378+0000","last_clean":"2024-09-13T17:06:50.407378+0000","last_became_active":"2024-09-13T17:06:48.459495+0000","last_became_peered":"2024-09-13T17:06:48.459495+0000","last_unstale":"2024-09-13T17:06:50.407378+0000","last_undegraded":"2024-09-13T17:06:50.407378+0000","last_fullsized":"2024-09-13T17:06:50.407378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:58.103402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408388+0000","last_change":"2024-09-13T17:06:48.456637+0000","last_active":"2024-09-13T17:06:50.408388+0000","last_peered":"2024-09-13T17:06:50.408388+0000","last_clean":"2024-09-13T17:06:50.408388+0000","last_became_active":"2024-09-13T17:06:48.454834+0000","last_became_peered":"2024-09-13T17:06:48.454834+0000","last_unstale":"2024-09-13T17:06:50.408388+0000","last_undegraded":"2024-09-13T17:06:50.408388+0000","last_fullsized":"2024-09-13T17:06:50.408388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:29.632832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435532+0000","last_change":"2024-09-13T17:06:48.076407+0000","last_active":"2024-09-13T17:06:49.435532+0000","last_peered":"2024-09-13T17:06:49.435532+0000","last_clean":"2024-09-13T17:06:49.435532+0000","last_became_active":"2024-09-13T17:06:48.076136+0000","last_became_peered":"2024-09-13T17:06:48.076136+0000","last_unstale":"2024-09-13T17:06:49.435532+0000","last_undegraded":"2024-09-13T17:06:49.435532+0000","last_fullsized":"2024-09-13T17:06:49.435532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:04.672617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.408258+0000","last_change":"2024-09-13T17:06:48.457607+0000","last_active":"2024-09-13T17:06:50.408258+0000","last_peered":"2024-09-13T17:06:50.408258+0000","last_clean":"2024-09-13T17:06:50.408258+0000","last_became_active":"2024-09-13T17:06:48.457325+0000","last_became_peered":"2024-09-13T17:06:48.457325+0000","last_unstale":"2024-09-13T17:06:50.408258+0000","last_undegraded":"2024-09-13T17:06:50.408258+0000","last_fullsized":"2024-09-13T17:06:50.408258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:59.371861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435762+0000","last_change":"2024-09-13T17:06:48.072948+0000","last_active":"2024-09-13T17:06:49.435762+0000","last_peered":"2024-09-13T17:06:49.435762+0000","last_clean":"2024-09-13T17:06:49.435762+0000","last_became_active":"2024-09-13T17:06:48.072466+0000","last_became_peered":"2024-09-13T17:06:48.072466+0000","last_unstale":"2024-09-13T17:06:49.435762+0000","last_undegraded":"2024-09-13T17:06:49.435762+0000","last_fullsized":"2024-09-13T17:06:49.435762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:16.886041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407035+0000","last_change":"2024-09-13T17:06:48.452786+0000","last_active":"2024-09-13T17:06:50.407035+0000","last_peered":"2024-09-13T17:06:50.407035+0000","last_clean":"2024-09-13T17:06:50.407035+0000","last_became_active":"2024-09-13T17:06:48.452536+0000","last_became_peered":"2024-09-13T17:06:48.452536+0000","last_unstale":"2024-09-13T17:06:50.407035+0000","last_undegraded":"2024-09-13T17:06:50.407035+0000","last_fullsized":"2024-09-13T17:06:50.407035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:11.510862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435770+0000","last_change":"2024-09-13T17:06:48.073581+0000","last_active":"2024-09-13T17:06:49.435770+0000","last_peered":"2024-09-13T17:06:49.435770+0000","last_clean":"2024-09-13T17:06:49.435770+0000","last_became_active":"2024-09-13T17:06:48.073283+0000","last_became_peered":"2024-09-13T17:06:48.073283+0000","last_unstale":"2024-09-13T17:06:49.435770+0000","last_undegraded":"2024-09-13T17:06:49.435770+0000","last_fullsized":"2024-09-13T17:06:49.435770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:11.933089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:49.435693+0000","last_change":"2024-09-13T17:06:48.461028+0000","last_active":"2024-09-13T17:06:49.435693+0000","last_peered":"2024-09-13T17:06:49.435693+0000","last_clean":"2024-09-13T17:06:49.435693+0000","last_became_active":"2024-09-13T17:06:48.460777+0000","last_became_peered":"2024-09-13T17:06:48.460777+0000","last_unstale":"2024-09-13T17:06:49.435693+0000","last_undegraded":"2024-09-13T17:06:49.435693+0000","last_fullsized":"2024-09-13T17:06:49.435693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:48.044666+0000","last_clean_scrub_stamp":"2024-09-13T17:06:48.044666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:59.371861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T17:06:50.407296+0000","last_change":"2024-09-13T17:06:48.079106+0000","last_active":"2024-09-13T17:06:50.407296+0000","last_peered":"2024-09-13T17:06:50.407296+0000","last_clean":"2024-09-13T17:06:50.407296+0000","last_became_active":"2024-09-13T17:06:48.078850+0000","last_became_peered":"2024-09-13T17:06:48.078850+0000","last_unstale":"2024-09-13T17:06:50.407296+0000","last_undegraded":"2024-09-13T17:06:50.407296+0000","last_fullsized":"2024-09-13T17:06:50.407296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:47.035728+0000","last_clean_scrub_stamp":"2024-09-13T17:06:47.035728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:47.258496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:06:56.809 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T17:06:56.809 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T17:06:56.810 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T17:06:56.810 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T17:06:56.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.906+0000 7fb3f30a4700 1 Processor -- start 2024-09-13T17:06:56.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.906+0000 7fb3f30a4700 1 -- start start 2024-09-13T17:06:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.906+0000 7fb3f30a4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3ec0cd090 0x7fb3ec0b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.906+0000 7fb3f30a4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3ec0b1af0 0x7fb3ec0c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.906+0000 7fb3f30a4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ec0b1f30 con 0x7fb3ec1612c0 2024-09-13T17:06:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.906+0000 7fb3f30a4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ec1616a0 con 0x7fb3ec0cd090 2024-09-13T17:06:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.906+0000 7fb3f30a4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec06e090 con 0x7fb3ec0b1af0 2024-09-13T17:06:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3ebfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3ec0cd090 0x7fb3ec0b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f1641700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3ec0b1af0 0x7fb3ec0c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3ebfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3ec0cd090 0x7fb3ec0b15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:37596/0 (socket says 172.21.15.123:37596) 2024-09-13T17:06:56.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3ebfff700 1 -- 172.21.15.123:0/2786905856 learned_addr learned my addr 172.21.15.123:0/2786905856 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:56.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f0e40700 1 --1- 172.21.15.123:0/2786905856 >> v1:172.21.15.153:6789/0 conn(0x7fb3ec1612c0 0x7fb3ec06d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:48462/0 (socket says 172.21.15.123:48462) 2024-09-13T17:06:56.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f1641700 1 -- 172.21.15.123:0/2786905856 >> v2:172.21.15.153:3300/0 conn(0x7fb3ec0cd090 msgr2=0x7fb3ec0b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:56.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f1641700 1 --2- 172.21.15.123:0/2786905856 >> v2:172.21.15.153:3300/0 conn(0x7fb3ec0cd090 0x7fb3ec0b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f1641700 1 -- 172.21.15.123:0/2786905856 >> v1:172.21.15.153:6789/0 conn(0x7fb3ec1612c0 legacy=0x7fb3ec06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f1641700 1 -- 172.21.15.123:0/2786905856 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec0cc2d0 con 0x7fb3ec0b1af0 2024-09-13T17:06:56.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f1641700 1 --2- 172.21.15.123:0/2786905856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3ec0b1af0 0x7fb3ec0c4890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009d90 tx=0x7fb3e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84488fa55e7d47ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:56.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3eb7fe700 1 -- 172.21.15.123:0/2786905856 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400e070 con 0x7fb3ec0b1af0 2024-09-13T17:06:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3eb7fe700 1 -- 172.21.15.123:0/2786905856 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e400bb20 con 0x7fb3ec0b1af0 2024-09-13T17:06:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3eb7fe700 1 -- 172.21.15.123:0/2786905856 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4012430 con 0x7fb3ec0b1af0 2024-09-13T17:06:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f30a4700 1 -- 172.21.15.123:0/2786905856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3ec0b1af0 msgr2=0x7fb3ec0c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f30a4700 1 --2- 172.21.15.123:0/2786905856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3ec0b1af0 0x7fb3ec0c4890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009d90 tx=0x7fb3e400b330 comp rx=0 tx=0).stop 2024-09-13T17:06:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f30a4700 1 -- 172.21.15.123:0/2786905856 shutdown_connections 2024-09-13T17:06:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f30a4700 1 --2- 172.21.15.123:0/2786905856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3ec0b1af0 0x7fb3ec0c4890 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f30a4700 1 --2- 172.21.15.123:0/2786905856 >> v2:172.21.15.153:3300/0 conn(0x7fb3ec0cd090 0x7fb3ec0b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f30a4700 1 -- 172.21.15.123:0/2786905856 >> 172.21.15.123:0/2786905856 conn(0x7fb3ec06a6b0 msgr2=0x7fb3ec066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f30a4700 1 -- 172.21.15.123:0/2786905856 shutdown_connections 2024-09-13T17:06:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f30a4700 1 -- 172.21.15.123:0/2786905856 wait complete. 2024-09-13T17:06:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f30a4700 1 Processor -- start 2024-09-13T17:06:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.910+0000 7fb3f30a4700 1 -- start start 2024-09-13T17:06:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3f30a4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3ec0b1af0 0x7fb3ec1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3f30a4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3ec0cd090 0x7fb3ec163e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3f30a4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3ec1612c0 0x7fb3ec143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3f30a4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec1557e0 con 0x7fb3ec0cd090 2024-09-13T17:06:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3f30a4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec156590 con 0x7fb3ec0b1af0 2024-09-13T17:06:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3f30a4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec155a10 con 0x7fb3ec1612c0 2024-09-13T17:06:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3ebfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3ec0cd090 0x7fb3ec163e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3ebfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3ec0cd090 0x7fb3ec163e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46728/0 (socket says 172.21.15.123:46728) 2024-09-13T17:06:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3ebfff700 1 -- 172.21.15.123:0/4210931155 learned_addr learned my addr 172.21.15.123:0/4210931155 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3f1641700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3ec1612c0 0x7fb3ec143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3f0e40700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3ec0b1af0 0x7fb3ec1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3ebfff700 1 -- 172.21.15.123:0/4210931155 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3ec1612c0 msgr2=0x7fb3ec143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3ebfff700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3ec1612c0 0x7fb3ec143a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3ebfff700 1 -- 172.21.15.123:0/4210931155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3ec0b1af0 msgr2=0x7fb3ec1552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3ebfff700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3ec0b1af0 0x7fb3ec1552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3ebfff700 1 -- 172.21.15.123:0/4210931155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e4009a70 con 0x7fb3ec0cd090 2024-09-13T17:06:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3f1641700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3ec1612c0 0x7fb3ec143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3ebfff700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3ec0cd090 0x7fb3ec163e90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc00e930 tx=0x7fb3dc00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3e97fa700 1 -- 172.21.15.123:0/4210931155 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0096c0 con 0x7fb3ec0cd090 2024-09-13T17:06:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3f30a4700 1 -- 172.21.15.123:0/4210931155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ec155cf0 con 0x7fb3ec0cd090 2024-09-13T17:06:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3e97fa700 1 -- 172.21.15.123:0/4210931155 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3dc00c850 con 0x7fb3ec0cd090 2024-09-13T17:06:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3e97fa700 1 -- 172.21.15.123:0/4210931155 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc00cc00 con 0x7fb3ec0cd090 2024-09-13T17:06:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3f30a4700 1 -- 172.21.15.123:0/4210931155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ec1562b0 con 0x7fb3ec0cd090 2024-09-13T17:06:56.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3f30a4700 1 -- 172.21.15.123:0/4210931155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ec0d05b0 con 0x7fb3ec0cd090 2024-09-13T17:06:56.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.914+0000 7fb3e97fa700 1 -- 172.21.15.123:0/4210931155 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb3dc00cd60 con 0x7fb3ec0cd090 2024-09-13T17:06:56.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.918+0000 7fb3e97fa700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb3d8066730 0x7fb3d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:56.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.918+0000 7fb3e97fa700 1 -- 172.21.15.123:0/4210931155 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3dc084200 con 0x7fb3ec0cd090 2024-09-13T17:06:56.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.918+0000 7fb3f0e40700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb3d8066730 0x7fb3d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:56.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.918+0000 7fb3f0e40700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb3d8066730 0x7fb3d8068bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0000f60 tx=0x7fb3e0007d30 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:56.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:56.922+0000 7fb3e97fa700 1 -- 172.21.15.123:0/4210931155 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb3dc051580 con 0x7fb3ec0cd090 2024-09-13T17:06:57.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.106+0000 7fb3f30a4700 1 -- 172.21.15.123:0/4210931155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb3ec0c6260 con 0x7fb3ec0cd090 2024-09-13T17:06:57.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.106+0000 7fb3e97fa700 1 -- 172.21.15.123:0/4210931155 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb3dc054ba0 con 0x7fb3ec0cd090 2024-09-13T17:06:57.114 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:57.114 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T17:06:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.110+0000 7fb3f30a4700 1 -- 172.21.15.123:0/4210931155 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb3d8066730 msgr2=0x7fb3d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.110+0000 7fb3f30a4700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb3d8066730 0x7fb3d8068bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0000f60 tx=0x7fb3e0007d30 comp rx=0 tx=0).stop 2024-09-13T17:06:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.110+0000 7fb3f30a4700 1 -- 172.21.15.123:0/4210931155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3ec0cd090 msgr2=0x7fb3ec163e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.110+0000 7fb3f30a4700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3ec0cd090 0x7fb3ec163e90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc00e930 tx=0x7fb3dc00ecf0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.110+0000 7fb3f30a4700 1 -- 172.21.15.123:0/4210931155 shutdown_connections 2024-09-13T17:06:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.110+0000 7fb3f30a4700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb3d8066730 0x7fb3d8068bf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.110+0000 7fb3f30a4700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3ec1612c0 0x7fb3ec143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.110+0000 7fb3f30a4700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3ec0cd090 0x7fb3ec163e90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.110+0000 7fb3f30a4700 1 --2- 172.21.15.123:0/4210931155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3ec0b1af0 0x7fb3ec1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.110+0000 7fb3f30a4700 1 -- 172.21.15.123:0/4210931155 >> 172.21.15.123:0/4210931155 conn(0x7fb3ec06a6b0 msgr2=0x7fb3ec15f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:57.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.110+0000 7fb3f30a4700 1 -- 172.21.15.123:0/4210931155 shutdown_connections 2024-09-13T17:06:57.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.110+0000 7fb3f30a4700 1 -- 172.21.15.123:0/4210931155 wait complete. 2024-09-13T17:06:57.127 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T17:06:57.127 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:06:57.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.222+0000 7f6e4560a700 1 Processor -- start 2024-09-13T17:06:57.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.222+0000 7f6e4560a700 1 -- start start 2024-09-13T17:06:57.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.222+0000 7f6e4560a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6e380e18c0 0x7f6e3801ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.222+0000 7f6e4560a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e38006ce0 con 0x7f6e3800a5b0 2024-09-13T17:06:57.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.222+0000 7f6e4560a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e380060d0 con 0x7f6e38005b10 2024-09-13T17:06:57.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.222+0000 7f6e4560a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e380063b0 con 0x7f6e380e18c0 2024-09-13T17:06:57.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.222+0000 7f6e44e09700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6e380e18c0 0x7f6e3801ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.222+0000 7f6e3ffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6e3800a5b0 0x7f6e3800a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49258/0 (socket says 172.21.15.123:49258) 2024-09-13T17:06:57.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.222+0000 7f6e3ffff700 1 -- 172.21.15.123:0/1443902050 learned_addr learned my addr 172.21.15.123:0/1443902050 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:57.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.226+0000 7f6e44e09700 1 -- 172.21.15.123:0/1443902050 >> v1:172.21.15.153:6789/0 conn(0x7f6e38005b10 legacy=0x7f6e3801c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:57.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.226+0000 7f6e44e09700 1 -- 172.21.15.123:0/1443902050 >> v1:172.21.15.123:6789/0 conn(0x7f6e3800a5b0 legacy=0x7f6e3800a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.226+0000 7f6e44e09700 1 -- 172.21.15.123:0/1443902050 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e38006690 con 0x7f6e380e18c0 2024-09-13T17:06:57.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.226+0000 7f6e44e09700 1 --2- 172.21.15.123:0/1443902050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e380e18c0 0x7f6e3801ce50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009850 tx=0x7f6e34009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c56a2fb267344ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:57.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.226+0000 7f6e3effd700 1 -- 172.21.15.123:0/1443902050 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34004230 con 0x7f6e380e18c0 2024-09-13T17:06:57.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.226+0000 7f6e3effd700 1 -- 172.21.15.123:0/1443902050 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e34004390 con 0x7f6e380e18c0 2024-09-13T17:06:57.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.226+0000 7f6e3effd700 1 -- 172.21.15.123:0/1443902050 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e340036c0 con 0x7f6e380e18c0 2024-09-13T17:06:57.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.226+0000 7f6e4560a700 1 -- 172.21.15.123:0/1443902050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e380e18c0 msgr2=0x7f6e3801ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.226+0000 7f6e4560a700 1 --2- 172.21.15.123:0/1443902050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e380e18c0 0x7f6e3801ce50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009850 tx=0x7f6e34009b60 comp rx=0 tx=0).stop 2024-09-13T17:06:57.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.226+0000 7f6e4560a700 1 -- 172.21.15.123:0/1443902050 shutdown_connections 2024-09-13T17:06:57.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.226+0000 7f6e4560a700 1 --2- 172.21.15.123:0/1443902050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e380e18c0 0x7f6e3801ce50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.226+0000 7f6e4560a700 1 -- 172.21.15.123:0/1443902050 >> 172.21.15.123:0/1443902050 conn(0x7f6e38036140 msgr2=0x7f6e38036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.226+0000 7f6e4560a700 1 -- 172.21.15.123:0/1443902050 shutdown_connections 2024-09-13T17:06:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.226+0000 7f6e4560a700 1 -- 172.21.15.123:0/1443902050 wait complete. 2024-09-13T17:06:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e4560a700 1 Processor -- start 2024-09-13T17:06:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e4560a700 1 -- start start 2024-09-13T17:06:57.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e4560a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e38005b10 0x7f6e38179a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e4560a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e3800a5b0 0x7f6e3804dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e4560a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e380e18c0 0x7f6e38031f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e4560a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e38049370 con 0x7f6e3800a5b0 2024-09-13T17:06:57.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e4560a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3804a350 con 0x7f6e380e18c0 2024-09-13T17:06:57.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e4560a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3804a5f0 con 0x7f6e38005b10 2024-09-13T17:06:57.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e3f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e3800a5b0 0x7f6e3804dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e3f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e3800a5b0 0x7f6e3804dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46746/0 (socket says 172.21.15.123:46746) 2024-09-13T17:06:57.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/899971152 learned_addr learned my addr 172.21.15.123:0/899971152 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:57.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e3ffff700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e38005b10 0x7f6e38179a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/899971152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e38005b10 msgr2=0x7f6e38179a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e3f7fe700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e38005b10 0x7f6e38179a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e44e09700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e380e18c0 0x7f6e38031f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/899971152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e380e18c0 msgr2=0x7f6e38031f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e3f7fe700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e380e18c0 0x7f6e38031f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/899971152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e340094b0 con 0x7f6e3800a5b0 2024-09-13T17:06:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e44e09700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e380e18c0 0x7f6e38031f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:06:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e3f7fe700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e3800a5b0 0x7f6e3804dee0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00b4a0 tx=0x7f6e2c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e3cff9700 1 -- 172.21.15.123:0/899971152 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c011830 con 0x7f6e3800a5b0 2024-09-13T17:06:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e3cff9700 1 -- 172.21.15.123:0/899971152 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c011990 con 0x7f6e3800a5b0 2024-09-13T17:06:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e3cff9700 1 -- 172.21.15.123:0/899971152 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c011d40 con 0x7f6e3800a5b0 2024-09-13T17:06:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e4560a700 1 -- 172.21.15.123:0/899971152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3804a8d0 con 0x7f6e3800a5b0 2024-09-13T17:06:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.230+0000 7f6e4560a700 1 -- 172.21.15.123:0/899971152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3804b730 con 0x7f6e3800a5b0 2024-09-13T17:06:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.234+0000 7f6e4560a700 1 -- 172.21.15.123:0/899971152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e3804b950 con 0x7f6e3800a5b0 2024-09-13T17:06:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.234+0000 7f6e3cff9700 1 -- 172.21.15.123:0/899971152 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e2c01a400 con 0x7f6e3800a5b0 2024-09-13T17:06:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.234+0000 7f6e3cff9700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6e24066730 0x7f6e24068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.234+0000 7f6e3ffff700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6e24066730 0x7f6e24068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.234+0000 7f6e3cff9700 1 -- 172.21.15.123:0/899971152 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e2c083df0 con 0x7f6e3800a5b0 2024-09-13T17:06:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.234+0000 7f6e3ffff700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6e24066730 0x7f6e24068bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6e40000b60 tx=0x7f6e400696b0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.242+0000 7f6e3cff9700 1 -- 172.21.15.123:0/899971152 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6e2c0511f0 con 0x7f6e3800a5b0 2024-09-13T17:06:57.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.394+0000 7f6e4560a700 1 -- 172.21.15.123:0/899971152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e3800a990 con 0x7f6e3800a5b0 2024-09-13T17:06:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.398+0000 7f6e3cff9700 1 -- 172.21.15.123:0/899971152 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f6e2c054810 con 0x7f6e3800a5b0 2024-09-13T17:06:57.402 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:57.402 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:06:57.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.398+0000 7f6e4560a700 1 -- 172.21.15.123:0/899971152 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6e24066730 msgr2=0x7f6e24068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.398+0000 7f6e4560a700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6e24066730 0x7f6e24068bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6e40000b60 tx=0x7f6e400696b0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.398+0000 7f6e4560a700 1 -- 172.21.15.123:0/899971152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e3800a5b0 msgr2=0x7f6e3804dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.398+0000 7f6e4560a700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e3800a5b0 0x7f6e3804dee0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00b4a0 tx=0x7f6e2c00b860 comp rx=0 tx=0).stop 2024-09-13T17:06:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.398+0000 7f6e4560a700 1 -- 172.21.15.123:0/899971152 shutdown_connections 2024-09-13T17:06:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.398+0000 7f6e4560a700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6e24066730 0x7f6e24068bf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.398+0000 7f6e4560a700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e380e18c0 0x7f6e38031f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.398+0000 7f6e4560a700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e3800a5b0 0x7f6e3804dee0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.398+0000 7f6e4560a700 1 --2- 172.21.15.123:0/899971152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e38005b10 0x7f6e38179a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.398+0000 7f6e4560a700 1 -- 172.21.15.123:0/899971152 >> 172.21.15.123:0/899971152 conn(0x7f6e38036140 msgr2=0x7f6e380d8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.398+0000 7f6e4560a700 1 -- 172.21.15.123:0/899971152 shutdown_connections 2024-09-13T17:06:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.398+0000 7f6e4560a700 1 -- 172.21.15.123:0/899971152 wait complete. 2024-09-13T17:06:57.416 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:06:57.416 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:06:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.518+0000 7f1faad1b700 1 Processor -- start 2024-09-13T17:06:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.518+0000 7f1faad1b700 1 -- start start 2024-09-13T17:06:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1faad1b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1fa40cb7e0 0x7f1fa40c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1faad1b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1fa406bdb0 0x7f1fa4071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1faad1b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa40ca750 con 0x7f1fa40c1480 2024-09-13T17:06:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1faad1b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa40c9210 con 0x7f1fa406bdb0 2024-09-13T17:06:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1faad1b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa41617b0 con 0x7f1fa40cb7e0 2024-09-13T17:06:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1fa9518700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1fa406bdb0 0x7f1fa4071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1fa9518700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1fa406bdb0 0x7f1fa4071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46758/0 (socket says 172.21.15.123:46758) 2024-09-13T17:06:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1fa9518700 1 -- 172.21.15.123:0/4064616910 learned_addr learned my addr 172.21.15.123:0/4064616910 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1fa9d19700 1 --2- 172.21.15.123:0/4064616910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1fa40cb7e0 0x7f1fa40c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1fa9518700 1 -- 172.21.15.123:0/4064616910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1fa40cb7e0 msgr2=0x7f1fa40c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1fa9518700 1 --2- 172.21.15.123:0/4064616910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1fa40cb7e0 0x7f1fa40c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1fa9518700 1 -- 172.21.15.123:0/4064616910 >> v1:172.21.15.153:6789/0 conn(0x7f1fa40c1480 legacy=0x7f1fa40706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1fa9518700 1 -- 172.21.15.123:0/4064616910 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa40cbbc0 con 0x7f1fa406bdb0 2024-09-13T17:06:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1fa9d19700 1 --2- 172.21.15.123:0/4064616910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1fa40cb7e0 0x7f1fa40c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:06:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1fa9518700 1 --2- 172.21.15.123:0/4064616910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fa406bdb0 0x7f1fa4071b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0009910 tx=0x7f1fa0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973992002c5cdc4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1fa8d17700 1 -- 172.21.15.123:0/4064616910 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0004230 con 0x7f1fa406bdb0 2024-09-13T17:06:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1fa8d17700 1 -- 172.21.15.123:0/4064616910 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa0004390 con 0x7f1fa406bdb0 2024-09-13T17:06:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1fa8d17700 1 -- 172.21.15.123:0/4064616910 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0009e60 con 0x7f1fa406bdb0 2024-09-13T17:06:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1faad1b700 1 -- 172.21.15.123:0/4064616910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fa406bdb0 msgr2=0x7f1fa4071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1faad1b700 1 --2- 172.21.15.123:0/4064616910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fa406bdb0 0x7f1fa4071b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0009910 tx=0x7f1fa0009c20 comp rx=0 tx=0).stop 2024-09-13T17:06:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1faad1b700 1 -- 172.21.15.123:0/4064616910 shutdown_connections 2024-09-13T17:06:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1faad1b700 1 --2- 172.21.15.123:0/4064616910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fa406bdb0 0x7f1fa4071b50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1faad1b700 1 --2- 172.21.15.123:0/4064616910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1fa40cb7e0 0x7f1fa40c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1faad1b700 1 -- 172.21.15.123:0/4064616910 >> 172.21.15.123:0/4064616910 conn(0x7f1fa40b01d0 msgr2=0x7f1fa40b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1faad1b700 1 -- 172.21.15.123:0/4064616910 shutdown_connections 2024-09-13T17:06:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.522+0000 7f1faad1b700 1 -- 172.21.15.123:0/4064616910 wait complete. 2024-09-13T17:06:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1faad1b700 1 Processor -- start 2024-09-13T17:06:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1faad1b700 1 -- start start 2024-09-13T17:06:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1faad1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fa40c1480 0x7f1fa415bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1faad1b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fa40cb7e0 0x7f1fa414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1faad1b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1fa415dd00 0x7f1fa415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1faad1b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa40c3ef0 con 0x7f1fa40cb7e0 2024-09-13T17:06:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1faad1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa415ef10 con 0x7f1fa40c1480 2024-09-13T17:06:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1faad1b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa40c3830 con 0x7f1fa415dd00 2024-09-13T17:06:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1fa9518700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fa40cb7e0 0x7f1fa414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1fa9518700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fa40cb7e0 0x7f1fa414ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46766/0 (socket says 172.21.15.123:46766) 2024-09-13T17:06:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1fa9518700 1 -- 172.21.15.123:0/1268503813 learned_addr learned my addr 172.21.15.123:0/1268503813 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1faa51a700 1 --2- 172.21.15.123:0/1268503813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1fa415dd00 0x7f1fa415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1fa9d19700 1 --2- 172.21.15.123:0/1268503813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fa40c1480 0x7f1fa415bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1fa9518700 1 -- 172.21.15.123:0/1268503813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1fa415dd00 msgr2=0x7f1fa415e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1fa9518700 1 --2- 172.21.15.123:0/1268503813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1fa415dd00 0x7f1fa415e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1fa9518700 1 -- 172.21.15.123:0/1268503813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fa40c1480 msgr2=0x7f1fa415bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1fa9518700 1 --2- 172.21.15.123:0/1268503813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fa40c1480 0x7f1fa415bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1fa9518700 1 -- 172.21.15.123:0/1268503813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa0009570 con 0x7f1fa40cb7e0 2024-09-13T17:06:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1fa9518700 1 --2- 172.21.15.123:0/1268503813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fa40cb7e0 0x7f1fa414ea90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0000c00 tx=0x7f1fa0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1f9a7fc700 1 -- 172.21.15.123:0/1268503813 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa000bc10 con 0x7f1fa40cb7e0 2024-09-13T17:06:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1f9a7fc700 1 -- 172.21.15.123:0/1268503813 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa001f070 con 0x7f1fa40cb7e0 2024-09-13T17:06:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1faad1b700 1 -- 172.21.15.123:0/1268503813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa40c3b10 con 0x7f1fa40cb7e0 2024-09-13T17:06:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1f9a7fc700 1 -- 172.21.15.123:0/1268503813 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00036c0 con 0x7f1fa40cb7e0 2024-09-13T17:06:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.526+0000 7f1faad1b700 1 -- 172.21.15.123:0/1268503813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa415c220 con 0x7f1fa40cb7e0 2024-09-13T17:06:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.530+0000 7f1faad1b700 1 -- 172.21.15.123:0/1268503813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa40c8cd0 con 0x7f1fa40cb7e0 2024-09-13T17:06:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.530+0000 7f1f9a7fc700 1 -- 172.21.15.123:0/1268503813 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1fa0021030 con 0x7f1fa40cb7e0 2024-09-13T17:06:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.530+0000 7f1f9a7fc700 1 --2- 172.21.15.123:0/1268503813 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1f88066730 0x7f1f88068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.530+0000 7f1f9a7fc700 1 -- 172.21.15.123:0/1268503813 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fa0085530 con 0x7f1fa40cb7e0 2024-09-13T17:06:57.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.530+0000 7f1fa9d19700 1 --2- 172.21.15.123:0/1268503813 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1f88066730 0x7f1f88068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.530+0000 7f1fa9d19700 1 --2- 172.21.15.123:0/1268503813 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1f88066730 0x7f1f88068bf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f94006fd0 tx=0x7f1f94008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:57.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.538+0000 7f1f9a7fc700 1 -- 172.21.15.123:0/1268503813 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1fa0052930 con 0x7f1fa40cb7e0 2024-09-13T17:06:57.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.706+0000 7f1faad1b700 1 -- 172.21.15.123:0/1268503813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fa40c8cd0 con 0x7f1fa40cb7e0 2024-09-13T17:06:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.710+0000 7f1f9a7fc700 1 -- 172.21.15.123:0/1268503813 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1fa0055f50 con 0x7f1fa40cb7e0 2024-09-13T17:06:57.716 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:06:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.710+0000 7f1faad1b700 1 -- 172.21.15.123:0/1268503813 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1f88066730 msgr2=0x7f1f88068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.710+0000 7f1faad1b700 1 --2- 172.21.15.123:0/1268503813 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1f88066730 0x7f1f88068bf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f94006fd0 tx=0x7f1f94008040 comp rx=0 tx=0).stop 2024-09-13T17:06:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.710+0000 7f1faad1b700 1 -- 172.21.15.123:0/1268503813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fa40cb7e0 msgr2=0x7f1fa414ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.710+0000 7f1faad1b700 1 --2- 172.21.15.123:0/1268503813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fa40cb7e0 0x7f1fa414ea90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0000c00 tx=0x7f1fa0004770 comp rx=0 tx=0).stop 2024-09-13T17:06:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.710+0000 7f1faad1b700 1 -- 172.21.15.123:0/1268503813 shutdown_connections 2024-09-13T17:06:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.710+0000 7f1faad1b700 1 --2- 172.21.15.123:0/1268503813 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1f88066730 0x7f1f88068bf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.710+0000 7f1faad1b700 1 --2- 172.21.15.123:0/1268503813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1fa415dd00 0x7f1fa415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.710+0000 7f1faad1b700 1 --2- 172.21.15.123:0/1268503813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fa40cb7e0 0x7f1fa414ea90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.710+0000 7f1faad1b700 1 --2- 172.21.15.123:0/1268503813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fa40c1480 0x7f1fa415bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.710+0000 7f1faad1b700 1 -- 172.21.15.123:0/1268503813 >> 172.21.15.123:0/1268503813 conn(0x7f1fa40b01d0 msgr2=0x7f1fa40b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:57.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.710+0000 7f1faad1b700 1 -- 172.21.15.123:0/1268503813 shutdown_connections 2024-09-13T17:06:57.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.710+0000 7f1faad1b700 1 -- 172.21.15.123:0/1268503813 wait complete. 2024-09-13T17:06:57.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:06:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.838+0000 7f9c6c98b700 1 Processor -- start 2024-09-13T17:06:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.838+0000 7f9c6c98b700 1 -- start start 2024-09-13T17:06:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c6c98b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c68159c60 0x7f9c6815e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c6c98b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9c680cdda0 0x7f9c6806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c6c98b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c680ada60 con 0x7f9c68070f90 2024-09-13T17:06:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c6c98b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6815e680 con 0x7f9c680cdda0 2024-09-13T17:06:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c6c98b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680720a0 con 0x7f9c68159c60 2024-09-13T17:06:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c67fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9c680cdda0 0x7f9c6806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c66ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9c68070f90 0x7f9c680cd690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:48480/0 (socket says 172.21.15.123:48480) 2024-09-13T17:06:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c66ffd700 1 -- 172.21.15.123:0/160680140 learned_addr learned my addr 172.21.15.123:0/160680140 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c677fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c68159c60 0x7f9c6815e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c677fe700 1 -- 172.21.15.123:0/160680140 >> v2:172.21.15.153:3300/0 conn(0x7f9c680cdda0 msgr2=0x7f9c6806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c677fe700 1 --2- 172.21.15.123:0/160680140 >> v2:172.21.15.153:3300/0 conn(0x7f9c680cdda0 0x7f9c6806c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c677fe700 1 -- 172.21.15.123:0/160680140 >> v1:172.21.15.153:6789/0 conn(0x7f9c68070f90 legacy=0x7f9c680cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c677fe700 1 -- 172.21.15.123:0/160680140 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c68072530 con 0x7f9c68159c60 2024-09-13T17:06:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c67fff700 1 --2- 172.21.15.123:0/160680140 >> v2:172.21.15.153:3300/0 conn(0x7f9c680cdda0 0x7f9c6806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c677fe700 1 --2- 172.21.15.123:0/160680140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c68159c60 0x7f9c6815e140 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009850 tx=0x7f9c50009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84b25b412042f772 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c667fc700 1 -- 172.21.15.123:0/160680140 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c50011830 con 0x7f9c68159c60 2024-09-13T17:06:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c667fc700 1 -- 172.21.15.123:0/160680140 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c50011990 con 0x7f9c68159c60 2024-09-13T17:06:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c667fc700 1 -- 172.21.15.123:0/160680140 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c50011d40 con 0x7f9c68159c60 2024-09-13T17:06:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c6c98b700 1 -- 172.21.15.123:0/160680140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c68159c60 msgr2=0x7f9c6815e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c6c98b700 1 --2- 172.21.15.123:0/160680140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c68159c60 0x7f9c6815e140 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009850 tx=0x7f9c50009b60 comp rx=0 tx=0).stop 2024-09-13T17:06:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c6c98b700 1 -- 172.21.15.123:0/160680140 shutdown_connections 2024-09-13T17:06:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c6c98b700 1 --2- 172.21.15.123:0/160680140 >> v2:172.21.15.153:3300/0 conn(0x7f9c680cdda0 0x7f9c6806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c6c98b700 1 --2- 172.21.15.123:0/160680140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c68159c60 0x7f9c6815e140 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c6c98b700 1 -- 172.21.15.123:0/160680140 >> 172.21.15.123:0/160680140 conn(0x7f9c680b01d0 msgr2=0x7f9c680b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c6c98b700 1 -- 172.21.15.123:0/160680140 shutdown_connections 2024-09-13T17:06:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.842+0000 7f9c6c98b700 1 -- 172.21.15.123:0/160680140 wait complete. 2024-09-13T17:06:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c6c98b700 1 Processor -- start 2024-09-13T17:06:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c6c98b700 1 -- start start 2024-09-13T17:06:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c6c98b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c68070f90 0x7f9c68147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c6c98b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c680cdda0 0x7f9c681495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c6c98b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c68159c60 0x7f9c68149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c6c98b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680b3ff0 con 0x7f9c680cdda0 2024-09-13T17:06:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c6c98b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680b42d0 con 0x7f9c68070f90 2024-09-13T17:06:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c6c98b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6814a3f0 con 0x7f9c68159c60 2024-09-13T17:06:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c66ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c680cdda0 0x7f9c681495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c66ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c680cdda0 0x7f9c681495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46772/0 (socket says 172.21.15.123:46772) 2024-09-13T17:06:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c66ffd700 1 -- 172.21.15.123:0/953122838 learned_addr learned my addr 172.21.15.123:0/953122838 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c67fff700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c68159c60 0x7f9c68149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c677fe700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c68070f90 0x7f9c68147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c66ffd700 1 -- 172.21.15.123:0/953122838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c68159c60 msgr2=0x7f9c68149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c66ffd700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c68159c60 0x7f9c68149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c66ffd700 1 -- 172.21.15.123:0/953122838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c68070f90 msgr2=0x7f9c68147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c66ffd700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c68070f90 0x7f9c68147d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c66ffd700 1 -- 172.21.15.123:0/953122838 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c60009a70 con 0x7f9c680cdda0 2024-09-13T17:06:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c677fe700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c68070f90 0x7f9c68147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c66ffd700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c680cdda0 0x7f9c681495e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9c58005930 tx=0x7f9c5800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c5ffff700 1 -- 172.21.15.123:0/953122838 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58005d90 con 0x7f9c680cdda0 2024-09-13T17:06:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c5ffff700 1 -- 172.21.15.123:0/953122838 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c580070d0 con 0x7f9c680cdda0 2024-09-13T17:06:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c6c98b700 1 -- 172.21.15.123:0/953122838 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c500094b0 con 0x7f9c680cdda0 2024-09-13T17:06:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c5ffff700 1 -- 172.21.15.123:0/953122838 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58007460 con 0x7f9c680cdda0 2024-09-13T17:06:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.846+0000 7f9c6c98b700 1 -- 172.21.15.123:0/953122838 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c680af140 con 0x7f9c680cdda0 2024-09-13T17:06:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.850+0000 7f9c6c98b700 1 -- 172.21.15.123:0/953122838 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c68071d30 con 0x7f9c680cdda0 2024-09-13T17:06:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.850+0000 7f9c5ffff700 1 -- 172.21.15.123:0/953122838 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9c580075c0 con 0x7f9c680cdda0 2024-09-13T17:06:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.850+0000 7f9c5ffff700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9c48066730 0x7f9c48068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.850+0000 7f9c5ffff700 1 -- 172.21.15.123:0/953122838 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c580835f0 con 0x7f9c680cdda0 2024-09-13T17:06:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.850+0000 7f9c677fe700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9c48066730 0x7f9c48068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:57.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.854+0000 7f9c677fe700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9c48066730 0x7f9c48068bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c500090b0 tx=0x7f9c50008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:57.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:57.858+0000 7f9c5ffff700 1 -- 172.21.15.123:0/953122838 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9c580508e0 con 0x7f9c680cdda0 2024-09-13T17:06:58.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.010+0000 7f9c6c98b700 1 -- 172.21.15.123:0/953122838 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c6815e460 con 0x7f9c680cdda0 2024-09-13T17:06:58.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.010+0000 7f9c5ffff700 1 -- 172.21.15.123:0/953122838 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c58053f00 con 0x7f9c680cdda0 2024-09-13T17:06:58.017 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:06:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.014+0000 7f9c6c98b700 1 -- 172.21.15.123:0/953122838 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9c48066730 msgr2=0x7f9c48068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.014+0000 7f9c6c98b700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9c48066730 0x7f9c48068bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c500090b0 tx=0x7f9c50008030 comp rx=0 tx=0).stop 2024-09-13T17:06:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.014+0000 7f9c6c98b700 1 -- 172.21.15.123:0/953122838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c680cdda0 msgr2=0x7f9c681495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.014+0000 7f9c6c98b700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c680cdda0 0x7f9c681495e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9c58005930 tx=0x7f9c5800c860 comp rx=0 tx=0).stop 2024-09-13T17:06:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.014+0000 7f9c6c98b700 1 -- 172.21.15.123:0/953122838 shutdown_connections 2024-09-13T17:06:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.014+0000 7f9c6c98b700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9c48066730 0x7f9c48068bf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.014+0000 7f9c6c98b700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9c68159c60 0x7f9c68149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.014+0000 7f9c6c98b700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c680cdda0 0x7f9c681495e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.014+0000 7f9c6c98b700 1 --2- 172.21.15.123:0/953122838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c68070f90 0x7f9c68147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.014+0000 7f9c6c98b700 1 -- 172.21.15.123:0/953122838 >> 172.21.15.123:0/953122838 conn(0x7f9c680b01d0 msgr2=0x7f9c6814df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.014+0000 7f9c6c98b700 1 -- 172.21.15.123:0/953122838 shutdown_connections 2024-09-13T17:06:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.014+0000 7f9c6c98b700 1 -- 172.21.15.123:0/953122838 wait complete. 2024-09-13T17:06:58.030 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:06:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 Processor -- start 2024-09-13T17:06:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 -- start start 2024-09-13T17:06:58.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39c00ae5e0 0x7f39c0160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c00ac8b0 0x7f39c00acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c0161520 con 0x7f39c00b2880 2024-09-13T17:06:58.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c015cf90 con 0x7f39c00ae5e0 2024-09-13T17:06:58.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00b2c60 con 0x7f39c00ac8b0 2024-09-13T17:06:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39bf7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39c00ae5e0 0x7f39c0160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39bf7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39c00ae5e0 0x7f39c0160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46774/0 (socket says 172.21.15.123:46774) 2024-09-13T17:06:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39bf7fe700 1 -- 172.21.15.123:0/3843445943 learned_addr learned my addr 172.21.15.123:0/3843445943 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c4eae700 1 --2- 172.21.15.123:0/3843445943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c00ac8b0 0x7f39c00acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39bf7fe700 1 -- 172.21.15.123:0/3843445943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c00ac8b0 msgr2=0x7f39c00acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39bf7fe700 1 --2- 172.21.15.123:0/3843445943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c00ac8b0 0x7f39c00acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39bf7fe700 1 -- 172.21.15.123:0/3843445943 >> v1:172.21.15.153:6789/0 conn(0x7f39c00b2880 legacy=0x7f39c015d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39bf7fe700 1 -- 172.21.15.123:0/3843445943 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c015d230 con 0x7f39c00ae5e0 2024-09-13T17:06:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39bf7fe700 1 --2- 172.21.15.123:0/3843445943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c00ae5e0 0x7f39c0160580 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009910 tx=0x7f39b0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42920dadfb39492e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39beffd700 1 -- 172.21.15.123:0/3843445943 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0004230 con 0x7f39c00ae5e0 2024-09-13T17:06:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39beffd700 1 -- 172.21.15.123:0/3843445943 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b0004390 con 0x7f39c00ae5e0 2024-09-13T17:06:58.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39beffd700 1 -- 172.21.15.123:0/3843445943 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0009e60 con 0x7f39c00ae5e0 2024-09-13T17:06:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 -- 172.21.15.123:0/3843445943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c00ae5e0 msgr2=0x7f39c0160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 --2- 172.21.15.123:0/3843445943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c00ae5e0 0x7f39c0160580 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009910 tx=0x7f39b0009c20 comp rx=0 tx=0).stop 2024-09-13T17:06:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 -- 172.21.15.123:0/3843445943 shutdown_connections 2024-09-13T17:06:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 --2- 172.21.15.123:0/3843445943 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c00ac8b0 0x7f39c00acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 --2- 172.21.15.123:0/3843445943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c00ae5e0 0x7f39c0160580 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 -- 172.21.15.123:0/3843445943 >> 172.21.15.123:0/3843445943 conn(0x7f39c006f940 msgr2=0x7f39c00b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 -- 172.21.15.123:0/3843445943 shutdown_connections 2024-09-13T17:06:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.138+0000 7f39c56af700 1 -- 172.21.15.123:0/3843445943 wait complete. 2024-09-13T17:06:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c56af700 1 Processor -- start 2024-09-13T17:06:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c56af700 1 -- start start 2024-09-13T17:06:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c56af700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39c00ac8b0 0x7f39c0141b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c56af700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c00ae5e0 0x7f39c014b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c56af700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c00b2880 0x7f39c014cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c56af700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c014f270 con 0x7f39c00b2880 2024-09-13T17:06:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c56af700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c006df30 con 0x7f39c00ac8b0 2024-09-13T17:06:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c56af700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01f61f0 con 0x7f39c00ae5e0 2024-09-13T17:06:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c4eae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c00b2880 0x7f39c014cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c4eae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c00b2880 0x7f39c014cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46778/0 (socket says 172.21.15.123:46778) 2024-09-13T17:06:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c4eae700 1 -- 172.21.15.123:0/69673926 learned_addr learned my addr 172.21.15.123:0/69673926 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39bffff700 1 --2- 172.21.15.123:0/69673926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39c00ac8b0 0x7f39c0141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39bf7fe700 1 --2- 172.21.15.123:0/69673926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c00ae5e0 0x7f39c014b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c4eae700 1 -- 172.21.15.123:0/69673926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c00ae5e0 msgr2=0x7f39c014b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c4eae700 1 --2- 172.21.15.123:0/69673926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c00ae5e0 0x7f39c014b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c4eae700 1 -- 172.21.15.123:0/69673926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39c00ac8b0 msgr2=0x7f39c0141b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c4eae700 1 --2- 172.21.15.123:0/69673926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39c00ac8b0 0x7f39c0141b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c4eae700 1 -- 172.21.15.123:0/69673926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b0009570 con 0x7f39c00b2880 2024-09-13T17:06:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c4eae700 1 --2- 172.21.15.123:0/69673926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c00b2880 0x7f39c014cbd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f39b8007e60 tx=0x7f39b800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39bcff9700 1 -- 172.21.15.123:0/69673926 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b800ed30 con 0x7f39c00b2880 2024-09-13T17:06:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39bcff9700 1 -- 172.21.15.123:0/69673926 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b8014420 con 0x7f39c00b2880 2024-09-13T17:06:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c56af700 1 -- 172.21.15.123:0/69673926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c006e180 con 0x7f39c00b2880 2024-09-13T17:06:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39bcff9700 1 -- 172.21.15.123:0/69673926 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b80147d0 con 0x7f39c00b2880 2024-09-13T17:06:58.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.142+0000 7f39c56af700 1 -- 172.21.15.123:0/69673926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c014ba30 con 0x7f39c00b2880 2024-09-13T17:06:58.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.146+0000 7f39c56af700 1 -- 172.21.15.123:0/69673926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c006e6a0 con 0x7f39c00b2880 2024-09-13T17:06:58.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.146+0000 7f39bcff9700 1 -- 172.21.15.123:0/69673926 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f39b8014930 con 0x7f39c00b2880 2024-09-13T17:06:58.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.146+0000 7f39bcff9700 1 --2- 172.21.15.123:0/69673926 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f39ac066730 0x7f39ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.146+0000 7f39bffff700 1 --2- 172.21.15.123:0/69673926 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f39ac066730 0x7f39ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.146+0000 7f39bcff9700 1 -- 172.21.15.123:0/69673926 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39b8084720 con 0x7f39c00b2880 2024-09-13T17:06:58.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.146+0000 7f39bffff700 1 --2- 172.21.15.123:0/69673926 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f39ac066730 0x7f39ac068bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f39c00d0010 tx=0x7f39b4007ee0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.154+0000 7f39bcff9700 1 -- 172.21.15.123:0/69673926 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f39c006e6a0 con 0x7f39c00b2880 2024-09-13T17:06:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.322+0000 7f39c56af700 1 -- 172.21.15.123:0/69673926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39c006e6a0 con 0x7f39c00b2880 2024-09-13T17:06:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.322+0000 7f39bcff9700 1 -- 172.21.15.123:0/69673926 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39c006e6a0 con 0x7f39c00b2880 2024-09-13T17:06:58.329 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:06:58.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.326+0000 7f39c56af700 1 -- 172.21.15.123:0/69673926 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f39ac066730 msgr2=0x7f39ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.326+0000 7f39c56af700 1 --2- 172.21.15.123:0/69673926 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f39ac066730 0x7f39ac068bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f39c00d0010 tx=0x7f39b4007ee0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.326+0000 7f39c56af700 1 -- 172.21.15.123:0/69673926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c00b2880 msgr2=0x7f39c014cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.326+0000 7f39c56af700 1 --2- 172.21.15.123:0/69673926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c00b2880 0x7f39c014cbd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f39b8007e60 tx=0x7f39b800e3c0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.326+0000 7f39c56af700 1 -- 172.21.15.123:0/69673926 shutdown_connections 2024-09-13T17:06:58.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.326+0000 7f39c56af700 1 --2- 172.21.15.123:0/69673926 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f39ac066730 0x7f39ac068bf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.326+0000 7f39c56af700 1 --2- 172.21.15.123:0/69673926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c00b2880 0x7f39c014cbd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.326+0000 7f39c56af700 1 --2- 172.21.15.123:0/69673926 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39c00ae5e0 0x7f39c014b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.326+0000 7f39c56af700 1 --2- 172.21.15.123:0/69673926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39c00ac8b0 0x7f39c0141b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.326+0000 7f39c56af700 1 -- 172.21.15.123:0/69673926 >> 172.21.15.123:0/69673926 conn(0x7f39c006f940 msgr2=0x7f39c015b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:58.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.326+0000 7f39c56af700 1 -- 172.21.15.123:0/69673926 shutdown_connections 2024-09-13T17:06:58.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.326+0000 7f39c56af700 1 -- 172.21.15.123:0/69673926 wait complete. 2024-09-13T17:06:58.343 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:06:58.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.450+0000 7f28cde47700 1 Processor -- start 2024-09-13T17:06:58.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cde47700 1 -- start start 2024-09-13T17:06:58.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cde47700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f28c8153390 0x7f28c8159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cde47700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c815a4c0 con 0x7f28c80cdb70 2024-09-13T17:06:58.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cde47700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c80cb730 con 0x7f28c8153770 2024-09-13T17:06:58.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cde47700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c81595a0 con 0x7f28c8153390 2024-09-13T17:06:58.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cce45700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f28c8153390 0x7f28c8159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cce45700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f28c8153390 0x7f28c8159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46794/0 (socket says 172.21.15.123:46794) 2024-09-13T17:06:58.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cce45700 1 -- 172.21.15.123:0/2830169356 learned_addr learned my addr 172.21.15.123:0/2830169356 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:58.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28bffff700 1 --1- 172.21.15.123:0/2830169356 >> v1:172.21.15.123:6789/0 conn(0x7f28c80cdb70 0x7f28c80cae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49274/0 (socket says 172.21.15.123:49274) 2024-09-13T17:06:58.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cce45700 1 -- 172.21.15.123:0/2830169356 >> v1:172.21.15.153:6789/0 conn(0x7f28c8153770 legacy=0x7f28c80ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cce45700 1 -- 172.21.15.123:0/2830169356 >> v1:172.21.15.123:6789/0 conn(0x7f28c80cdb70 legacy=0x7f28c80cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28bf7fe700 1 -- 172.21.15.123:0/2830169356 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277653516 0 0) 0x7f28c815a4c0 con 0x7f28c80cdb70 2024-09-13T17:06:58.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cce45700 1 -- 172.21.15.123:0/2830169356 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c80cba10 con 0x7f28c8153390 2024-09-13T17:06:58.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cce45700 1 --2- 172.21.15.123:0/2830169356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28c8153390 0x7f28c8159f80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009970 tx=0x7f28c4009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445af2494c46b0d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:58.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28bf7fe700 1 -- 172.21.15.123:0/2830169356 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400b9e0 con 0x7f28c8153390 2024-09-13T17:06:58.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28bf7fe700 1 -- 172.21.15.123:0/2830169356 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c400bb40 con 0x7f28c8153390 2024-09-13T17:06:58.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28bf7fe700 1 -- 172.21.15.123:0/2830169356 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4011420 con 0x7f28c8153390 2024-09-13T17:06:58.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cde47700 1 -- 172.21.15.123:0/2830169356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28c8153390 msgr2=0x7f28c8159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cde47700 1 --2- 172.21.15.123:0/2830169356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28c8153390 0x7f28c8159f80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009970 tx=0x7f28c4009c80 comp rx=0 tx=0).stop 2024-09-13T17:06:58.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cde47700 1 -- 172.21.15.123:0/2830169356 shutdown_connections 2024-09-13T17:06:58.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cde47700 1 --2- 172.21.15.123:0/2830169356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28c8153390 0x7f28c8159f80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cde47700 1 -- 172.21.15.123:0/2830169356 >> 172.21.15.123:0/2830169356 conn(0x7f28c8066150 msgr2=0x7f28c8066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:58.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cde47700 1 -- 172.21.15.123:0/2830169356 shutdown_connections 2024-09-13T17:06:58.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.454+0000 7f28cde47700 1 -- 172.21.15.123:0/2830169356 wait complete. 2024-09-13T17:06:58.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cde47700 1 Processor -- start 2024-09-13T17:06:58.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cde47700 1 -- start start 2024-09-13T17:06:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cde47700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28c80cdb70 0x7f28c806be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cde47700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28c8153390 0x7f28c8158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cde47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28c8153770 0x7f28c814cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cde47700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80c4130 con 0x7f28c80cdb70 2024-09-13T17:06:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cde47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c806d2f0 con 0x7f28c8153770 2024-09-13T17:06:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cde47700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c806d780 con 0x7f28c8153390 2024-09-13T17:06:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cce45700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28c80cdb70 0x7f28c806be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cce45700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28c80cdb70 0x7f28c806be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46802/0 (socket says 172.21.15.123:46802) 2024-09-13T17:06:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cce45700 1 -- 172.21.15.123:0/72768577 learned_addr learned my addr 172.21.15.123:0/72768577 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28bffff700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28c8153390 0x7f28c8158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cd646700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28c8153770 0x7f28c814cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cce45700 1 -- 172.21.15.123:0/72768577 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28c8153390 msgr2=0x7f28c8158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cce45700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28c8153390 0x7f28c8158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cce45700 1 -- 172.21.15.123:0/72768577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28c8153770 msgr2=0x7f28c814cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cce45700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28c8153770 0x7f28c814cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cce45700 1 -- 172.21.15.123:0/72768577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c4009570 con 0x7f28c80cdb70 2024-09-13T17:06:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28bffff700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28c8153390 0x7f28c8158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cce45700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28c80cdb70 0x7f28c806be90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f28c4000c00 tx=0x7f28c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28bd7fa700 1 -- 172.21.15.123:0/72768577 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c40036c0 con 0x7f28c80cdb70 2024-09-13T17:06:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28bd7fa700 1 -- 172.21.15.123:0/72768577 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c401f070 con 0x7f28c80cdb70 2024-09-13T17:06:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cde47700 1 -- 172.21.15.123:0/72768577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c806c6e0 con 0x7f28c80cdb70 2024-09-13T17:06:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28bd7fa700 1 -- 172.21.15.123:0/72768577 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4003a40 con 0x7f28c80cdb70 2024-09-13T17:06:58.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cde47700 1 -- 172.21.15.123:0/72768577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c806cca0 con 0x7f28c80cdb70 2024-09-13T17:06:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.458+0000 7f28cde47700 1 -- 172.21.15.123:0/72768577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c80677f0 con 0x7f28c80cdb70 2024-09-13T17:06:58.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.462+0000 7f28bd7fa700 1 -- 172.21.15.123:0/72768577 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f28c4003ba0 con 0x7f28c80cdb70 2024-09-13T17:06:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.462+0000 7f28bd7fa700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28b4066760 0x7f28b4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.462+0000 7f28bd7fa700 1 -- 172.21.15.123:0/72768577 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28c4021070 con 0x7f28c80cdb70 2024-09-13T17:06:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.462+0000 7f28bffff700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28b4066760 0x7f28b4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.462+0000 7f28bffff700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28b4066760 0x7f28b4068c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f28c81f5f70 tx=0x7f28b8007cc0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.470+0000 7f28bd7fa700 1 -- 172.21.15.123:0/72768577 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f28c4052e70 con 0x7f28c80cdb70 2024-09-13T17:06:58.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.674+0000 7f28cde47700 1 -- 172.21.15.123:0/72768577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28c8159f80 con 0x7f28c80cdb70 2024-09-13T17:06:58.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.674+0000 7f28bd7fa700 1 -- 172.21.15.123:0/72768577 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7f28c402b020 con 0x7f28c80cdb70 2024-09-13T17:06:58.679 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:58.679 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/721071800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":721071800},{"type":"v1","addr":"172.21.15.123:6835","nonce":721071800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1472515409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1472515409},{"type":"v1","addr":"172.21.15.123:6837","nonce":1472515409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3017694841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3017694841},{"type":"v1","addr":"172.21.15.153:6833","nonce":3017694841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:06:48.418287+0000","modified":"2024-09-13T17:06:51.426119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/2848393496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2848393496},{"type":"v1","addr":"172.21.15.153:6835","nonce":2848393496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:06:58.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.674+0000 7f28cde47700 1 -- 172.21.15.123:0/72768577 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28b4066760 msgr2=0x7f28b4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.674+0000 7f28cde47700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28b4066760 0x7f28b4068c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f28c81f5f70 tx=0x7f28b8007cc0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.674+0000 7f28cde47700 1 -- 172.21.15.123:0/72768577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28c80cdb70 msgr2=0x7f28c806be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.674+0000 7f28cde47700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28c80cdb70 0x7f28c806be90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f28c4000c00 tx=0x7f28c4004770 comp rx=0 tx=0).stop 2024-09-13T17:06:58.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.674+0000 7f28cde47700 1 -- 172.21.15.123:0/72768577 shutdown_connections 2024-09-13T17:06:58.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.674+0000 7f28cde47700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28b4066760 0x7f28b4068c20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.674+0000 7f28cde47700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28c8153770 0x7f28c814cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.674+0000 7f28cde47700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28c8153390 0x7f28c8158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.674+0000 7f28cde47700 1 --2- 172.21.15.123:0/72768577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28c80cdb70 0x7f28c806be90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.674+0000 7f28cde47700 1 -- 172.21.15.123:0/72768577 >> 172.21.15.123:0/72768577 conn(0x7f28c8066150 msgr2=0x7f28c80afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:58.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.678+0000 7f28cde47700 1 -- 172.21.15.123:0/72768577 shutdown_connections 2024-09-13T17:06:58.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.678+0000 7f28cde47700 1 -- 172.21.15.123:0/72768577 wait complete. 2024-09-13T17:06:58.683 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 7 2024-09-13T17:06:58.694 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:06:58.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.798+0000 7fa59a6a6700 1 Processor -- start 2024-09-13T17:06:58.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.798+0000 7fa59a6a6700 1 -- start start 2024-09-13T17:06:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa59a6a6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa59415ed00 0x7fa594161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa59a6a6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa594161a80 0x7fa5940cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa59a6a6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa594162550 con 0x7fa59415e920 2024-09-13T17:06:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa59a6a6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5940cd690 con 0x7fa594161a80 2024-09-13T17:06:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa59a6a6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa594161f90 con 0x7fa59415ed00 2024-09-13T17:06:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa599ea5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa594161a80 0x7fa5940cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa599ea5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa594161a80 0x7fa5940cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46808/0 (socket says 172.21.15.123:46808) 2024-09-13T17:06:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa599ea5700 1 -- 172.21.15.123:0/2076582875 learned_addr learned my addr 172.21.15.123:0/2076582875 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa5996a4700 1 --1- 172.21.15.123:0/2076582875 >> v1:172.21.15.123:6789/0 conn(0x7fa59415e920 0x7fa5940caae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49276/0 (socket says 172.21.15.123:49276) 2024-09-13T17:06:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa598ea3700 1 --2- 172.21.15.123:0/2076582875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa59415ed00 0x7fa594161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa599ea5700 1 -- 172.21.15.123:0/2076582875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa59415ed00 msgr2=0x7fa594161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa599ea5700 1 --2- 172.21.15.123:0/2076582875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa59415ed00 0x7fa594161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa599ea5700 1 -- 172.21.15.123:0/2076582875 >> v1:172.21.15.123:6789/0 conn(0x7fa59415e920 legacy=0x7fa5940caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa599ea5700 1 -- 172.21.15.123:0/2076582875 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa594162270 con 0x7fa594161a80 2024-09-13T17:06:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa599ea5700 1 --2- 172.21.15.123:0/2076582875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa594161a80 0x7fa5940cdb20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009910 tx=0x7fa58c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fcc52067f24fce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa58bfff700 1 -- 172.21.15.123:0/2076582875 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c011830 con 0x7fa594161a80 2024-09-13T17:06:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa58bfff700 1 -- 172.21.15.123:0/2076582875 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c011990 con 0x7fa594161a80 2024-09-13T17:06:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa58bfff700 1 -- 172.21.15.123:0/2076582875 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c011d40 con 0x7fa594161a80 2024-09-13T17:06:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa59a6a6700 1 -- 172.21.15.123:0/2076582875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa594161a80 msgr2=0x7fa5940cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa59a6a6700 1 --2- 172.21.15.123:0/2076582875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa594161a80 0x7fa5940cdb20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009910 tx=0x7fa58c009c20 comp rx=0 tx=0).stop 2024-09-13T17:06:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa59a6a6700 1 -- 172.21.15.123:0/2076582875 shutdown_connections 2024-09-13T17:06:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa59a6a6700 1 --2- 172.21.15.123:0/2076582875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa594161a80 0x7fa5940cdb20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa59a6a6700 1 --2- 172.21.15.123:0/2076582875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa59415ed00 0x7fa594161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa59a6a6700 1 -- 172.21.15.123:0/2076582875 >> 172.21.15.123:0/2076582875 conn(0x7fa594066150 msgr2=0x7fa594066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa59a6a6700 1 -- 172.21.15.123:0/2076582875 shutdown_connections 2024-09-13T17:06:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.802+0000 7fa59a6a6700 1 -- 172.21.15.123:0/2076582875 wait complete. 2024-09-13T17:06:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa59a6a6700 1 Processor -- start 2024-09-13T17:06:58.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa59a6a6700 1 -- start start 2024-09-13T17:06:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa59a6a6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa59415e920 0x7fa5940c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa59a6a6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa59415ed00 0x7fa5941598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa59a6a6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa594161a80 0x7fa594159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa59a6a6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5940ca1a0 con 0x7fa59415ed00 2024-09-13T17:06:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa59a6a6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5941e7aa0 con 0x7fa59415e920 2024-09-13T17:06:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa59a6a6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5941e8340 con 0x7fa594161a80 2024-09-13T17:06:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa598ea3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa59415ed00 0x7fa5941598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa598ea3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa59415ed00 0x7fa5941598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46820/0 (socket says 172.21.15.123:46820) 2024-09-13T17:06:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa598ea3700 1 -- 172.21.15.123:0/3903809093 learned_addr learned my addr 172.21.15.123:0/3903809093 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa599ea5700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa594161a80 0x7fa594159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa5996a4700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa59415e920 0x7fa5940c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa598ea3700 1 -- 172.21.15.123:0/3903809093 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa594161a80 msgr2=0x7fa594159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa598ea3700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa594161a80 0x7fa594159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa598ea3700 1 -- 172.21.15.123:0/3903809093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa59415e920 msgr2=0x7fa5940c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:58.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa598ea3700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa59415e920 0x7fa5940c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:58.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa598ea3700 1 -- 172.21.15.123:0/3903809093 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c009570 con 0x7fa59415ed00 2024-09-13T17:06:58.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa5996a4700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa59415e920 0x7fa5940c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:58.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa598ea3700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa59415ed00 0x7fa5941598d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa58400e960 tx=0x7fa58400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:58.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa589ffb700 1 -- 172.21.15.123:0/3903809093 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5840096c0 con 0x7fa59415ed00 2024-09-13T17:06:58.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa589ffb700 1 -- 172.21.15.123:0/3903809093 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58400eeb0 con 0x7fa59415ed00 2024-09-13T17:06:58.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa59a6a6700 1 -- 172.21.15.123:0/3903809093 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5941ed2c0 con 0x7fa59415ed00 2024-09-13T17:06:58.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa589ffb700 1 -- 172.21.15.123:0/3903809093 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58400ca50 con 0x7fa59415ed00 2024-09-13T17:06:58.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.806+0000 7fa59a6a6700 1 -- 172.21.15.123:0/3903809093 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5941e7fd0 con 0x7fa59415ed00 2024-09-13T17:06:58.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.810+0000 7fa59a6a6700 1 -- 172.21.15.123:0/3903809093 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5940677f0 con 0x7fa59415ed00 2024-09-13T17:06:58.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.810+0000 7fa589ffb700 1 -- 172.21.15.123:0/3903809093 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa58400cbb0 con 0x7fa59415ed00 2024-09-13T17:06:58.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.810+0000 7fa589ffb700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa578066760 0x7fa578068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:58.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.810+0000 7fa5996a4700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa578066760 0x7fa578068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:58.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.810+0000 7fa589ffb700 1 -- 172.21.15.123:0/3903809093 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5840841c0 con 0x7fa59415ed00 2024-09-13T17:06:58.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.810+0000 7fa5996a4700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa578066760 0x7fa578068c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa5900012e0 tx=0x7fa5900019e0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:58.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.818+0000 7fa589ffb700 1 -- 172.21.15.123:0/3903809093 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa584051520 con 0x7fa59415ed00 2024-09-13T17:06:58.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.990+0000 7fa59a6a6700 1 -- 172.21.15.123:0/3903809093 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa594161540 con 0x7fa59415ed00 2024-09-13T17:06:58.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.994+0000 7fa589ffb700 1 -- 172.21.15.123:0/3903809093 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7fa58400ce60 con 0x7fa59415ed00 2024-09-13T17:06:58.999 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:06:58.999 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:06:59.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.994+0000 7fa59a6a6700 1 -- 172.21.15.123:0/3903809093 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa578066760 msgr2=0x7fa578068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.994+0000 7fa59a6a6700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa578066760 0x7fa578068c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa5900012e0 tx=0x7fa5900019e0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.994+0000 7fa59a6a6700 1 -- 172.21.15.123:0/3903809093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa59415ed00 msgr2=0x7fa5941598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.994+0000 7fa59a6a6700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa59415ed00 0x7fa5941598d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa58400e960 tx=0x7fa58400ec70 comp rx=0 tx=0).stop 2024-09-13T17:06:59.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.994+0000 7fa59a6a6700 1 -- 172.21.15.123:0/3903809093 shutdown_connections 2024-09-13T17:06:59.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.994+0000 7fa59a6a6700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa578066760 0x7fa578068c20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.994+0000 7fa59a6a6700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa594161a80 0x7fa594159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.994+0000 7fa59a6a6700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa59415ed00 0x7fa5941598d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.994+0000 7fa59a6a6700 1 --2- 172.21.15.123:0/3903809093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa59415e920 0x7fa5940c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.994+0000 7fa59a6a6700 1 -- 172.21.15.123:0/3903809093 >> 172.21.15.123:0/3903809093 conn(0x7fa594066150 msgr2=0x7fa59406c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:59.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.994+0000 7fa59a6a6700 1 -- 172.21.15.123:0/3903809093 shutdown_connections 2024-09-13T17:06:59.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:58.994+0000 7fa59a6a6700 1 -- 172.21.15.123:0/3903809093 wait complete. 2024-09-13T17:06:59.014 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:06:59.015 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:06:59.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.126+0000 7fcd5f217700 1 Processor -- start 2024-09-13T17:06:59.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.126+0000 7fcd5f217700 1 -- start start 2024-09-13T17:06:59.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.126+0000 7fcd5f217700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd581592e0 0x7fcd5815d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.126+0000 7fcd5f217700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcd581596c0 0x7fcd5815d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.126+0000 7fcd5f217700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd580cd2e0 con 0x7fcd5806dc90 2024-09-13T17:06:59.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.126+0000 7fcd5f217700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd580cd5c0 con 0x7fcd581596c0 2024-09-13T17:06:59.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.126+0000 7fcd5f217700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd580cd8a0 con 0x7fcd581592e0 2024-09-13T17:06:59.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.126+0000 7fcd5e215700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd581592e0 0x7fcd5815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.126+0000 7fcd5da14700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcd581596c0 0x7fcd5815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.126+0000 7fcd5ea16700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcd5806dc90 0x7fcd580c8cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:48502/0 (socket says 172.21.15.123:48502) 2024-09-13T17:06:59.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.126+0000 7fcd5ea16700 1 -- 172.21.15.123:0/2388915785 learned_addr learned my addr 172.21.15.123:0/2388915785 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:59.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.126+0000 7fcd5e215700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd581592e0 0x7fcd5815d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:37958/0 (socket says 172.21.15.123:37958) 2024-09-13T17:06:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5d213700 1 -- 172.21.15.123:0/2388915785 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102596362 0 0) 0x7fcd580cd2e0 con 0x7fcd5806dc90 2024-09-13T17:06:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5d213700 1 -- 172.21.15.123:0/2388915785 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd400035d0 con 0x7fcd5806dc90 2024-09-13T17:06:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5e215700 1 -- 172.21.15.123:0/2388915785 >> v2:172.21.15.153:3300/0 conn(0x7fcd581596c0 msgr2=0x7fcd5815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5e215700 1 --2- 172.21.15.123:0/2388915785 >> v2:172.21.15.153:3300/0 conn(0x7fcd581596c0 0x7fcd5815d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5e215700 1 -- 172.21.15.123:0/2388915785 >> v1:172.21.15.153:6789/0 conn(0x7fcd5806dc90 legacy=0x7fcd580c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5e215700 1 -- 172.21.15.123:0/2388915785 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd580cdb80 con 0x7fcd581592e0 2024-09-13T17:06:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5e215700 1 --2- 172.21.15.123:0/2388915785 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd581592e0 0x7fcd5815d030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009850 tx=0x7fcd4c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7553b989c227007c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5d213700 1 -- 172.21.15.123:0/2388915785 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c011830 con 0x7fcd581592e0 2024-09-13T17:06:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5d213700 1 -- 172.21.15.123:0/2388915785 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c011990 con 0x7fcd581592e0 2024-09-13T17:06:59.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5d213700 1 -- 172.21.15.123:0/2388915785 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c011d00 con 0x7fcd581592e0 2024-09-13T17:06:59.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5f217700 1 -- 172.21.15.123:0/2388915785 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd581592e0 msgr2=0x7fcd5815d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5f217700 1 --2- 172.21.15.123:0/2388915785 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd581592e0 0x7fcd5815d030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009850 tx=0x7fcd4c009b60 comp rx=0 tx=0).stop 2024-09-13T17:06:59.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5f217700 1 -- 172.21.15.123:0/2388915785 shutdown_connections 2024-09-13T17:06:59.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5f217700 1 --2- 172.21.15.123:0/2388915785 >> v2:172.21.15.153:3300/0 conn(0x7fcd581596c0 0x7fcd5815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5f217700 1 --2- 172.21.15.123:0/2388915785 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd581592e0 0x7fcd5815d030 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5f217700 1 -- 172.21.15.123:0/2388915785 >> 172.21.15.123:0/2388915785 conn(0x7fcd580b01d0 msgr2=0x7fcd580b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:59.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5f217700 1 -- 172.21.15.123:0/2388915785 shutdown_connections 2024-09-13T17:06:59.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5f217700 1 -- 172.21.15.123:0/2388915785 wait complete. 2024-09-13T17:06:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5f217700 1 Processor -- start 2024-09-13T17:06:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.130+0000 7fcd5f217700 1 -- start start 2024-09-13T17:06:59.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5f217700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd5806dc90 0x7fcd5814c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5f217700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd581592e0 0x7fcd58158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5f217700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd581596c0 0x7fcd5806c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5f217700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd58149e00 con 0x7fcd581592e0 2024-09-13T17:06:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5f217700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd580b3b70 con 0x7fcd5806dc90 2024-09-13T17:06:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5f217700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd581491f0 con 0x7fcd581596c0 2024-09-13T17:06:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5da14700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd581592e0 0x7fcd58158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5da14700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd581592e0 0x7fcd58158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46836/0 (socket says 172.21.15.123:46836) 2024-09-13T17:06:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5da14700 1 -- 172.21.15.123:0/2432000475 learned_addr learned my addr 172.21.15.123:0/2432000475 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5e215700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd5806dc90 0x7fcd5814c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5ea16700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd581596c0 0x7fcd5806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5da14700 1 -- 172.21.15.123:0/2432000475 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd581596c0 msgr2=0x7fcd5806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5da14700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd581596c0 0x7fcd5806c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5da14700 1 -- 172.21.15.123:0/2432000475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd5806dc90 msgr2=0x7fcd5814c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5da14700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd5806dc90 0x7fcd5814c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5da14700 1 -- 172.21.15.123:0/2432000475 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c0094b0 con 0x7fcd581592e0 2024-09-13T17:06:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5e215700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd5806dc90 0x7fcd5814c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:06:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5da14700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd581592e0 0x7fcd58158ca0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009cd0 tx=0x7fcd4800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd56ffd700 1 -- 172.21.15.123:0/2432000475 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4800cdc0 con 0x7fcd581592e0 2024-09-13T17:06:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5f217700 1 -- 172.21.15.123:0/2432000475 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd581494d0 con 0x7fcd581592e0 2024-09-13T17:06:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5f217700 1 -- 172.21.15.123:0/2432000475 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd58149a90 con 0x7fcd581592e0 2024-09-13T17:06:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd56ffd700 1 -- 172.21.15.123:0/2432000475 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4800f040 con 0x7fcd581592e0 2024-09-13T17:06:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd56ffd700 1 -- 172.21.15.123:0/2432000475 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd480146a0 con 0x7fcd581592e0 2024-09-13T17:06:59.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.134+0000 7fcd5f217700 1 -- 172.21.15.123:0/2432000475 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd38005310 con 0x7fcd581592e0 2024-09-13T17:06:59.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.138+0000 7fcd56ffd700 1 -- 172.21.15.123:0/2432000475 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd48014800 con 0x7fcd581592e0 2024-09-13T17:06:59.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.138+0000 7fcd56ffd700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd44066760 0x7fcd44068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.138+0000 7fcd56ffd700 1 -- 172.21.15.123:0/2432000475 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd48084c60 con 0x7fcd581592e0 2024-09-13T17:06:59.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.138+0000 7fcd5e215700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd44066760 0x7fcd44068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.138+0000 7fcd5e215700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd44066760 0x7fcd44068c20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0090b0 tx=0x7fcd4c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.146+0000 7fcd56ffd700 1 -- 172.21.15.123:0/2432000475 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcd48051fd0 con 0x7fcd581592e0 2024-09-13T17:06:59.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.310+0000 7fcd5f217700 1 -- 172.21.15.123:0/2432000475 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd38005b40 con 0x7fcd581592e0 2024-09-13T17:06:59.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.310+0000 7fcd56ffd700 1 -- 172.21.15.123:0/2432000475 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd480180a0 con 0x7fcd581592e0 2024-09-13T17:06:59.317 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:06:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.314+0000 7fcd5f217700 1 -- 172.21.15.123:0/2432000475 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd44066760 msgr2=0x7fcd44068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.314+0000 7fcd5f217700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd44066760 0x7fcd44068c20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0090b0 tx=0x7fcd4c008030 comp rx=0 tx=0).stop 2024-09-13T17:06:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.314+0000 7fcd5f217700 1 -- 172.21.15.123:0/2432000475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd581592e0 msgr2=0x7fcd58158ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.314+0000 7fcd5f217700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd581592e0 0x7fcd58158ca0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009cd0 tx=0x7fcd4800c3a0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.314+0000 7fcd5f217700 1 -- 172.21.15.123:0/2432000475 shutdown_connections 2024-09-13T17:06:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.314+0000 7fcd5f217700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd44066760 0x7fcd44068c20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.314+0000 7fcd5f217700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd581596c0 0x7fcd5806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.314+0000 7fcd5f217700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd581592e0 0x7fcd58158ca0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.314+0000 7fcd5f217700 1 --2- 172.21.15.123:0/2432000475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd5806dc90 0x7fcd5814c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.314+0000 7fcd5f217700 1 -- 172.21.15.123:0/2432000475 >> 172.21.15.123:0/2432000475 conn(0x7fcd580b01d0 msgr2=0x7fcd580b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.314+0000 7fcd5f217700 1 -- 172.21.15.123:0/2432000475 shutdown_connections 2024-09-13T17:06:59.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.314+0000 7fcd5f217700 1 -- 172.21.15.123:0/2432000475 wait complete. 2024-09-13T17:06:59.331 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:06:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.438+0000 7f6dc8d17700 1 Processor -- start 2024-09-13T17:06:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.438+0000 7f6dc8d17700 1 -- start start 2024-09-13T17:06:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc8d17700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6dc40cb7e0 0x7f6dc40c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc8d17700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6dc406bdb0 0x7f6dc4071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc8d17700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc40ca750 con 0x7f6dc40c1480 2024-09-13T17:06:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc8d17700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc40c9210 con 0x7f6dc40cb7e0 2024-09-13T17:06:59.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc8d17700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc41617b0 con 0x7f6dc406bdb0 2024-09-13T17:06:59.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc3fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6dc40c1480 0x7f6dc40706a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49292/0 (socket says 172.21.15.123:49292) 2024-09-13T17:06:59.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc3fff700 1 -- 172.21.15.123:0/3412876583 learned_addr learned my addr 172.21.15.123:0/3412876583 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:59.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc2ffd700 1 --2- 172.21.15.123:0/3412876583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6dc406bdb0 0x7f6dc4071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc37fe700 1 --2- 172.21.15.123:0/3412876583 >> v2:172.21.15.153:3300/0 conn(0x7f6dc40cb7e0 0x7f6dc40c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 -- 172.21.15.123:0/3412876583 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440450126 0 0) 0x7f6dc40ca750 con 0x7f6dc40c1480 2024-09-13T17:06:59.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 -- 172.21.15.123:0/3412876583 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dac0035d0 con 0x7f6dc40c1480 2024-09-13T17:06:59.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 -- 172.21.15.123:0/3412876583 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1471083005 0 0) 0x7f6dac0035d0 con 0x7f6dc40c1480 2024-09-13T17:06:59.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 -- 172.21.15.123:0/3412876583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6dc406bdb0 msgr2=0x7f6dc4071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:59.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 --2- 172.21.15.123:0/3412876583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6dc406bdb0 0x7f6dc4071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 -- 172.21.15.123:0/3412876583 >> v2:172.21.15.153:3300/0 conn(0x7f6dc40cb7e0 msgr2=0x7f6dc40c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 --2- 172.21.15.123:0/3412876583 >> v2:172.21.15.153:3300/0 conn(0x7f6dc40cb7e0 0x7f6dc40c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 -- 172.21.15.123:0/3412876583 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc40cbbc0 con 0x7f6dc40c1480 2024-09-13T17:06:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 -- 172.21.15.123:0/3412876583 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f6dbc0019f0 con 0x7f6dc40c1480 2024-09-13T17:06:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 -- 172.21.15.123:0/3412876583 >> v1:172.21.15.123:6789/0 conn(0x7f6dc40c1480 legacy=0x7f6dc40706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 --2- 172.21.15.123:0/3412876583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dac003a20 0x7f6dac003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 --2- 172.21.15.123:0/3412876583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6dc406bdb0 0x7f6dac004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 --2- 172.21.15.123:0/3412876583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dac004db0 0x7f6dac005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 -- 172.21.15.123:0/3412876583 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40c9210 con 0x7f6dac004db0 2024-09-13T17:06:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 -- 172.21.15.123:0/3412876583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc41617b0 con 0x7f6dac003a20 2024-09-13T17:06:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 -- 172.21.15.123:0/3412876583 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac00ba30 con 0x7f6dc406bdb0 2024-09-13T17:06:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc3fff700 1 --2- 172.21.15.123:0/3412876583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dac004db0 0x7f6dac005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc37fe700 1 --2- 172.21.15.123:0/3412876583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dac003a20 0x7f6dac003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc2ffd700 1 --2- 172.21.15.123:0/3412876583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6dc406bdb0 0x7f6dac004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc3fff700 1 -- 172.21.15.123:0/3412876583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6dc406bdb0 msgr2=0x7f6dac004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc3fff700 1 --2- 172.21.15.123:0/3412876583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6dc406bdb0 0x7f6dac004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc3fff700 1 -- 172.21.15.123:0/3412876583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dac003a20 msgr2=0x7f6dac003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc3fff700 1 --2- 172.21.15.123:0/3412876583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dac003a20 0x7f6dac003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc3fff700 1 -- 172.21.15.123:0/3412876583 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac0035d0 con 0x7f6dac004db0 2024-09-13T17:06:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc3fff700 1 --2- 172.21.15.123:0/3412876583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dac004db0 0x7f6dac005230 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00a900 tx=0x7f6dac0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89197643a91af99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 -- 172.21.15.123:0/3412876583 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00a340 con 0x7f6dac004db0 2024-09-13T17:06:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 -- 172.21.15.123:0/3412876583 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc0072d0 con 0x7f6dac004db0 2024-09-13T17:06:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.442+0000 7f6dc27fc700 1 -- 172.21.15.123:0/3412876583 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc007680 con 0x7f6dac004db0 2024-09-13T17:06:59.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3412876583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dac004db0 msgr2=0x7f6dac005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 --2- 172.21.15.123:0/3412876583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dac004db0 0x7f6dac005230 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00a900 tx=0x7f6dac0058a0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc3fff700 1 -- 172.21.15.123:0/3412876583 reap_dead start 2024-09-13T17:06:59.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3412876583 shutdown_connections 2024-09-13T17:06:59.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3412876583 >> 172.21.15.123:0/3412876583 conn(0x7f6dc40b01d0 msgr2=0x7f6dc40b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:59.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3412876583 shutdown_connections 2024-09-13T17:06:59.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3412876583 wait complete. 2024-09-13T17:06:59.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 Processor -- start 2024-09-13T17:06:59.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 -- start start 2024-09-13T17:06:59.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dc40c0a60 0x7f6dc40c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc40c0e40 0x7f6dc40c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6dc4163510 0x7f6dc41639c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40c3640 con 0x7f6dc40c0e40 2024-09-13T17:06:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40c8580 con 0x7f6dc40c0a60 2024-09-13T17:06:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40c3010 con 0x7f6dc4163510 2024-09-13T17:06:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc40c0e40 0x7f6dc40c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc40c0e40 0x7f6dc40c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46854/0 (socket says 172.21.15.123:46854) 2024-09-13T17:06:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc2ffd700 1 -- 172.21.15.123:0/3909197222 learned_addr learned my addr 172.21.15.123:0/3909197222 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc37fe700 1 --2- 172.21.15.123:0/3909197222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dc40c0a60 0x7f6dc40c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc3fff700 1 --2- 172.21.15.123:0/3909197222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6dc4163510 0x7f6dc41639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc2ffd700 1 -- 172.21.15.123:0/3909197222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6dc4163510 msgr2=0x7f6dc41639c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc2ffd700 1 --2- 172.21.15.123:0/3909197222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6dc4163510 0x7f6dc41639c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc2ffd700 1 -- 172.21.15.123:0/3909197222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dc40c0a60 msgr2=0x7f6dc40c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc2ffd700 1 --2- 172.21.15.123:0/3909197222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dc40c0a60 0x7f6dc40c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc2ffd700 1 -- 172.21.15.123:0/3909197222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc4164240 con 0x7f6dc40c0e40 2024-09-13T17:06:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc2ffd700 1 --2- 172.21.15.123:0/3909197222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc40c0e40 0x7f6dc40c8040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6db4011a00 tx=0x7f6db4011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dabfff700 1 -- 172.21.15.123:0/3909197222 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4009640 con 0x7f6dc40c0e40 2024-09-13T17:06:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dabfff700 1 -- 172.21.15.123:0/3909197222 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db4004240 con 0x7f6dc40c0e40 2024-09-13T17:06:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3909197222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc40c32d0 con 0x7f6dc40c0e40 2024-09-13T17:06:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dabfff700 1 -- 172.21.15.123:0/3909197222 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db40045d0 con 0x7f6dc40c0e40 2024-09-13T17:06:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.446+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3909197222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc40c5750 con 0x7f6dc40c0e40 2024-09-13T17:06:59.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.450+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3909197222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc40c37f0 con 0x7f6dc40c0e40 2024-09-13T17:06:59.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.450+0000 7f6dabfff700 1 -- 172.21.15.123:0/3909197222 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6db40036c0 con 0x7f6dc40c0e40 2024-09-13T17:06:59.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.450+0000 7f6dabfff700 1 --2- 172.21.15.123:0/3909197222 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6db0066730 0x7f6db0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.450+0000 7f6dabfff700 1 -- 172.21.15.123:0/3909197222 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6db4084730 con 0x7f6dc40c0e40 2024-09-13T17:06:59.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.450+0000 7f6dc37fe700 1 --2- 172.21.15.123:0/3909197222 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6db0066730 0x7f6db0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.450+0000 7f6dc37fe700 1 --2- 172.21.15.123:0/3909197222 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6db0066730 0x7f6db0068bf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009c70 tx=0x7f6db8009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:59.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.458+0000 7f6dabfff700 1 -- 172.21.15.123:0/3909197222 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6dc40c37f0 con 0x7f6dc40c0e40 2024-09-13T17:06:59.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.622+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3909197222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6dc40c37f0 con 0x7f6dc40c0e40 2024-09-13T17:06:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.622+0000 7f6dabfff700 1 -- 172.21.15.123:0/3909197222 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6dc40c37f0 con 0x7f6dc40c0e40 2024-09-13T17:06:59.629 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:06:59.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.626+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3909197222 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6db0066730 msgr2=0x7f6db0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.626+0000 7f6dc8d17700 1 --2- 172.21.15.123:0/3909197222 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6db0066730 0x7f6db0068bf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009c70 tx=0x7f6db8009240 comp rx=0 tx=0).stop 2024-09-13T17:06:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.626+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3909197222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc40c0e40 msgr2=0x7f6dc40c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.626+0000 7f6dc8d17700 1 --2- 172.21.15.123:0/3909197222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc40c0e40 0x7f6dc40c8040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6db4011a00 tx=0x7f6db4011dc0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.626+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3909197222 shutdown_connections 2024-09-13T17:06:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.626+0000 7f6dc8d17700 1 --2- 172.21.15.123:0/3909197222 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6db0066730 0x7f6db0068bf0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.626+0000 7f6dc8d17700 1 --2- 172.21.15.123:0/3909197222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6dc4163510 0x7f6dc41639c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.626+0000 7f6dc8d17700 1 --2- 172.21.15.123:0/3909197222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dc40c0e40 0x7f6dc40c8040 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.626+0000 7f6dc8d17700 1 --2- 172.21.15.123:0/3909197222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dc40c0a60 0x7f6dc40c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.626+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3909197222 >> 172.21.15.123:0/3909197222 conn(0x7f6dc40b01d0 msgr2=0x7f6dc40ae220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.626+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3909197222 shutdown_connections 2024-09-13T17:06:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.626+0000 7f6dc8d17700 1 -- 172.21.15.123:0/3909197222 wait complete. 2024-09-13T17:06:59.643 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:06:59.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.758+0000 7f3711f34700 1 Processor -- start 2024-09-13T17:06:59.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.758+0000 7f3711f34700 1 -- start start 2024-09-13T17:06:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.758+0000 7f3711f34700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f370c159c60 0x7f370c15e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.758+0000 7f3711f34700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f370c070f90 0x7f370c0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.758+0000 7f3711f34700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c0ada60 con 0x7f370c0cdbd0 2024-09-13T17:06:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.758+0000 7f3711f34700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c0ce060 con 0x7f370c159c60 2024-09-13T17:06:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.758+0000 7f3711f34700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c15e680 con 0x7f370c070f90 2024-09-13T17:06:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.758+0000 7f3710f32700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f370c159c60 0x7f370c15e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.758+0000 7f370bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f370c070f90 0x7f370c0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.758+0000 7f3711733700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f370c0cdbd0 0x7f370c0cb090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:48510/0 (socket says 172.21.15.123:48510) 2024-09-13T17:06:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.758+0000 7f3711733700 1 -- 172.21.15.123:0/2057741324 learned_addr learned my addr 172.21.15.123:0/2057741324 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:06:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f370bfff700 1 -- 172.21.15.123:0/2057741324 >> v2:172.21.15.153:3300/0 conn(0x7f370c159c60 msgr2=0x7f370c15e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:06:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f370bfff700 1 --2- 172.21.15.123:0/2057741324 >> v2:172.21.15.153:3300/0 conn(0x7f370c159c60 0x7f370c15e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f370bfff700 1 -- 172.21.15.123:0/2057741324 >> v1:172.21.15.153:6789/0 conn(0x7f370c0cdbd0 legacy=0x7f370c0cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f370b7fe700 1 -- 172.21.15.123:0/2057741324 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578772332 0 0) 0x7f370c0ada60 con 0x7f370c0cdbd0 2024-09-13T17:06:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f370bfff700 1 -- 172.21.15.123:0/2057741324 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c0720a0 con 0x7f370c070f90 2024-09-13T17:06:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f3710f32700 1 --2- 172.21.15.123:0/2057741324 >> v2:172.21.15.153:3300/0 conn(0x7f370c159c60 0x7f370c15e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f370bfff700 1 --2- 172.21.15.123:0/2057741324 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f370c070f90 0x7f370c0cd690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3700009850 tx=0x7f3700009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79efb2c967c89011 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f370b7fe700 1 -- 172.21.15.123:0/2057741324 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3700011830 con 0x7f370c070f90 2024-09-13T17:06:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f370b7fe700 1 -- 172.21.15.123:0/2057741324 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3700011990 con 0x7f370c070f90 2024-09-13T17:06:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f370b7fe700 1 -- 172.21.15.123:0/2057741324 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3700011d40 con 0x7f370c070f90 2024-09-13T17:06:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f3711f34700 1 -- 172.21.15.123:0/2057741324 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f370c070f90 msgr2=0x7f370c0cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f3711f34700 1 --2- 172.21.15.123:0/2057741324 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f370c070f90 0x7f370c0cd690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3700009850 tx=0x7f3700009b60 comp rx=0 tx=0).stop 2024-09-13T17:06:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f3711f34700 1 -- 172.21.15.123:0/2057741324 shutdown_connections 2024-09-13T17:06:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f3711f34700 1 --2- 172.21.15.123:0/2057741324 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f370c070f90 0x7f370c0cd690 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f3711f34700 1 --2- 172.21.15.123:0/2057741324 >> v2:172.21.15.153:3300/0 conn(0x7f370c159c60 0x7f370c15e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f3711f34700 1 -- 172.21.15.123:0/2057741324 >> 172.21.15.123:0/2057741324 conn(0x7f370c0b01d0 msgr2=0x7f370c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f3711f34700 1 -- 172.21.15.123:0/2057741324 shutdown_connections 2024-09-13T17:06:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f3711f34700 1 -- 172.21.15.123:0/2057741324 wait complete. 2024-09-13T17:06:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f3711f34700 1 Processor -- start 2024-09-13T17:06:59.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.762+0000 7f3711f34700 1 -- start start 2024-09-13T17:06:59.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f3711f34700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f370c070f90 0x7f370c14c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f3711f34700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f370c0cdbd0 0x7f370c0b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f3711f34700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f370c159c60 0x7f370c0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f3711f34700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0af460 con 0x7f370c0cdbd0 2024-09-13T17:06:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f3711f34700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c152c10 con 0x7f370c070f90 2024-09-13T17:06:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f3711f34700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0af720 con 0x7f370c159c60 2024-09-13T17:06:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f370bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f370c0cdbd0 0x7f370c0b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f370bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f370c0cdbd0 0x7f370c0b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46870/0 (socket says 172.21.15.123:46870) 2024-09-13T17:06:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f370bfff700 1 -- 172.21.15.123:0/3920912165 learned_addr learned my addr 172.21.15.123:0/3920912165 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:06:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f3710f32700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f370c070f90 0x7f370c14c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f3711733700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f370c159c60 0x7f370c0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f370bfff700 1 -- 172.21.15.123:0/3920912165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f370c159c60 msgr2=0x7f370c0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f370bfff700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f370c159c60 0x7f370c0ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f370bfff700 1 -- 172.21.15.123:0/3920912165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f370c070f90 msgr2=0x7f370c14c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f370bfff700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f370c070f90 0x7f370c14c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f370bfff700 1 -- 172.21.15.123:0/3920912165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc009a70 con 0x7f370c0cdbd0 2024-09-13T17:06:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f3710f32700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f370c070f90 0x7f370c14c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:06:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f370bfff700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f370c0cdbd0 0x7f370c0b14d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3700000c00 tx=0x7f3700004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f37097fa700 1 -- 172.21.15.123:0/3920912165 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370001a990 con 0x7f370c0cdbd0 2024-09-13T17:06:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f37097fa700 1 -- 172.21.15.123:0/3920912165 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370001f070 con 0x7f370c0cdbd0 2024-09-13T17:06:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f3711f34700 1 -- 172.21.15.123:0/3920912165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37000094b0 con 0x7f370c0cdbd0 2024-09-13T17:06:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f37097fa700 1 -- 172.21.15.123:0/3920912165 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370001ad30 con 0x7f370c0cdbd0 2024-09-13T17:06:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f3711f34700 1 -- 172.21.15.123:0/3920912165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c1f3700 con 0x7f370c0cdbd0 2024-09-13T17:06:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.766+0000 7f3711f34700 1 -- 172.21.15.123:0/3920912165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c0afc40 con 0x7f370c0cdbd0 2024-09-13T17:06:59.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.770+0000 7f37097fa700 1 -- 172.21.15.123:0/3920912165 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f370002e450 con 0x7f370c0cdbd0 2024-09-13T17:06:59.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.770+0000 7f37097fa700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f36f8066730 0x7f36f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:59.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.770+0000 7f3710f32700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f36f8066730 0x7f36f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:59.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.770+0000 7f37097fa700 1 -- 172.21.15.123:0/3920912165 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37000855b0 con 0x7f370c0cdbd0 2024-09-13T17:06:59.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.770+0000 7f3710f32700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f36f8066730 0x7f36f8068bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009fd0 tx=0x7f36fc00b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:59.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.778+0000 7f37097fa700 1 -- 172.21.15.123:0/3920912165 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3700052910 con 0x7f370c0cdbd0 2024-09-13T17:06:59.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.942+0000 7f3711f34700 1 -- 172.21.15.123:0/3920912165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f370c1f3950 con 0x7f370c0cdbd0 2024-09-13T17:06:59.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.942+0000 7f37097fa700 1 -- 172.21.15.123:0/3920912165 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3700015020 con 0x7f370c0cdbd0 2024-09-13T17:06:59.949 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:06:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.946+0000 7f3711f34700 1 -- 172.21.15.123:0/3920912165 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f36f8066730 msgr2=0x7f36f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.946+0000 7f3711f34700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f36f8066730 0x7f36f8068bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009fd0 tx=0x7f36fc00b040 comp rx=0 tx=0).stop 2024-09-13T17:06:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.946+0000 7f3711f34700 1 -- 172.21.15.123:0/3920912165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f370c0cdbd0 msgr2=0x7f370c0b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.946+0000 7f3711f34700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f370c0cdbd0 0x7f370c0b14d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3700000c00 tx=0x7f3700004770 comp rx=0 tx=0).stop 2024-09-13T17:06:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.946+0000 7f3711f34700 1 -- 172.21.15.123:0/3920912165 shutdown_connections 2024-09-13T17:06:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.946+0000 7f3711f34700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f36f8066730 0x7f36f8068bf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.946+0000 7f3711f34700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f370c159c60 0x7f370c0ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.946+0000 7f3711f34700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f370c0cdbd0 0x7f370c0b14d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.946+0000 7f3711f34700 1 --2- 172.21.15.123:0/3920912165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f370c070f90 0x7f370c14c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.946+0000 7f3711f34700 1 -- 172.21.15.123:0/3920912165 >> 172.21.15.123:0/3920912165 conn(0x7f370c0b01d0 msgr2=0x7f370c0ada60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.946+0000 7f3711f34700 1 -- 172.21.15.123:0/3920912165 shutdown_connections 2024-09-13T17:06:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:06:59.946+0000 7f3711f34700 1 -- 172.21.15.123:0/3920912165 wait complete. 2024-09-13T17:06:59.963 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:07:00.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 Processor -- start 2024-09-13T17:07:00.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 -- start start 2024-09-13T17:07:00.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8a2015ac60 0x7f8a200af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a200afea0 0x7f8a200cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a200ce190 con 0x7f8a200afa60 2024-09-13T17:07:00.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a200cd610 con 0x7f8a200afea0 2024-09-13T17:07:00.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a200cd8f0 con 0x7f8a2015ac60 2024-09-13T17:07:00.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a25f78700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a200afea0 0x7f8a200cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a25f78700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a200afea0 0x7f8a200cec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46876/0 (socket says 172.21.15.123:46876) 2024-09-13T17:07:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a25f78700 1 -- 172.21.15.123:0/2949348463 learned_addr learned my addr 172.21.15.123:0/2949348463 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a25777700 1 --2- 172.21.15.123:0/2949348463 >> v2:172.21.15.153:3300/0 conn(0x7f8a2015ac60 0x7f8a200af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a25f78700 1 -- 172.21.15.123:0/2949348463 >> v2:172.21.15.153:3300/0 conn(0x7f8a2015ac60 msgr2=0x7f8a200af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a25f78700 1 --2- 172.21.15.123:0/2949348463 >> v2:172.21.15.153:3300/0 conn(0x7f8a2015ac60 0x7f8a200af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a25f78700 1 -- 172.21.15.123:0/2949348463 >> v1:172.21.15.153:6789/0 conn(0x7f8a200afa60 legacy=0x7f8a200ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a25f78700 1 -- 172.21.15.123:0/2949348463 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a200cdbd0 con 0x7f8a200afea0 2024-09-13T17:07:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a25f78700 1 --2- 172.21.15.123:0/2949348463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a200afea0 0x7f8a200cec30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8a200670f0 tx=0x7f8a1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca323f2c28f22dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a17fff700 1 -- 172.21.15.123:0/2949348463 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1800e070 con 0x7f8a200afea0 2024-09-13T17:07:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a17fff700 1 -- 172.21.15.123:0/2949348463 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1800b9c0 con 0x7f8a200afea0 2024-09-13T17:07:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a17fff700 1 -- 172.21.15.123:0/2949348463 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1800bd70 con 0x7f8a200afea0 2024-09-13T17:07:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 -- 172.21.15.123:0/2949348463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a200afea0 msgr2=0x7f8a200cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 --2- 172.21.15.123:0/2949348463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a200afea0 0x7f8a200cec30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8a200670f0 tx=0x7f8a1800b330 comp rx=0 tx=0).stop 2024-09-13T17:07:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 -- 172.21.15.123:0/2949348463 shutdown_connections 2024-09-13T17:07:00.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 --2- 172.21.15.123:0/2949348463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a200afea0 0x7f8a200cec30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 --2- 172.21.15.123:0/2949348463 >> v2:172.21.15.153:3300/0 conn(0x7f8a2015ac60 0x7f8a200af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 -- 172.21.15.123:0/2949348463 >> 172.21.15.123:0/2949348463 conn(0x7f8a200b24c0 msgr2=0x7f8a200b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:00.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 -- 172.21.15.123:0/2949348463 shutdown_connections 2024-09-13T17:07:00.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.074+0000 7f8a26779700 1 -- 172.21.15.123:0/2949348463 wait complete. 2024-09-13T17:07:00.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a26779700 1 Processor -- start 2024-09-13T17:07:00.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a26779700 1 -- start start 2024-09-13T17:07:00.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a26779700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a200afa60 0x7f8a200ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a26779700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a200afea0 0x7f8a200c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a26779700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2015ac60 0x7f8a201479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a26779700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200c7f60 con 0x7f8a200afa60 2024-09-13T17:07:00.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a26779700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2015cdd0 con 0x7f8a200afea0 2024-09-13T17:07:00.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a26779700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2015d0b0 con 0x7f8a2015ac60 2024-09-13T17:07:00.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a25777700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a200afa60 0x7f8a200ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a25777700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a200afa60 0x7f8a200ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46888/0 (socket says 172.21.15.123:46888) 2024-09-13T17:07:00.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a25777700 1 -- 172.21.15.123:0/202911047 learned_addr learned my addr 172.21.15.123:0/202911047 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:00.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a24f76700 1 --2- 172.21.15.123:0/202911047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a200afea0 0x7f8a200c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a25f78700 1 --2- 172.21.15.123:0/202911047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2015ac60 0x7f8a201479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a25777700 1 -- 172.21.15.123:0/202911047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2015ac60 msgr2=0x7f8a201479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a25777700 1 --2- 172.21.15.123:0/202911047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2015ac60 0x7f8a201479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a25777700 1 -- 172.21.15.123:0/202911047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a200afea0 msgr2=0x7f8a200c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a25777700 1 --2- 172.21.15.123:0/202911047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a200afea0 0x7f8a200c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a25777700 1 -- 172.21.15.123:0/202911047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a18009b30 con 0x7f8a200afa60 2024-09-13T17:07:00.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a25777700 1 --2- 172.21.15.123:0/202911047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a200afa60 0x7f8a200ca700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00d800 tx=0x7f8a1c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:00.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a15ffb700 1 -- 172.21.15.123:0/202911047 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0126b0 con 0x7f8a200afa60 2024-09-13T17:07:00.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a15ffb700 1 -- 172.21.15.123:0/202911047 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c012810 con 0x7f8a200afa60 2024-09-13T17:07:00.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a26779700 1 -- 172.21.15.123:0/202911047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2015d390 con 0x7f8a200afa60 2024-09-13T17:07:00.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a15ffb700 1 -- 172.21.15.123:0/202911047 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c012bc0 con 0x7f8a200afa60 2024-09-13T17:07:00.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a26779700 1 -- 172.21.15.123:0/202911047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2015d950 con 0x7f8a200afa60 2024-09-13T17:07:00.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.078+0000 7f8a26779700 1 -- 172.21.15.123:0/202911047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2015db40 con 0x7f8a200afa60 2024-09-13T17:07:00.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.082+0000 7f8a15ffb700 1 -- 172.21.15.123:0/202911047 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8a1c012d20 con 0x7f8a200afa60 2024-09-13T17:07:00.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.082+0000 7f8a15ffb700 1 --2- 172.21.15.123:0/202911047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8a04066730 0x7f8a04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.082+0000 7f8a24f76700 1 --2- 172.21.15.123:0/202911047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8a04066730 0x7f8a04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.082+0000 7f8a15ffb700 1 -- 172.21.15.123:0/202911047 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a1c084df0 con 0x7f8a200afa60 2024-09-13T17:07:00.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.082+0000 7f8a24f76700 1 --2- 172.21.15.123:0/202911047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8a04066730 0x7f8a04068bf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8a200cefd0 tx=0x7f8a10009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:00.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.090+0000 7f8a15ffb700 1 -- 172.21.15.123:0/202911047 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8a1c052150 con 0x7f8a200afa60 2024-09-13T17:07:00.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.294+0000 7f8a26779700 1 -- 172.21.15.123:0/202911047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a200b3100 con 0x7f8a200afa60 2024-09-13T17:07:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.294+0000 7f8a15ffb700 1 -- 172.21.15.123:0/202911047 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7f8a1c055770 con 0x7f8a200afa60 2024-09-13T17:07:00.300 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:00.300 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/721071800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":721071800},{"type":"v1","addr":"172.21.15.123:6835","nonce":721071800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1472515409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1472515409},{"type":"v1","addr":"172.21.15.123:6837","nonce":1472515409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3017694841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3017694841},{"type":"v1","addr":"172.21.15.153:6833","nonce":3017694841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:06:48.418287+0000","modified":"2024-09-13T17:06:51.426119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/2848393496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2848393496},{"type":"v1","addr":"172.21.15.153:6835","nonce":2848393496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:07:00.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.298+0000 7f8a26779700 1 -- 172.21.15.123:0/202911047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8a04066730 msgr2=0x7f8a04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.298+0000 7f8a26779700 1 --2- 172.21.15.123:0/202911047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8a04066730 0x7f8a04068bf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8a200cefd0 tx=0x7f8a10009040 comp rx=0 tx=0).stop 2024-09-13T17:07:00.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.298+0000 7f8a26779700 1 -- 172.21.15.123:0/202911047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a200afa60 msgr2=0x7f8a200ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.298+0000 7f8a26779700 1 --2- 172.21.15.123:0/202911047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a200afa60 0x7f8a200ca700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00d800 tx=0x7f8a1c00db10 comp rx=0 tx=0).stop 2024-09-13T17:07:00.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.298+0000 7f8a26779700 1 -- 172.21.15.123:0/202911047 shutdown_connections 2024-09-13T17:07:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.298+0000 7f8a26779700 1 --2- 172.21.15.123:0/202911047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8a04066730 0x7f8a04068bf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.298+0000 7f8a26779700 1 --2- 172.21.15.123:0/202911047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a2015ac60 0x7f8a201479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.298+0000 7f8a26779700 1 --2- 172.21.15.123:0/202911047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a200afea0 0x7f8a200c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.298+0000 7f8a26779700 1 --2- 172.21.15.123:0/202911047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a200afa60 0x7f8a200ca700 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.298+0000 7f8a26779700 1 -- 172.21.15.123:0/202911047 >> 172.21.15.123:0/202911047 conn(0x7f8a200b24c0 msgr2=0x7f8a20073f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.298+0000 7f8a26779700 1 -- 172.21.15.123:0/202911047 shutdown_connections 2024-09-13T17:07:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.298+0000 7f8a26779700 1 -- 172.21.15.123:0/202911047 wait complete. 2024-09-13T17:07:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 7 2024-09-13T17:07:00.320 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722b46700 1 Processor -- start 2024-09-13T17:07:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722b46700 1 -- start start 2024-09-13T17:07:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722b46700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe71c0ce1c0 0x7fe71c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722b46700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe71c0d14f0 0x7fe71c0b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722b46700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71c0cea60 con 0x7fe71c15cc00 2024-09-13T17:07:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722b46700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71c0d19a0 con 0x7fe71c0d14f0 2024-09-13T17:07:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722b46700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0ce780 con 0x7fe71c0ce1c0 2024-09-13T17:07:00.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe721343700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe71c0ce1c0 0x7fe71c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722345700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe71c0d14f0 0x7fe71c0b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe721343700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe71c0ce1c0 0x7fe71c0d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:38020/0 (socket says 172.21.15.123:38020) 2024-09-13T17:07:00.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe721343700 1 -- 172.21.15.123:0/1629407876 learned_addr learned my addr 172.21.15.123:0/1629407876 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:00.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722345700 1 -- 172.21.15.123:0/1629407876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe71c0ce1c0 msgr2=0x7fe71c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:00.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722345700 1 --2- 172.21.15.123:0/1629407876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe71c0ce1c0 0x7fe71c0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722345700 1 -- 172.21.15.123:0/1629407876 >> v1:172.21.15.153:6789/0 conn(0x7fe71c15cc00 legacy=0x7fe71c0d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722345700 1 -- 172.21.15.123:0/1629407876 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c0af710 con 0x7fe71c0d14f0 2024-09-13T17:07:00.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722345700 1 --2- 172.21.15.123:0/1629407876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe71c0d14f0 0x7fe71c0b01f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe714009d90 tx=0x7fe71400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70f6d5d6f6cbe6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:00.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe720b42700 1 -- 172.21.15.123:0/1629407876 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71400e070 con 0x7fe71c0d14f0 2024-09-13T17:07:00.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe720b42700 1 -- 172.21.15.123:0/1629407876 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71400bb20 con 0x7fe71c0d14f0 2024-09-13T17:07:00.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe720b42700 1 -- 172.21.15.123:0/1629407876 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe714012430 con 0x7fe71c0d14f0 2024-09-13T17:07:00.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722b46700 1 -- 172.21.15.123:0/1629407876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe71c0d14f0 msgr2=0x7fe71c0b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722b46700 1 --2- 172.21.15.123:0/1629407876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe71c0d14f0 0x7fe71c0b01f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe714009d90 tx=0x7fe71400b330 comp rx=0 tx=0).stop 2024-09-13T17:07:00.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722b46700 1 -- 172.21.15.123:0/1629407876 shutdown_connections 2024-09-13T17:07:00.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722b46700 1 --2- 172.21.15.123:0/1629407876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe71c0d14f0 0x7fe71c0b01f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722b46700 1 --2- 172.21.15.123:0/1629407876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe71c0ce1c0 0x7fe71c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.426+0000 7fe722b46700 1 -- 172.21.15.123:0/1629407876 >> 172.21.15.123:0/1629407876 conn(0x7fe71c0d2a80 msgr2=0x7fe71c0d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:00.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe722b46700 1 -- 172.21.15.123:0/1629407876 shutdown_connections 2024-09-13T17:07:00.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe722b46700 1 -- 172.21.15.123:0/1629407876 wait complete. 2024-09-13T17:07:00.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe722b46700 1 Processor -- start 2024-09-13T17:07:00.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe722b46700 1 -- start start 2024-09-13T17:07:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe722b46700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c0ce1c0 0x7fe71c0cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe722b46700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe71c0d14f0 0x7fe71c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe722b46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe71c15cc00 0x7fe71c1f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe722b46700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c15bd50 con 0x7fe71c0ce1c0 2024-09-13T17:07:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe722b46700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0caac0 con 0x7fe71c15cc00 2024-09-13T17:07:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe722b46700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0cb360 con 0x7fe71c0d14f0 2024-09-13T17:07:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe721b44700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c0ce1c0 0x7fe71c0cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe721b44700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c0ce1c0 0x7fe71c0cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46894/0 (socket says 172.21.15.123:46894) 2024-09-13T17:07:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe721b44700 1 -- 172.21.15.123:0/2255532581 learned_addr learned my addr 172.21.15.123:0/2255532581 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe721343700 1 --2- 172.21.15.123:0/2255532581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe71c0d14f0 0x7fe71c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe722345700 1 --2- 172.21.15.123:0/2255532581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe71c15cc00 0x7fe71c1f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe721b44700 1 -- 172.21.15.123:0/2255532581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe71c0d14f0 msgr2=0x7fe71c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe721b44700 1 --2- 172.21.15.123:0/2255532581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe71c0d14f0 0x7fe71c15b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe721b44700 1 -- 172.21.15.123:0/2255532581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe71c15cc00 msgr2=0x7fe71c1f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe721b44700 1 --2- 172.21.15.123:0/2255532581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe71c15cc00 0x7fe71c1f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe721b44700 1 -- 172.21.15.123:0/2255532581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe714009a70 con 0x7fe71c0ce1c0 2024-09-13T17:07:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.430+0000 7fe721b44700 1 --2- 172.21.15.123:0/2255532581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c0ce1c0 0x7fe71c0cca60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe71800c530 tx=0x7fe71800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.434+0000 7fe7127fc700 1 -- 172.21.15.123:0/2255532581 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71800cea0 con 0x7fe71c0ce1c0 2024-09-13T17:07:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.434+0000 7fe7127fc700 1 -- 172.21.15.123:0/2255532581 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7180052d0 con 0x7fe71c0ce1c0 2024-09-13T17:07:00.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.434+0000 7fe7127fc700 1 -- 172.21.15.123:0/2255532581 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180036a0 con 0x7fe71c0ce1c0 2024-09-13T17:07:00.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.434+0000 7fe722b46700 1 -- 172.21.15.123:0/2255532581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71c15d160 con 0x7fe71c0ce1c0 2024-09-13T17:07:00.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.434+0000 7fe722b46700 1 -- 172.21.15.123:0/2255532581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c0cad10 con 0x7fe71c0ce1c0 2024-09-13T17:07:00.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.434+0000 7fe722b46700 1 -- 172.21.15.123:0/2255532581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71c0cdfa0 con 0x7fe71c0ce1c0 2024-09-13T17:07:00.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.434+0000 7fe7127fc700 1 -- 172.21.15.123:0/2255532581 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe718003800 con 0x7fe71c0ce1c0 2024-09-13T17:07:00.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.434+0000 7fe7127fc700 1 --2- 172.21.15.123:0/2255532581 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe700066730 0x7fe700068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.434+0000 7fe7127fc700 1 -- 172.21.15.123:0/2255532581 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe718083510 con 0x7fe71c0ce1c0 2024-09-13T17:07:00.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.434+0000 7fe721343700 1 --2- 172.21.15.123:0/2255532581 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe700066730 0x7fe700068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.434+0000 7fe721343700 1 --2- 172.21.15.123:0/2255532581 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe700066730 0x7fe700068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0b4fd0 tx=0x7fe70c0092e0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:00.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.442+0000 7fe7127fc700 1 -- 172.21.15.123:0/2255532581 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe7180507f0 con 0x7fe71c0ce1c0 2024-09-13T17:07:00.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.614+0000 7fe722b46700 1 -- 172.21.15.123:0/2255532581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe71c08cb10 con 0x7fe71c0ce1c0 2024-09-13T17:07:00.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.614+0000 7fe7127fc700 1 -- 172.21.15.123:0/2255532581 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7fe718053e10 con 0x7fe71c0ce1c0 2024-09-13T17:07:00.621 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:00.621 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.618+0000 7fe722b46700 1 -- 172.21.15.123:0/2255532581 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe700066730 msgr2=0x7fe700068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.618+0000 7fe722b46700 1 --2- 172.21.15.123:0/2255532581 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe700066730 0x7fe700068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0b4fd0 tx=0x7fe70c0092e0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.618+0000 7fe722b46700 1 -- 172.21.15.123:0/2255532581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c0ce1c0 msgr2=0x7fe71c0cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.618+0000 7fe722b46700 1 --2- 172.21.15.123:0/2255532581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c0ce1c0 0x7fe71c0cca60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe71800c530 tx=0x7fe71800c840 comp rx=0 tx=0).stop 2024-09-13T17:07:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.618+0000 7fe722b46700 1 -- 172.21.15.123:0/2255532581 shutdown_connections 2024-09-13T17:07:00.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.618+0000 7fe722b46700 1 --2- 172.21.15.123:0/2255532581 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe700066730 0x7fe700068bf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.618+0000 7fe722b46700 1 --2- 172.21.15.123:0/2255532581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe71c15cc00 0x7fe71c1f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.618+0000 7fe722b46700 1 --2- 172.21.15.123:0/2255532581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe71c0d14f0 0x7fe71c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.618+0000 7fe722b46700 1 --2- 172.21.15.123:0/2255532581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c0ce1c0 0x7fe71c0cca60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.618+0000 7fe722b46700 1 -- 172.21.15.123:0/2255532581 >> 172.21.15.123:0/2255532581 conn(0x7fe71c0d2a80 msgr2=0x7fe71c0b6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:00.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.618+0000 7fe722b46700 1 -- 172.21.15.123:0/2255532581 shutdown_connections 2024-09-13T17:07:00.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.618+0000 7fe722b46700 1 -- 172.21.15.123:0/2255532581 wait complete. 2024-09-13T17:07:00.636 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:07:00.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.734+0000 7fdce21a1700 1 Processor -- start 2024-09-13T17:07:00.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce21a1700 1 -- start start 2024-09-13T17:07:00.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce21a1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdcdc153390 0x7fdcdc159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce21a1700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcdc0cdb70 0x7fdcdc0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce21a1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc15a4c0 con 0x7fdcdc153770 2024-09-13T17:07:00.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce21a1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc1595a0 con 0x7fdcdc153390 2024-09-13T17:07:00.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce21a1700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0cb730 con 0x7fdcdc0cdb70 2024-09-13T17:07:00.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce119f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdcdc153390 0x7fdcdc159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce119f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdcdc153390 0x7fdcdc159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46908/0 (socket says 172.21.15.123:46908) 2024-09-13T17:07:00.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce119f700 1 -- 172.21.15.123:0/2745143908 learned_addr learned my addr 172.21.15.123:0/2745143908 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:00.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce099e700 1 --2- 172.21.15.123:0/2745143908 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcdc0cdb70 0x7fdcdc0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce119f700 1 -- 172.21.15.123:0/2745143908 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcdc0cdb70 msgr2=0x7fdcdc0cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:00.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce119f700 1 --2- 172.21.15.123:0/2745143908 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcdc0cdb70 0x7fdcdc0cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce119f700 1 -- 172.21.15.123:0/2745143908 >> v1:172.21.15.153:6789/0 conn(0x7fdcdc153770 legacy=0x7fdcdc0ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce119f700 1 -- 172.21.15.123:0/2745143908 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc0cba10 con 0x7fdcdc153390 2024-09-13T17:07:00.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce099e700 1 --2- 172.21.15.123:0/2745143908 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcdc0cdb70 0x7fdcdc0cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:00.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdce119f700 1 --2- 172.21.15.123:0/2745143908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcdc153390 0x7fdcdc159f80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009910 tx=0x7fdcd8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7650454d46ac7282 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:00.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.738+0000 7fdcd3fff700 1 -- 172.21.15.123:0/2745143908 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800ba60 con 0x7fdcdc153390 2024-09-13T17:07:00.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.742+0000 7fdcd3fff700 1 -- 172.21.15.123:0/2745143908 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd800bbc0 con 0x7fdcdc153390 2024-09-13T17:07:00.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.742+0000 7fdcd3fff700 1 -- 172.21.15.123:0/2745143908 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8009e60 con 0x7fdcdc153390 2024-09-13T17:07:00.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.742+0000 7fdce21a1700 1 -- 172.21.15.123:0/2745143908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcdc153390 msgr2=0x7fdcdc159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.742+0000 7fdce21a1700 1 --2- 172.21.15.123:0/2745143908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcdc153390 0x7fdcdc159f80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009910 tx=0x7fdcd8009c20 comp rx=0 tx=0).stop 2024-09-13T17:07:00.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.742+0000 7fdce21a1700 1 -- 172.21.15.123:0/2745143908 shutdown_connections 2024-09-13T17:07:00.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.742+0000 7fdce21a1700 1 --2- 172.21.15.123:0/2745143908 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcdc0cdb70 0x7fdcdc0cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.742+0000 7fdce21a1700 1 --2- 172.21.15.123:0/2745143908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcdc153390 0x7fdcdc159f80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.742+0000 7fdce21a1700 1 -- 172.21.15.123:0/2745143908 >> 172.21.15.123:0/2745143908 conn(0x7fdcdc066150 msgr2=0x7fdcdc066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:00.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.742+0000 7fdce21a1700 1 -- 172.21.15.123:0/2745143908 shutdown_connections 2024-09-13T17:07:00.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.742+0000 7fdce21a1700 1 -- 172.21.15.123:0/2745143908 wait complete. 2024-09-13T17:07:00.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.742+0000 7fdce21a1700 1 Processor -- start 2024-09-13T17:07:00.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.742+0000 7fdce21a1700 1 -- start start 2024-09-13T17:07:00.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce21a1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcdc0cdb70 0x7fdcdc1edc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce21a1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcdc153390 0x7fdcdc1ee180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce21a1700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcdc153770 0x7fdcdc155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce21a1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc1f28a0 con 0x7fdcdc0cdb70 2024-09-13T17:07:00.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce21a1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc1ee7b0 con 0x7fdcdc153390 2024-09-13T17:07:00.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce21a1700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc1eea90 con 0x7fdcdc153770 2024-09-13T17:07:00.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce119f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcdc0cdb70 0x7fdcdc1edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce119f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcdc0cdb70 0x7fdcdc1edc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46918/0 (socket says 172.21.15.123:46918) 2024-09-13T17:07:00.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce119f700 1 -- 172.21.15.123:0/3216067529 learned_addr learned my addr 172.21.15.123:0/3216067529 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:00.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce099e700 1 --2- 172.21.15.123:0/3216067529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcdc153390 0x7fdcdc1ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce19a0700 1 --2- 172.21.15.123:0/3216067529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcdc153770 0x7fdcdc155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce119f700 1 -- 172.21.15.123:0/3216067529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcdc153770 msgr2=0x7fdcdc155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce119f700 1 --2- 172.21.15.123:0/3216067529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcdc153770 0x7fdcdc155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce119f700 1 -- 172.21.15.123:0/3216067529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcdc153390 msgr2=0x7fdcdc1ee180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce119f700 1 --2- 172.21.15.123:0/3216067529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcdc153390 0x7fdcdc1ee180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce119f700 1 -- 172.21.15.123:0/3216067529 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd8009570 con 0x7fdcdc0cdb70 2024-09-13T17:07:00.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce119f700 1 --2- 172.21.15.123:0/3216067529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcdc0cdb70 0x7fdcdc1edc40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8000c00 tx=0x7fdcd8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:00.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdcd1ffb700 1 -- 172.21.15.123:0/3216067529 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd801c850 con 0x7fdcdc0cdb70 2024-09-13T17:07:00.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdcd1ffb700 1 -- 172.21.15.123:0/3216067529 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd801c9b0 con 0x7fdcdc0cdb70 2024-09-13T17:07:00.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdcd1ffb700 1 -- 172.21.15.123:0/3216067529 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd801cd40 con 0x7fdcdc0cdb70 2024-09-13T17:07:00.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce21a1700 1 -- 172.21.15.123:0/3216067529 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc1eed70 con 0x7fdcdc0cdb70 2024-09-13T17:07:00.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce21a1700 1 -- 172.21.15.123:0/3216067529 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc155ac0 con 0x7fdcdc0cdb70 2024-09-13T17:07:00.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.746+0000 7fdce21a1700 1 -- 172.21.15.123:0/3216067529 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc0677f0 con 0x7fdcdc0cdb70 2024-09-13T17:07:00.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.750+0000 7fdcd1ffb700 1 -- 172.21.15.123:0/3216067529 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdcd8024070 con 0x7fdcdc0cdb70 2024-09-13T17:07:00.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.750+0000 7fdcd1ffb700 1 --2- 172.21.15.123:0/3216067529 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdcc0066730 0x7fdcc0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:00.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.750+0000 7fdce099e700 1 --2- 172.21.15.123:0/3216067529 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdcc0066730 0x7fdcc0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:00.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.750+0000 7fdcd1ffb700 1 -- 172.21.15.123:0/3216067529 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcd8087180 con 0x7fdcdc0cdb70 2024-09-13T17:07:00.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.750+0000 7fdce099e700 1 --2- 172.21.15.123:0/3216067529 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdcc0066730 0x7fdcc0068bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc15a440 tx=0x7fdccc008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:00.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.758+0000 7fdcd1ffb700 1 -- 172.21.15.123:0/3216067529 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdcd8054500 con 0x7fdcdc0cdb70 2024-09-13T17:07:00.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.946+0000 7fdce21a1700 1 -- 172.21.15.123:0/3216067529 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcdc0adf80 con 0x7fdcdc0cdb70 2024-09-13T17:07:00.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.946+0000 7fdcd1ffb700 1 -- 172.21.15.123:0/3216067529 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7fdcd8057b20 con 0x7fdcdc0cdb70 2024-09-13T17:07:00.953 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:00.954 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/721071800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":721071800},{"type":"v1","addr":"172.21.15.123:6835","nonce":721071800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1472515409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1472515409},{"type":"v1","addr":"172.21.15.123:6837","nonce":1472515409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3017694841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3017694841},{"type":"v1","addr":"172.21.15.153:6833","nonce":3017694841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:06:48.418287+0000","modified":"2024-09-13T17:06:51.426119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/2848393496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2848393496},{"type":"v1","addr":"172.21.15.153:6835","nonce":2848393496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:07:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.950+0000 7fdce21a1700 1 -- 172.21.15.123:0/3216067529 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdcc0066730 msgr2=0x7fdcc0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.950+0000 7fdce21a1700 1 --2- 172.21.15.123:0/3216067529 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdcc0066730 0x7fdcc0068bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc15a440 tx=0x7fdccc008040 comp rx=0 tx=0).stop 2024-09-13T17:07:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.950+0000 7fdce21a1700 1 -- 172.21.15.123:0/3216067529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcdc0cdb70 msgr2=0x7fdcdc1edc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.950+0000 7fdce21a1700 1 --2- 172.21.15.123:0/3216067529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcdc0cdb70 0x7fdcdc1edc40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8000c00 tx=0x7fdcd8004770 comp rx=0 tx=0).stop 2024-09-13T17:07:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.950+0000 7fdce21a1700 1 -- 172.21.15.123:0/3216067529 shutdown_connections 2024-09-13T17:07:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.950+0000 7fdce21a1700 1 --2- 172.21.15.123:0/3216067529 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdcc0066730 0x7fdcc0068bf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.950+0000 7fdce21a1700 1 --2- 172.21.15.123:0/3216067529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdcdc153770 0x7fdcdc155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.950+0000 7fdce21a1700 1 --2- 172.21.15.123:0/3216067529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcdc153390 0x7fdcdc1ee180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.950+0000 7fdce21a1700 1 --2- 172.21.15.123:0/3216067529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcdc0cdb70 0x7fdcdc1edc40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.950+0000 7fdce21a1700 1 -- 172.21.15.123:0/3216067529 >> 172.21.15.123:0/3216067529 conn(0x7fdcdc066150 msgr2=0x7fdcdc0b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:00.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.950+0000 7fdce21a1700 1 -- 172.21.15.123:0/3216067529 shutdown_connections 2024-09-13T17:07:00.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:00.950+0000 7fdce21a1700 1 -- 172.21.15.123:0/3216067529 wait complete. 2024-09-13T17:07:00.957 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 7 2024-09-13T17:07:01.370 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:06:48.418287+0000', 'modified': '2024-09-13T17:06:51.426119+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6835/2848393496', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 2848393496}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 2848393496}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:07:01.371 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:07:01.371 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T17:07:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdceefe0700 1 Processor -- start 2024-09-13T17:07:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdceefe0700 1 -- start start 2024-09-13T17:07:01.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdceefe0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdce80d0f40 0x7fdce80d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdceefe0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdce80b58b0 0x7fdce80d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdceefe0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdce80b1100 0x7fdce80b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdceefe0700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce80b0060 con 0x7fdce80b58b0 2024-09-13T17:07:01.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdceefe0700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce80b0340 con 0x7fdce80b1100 2024-09-13T17:07:01.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdceefe0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80b0620 con 0x7fdce80d0f40 2024-09-13T17:07:01.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdced7dd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdce80b58b0 0x7fdce80d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdcedfde700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdce80d0f40 0x7fdce80d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdcedfde700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdce80d0f40 0x7fdce80d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:38050/0 (socket says 172.21.15.123:38050) 2024-09-13T17:07:01.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdcedfde700 1 -- 172.21.15.123:0/784880804 learned_addr learned my addr 172.21.15.123:0/784880804 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:01.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdcee7df700 1 --2- 172.21.15.123:0/784880804 >> v2:172.21.15.153:3300/0 conn(0x7fdce80b1100 0x7fdce80b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdcee7df700 1 -- 172.21.15.123:0/784880804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdce80d0f40 msgr2=0x7fdce80d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:01.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdcee7df700 1 --2- 172.21.15.123:0/784880804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdce80d0f40 0x7fdce80d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdcee7df700 1 -- 172.21.15.123:0/784880804 >> v2:172.21.15.123:3300/0 conn(0x7fdce80b58b0 msgr2=0x7fdce80d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdcee7df700 1 --2- 172.21.15.123:0/784880804 >> v2:172.21.15.123:3300/0 conn(0x7fdce80b58b0 0x7fdce80d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdcee7df700 1 -- 172.21.15.123:0/784880804 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce80b0900 con 0x7fdce80b1100 2024-09-13T17:07:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdced7dd700 1 --2- 172.21.15.123:0/784880804 >> v2:172.21.15.123:3300/0 conn(0x7fdce80b58b0 0x7fdce80d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdcedfde700 1 --2- 172.21.15.123:0/784880804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdce80d0f40 0x7fdce80d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdcee7df700 1 --2- 172.21.15.123:0/784880804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdce80b1100 0x7fdce80b1550 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdce80d28f0 tx=0x7fdce4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e19f3327af591d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdcecfdc700 1 -- 172.21.15.123:0/784880804 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4011830 con 0x7fdce80b1100 2024-09-13T17:07:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdcecfdc700 1 -- 172.21.15.123:0/784880804 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce4011990 con 0x7fdce80b1100 2024-09-13T17:07:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.490+0000 7fdcecfdc700 1 -- 172.21.15.123:0/784880804 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4011d20 con 0x7fdce80b1100 2024-09-13T17:07:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 -- 172.21.15.123:0/784880804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdce80b1100 msgr2=0x7fdce80b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 --2- 172.21.15.123:0/784880804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdce80b1100 0x7fdce80b1550 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdce80d28f0 tx=0x7fdce4009b30 comp rx=0 tx=0).stop 2024-09-13T17:07:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 -- 172.21.15.123:0/784880804 shutdown_connections 2024-09-13T17:07:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 --2- 172.21.15.123:0/784880804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdce80b1100 0x7fdce80b1550 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 --2- 172.21.15.123:0/784880804 >> v2:172.21.15.123:3300/0 conn(0x7fdce80b58b0 0x7fdce80d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 --2- 172.21.15.123:0/784880804 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdce80d0f40 0x7fdce80d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 -- 172.21.15.123:0/784880804 >> 172.21.15.123:0/784880804 conn(0x7fdce80d2a60 msgr2=0x7fdce80d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 -- 172.21.15.123:0/784880804 shutdown_connections 2024-09-13T17:07:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 -- 172.21.15.123:0/784880804 wait complete. 2024-09-13T17:07:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 Processor -- start 2024-09-13T17:07:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 -- start start 2024-09-13T17:07:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdce80b1100 0x7fdce80b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce80b58b0 0x7fdce814ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdce80d0f40 0x7fdce815f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce815f250 con 0x7fdce80b58b0 2024-09-13T17:07:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce814f260 con 0x7fdce80b1100 2024-09-13T17:07:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce815e640 con 0x7fdce80d0f40 2024-09-13T17:07:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdced7dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce80b58b0 0x7fdce814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdced7dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce80b58b0 0x7fdce814ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46942/0 (socket says 172.21.15.123:46942) 2024-09-13T17:07:01.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdced7dd700 1 -- 172.21.15.123:0/1543929442 learned_addr learned my addr 172.21.15.123:0/1543929442 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:01.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdcee7df700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdce80d0f40 0x7fdce815f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdcedfde700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdce80b1100 0x7fdce80b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdced7dd700 1 -- 172.21.15.123:0/1543929442 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdce80d0f40 msgr2=0x7fdce815f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:01.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdced7dd700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdce80d0f40 0x7fdce815f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdced7dd700 1 -- 172.21.15.123:0/1543929442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdce80b1100 msgr2=0x7fdce80b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:01.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdced7dd700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdce80b1100 0x7fdce80b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdced7dd700 1 -- 172.21.15.123:0/1543929442 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd80094b0 con 0x7fdce80b58b0 2024-09-13T17:07:01.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdcedfde700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdce80b1100 0x7fdce80b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:01.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdced7dd700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce80b58b0 0x7fdce814ed20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800e9d0 tx=0x7fdcd800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:01.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdcde7fc700 1 -- 172.21.15.123:0/1543929442 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800c850 con 0x7fdce80b58b0 2024-09-13T17:07:01.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdcde7fc700 1 -- 172.21.15.123:0/1543929442 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd800c9b0 con 0x7fdce80b58b0 2024-09-13T17:07:01.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 -- 172.21.15.123:0/1543929442 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce0009b30 con 0x7fdce80b58b0 2024-09-13T17:07:01.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdcde7fc700 1 -- 172.21.15.123:0/1543929442 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800cd40 con 0x7fdce80b58b0 2024-09-13T17:07:01.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.494+0000 7fdceefe0700 1 -- 172.21.15.123:0/1543929442 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce40094b0 con 0x7fdce80b58b0 2024-09-13T17:07:01.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.498+0000 7fdcde7fc700 1 -- 172.21.15.123:0/1543929442 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdcd8013470 con 0x7fdce80b58b0 2024-09-13T17:07:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.498+0000 7fdcde7fc700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdccc066760 0x7fdccc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.498+0000 7fdcedfde700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdccc066760 0x7fdccc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.498+0000 7fdcde7fc700 1 -- 172.21.15.123:0/1543929442 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcd80842d0 con 0x7fdce80b58b0 2024-09-13T17:07:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.498+0000 7fdcedfde700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdccc066760 0x7fdccc068c20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdce00092e0 tx=0x7fdce000b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 Processor -- start 2024-09-13T17:07:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 -- start start 2024-09-13T17:07:01.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 0x1ec3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ea1e90 0x1e8b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ec3b50 0x1e8bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dead80 con 0x1ea1e90 2024-09-13T17:07:01.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1de8510 con 0x1ec3b50 2024-09-13T17:07:01.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x1de3e00 con 0x1ec3230 2024-09-13T17:07:01.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdced7dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ea1e90 0x1e8b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdced7dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ea1e90 0x1e8b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46948/0 (socket says 172.21.15.123:46948) 2024-09-13T17:07:01.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdced7dd700 1 -- 172.21.15.123:0/1630159333 learned_addr learned my addr 172.21.15.123:0/1630159333 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:01.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcedfde700 1 --2- 172.21.15.123:0/1630159333 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 0x1ec3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcee7df700 1 --2- 172.21.15.123:0/1630159333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ec3b50 0x1e8bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdced7dd700 1 -- 172.21.15.123:0/1630159333 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 msgr2=0x1ec3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:01.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdced7dd700 1 --2- 172.21.15.123:0/1630159333 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 0x1ec3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdced7dd700 1 -- 172.21.15.123:0/1630159333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ec3b50 msgr2=0x1e8bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:01.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdced7dd700 1 --2- 172.21.15.123:0/1630159333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ec3b50 0x1e8bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdced7dd700 1 -- 172.21.15.123:0/1630159333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c56960 con 0x1ea1e90 2024-09-13T17:07:01.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdced7dd700 1 --2- 172.21.15.123:0/1630159333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ea1e90 0x1e8b890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800e9a0 tx=0x7fdcd8055200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5572aff6636a817 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:01.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdccb7fe700 1 -- 172.21.15.123:0/1630159333 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8059130 con 0x1ea1e90 2024-09-13T17:07:01.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdccb7fe700 1 -- 172.21.15.123:0/1630159333 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd806a030 con 0x1ea1e90 2024-09-13T17:07:01.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdccb7fe700 1 -- 172.21.15.123:0/1630159333 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd805d6f0 con 0x1ea1e90 2024-09-13T17:07:01.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1630159333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ea1e90 msgr2=0x1e8b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:01.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1630159333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ea1e90 0x1e8b890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800e9a0 tx=0x7fdcd8055200 comp rx=0 tx=0).stop 2024-09-13T17:07:01.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1630159333 shutdown_connections 2024-09-13T17:07:01.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1630159333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ec3b50 0x1e8bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1630159333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ea1e90 0x1e8b890 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1630159333 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 0x1ec3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1630159333 >> 172.21.15.123:0/1630159333 conn(0x1c0b4d0 msgr2=0x1ea4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:01.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1630159333 shutdown_connections 2024-09-13T17:07:01.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.502+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1630159333 wait complete. 2024-09-13T17:07:01.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcf34f3740 1 -- start start 2024-09-13T17:07:01.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcf34f3740 1 Processor -- start 2024-09-13T17:07:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcf34f3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 0x1ea25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcf34f3740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 0x1ea13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcf34f3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3b50 0x1e7bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcf34f3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1da1730 con 0x1ec3b50 2024-09-13T17:07:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcf34f3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1da75b0 con 0x1ea1e90 2024-09-13T17:07:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcf34f3740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c8faa0 con 0x1ec3230 2024-09-13T17:07:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcf34f3740 10 client.0 _ll_register_callbacks cb 0x1ddd610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:07:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcee7df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3b50 0x1e7bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcee7df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3b50 0x1e7bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46960/0 (socket says 172.21.15.123:46960) 2024-09-13T17:07:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcedfde700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 0x1ea25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdced7dd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 0x1ea13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcee7df700 1 -- 172.21.15.123:0/1517466996 learned_addr learned my addr 172.21.15.123:0/1517466996 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcee7df700 1 -- 172.21.15.123:0/1517466996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 msgr2=0x1ea13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcee7df700 1 --2- 172.21.15.123:0/1517466996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 0x1ea13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcee7df700 1 -- 172.21.15.123:0/1517466996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 msgr2=0x1ea25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcee7df700 1 --2- 172.21.15.123:0/1517466996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 0x1ea25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcee7df700 1 -- 172.21.15.123:0/1517466996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce40094b0 con 0x1ec3b50 2024-09-13T17:07:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdced7dd700 1 --2- 172.21.15.123:0/1517466996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 0x1ea13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcee7df700 1 --2- 172.21.15.123:0/1517466996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3b50 0x1e7bca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009e80 tx=0x7fdce40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ee8bbe8878915e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcc8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-13T17:07:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcc8ff9700 1 -- 172.21.15.123:0/1517466996 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4021070 con 0x1ec3b50 2024-09-13T17:07:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcc8ff9700 1 -- 172.21.15.123:0/1517466996 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdce4011d10 con 0x1ec3b50 2024-09-13T17:07:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1517466996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1c181e0 con 0x1ec3b50 2024-09-13T17:07:01.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcc8ff9700 1 -- 172.21.15.123:0/1517466996 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdce4004040 con 0x1ec3b50 2024-09-13T17:07:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcf34f3740 10 client.4668 fetch_fsmap learned FSMap version 7 2024-09-13T17:07:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1517466996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x1daa220 con 0x1ec3b50 2024-09-13T17:07:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcc8ff9700 1 -- 172.21.15.123:0/1517466996 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1c181e0 con 0x1ec3b50 2024-09-13T17:07:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcc8ff9700 1 -- 172.21.15.123:0/1517466996 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fdce40041a0 con 0x1ec3b50 2024-09-13T17:07:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.506+0000 7fdcf34f3740 10 client.4668 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T17:07:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 10 client.4668 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T17:07:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 20 client.4668 populate_metadata read hostname 'smithi123' 2024-09-13T17:07:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1517466996 >> [v2:172.21.15.153:6834/2848393496,v1:172.21.15.153:6835/2848393496] conn(0x1ea4080 0x1ed6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 4 client.4668 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:07:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1517466996 --> [v2:172.21.15.153:6834/2848393496,v1:172.21.15.153:6835/2848393496] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1c62460 con 0x1ea4080 2024-09-13T17:07:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcedfde700 1 --2- 172.21.15.123:0/1517466996 >> [v2:172.21.15.153:6834/2848393496,v1:172.21.15.153:6835/2848393496] conn(0x1ea4080 0x1ed6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcedfde700 1 --2- 172.21.15.123:0/1517466996 >> [v2:172.21.15.153:6834/2848393496,v1:172.21.15.153:6835/2848393496] conn(0x1ea4080 0x1ed6d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cde56b1dea5b96 server_cookie=d7939388552aec93 in_seq=0 out_seq=0 2024-09-13T17:07:01.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcc8ff9700 10 client.4668 ms_handle_connect on v2:172.21.15.153:6834/2848393496 2024-09-13T17:07:01.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcc8ff9700 1 -- 172.21.15.123:0/1517466996 <== mds.0 v2:172.21.15.153:6834/2848393496 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1c62460 con 0x1ea4080 2024-09-13T17:07:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcc8ff9700 10 client.4668 handle_command_reply: tid=0 2024-09-13T17:07:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 1 client.4668 shutdown 2024-09-13T17:07:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1517466996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3b50 msgr2=0x1e7bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1517466996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3b50 0x1e7bca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009e80 tx=0x7fdce40047e0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1517466996 shutdown_connections 2024-09-13T17:07:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1517466996 >> [v2:172.21.15.153:6834/2848393496,v1:172.21.15.153:6835/2848393496] conn(0x1ea4080 0x1ed6d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1517466996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3b50 0x1e7bca0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1517466996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 0x1ea13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcc8ff9700 0 client.4668 ms_handle_reset on v2:172.21.15.153:6834/2848393496 2024-09-13T17:07:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1517466996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 0x1ea25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1517466996 >> 172.21.15.123:0/1517466996 conn(0x1c0b4d0 msgr2=0x1e77700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1517466996 shutdown_connections 2024-09-13T17:07:01.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1517466996 wait complete. 2024-09-13T17:07:01.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.510+0000 7fdcf34f3740 20 client.4668 trim_cache size 0 max 16384 2024-09-13T17:07:01.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcf34f3740 1 Processor -- start 2024-09-13T17:07:01.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcf34f3740 1 -- start start 2024-09-13T17:07:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcf34f3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 0x1e7b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcf34f3740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 0x1e7bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcf34f3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3b50 0x1ec1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcf34f3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dad8d0 con 0x1ec3b50 2024-09-13T17:07:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcf34f3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dac200 con 0x1ea1e90 2024-09-13T17:07:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcf34f3740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e12ec0 con 0x1ec3230 2024-09-13T17:07:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcee7df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3b50 0x1ec1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcee7df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3b50 0x1ec1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46974/0 (socket says 172.21.15.123:46974) 2024-09-13T17:07:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcee7df700 1 -- 172.21.15.123:0/1688662017 learned_addr learned my addr 172.21.15.123:0/1688662017 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdced7dd700 1 --2- 172.21.15.123:0/1688662017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 0x1e7bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcedfde700 1 --2- 172.21.15.123:0/1688662017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 0x1e7b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdced7dd700 1 -- 172.21.15.123:0/1688662017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 msgr2=0x1e7b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:01.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdced7dd700 1 --2- 172.21.15.123:0/1688662017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 0x1e7b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdced7dd700 1 -- 172.21.15.123:0/1688662017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3b50 msgr2=0x1ec1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:01.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdced7dd700 1 --2- 172.21.15.123:0/1688662017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3b50 0x1ec1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdced7dd700 1 -- 172.21.15.123:0/1688662017 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1d90450 con 0x1ec3230 2024-09-13T17:07:01.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcee7df700 1 --2- 172.21.15.123:0/1688662017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3b50 0x1ec1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:01.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdced7dd700 1 --2- 172.21.15.123:0/1688662017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 0x1e7bc80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800c430 tx=0x7fdcd8009440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54231184c41b7c59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:01.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdccbfff700 1 -- 172.21.15.123:0/1688662017 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8082040 con 0x1ec3230 2024-09-13T17:07:01.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdccbfff700 1 -- 172.21.15.123:0/1688662017 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8059130 con 0x1ec3230 2024-09-13T17:07:01.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdccbfff700 1 -- 172.21.15.123:0/1688662017 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800cea0 con 0x1ec3230 2024-09-13T17:07:01.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1688662017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 msgr2=0x1e7bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:01.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.534+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1688662017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 0x1e7bc80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800c430 tx=0x7fdcd8009440 comp rx=0 tx=0).stop 2024-09-13T17:07:01.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1688662017 shutdown_connections 2024-09-13T17:07:01.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1688662017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3b50 0x1ec1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1688662017 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3230 0x1e7bc80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1688662017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 0x1e7b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1688662017 >> 172.21.15.123:0/1688662017 conn(0x1c0b4d0 msgr2=0x1ea1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1688662017 shutdown_connections 2024-09-13T17:07:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1688662017 wait complete. 2024-09-13T17:07:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 -- start start 2024-09-13T17:07:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 Processor -- start 2024-09-13T17:07:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 0x1f26990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3230 0x1e7ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3b50 0x1e7b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ee1db0 con 0x1ec3230 2024-09-13T17:07:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ee1750 con 0x1ea1e90 2024-09-13T17:07:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e7a410 con 0x1ec3b50 2024-09-13T17:07:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 10 client.0 _ll_register_callbacks cb 0x1d95ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:07:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdced7dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3230 0x1e7ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdced7dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3230 0x1e7ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46986/0 (socket says 172.21.15.123:46986) 2024-09-13T17:07:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdced7dd700 1 -- 172.21.15.123:0/1123881521 learned_addr learned my addr 172.21.15.123:0/1123881521 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcee7df700 1 --2- 172.21.15.123:0/1123881521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3b50 0x1e7b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcedfde700 1 --2- 172.21.15.123:0/1123881521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 0x1f26990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdced7dd700 1 -- 172.21.15.123:0/1123881521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3b50 msgr2=0x1e7b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdced7dd700 1 --2- 172.21.15.123:0/1123881521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3b50 0x1e7b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdced7dd700 1 -- 172.21.15.123:0/1123881521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 msgr2=0x1f26990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdced7dd700 1 --2- 172.21.15.123:0/1123881521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 0x1f26990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdced7dd700 1 -- 172.21.15.123:0/1123881521 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1daa220 con 0x1ec3230 2024-09-13T17:07:01.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdced7dd700 1 --2- 172.21.15.123:0/1123881521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3230 0x1e7ae40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8055290 tx=0x7fdcd800efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e8d4bb0e2c9d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:01.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcc8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-13T17:07:01.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcc8ff9700 1 -- 172.21.15.123:0/1123881521 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8082040 con 0x1ec3230 2024-09-13T17:07:01.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcc8ff9700 1 -- 172.21.15.123:0/1123881521 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcd805d6f0 con 0x1ec3230 2024-09-13T17:07:01.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1123881521 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdcd806a030 con 0x1ec3230 2024-09-13T17:07:01.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcc8ff9700 1 -- 172.21.15.123:0/1123881521 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcd800cea0 con 0x1ec3230 2024-09-13T17:07:01.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 10 client.4674 fetch_fsmap learned FSMap version 7 2024-09-13T17:07:01.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1123881521 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x1c56960 con 0x1ec3230 2024-09-13T17:07:01.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcc8ff9700 1 -- 172.21.15.123:0/1123881521 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd806a030 con 0x1ec3230 2024-09-13T17:07:01.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcc8ff9700 1 -- 172.21.15.123:0/1123881521 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fdcd805d260 con 0x1ec3230 2024-09-13T17:07:01.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 10 client.4674 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T17:07:01.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 10 client.4674 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T17:07:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 20 client.4674 populate_metadata read hostname 'smithi123' 2024-09-13T17:07:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1123881521 >> [v2:172.21.15.153:6834/2848393496,v1:172.21.15.153:6835/2848393496] conn(0x1e789f0 0x1e78dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 4 client.4674 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:07:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.538+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1123881521 --> [v2:172.21.15.153:6834/2848393496,v1:172.21.15.153:6835/2848393496] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1c871e0 con 0x1e789f0 2024-09-13T17:07:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcedfde700 1 --2- 172.21.15.123:0/1123881521 >> [v2:172.21.15.153:6834/2848393496,v1:172.21.15.153:6835/2848393496] conn(0x1e789f0 0x1e78dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcedfde700 1 --2- 172.21.15.123:0/1123881521 >> [v2:172.21.15.153:6834/2848393496,v1:172.21.15.153:6835/2848393496] conn(0x1e789f0 0x1e78dd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30333e5727b73ee3 server_cookie=d045abaedb0193b6 in_seq=0 out_seq=0 2024-09-13T17:07:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcc8ff9700 10 client.4674 ms_handle_connect on v2:172.21.15.153:6834/2848393496 2024-09-13T17:07:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcc8ff9700 1 -- 172.21.15.123:0/1123881521 <== mds.0 v2:172.21.15.153:6834/2848393496 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x1c871e0 con 0x1e789f0 2024-09-13T17:07:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcc8ff9700 10 client.4674 handle_command_reply: tid=0 2024-09-13T17:07:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcf34f3740 1 client.4674 shutdown 2024-09-13T17:07:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1123881521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3230 msgr2=0x1e7ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1123881521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3230 0x1e7ae40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8055290 tx=0x7fdcd800efd0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1123881521 shutdown_connections 2024-09-13T17:07:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1123881521 >> [v2:172.21.15.153:6834/2848393496,v1:172.21.15.153:6835/2848393496] conn(0x1e789f0 0x1e78dd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1123881521 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ec3b50 0x1e7b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1123881521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ec3230 0x1e7ae40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcf34f3740 1 --2- 172.21.15.123:0/1123881521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ea1e90 0x1f26990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcc8ff9700 0 client.4674 ms_handle_reset on v2:172.21.15.153:6834/2848393496 2024-09-13T17:07:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1123881521 >> 172.21.15.123:0/1123881521 conn(0x1c0b4d0 msgr2=0x1ea1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1123881521 shutdown_connections 2024-09-13T17:07:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcf34f3740 1 -- 172.21.15.123:0/1123881521 wait complete. 2024-09-13T17:07:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdcf34f3740 20 client.4674 trim_cache size 0 max 16384 2024-09-13T17:07:01.551 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:07:01.551 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "c45759e3-62b7-46ff-ad19-917097e4c126", 2024-09-13T17:07:01.552 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-13T17:07:01.552 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4294, 2024-09-13T17:07:01.552 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-13T17:07:01.552 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-13T17:07:01.552 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-13T17:07:01.552 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 13.123302377, 2024-09-13T17:07:01.552 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 7, 2024-09-13T17:07:01.552 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 20, 2024-09-13T17:07:01.552 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 20, 2024-09-13T17:07:01.552 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 19.112223136000001 2024-09-13T17:07:01.552 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:07:01.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdceefe0700 1 -- 172.21.15.123:0/1543929442 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdccc066760 msgr2=0x7fdccc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:01.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdceefe0700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdccc066760 0x7fdccc068c20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdce00092e0 tx=0x7fdce000b040 comp rx=0 tx=0).stop 2024-09-13T17:07:01.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdceefe0700 1 -- 172.21.15.123:0/1543929442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce80b58b0 msgr2=0x7fdce814ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:01.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdceefe0700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce80b58b0 0x7fdce814ed20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800e9d0 tx=0x7fdcd800ed90 comp rx=0 tx=0).stop 2024-09-13T17:07:01.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdceefe0700 1 -- 172.21.15.123:0/1543929442 shutdown_connections 2024-09-13T17:07:01.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdceefe0700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdccc066760 0x7fdccc068c20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdceefe0700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdce80d0f40 0x7fdce815f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdceefe0700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce80b58b0 0x7fdce814ed20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdceefe0700 1 --2- 172.21.15.123:0/1543929442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdce80b1100 0x7fdce80b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdceefe0700 1 -- 172.21.15.123:0/1543929442 >> 172.21.15.123:0/1543929442 conn(0x7fdce80d2a60 msgr2=0x7fdce8070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:01.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdceefe0700 1 -- 172.21.15.123:0/1543929442 shutdown_connections 2024-09-13T17:07:01.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.542+0000 7fdceefe0700 1 -- 172.21.15.123:0/1543929442 wait complete. 2024-09-13T17:07:01.562 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T17:07:01.573 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T17:07:01.573 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T17:07:01.573 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T17:07:01.573 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T17:07:01.620 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T17:07:01.620 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-13T17:07:01.621 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-13T17:07:01.621 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:07:01.621 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:07:01.621 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-13T17:07:01.621 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:07:01.621 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T17:07:01.621 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-13T17:07:01.621 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:07:01.621 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:07:01.621 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-13T17:07:01.621 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:07:01.622 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T17:07:01.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:01.622 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-13T17:07:01.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:01.630 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-09-13T17:07:01.650 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-09-13T17:07:01.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:07:01.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:01.651 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-13T17:07:01.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:01.659 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-09-13T17:07:01.677 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-09-13T17:07:01.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:07:01.679 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T17:07:01.679 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T17:07:01.679 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:07:01.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78ac30700 1 Processor -- start 2024-09-13T17:07:01.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78ac30700 1 -- start start 2024-09-13T17:07:01.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78ac30700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc78415ed00 0x7fc784161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78ac30700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc784161a80 0x7fc7840cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78ac30700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc784162550 con 0x7fc78415e920 2024-09-13T17:07:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78ac30700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7840cd690 con 0x7fc784161a80 2024-09-13T17:07:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78ac30700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc784161f90 con 0x7fc78415ed00 2024-09-13T17:07:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78a42f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc784161a80 0x7fc7840cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78a42f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc784161a80 0x7fc7840cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47000/0 (socket says 172.21.15.123:47000) 2024-09-13T17:07:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78a42f700 1 -- 172.21.15.123:0/339883694 learned_addr learned my addr 172.21.15.123:0/339883694 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc789c2e700 1 --1- 172.21.15.123:0/339883694 >> v1:172.21.15.123:6789/0 conn(0x7fc78415e920 0x7fc7840caae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49302/0 (socket says 172.21.15.123:49302) 2024-09-13T17:07:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78942d700 1 --2- 172.21.15.123:0/339883694 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc78415ed00 0x7fc784161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78a42f700 1 -- 172.21.15.123:0/339883694 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc78415ed00 msgr2=0x7fc784161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78a42f700 1 --2- 172.21.15.123:0/339883694 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc78415ed00 0x7fc784161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78a42f700 1 -- 172.21.15.123:0/339883694 >> v1:172.21.15.123:6789/0 conn(0x7fc78415e920 legacy=0x7fc7840caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc788c2c700 1 -- 172.21.15.123:0/339883694 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726208452 0 0) 0x7fc784162550 con 0x7fc78415e920 2024-09-13T17:07:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.790+0000 7fc78a42f700 1 -- 172.21.15.123:0/339883694 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc784162270 con 0x7fc784161a80 2024-09-13T17:07:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.794+0000 7fc78a42f700 1 --2- 172.21.15.123:0/339883694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc784161a80 0x7fc7840cdb20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009910 tx=0x7fc77c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31be3333b52eddb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.794+0000 7fc788c2c700 1 -- 172.21.15.123:0/339883694 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c011830 con 0x7fc784161a80 2024-09-13T17:07:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.794+0000 7fc788c2c700 1 -- 172.21.15.123:0/339883694 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c011990 con 0x7fc784161a80 2024-09-13T17:07:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.794+0000 7fc788c2c700 1 -- 172.21.15.123:0/339883694 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c011d40 con 0x7fc784161a80 2024-09-13T17:07:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.794+0000 7fc78ac30700 1 -- 172.21.15.123:0/339883694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc784161a80 msgr2=0x7fc7840cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.794+0000 7fc78ac30700 1 --2- 172.21.15.123:0/339883694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc784161a80 0x7fc7840cdb20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009910 tx=0x7fc77c009c20 comp rx=0 tx=0).stop 2024-09-13T17:07:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.794+0000 7fc78ac30700 1 -- 172.21.15.123:0/339883694 shutdown_connections 2024-09-13T17:07:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.794+0000 7fc78ac30700 1 --2- 172.21.15.123:0/339883694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc784161a80 0x7fc7840cdb20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.794+0000 7fc78ac30700 1 --2- 172.21.15.123:0/339883694 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc78415ed00 0x7fc784161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.794+0000 7fc78ac30700 1 -- 172.21.15.123:0/339883694 >> 172.21.15.123:0/339883694 conn(0x7fc784066150 msgr2=0x7fc784066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:01.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.794+0000 7fc78ac30700 1 -- 172.21.15.123:0/339883694 shutdown_connections 2024-09-13T17:07:01.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.794+0000 7fc78ac30700 1 -- 172.21.15.123:0/339883694 wait complete. 2024-09-13T17:07:01.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.794+0000 7fc78ac30700 1 Processor -- start 2024-09-13T17:07:01.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.794+0000 7fc78ac30700 1 -- start start 2024-09-13T17:07:01.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc78ac30700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc78415e920 0x7fc78414ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc78ac30700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc78415ed00 0x7fc7841eadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc78ac30700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc784161a80 0x7fc78414e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc78ac30700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78414cc30 con 0x7fc78415e920 2024-09-13T17:07:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc78ac30700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841eb2f0 con 0x7fc784161a80 2024-09-13T17:07:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc78ac30700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78414ea80 con 0x7fc78415ed00 2024-09-13T17:07:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc789c2e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc78415e920 0x7fc78414ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc789c2e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc78415e920 0x7fc78414ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47012/0 (socket says 172.21.15.123:47012) 2024-09-13T17:07:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc789c2e700 1 -- 172.21.15.123:0/672721132 learned_addr learned my addr 172.21.15.123:0/672721132 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc78a42f700 1 --2- 172.21.15.123:0/672721132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc784161a80 0x7fc78414e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc78942d700 1 --2- 172.21.15.123:0/672721132 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc78415ed00 0x7fc7841eadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc789c2e700 1 -- 172.21.15.123:0/672721132 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc78415ed00 msgr2=0x7fc7841eadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc789c2e700 1 --2- 172.21.15.123:0/672721132 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc78415ed00 0x7fc7841eadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc789c2e700 1 -- 172.21.15.123:0/672721132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc784161a80 msgr2=0x7fc78414e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc789c2e700 1 --2- 172.21.15.123:0/672721132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc784161a80 0x7fc78414e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc789c2e700 1 -- 172.21.15.123:0/672721132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c009570 con 0x7fc78415e920 2024-09-13T17:07:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc789c2e700 1 --2- 172.21.15.123:0/672721132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc78415e920 0x7fc78414ba40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc77400c580 tx=0x7fc77400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc77a7fc700 1 -- 172.21.15.123:0/672721132 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774004ca0 con 0x7fc78415e920 2024-09-13T17:07:01.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc77a7fc700 1 -- 172.21.15.123:0/672721132 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc774004e20 con 0x7fc78415e920 2024-09-13T17:07:01.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc78ac30700 1 -- 172.21.15.123:0/672721132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78414c020 con 0x7fc78415e920 2024-09-13T17:07:01.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc77a7fc700 1 -- 172.21.15.123:0/672721132 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774007310 con 0x7fc78415e920 2024-09-13T17:07:01.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc78ac30700 1 -- 172.21.15.123:0/672721132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78414c5e0 con 0x7fc78415e920 2024-09-13T17:07:01.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc78ac30700 1 -- 172.21.15.123:0/672721132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7840677f0 con 0x7fc78415e920 2024-09-13T17:07:01.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.798+0000 7fc77a7fc700 1 -- 172.21.15.123:0/672721132 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc774007470 con 0x7fc78415e920 2024-09-13T17:07:01.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.802+0000 7fc77a7fc700 1 --2- 172.21.15.123:0/672721132 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc768066730 0x7fc768068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:01.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.802+0000 7fc77a7fc700 1 -- 172.21.15.123:0/672721132 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc774083f70 con 0x7fc78415e920 2024-09-13T17:07:01.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.802+0000 7fc78942d700 1 --2- 172.21.15.123:0/672721132 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc768066730 0x7fc768068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:01.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.802+0000 7fc78942d700 1 --2- 172.21.15.123:0/672721132 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc768066730 0x7fc768068bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7841fa360 tx=0x7fc78000b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:01.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:01.806+0000 7fc77a7fc700 1 -- 172.21.15.123:0/672721132 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc7740b5db0 con 0x7fc78415e920 2024-09-13T17:07:02.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:02.018+0000 7fc78ac30700 1 -- 172.21.15.123:0/672721132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc784161540 con 0x7fc78415e920 2024-09-13T17:07:02.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:02.018+0000 7fc77a7fc700 1 -- 172.21.15.123:0/672721132 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc7740512e0 con 0x7fc78415e920 2024-09-13T17:07:02.023 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:07:02.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:02.022+0000 7fc78ac30700 1 -- 172.21.15.123:0/672721132 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc768066730 msgr2=0x7fc768068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:02.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:02.022+0000 7fc78ac30700 1 --2- 172.21.15.123:0/672721132 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc768066730 0x7fc768068bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7841fa360 tx=0x7fc78000b040 comp rx=0 tx=0).stop 2024-09-13T17:07:02.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:02.022+0000 7fc78ac30700 1 -- 172.21.15.123:0/672721132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc78415e920 msgr2=0x7fc78414ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:02.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:02.022+0000 7fc78ac30700 1 --2- 172.21.15.123:0/672721132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc78415e920 0x7fc78414ba40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc77400c580 tx=0x7fc77400c940 comp rx=0 tx=0).stop 2024-09-13T17:07:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:02.022+0000 7fc78ac30700 1 -- 172.21.15.123:0/672721132 shutdown_connections 2024-09-13T17:07:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:02.022+0000 7fc78ac30700 1 --2- 172.21.15.123:0/672721132 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc768066730 0x7fc768068bf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:02.022+0000 7fc78ac30700 1 --2- 172.21.15.123:0/672721132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc784161a80 0x7fc78414e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:02.022+0000 7fc78ac30700 1 --2- 172.21.15.123:0/672721132 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc78415ed00 0x7fc7841eadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:02.022+0000 7fc78ac30700 1 --2- 172.21.15.123:0/672721132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc78415e920 0x7fc78414ba40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:02.022+0000 7fc78ac30700 1 -- 172.21.15.123:0/672721132 >> 172.21.15.123:0/672721132 conn(0x7fc784066150 msgr2=0x7fc78406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:02.022+0000 7fc78ac30700 1 -- 172.21.15.123:0/672721132 shutdown_connections 2024-09-13T17:07:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:02.022+0000 7fc78ac30700 1 -- 172.21.15.123:0/672721132 wait complete. 2024-09-13T17:07:02.038 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:07:02.038 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:07:02.038 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-13T17:07:02.038 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:07:02.039 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:07:02.039 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:07:02.039 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:07:02.039 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:07:02.039 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:07:02.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:02.039 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-13T17:07:02.044 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:07:02.044 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:07:02.044 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:07:02.044 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:02.045 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-13T17:07:02.045 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:02.045 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:02.045 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:02.045 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:02.045 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:02.045 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:02.045 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:02.045 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:07:02.045 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:02.045 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:07:02.045 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42586sec preferred_lft 42586sec 2024-09-13T17:07:02.045 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-09-13T17:07:02.046 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:02.046 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:07:02.046 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:b1:d7:75:e9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:02.046 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:07:02.046 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:02.046 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:07:02.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:02.046 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:07:02.047 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:07:02.047 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:07:02.047 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2024-09-13T17:07:02.047 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2024-09-13T17:07:02.047 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:07:02.047 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:07:02.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:02.086 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:07:02.148 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-13T17:07:02.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:02.151 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-13T17:07:02.176 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-13T17:07:02.176 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:07:02.176 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:07:02.176 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:07:02.176 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:07:02.176 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:07:02.176 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:07:02.176 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:07:02.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:02.177 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:07:02.177 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:07:02.177 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:07:02.177 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:07:02.177 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:07:02.177 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:07:02.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:02.218 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-13T17:07:02.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:02.272 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-09-13T17:07:02.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:02.279 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:07:02.279 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:07:02.279 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:07:02.280 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T17:07:02.280 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:07:02.312 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T17:07:02.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:02.313 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:07:02.313 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:07:02.313 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T17:07:02.313 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:07:02.313 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T17:07:02.313 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T17:07:02.313 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T17:07:02.313 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:07:02.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:02.384 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:07:02.384 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:07:02.384 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-13T17:07:02.384 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:07:02.384 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:07:02.409 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:07:02.409 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:07:02.409 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:07:02.415 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:07:02.415 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:07:02.415 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:07:02.421 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:07:02.437 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:02.438 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:02.497 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:02.498 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:02.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:02.499 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:07:02.507 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:07:02.507 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:07:02.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:07:02.526 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:02.526 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:02.583 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:02.584 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:02.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:02.585 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:07:02.592 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:2024-09-13T17:07:02.586+0000 7f8a22e09640 -1 init, newargv = 0x555666ab6970 newargc=15 2024-09-13T17:07:02.592 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[34307]: starting ceph client 2024-09-13T17:07:02.600 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[34307]: starting fuse 2024-09-13T17:07:03.691 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:07:03.709 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:03.709 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:03.766 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:03.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:03.767 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:07:03.774 INFO:teuthology.orchestra.run.smithi123.stdout:52 2024-09-13T17:07:03.775 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:07:03.775 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:07:03.775 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2024-09-13T17:07:03.775 DEBUG:teuthology.orchestra.run.smithi123:> import re 2024-09-13T17:07:03.775 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-13T17:07:03.775 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2024-09-13T17:07:03.775 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:07:03.775 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2024-09-13T17:07:03.775 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:07:03.775 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2024-09-13T17:07:03.775 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:07:03.775 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:07:03.775 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2024-09-13T17:07:03.776 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2024-09-13T17:07:03.776 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2024-09-13T17:07:03.776 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2024-09-13T17:07:03.776 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:07:03.776 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2024-09-13T17:07:03.776 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:07:03.776 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:07:03.776 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:07:03.776 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2024-09-13T17:07:03.776 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2024-09-13T17:07:03.776 DEBUG:teuthology.orchestra.run.smithi123:> return f 2024-09-13T17:07:03.776 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:07:03.776 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:07:03.776 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.0")) 2024-09-13T17:07:03.777 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-13T17:07:03.857 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.0.34307.asok 2024-09-13T17:07:04.042 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34307.asok 2024-09-13T17:07:04.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:04.043 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34307.asok status 2024-09-13T17:07:04.188 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:07:04.188 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2024-09-13T17:07:04.188 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:07:04.189 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:07:04.189 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "0", 2024-09-13T17:07:04.189 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2024-09-13T17:07:04.189 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:07:04.189 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "34307", 2024-09-13T17:07:04.189 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2024-09-13T17:07:04.189 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:04.189 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2024-09-13T17:07:04.189 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2024-09-13T17:07:04.189 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4692, 2024-09-13T17:07:04.189 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2024-09-13T17:07:04.189 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2024-09-13T17:07:04.189 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2024-09-13T17:07:04.190 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4692 2024-09-13T17:07:04.190 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:04.190 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:07:04.190 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:07:04.190 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:07:04.190 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 3021998611 2024-09-13T17:07:04.190 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:04.190 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:04.190 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:07:04.190 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:07:04.190 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:07:04.190 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 3021998611 2024-09-13T17:07:04.190 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:04.191 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.4692 192.168.0.1:0/3021998611", 2024-09-13T17:07:04.191 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.1:0/3021998611", 2024-09-13T17:07:04.191 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2024-09-13T17:07:04.191 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 7, 2024-09-13T17:07:04.191 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 20, 2024-09-13T17:07:04.191 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:07:04.191 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2024-09-13T17:07:04.191 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2024-09-13T17:07:04.191 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:07:04.198 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T17:07:04.198 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:07:04.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.298+0000 7fbb26723700 1 Processor -- start 2024-09-13T17:07:04.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.298+0000 7fbb26723700 1 -- start start 2024-09-13T17:07:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb26723700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb20161520 0x7fbb200d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb26723700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbb200d0e20 0x7fbb200cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb26723700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb200d0400 con 0x7fbb2015cfd0 2024-09-13T17:07:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb26723700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb200d12d0 con 0x7fbb200d0e20 2024-09-13T17:07:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb26723700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb200afcb0 con 0x7fbb20161520 2024-09-13T17:07:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb25721700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbb2015cfd0 0x7fbb200ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49392/0 (socket says 172.21.15.123:49392) 2024-09-13T17:07:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb25721700 1 -- 172.21.15.123:0/3912977239 learned_addr learned my addr 172.21.15.123:0/3912977239 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb24f20700 1 --2- 172.21.15.123:0/3912977239 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb20161520 0x7fbb200d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb25f22700 1 --2- 172.21.15.123:0/3912977239 >> v2:172.21.15.153:3300/0 conn(0x7fbb200d0e20 0x7fbb200cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb17fff700 1 -- 172.21.15.123:0/3912977239 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244077095 0 0) 0x7fbb200d0400 con 0x7fbb2015cfd0 2024-09-13T17:07:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb17fff700 1 -- 172.21.15.123:0/3912977239 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb0c0035d0 con 0x7fbb2015cfd0 2024-09-13T17:07:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb24f20700 1 -- 172.21.15.123:0/3912977239 >> v2:172.21.15.153:3300/0 conn(0x7fbb200d0e20 msgr2=0x7fbb200cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb24f20700 1 --2- 172.21.15.123:0/3912977239 >> v2:172.21.15.153:3300/0 conn(0x7fbb200d0e20 0x7fbb200cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb24f20700 1 -- 172.21.15.123:0/3912977239 >> v1:172.21.15.123:6789/0 conn(0x7fbb2015cfd0 legacy=0x7fbb200ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb24f20700 1 -- 172.21.15.123:0/3912977239 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb20161940 con 0x7fbb20161520 2024-09-13T17:07:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb25f22700 1 --2- 172.21.15.123:0/3912977239 >> v2:172.21.15.153:3300/0 conn(0x7fbb200d0e20 0x7fbb200cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb24f20700 1 --2- 172.21.15.123:0/3912977239 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb20161520 0x7fbb200d08e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009880 tx=0x7fbb1c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f421062577c8c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb17fff700 1 -- 172.21.15.123:0/3912977239 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c011830 con 0x7fbb20161520 2024-09-13T17:07:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb17fff700 1 -- 172.21.15.123:0/3912977239 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c011990 con 0x7fbb20161520 2024-09-13T17:07:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb17fff700 1 -- 172.21.15.123:0/3912977239 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c011d20 con 0x7fbb20161520 2024-09-13T17:07:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb26723700 1 -- 172.21.15.123:0/3912977239 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb20161520 msgr2=0x7fbb200d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb26723700 1 --2- 172.21.15.123:0/3912977239 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb20161520 0x7fbb200d08e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009880 tx=0x7fbb1c009b90 comp rx=0 tx=0).stop 2024-09-13T17:07:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb26723700 1 -- 172.21.15.123:0/3912977239 shutdown_connections 2024-09-13T17:07:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb26723700 1 --2- 172.21.15.123:0/3912977239 >> v2:172.21.15.153:3300/0 conn(0x7fbb200d0e20 0x7fbb200cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb26723700 1 --2- 172.21.15.123:0/3912977239 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb20161520 0x7fbb200d08e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb26723700 1 -- 172.21.15.123:0/3912977239 >> 172.21.15.123:0/3912977239 conn(0x7fbb200b24c0 msgr2=0x7fbb200b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.302+0000 7fbb26723700 1 -- 172.21.15.123:0/3912977239 shutdown_connections 2024-09-13T17:07:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb26723700 1 -- 172.21.15.123:0/3912977239 wait complete. 2024-09-13T17:07:04.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb26723700 1 Processor -- start 2024-09-13T17:07:04.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb26723700 1 -- start start 2024-09-13T17:07:04.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb26723700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb200d0e20 0x7fbb200b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:04.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb26723700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb2015cfd0 0x7fbb200b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:04.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb26723700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb20161520 0x7fbb200b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:04.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb26723700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2015da00 con 0x7fbb20161520 2024-09-13T17:07:04.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb26723700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb200b4b90 con 0x7fbb2015cfd0 2024-09-13T17:07:04.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb26723700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb200b4e70 con 0x7fbb200d0e20 2024-09-13T17:07:04.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb25f22700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb20161520 0x7fbb200b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb25f22700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb20161520 0x7fbb200b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48864/0 (socket says 172.21.15.123:48864) 2024-09-13T17:07:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb25f22700 1 -- 172.21.15.123:0/2993603477 learned_addr learned my addr 172.21.15.123:0/2993603477 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb25721700 1 --2- 172.21.15.123:0/2993603477 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb200d0e20 0x7fbb200b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb24f20700 1 --2- 172.21.15.123:0/2993603477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb2015cfd0 0x7fbb200b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb25f22700 1 -- 172.21.15.123:0/2993603477 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb200d0e20 msgr2=0x7fbb200b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb25f22700 1 --2- 172.21.15.123:0/2993603477 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb200d0e20 0x7fbb200b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb25f22700 1 -- 172.21.15.123:0/2993603477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb2015cfd0 msgr2=0x7fbb200b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb25f22700 1 --2- 172.21.15.123:0/2993603477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb2015cfd0 0x7fbb200b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb25f22700 1 -- 172.21.15.123:0/2993603477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb18009a70 con 0x7fbb20161520 2024-09-13T17:07:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.306+0000 7fbb25f22700 1 --2- 172.21.15.123:0/2993603477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb20161520 0x7fbb200b4240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800efc0 tx=0x7fbb1800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.310+0000 7fbb15ffb700 1 -- 172.21.15.123:0/2993603477 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18009d70 con 0x7fbb20161520 2024-09-13T17:07:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.310+0000 7fbb15ffb700 1 -- 172.21.15.123:0/2993603477 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1800f040 con 0x7fbb20161520 2024-09-13T17:07:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.310+0000 7fbb26723700 1 -- 172.21.15.123:0/2993603477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1c0094b0 con 0x7fbb20161520 2024-09-13T17:07:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.310+0000 7fbb15ffb700 1 -- 172.21.15.123:0/2993603477 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1800ce00 con 0x7fbb20161520 2024-09-13T17:07:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.310+0000 7fbb26723700 1 -- 172.21.15.123:0/2993603477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2015d690 con 0x7fbb20161520 2024-09-13T17:07:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.310+0000 7fbb26723700 1 -- 172.21.15.123:0/2993603477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2015db70 con 0x7fbb20161520 2024-09-13T17:07:04.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.310+0000 7fbb15ffb700 1 -- 172.21.15.123:0/2993603477 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbb18014480 con 0x7fbb20161520 2024-09-13T17:07:04.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.314+0000 7fbb15ffb700 1 --2- 172.21.15.123:0/2993603477 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb04066760 0x7fbb04068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:04.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.314+0000 7fbb15ffb700 1 -- 172.21.15.123:0/2993603477 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb18084980 con 0x7fbb20161520 2024-09-13T17:07:04.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.314+0000 7fbb25721700 1 --2- 172.21.15.123:0/2993603477 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb04066760 0x7fbb04068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:04.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.314+0000 7fbb25721700 1 --2- 172.21.15.123:0/2993603477 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb04066760 0x7fbb04068c20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb100011e0 tx=0x7fbb10009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.318+0000 7fbb15ffb700 1 -- 172.21.15.123:0/2993603477 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbb18051c50 con 0x7fbb20161520 2024-09-13T17:07:04.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.526+0000 7fbb26723700 1 -- 172.21.15.123:0/2993603477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbb200d08e0 con 0x7fbb20161520 2024-09-13T17:07:04.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.526+0000 7fbb15ffb700 1 -- 172.21.15.123:0/2993603477 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbb18055270 con 0x7fbb20161520 2024-09-13T17:07:04.531 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:07:04.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.530+0000 7fbb26723700 1 -- 172.21.15.123:0/2993603477 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb04066760 msgr2=0x7fbb04068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:04.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.530+0000 7fbb26723700 1 --2- 172.21.15.123:0/2993603477 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb04066760 0x7fbb04068c20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb100011e0 tx=0x7fbb10009040 comp rx=0 tx=0).stop 2024-09-13T17:07:04.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.530+0000 7fbb26723700 1 -- 172.21.15.123:0/2993603477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb20161520 msgr2=0x7fbb200b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:04.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.530+0000 7fbb26723700 1 --2- 172.21.15.123:0/2993603477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb20161520 0x7fbb200b4240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800efc0 tx=0x7fbb1800c3a0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.530+0000 7fbb26723700 1 -- 172.21.15.123:0/2993603477 shutdown_connections 2024-09-13T17:07:04.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.530+0000 7fbb26723700 1 --2- 172.21.15.123:0/2993603477 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb04066760 0x7fbb04068c20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.530+0000 7fbb26723700 1 --2- 172.21.15.123:0/2993603477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb20161520 0x7fbb200b4240 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.530+0000 7fbb26723700 1 --2- 172.21.15.123:0/2993603477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb2015cfd0 0x7fbb200b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.530+0000 7fbb26723700 1 --2- 172.21.15.123:0/2993603477 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb200d0e20 0x7fbb200b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.530+0000 7fbb26723700 1 -- 172.21.15.123:0/2993603477 >> 172.21.15.123:0/2993603477 conn(0x7fbb200b24c0 msgr2=0x7fbb200cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:04.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.530+0000 7fbb26723700 1 -- 172.21.15.123:0/2993603477 shutdown_connections 2024-09-13T17:07:04.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:04.530+0000 7fbb26723700 1 -- 172.21.15.123:0/2993603477 wait complete. 2024-09-13T17:07:04.546 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:07:04.546 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:07:04.546 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-13T17:07:04.546 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-13T17:07:04.546 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T17:07:04.547 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:07:04.547 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:07:04.547 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:07:04.547 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-13T17:07:04.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:04.547 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-13T17:07:04.552 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:07:04.552 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:07:04.552 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:07:04.552 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.552 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-13T17:07:04.552 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.552 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:04.553 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:04.553 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:04.553 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:04.553 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:04.553 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:04.553 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:07:04.553 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:04.553 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:07:04.553 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42583sec preferred_lft 42583sec 2024-09-13T17:07:04.553 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-09-13T17:07:04.553 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.553 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:07:04.553 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:b1:d7:75:e9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:04.554 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:07:04.554 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.554 INFO:teuthology.orchestra.run.smithi123.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:07:04.554 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether da:a9:95:cd:41:8c brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:04.554 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:07:04.554 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.554 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::a038:65ff:fec0:5513/64 scope link 2024-09-13T17:07:04.554 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.554 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:07:04.554 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether da:a9:95:cd:41:8c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:07:04.554 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::d8a9:95ff:fecd:418c/64 scope link 2024-09-13T17:07:04.554 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:04.555 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:07:04.608 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-13T17:07:04.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:04.610 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-13T17:07:04.617 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-13T17:07:04.617 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:07:04.617 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:07:04.617 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:07:04.617 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:07:04.617 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:07:04.617 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:07:04.618 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:07:04.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:04.618 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:07:04.618 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:07:04.618 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:07:04.618 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:07:04.618 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:07:04.618 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:07:04.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:04.656 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-13T17:07:04.709 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:07:04.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:04.709 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-09-13T17:07:04.717 INFO:teuthology.orchestra.run.smithi123.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-13T17:07:04.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:04.718 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:07:04.718 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:07:04.718 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:07:04.718 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-13T17:07:04.718 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:07:04.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:04.748 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T17:07:04.807 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:07:04.807 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:07:04.807 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:07:04.807 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.807 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-13T17:07:04.807 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.808 INFO:teuthology.orchestra.run.smithi123.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:07:04.808 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether ee:db:c4:5f:ea:8f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:07:04.808 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:07:04.808 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.808 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ecdb:c4ff:fe5f:ea8f/64 scope link 2024-09-13T17:07:04.808 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:04.809 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T17:07:04.820 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:07:04.820 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:07:04.820 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:07:04.820 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.820 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-13T17:07:04.820 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.820 INFO:teuthology.orchestra.run.smithi123.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:07:04.820 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether ee:db:c4:5f:ea:8f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:07:04.820 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:07:04.820 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.821 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ecdb:c4ff:fe5f:ea8f/64 scope link 2024-09-13T17:07:04.821 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:04.822 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-13T17:07:04.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:04.822 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:07:04.822 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:07:04.822 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-13T17:07:04.822 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T17:07:04.822 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-13T17:07:04.822 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-13T17:07:04.822 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-13T17:07:04.822 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:07:04.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:04.882 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:07:04.882 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:07:04.882 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.1 up 2024-09-13T17:07:04.882 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T17:07:04.882 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:07:04.911 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-13T17:07:04.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:07:04.912 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-13T17:07:04.918 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-13T17:07:04.919 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:07:04.919 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-13T17:07:04.924 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:07:04.936 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:04.936 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:04.946 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:04.947 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:04.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:04.947 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:07:04.996 INFO:teuthology.orchestra.run.smithi123.stdout:52 2024-09-13T17:07:04.996 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-09-13T17:07:04.996 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-13T17:07:04.999 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:07:05.014 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:05.014 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:05.028 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:05.029 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:05.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:05.029 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:07:05.033 INFO:teuthology.orchestra.run.smithi123.stdout:52 2024-09-13T17:07:05.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi123.stderr:2024-09-13T17:07:05.082+0000 7fb2bfe55640 -1 init, newargv = 0x558ba92d7810 newargc=15 2024-09-13T17:07:05.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi123.stderr:ceph-fuse[34451]: starting ceph client 2024-09-13T17:07:05.097 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi123.stderr:ceph-fuse[34451]: starting fuse 2024-09-13T17:07:06.135 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:07:06.154 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:06.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:06.167 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:06.167 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:06.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:06.168 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:07:06.216 INFO:teuthology.orchestra.run.smithi123.stdout:52 2024-09-13T17:07:06.216 INFO:teuthology.orchestra.run.smithi123.stdout:53 2024-09-13T17:07:06.217 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-09-13T17:07:06.217 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:07:06.217 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2024-09-13T17:07:06.217 DEBUG:teuthology.orchestra.run.smithi123:> import re 2024-09-13T17:07:06.217 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-13T17:07:06.217 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2024-09-13T17:07:06.217 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:07:06.217 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2024-09-13T17:07:06.217 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-13T17:07:06.217 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2024-09-13T17:07:06.217 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> return f 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:07:06.218 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.2")) 2024-09-13T17:07:06.219 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-13T17:07:06.304 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.2.34451.asok 2024-09-13T17:07:06.488 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.34451.asok 2024-09-13T17:07:06.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:06.488 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.34451.asok status 2024-09-13T17:07:06.594 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:07:06.594 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2024-09-13T17:07:06.594 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:07:06.594 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:07:06.594 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "2", 2024-09-13T17:07:06.594 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2024-09-13T17:07:06.594 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-13T17:07:06.595 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "34451", 2024-09-13T17:07:06.595 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2024-09-13T17:07:06.595 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:06.595 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2024-09-13T17:07:06.595 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2024-09-13T17:07:06.595 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4704, 2024-09-13T17:07:06.595 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2024-09-13T17:07:06.595 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2024-09-13T17:07:06.595 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2024-09-13T17:07:06.595 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4704 2024-09-13T17:07:06.595 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:06.596 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:07:06.596 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:07:06.596 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.2:0", 2024-09-13T17:07:06.596 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 2728594521 2024-09-13T17:07:06.596 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:06.596 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:06.596 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:07:06.596 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:07:06.596 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.2:0", 2024-09-13T17:07:06.596 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 2728594521 2024-09-13T17:07:06.596 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:06.596 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.4704 192.168.0.2:0/2728594521", 2024-09-13T17:07:06.597 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.2:0/2728594521", 2024-09-13T17:07:06.597 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2024-09-13T17:07:06.597 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 7, 2024-09-13T17:07:06.597 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 20, 2024-09-13T17:07:06.597 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:07:06.597 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2024-09-13T17:07:06.597 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2024-09-13T17:07:06.597 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:07:06.604 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T17:07:06.604 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:07:06.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.714+0000 7f4e5eb96700 1 Processor -- start 2024-09-13T17:07:06.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.714+0000 7f4e5eb96700 1 -- start start 2024-09-13T17:07:06.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5eb96700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e5806a970 0x7f4e5806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:06.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5eb96700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e580ae7a0 con 0x7f4e5815ca10 2024-09-13T17:07:06.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5db94700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4e5815ca10 0x7f4e5806a260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49402/0 (socket says 172.21.15.123:49402) 2024-09-13T17:07:06.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5eb96700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e580711f0 con 0x7f4e580b1580 2024-09-13T17:07:06.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5db94700 1 -- 172.21.15.123:0/2845372934 learned_addr learned my addr 172.21.15.123:0/2845372934 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:06.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5eb96700 1 -- 172.21.15.123:0/2845372934 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580714d0 con 0x7f4e5806a970 2024-09-13T17:07:06.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5d393700 1 --2- 172.21.15.123:0/2845372934 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e5806a970 0x7f4e5806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:06.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317238707 0 0) 0x7f4e580ae7a0 con 0x7f4e5815ca10 2024-09-13T17:07:06.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e440035d0 con 0x7f4e5815ca10 2024-09-13T17:07:06.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864705988 0 0) 0x7f4e580711f0 con 0x7f4e580b1580 2024-09-13T17:07:06.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e580ae7a0 con 0x7f4e580b1580 2024-09-13T17:07:06.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2694032941 0 0) 0x7f4e440035d0 con 0x7f4e5815ca10 2024-09-13T17:07:06.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e5806a970 msgr2=0x7f4e5806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:06.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 --2- 172.21.15.123:0/2845372934 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e5806a970 0x7f4e5806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:06.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 >> v1:172.21.15.153:6789/0 conn(0x7f4e580b1580 legacy=0x7f4e58160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:06.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e580717b0 con 0x7f4e5815ca10 2024-09-13T17:07:06.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f4e540019f0 con 0x7f4e5815ca10 2024-09-13T17:07:06.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 >> v1:172.21.15.123:6789/0 conn(0x7f4e5815ca10 legacy=0x7f4e5806a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:06.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 --2- 172.21.15.123:0/2845372934 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e5806a970 0x7f4e44003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:06.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 --2- 172.21.15.123:0/2845372934 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e44004140 0x7f4e44004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:06.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 --2- 172.21.15.123:0/2845372934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e44004db0 0x7f4e44005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:06.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580714d0 con 0x7f4e44004140 2024-09-13T17:07:06.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4400bb10 con 0x7f4e44004db0 2024-09-13T17:07:06.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4400bcd0 con 0x7f4e5806a970 2024-09-13T17:07:06.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5d393700 1 --2- 172.21.15.123:0/2845372934 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e44004140 0x7f4e44004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:06.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5db94700 1 --2- 172.21.15.123:0/2845372934 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e5806a970 0x7f4e44003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:06.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5e395700 1 --2- 172.21.15.123:0/2845372934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e44004db0 0x7f4e44005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:06.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5d393700 1 -- 172.21.15.123:0/2845372934 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e5806a970 msgr2=0x7f4e44003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:06.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5d393700 1 --2- 172.21.15.123:0/2845372934 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e5806a970 0x7f4e44003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:06.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5d393700 1 -- 172.21.15.123:0/2845372934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e44004db0 msgr2=0x7f4e44005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:06.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5d393700 1 --2- 172.21.15.123:0/2845372934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e44004db0 0x7f4e44005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:06.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5d393700 1 -- 172.21.15.123:0/2845372934 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e440035d0 con 0x7f4e44004140 2024-09-13T17:07:06.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5d393700 1 --2- 172.21.15.123:0/2845372934 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e44004140 0x7f4e44004870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4e48009b70 tx=0x7f4e440058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce009f5c5dbdca09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:06.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4800e6c0 con 0x7f4e44004140 2024-09-13T17:07:06.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4800e820 con 0x7f4e44004140 2024-09-13T17:07:06.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5cb92700 1 -- 172.21.15.123:0/2845372934 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4800eb90 con 0x7f4e44004140 2024-09-13T17:07:06.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5eb96700 1 -- 172.21.15.123:0/2845372934 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e44004140 msgr2=0x7f4e44004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:06.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5eb96700 1 --2- 172.21.15.123:0/2845372934 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e44004140 0x7f4e44004870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4e48009b70 tx=0x7f4e440058a0 comp rx=0 tx=0).stop 2024-09-13T17:07:06.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5e395700 1 -- 172.21.15.123:0/2845372934 reap_dead start 2024-09-13T17:07:06.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5eb96700 1 -- 172.21.15.123:0/2845372934 shutdown_connections 2024-09-13T17:07:06.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.718+0000 7f4e5eb96700 1 -- 172.21.15.123:0/2845372934 >> 172.21.15.123:0/2845372934 conn(0x7f4e5806fa10 msgr2=0x7f4e580b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:06.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.722+0000 7f4e5eb96700 1 -- 172.21.15.123:0/2845372934 shutdown_connections 2024-09-13T17:07:06.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.722+0000 7f4e5eb96700 1 -- 172.21.15.123:0/2845372934 wait complete. 2024-09-13T17:07:06.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.722+0000 7f4e5eb96700 1 Processor -- start 2024-09-13T17:07:06.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.722+0000 7f4e5eb96700 1 -- start start 2024-09-13T17:07:06.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.722+0000 7f4e5eb96700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e44004140 0x7f4e5814cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:06.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.722+0000 7f4e5eb96700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5814e800 0x7f4e5815d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:06.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.722+0000 7f4e5eb96700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e5814fee0 0x7f4e58150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:06.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.722+0000 7f4e5eb96700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5814d180 con 0x7f4e5814fee0 2024-09-13T17:07:06.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.722+0000 7f4e5eb96700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e581508a0 con 0x7f4e5814e800 2024-09-13T17:07:06.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.722+0000 7f4e5eb96700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5814d510 con 0x7f4e44004140 2024-09-13T17:07:06.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.722+0000 7f4e5e395700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e5814fee0 0x7f4e58150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:06.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e5e395700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e5814fee0 0x7f4e58150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48884/0 (socket says 172.21.15.123:48884) 2024-09-13T17:07:06.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e5e395700 1 -- 172.21.15.123:0/3302133480 learned_addr learned my addr 172.21.15.123:0/3302133480 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:06.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e5db94700 1 --2- 172.21.15.123:0/3302133480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e44004140 0x7f4e5814cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:06.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e5d393700 1 --2- 172.21.15.123:0/3302133480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5814e800 0x7f4e5815d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:06.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e5e395700 1 -- 172.21.15.123:0/3302133480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e44004140 msgr2=0x7f4e5814cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:06.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e5e395700 1 --2- 172.21.15.123:0/3302133480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e44004140 0x7f4e5814cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:06.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e5e395700 1 -- 172.21.15.123:0/3302133480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5814e800 msgr2=0x7f4e5815d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:06.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e5e395700 1 --2- 172.21.15.123:0/3302133480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5814e800 0x7f4e5815d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:06.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e5e395700 1 -- 172.21.15.123:0/3302133480 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5814e370 con 0x7f4e5814fee0 2024-09-13T17:07:06.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e5e395700 1 --2- 172.21.15.123:0/3302133480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e5814fee0 0x7f4e58150360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4e58072300 tx=0x7f4e5000fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:06.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e4e7fc700 1 -- 172.21.15.123:0/3302133480 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50006a90 con 0x7f4e5814fee0 2024-09-13T17:07:06.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e4e7fc700 1 -- 172.21.15.123:0/3302133480 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e50006bf0 con 0x7f4e5814fee0 2024-09-13T17:07:06.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e5eb96700 1 -- 172.21.15.123:0/3302133480 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5814d760 con 0x7f4e5814fee0 2024-09-13T17:07:06.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e4e7fc700 1 -- 172.21.15.123:0/3302133480 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500050d0 con 0x7f4e5814fee0 2024-09-13T17:07:06.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e5eb96700 1 -- 172.21.15.123:0/3302133480 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5814dd20 con 0x7f4e5814fee0 2024-09-13T17:07:06.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e5eb96700 1 -- 172.21.15.123:0/3302133480 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5814e500 con 0x7f4e5814fee0 2024-09-13T17:07:06.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e4e7fc700 1 -- 172.21.15.123:0/3302133480 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4e50005230 con 0x7f4e5814fee0 2024-09-13T17:07:06.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.726+0000 7f4e4e7fc700 1 --2- 172.21.15.123:0/3302133480 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4e3c066760 0x7f4e3c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:06.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.730+0000 7f4e5db94700 1 --2- 172.21.15.123:0/3302133480 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4e3c066760 0x7f4e3c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:06.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.730+0000 7f4e4e7fc700 1 -- 172.21.15.123:0/3302133480 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e50082fd0 con 0x7f4e5814fee0 2024-09-13T17:07:06.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.730+0000 7f4e5db94700 1 --2- 172.21.15.123:0/3302133480 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4e3c066760 0x7f4e3c068c20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4e540013d0 tx=0x7f4e54006040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:06.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.734+0000 7f4e4e7fc700 1 -- 172.21.15.123:0/3302133480 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4e500503d0 con 0x7f4e5814fee0 2024-09-13T17:07:06.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.942+0000 7f4e5eb96700 1 -- 172.21.15.123:0/3302133480 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4e58067380 con 0x7f4e5814fee0 2024-09-13T17:07:06.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.942+0000 7f4e4e7fc700 1 -- 172.21.15.123:0/3302133480 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4e50019060 con 0x7f4e5814fee0 2024-09-13T17:07:06.948 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:07:06.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.946+0000 7f4e5eb96700 1 -- 172.21.15.123:0/3302133480 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4e3c066760 msgr2=0x7f4e3c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:06.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.946+0000 7f4e5eb96700 1 --2- 172.21.15.123:0/3302133480 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4e3c066760 0x7f4e3c068c20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4e540013d0 tx=0x7f4e54006040 comp rx=0 tx=0).stop 2024-09-13T17:07:06.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.946+0000 7f4e5eb96700 1 -- 172.21.15.123:0/3302133480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e5814fee0 msgr2=0x7f4e58150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:06.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.946+0000 7f4e5eb96700 1 --2- 172.21.15.123:0/3302133480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e5814fee0 0x7f4e58150360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4e58072300 tx=0x7f4e5000fa50 comp rx=0 tx=0).stop 2024-09-13T17:07:06.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.946+0000 7f4e5eb96700 1 -- 172.21.15.123:0/3302133480 shutdown_connections 2024-09-13T17:07:06.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.946+0000 7f4e5eb96700 1 --2- 172.21.15.123:0/3302133480 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4e3c066760 0x7f4e3c068c20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:06.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.946+0000 7f4e5eb96700 1 --2- 172.21.15.123:0/3302133480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e5814fee0 0x7f4e58150360 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:06.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.946+0000 7f4e5eb96700 1 --2- 172.21.15.123:0/3302133480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5814e800 0x7f4e5815d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:06.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.946+0000 7f4e5eb96700 1 --2- 172.21.15.123:0/3302133480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e44004140 0x7f4e5814cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:06.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.946+0000 7f4e5eb96700 1 -- 172.21.15.123:0/3302133480 >> 172.21.15.123:0/3302133480 conn(0x7f4e5806fa10 msgr2=0x7f4e5806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:06.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.946+0000 7f4e5eb96700 1 -- 172.21.15.123:0/3302133480 shutdown_connections 2024-09-13T17:07:06.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:06.946+0000 7f4e5eb96700 1 -- 172.21.15.123:0/3302133480 wait complete. 2024-09-13T17:07:06.963 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:07:06.963 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:07:06.963 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-13T17:07:06.963 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:07:06.963 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:07:06.963 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:07:06.963 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:07:06.964 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:07:06.964 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:07:06.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:06.964 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-13T17:07:06.972 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:07:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:07:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:07:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-13T17:07:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:06.973 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:06.973 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:06.973 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:06.973 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:07:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:07:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42584sec preferred_lft 42584sec 2024-09-13T17:07:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-09-13T17:07:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:06.974 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:07:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:73:6c:03:01 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:07:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:06.974 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:07:06.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:06.975 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:07:06.975 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:07:06.975 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:07:06.975 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2024-09-13T17:07:06.975 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2024-09-13T17:07:06.976 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:07:06.976 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:07:07.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:07.063 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:07:07.073 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-13T17:07:07.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:07.075 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-13T17:07:07.103 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-13T17:07:07.103 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:07:07.103 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:07:07.103 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:07:07.103 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:07:07.103 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:07:07.103 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:07:07.103 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:07:07.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:07.104 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:07:07.104 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:07:07.104 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:07:07.104 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:07:07.104 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:07:07.104 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:07:07.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:07.180 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-13T17:07:07.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:07.188 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-09-13T17:07:07.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:07.195 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:07:07.195 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:07:07.195 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:07:07.195 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T17:07:07.195 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:07:07.227 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T17:07:07.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:07.227 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:07:07.227 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:07:07.227 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T17:07:07.227 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:07:07.227 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T17:07:07.227 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T17:07:07.227 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T17:07:07.227 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:07:07.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:07.346 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:07:07.346 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:07:07.346 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-09-13T17:07:07.346 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:07:07.346 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:07:07.373 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:07:07.373 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:07:07.373 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:07:07.379 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:07:07.379 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:07:07.379 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:07:07.429 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:07:07.446 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:07.446 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:07.456 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:07.457 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:07.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:07.458 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:07:07.465 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:07:07.465 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:07:07.467 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:07:07.485 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:07.485 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:07.495 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:07.496 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:07.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:07.497 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:07:07.559 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:2024-09-13T17:07:07.552+0000 7f90f1cff640 -1 init, newargv = 0x561cef7e2590 newargc=15 2024-09-13T17:07:07.559 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[32593]: starting ceph client 2024-09-13T17:07:07.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[32593]: starting fuse 2024-09-13T17:07:08.605 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:07:08.623 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:08.624 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:08.683 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:08.683 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:08.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:08.684 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:07:08.691 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-09-13T17:07:08.692 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:07:08.692 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:07:08.692 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-09-13T17:07:08.692 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-09-13T17:07:08.692 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-13T17:07:08.692 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-09-13T17:07:08.692 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:07:08.692 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-09-13T17:07:08.693 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:07:08.693 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-09-13T17:07:08.693 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:07:08.693 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:07:08.693 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-09-13T17:07:08.693 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-09-13T17:07:08.693 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-09-13T17:07:08.693 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-09-13T17:07:08.693 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:07:08.693 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-09-13T17:07:08.693 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:07:08.693 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:07:08.693 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:07:08.694 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-09-13T17:07:08.694 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-09-13T17:07:08.694 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-09-13T17:07:08.694 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:07:08.694 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:07:08.694 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.1")) 2024-09-13T17:07:08.694 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-13T17:07:08.771 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.1.32593.asok 2024-09-13T17:07:08.956 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.32593.asok 2024-09-13T17:07:08.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:08.957 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.32593.asok status 2024-09-13T17:07:09.105 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-13T17:07:09.105 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-09-13T17:07:09.106 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:07:09.106 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:07:09.106 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "1", 2024-09-13T17:07:09.106 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-09-13T17:07:09.106 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:07:09.106 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "32593", 2024-09-13T17:07:09.106 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-09-13T17:07:09.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:07:09.106 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-09-13T17:07:09.106 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-09-13T17:07:09.106 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4550, 2024-09-13T17:07:09.106 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-09-13T17:07:09.106 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-09-13T17:07:09.106 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-09-13T17:07:09.107 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 4550 2024-09-13T17:07:09.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:07:09.107 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:07:09.107 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:07:09.107 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:07:09.107 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 2354130369 2024-09-13T17:07:09.107 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-13T17:07:09.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:07:09.107 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:07:09.107 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:07:09.107 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:07:09.107 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 2354130369 2024-09-13T17:07:09.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:07:09.108 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.4550 192.168.0.1:0/2354130369", 2024-09-13T17:07:09.108 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.1:0/2354130369", 2024-09-13T17:07:09.108 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-09-13T17:07:09.108 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 7, 2024-09-13T17:07:09.108 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 20, 2024-09-13T17:07:09.108 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:07:09.108 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-09-13T17:07:09.108 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-09-13T17:07:09.108 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-13T17:07:09.115 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T17:07:09.115 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:07:09.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.229+0000 7f49df39a700 1 Processor -- start 2024-09-13T17:07:09.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.229+0000 7f49df39a700 1 -- start start 2024-09-13T17:07:09.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.229+0000 7f49df39a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f49d80aca40 0x7f49d80b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:09.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.229+0000 7f49df39a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49d80b2fc0 0x7f49d8166770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:09.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.229+0000 7f49df39a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d806be90 con 0x7f49d8072210 2024-09-13T17:07:09.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.229+0000 7f49df39a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d80b1c70 con 0x7f49d80aca40 2024-09-13T17:07:09.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.229+0000 7f49df39a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8070540 con 0x7f49d80b2fc0 2024-09-13T17:07:09.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.229+0000 7f49ddb97700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f49d80aca40 0x7f49d80b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:09.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.229+0000 7f49de398700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f49d8072210 0x7f49d815dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:37192/0 (socket says 172.21.15.123:37192) 2024-09-13T17:07:09.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.229+0000 7f49de398700 1 -- 172.21.15.123:0/1292071023 learned_addr learned my addr 172.21.15.123:0/1292071023 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:09.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.229+0000 7f49deb99700 1 --2- 172.21.15.123:0/1292071023 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49d80b2fc0 0x7f49d8166770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:09.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49ddb97700 1 -- 172.21.15.123:0/1292071023 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49d80b2fc0 msgr2=0x7f49d8166770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:09.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49ddb97700 1 --2- 172.21.15.123:0/1292071023 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49d80b2fc0 0x7f49d8166770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:09.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49ddb97700 1 -- 172.21.15.123:0/1292071023 >> v1:172.21.15.153:6789/0 conn(0x7f49d8072210 legacy=0x7f49d815dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:09.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49ddb97700 1 -- 172.21.15.123:0/1292071023 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d80acfc0 con 0x7f49d80aca40 2024-09-13T17:07:09.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49deb99700 1 --2- 172.21.15.123:0/1292071023 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49d80b2fc0 0x7f49d8166770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:09.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49ddb97700 1 --2- 172.21.15.123:0/1292071023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49d80aca40 0x7f49d80b2a80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009850 tx=0x7f49d4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0fe048e05c5b3f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:09.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49dd396700 1 -- 172.21.15.123:0/1292071023 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4011830 con 0x7f49d80aca40 2024-09-13T17:07:09.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49dd396700 1 -- 172.21.15.123:0/1292071023 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4011990 con 0x7f49d80aca40 2024-09-13T17:07:09.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49dd396700 1 -- 172.21.15.123:0/1292071023 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4011d40 con 0x7f49d80aca40 2024-09-13T17:07:09.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49df39a700 1 -- 172.21.15.123:0/1292071023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49d80aca40 msgr2=0x7f49d80b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:09.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49df39a700 1 --2- 172.21.15.123:0/1292071023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49d80aca40 0x7f49d80b2a80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009850 tx=0x7f49d4009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:09.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49df39a700 1 -- 172.21.15.123:0/1292071023 shutdown_connections 2024-09-13T17:07:09.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49df39a700 1 --2- 172.21.15.123:0/1292071023 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49d80b2fc0 0x7f49d8166770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:09.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49df39a700 1 --2- 172.21.15.123:0/1292071023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49d80aca40 0x7f49d80b2a80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:09.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49df39a700 1 -- 172.21.15.123:0/1292071023 >> 172.21.15.123:0/1292071023 conn(0x7f49d8066150 msgr2=0x7f49d8066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:09.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49df39a700 1 -- 172.21.15.123:0/1292071023 shutdown_connections 2024-09-13T17:07:09.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49df39a700 1 -- 172.21.15.123:0/1292071023 wait complete. 2024-09-13T17:07:09.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.233+0000 7f49df39a700 1 Processor -- start 2024-09-13T17:07:09.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49df39a700 1 -- start start 2024-09-13T17:07:09.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49df39a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49d8072210 0x7f49d81454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:09.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49df39a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49d80aca40 0x7f49d80b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:09.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49df39a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d80b2fc0 0x7f49d815ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:09.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49df39a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80ae140 con 0x7f49d80b2fc0 2024-09-13T17:07:09.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49df39a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d815e260 con 0x7f49d80aca40 2024-09-13T17:07:09.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49df39a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d815e540 con 0x7f49d8072210 2024-09-13T17:07:09.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49deb99700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d80b2fc0 0x7f49d815ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:09.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49deb99700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d80b2fc0 0x7f49d815ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48898/0 (socket says 172.21.15.123:48898) 2024-09-13T17:07:09.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49deb99700 1 -- 172.21.15.123:0/3983055134 learned_addr learned my addr 172.21.15.123:0/3983055134 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:09.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49ddb97700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49d80aca40 0x7f49d80b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:09.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49de398700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49d8072210 0x7f49d81454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:09.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49deb99700 1 -- 172.21.15.123:0/3983055134 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49d8072210 msgr2=0x7f49d81454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:09.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49deb99700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49d8072210 0x7f49d81454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:09.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49deb99700 1 -- 172.21.15.123:0/3983055134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49d80aca40 msgr2=0x7f49d80b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:09.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49deb99700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49d80aca40 0x7f49d80b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:09.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49deb99700 1 -- 172.21.15.123:0/3983055134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d0009a70 con 0x7f49d80b2fc0 2024-09-13T17:07:09.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49ddb97700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49d80aca40 0x7f49d80b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:09.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49deb99700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d80b2fc0 0x7f49d815ee30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f49d000efc0 tx=0x7f49d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:09.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49ceffd700 1 -- 172.21.15.123:0/3983055134 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000ca90 con 0x7f49d80b2fc0 2024-09-13T17:07:09.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49ceffd700 1 -- 172.21.15.123:0/3983055134 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d000f040 con 0x7f49d80b2fc0 2024-09-13T17:07:09.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49df39a700 1 -- 172.21.15.123:0/3983055134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d40094b0 con 0x7f49d80b2fc0 2024-09-13T17:07:09.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49ceffd700 1 -- 172.21.15.123:0/3983055134 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000ce30 con 0x7f49d80b2fc0 2024-09-13T17:07:09.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.237+0000 7f49df39a700 1 -- 172.21.15.123:0/3983055134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d80ae670 con 0x7f49d80b2fc0 2024-09-13T17:07:09.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.241+0000 7f49df39a700 1 -- 172.21.15.123:0/3983055134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d80677f0 con 0x7f49d80b2fc0 2024-09-13T17:07:09.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.241+0000 7f49ceffd700 1 -- 172.21.15.123:0/3983055134 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f49d0014480 con 0x7f49d80b2fc0 2024-09-13T17:07:09.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.241+0000 7f49ceffd700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f49bc066730 0x7f49bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:09.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.241+0000 7f49ceffd700 1 -- 172.21.15.123:0/3983055134 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49d0084830 con 0x7f49d80b2fc0 2024-09-13T17:07:09.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.241+0000 7f49de398700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f49bc066730 0x7f49bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:09.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.241+0000 7f49de398700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f49bc066730 0x7f49bc068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f49c8000f60 tx=0x7f49c8007f30 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:09.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.249+0000 7f49ceffd700 1 -- 172.21.15.123:0/3983055134 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f49d0051b10 con 0x7f49d80b2fc0 2024-09-13T17:07:09.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.453+0000 7f49df39a700 1 -- 172.21.15.123:0/3983055134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f49d80ae890 con 0x7f49d80b2fc0 2024-09-13T17:07:09.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.453+0000 7f49ceffd700 1 -- 172.21.15.123:0/3983055134 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f49d0009cd0 con 0x7f49d80b2fc0 2024-09-13T17:07:09.460 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:07:09.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.457+0000 7f49df39a700 1 -- 172.21.15.123:0/3983055134 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f49bc066730 msgr2=0x7f49bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:09.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.457+0000 7f49df39a700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f49bc066730 0x7f49bc068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f49c8000f60 tx=0x7f49c8007f30 comp rx=0 tx=0).stop 2024-09-13T17:07:09.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.457+0000 7f49df39a700 1 -- 172.21.15.123:0/3983055134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d80b2fc0 msgr2=0x7f49d815ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:09.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.457+0000 7f49df39a700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d80b2fc0 0x7f49d815ee30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f49d000efc0 tx=0x7f49d000c3a0 comp rx=0 tx=0).stop 2024-09-13T17:07:09.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.457+0000 7f49df39a700 1 -- 172.21.15.123:0/3983055134 shutdown_connections 2024-09-13T17:07:09.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.457+0000 7f49df39a700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f49bc066730 0x7f49bc068bf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:09.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.457+0000 7f49df39a700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d80b2fc0 0x7f49d815ee30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:09.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.457+0000 7f49df39a700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49d80aca40 0x7f49d80b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:09.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.457+0000 7f49df39a700 1 --2- 172.21.15.123:0/3983055134 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49d8072210 0x7f49d81454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:09.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.457+0000 7f49df39a700 1 -- 172.21.15.123:0/3983055134 >> 172.21.15.123:0/3983055134 conn(0x7f49d8066150 msgr2=0x7f49d80cd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:09.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.457+0000 7f49df39a700 1 -- 172.21.15.123:0/3983055134 shutdown_connections 2024-09-13T17:07:09.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:09.457+0000 7f49df39a700 1 -- 172.21.15.123:0/3983055134 wait complete. 2024-09-13T17:07:09.475 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:07:09.475 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:07:09.476 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-13T17:07:09.476 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-13T17:07:09.476 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T17:07:09.476 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:07:09.476 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:07:09.476 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:07:09.477 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-13T17:07:09.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:09.477 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-13T17:07:09.486 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:07:09.486 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:07:09.486 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:07:09.486 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.486 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-13T17:07:09.486 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.486 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:09.486 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:09.486 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:09.487 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:09.487 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:09.487 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:09.487 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:07:09.487 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:09.487 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:07:09.487 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42581sec preferred_lft 42581sec 2024-09-13T17:07:09.487 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-09-13T17:07:09.487 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.487 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:07:09.487 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:73:6c:03:01 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:09.487 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:07:09.487 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.487 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:07:09.488 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:09.488 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:07:09.488 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.488 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::f82f:21ff:fe0c:65de/64 scope link 2024-09-13T17:07:09.488 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.488 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:07:09.488 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:07:09.488 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::346e:9ff:fe92:ffa0/64 scope link 2024-09-13T17:07:09.488 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:09.489 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:07:09.504 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-13T17:07:09.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:09.506 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-13T17:07:09.556 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-13T17:07:09.556 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:07:09.556 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:07:09.556 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:07:09.557 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:07:09.557 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:07:09.557 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:07:09.557 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:07:09.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:09.557 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:07:09.557 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:07:09.557 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:07:09.558 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:07:09.558 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:07:09.558 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:07:09.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:09.598 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-13T17:07:09.605 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:07:09.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:09.606 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-09-13T17:07:09.611 INFO:teuthology.orchestra.run.smithi153.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-13T17:07:09.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:09.611 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:07:09.611 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:07:09.612 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:07:09.612 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-13T17:07:09.612 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:07:09.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:09.687 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T17:07:09.700 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:07:09.700 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:07:09.700 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:07:09.700 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.700 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-13T17:07:09.700 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.701 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:07:09.701 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 3a:17:fe:de:90:74 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:07:09.701 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:07:09.701 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.701 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::3817:feff:fede:9074/64 scope link 2024-09-13T17:07:09.701 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:09.702 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T17:07:09.715 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:07:09.715 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:07:09.715 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:07:09.715 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.715 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-13T17:07:09.715 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.715 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:07:09.715 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 3a:17:fe:de:90:74 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:07:09.715 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:07:09.715 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.715 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::3817:feff:fede:9074/64 scope link 2024-09-13T17:07:09.715 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:09.716 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-13T17:07:09.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:09.717 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:07:09.717 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:07:09.717 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-13T17:07:09.717 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T17:07:09.717 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-13T17:07:09.717 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-13T17:07:09.717 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-13T17:07:09.717 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:07:09.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:09.815 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:07:09.816 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:07:09.816 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.1 up 2024-09-13T17:07:09.816 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T17:07:09.816 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:07:09.842 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-13T17:07:09.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:07:09.842 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-13T17:07:09.848 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-13T17:07:09.849 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:07:09.849 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-13T17:07:09.897 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:07:09.915 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:09.915 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:09.924 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:09.925 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:09.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:09.926 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:07:09.932 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-09-13T17:07:09.932 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-09-13T17:07:09.933 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-13T17:07:09.935 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:07:09.950 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:09.950 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:10.008 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:10.009 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:10.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:10.010 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:07:10.014 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-09-13T17:07:10.021 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi153.stderr:2024-09-13T17:07:10.016+0000 7efe88ce8640 -1 init, newargv = 0x56037d4473c0 newargc=15 2024-09-13T17:07:10.021 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi153.stderr:ceph-fuse[32704]: starting ceph client 2024-09-13T17:07:10.029 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi153.stderr:ceph-fuse[32704]: starting fuse 2024-09-13T17:07:11.116 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:07:11.135 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:11.135 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:11.147 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:11.148 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:11.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:11.148 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:07:11.198 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-09-13T17:07:11.198 INFO:teuthology.orchestra.run.smithi153.stdout:53 2024-09-13T17:07:11.198 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-09-13T17:07:11.199 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:07:11.199 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-09-13T17:07:11.199 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-09-13T17:07:11.199 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-13T17:07:11.199 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-09-13T17:07:11.199 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:07:11.199 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-09-13T17:07:11.199 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-13T17:07:11.199 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-09-13T17:07:11.199 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-13T17:07:11.199 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:07:11.199 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-09-13T17:07:11.199 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-09-13T17:07:11.200 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-09-13T17:07:11.200 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-09-13T17:07:11.200 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:07:11.200 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-09-13T17:07:11.200 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:07:11.200 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:07:11.200 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:07:11.200 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-09-13T17:07:11.200 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-09-13T17:07:11.200 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-09-13T17:07:11.200 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:07:11.200 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:07:11.200 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.3")) 2024-09-13T17:07:11.201 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-13T17:07:11.279 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.3.32704.asok 2024-09-13T17:07:11.464 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.32704.asok 2024-09-13T17:07:11.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:11.465 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.32704.asok status 2024-09-13T17:07:11.568 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-13T17:07:11.568 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-09-13T17:07:11.568 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:07:11.568 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "3", 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "32704", 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4562, 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 4562 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:07:11.569 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:07:11.570 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:07:11.570 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.2:0", 2024-09-13T17:07:11.570 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 3335584432 2024-09-13T17:07:11.570 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-13T17:07:11.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:07:11.570 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:07:11.570 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:07:11.570 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.2:0", 2024-09-13T17:07:11.570 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 3335584432 2024-09-13T17:07:11.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:07:11.570 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.4562 192.168.0.2:0/3335584432", 2024-09-13T17:07:11.570 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.2:0/3335584432", 2024-09-13T17:07:11.570 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-09-13T17:07:11.571 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 7, 2024-09-13T17:07:11.571 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 20, 2024-09-13T17:07:11.571 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:07:11.571 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-09-13T17:07:11.571 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-09-13T17:07:11.571 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-13T17:07:11.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:11.578 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2024-09-13T17:07:11.578 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:07:11.586 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2024-09-13T17:07:11.587 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:07:11.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:11.587 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:07:11.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:11.648 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2024-09-13T17:07:11.648 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-13T17:07:11.656 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2024-09-13T17:07:11.656 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-13T17:07:11.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:11.657 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-13T17:07:11.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:11.676 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-09-13T17:07:11.676 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:07:11.684 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-09-13T17:07:11.684 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:07:11.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:11.684 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:07:11.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:11.746 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-09-13T17:07:11.746 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-13T17:07:11.752 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-09-13T17:07:11.752 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-13T17:07:11.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:11.752 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-13T17:07:11.766 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-13T17:07:11.783 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:11.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd394831700 1 Processor -- start 2024-09-13T17:07:11.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd394831700 1 -- start start 2024-09-13T17:07:11.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd394831700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3900b1cc0 0x7fd39016bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:11.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd394831700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39006e090 con 0x7fd3901612c0 2024-09-13T17:07:11.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd394831700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3900cc2d0 con 0x7fd3900cd090 2024-09-13T17:07:11.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd394831700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3901616a0 con 0x7fd3900b1cc0 2024-09-13T17:07:11.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38e59c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd3901612c0 0x7fd39006d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49414/0 (socket says 172.21.15.123:49414) 2024-09-13T17:07:11.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38e59c700 1 -- 172.21.15.123:0/18753906 learned_addr learned my addr 172.21.15.123:0/18753906 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:11.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38ed9d700 1 --2- 172.21.15.123:0/18753906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3900b1cc0 0x7fd39016bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:11.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 -- 172.21.15.123:0/18753906 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279629211 0 0) 0x7fd39006e090 con 0x7fd3901612c0 2024-09-13T17:07:11.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 -- 172.21.15.123:0/18753906 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd37c0035d0 con 0x7fd3901612c0 2024-09-13T17:07:11.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 -- 172.21.15.123:0/18753906 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 528227539 0 0) 0x7fd37c0035d0 con 0x7fd3901612c0 2024-09-13T17:07:11.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 -- 172.21.15.123:0/18753906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3900b1cc0 msgr2=0x7fd39016bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:11.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 --2- 172.21.15.123:0/18753906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3900b1cc0 0x7fd39016bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 -- 172.21.15.123:0/18753906 >> v1:172.21.15.153:6789/0 conn(0x7fd3900cd090 legacy=0x7fd3900b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 -- 172.21.15.123:0/18753906 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900cc5b0 con 0x7fd3901612c0 2024-09-13T17:07:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 -- 172.21.15.123:0/18753906 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7fd378001670 con 0x7fd3901612c0 2024-09-13T17:07:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 -- 172.21.15.123:0/18753906 >> v1:172.21.15.123:6789/0 conn(0x7fd3901612c0 legacy=0x7fd39006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 --2- 172.21.15.123:0/18753906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd37c003a50 0x7fd37c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 --2- 172.21.15.123:0/18753906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3900b1cc0 0x7fd37c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 --2- 172.21.15.123:0/18753906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd37c004db0 0x7fd37c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 -- 172.21.15.123:0/18753906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3901616a0 con 0x7fd37c003a50 2024-09-13T17:07:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 -- 172.21.15.123:0/18753906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c00bae0 con 0x7fd37c004db0 2024-09-13T17:07:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38d59a700 1 -- 172.21.15.123:0/18753906 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c00bca0 con 0x7fd3900b1cc0 2024-09-13T17:07:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38e59c700 1 --2- 172.21.15.123:0/18753906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd37c003a50 0x7fd37c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38dd9b700 1 --2- 172.21.15.123:0/18753906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3900b1cc0 0x7fd37c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38ed9d700 1 --2- 172.21.15.123:0/18753906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd37c004db0 0x7fd37c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:11.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38e59c700 1 -- 172.21.15.123:0/18753906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3900b1cc0 msgr2=0x7fd37c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:11.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38e59c700 1 --2- 172.21.15.123:0/18753906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3900b1cc0 0x7fd37c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:11.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38e59c700 1 -- 172.21.15.123:0/18753906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd37c004db0 msgr2=0x7fd37c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:11.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38e59c700 1 --2- 172.21.15.123:0/18753906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd37c004db0 0x7fd37c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:11.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38e59c700 1 -- 172.21.15.123:0/18753906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0035d0 con 0x7fd37c003a50 2024-09-13T17:07:11.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.901+0000 7fd38e59c700 1 --2- 172.21.15.123:0/18753906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd37c003a50 0x7fd37c003e30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd37800c2f0 tx=0x7fd37c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9047e770806e27e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:11.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.905+0000 7fd38d59a700 1 -- 172.21.15.123:0/18753906 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37800ce30 con 0x7fd37c003a50 2024-09-13T17:07:11.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.905+0000 7fd38d59a700 1 -- 172.21.15.123:0/18753906 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd378005980 con 0x7fd37c003a50 2024-09-13T17:07:11.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.905+0000 7fd38d59a700 1 -- 172.21.15.123:0/18753906 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378005d30 con 0x7fd37c003a50 2024-09-13T17:07:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.905+0000 7fd394831700 1 -- 172.21.15.123:0/18753906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd37c003a50 msgr2=0x7fd37c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.905+0000 7fd394831700 1 --2- 172.21.15.123:0/18753906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd37c003a50 0x7fd37c003e30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd37800c2f0 tx=0x7fd37c0058a0 comp rx=0 tx=0).stop 2024-09-13T17:07:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.905+0000 7fd38ed9d700 1 -- 172.21.15.123:0/18753906 reap_dead start 2024-09-13T17:07:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.905+0000 7fd394831700 1 -- 172.21.15.123:0/18753906 shutdown_connections 2024-09-13T17:07:11.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.905+0000 7fd394831700 1 -- 172.21.15.123:0/18753906 >> 172.21.15.123:0/18753906 conn(0x7fd39006a6b0 msgr2=0x7fd390066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:11.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.905+0000 7fd394831700 1 -- 172.21.15.123:0/18753906 shutdown_connections 2024-09-13T17:07:11.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.905+0000 7fd394831700 1 -- 172.21.15.123:0/18753906 wait complete. 2024-09-13T17:07:11.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.905+0000 7fd394831700 1 Processor -- start 2024-09-13T17:07:11.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.905+0000 7fd394831700 1 -- start start 2024-09-13T17:07:11.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd394831700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd390143d30 0x7fd3900b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:11.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd394831700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3900b2920 0x7fd390155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:11.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd394831700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3900b4d80 0x7fd3900b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:11.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd394831700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900b5740 con 0x7fd3900b2920 2024-09-13T17:07:11.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd394831700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900b3aa0 con 0x7fd390143d30 2024-09-13T17:07:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd394831700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900b4470 con 0x7fd3900b4d80 2024-09-13T17:07:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd38dd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3900b2920 0x7fd390155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd38dd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3900b2920 0x7fd390155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48922/0 (socket says 172.21.15.123:48922) 2024-09-13T17:07:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd38dd9b700 1 -- 172.21.15.123:0/3547457099 learned_addr learned my addr 172.21.15.123:0/3547457099 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd38e59c700 1 --2- 172.21.15.123:0/3547457099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd390143d30 0x7fd3900b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd38ed9d700 1 --2- 172.21.15.123:0/3547457099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3900b4d80 0x7fd3900b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:11.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd38dd9b700 1 -- 172.21.15.123:0/3547457099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3900b4d80 msgr2=0x7fd3900b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:11.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd38dd9b700 1 --2- 172.21.15.123:0/3547457099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3900b4d80 0x7fd3900b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:11.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd38dd9b700 1 -- 172.21.15.123:0/3547457099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd390143d30 msgr2=0x7fd3900b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:11.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd38dd9b700 1 --2- 172.21.15.123:0/3547457099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd390143d30 0x7fd3900b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:11.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd38dd9b700 1 -- 172.21.15.123:0/3547457099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900b2e90 con 0x7fd3900b2920 2024-09-13T17:07:11.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd38dd9b700 1 --2- 172.21.15.123:0/3547457099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3900b2920 0x7fd390155d50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd38800d400 tx=0x7fd38800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:11.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd386ffd700 1 -- 172.21.15.123:0/3547457099 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800dcc0 con 0x7fd3900b2920 2024-09-13T17:07:11.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd386ffd700 1 -- 172.21.15.123:0/3547457099 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38800de20 con 0x7fd3900b2920 2024-09-13T17:07:11.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd386ffd700 1 -- 172.21.15.123:0/3547457099 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388003c60 con 0x7fd3900b2920 2024-09-13T17:07:11.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd394831700 1 -- 172.21.15.123:0/3547457099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3900b3170 con 0x7fd3900b2920 2024-09-13T17:07:11.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.909+0000 7fd394831700 1 -- 172.21.15.123:0/3547457099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3900b3730 con 0x7fd3900b2920 2024-09-13T17:07:11.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.913+0000 7fd394831700 1 -- 172.21.15.123:0/3547457099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3900b3c30 con 0x7fd3900b2920 2024-09-13T17:07:11.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.913+0000 7fd386ffd700 1 -- 172.21.15.123:0/3547457099 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3880050d0 con 0x7fd3900b2920 2024-09-13T17:07:11.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.913+0000 7fd386ffd700 1 --2- 172.21.15.123:0/3547457099 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd370066760 0x7fd370068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.913+0000 7fd386ffd700 1 -- 172.21.15.123:0/3547457099 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3880845a0 con 0x7fd3900b2920 2024-09-13T17:07:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.913+0000 7fd38e59c700 1 --2- 172.21.15.123:0/3547457099 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd370066760 0x7fd370068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.913+0000 7fd38e59c700 1 --2- 172.21.15.123:0/3547457099 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd370066760 0x7fd370068c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd3900cea70 tx=0x7fd378007000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:11.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:11.921+0000 7fd386ffd700 1 -- 172.21.15.123:0/3547457099 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd3880519a0 con 0x7fd3900b2920 2024-09-13T17:07:12.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.097+0000 7fd394831700 1 -- 172.21.15.123:0/3547457099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3900cc2d0 con 0x7fd3900b2920 2024-09-13T17:07:12.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.101+0000 7fd386ffd700 1 -- 172.21.15.123:0/3547457099 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7fd388054fc0 con 0x7fd3900b2920 2024-09-13T17:07:12.108 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:12.108 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:12.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.101+0000 7fd394831700 1 -- 172.21.15.123:0/3547457099 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd370066760 msgr2=0x7fd370068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.101+0000 7fd394831700 1 --2- 172.21.15.123:0/3547457099 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd370066760 0x7fd370068c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd3900cea70 tx=0x7fd378007000 comp rx=0 tx=0).stop 2024-09-13T17:07:12.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.101+0000 7fd394831700 1 -- 172.21.15.123:0/3547457099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3900b2920 msgr2=0x7fd390155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.101+0000 7fd394831700 1 --2- 172.21.15.123:0/3547457099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3900b2920 0x7fd390155d50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd38800d400 tx=0x7fd38800d710 comp rx=0 tx=0).stop 2024-09-13T17:07:12.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.101+0000 7fd394831700 1 -- 172.21.15.123:0/3547457099 shutdown_connections 2024-09-13T17:07:12.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.105+0000 7fd394831700 1 --2- 172.21.15.123:0/3547457099 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd370066760 0x7fd370068c20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.105+0000 7fd394831700 1 --2- 172.21.15.123:0/3547457099 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3900b4d80 0x7fd3900b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.105+0000 7fd394831700 1 --2- 172.21.15.123:0/3547457099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3900b2920 0x7fd390155d50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.105+0000 7fd394831700 1 --2- 172.21.15.123:0/3547457099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd390143d30 0x7fd3900b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.105+0000 7fd394831700 1 -- 172.21.15.123:0/3547457099 >> 172.21.15.123:0/3547457099 conn(0x7fd39006a6b0 msgr2=0x7fd390160540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:12.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.105+0000 7fd394831700 1 -- 172.21.15.123:0/3547457099 shutdown_connections 2024-09-13T17:07:12.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.105+0000 7fd394831700 1 -- 172.21.15.123:0/3547457099 wait complete. 2024-09-13T17:07:12.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:12.123 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:12.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.229+0000 7efdcad70700 1 Processor -- start 2024-09-13T17:07:12.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.229+0000 7efdcad70700 1 -- start start 2024-09-13T17:07:12.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdcad70700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efdc40d0f40 0x7efdc40d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdcad70700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc40b58b0 0x7efdc40d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdcad70700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc40b0060 con 0x7efdc40b1100 2024-09-13T17:07:12.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdcad70700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc40b0340 con 0x7efdc40d0f40 2024-09-13T17:07:12.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdcad70700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc40b0620 con 0x7efdc40b58b0 2024-09-13T17:07:12.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdca56f700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7efdc40b1100 0x7efdc40b1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55996/0 (socket says 172.21.15.123:55996) 2024-09-13T17:07:12.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdc9d6e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efdc40d0f40 0x7efdc40d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdca56f700 1 -- 172.21.15.123:0/382468241 learned_addr learned my addr 172.21.15.123:0/382468241 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:12.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdc956d700 1 --2- 172.21.15.123:0/382468241 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc40b58b0 0x7efdc40d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdc9d6e700 1 -- 172.21.15.123:0/382468241 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc40b58b0 msgr2=0x7efdc40d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:12.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdc9d6e700 1 --2- 172.21.15.123:0/382468241 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc40b58b0 0x7efdc40d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdc9d6e700 1 -- 172.21.15.123:0/382468241 >> v1:172.21.15.123:6789/0 conn(0x7efdc40b1100 legacy=0x7efdc40b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdc9d6e700 1 -- 172.21.15.123:0/382468241 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc40b0900 con 0x7efdc40d0f40 2024-09-13T17:07:12.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdc8d6c700 1 -- 172.21.15.123:0/382468241 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506292669 0 0) 0x7efdc40b0060 con 0x7efdc40b1100 2024-09-13T17:07:12.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdc9d6e700 1 --2- 172.21.15.123:0/382468241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdc40d0f40 0x7efdc40d1320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009850 tx=0x7efdc0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d9ffcbc0ea0c6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:12.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdc8d6c700 1 -- 172.21.15.123:0/382468241 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc0011830 con 0x7efdc40d0f40 2024-09-13T17:07:12.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdc8d6c700 1 -- 172.21.15.123:0/382468241 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc0011990 con 0x7efdc40d0f40 2024-09-13T17:07:12.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdc8d6c700 1 -- 172.21.15.123:0/382468241 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc0011d40 con 0x7efdc40d0f40 2024-09-13T17:07:12.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdcad70700 1 -- 172.21.15.123:0/382468241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdc40d0f40 msgr2=0x7efdc40d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdcad70700 1 --2- 172.21.15.123:0/382468241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdc40d0f40 0x7efdc40d1320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009850 tx=0x7efdc0009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:12.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdcad70700 1 -- 172.21.15.123:0/382468241 shutdown_connections 2024-09-13T17:07:12.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdcad70700 1 --2- 172.21.15.123:0/382468241 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc40b58b0 0x7efdc40d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdcad70700 1 --2- 172.21.15.123:0/382468241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdc40d0f40 0x7efdc40d1320 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdcad70700 1 -- 172.21.15.123:0/382468241 >> 172.21.15.123:0/382468241 conn(0x7efdc40d2a60 msgr2=0x7efdc40d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:12.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdcad70700 1 -- 172.21.15.123:0/382468241 shutdown_connections 2024-09-13T17:07:12.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.233+0000 7efdcad70700 1 -- 172.21.15.123:0/382468241 wait complete. 2024-09-13T17:07:12.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdcad70700 1 Processor -- start 2024-09-13T17:07:12.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdcad70700 1 -- start start 2024-09-13T17:07:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdcad70700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc40b1100 0x7efdc40c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdcad70700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc40b58b0 0x7efdc40b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdcad70700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdc40d0f40 0x7efdc4153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdcad70700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc40c9210 con 0x7efdc40d0f40 2024-09-13T17:07:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdcad70700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc40c9440 con 0x7efdc40b1100 2024-09-13T17:07:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdcad70700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc40b23c0 con 0x7efdc40b58b0 2024-09-13T17:07:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdca56f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdc40d0f40 0x7efdc4153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdca56f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdc40d0f40 0x7efdc4153b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56736/0 (socket says 172.21.15.123:56736) 2024-09-13T17:07:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdca56f700 1 -- 172.21.15.123:0/2011205818 learned_addr learned my addr 172.21.15.123:0/2011205818 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdc9d6e700 1 --2- 172.21.15.123:0/2011205818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc40b1100 0x7efdc40c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdc956d700 1 --2- 172.21.15.123:0/2011205818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc40b58b0 0x7efdc40b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdca56f700 1 -- 172.21.15.123:0/2011205818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc40b58b0 msgr2=0x7efdc40b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdca56f700 1 --2- 172.21.15.123:0/2011205818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc40b58b0 0x7efdc40b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdca56f700 1 -- 172.21.15.123:0/2011205818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc40b1100 msgr2=0x7efdc40c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdca56f700 1 --2- 172.21.15.123:0/2011205818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc40b1100 0x7efdc40c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdca56f700 1 -- 172.21.15.123:0/2011205818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc00094b0 con 0x7efdc40d0f40 2024-09-13T17:07:12.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdca56f700 1 --2- 172.21.15.123:0/2011205818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdc40d0f40 0x7efdc4153b70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00cc10 tx=0x7efdbc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:12.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdb67fc700 1 -- 172.21.15.123:0/2011205818 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc00a9e0 con 0x7efdc40d0f40 2024-09-13T17:07:12.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdb67fc700 1 -- 172.21.15.123:0/2011205818 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc00ab40 con 0x7efdc40d0f40 2024-09-13T17:07:12.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdcad70700 1 -- 172.21.15.123:0/2011205818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc40b26a0 con 0x7efdc40d0f40 2024-09-13T17:07:12.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdb67fc700 1 -- 172.21.15.123:0/2011205818 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0070d0 con 0x7efdc40d0f40 2024-09-13T17:07:12.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.237+0000 7efdcad70700 1 -- 172.21.15.123:0/2011205818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc40b2c60 con 0x7efdc40d0f40 2024-09-13T17:07:12.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.241+0000 7efdcad70700 1 -- 172.21.15.123:0/2011205818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc415ce70 con 0x7efdc40d0f40 2024-09-13T17:07:12.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.241+0000 7efdb67fc700 1 -- 172.21.15.123:0/2011205818 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efdbc007230 con 0x7efdc40d0f40 2024-09-13T17:07:12.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.241+0000 7efdb67fc700 1 --2- 172.21.15.123:0/2011205818 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efda8066730 0x7efda8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.241+0000 7efdb67fc700 1 -- 172.21.15.123:0/2011205818 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdbc083e40 con 0x7efdc40d0f40 2024-09-13T17:07:12.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.241+0000 7efdc9d6e700 1 --2- 172.21.15.123:0/2011205818 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efda8066730 0x7efda8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.241+0000 7efdc9d6e700 1 --2- 172.21.15.123:0/2011205818 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efda8066730 0x7efda8068bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efdc0000c00 tx=0x7efdc001c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:12.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.249+0000 7efdb67fc700 1 -- 172.21.15.123:0/2011205818 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efdbc051120 con 0x7efdc40d0f40 2024-09-13T17:07:12.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.417+0000 7efdcad70700 1 -- 172.21.15.123:0/2011205818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efdc408c250 con 0x7efdc40d0f40 2024-09-13T17:07:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.417+0000 7efdb67fc700 1 -- 172.21.15.123:0/2011205818 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7efdbc018070 con 0x7efdc40d0f40 2024-09-13T17:07:12.423 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.417+0000 7efdcad70700 1 -- 172.21.15.123:0/2011205818 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efda8066730 msgr2=0x7efda8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.417+0000 7efdcad70700 1 --2- 172.21.15.123:0/2011205818 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efda8066730 0x7efda8068bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efdc0000c00 tx=0x7efdc001c040 comp rx=0 tx=0).stop 2024-09-13T17:07:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.417+0000 7efdcad70700 1 -- 172.21.15.123:0/2011205818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdc40d0f40 msgr2=0x7efdc4153b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.417+0000 7efdcad70700 1 --2- 172.21.15.123:0/2011205818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdc40d0f40 0x7efdc4153b70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00cc10 tx=0x7efdbc00cf20 comp rx=0 tx=0).stop 2024-09-13T17:07:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.417+0000 7efdcad70700 1 -- 172.21.15.123:0/2011205818 shutdown_connections 2024-09-13T17:07:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.417+0000 7efdcad70700 1 --2- 172.21.15.123:0/2011205818 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efda8066730 0x7efda8068bf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.417+0000 7efdcad70700 1 --2- 172.21.15.123:0/2011205818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdc40d0f40 0x7efdc4153b70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.417+0000 7efdcad70700 1 --2- 172.21.15.123:0/2011205818 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc40b58b0 0x7efdc40b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.417+0000 7efdcad70700 1 --2- 172.21.15.123:0/2011205818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc40b1100 0x7efdc40c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.417+0000 7efdcad70700 1 -- 172.21.15.123:0/2011205818 >> 172.21.15.123:0/2011205818 conn(0x7efdc40d2a60 msgr2=0x7efdc40af650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.421+0000 7efdcad70700 1 -- 172.21.15.123:0/2011205818 shutdown_connections 2024-09-13T17:07:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.421+0000 7efdcad70700 1 -- 172.21.15.123:0/2011205818 wait complete. 2024-09-13T17:07:12.438 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:07:12.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.545+0000 7f64d3085700 1 Processor -- start 2024-09-13T17:07:12.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.545+0000 7f64d3085700 1 -- start start 2024-09-13T17:07:12.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.545+0000 7f64d3085700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f64c4007d40 0x7f64c403a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d3085700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64c4005e80 0x7f64c4036960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d3085700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f64c4036ea0 0x7f64c4037310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d3085700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c404ff00 con 0x7f64c4036ea0 2024-09-13T17:07:12.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d3085700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c403aae0 con 0x7f64c4007d40 2024-09-13T17:07:12.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d3085700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c403ad60 con 0x7f64c4005e80 2024-09-13T17:07:12.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d2884700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f64c4036ea0 0x7f64c4037310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d2884700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f64c4036ea0 0x7f64c4037310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56750/0 (socket says 172.21.15.123:56750) 2024-09-13T17:07:12.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d2884700 1 -- 172.21.15.123:0/3072379666 learned_addr learned my addr 172.21.15.123:0/3072379666 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:12.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d2083700 1 --2- 172.21.15.123:0/3072379666 >> v2:172.21.15.153:3300/0 conn(0x7f64c4007d40 0x7f64c403a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d1882700 1 --2- 172.21.15.123:0/3072379666 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64c4005e80 0x7f64c4036960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d2884700 1 -- 172.21.15.123:0/3072379666 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64c4005e80 msgr2=0x7f64c4036960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:12.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d2884700 1 --2- 172.21.15.123:0/3072379666 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64c4005e80 0x7f64c4036960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d2884700 1 -- 172.21.15.123:0/3072379666 >> v2:172.21.15.153:3300/0 conn(0x7f64c4007d40 msgr2=0x7f64c403a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:12.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d2884700 1 --2- 172.21.15.123:0/3072379666 >> v2:172.21.15.153:3300/0 conn(0x7f64c4007d40 0x7f64c403a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d2884700 1 -- 172.21.15.123:0/3072379666 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c404f5d0 con 0x7f64c4036ea0 2024-09-13T17:07:12.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d2083700 1 --2- 172.21.15.123:0/3072379666 >> v2:172.21.15.153:3300/0 conn(0x7f64c4007d40 0x7f64c403a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:12.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d2884700 1 --2- 172.21.15.123:0/3072379666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c4036ea0 0x7f64c4037310 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f64cc064010 tx=0x7f64cc069900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16be4b19f3732eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:12.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d1081700 1 -- 172.21.15.123:0/3072379666 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc0687a0 con 0x7f64c4036ea0 2024-09-13T17:07:12.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d1081700 1 -- 172.21.15.123:0/3072379666 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc073f10 con 0x7f64c4036ea0 2024-09-13T17:07:12.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d1081700 1 -- 172.21.15.123:0/3072379666 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc074300 con 0x7f64c4036ea0 2024-09-13T17:07:12.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d3085700 1 -- 172.21.15.123:0/3072379666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c4036ea0 msgr2=0x7f64c4037310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d3085700 1 --2- 172.21.15.123:0/3072379666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c4036ea0 0x7f64c4037310 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f64cc064010 tx=0x7f64cc069900 comp rx=0 tx=0).stop 2024-09-13T17:07:12.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d3085700 1 -- 172.21.15.123:0/3072379666 shutdown_connections 2024-09-13T17:07:12.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d3085700 1 --2- 172.21.15.123:0/3072379666 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64c4005e80 0x7f64c4036960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d3085700 1 --2- 172.21.15.123:0/3072379666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c4036ea0 0x7f64c4037310 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d3085700 1 --2- 172.21.15.123:0/3072379666 >> v2:172.21.15.153:3300/0 conn(0x7f64c4007d40 0x7f64c403a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d3085700 1 -- 172.21.15.123:0/3072379666 >> 172.21.15.123:0/3072379666 conn(0x7f64c401e270 msgr2=0x7f64c4054ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:12.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d3085700 1 -- 172.21.15.123:0/3072379666 shutdown_connections 2024-09-13T17:07:12.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.549+0000 7f64d3085700 1 -- 172.21.15.123:0/3072379666 wait complete. 2024-09-13T17:07:12.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d3085700 1 Processor -- start 2024-09-13T17:07:12.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d3085700 1 -- start start 2024-09-13T17:07:12.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d3085700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c4005e80 0x7f64c4055280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d3085700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64c4007d40 0x7f64c404e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d3085700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c4036ea0 0x7f64c404e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d3085700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c404cb90 con 0x7f64c4036ea0 2024-09-13T17:07:12.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d3085700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c404bfc0 con 0x7f64c4005e80 2024-09-13T17:07:12.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d3085700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c404c260 con 0x7f64c4007d40 2024-09-13T17:07:12.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d2884700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c4036ea0 0x7f64c404e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d2884700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c4036ea0 0x7f64c404e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56756/0 (socket says 172.21.15.123:56756) 2024-09-13T17:07:12.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d2884700 1 -- 172.21.15.123:0/2872992668 learned_addr learned my addr 172.21.15.123:0/2872992668 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:12.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d1882700 1 --2- 172.21.15.123:0/2872992668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64c4007d40 0x7f64c404e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d2083700 1 --2- 172.21.15.123:0/2872992668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c4005e80 0x7f64c4055280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d2884700 1 -- 172.21.15.123:0/2872992668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64c4007d40 msgr2=0x7f64c404e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d2884700 1 --2- 172.21.15.123:0/2872992668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64c4007d40 0x7f64c404e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d2884700 1 -- 172.21.15.123:0/2872992668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c4005e80 msgr2=0x7f64c4055280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d2884700 1 --2- 172.21.15.123:0/2872992668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c4005e80 0x7f64c4055280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d2884700 1 -- 172.21.15.123:0/2872992668 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc04f5c0 con 0x7f64c4036ea0 2024-09-13T17:07:12.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d2884700 1 --2- 172.21.15.123:0/2872992668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c4036ea0 0x7f64c404e9f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0641b0 tx=0x7f64cc069dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:12.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64c2ffd700 1 -- 172.21.15.123:0/2872992668 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc098070 con 0x7f64c4036ea0 2024-09-13T17:07:12.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64c2ffd700 1 -- 172.21.15.123:0/2872992668 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc0720c0 con 0x7f64c4036ea0 2024-09-13T17:07:12.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64c2ffd700 1 -- 172.21.15.123:0/2872992668 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc072450 con 0x7f64c4036ea0 2024-09-13T17:07:12.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d3085700 1 -- 172.21.15.123:0/2872992668 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c404c540 con 0x7f64c4036ea0 2024-09-13T17:07:12.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.553+0000 7f64d3085700 1 -- 172.21.15.123:0/2872992668 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c404b400 con 0x7f64c4036ea0 2024-09-13T17:07:12.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.557+0000 7f64d3085700 1 -- 172.21.15.123:0/2872992668 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c404bd70 con 0x7f64c4036ea0 2024-09-13T17:07:12.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.557+0000 7f64c2ffd700 1 -- 172.21.15.123:0/2872992668 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f64cc06d040 con 0x7f64c4036ea0 2024-09-13T17:07:12.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.557+0000 7f64c2ffd700 1 --2- 172.21.15.123:0/2872992668 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64b0066730 0x7f64b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.557+0000 7f64c2ffd700 1 -- 172.21.15.123:0/2872992668 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64cc0feda0 con 0x7f64c4036ea0 2024-09-13T17:07:12.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.557+0000 7f64d2083700 1 --2- 172.21.15.123:0/2872992668 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64b0066730 0x7f64b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.557+0000 7f64d2083700 1 --2- 172.21.15.123:0/2872992668 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64b0066730 0x7f64b0068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009960 tx=0x7f64c8008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:12.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.565+0000 7f64c2ffd700 1 -- 172.21.15.123:0/2872992668 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f64cc0cc100 con 0x7f64c4036ea0 2024-09-13T17:07:12.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.737+0000 7f64d3085700 1 -- 172.21.15.123:0/2872992668 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64c40083d0 con 0x7f64c4036ea0 2024-09-13T17:07:12.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.737+0000 7f64c2ffd700 1 -- 172.21.15.123:0/2872992668 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64cc0cf720 con 0x7f64c4036ea0 2024-09-13T17:07:12.743 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:07:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.737+0000 7f64d3085700 1 -- 172.21.15.123:0/2872992668 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64b0066730 msgr2=0x7f64b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.737+0000 7f64d3085700 1 --2- 172.21.15.123:0/2872992668 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64b0066730 0x7f64b0068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009960 tx=0x7f64c8008040 comp rx=0 tx=0).stop 2024-09-13T17:07:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.737+0000 7f64d3085700 1 -- 172.21.15.123:0/2872992668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c4036ea0 msgr2=0x7f64c404e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.737+0000 7f64d3085700 1 --2- 172.21.15.123:0/2872992668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c4036ea0 0x7f64c404e9f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0641b0 tx=0x7f64cc069dc0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.741+0000 7f64d3085700 1 -- 172.21.15.123:0/2872992668 shutdown_connections 2024-09-13T17:07:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.741+0000 7f64d3085700 1 --2- 172.21.15.123:0/2872992668 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64b0066730 0x7f64b0068bf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.741+0000 7f64d3085700 1 --2- 172.21.15.123:0/2872992668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c4036ea0 0x7f64c404e9f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.741+0000 7f64d3085700 1 --2- 172.21.15.123:0/2872992668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64c4007d40 0x7f64c404e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.741+0000 7f64d3085700 1 --2- 172.21.15.123:0/2872992668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c4005e80 0x7f64c4055280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.741+0000 7f64d3085700 1 -- 172.21.15.123:0/2872992668 >> 172.21.15.123:0/2872992668 conn(0x7f64c401e270 msgr2=0x7f64c4006cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.741+0000 7f64d3085700 1 -- 172.21.15.123:0/2872992668 shutdown_connections 2024-09-13T17:07:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.741+0000 7f64d3085700 1 -- 172.21.15.123:0/2872992668 wait complete. 2024-09-13T17:07:12.762 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:07:12.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.873+0000 7f8dabfff700 1 Processor -- start 2024-09-13T17:07:12.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.873+0000 7f8dabfff700 1 -- start start 2024-09-13T17:07:12.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dabfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dac0d0f40 0x7f8dac0d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dabfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8dac0b58b0 0x7f8dac0d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dabfff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dac0b0060 con 0x7f8dac0b1100 2024-09-13T17:07:12.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dabfff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dac0b0340 con 0x7f8dac0b58b0 2024-09-13T17:07:12.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dabfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac0b0620 con 0x7f8dac0d0f40 2024-09-13T17:07:12.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dab7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8dac0b1100 0x7f8dac0b1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56008/0 (socket says 172.21.15.123:56008) 2024-09-13T17:07:12.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dab7fe700 1 -- 172.21.15.123:0/1276634793 learned_addr learned my addr 172.21.15.123:0/1276634793 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:12.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8daa7fc700 1 --2- 172.21.15.123:0/1276634793 >> v2:172.21.15.153:3300/0 conn(0x7f8dac0b58b0 0x7f8dac0d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8daaffd700 1 --2- 172.21.15.123:0/1276634793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dac0d0f40 0x7f8dac0d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 -- 172.21.15.123:0/1276634793 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282257175 0 0) 0x7f8dac0b0060 con 0x7f8dac0b1100 2024-09-13T17:07:12.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 -- 172.21.15.123:0/1276634793 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d940035d0 con 0x7f8dac0b1100 2024-09-13T17:07:12.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 -- 172.21.15.123:0/1276634793 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2448725032 0 0) 0x7f8d940035d0 con 0x7f8dac0b1100 2024-09-13T17:07:12.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 -- 172.21.15.123:0/1276634793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dac0d0f40 msgr2=0x7f8dac0d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:12.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 --2- 172.21.15.123:0/1276634793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dac0d0f40 0x7f8dac0d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 -- 172.21.15.123:0/1276634793 >> v2:172.21.15.153:3300/0 conn(0x7f8dac0b58b0 msgr2=0x7f8dac0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:12.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 --2- 172.21.15.123:0/1276634793 >> v2:172.21.15.153:3300/0 conn(0x7f8dac0b58b0 0x7f8dac0d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 -- 172.21.15.123:0/1276634793 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac0b0900 con 0x7f8dac0b1100 2024-09-13T17:07:12.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 -- 172.21.15.123:0/1276634793 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f8da40019f0 con 0x7f8dac0b1100 2024-09-13T17:07:12.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8daa7fc700 1 --2- 172.21.15.123:0/1276634793 >> v2:172.21.15.153:3300/0 conn(0x7f8dac0b58b0 0x7f8dac0d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:12.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 -- 172.21.15.123:0/1276634793 >> v1:172.21.15.123:6789/0 conn(0x7f8dac0b1100 legacy=0x7f8dac0b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 --2- 172.21.15.123:0/1276634793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d94003a20 0x7f8d94003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 --2- 172.21.15.123:0/1276634793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d94004870 0x7f8d94004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 --2- 172.21.15.123:0/1276634793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dac0d0f40 0x7f8d94005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 -- 172.21.15.123:0/1276634793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac0b0340 con 0x7f8d94004870 2024-09-13T17:07:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 -- 172.21.15.123:0/1276634793 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac0b0620 con 0x7f8d94003a20 2024-09-13T17:07:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 -- 172.21.15.123:0/1276634793 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9400ba30 con 0x7f8dac0d0f40 2024-09-13T17:07:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8daa7fc700 1 --2- 172.21.15.123:0/1276634793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d94004870 0x7f8d94004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8daaffd700 1 --2- 172.21.15.123:0/1276634793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d94003a20 0x7f8d94003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dab7fe700 1 --2- 172.21.15.123:0/1276634793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dac0d0f40 0x7f8d94005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8daa7fc700 1 -- 172.21.15.123:0/1276634793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dac0d0f40 msgr2=0x7f8d94005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8daa7fc700 1 --2- 172.21.15.123:0/1276634793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dac0d0f40 0x7f8d94005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8daa7fc700 1 -- 172.21.15.123:0/1276634793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d94003a20 msgr2=0x7f8d94003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8daa7fc700 1 --2- 172.21.15.123:0/1276634793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d94003a20 0x7f8d94003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8daa7fc700 1 -- 172.21.15.123:0/1276634793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d940035d0 con 0x7f8d94004870 2024-09-13T17:07:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8daa7fc700 1 --2- 172.21.15.123:0/1276634793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d94004870 0x7f8d94004cf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009d10 tx=0x7f8d940058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56c46651955739a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 -- 172.21.15.123:0/1276634793 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c009e60 con 0x7f8d94004870 2024-09-13T17:07:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 -- 172.21.15.123:0/1276634793 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9c00e9a0 con 0x7f8d94004870 2024-09-13T17:07:12.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8da9ffb700 1 -- 172.21.15.123:0/1276634793 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c00ed10 con 0x7f8d94004870 2024-09-13T17:07:12.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dabfff700 1 -- 172.21.15.123:0/1276634793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d94004870 msgr2=0x7f8d94004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dabfff700 1 --2- 172.21.15.123:0/1276634793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d94004870 0x7f8d94004cf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009d10 tx=0x7f8d940058a0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dab7fe700 1 -- 172.21.15.123:0/1276634793 reap_dead start 2024-09-13T17:07:12.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dabfff700 1 -- 172.21.15.123:0/1276634793 shutdown_connections 2024-09-13T17:07:12.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dabfff700 1 -- 172.21.15.123:0/1276634793 >> 172.21.15.123:0/1276634793 conn(0x7f8dac0d2a60 msgr2=0x7f8dac0d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:12.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dabfff700 1 -- 172.21.15.123:0/1276634793 shutdown_connections 2024-09-13T17:07:12.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.877+0000 7f8dabfff700 1 -- 172.21.15.123:0/1276634793 wait complete. 2024-09-13T17:07:12.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.881+0000 7f8dabfff700 1 Processor -- start 2024-09-13T17:07:12.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.881+0000 7f8dabfff700 1 -- start start 2024-09-13T17:07:12.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.881+0000 7f8dabfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac14bd60 0x7f8dac0b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.881+0000 7f8dabfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac14c140 0x7f8dac0b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.881+0000 7f8dabfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dac0b2900 0x7f8dac0cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.881+0000 7f8dabfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac0b2d80 con 0x7f8dac14c140 2024-09-13T17:07:12.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.881+0000 7f8dabfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac0b3060 con 0x7f8dac14bd60 2024-09-13T17:07:12.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.881+0000 7f8dabfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac0b3340 con 0x7f8dac0b2900 2024-09-13T17:07:12.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.881+0000 7f8daa7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac14c140 0x7f8dac0b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.881+0000 7f8daa7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac14c140 0x7f8dac0b23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56780/0 (socket says 172.21.15.123:56780) 2024-09-13T17:07:12.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.881+0000 7f8daa7fc700 1 -- 172.21.15.123:0/1098824518 learned_addr learned my addr 172.21.15.123:0/1098824518 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:12.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.881+0000 7f8daaffd700 1 --2- 172.21.15.123:0/1098824518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac14bd60 0x7f8dac0b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.881+0000 7f8dab7fe700 1 --2- 172.21.15.123:0/1098824518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dac0b2900 0x7f8dac0cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.885+0000 7f8daa7fc700 1 -- 172.21.15.123:0/1098824518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dac0b2900 msgr2=0x7f8dac0cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.885+0000 7f8daa7fc700 1 --2- 172.21.15.123:0/1098824518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dac0b2900 0x7f8dac0cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.885+0000 7f8daa7fc700 1 -- 172.21.15.123:0/1098824518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac14bd60 msgr2=0x7f8dac0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:12.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.885+0000 7f8daa7fc700 1 --2- 172.21.15.123:0/1098824518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac14bd60 0x7f8dac0b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:12.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.885+0000 7f8daa7fc700 1 -- 172.21.15.123:0/1098824518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac0b3620 con 0x7f8dac14c140 2024-09-13T17:07:12.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.885+0000 7f8daa7fc700 1 --2- 172.21.15.123:0/1098824518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac14c140 0x7f8dac0b23c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0090b0 tx=0x7f8d9c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:12.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.885+0000 7f8d93fff700 1 -- 172.21.15.123:0/1098824518 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c003ad0 con 0x7f8dac14c140 2024-09-13T17:07:12.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.885+0000 7f8d93fff700 1 -- 172.21.15.123:0/1098824518 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9c003c50 con 0x7f8dac14c140 2024-09-13T17:07:12.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.885+0000 7f8dabfff700 1 -- 172.21.15.123:0/1098824518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dac0b3900 con 0x7f8dac14c140 2024-09-13T17:07:12.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.885+0000 7f8d93fff700 1 -- 172.21.15.123:0/1098824518 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c009e60 con 0x7f8dac14c140 2024-09-13T17:07:12.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.885+0000 7f8dabfff700 1 -- 172.21.15.123:0/1098824518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac160050 con 0x7f8dac14c140 2024-09-13T17:07:12.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.885+0000 7f8dabfff700 1 -- 172.21.15.123:0/1098824518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dac0d0120 con 0x7f8dac14c140 2024-09-13T17:07:12.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.885+0000 7f8d93fff700 1 -- 172.21.15.123:0/1098824518 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8d9c013470 con 0x7f8dac14c140 2024-09-13T17:07:12.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.889+0000 7f8d93fff700 1 --2- 172.21.15.123:0/1098824518 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8d98066730 0x7f8d98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:12.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.889+0000 7f8d93fff700 1 -- 172.21.15.123:0/1098824518 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d9c085830 con 0x7f8dac14c140 2024-09-13T17:07:12.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.889+0000 7f8daaffd700 1 --2- 172.21.15.123:0/1098824518 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8d98066730 0x7f8d98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:12.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.889+0000 7f8daaffd700 1 --2- 172.21.15.123:0/1098824518 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8d98066730 0x7f8d98068bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8dac15baa0 tx=0x7f8da0008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:12.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:12.893+0000 7f8d93fff700 1 -- 172.21.15.123:0/1098824518 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8d9c052d50 con 0x7f8dac14c140 2024-09-13T17:07:13.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.057+0000 7f8dabfff700 1 -- 172.21.15.123:0/1098824518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8dac0b3a90 con 0x7f8dac14c140 2024-09-13T17:07:13.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.061+0000 7f8d93fff700 1 -- 172.21.15.123:0/1098824518 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8d9c056370 con 0x7f8dac14c140 2024-09-13T17:07:13.066 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:07:13.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.061+0000 7f8dabfff700 1 -- 172.21.15.123:0/1098824518 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8d98066730 msgr2=0x7f8d98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.061+0000 7f8dabfff700 1 --2- 172.21.15.123:0/1098824518 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8d98066730 0x7f8d98068bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8dac15baa0 tx=0x7f8da0008040 comp rx=0 tx=0).stop 2024-09-13T17:07:13.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.061+0000 7f8dabfff700 1 -- 172.21.15.123:0/1098824518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac14c140 msgr2=0x7f8dac0b23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.061+0000 7f8dabfff700 1 --2- 172.21.15.123:0/1098824518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac14c140 0x7f8dac0b23c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0090b0 tx=0x7f8d9c0047e0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.061+0000 7f8dabfff700 1 -- 172.21.15.123:0/1098824518 shutdown_connections 2024-09-13T17:07:13.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.061+0000 7f8dabfff700 1 --2- 172.21.15.123:0/1098824518 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8d98066730 0x7f8d98068bf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.061+0000 7f8dabfff700 1 --2- 172.21.15.123:0/1098824518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dac0b2900 0x7f8dac0cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.061+0000 7f8dabfff700 1 --2- 172.21.15.123:0/1098824518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac14c140 0x7f8dac0b23c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.061+0000 7f8dabfff700 1 --2- 172.21.15.123:0/1098824518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac14bd60 0x7f8dac0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.061+0000 7f8dabfff700 1 -- 172.21.15.123:0/1098824518 >> 172.21.15.123:0/1098824518 conn(0x7f8dac0d2a60 msgr2=0x7f8dac0b6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:13.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.061+0000 7f8dabfff700 1 -- 172.21.15.123:0/1098824518 shutdown_connections 2024-09-13T17:07:13.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.061+0000 7f8dabfff700 1 -- 172.21.15.123:0/1098824518 wait complete. 2024-09-13T17:07:13.081 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:13.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f181d490700 1 Processor -- start 2024-09-13T17:07:13.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f181d490700 1 -- start start 2024-09-13T17:07:13.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f181d490700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f181806f280 0x7f181806f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f181d490700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18180cdb60 con 0x7f1818153aa0 2024-09-13T17:07:13.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f181d490700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1818160f40 con 0x7f1818153e80 2024-09-13T17:07:13.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f181d490700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18181617b0 con 0x7f181806f280 2024-09-13T17:07:13.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f1817fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1818153aa0 0x7f1818160830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56020/0 (socket says 172.21.15.123:56020) 2024-09-13T17:07:13.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f1817fff700 1 -- 172.21.15.123:0/373383114 learned_addr learned my addr 172.21.15.123:0/373383114 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:13.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f181cc8f700 1 --2- 172.21.15.123:0/373383114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f181806f280 0x7f181806f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f1816ffd700 1 -- 172.21.15.123:0/373383114 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525855549 0 0) 0x7f18180cdb60 con 0x7f1818153aa0 2024-09-13T17:07:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f1816ffd700 1 -- 172.21.15.123:0/373383114 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18040035d0 con 0x7f1818153aa0 2024-09-13T17:07:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f1816ffd700 1 -- 172.21.15.123:0/373383114 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894063528 0 0) 0x7f1818160f40 con 0x7f1818153e80 2024-09-13T17:07:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f1816ffd700 1 -- 172.21.15.123:0/373383114 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18180cdb60 con 0x7f1818153e80 2024-09-13T17:07:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f181cc8f700 1 -- 172.21.15.123:0/373383114 >> v1:172.21.15.153:6789/0 conn(0x7f1818153e80 legacy=0x7f18180cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f181cc8f700 1 -- 172.21.15.123:0/373383114 >> v1:172.21.15.123:6789/0 conn(0x7f1818153aa0 legacy=0x7f1818160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f181cc8f700 1 -- 172.21.15.123:0/373383114 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18181611f0 con 0x7f181806f280 2024-09-13T17:07:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.181+0000 7f181cc8f700 1 --2- 172.21.15.123:0/373383114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f181806f280 0x7f181806f6f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1810009dc0 tx=0x7f181000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b22c77c64227f6d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f1816ffd700 1 -- 172.21.15.123:0/373383114 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181000e070 con 0x7f181806f280 2024-09-13T17:07:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f1816ffd700 1 -- 172.21.15.123:0/373383114 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181000bb20 con 0x7f181806f280 2024-09-13T17:07:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f1816ffd700 1 -- 172.21.15.123:0/373383114 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810012430 con 0x7f181806f280 2024-09-13T17:07:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 -- 172.21.15.123:0/373383114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f181806f280 msgr2=0x7f181806f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 --2- 172.21.15.123:0/373383114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f181806f280 0x7f181806f6f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1810009dc0 tx=0x7f181000b330 comp rx=0 tx=0).stop 2024-09-13T17:07:13.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 -- 172.21.15.123:0/373383114 shutdown_connections 2024-09-13T17:07:13.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 --2- 172.21.15.123:0/373383114 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f181806f280 0x7f181806f6f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 -- 172.21.15.123:0/373383114 >> 172.21.15.123:0/373383114 conn(0x7f18180b0c30 msgr2=0x7f18180b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:13.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 -- 172.21.15.123:0/373383114 shutdown_connections 2024-09-13T17:07:13.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 -- 172.21.15.123:0/373383114 wait complete. 2024-09-13T17:07:13.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 Processor -- start 2024-09-13T17:07:13.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 -- start start 2024-09-13T17:07:13.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181806f280 0x7f181813f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1818153aa0 0x7f18181505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1818153e80 0x7f1818150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18180c3ea0 con 0x7f181806f280 2024-09-13T17:07:13.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1818140060 con 0x7f1818153e80 2024-09-13T17:07:13.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181d490700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18180c40f0 con 0x7f1818153aa0 2024-09-13T17:07:13.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f1817fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181806f280 0x7f181813f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f1817fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181806f280 0x7f181813f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56794/0 (socket says 172.21.15.123:56794) 2024-09-13T17:07:13.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f1817fff700 1 -- 172.21.15.123:0/1240559022 learned_addr learned my addr 172.21.15.123:0/1240559022 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:13.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f181cc8f700 1 --2- 172.21.15.123:0/1240559022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1818153e80 0x7f1818150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.185+0000 7f18177fe700 1 --2- 172.21.15.123:0/1240559022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1818153aa0 0x7f18181505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.189+0000 7f1817fff700 1 -- 172.21.15.123:0/1240559022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1818153aa0 msgr2=0x7f18181505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.189+0000 7f1817fff700 1 --2- 172.21.15.123:0/1240559022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1818153aa0 0x7f18181505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.189+0000 7f1817fff700 1 -- 172.21.15.123:0/1240559022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1818153e80 msgr2=0x7f1818150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.189+0000 7f1817fff700 1 --2- 172.21.15.123:0/1240559022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1818153e80 0x7f1818150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.189+0000 7f1817fff700 1 -- 172.21.15.123:0/1240559022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1810009a70 con 0x7f181806f280 2024-09-13T17:07:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.189+0000 7f1817fff700 1 --2- 172.21.15.123:0/1240559022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181806f280 0x7f181813f310 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f180800c730 tx=0x7f180800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.189+0000 7f1814ff9700 1 -- 172.21.15.123:0/1240559022 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808005d90 con 0x7f181806f280 2024-09-13T17:07:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.189+0000 7f1814ff9700 1 -- 172.21.15.123:0/1240559022 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18080070d0 con 0x7f181806f280 2024-09-13T17:07:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.189+0000 7f1814ff9700 1 -- 172.21.15.123:0/1240559022 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808007480 con 0x7f181806f280 2024-09-13T17:07:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.189+0000 7f181d490700 1 -- 172.21.15.123:0/1240559022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18180c43d0 con 0x7f181806f280 2024-09-13T17:07:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.189+0000 7f181d490700 1 -- 172.21.15.123:0/1240559022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181813fcf0 con 0x7f181806f280 2024-09-13T17:07:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.189+0000 7f181d490700 1 -- 172.21.15.123:0/1240559022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181813fe80 con 0x7f181806f280 2024-09-13T17:07:13.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.193+0000 7f1814ff9700 1 -- 172.21.15.123:0/1240559022 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18080075e0 con 0x7f181806f280 2024-09-13T17:07:13.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.193+0000 7f1814ff9700 1 --2- 172.21.15.123:0/1240559022 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f17f8066730 0x7f17f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.193+0000 7f1814ff9700 1 -- 172.21.15.123:0/1240559022 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1808083550 con 0x7f181806f280 2024-09-13T17:07:13.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.193+0000 7f18177fe700 1 --2- 172.21.15.123:0/1240559022 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f17f8066730 0x7f17f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.193+0000 7f18177fe700 1 --2- 172.21.15.123:0/1240559022 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f17f8066730 0x7f17f8068bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1800001850 tx=0x7f1800009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:13.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.197+0000 7f1814ff9700 1 -- 172.21.15.123:0/1240559022 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18080508c0 con 0x7f181806f280 2024-09-13T17:07:13.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.373+0000 7f181d490700 1 -- 172.21.15.123:0/1240559022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1818073380 con 0x7f181806f280 2024-09-13T17:07:13.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.373+0000 7f1814ff9700 1 -- 172.21.15.123:0/1240559022 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f1808053ee0 con 0x7f181806f280 2024-09-13T17:07:13.381 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:13.382 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:13.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.377+0000 7f181d490700 1 -- 172.21.15.123:0/1240559022 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f17f8066730 msgr2=0x7f17f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.377+0000 7f181d490700 1 --2- 172.21.15.123:0/1240559022 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f17f8066730 0x7f17f8068bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1800001850 tx=0x7f1800009040 comp rx=0 tx=0).stop 2024-09-13T17:07:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.377+0000 7f181d490700 1 -- 172.21.15.123:0/1240559022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181806f280 msgr2=0x7f181813f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.377+0000 7f181d490700 1 --2- 172.21.15.123:0/1240559022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181806f280 0x7f181813f310 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f180800c730 tx=0x7f180800ca40 comp rx=0 tx=0).stop 2024-09-13T17:07:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.377+0000 7f181d490700 1 -- 172.21.15.123:0/1240559022 shutdown_connections 2024-09-13T17:07:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.377+0000 7f181d490700 1 --2- 172.21.15.123:0/1240559022 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f17f8066730 0x7f17f8068bf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.377+0000 7f181d490700 1 --2- 172.21.15.123:0/1240559022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1818153e80 0x7f1818150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.377+0000 7f181d490700 1 --2- 172.21.15.123:0/1240559022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1818153aa0 0x7f18181505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.377+0000 7f181d490700 1 --2- 172.21.15.123:0/1240559022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181806f280 0x7f181813f310 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.377+0000 7f181d490700 1 -- 172.21.15.123:0/1240559022 >> 172.21.15.123:0/1240559022 conn(0x7f18180b0c30 msgr2=0x7f18180cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:13.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.377+0000 7f181d490700 1 -- 172.21.15.123:0/1240559022 shutdown_connections 2024-09-13T17:07:13.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.377+0000 7f181d490700 1 -- 172.21.15.123:0/1240559022 wait complete. 2024-09-13T17:07:13.396 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:13.396 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:13.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d9b2700 1 Processor -- start 2024-09-13T17:07:13.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d9b2700 1 -- start start 2024-09-13T17:07:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d9b2700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8181506b0 0x7fe8180b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d9b2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8180b4990 0x7fe81815dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d9b2700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8180b3310 con 0x7fe8180b37a0 2024-09-13T17:07:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d9b2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8180b4e40 con 0x7fe8180b4990 2024-09-13T17:07:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d9b2700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81815e280 con 0x7fe8181506b0 2024-09-13T17:07:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d1b1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8180b4990 0x7fe81815dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d1b1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8180b4990 0x7fe81815dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56802/0 (socket says 172.21.15.123:56802) 2024-09-13T17:07:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d1b1700 1 -- 172.21.15.123:0/3067691855 learned_addr learned my addr 172.21.15.123:0/3067691855 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81c9b0700 1 --2- 172.21.15.123:0/3067691855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8181506b0 0x7fe8180b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d1b1700 1 -- 172.21.15.123:0/3067691855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8181506b0 msgr2=0x7fe8180b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:13.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d1b1700 1 --2- 172.21.15.123:0/3067691855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8181506b0 0x7fe8180b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d1b1700 1 -- 172.21.15.123:0/3067691855 >> v1:172.21.15.153:6789/0 conn(0x7fe8180b37a0 legacy=0x7fe81815d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d1b1700 1 -- 172.21.15.123:0/3067691855 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8180b29e0 con 0x7fe8180b4990 2024-09-13T17:07:13.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe81d1b1700 1 --2- 172.21.15.123:0/3067691855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8180b4990 0x7fe81815dbd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe810009e50 tx=0x7fe81000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4408192dcf717b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:13.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe8177fe700 1 -- 172.21.15.123:0/3067691855 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81000e070 con 0x7fe8180b4990 2024-09-13T17:07:13.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe8177fe700 1 -- 172.21.15.123:0/3067691855 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81000b910 con 0x7fe8180b4990 2024-09-13T17:07:13.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.517+0000 7fe8177fe700 1 -- 172.21.15.123:0/3067691855 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81000bcc0 con 0x7fe8180b4990 2024-09-13T17:07:13.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.521+0000 7fe81d9b2700 1 -- 172.21.15.123:0/3067691855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8180b4990 msgr2=0x7fe81815dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.521+0000 7fe81d9b2700 1 --2- 172.21.15.123:0/3067691855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8180b4990 0x7fe81815dbd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe810009e50 tx=0x7fe81000b330 comp rx=0 tx=0).stop 2024-09-13T17:07:13.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.521+0000 7fe81d9b2700 1 -- 172.21.15.123:0/3067691855 shutdown_connections 2024-09-13T17:07:13.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.521+0000 7fe81d9b2700 1 --2- 172.21.15.123:0/3067691855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8180b4990 0x7fe81815dbd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.521+0000 7fe81d9b2700 1 --2- 172.21.15.123:0/3067691855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8181506b0 0x7fe8180b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.521+0000 7fe81d9b2700 1 -- 172.21.15.123:0/3067691855 >> 172.21.15.123:0/3067691855 conn(0x7fe818066780 msgr2=0x7fe8180719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:13.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.521+0000 7fe81d9b2700 1 -- 172.21.15.123:0/3067691855 shutdown_connections 2024-09-13T17:07:13.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.521+0000 7fe81d9b2700 1 -- 172.21.15.123:0/3067691855 wait complete. 2024-09-13T17:07:13.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.521+0000 7fe81d9b2700 1 Processor -- start 2024-09-13T17:07:13.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.521+0000 7fe81d9b2700 1 -- start start 2024-09-13T17:07:13.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe81d9b2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8180b37a0 0x7fe818152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe81d9b2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8180b4990 0x7fe81815b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe81d9b2700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8181506b0 0x7fe81815be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe81d9b2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8181544a0 con 0x7fe8180b4990 2024-09-13T17:07:13.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe81d9b2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe818154780 con 0x7fe8180b37a0 2024-09-13T17:07:13.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe81d9b2700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe818154a60 con 0x7fe8181506b0 2024-09-13T17:07:13.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe817fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8180b4990 0x7fe81815b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe817fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8180b4990 0x7fe81815b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56816/0 (socket says 172.21.15.123:56816) 2024-09-13T17:07:13.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe817fff700 1 -- 172.21.15.123:0/2487375170 learned_addr learned my addr 172.21.15.123:0/2487375170 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:13.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe81c9b0700 1 --2- 172.21.15.123:0/2487375170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8180b37a0 0x7fe818152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe81d1b1700 1 --2- 172.21.15.123:0/2487375170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8181506b0 0x7fe81815be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe817fff700 1 -- 172.21.15.123:0/2487375170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8181506b0 msgr2=0x7fe81815be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe817fff700 1 --2- 172.21.15.123:0/2487375170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8181506b0 0x7fe81815be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe817fff700 1 -- 172.21.15.123:0/2487375170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8180b37a0 msgr2=0x7fe818152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe817fff700 1 --2- 172.21.15.123:0/2487375170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8180b37a0 0x7fe818152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe817fff700 1 -- 172.21.15.123:0/2487375170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe810009b30 con 0x7fe8180b4990 2024-09-13T17:07:13.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe817fff700 1 --2- 172.21.15.123:0/2487375170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8180b4990 0x7fe81815b940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe808001e40 tx=0x7fe808001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:13.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe8157fa700 1 -- 172.21.15.123:0/2487375170 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080052d0 con 0x7fe8180b4990 2024-09-13T17:07:13.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe8157fa700 1 -- 172.21.15.123:0/2487375170 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe808005430 con 0x7fe8180b4990 2024-09-13T17:07:13.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe8157fa700 1 -- 172.21.15.123:0/2487375170 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080055a0 con 0x7fe8180b4990 2024-09-13T17:07:13.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe81d9b2700 1 -- 172.21.15.123:0/2487375170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe818154d40 con 0x7fe8180b4990 2024-09-13T17:07:13.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.525+0000 7fe81d9b2700 1 -- 172.21.15.123:0/2487375170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe818152b10 con 0x7fe8180b4990 2024-09-13T17:07:13.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.529+0000 7fe81d9b2700 1 -- 172.21.15.123:0/2487375170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8181586c0 con 0x7fe8180b4990 2024-09-13T17:07:13.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.529+0000 7fe8157fa700 1 -- 172.21.15.123:0/2487375170 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe8080038c0 con 0x7fe8180b4990 2024-09-13T17:07:13.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.529+0000 7fe8157fa700 1 --2- 172.21.15.123:0/2487375170 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7f8066730 0x7fe7f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.529+0000 7fe8157fa700 1 -- 172.21.15.123:0/2487375170 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe808085c90 con 0x7fe8180b4990 2024-09-13T17:07:13.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.529+0000 7fe81c9b0700 1 --2- 172.21.15.123:0/2487375170 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7f8066730 0x7fe7f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.529+0000 7fe81c9b0700 1 --2- 172.21.15.123:0/2487375170 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7f8066730 0x7fe7f8068bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe800009bf0 tx=0x7fe800009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:13.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.537+0000 7fe8157fa700 1 -- 172.21.15.123:0/2487375170 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe808053090 con 0x7fe8180b4990 2024-09-13T17:07:13.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.705+0000 7fe81d9b2700 1 -- 172.21.15.123:0/2487375170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8180709c0 con 0x7fe8180b4990 2024-09-13T17:07:13.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.705+0000 7fe8157fa700 1 -- 172.21.15.123:0/2487375170 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8080566b0 con 0x7fe8180b4990 2024-09-13T17:07:13.711 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:13.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.709+0000 7fe81d9b2700 1 -- 172.21.15.123:0/2487375170 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7f8066730 msgr2=0x7fe7f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.709+0000 7fe81d9b2700 1 --2- 172.21.15.123:0/2487375170 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7f8066730 0x7fe7f8068bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe800009bf0 tx=0x7fe800009240 comp rx=0 tx=0).stop 2024-09-13T17:07:13.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.709+0000 7fe81d9b2700 1 -- 172.21.15.123:0/2487375170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8180b4990 msgr2=0x7fe81815b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.709+0000 7fe81d9b2700 1 --2- 172.21.15.123:0/2487375170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8180b4990 0x7fe81815b940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe808001e40 tx=0x7fe808001e70 comp rx=0 tx=0).stop 2024-09-13T17:07:13.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.709+0000 7fe81d9b2700 1 -- 172.21.15.123:0/2487375170 shutdown_connections 2024-09-13T17:07:13.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.709+0000 7fe81d9b2700 1 --2- 172.21.15.123:0/2487375170 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7f8066730 0x7fe7f8068bf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.709+0000 7fe81d9b2700 1 --2- 172.21.15.123:0/2487375170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8181506b0 0x7fe81815be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.709+0000 7fe81d9b2700 1 --2- 172.21.15.123:0/2487375170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8180b4990 0x7fe81815b940 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.709+0000 7fe81d9b2700 1 --2- 172.21.15.123:0/2487375170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8180b37a0 0x7fe818152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.709+0000 7fe81d9b2700 1 -- 172.21.15.123:0/2487375170 >> 172.21.15.123:0/2487375170 conn(0x7fe818066780 msgr2=0x7fe818158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:13.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.709+0000 7fe81d9b2700 1 -- 172.21.15.123:0/2487375170 shutdown_connections 2024-09-13T17:07:13.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.709+0000 7fe81d9b2700 1 -- 172.21.15.123:0/2487375170 wait complete. 2024-09-13T17:07:13.732 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:07:13.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda17180700 1 Processor -- start 2024-09-13T17:07:13.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda17180700 1 -- start start 2024-09-13T17:07:13.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda17180700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fda100b3990 0x7fda100cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda17180700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda100ccac0 0x7fda100cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda17180700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fda100cb5b0 0x7fda1015e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda17180700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda100ccf00 con 0x7fda100cb5b0 2024-09-13T17:07:13.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda17180700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda100cb9f0 con 0x7fda100b3990 2024-09-13T17:07:13.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda17180700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda100ce180 con 0x7fda100ccac0 2024-09-13T17:07:13.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1697f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fda100cb5b0 0x7fda1015e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1697f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fda100cb5b0 0x7fda1015e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56830/0 (socket says 172.21.15.123:56830) 2024-09-13T17:07:13.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1697f700 1 -- 172.21.15.123:0/1815020689 learned_addr learned my addr 172.21.15.123:0/1815020689 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:13.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1617e700 1 --2- 172.21.15.123:0/1815020689 >> v2:172.21.15.153:3300/0 conn(0x7fda100b3990 0x7fda100cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1597d700 1 --2- 172.21.15.123:0/1815020689 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda100ccac0 0x7fda100cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1697f700 1 -- 172.21.15.123:0/1815020689 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda100ccac0 msgr2=0x7fda100cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:13.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1697f700 1 --2- 172.21.15.123:0/1815020689 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda100ccac0 0x7fda100cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1697f700 1 -- 172.21.15.123:0/1815020689 >> v2:172.21.15.153:3300/0 conn(0x7fda100b3990 msgr2=0x7fda100cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:13.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1697f700 1 --2- 172.21.15.123:0/1815020689 >> v2:172.21.15.153:3300/0 conn(0x7fda100b3990 0x7fda100cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1697f700 1 -- 172.21.15.123:0/1815020689 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda100cd990 con 0x7fda100cb5b0 2024-09-13T17:07:13.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1617e700 1 --2- 172.21.15.123:0/1815020689 >> v2:172.21.15.153:3300/0 conn(0x7fda100b3990 0x7fda100cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:13.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1697f700 1 --2- 172.21.15.123:0/1815020689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda100cb5b0 0x7fda1015e8d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fda100cf750 tx=0x7fda0c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1371c352d60ad69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:13.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1517c700 1 -- 172.21.15.123:0/1815020689 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c00b8a0 con 0x7fda100cb5b0 2024-09-13T17:07:13.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1517c700 1 -- 172.21.15.123:0/1815020689 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c00ba00 con 0x7fda100cb5b0 2024-09-13T17:07:13.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.845+0000 7fda1517c700 1 -- 172.21.15.123:0/1815020689 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c00bd90 con 0x7fda100cb5b0 2024-09-13T17:07:13.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.849+0000 7fda17180700 1 -- 172.21.15.123:0/1815020689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda100cb5b0 msgr2=0x7fda1015e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.849+0000 7fda17180700 1 --2- 172.21.15.123:0/1815020689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda100cb5b0 0x7fda1015e8d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fda100cf750 tx=0x7fda0c009bf0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.849+0000 7fda17180700 1 -- 172.21.15.123:0/1815020689 shutdown_connections 2024-09-13T17:07:13.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.849+0000 7fda17180700 1 --2- 172.21.15.123:0/1815020689 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda100ccac0 0x7fda100cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.849+0000 7fda17180700 1 --2- 172.21.15.123:0/1815020689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda100cb5b0 0x7fda1015e8d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.849+0000 7fda17180700 1 --2- 172.21.15.123:0/1815020689 >> v2:172.21.15.153:3300/0 conn(0x7fda100b3990 0x7fda100cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.849+0000 7fda17180700 1 -- 172.21.15.123:0/1815020689 >> 172.21.15.123:0/1815020689 conn(0x7fda100b01d0 msgr2=0x7fda100b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:13.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.849+0000 7fda17180700 1 -- 172.21.15.123:0/1815020689 shutdown_connections 2024-09-13T17:07:13.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.849+0000 7fda17180700 1 -- 172.21.15.123:0/1815020689 wait complete. 2024-09-13T17:07:13.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.849+0000 7fda17180700 1 Processor -- start 2024-09-13T17:07:13.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.849+0000 7fda17180700 1 -- start start 2024-09-13T17:07:13.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda17180700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda100b3990 0x7fda100ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda17180700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda100cb5b0 0x7fda100a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda17180700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda100ccac0 0x7fda1015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda17180700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda100c8970 con 0x7fda100ccac0 2024-09-13T17:07:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda17180700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda100a93e0 con 0x7fda100cb5b0 2024-09-13T17:07:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda17180700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda100ac570 con 0x7fda100b3990 2024-09-13T17:07:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda1697f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda100ccac0 0x7fda1015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda1697f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda100ccac0 0x7fda1015bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56840/0 (socket says 172.21.15.123:56840) 2024-09-13T17:07:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda1697f700 1 -- 172.21.15.123:0/1700151463 learned_addr learned my addr 172.21.15.123:0/1700151463 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda1597d700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda100cb5b0 0x7fda100a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda1617e700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda100b3990 0x7fda100ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda1697f700 1 -- 172.21.15.123:0/1700151463 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda100b3990 msgr2=0x7fda100ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda1697f700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda100b3990 0x7fda100ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda1697f700 1 -- 172.21.15.123:0/1700151463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda100cb5b0 msgr2=0x7fda100a8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:13.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda1697f700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda100cb5b0 0x7fda100a8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:13.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda1697f700 1 -- 172.21.15.123:0/1700151463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c009570 con 0x7fda100ccac0 2024-09-13T17:07:13.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda1597d700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda100cb5b0 0x7fda100a8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:13.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda1697f700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda100ccac0 0x7fda1015bd60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fda1006b4a0 tx=0x7fda0c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:13.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda06ffd700 1 -- 172.21.15.123:0/1700151463 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0036c0 con 0x7fda100ccac0 2024-09-13T17:07:13.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda06ffd700 1 -- 172.21.15.123:0/1700151463 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c01f070 con 0x7fda100ccac0 2024-09-13T17:07:13.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda17180700 1 -- 172.21.15.123:0/1700151463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda100ab960 con 0x7fda100ccac0 2024-09-13T17:07:13.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda06ffd700 1 -- 172.21.15.123:0/1700151463 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c003a80 con 0x7fda100ccac0 2024-09-13T17:07:13.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda17180700 1 -- 172.21.15.123:0/1700151463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda100abf20 con 0x7fda100ccac0 2024-09-13T17:07:13.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.853+0000 7fda17180700 1 -- 172.21.15.123:0/1700151463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda100cd660 con 0x7fda100ccac0 2024-09-13T17:07:13.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.857+0000 7fda06ffd700 1 -- 172.21.15.123:0/1700151463 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fda0c021030 con 0x7fda100ccac0 2024-09-13T17:07:13.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.857+0000 7fda06ffd700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9f4066730 0x7fd9f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:13.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.857+0000 7fda06ffd700 1 -- 172.21.15.123:0/1700151463 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda0c085820 con 0x7fda100ccac0 2024-09-13T17:07:13.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.857+0000 7fda1617e700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9f4066730 0x7fd9f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:13.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.857+0000 7fda1617e700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9f4066730 0x7fd9f4068bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda08009aa0 tx=0x7fda08003a40 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:13.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:13.861+0000 7fda06ffd700 1 -- 172.21.15.123:0/1700151463 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fda0c052ba0 con 0x7fda100ccac0 2024-09-13T17:07:14.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.029+0000 7fda17180700 1 -- 172.21.15.123:0/1700151463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda100ac6e0 con 0x7fda100ccac0 2024-09-13T17:07:14.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.033+0000 7fda06ffd700 1 -- 172.21.15.123:0/1700151463 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda0c0561c0 con 0x7fda100ccac0 2024-09-13T17:07:14.039 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:07:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.033+0000 7fda17180700 1 -- 172.21.15.123:0/1700151463 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9f4066730 msgr2=0x7fd9f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.033+0000 7fda17180700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9f4066730 0x7fd9f4068bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda08009aa0 tx=0x7fda08003a40 comp rx=0 tx=0).stop 2024-09-13T17:07:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.033+0000 7fda17180700 1 -- 172.21.15.123:0/1700151463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda100ccac0 msgr2=0x7fda1015bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.033+0000 7fda17180700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda100ccac0 0x7fda1015bd60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fda1006b4a0 tx=0x7fda0c004770 comp rx=0 tx=0).stop 2024-09-13T17:07:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.033+0000 7fda17180700 1 -- 172.21.15.123:0/1700151463 shutdown_connections 2024-09-13T17:07:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.033+0000 7fda17180700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9f4066730 0x7fd9f4068bf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.033+0000 7fda17180700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda100ccac0 0x7fda1015bd60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.033+0000 7fda17180700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda100cb5b0 0x7fda100a8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.033+0000 7fda17180700 1 --2- 172.21.15.123:0/1700151463 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda100b3990 0x7fda100ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.033+0000 7fda17180700 1 -- 172.21.15.123:0/1700151463 >> 172.21.15.123:0/1700151463 conn(0x7fda100b01d0 msgr2=0x7fda100ae3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.033+0000 7fda17180700 1 -- 172.21.15.123:0/1700151463 shutdown_connections 2024-09-13T17:07:14.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.033+0000 7fda17180700 1 -- 172.21.15.123:0/1700151463 wait complete. 2024-09-13T17:07:14.054 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:07:14.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.169+0000 7f8c5d607700 1 Processor -- start 2024-09-13T17:07:14.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.169+0000 7f8c5d607700 1 -- start start 2024-09-13T17:07:14.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8c580c8f40 0x7f8c580cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8c5806a260 0x7f8c580706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5815d9c0 con 0x7f8c580c9320 2024-09-13T17:07:14.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c5815d6e0 con 0x7f8c5806a260 2024-09-13T17:07:14.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c580cad60 con 0x7f8c580c8f40 2024-09-13T17:07:14.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5ce06700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8c5806a260 0x7f8c580706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5ce06700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8c5806a260 0x7f8c580706a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56844/0 (socket says 172.21.15.123:56844) 2024-09-13T17:07:14.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5ce06700 1 -- 172.21.15.123:0/1088951739 learned_addr learned my addr 172.21.15.123:0/1088951739 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:14.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c577fe700 1 --1- 172.21.15.123:0/1088951739 >> v1:172.21.15.123:6789/0 conn(0x7f8c580c9320 0x7f8c5815ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56030/0 (socket says 172.21.15.123:56030) 2024-09-13T17:07:14.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c57fff700 1 --2- 172.21.15.123:0/1088951739 >> v2:172.21.15.153:3300/0 conn(0x7f8c580c8f40 0x7f8c580cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5ce06700 1 -- 172.21.15.123:0/1088951739 >> v2:172.21.15.153:3300/0 conn(0x7f8c580c8f40 msgr2=0x7f8c580cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:14.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5ce06700 1 --2- 172.21.15.123:0/1088951739 >> v2:172.21.15.153:3300/0 conn(0x7f8c580c8f40 0x7f8c580cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5ce06700 1 -- 172.21.15.123:0/1088951739 >> v1:172.21.15.123:6789/0 conn(0x7f8c580c9320 legacy=0x7f8c5815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5ce06700 1 -- 172.21.15.123:0/1088951739 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c580cb040 con 0x7f8c5806a260 2024-09-13T17:07:14.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c57fff700 1 --2- 172.21.15.123:0/1088951739 >> v2:172.21.15.153:3300/0 conn(0x7f8c580c8f40 0x7f8c580cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:14.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5ce06700 1 --2- 172.21.15.123:0/1088951739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c5806a260 0x7f8c580706a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c50009e80 tx=0x7f8c5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a750123e5691361 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:14.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c56ffd700 1 -- 172.21.15.123:0/1088951739 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5000e070 con 0x7f8c5806a260 2024-09-13T17:07:14.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c56ffd700 1 -- 172.21.15.123:0/1088951739 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5000b940 con 0x7f8c5806a260 2024-09-13T17:07:14.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c56ffd700 1 -- 172.21.15.123:0/1088951739 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5000bcf0 con 0x7f8c5806a260 2024-09-13T17:07:14.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 -- 172.21.15.123:0/1088951739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c5806a260 msgr2=0x7f8c580706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 --2- 172.21.15.123:0/1088951739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c5806a260 0x7f8c580706a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c50009e80 tx=0x7f8c5000b330 comp rx=0 tx=0).stop 2024-09-13T17:07:14.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 -- 172.21.15.123:0/1088951739 shutdown_connections 2024-09-13T17:07:14.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 --2- 172.21.15.123:0/1088951739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c5806a260 0x7f8c580706a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 --2- 172.21.15.123:0/1088951739 >> v2:172.21.15.153:3300/0 conn(0x7f8c580c8f40 0x7f8c580cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 -- 172.21.15.123:0/1088951739 >> 172.21.15.123:0/1088951739 conn(0x7f8c580b01d0 msgr2=0x7f8c580b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:14.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 -- 172.21.15.123:0/1088951739 shutdown_connections 2024-09-13T17:07:14.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 -- 172.21.15.123:0/1088951739 wait complete. 2024-09-13T17:07:14.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 Processor -- start 2024-09-13T17:07:14.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.173+0000 7f8c5d607700 1 -- start start 2024-09-13T17:07:14.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5d607700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c5806a260 0x7f8c58151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5d607700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c580c8f40 0x7f8c581f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5d607700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c580c9320 0x7f8c580c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5d607700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c581f2890 con 0x7f8c580c9320 2024-09-13T17:07:14.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5d607700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c581f3f90 con 0x7f8c5806a260 2024-09-13T17:07:14.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5d607700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580b2d60 con 0x7f8c580c8f40 2024-09-13T17:07:14.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5ce06700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c580c9320 0x7f8c580c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5ce06700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c580c9320 0x7f8c580c78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56860/0 (socket says 172.21.15.123:56860) 2024-09-13T17:07:14.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5ce06700 1 -- 172.21.15.123:0/3916817165 learned_addr learned my addr 172.21.15.123:0/3916817165 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:14.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c57fff700 1 --2- 172.21.15.123:0/3916817165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c5806a260 0x7f8c58151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c577fe700 1 --2- 172.21.15.123:0/3916817165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c580c8f40 0x7f8c581f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5ce06700 1 -- 172.21.15.123:0/3916817165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c580c8f40 msgr2=0x7f8c581f3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5ce06700 1 --2- 172.21.15.123:0/3916817165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c580c8f40 0x7f8c581f3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5ce06700 1 -- 172.21.15.123:0/3916817165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c5806a260 msgr2=0x7f8c58151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5ce06700 1 --2- 172.21.15.123:0/3916817165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c5806a260 0x7f8c58151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5ce06700 1 -- 172.21.15.123:0/3916817165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c50009b30 con 0x7f8c580c9320 2024-09-13T17:07:14.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5ce06700 1 --2- 172.21.15.123:0/3916817165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c580c9320 0x7f8c580c78c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8c580b0ff0 tx=0x7f8c50004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:14.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c54ff9700 1 -- 172.21.15.123:0/3916817165 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5000bea0 con 0x7f8c580c9320 2024-09-13T17:07:14.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c54ff9700 1 -- 172.21.15.123:0/3916817165 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c50004820 con 0x7f8c580c9320 2024-09-13T17:07:14.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c54ff9700 1 -- 172.21.15.123:0/3916817165 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c50004990 con 0x7f8c580c9320 2024-09-13T17:07:14.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5d607700 1 -- 172.21.15.123:0/3916817165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c580b3040 con 0x7f8c580c9320 2024-09-13T17:07:14.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.177+0000 7f8c5d607700 1 -- 172.21.15.123:0/3916817165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c580b3600 con 0x7f8c580c9320 2024-09-13T17:07:14.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.181+0000 7f8c5d607700 1 -- 172.21.15.123:0/3916817165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c581f29e0 con 0x7f8c580c9320 2024-09-13T17:07:14.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.181+0000 7f8c54ff9700 1 -- 172.21.15.123:0/3916817165 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8c5001c680 con 0x7f8c580c9320 2024-09-13T17:07:14.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.181+0000 7f8c54ff9700 1 --2- 172.21.15.123:0/3916817165 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8c38066730 0x7f8c38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.181+0000 7f8c54ff9700 1 -- 172.21.15.123:0/3916817165 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c50085d50 con 0x7f8c580c9320 2024-09-13T17:07:14.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.181+0000 7f8c57fff700 1 --2- 172.21.15.123:0/3916817165 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8c38066730 0x7f8c38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.181+0000 7f8c57fff700 1 --2- 172.21.15.123:0/3916817165 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8c38066730 0x7f8c38068bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8c40006fd0 tx=0x7f8c40008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:14.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.189+0000 7f8c54ff9700 1 -- 172.21.15.123:0/3916817165 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8c581f29e0 con 0x7f8c580c9320 2024-09-13T17:07:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.357+0000 7f8c5d607700 1 -- 172.21.15.123:0/3916817165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c581f29e0 con 0x7f8c580c9320 2024-09-13T17:07:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.357+0000 7f8c54ff9700 1 -- 172.21.15.123:0/3916817165 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c581f29e0 con 0x7f8c580c9320 2024-09-13T17:07:14.365 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:07:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.361+0000 7f8c5d607700 1 -- 172.21.15.123:0/3916817165 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8c38066730 msgr2=0x7f8c38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.361+0000 7f8c5d607700 1 --2- 172.21.15.123:0/3916817165 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8c38066730 0x7f8c38068bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8c40006fd0 tx=0x7f8c40008040 comp rx=0 tx=0).stop 2024-09-13T17:07:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.361+0000 7f8c5d607700 1 -- 172.21.15.123:0/3916817165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c580c9320 msgr2=0x7f8c580c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.361+0000 7f8c5d607700 1 --2- 172.21.15.123:0/3916817165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c580c9320 0x7f8c580c78c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8c580b0ff0 tx=0x7f8c50004af0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.361+0000 7f8c5d607700 1 -- 172.21.15.123:0/3916817165 shutdown_connections 2024-09-13T17:07:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.361+0000 7f8c5d607700 1 --2- 172.21.15.123:0/3916817165 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8c38066730 0x7f8c38068bf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.361+0000 7f8c5d607700 1 --2- 172.21.15.123:0/3916817165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c580c9320 0x7f8c580c78c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.361+0000 7f8c5d607700 1 --2- 172.21.15.123:0/3916817165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c580c8f40 0x7f8c581f3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.361+0000 7f8c5d607700 1 --2- 172.21.15.123:0/3916817165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c5806a260 0x7f8c58151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.361+0000 7f8c5d607700 1 -- 172.21.15.123:0/3916817165 >> 172.21.15.123:0/3916817165 conn(0x7f8c580b01d0 msgr2=0x7f8c580706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:14.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.361+0000 7f8c5d607700 1 -- 172.21.15.123:0/3916817165 shutdown_connections 2024-09-13T17:07:14.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.361+0000 7f8c5d607700 1 -- 172.21.15.123:0/3916817165 wait complete. 2024-09-13T17:07:14.386 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:14.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.493+0000 7f850a438700 1 Processor -- start 2024-09-13T17:07:14.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.493+0000 7f850a438700 1 -- start start 2024-09-13T17:07:14.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.493+0000 7f850a438700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f850415e920 0x7f85040caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.493+0000 7f850a438700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8504162550 con 0x7f85040cb020 2024-09-13T17:07:14.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.493+0000 7f850a438700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85040cd690 con 0x7f850415ed00 2024-09-13T17:07:14.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.493+0000 7f850a438700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8504161f90 con 0x7f850415e920 2024-09-13T17:07:14.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.493+0000 7f8508c35700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f85040cb020 0x7f8504161540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56032/0 (socket says 172.21.15.123:56032) 2024-09-13T17:07:14.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.493+0000 7f8509436700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f850415e920 0x7f85040caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.493+0000 7f8508c35700 1 -- 172.21.15.123:0/2098684878 learned_addr learned my addr 172.21.15.123:0/2098684878 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:14.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f84fbfff700 1 -- 172.21.15.123:0/2098684878 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665622595 0 0) 0x7f8504162550 con 0x7f85040cb020 2024-09-13T17:07:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f84fbfff700 1 -- 172.21.15.123:0/2098684878 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f00035d0 con 0x7f85040cb020 2024-09-13T17:07:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f8509436700 1 -- 172.21.15.123:0/2098684878 >> v1:172.21.15.153:6789/0 conn(0x7f850415ed00 legacy=0x7f85040cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f8509436700 1 -- 172.21.15.123:0/2098684878 >> v1:172.21.15.123:6789/0 conn(0x7f85040cb020 legacy=0x7f8504161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f8509436700 1 -- 172.21.15.123:0/2098684878 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8504162270 con 0x7f850415e920 2024-09-13T17:07:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f8509436700 1 --2- 172.21.15.123:0/2098684878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f850415e920 0x7f85040caae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8500009850 tx=0x7f8500009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb970e2a861985e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:14.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f84fbfff700 1 -- 172.21.15.123:0/2098684878 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500011830 con 0x7f850415e920 2024-09-13T17:07:14.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f84fbfff700 1 -- 172.21.15.123:0/2098684878 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8500011990 con 0x7f850415e920 2024-09-13T17:07:14.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f84fbfff700 1 -- 172.21.15.123:0/2098684878 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500011d40 con 0x7f850415e920 2024-09-13T17:07:14.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f850a438700 1 -- 172.21.15.123:0/2098684878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f850415e920 msgr2=0x7f85040caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f850a438700 1 --2- 172.21.15.123:0/2098684878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f850415e920 0x7f85040caae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8500009850 tx=0x7f8500009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:14.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f850a438700 1 -- 172.21.15.123:0/2098684878 shutdown_connections 2024-09-13T17:07:14.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f850a438700 1 --2- 172.21.15.123:0/2098684878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f850415e920 0x7f85040caae0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f850a438700 1 -- 172.21.15.123:0/2098684878 >> 172.21.15.123:0/2098684878 conn(0x7f8504066150 msgr2=0x7f8504066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:14.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f850a438700 1 -- 172.21.15.123:0/2098684878 shutdown_connections 2024-09-13T17:07:14.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f850a438700 1 -- 172.21.15.123:0/2098684878 wait complete. 2024-09-13T17:07:14.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.497+0000 7f850a438700 1 Processor -- start 2024-09-13T17:07:14.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f850a438700 1 -- start start 2024-09-13T17:07:14.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f850a438700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85040cb020 0x7f85040aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f850a438700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850415e920 0x7f8504150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f850a438700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f850415ed00 0x7f85041eb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f850a438700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85040a9fa0 con 0x7f850415ed00 2024-09-13T17:07:14.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f850a438700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85040a9320 con 0x7f85040cb020 2024-09-13T17:07:14.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f850a438700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85040a9600 con 0x7f850415e920 2024-09-13T17:07:14.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f8509c37700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f850415ed00 0x7f85041eb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f8509c37700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f850415ed00 0x7f85041eb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56884/0 (socket says 172.21.15.123:56884) 2024-09-13T17:07:14.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f8509c37700 1 -- 172.21.15.123:0/4114199332 learned_addr learned my addr 172.21.15.123:0/4114199332 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:14.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f8508c35700 1 --2- 172.21.15.123:0/4114199332 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850415e920 0x7f8504150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f8509436700 1 --2- 172.21.15.123:0/4114199332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85040cb020 0x7f85040aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f8509c37700 1 -- 172.21.15.123:0/4114199332 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850415e920 msgr2=0x7f8504150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f8509c37700 1 --2- 172.21.15.123:0/4114199332 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850415e920 0x7f8504150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f8509c37700 1 -- 172.21.15.123:0/4114199332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85040cb020 msgr2=0x7f85040aa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f8509c37700 1 --2- 172.21.15.123:0/4114199332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85040cb020 0x7f85040aa3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f8509c37700 1 -- 172.21.15.123:0/4114199332 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000094b0 con 0x7f850415ed00 2024-09-13T17:07:14.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f8509c37700 1 --2- 172.21.15.123:0/4114199332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f850415ed00 0x7f85041eb960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00cbc0 tx=0x7f84fc00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:14.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f84f9ffb700 1 -- 172.21.15.123:0/4114199332 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc003c20 con 0x7f850415ed00 2024-09-13T17:07:14.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f84f9ffb700 1 -- 172.21.15.123:0/4114199332 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc003d80 con 0x7f850415ed00 2024-09-13T17:07:14.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f850a438700 1 -- 172.21.15.123:0/4114199332 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85040a98e0 con 0x7f850415ed00 2024-09-13T17:07:14.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f84f9ffb700 1 -- 172.21.15.123:0/4114199332 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc00aa20 con 0x7f850415ed00 2024-09-13T17:07:14.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.501+0000 7f850a438700 1 -- 172.21.15.123:0/4114199332 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85041510d0 con 0x7f850415ed00 2024-09-13T17:07:14.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.505+0000 7f850a438700 1 -- 172.21.15.123:0/4114199332 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85040677f0 con 0x7f850415ed00 2024-09-13T17:07:14.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.505+0000 7f84f9ffb700 1 -- 172.21.15.123:0/4114199332 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f84fc00ab80 con 0x7f850415ed00 2024-09-13T17:07:14.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.505+0000 7f84f9ffb700 1 --2- 172.21.15.123:0/4114199332 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f84e8066730 0x7f84e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.505+0000 7f84f9ffb700 1 -- 172.21.15.123:0/4114199332 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84fc084040 con 0x7f850415ed00 2024-09-13T17:07:14.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.505+0000 7f8509436700 1 --2- 172.21.15.123:0/4114199332 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f84e8066730 0x7f84e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.505+0000 7f8509436700 1 --2- 172.21.15.123:0/4114199332 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f84e8066730 0x7f84e8068bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f85000090b0 tx=0x7f8500008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:14.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.513+0000 7f84f9ffb700 1 -- 172.21.15.123:0/4114199332 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f84fc0513b0 con 0x7f850415ed00 2024-09-13T17:07:14.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.681+0000 7f850a438700 1 -- 172.21.15.123:0/4114199332 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85040aa0e0 con 0x7f850415ed00 2024-09-13T17:07:14.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.685+0000 7f84f9ffb700 1 -- 172.21.15.123:0/4114199332 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f85040aa0e0 con 0x7f850415ed00 2024-09-13T17:07:14.692 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:14.692 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:14.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.689+0000 7f850a438700 1 -- 172.21.15.123:0/4114199332 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f84e8066730 msgr2=0x7f84e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.689+0000 7f850a438700 1 --2- 172.21.15.123:0/4114199332 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f84e8066730 0x7f84e8068bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f85000090b0 tx=0x7f8500008030 comp rx=0 tx=0).stop 2024-09-13T17:07:14.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.689+0000 7f850a438700 1 -- 172.21.15.123:0/4114199332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f850415ed00 msgr2=0x7f85041eb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.689+0000 7f850a438700 1 --2- 172.21.15.123:0/4114199332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f850415ed00 0x7f85041eb960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00cbc0 tx=0x7f84fc00ced0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.689+0000 7f850a438700 1 -- 172.21.15.123:0/4114199332 shutdown_connections 2024-09-13T17:07:14.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.689+0000 7f850a438700 1 --2- 172.21.15.123:0/4114199332 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f84e8066730 0x7f84e8068bf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.689+0000 7f850a438700 1 --2- 172.21.15.123:0/4114199332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f850415ed00 0x7f85041eb960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.689+0000 7f850a438700 1 --2- 172.21.15.123:0/4114199332 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f850415e920 0x7f8504150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.689+0000 7f850a438700 1 --2- 172.21.15.123:0/4114199332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85040cb020 0x7f85040aa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.689+0000 7f850a438700 1 -- 172.21.15.123:0/4114199332 >> 172.21.15.123:0/4114199332 conn(0x7f8504066150 msgr2=0x7f850406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:14.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.689+0000 7f850a438700 1 -- 172.21.15.123:0/4114199332 shutdown_connections 2024-09-13T17:07:14.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.689+0000 7f850a438700 1 -- 172.21.15.123:0/4114199332 wait complete. 2024-09-13T17:07:14.711 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:14.711 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:14.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.817+0000 7fc5edb46700 1 Processor -- start 2024-09-13T17:07:14.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.817+0000 7fc5edb46700 1 -- start start 2024-09-13T17:07:14.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5edb46700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5e815af00 0x7fc5e80d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5edb46700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc5e80caf10 0x7fc5e80cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5edb46700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e80d0df0 con 0x7fc5e80b23e0 2024-09-13T17:07:14.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5edb46700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e815b2e0 con 0x7fc5e815af00 2024-09-13T17:07:14.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5edb46700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e80ce260 con 0x7fc5e80caf10 2024-09-13T17:07:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5ecb44700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5e815af00 0x7fc5e80d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5ecb44700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5e815af00 0x7fc5e80d1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56888/0 (socket says 172.21.15.123:56888) 2024-09-13T17:07:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5ecb44700 1 -- 172.21.15.123:0/4219890239 learned_addr learned my addr 172.21.15.123:0/4219890239 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:14.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5e7fff700 1 --2- 172.21.15.123:0/4219890239 >> v2:172.21.15.153:3300/0 conn(0x7fc5e80caf10 0x7fc5e80cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5ecb44700 1 -- 172.21.15.123:0/4219890239 >> v2:172.21.15.153:3300/0 conn(0x7fc5e80caf10 msgr2=0x7fc5e80cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5ecb44700 1 --2- 172.21.15.123:0/4219890239 >> v2:172.21.15.153:3300/0 conn(0x7fc5e80caf10 0x7fc5e80cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5ecb44700 1 -- 172.21.15.123:0/4219890239 >> v1:172.21.15.123:6789/0 conn(0x7fc5e80b23e0 legacy=0x7fc5e80b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5ecb44700 1 -- 172.21.15.123:0/4219890239 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e80d01e0 con 0x7fc5e815af00 2024-09-13T17:07:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5e7fff700 1 --2- 172.21.15.123:0/4219890239 >> v2:172.21.15.153:3300/0 conn(0x7fc5e80caf10 0x7fc5e80cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5ecb44700 1 --2- 172.21.15.123:0/4219890239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e815af00 0x7fc5e80d1280 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80670c0 tx=0x7fc5dc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b925ee49edf5d9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5e77fe700 1 -- 172.21.15.123:0/4219890239 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc00b8a0 con 0x7fc5e815af00 2024-09-13T17:07:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5e77fe700 1 -- 172.21.15.123:0/4219890239 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc00ba00 con 0x7fc5e815af00 2024-09-13T17:07:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5e77fe700 1 -- 172.21.15.123:0/4219890239 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc00bd90 con 0x7fc5e815af00 2024-09-13T17:07:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5edb46700 1 -- 172.21.15.123:0/4219890239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e815af00 msgr2=0x7fc5e80d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5edb46700 1 --2- 172.21.15.123:0/4219890239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e815af00 0x7fc5e80d1280 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80670c0 tx=0x7fc5dc009bf0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5edb46700 1 -- 172.21.15.123:0/4219890239 shutdown_connections 2024-09-13T17:07:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5edb46700 1 --2- 172.21.15.123:0/4219890239 >> v2:172.21.15.153:3300/0 conn(0x7fc5e80caf10 0x7fc5e80cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5edb46700 1 --2- 172.21.15.123:0/4219890239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e815af00 0x7fc5e80d1280 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5edb46700 1 -- 172.21.15.123:0/4219890239 >> 172.21.15.123:0/4219890239 conn(0x7fc5e8066150 msgr2=0x7fc5e8066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:14.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5edb46700 1 -- 172.21.15.123:0/4219890239 shutdown_connections 2024-09-13T17:07:14.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.821+0000 7fc5edb46700 1 -- 172.21.15.123:0/4219890239 wait complete. 2024-09-13T17:07:14.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5edb46700 1 Processor -- start 2024-09-13T17:07:14.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5edb46700 1 -- start start 2024-09-13T17:07:14.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5edb46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e80b23e0 0x7fc5e8150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5edb46700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5e80caf10 0x7fc5e8070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5edb46700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e815af00 0x7fc5e80c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5edb46700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80aec20 con 0x7fc5e815af00 2024-09-13T17:07:14.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5edb46700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80ae010 con 0x7fc5e80b23e0 2024-09-13T17:07:14.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5edb46700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80ae2f0 con 0x7fc5e80caf10 2024-09-13T17:07:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5ed345700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e815af00 0x7fc5e80c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5ed345700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e815af00 0x7fc5e80c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56896/0 (socket says 172.21.15.123:56896) 2024-09-13T17:07:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5ed345700 1 -- 172.21.15.123:0/1336654373 learned_addr learned my addr 172.21.15.123:0/1336654373 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5ecb44700 1 --2- 172.21.15.123:0/1336654373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e80b23e0 0x7fc5e8150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5e7fff700 1 --2- 172.21.15.123:0/1336654373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5e80caf10 0x7fc5e8070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5ed345700 1 -- 172.21.15.123:0/1336654373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5e80caf10 msgr2=0x7fc5e8070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5ed345700 1 --2- 172.21.15.123:0/1336654373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5e80caf10 0x7fc5e8070e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5ed345700 1 -- 172.21.15.123:0/1336654373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e80b23e0 msgr2=0x7fc5e8150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5ed345700 1 --2- 172.21.15.123:0/1336654373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e80b23e0 0x7fc5e8150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5ed345700 1 -- 172.21.15.123:0/1336654373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc009570 con 0x7fc5e815af00 2024-09-13T17:07:14.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.825+0000 7fc5ed345700 1 --2- 172.21.15.123:0/1336654373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e815af00 0x7fc5e80c91e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000cba0 tx=0x7fc5e000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:14.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.829+0000 7fc5e57fa700 1 -- 172.21.15.123:0/1336654373 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0003c20 con 0x7fc5e815af00 2024-09-13T17:07:14.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.829+0000 7fc5e57fa700 1 -- 172.21.15.123:0/1336654373 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e0003d80 con 0x7fc5e815af00 2024-09-13T17:07:14.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.829+0000 7fc5edb46700 1 -- 172.21.15.123:0/1336654373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e80ae5d0 con 0x7fc5e815af00 2024-09-13T17:07:14.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.829+0000 7fc5e57fa700 1 -- 172.21.15.123:0/1336654373 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000ab10 con 0x7fc5e815af00 2024-09-13T17:07:14.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.829+0000 7fc5edb46700 1 -- 172.21.15.123:0/1336654373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e8071350 con 0x7fc5e815af00 2024-09-13T17:07:14.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.829+0000 7fc5edb46700 1 -- 172.21.15.123:0/1336654373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e80747b0 con 0x7fc5e815af00 2024-09-13T17:07:14.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.829+0000 7fc5e57fa700 1 -- 172.21.15.123:0/1336654373 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc5e000ac70 con 0x7fc5e815af00 2024-09-13T17:07:14.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.829+0000 7fc5e57fa700 1 --2- 172.21.15.123:0/1336654373 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc5cc066760 0x7fc5cc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:14.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.829+0000 7fc5e57fa700 1 -- 172.21.15.123:0/1336654373 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5e0084110 con 0x7fc5e815af00 2024-09-13T17:07:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.829+0000 7fc5ecb44700 1 --2- 172.21.15.123:0/1336654373 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc5cc066760 0x7fc5cc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.833+0000 7fc5ecb44700 1 --2- 172.21.15.123:0/1336654373 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc5cc066760 0x7fc5cc068c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc014040 tx=0x7fc5dc008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:14.837+0000 7fc5e57fa700 1 -- 172.21.15.123:0/1336654373 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc5e00515c0 con 0x7fc5e815af00 2024-09-13T17:07:15.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.005+0000 7fc5edb46700 1 -- 172.21.15.123:0/1336654373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5e80cdd20 con 0x7fc5e815af00 2024-09-13T17:07:15.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.009+0000 7fc5e57fa700 1 -- 172.21.15.123:0/1336654373 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5e0054be0 con 0x7fc5e815af00 2024-09-13T17:07:15.014 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:15.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.009+0000 7fc5edb46700 1 -- 172.21.15.123:0/1336654373 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc5cc066760 msgr2=0x7fc5cc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.009+0000 7fc5edb46700 1 --2- 172.21.15.123:0/1336654373 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc5cc066760 0x7fc5cc068c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc014040 tx=0x7fc5dc008030 comp rx=0 tx=0).stop 2024-09-13T17:07:15.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.009+0000 7fc5edb46700 1 -- 172.21.15.123:0/1336654373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e815af00 msgr2=0x7fc5e80c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.009+0000 7fc5edb46700 1 --2- 172.21.15.123:0/1336654373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e815af00 0x7fc5e80c91e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000cba0 tx=0x7fc5e000ceb0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.009+0000 7fc5edb46700 1 -- 172.21.15.123:0/1336654373 shutdown_connections 2024-09-13T17:07:15.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.009+0000 7fc5edb46700 1 --2- 172.21.15.123:0/1336654373 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc5cc066760 0x7fc5cc068c20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.009+0000 7fc5edb46700 1 --2- 172.21.15.123:0/1336654373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e815af00 0x7fc5e80c91e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.009+0000 7fc5edb46700 1 --2- 172.21.15.123:0/1336654373 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5e80caf10 0x7fc5e8070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.009+0000 7fc5edb46700 1 --2- 172.21.15.123:0/1336654373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e80b23e0 0x7fc5e8150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.009+0000 7fc5edb46700 1 -- 172.21.15.123:0/1336654373 >> 172.21.15.123:0/1336654373 conn(0x7fc5e8066150 msgr2=0x7fc5e80b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:15.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.009+0000 7fc5edb46700 1 -- 172.21.15.123:0/1336654373 shutdown_connections 2024-09-13T17:07:15.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.009+0000 7fc5edb46700 1 -- 172.21.15.123:0/1336654373 wait complete. 2024-09-13T17:07:15.029 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:07:15.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.141+0000 7fb460baf700 1 Processor -- start 2024-09-13T17:07:15.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.141+0000 7fb460baf700 1 -- start start 2024-09-13T17:07:15.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.141+0000 7fb460baf700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb45c1604b0 0x7fb45c0cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.141+0000 7fb460baf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb45c0c98c0 0x7fb45c0cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.141+0000 7fb460baf700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c0ceec0 con 0x7fb45c160890 2024-09-13T17:07:15.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.141+0000 7fb460baf700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45c0ce430 con 0x7fb45c0c98c0 2024-09-13T17:07:15.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.141+0000 7fb460baf700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0d1ec0 con 0x7fb45c1604b0 2024-09-13T17:07:15.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.141+0000 7fb451d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb45c0c98c0 0x7fb45c0cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.141+0000 7fb451d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb45c0c98c0 0x7fb45c0cf820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56900/0 (socket says 172.21.15.123:56900) 2024-09-13T17:07:15.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.141+0000 7fb451d9b700 1 -- 172.21.15.123:0/2864869748 learned_addr learned my addr 172.21.15.123:0/2864869748 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:15.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.141+0000 7fb45a59c700 1 --2- 172.21.15.123:0/2864869748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb45c1604b0 0x7fb45c0cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb451d9b700 1 -- 172.21.15.123:0/2864869748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb45c1604b0 msgr2=0x7fb45c0cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:15.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb451d9b700 1 --2- 172.21.15.123:0/2864869748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb45c1604b0 0x7fb45c0cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb451d9b700 1 -- 172.21.15.123:0/2864869748 >> v1:172.21.15.153:6789/0 conn(0x7fb45c160890 legacy=0x7fb45c0d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb451d9b700 1 -- 172.21.15.123:0/2864869748 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c0ce620 con 0x7fb45c0c98c0 2024-09-13T17:07:15.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb451d9b700 1 --2- 172.21.15.123:0/2864869748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb45c0c98c0 0x7fb45c0cf820 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb444009910 tx=0x7fb444009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ce79d2ee069452 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:15.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb459d9b700 1 -- 172.21.15.123:0/2864869748 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44400ba60 con 0x7fb45c0c98c0 2024-09-13T17:07:15.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb459d9b700 1 -- 172.21.15.123:0/2864869748 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44400bbc0 con 0x7fb45c0c98c0 2024-09-13T17:07:15.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb459d9b700 1 -- 172.21.15.123:0/2864869748 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444009e60 con 0x7fb45c0c98c0 2024-09-13T17:07:15.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb460baf700 1 -- 172.21.15.123:0/2864869748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb45c0c98c0 msgr2=0x7fb45c0cf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb460baf700 1 --2- 172.21.15.123:0/2864869748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb45c0c98c0 0x7fb45c0cf820 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb444009910 tx=0x7fb444009c20 comp rx=0 tx=0).stop 2024-09-13T17:07:15.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb460baf700 1 -- 172.21.15.123:0/2864869748 shutdown_connections 2024-09-13T17:07:15.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb460baf700 1 --2- 172.21.15.123:0/2864869748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb45c0c98c0 0x7fb45c0cf820 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb460baf700 1 --2- 172.21.15.123:0/2864869748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb45c1604b0 0x7fb45c0cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb460baf700 1 -- 172.21.15.123:0/2864869748 >> 172.21.15.123:0/2864869748 conn(0x7fb45c0d2cb0 msgr2=0x7fb45c0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:15.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb460baf700 1 -- 172.21.15.123:0/2864869748 shutdown_connections 2024-09-13T17:07:15.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.145+0000 7fb460baf700 1 -- 172.21.15.123:0/2864869748 wait complete. 2024-09-13T17:07:15.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.149+0000 7fb460baf700 1 Processor -- start 2024-09-13T17:07:15.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.149+0000 7fb460baf700 1 -- start start 2024-09-13T17:07:15.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.149+0000 7fb460baf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb45c0c98c0 0x7fb45c0b6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.149+0000 7fb460baf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb45c1604b0 0x7fb45c0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.149+0000 7fb460baf700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb45c160890 0x7fb45c156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.149+0000 7fb460baf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0b6c30 con 0x7fb45c1604b0 2024-09-13T17:07:15.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.149+0000 7fb460baf700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0b6a50 con 0x7fb45c0c98c0 2024-09-13T17:07:15.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.149+0000 7fb460baf700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c1f24a0 con 0x7fb45c160890 2024-09-13T17:07:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.149+0000 7fb451d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb45c1604b0 0x7fb45c0b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.149+0000 7fb451d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb45c1604b0 0x7fb45c0b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56902/0 (socket says 172.21.15.123:56902) 2024-09-13T17:07:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.149+0000 7fb451d9b700 1 -- 172.21.15.123:0/3543914560 learned_addr learned my addr 172.21.15.123:0/3543914560 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.149+0000 7fb45a59c700 1 --2- 172.21.15.123:0/3543914560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb45c0c98c0 0x7fb45c0b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.149+0000 7fb45ad9d700 1 --2- 172.21.15.123:0/3543914560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb45c160890 0x7fb45c156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.153+0000 7fb451d9b700 1 -- 172.21.15.123:0/3543914560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb45c160890 msgr2=0x7fb45c156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.153+0000 7fb451d9b700 1 --2- 172.21.15.123:0/3543914560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb45c160890 0x7fb45c156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.153+0000 7fb451d9b700 1 -- 172.21.15.123:0/3543914560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb45c0c98c0 msgr2=0x7fb45c0b6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.153+0000 7fb451d9b700 1 --2- 172.21.15.123:0/3543914560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb45c0c98c0 0x7fb45c0b6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.153+0000 7fb451d9b700 1 -- 172.21.15.123:0/3543914560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb444009570 con 0x7fb45c1604b0 2024-09-13T17:07:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.153+0000 7fb451d9b700 1 --2- 172.21.15.123:0/3543914560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb45c1604b0 0x7fb45c0b0c00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb444000c00 tx=0x7fb444004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.153+0000 7fb4537fe700 1 -- 172.21.15.123:0/3543914560 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444004450 con 0x7fb45c1604b0 2024-09-13T17:07:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.153+0000 7fb4537fe700 1 -- 172.21.15.123:0/3543914560 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44401f070 con 0x7fb45c1604b0 2024-09-13T17:07:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.153+0000 7fb460baf700 1 -- 172.21.15.123:0/3543914560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c1f2760 con 0x7fb45c1604b0 2024-09-13T17:07:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.153+0000 7fb4537fe700 1 -- 172.21.15.123:0/3543914560 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444003900 con 0x7fb45c1604b0 2024-09-13T17:07:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.153+0000 7fb460baf700 1 -- 172.21.15.123:0/3543914560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c1f2af0 con 0x7fb45c1604b0 2024-09-13T17:07:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.153+0000 7fb460baf700 1 -- 172.21.15.123:0/3543914560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45c0cf2e0 con 0x7fb45c1604b0 2024-09-13T17:07:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.153+0000 7fb4537fe700 1 -- 172.21.15.123:0/3543914560 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb444003a60 con 0x7fb45c1604b0 2024-09-13T17:07:15.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.157+0000 7fb4537fe700 1 --2- 172.21.15.123:0/3543914560 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb43c066730 0x7fb43c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.157+0000 7fb4537fe700 1 -- 172.21.15.123:0/3543914560 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb444021070 con 0x7fb45c1604b0 2024-09-13T17:07:15.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.157+0000 7fb45a59c700 1 --2- 172.21.15.123:0/3543914560 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb43c066730 0x7fb43c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.157+0000 7fb45a59c700 1 --2- 172.21.15.123:0/3543914560 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb43c066730 0x7fb43c068bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009a00 tx=0x7fb44c008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:15.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.161+0000 7fb4537fe700 1 -- 172.21.15.123:0/3543914560 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb444052980 con 0x7fb45c1604b0 2024-09-13T17:07:15.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.329+0000 7fb460baf700 1 -- 172.21.15.123:0/3543914560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb45c06eca0 con 0x7fb45c1604b0 2024-09-13T17:07:15.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.329+0000 7fb4537fe700 1 -- 172.21.15.123:0/3543914560 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb444015020 con 0x7fb45c1604b0 2024-09-13T17:07:15.337 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:07:15.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.333+0000 7fb460baf700 1 -- 172.21.15.123:0/3543914560 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb43c066730 msgr2=0x7fb43c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.333+0000 7fb460baf700 1 --2- 172.21.15.123:0/3543914560 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb43c066730 0x7fb43c068bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009a00 tx=0x7fb44c008040 comp rx=0 tx=0).stop 2024-09-13T17:07:15.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.333+0000 7fb460baf700 1 -- 172.21.15.123:0/3543914560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb45c1604b0 msgr2=0x7fb45c0b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.333+0000 7fb460baf700 1 --2- 172.21.15.123:0/3543914560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb45c1604b0 0x7fb45c0b0c00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb444000c00 tx=0x7fb444004770 comp rx=0 tx=0).stop 2024-09-13T17:07:15.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.333+0000 7fb460baf700 1 -- 172.21.15.123:0/3543914560 shutdown_connections 2024-09-13T17:07:15.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.333+0000 7fb460baf700 1 --2- 172.21.15.123:0/3543914560 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb43c066730 0x7fb43c068bf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.333+0000 7fb460baf700 1 --2- 172.21.15.123:0/3543914560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb45c160890 0x7fb45c156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.333+0000 7fb460baf700 1 --2- 172.21.15.123:0/3543914560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb45c1604b0 0x7fb45c0b0c00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.333+0000 7fb460baf700 1 --2- 172.21.15.123:0/3543914560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb45c0c98c0 0x7fb45c0b6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.333+0000 7fb460baf700 1 -- 172.21.15.123:0/3543914560 >> 172.21.15.123:0/3543914560 conn(0x7fb45c0d2cb0 msgr2=0x7fb45c15eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:15.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.333+0000 7fb460baf700 1 -- 172.21.15.123:0/3543914560 shutdown_connections 2024-09-13T17:07:15.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.333+0000 7fb460baf700 1 -- 172.21.15.123:0/3543914560 wait complete. 2024-09-13T17:07:15.350 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:07:15.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.461+0000 7fa95bfff700 1 Processor -- start 2024-09-13T17:07:15.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.461+0000 7fa95bfff700 1 -- start start 2024-09-13T17:07:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa95c0b58b0 0x7fa95c0d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa95c0cd5e0 0x7fa95c0cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95bfff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95c0b0060 con 0x7fa95c0d0f40 2024-09-13T17:07:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95bfff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa95c0b0340 con 0x7fa95c0b58b0 2024-09-13T17:07:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c0b0620 con 0x7fa95c0cd5e0 2024-09-13T17:07:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa953fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa95c0b58b0 0x7fa95c0d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95affd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa95c0d0f40 0x7fa95c0d1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56042/0 (socket says 172.21.15.123:56042) 2024-09-13T17:07:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95affd700 1 -- 172.21.15.123:0/1197989388 learned_addr learned my addr 172.21.15.123:0/1197989388 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95b7fe700 1 --2- 172.21.15.123:0/1197989388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa95c0cd5e0 0x7fa95c0cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95a7fc700 1 -- 172.21.15.123:0/1197989388 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473636231 0 0) 0x7fa95c0b0060 con 0x7fa95c0d0f40 2024-09-13T17:07:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95a7fc700 1 -- 172.21.15.123:0/1197989388 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa93c0035d0 con 0x7fa95c0d0f40 2024-09-13T17:07:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa953fff700 1 -- 172.21.15.123:0/1197989388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa95c0cd5e0 msgr2=0x7fa95c0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa953fff700 1 --2- 172.21.15.123:0/1197989388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa95c0cd5e0 0x7fa95c0cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa953fff700 1 -- 172.21.15.123:0/1197989388 >> v1:172.21.15.123:6789/0 conn(0x7fa95c0d0f40 legacy=0x7fa95c0d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa953fff700 1 -- 172.21.15.123:0/1197989388 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c0b0900 con 0x7fa95c0b58b0 2024-09-13T17:07:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95b7fe700 1 --2- 172.21.15.123:0/1197989388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa95c0cd5e0 0x7fa95c0cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa953fff700 1 --2- 172.21.15.123:0/1197989388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa95c0b58b0 0x7fa95c0d05a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa944009850 tx=0x7fa944009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7605df551f292c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95a7fc700 1 -- 172.21.15.123:0/1197989388 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944011830 con 0x7fa95c0b58b0 2024-09-13T17:07:15.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95a7fc700 1 -- 172.21.15.123:0/1197989388 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa944011990 con 0x7fa95c0b58b0 2024-09-13T17:07:15.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95a7fc700 1 -- 172.21.15.123:0/1197989388 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944011d40 con 0x7fa95c0b58b0 2024-09-13T17:07:15.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95bfff700 1 -- 172.21.15.123:0/1197989388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa95c0b58b0 msgr2=0x7fa95c0d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95bfff700 1 --2- 172.21.15.123:0/1197989388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa95c0b58b0 0x7fa95c0d05a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa944009850 tx=0x7fa944009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:15.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95bfff700 1 -- 172.21.15.123:0/1197989388 shutdown_connections 2024-09-13T17:07:15.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95bfff700 1 --2- 172.21.15.123:0/1197989388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa95c0cd5e0 0x7fa95c0cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95bfff700 1 --2- 172.21.15.123:0/1197989388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa95c0b58b0 0x7fa95c0d05a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95bfff700 1 -- 172.21.15.123:0/1197989388 >> 172.21.15.123:0/1197989388 conn(0x7fa95c0d2a60 msgr2=0x7fa95c0d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:15.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95bfff700 1 -- 172.21.15.123:0/1197989388 shutdown_connections 2024-09-13T17:07:15.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.465+0000 7fa95bfff700 1 -- 172.21.15.123:0/1197989388 wait complete. 2024-09-13T17:07:15.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa95bfff700 1 Processor -- start 2024-09-13T17:07:15.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa95bfff700 1 -- start start 2024-09-13T17:07:15.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa95bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa95c0b58b0 0x7fa95c1f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa95bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa95c0cd5e0 0x7fa95c15fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa95bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa95c0d0f40 0x7fa95c0cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa95bfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c1f2160 con 0x7fa95c0cd5e0 2024-09-13T17:07:15.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa95bfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c15d6c0 con 0x7fa95c0b58b0 2024-09-13T17:07:15.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa95bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c15d9a0 con 0x7fa95c0d0f40 2024-09-13T17:07:15.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa953fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa95c0cd5e0 0x7fa95c15fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa953fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa95c0cd5e0 0x7fa95c15fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56922/0 (socket says 172.21.15.123:56922) 2024-09-13T17:07:15.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa953fff700 1 -- 172.21.15.123:0/1611397326 learned_addr learned my addr 172.21.15.123:0/1611397326 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:15.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa95b7fe700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa95c0d0f40 0x7fa95c0cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa95affd700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa95c0b58b0 0x7fa95c1f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa953fff700 1 -- 172.21.15.123:0/1611397326 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa95c0d0f40 msgr2=0x7fa95c0cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa953fff700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa95c0d0f40 0x7fa95c0cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa953fff700 1 -- 172.21.15.123:0/1611397326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa95c0b58b0 msgr2=0x7fa95c1f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa953fff700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa95c0b58b0 0x7fa95c1f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa953fff700 1 -- 172.21.15.123:0/1611397326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9440094b0 con 0x7fa95c0cd5e0 2024-09-13T17:07:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa95b7fe700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa95c0d0f40 0x7fa95c0cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa95affd700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa95c0b58b0 0x7fa95c1f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa953fff700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa95c0cd5e0 0x7fa95c15fc50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa944014040 tx=0x7fa944004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa9537fe700 1 -- 172.21.15.123:0/1611397326 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440036c0 con 0x7fa95c0cd5e0 2024-09-13T17:07:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.469+0000 7fa9537fe700 1 -- 172.21.15.123:0/1611397326 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94401e070 con 0x7fa95c0cd5e0 2024-09-13T17:07:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.473+0000 7fa95bfff700 1 -- 172.21.15.123:0/1611397326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa95c15dc80 con 0x7fa95c0cd5e0 2024-09-13T17:07:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.473+0000 7fa9537fe700 1 -- 172.21.15.123:0/1611397326 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944003a80 con 0x7fa95c0cd5e0 2024-09-13T17:07:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.473+0000 7fa95bfff700 1 -- 172.21.15.123:0/1611397326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa95c15e240 con 0x7fa95c0cd5e0 2024-09-13T17:07:15.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.473+0000 7fa95bfff700 1 -- 172.21.15.123:0/1611397326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa95c0d1320 con 0x7fa95c0cd5e0 2024-09-13T17:07:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.473+0000 7fa9537fe700 1 -- 172.21.15.123:0/1611397326 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa944003be0 con 0x7fa95c0cd5e0 2024-09-13T17:07:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.473+0000 7fa9537fe700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa940066760 0x7fa940068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.473+0000 7fa9537fe700 1 -- 172.21.15.123:0/1611397326 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa944020070 con 0x7fa95c0cd5e0 2024-09-13T17:07:15.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.477+0000 7fa95affd700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa940066760 0x7fa940068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.477+0000 7fa95affd700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa940066760 0x7fa940068c20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa94c007fd0 tx=0x7fa94c007de0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:15.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.481+0000 7fa9537fe700 1 -- 172.21.15.123:0/1611397326 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa944052850 con 0x7fa95c0cd5e0 2024-09-13T17:07:15.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.649+0000 7fa95bfff700 1 -- 172.21.15.123:0/1611397326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa95c08c250 con 0x7fa95c0cd5e0 2024-09-13T17:07:15.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.649+0000 7fa9537fe700 1 -- 172.21.15.123:0/1611397326 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa944006ce0 con 0x7fa95c0cd5e0 2024-09-13T17:07:15.657 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:07:15.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.653+0000 7fa95bfff700 1 -- 172.21.15.123:0/1611397326 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa940066760 msgr2=0x7fa940068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.653+0000 7fa95bfff700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa940066760 0x7fa940068c20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa94c007fd0 tx=0x7fa94c007de0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.653+0000 7fa95bfff700 1 -- 172.21.15.123:0/1611397326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa95c0cd5e0 msgr2=0x7fa95c15fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.653+0000 7fa95bfff700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa95c0cd5e0 0x7fa95c15fc50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa944014040 tx=0x7fa944004770 comp rx=0 tx=0).stop 2024-09-13T17:07:15.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.653+0000 7fa95bfff700 1 -- 172.21.15.123:0/1611397326 shutdown_connections 2024-09-13T17:07:15.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.653+0000 7fa95bfff700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa940066760 0x7fa940068c20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.653+0000 7fa95bfff700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa95c0d0f40 0x7fa95c0cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.653+0000 7fa95bfff700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa95c0cd5e0 0x7fa95c15fc50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.653+0000 7fa95bfff700 1 --2- 172.21.15.123:0/1611397326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa95c0b58b0 0x7fa95c1f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.653+0000 7fa95bfff700 1 -- 172.21.15.123:0/1611397326 >> 172.21.15.123:0/1611397326 conn(0x7fa95c0d2a60 msgr2=0x7fa95c070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:15.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.653+0000 7fa95bfff700 1 -- 172.21.15.123:0/1611397326 shutdown_connections 2024-09-13T17:07:15.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.653+0000 7fa95bfff700 1 -- 172.21.15.123:0/1611397326 wait complete. 2024-09-13T17:07:15.672 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:15.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2edee2700 1 Processor -- start 2024-09-13T17:07:15.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2edee2700 1 -- start start 2024-09-13T17:07:15.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2edee2700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2e81598b0 0x7ff2e8071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2edee2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff2e80cdfd0 0x7ff2e80ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2edee2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e815d360 con 0x7ff2e80cebf0 2024-09-13T17:07:15.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2edee2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e80cf080 con 0x7ff2e80cdfd0 2024-09-13T17:07:15.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2edee2700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e815aca0 con 0x7ff2e81598b0 2024-09-13T17:07:15.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2e7fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff2e80cdfd0 0x7ff2e80ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2ed6e1700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff2e80cebf0 0x7ff2e80b15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56044/0 (socket says 172.21.15.123:56044) 2024-09-13T17:07:15.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2ed6e1700 1 -- 172.21.15.123:0/37046803 learned_addr learned my addr 172.21.15.123:0/37046803 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:15.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2ecee0700 1 --2- 172.21.15.123:0/37046803 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2e81598b0 0x7ff2e8071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2e7fff700 1 -- 172.21.15.123:0/37046803 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2e81598b0 msgr2=0x7ff2e8071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:15.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2e7fff700 1 --2- 172.21.15.123:0/37046803 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2e81598b0 0x7ff2e8071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2e7fff700 1 -- 172.21.15.123:0/37046803 >> v1:172.21.15.123:6789/0 conn(0x7ff2e80cebf0 legacy=0x7ff2e80b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2e7fff700 1 -- 172.21.15.123:0/37046803 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e80ce3d0 con 0x7ff2e80cdfd0 2024-09-13T17:07:15.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2e7fff700 1 --2- 172.21.15.123:0/37046803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e80cdfd0 0x7ff2e80ce6b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009850 tx=0x7ff2dc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb931d3d0083510 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:15.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2e77fe700 1 -- 172.21.15.123:0/37046803 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc011830 con 0x7ff2e80cdfd0 2024-09-13T17:07:15.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2e77fe700 1 -- 172.21.15.123:0/37046803 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc011990 con 0x7ff2e80cdfd0 2024-09-13T17:07:15.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2e77fe700 1 -- 172.21.15.123:0/37046803 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc011d40 con 0x7ff2e80cdfd0 2024-09-13T17:07:15.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2edee2700 1 -- 172.21.15.123:0/37046803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e80cdfd0 msgr2=0x7ff2e80ce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2edee2700 1 --2- 172.21.15.123:0/37046803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e80cdfd0 0x7ff2e80ce6b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009850 tx=0x7ff2dc009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:15.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2edee2700 1 -- 172.21.15.123:0/37046803 shutdown_connections 2024-09-13T17:07:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2edee2700 1 --2- 172.21.15.123:0/37046803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e80cdfd0 0x7ff2e80ce6b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2edee2700 1 --2- 172.21.15.123:0/37046803 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2e81598b0 0x7ff2e8071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.777+0000 7ff2edee2700 1 -- 172.21.15.123:0/37046803 >> 172.21.15.123:0/37046803 conn(0x7ff2e8066150 msgr2=0x7ff2e8066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2edee2700 1 -- 172.21.15.123:0/37046803 shutdown_connections 2024-09-13T17:07:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2edee2700 1 -- 172.21.15.123:0/37046803 wait complete. 2024-09-13T17:07:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2edee2700 1 Processor -- start 2024-09-13T17:07:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2edee2700 1 -- start start 2024-09-13T17:07:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2edee2700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2e80cdfd0 0x7ff2e81575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2edee2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2e80cebf0 0x7ff2e8141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2edee2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e81598b0 0x7ff2e813ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2edee2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8157ce0 con 0x7ff2e81598b0 2024-09-13T17:07:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2edee2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8157fc0 con 0x7ff2e80cebf0 2024-09-13T17:07:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2edee2700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e81582a0 con 0x7ff2e80cdfd0 2024-09-13T17:07:15.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2ed6e1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e81598b0 0x7ff2e813ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2ed6e1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e81598b0 0x7ff2e813ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56944/0 (socket says 172.21.15.123:56944) 2024-09-13T17:07:15.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2ed6e1700 1 -- 172.21.15.123:0/2068646909 learned_addr learned my addr 172.21.15.123:0/2068646909 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:15.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2ecee0700 1 --2- 172.21.15.123:0/2068646909 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2e80cdfd0 0x7ff2e81575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2e7fff700 1 --2- 172.21.15.123:0/2068646909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2e80cebf0 0x7ff2e8141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2ed6e1700 1 -- 172.21.15.123:0/2068646909 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2e80cdfd0 msgr2=0x7ff2e81575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2ed6e1700 1 --2- 172.21.15.123:0/2068646909 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2e80cdfd0 0x7ff2e81575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2ed6e1700 1 -- 172.21.15.123:0/2068646909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2e80cebf0 msgr2=0x7ff2e8141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2ed6e1700 1 --2- 172.21.15.123:0/2068646909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2e80cebf0 0x7ff2e8141f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2ed6e1700 1 -- 172.21.15.123:0/2068646909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc0094b0 con 0x7ff2e81598b0 2024-09-13T17:07:15.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2ed6e1700 1 --2- 172.21.15.123:0/2068646909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e81598b0 0x7ff2e813ea70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000cbc0 tx=0x7ff2e000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:15.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2e57fa700 1 -- 172.21.15.123:0/2068646909 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000a9e0 con 0x7ff2e81598b0 2024-09-13T17:07:15.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2e57fa700 1 -- 172.21.15.123:0/2068646909 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e000ab40 con 0x7ff2e81598b0 2024-09-13T17:07:15.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2edee2700 1 -- 172.21.15.123:0/2068646909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e8158580 con 0x7ff2e81598b0 2024-09-13T17:07:15.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2e57fa700 1 -- 172.21.15.123:0/2068646909 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000ce80 con 0x7ff2e81598b0 2024-09-13T17:07:15.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.781+0000 7ff2edee2700 1 -- 172.21.15.123:0/2068646909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e8158d80 con 0x7ff2e81598b0 2024-09-13T17:07:15.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.785+0000 7ff2edee2700 1 -- 172.21.15.123:0/2068646909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e80677f0 con 0x7ff2e81598b0 2024-09-13T17:07:15.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.785+0000 7ff2e57fa700 1 -- 172.21.15.123:0/2068646909 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2e001b3b0 con 0x7ff2e81598b0 2024-09-13T17:07:15.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.785+0000 7ff2e57fa700 1 --2- 172.21.15.123:0/2068646909 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff2d4066730 0x7ff2d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:15.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.785+0000 7ff2ecee0700 1 --2- 172.21.15.123:0/2068646909 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff2d4066730 0x7ff2d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:15.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.785+0000 7ff2e57fa700 1 -- 172.21.15.123:0/2068646909 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2e0083be0 con 0x7ff2e81598b0 2024-09-13T17:07:15.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.785+0000 7ff2ecee0700 1 --2- 172.21.15.123:0/2068646909 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff2d4066730 0x7ff2d4068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8167680 tx=0x7ff2d8008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:15.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.793+0000 7ff2e57fa700 1 -- 172.21.15.123:0/2068646909 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff2e0050ee0 con 0x7ff2e81598b0 2024-09-13T17:07:15.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.965+0000 7ff2edee2700 1 -- 172.21.15.123:0/2068646909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2e8158aa0 con 0x7ff2e81598b0 2024-09-13T17:07:15.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.965+0000 7ff2e57fa700 1 -- 172.21.15.123:0/2068646909 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7ff2e8158aa0 con 0x7ff2e81598b0 2024-09-13T17:07:15.974 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:15.974 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:15.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.969+0000 7ff2edee2700 1 -- 172.21.15.123:0/2068646909 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff2d4066730 msgr2=0x7ff2d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.969+0000 7ff2edee2700 1 --2- 172.21.15.123:0/2068646909 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff2d4066730 0x7ff2d4068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8167680 tx=0x7ff2d8008040 comp rx=0 tx=0).stop 2024-09-13T17:07:15.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.969+0000 7ff2edee2700 1 -- 172.21.15.123:0/2068646909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e81598b0 msgr2=0x7ff2e813ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:15.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.969+0000 7ff2edee2700 1 --2- 172.21.15.123:0/2068646909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e81598b0 0x7ff2e813ea70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000cbc0 tx=0x7ff2e000cca0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.969+0000 7ff2edee2700 1 -- 172.21.15.123:0/2068646909 shutdown_connections 2024-09-13T17:07:15.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.969+0000 7ff2edee2700 1 --2- 172.21.15.123:0/2068646909 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff2d4066730 0x7ff2d4068bf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.969+0000 7ff2edee2700 1 --2- 172.21.15.123:0/2068646909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e81598b0 0x7ff2e813ea70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.969+0000 7ff2edee2700 1 --2- 172.21.15.123:0/2068646909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2e80cebf0 0x7ff2e8141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.969+0000 7ff2edee2700 1 --2- 172.21.15.123:0/2068646909 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2e80cdfd0 0x7ff2e81575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:15.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.969+0000 7ff2edee2700 1 -- 172.21.15.123:0/2068646909 >> 172.21.15.123:0/2068646909 conn(0x7ff2e8066150 msgr2=0x7ff2e8066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:15.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.969+0000 7ff2edee2700 1 -- 172.21.15.123:0/2068646909 shutdown_connections 2024-09-13T17:07:15.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:15.969+0000 7ff2edee2700 1 -- 172.21.15.123:0/2068646909 wait complete. 2024-09-13T17:07:15.990 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:15.990 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:16.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.101+0000 7f27dae99700 1 Processor -- start 2024-09-13T17:07:16.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.101+0000 7f27dae99700 1 -- start start 2024-09-13T17:07:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27dae99700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27d415cbd0 0x7f27d4160900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27dae99700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d40cb110 con 0x7f27d415cfb0 2024-09-13T17:07:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27dae99700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d40d0a70 con 0x7f27d40ce690 2024-09-13T17:07:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27dae99700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40d0d50 con 0x7f27d415cbd0 2024-09-13T17:07:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d3fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f27d415cfb0 0x7f27d4160e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56052/0 (socket says 172.21.15.123:56052) 2024-09-13T17:07:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d3fff700 1 -- 172.21.15.123:0/2439926417 learned_addr learned my addr 172.21.15.123:0/2439926417 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d8c35700 1 --2- 172.21.15.123:0/2439926417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27d415cbd0 0x7f27d4160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126289413 0 0) 0x7f27d40cb110 con 0x7f27d415cfb0 2024-09-13T17:07:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27bc0035d0 con 0x7f27d415cfb0 2024-09-13T17:07:16.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728625123 0 0) 0x7f27d40d0a70 con 0x7f27d40ce690 2024-09-13T17:07:16.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d40cb110 con 0x7f27d40ce690 2024-09-13T17:07:16.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3624011715 0 0) 0x7f27bc0035d0 con 0x7f27d415cfb0 2024-09-13T17:07:16.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27d415cbd0 msgr2=0x7f27d4160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 --2- 172.21.15.123:0/2439926417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27d415cbd0 0x7f27d4160900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 >> v1:172.21.15.153:6789/0 conn(0x7f27d40ce690 legacy=0x7f27d40cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40d1030 con 0x7f27d415cfb0 2024-09-13T17:07:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f27c4001670 con 0x7f27d415cfb0 2024-09-13T17:07:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 >> v1:172.21.15.123:6789/0 conn(0x7f27d415cfb0 legacy=0x7f27d4160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 --2- 172.21.15.123:0/2439926417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27bc003be0 0x7f27bc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 --2- 172.21.15.123:0/2439926417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27d415cbd0 0x7f27bc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 --2- 172.21.15.123:0/2439926417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27bc004db0 0x7f27bc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40d0d50 con 0x7f27bc003be0 2024-09-13T17:07:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc00bbc0 con 0x7f27bc004db0 2024-09-13T17:07:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc00bd50 con 0x7f27d415cbd0 2024-09-13T17:07:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d8c35700 1 --2- 172.21.15.123:0/2439926417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27bc003be0 0x7f27bc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d3fff700 1 --2- 172.21.15.123:0/2439926417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27d415cbd0 0x7f27bc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d9436700 1 --2- 172.21.15.123:0/2439926417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27bc004db0 0x7f27bc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d8c35700 1 -- 172.21.15.123:0/2439926417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27d415cbd0 msgr2=0x7f27bc004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d8c35700 1 --2- 172.21.15.123:0/2439926417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27d415cbd0 0x7f27bc004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d8c35700 1 -- 172.21.15.123:0/2439926417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27bc004db0 msgr2=0x7f27bc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d8c35700 1 --2- 172.21.15.123:0/2439926417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27bc004db0 0x7f27bc005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d8c35700 1 -- 172.21.15.123:0/2439926417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc0035d0 con 0x7f27bc003be0 2024-09-13T17:07:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d8c35700 1 --2- 172.21.15.123:0/2439926417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27bc003be0 0x7f27bc003fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009ba0 tx=0x7f27bc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5db21bcf3d333d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c800e6c0 con 0x7f27bc003be0 2024-09-13T17:07:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c800e820 con 0x7f27bc003be0 2024-09-13T17:07:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d37fe700 1 -- 172.21.15.123:0/2439926417 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c800eb90 con 0x7f27bc003be0 2024-09-13T17:07:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27dae99700 1 -- 172.21.15.123:0/2439926417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27bc003be0 msgr2=0x7f27bc003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27dae99700 1 --2- 172.21.15.123:0/2439926417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27bc003be0 0x7f27bc003fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009ba0 tx=0x7f27bc0058a0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27d9436700 1 -- 172.21.15.123:0/2439926417 reap_dead start 2024-09-13T17:07:16.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27dae99700 1 -- 172.21.15.123:0/2439926417 shutdown_connections 2024-09-13T17:07:16.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27dae99700 1 -- 172.21.15.123:0/2439926417 >> 172.21.15.123:0/2439926417 conn(0x7f27d4066150 msgr2=0x7f27d4066560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:16.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27dae99700 1 -- 172.21.15.123:0/2439926417 shutdown_connections 2024-09-13T17:07:16.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.105+0000 7f27dae99700 1 -- 172.21.15.123:0/2439926417 wait complete. 2024-09-13T17:07:16.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27dae99700 1 Processor -- start 2024-09-13T17:07:16.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27dae99700 1 -- start start 2024-09-13T17:07:16.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27dae99700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27d40aecd0 0x7f27d40ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27dae99700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d40b3090 0x7f27d415e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27dae99700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27d40af0b0 0x7f27d415eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27dae99700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40b09e0 con 0x7f27d40aecd0 2024-09-13T17:07:16.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27dae99700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40b0420 con 0x7f27d40b3090 2024-09-13T17:07:16.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27dae99700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40b0700 con 0x7f27d40af0b0 2024-09-13T17:07:16.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27d8c35700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27d40aecd0 0x7f27d40ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27d8c35700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27d40aecd0 0x7f27d40ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56962/0 (socket says 172.21.15.123:56962) 2024-09-13T17:07:16.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27d8c35700 1 -- 172.21.15.123:0/4114205151 learned_addr learned my addr 172.21.15.123:0/4114205151 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:16.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27d9436700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27d40af0b0 0x7f27d415eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27d3fff700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d40b3090 0x7f27d415e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27d8c35700 1 -- 172.21.15.123:0/4114205151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27d40af0b0 msgr2=0x7f27d415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27d8c35700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27d40af0b0 0x7f27d415eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27d8c35700 1 -- 172.21.15.123:0/4114205151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d40b3090 msgr2=0x7f27d415e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27d8c35700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d40b3090 0x7f27d415e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27d8c35700 1 -- 172.21.15.123:0/4114205151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40acc90 con 0x7f27d40aecd0 2024-09-13T17:07:16.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27d9436700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27d40af0b0 0x7f27d415eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:16.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27d3fff700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d40b3090 0x7f27d415e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:16.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.109+0000 7f27d8c35700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27d40aecd0 0x7f27d40ad250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27c80090b0 tx=0x7f27c80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:16.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.113+0000 7f27d17fa700 1 -- 172.21.15.123:0/4114205151 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c800e6c0 con 0x7f27d40aecd0 2024-09-13T17:07:16.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.113+0000 7f27dae99700 1 -- 172.21.15.123:0/4114205151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d40b09e0 con 0x7f27d40aecd0 2024-09-13T17:07:16.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.113+0000 7f27d17fa700 1 -- 172.21.15.123:0/4114205151 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c8003b10 con 0x7f27d40aecd0 2024-09-13T17:07:16.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.113+0000 7f27d17fa700 1 -- 172.21.15.123:0/4114205151 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8013470 con 0x7f27d40aecd0 2024-09-13T17:07:16.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.113+0000 7f27dae99700 1 -- 172.21.15.123:0/4114205151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d40ad790 con 0x7f27d40aecd0 2024-09-13T17:07:16.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.113+0000 7f27dae99700 1 -- 172.21.15.123:0/4114205151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d4160900 con 0x7f27d40aecd0 2024-09-13T17:07:16.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.113+0000 7f27d17fa700 1 -- 172.21.15.123:0/4114205151 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f27c80135d0 con 0x7f27d40aecd0 2024-09-13T17:07:16.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.113+0000 7f27d17fa700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f27c0066730 0x7f27c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.113+0000 7f27d17fa700 1 -- 172.21.15.123:0/4114205151 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27c80853b0 con 0x7f27d40aecd0 2024-09-13T17:07:16.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.113+0000 7f27d3fff700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f27c0066730 0x7f27c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.117+0000 7f27d3fff700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f27c0066730 0x7f27c0068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f27d4155d50 tx=0x7f27c4009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:16.124 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:07:16.125 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:07:16.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.121+0000 7f27d17fa700 1 -- 172.21.15.123:0/4114205151 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f27c8052900 con 0x7f27d40aecd0 2024-09-13T17:07:16.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.285+0000 7f27dae99700 1 -- 172.21.15.123:0/4114205151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27d40ccdc0 con 0x7f27d40aecd0 2024-09-13T17:07:16.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.285+0000 7f27d17fa700 1 -- 172.21.15.123:0/4114205151 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27c8055f20 con 0x7f27d40aecd0 2024-09-13T17:07:16.291 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:16.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.285+0000 7f27dae99700 1 -- 172.21.15.123:0/4114205151 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f27c0066730 msgr2=0x7f27c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.285+0000 7f27dae99700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f27c0066730 0x7f27c0068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f27d4155d50 tx=0x7f27c4009040 comp rx=0 tx=0).stop 2024-09-13T17:07:16.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.285+0000 7f27dae99700 1 -- 172.21.15.123:0/4114205151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27d40aecd0 msgr2=0x7f27d40ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.285+0000 7f27dae99700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27d40aecd0 0x7f27d40ad250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27c80090b0 tx=0x7f27c80047e0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.285+0000 7f27dae99700 1 -- 172.21.15.123:0/4114205151 shutdown_connections 2024-09-13T17:07:16.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.285+0000 7f27dae99700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f27c0066730 0x7f27c0068bf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.285+0000 7f27dae99700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f27d40af0b0 0x7f27d415eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.285+0000 7f27dae99700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d40b3090 0x7f27d415e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.285+0000 7f27dae99700 1 --2- 172.21.15.123:0/4114205151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27d40aecd0 0x7f27d40ad250 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.285+0000 7f27dae99700 1 -- 172.21.15.123:0/4114205151 >> 172.21.15.123:0/4114205151 conn(0x7f27d4066150 msgr2=0x7f27d40b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:16.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.285+0000 7f27dae99700 1 -- 172.21.15.123:0/4114205151 shutdown_connections 2024-09-13T17:07:16.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.285+0000 7f27dae99700 1 -- 172.21.15.123:0/4114205151 wait complete. 2024-09-13T17:07:16.305 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:07:16.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49fca39700 1 Processor -- start 2024-09-13T17:07:16.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49fca39700 1 -- start start 2024-09-13T17:07:16.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49fca39700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49f8160810 0x7f49f80cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49fca39700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f80b42c0 con 0x7f49f80cfd10 2024-09-13T17:07:16.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49fca39700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f80c7890 con 0x7f49f8160430 2024-09-13T17:07:16.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49fca39700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80b3d00 con 0x7f49f8160810 2024-09-13T17:07:16.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49f5d9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f49f80cfd10 0x7f49f80cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56066/0 (socket says 172.21.15.123:56066) 2024-09-13T17:07:16.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49f5d9b700 1 -- 172.21.15.123:0/258999495 learned_addr learned my addr 172.21.15.123:0/258999495 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:16.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49f6d9d700 1 --2- 172.21.15.123:0/258999495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49f8160810 0x7f49f80cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49f559a700 1 -- 172.21.15.123:0/258999495 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543223305 0 0) 0x7f49f80b42c0 con 0x7f49f80cfd10 2024-09-13T17:07:16.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49f559a700 1 -- 172.21.15.123:0/258999495 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49e40035d0 con 0x7f49f80cfd10 2024-09-13T17:07:16.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49f559a700 1 -- 172.21.15.123:0/258999495 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159126026 0 0) 0x7f49f80c7890 con 0x7f49f8160430 2024-09-13T17:07:16.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49f559a700 1 -- 172.21.15.123:0/258999495 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f80b42c0 con 0x7f49f8160430 2024-09-13T17:07:16.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49f6d9d700 1 -- 172.21.15.123:0/258999495 >> v1:172.21.15.153:6789/0 conn(0x7f49f8160430 legacy=0x7f49f80cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49f6d9d700 1 -- 172.21.15.123:0/258999495 >> v1:172.21.15.123:6789/0 conn(0x7f49f80cfd10 legacy=0x7f49f80cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49f6d9d700 1 -- 172.21.15.123:0/258999495 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f80b3fe0 con 0x7f49f8160810 2024-09-13T17:07:16.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49f6d9d700 1 --2- 172.21.15.123:0/258999495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49f8160810 0x7f49f80cdfe0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009880 tx=0x7f49f0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe4122f4d3bb50c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:16.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.421+0000 7f49f559a700 1 -- 172.21.15.123:0/258999495 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f0011830 con 0x7f49f8160810 2024-09-13T17:07:16.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.425+0000 7f49f559a700 1 -- 172.21.15.123:0/258999495 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f0011990 con 0x7f49f8160810 2024-09-13T17:07:16.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.425+0000 7f49f559a700 1 -- 172.21.15.123:0/258999495 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f0011d00 con 0x7f49f8160810 2024-09-13T17:07:16.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.425+0000 7f49fca39700 1 -- 172.21.15.123:0/258999495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49f8160810 msgr2=0x7f49f80cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.425+0000 7f49fca39700 1 --2- 172.21.15.123:0/258999495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49f8160810 0x7f49f80cdfe0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009880 tx=0x7f49f0009b90 comp rx=0 tx=0).stop 2024-09-13T17:07:16.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.425+0000 7f49fca39700 1 -- 172.21.15.123:0/258999495 shutdown_connections 2024-09-13T17:07:16.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.425+0000 7f49fca39700 1 --2- 172.21.15.123:0/258999495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49f8160810 0x7f49f80cdfe0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.425+0000 7f49fca39700 1 -- 172.21.15.123:0/258999495 >> 172.21.15.123:0/258999495 conn(0x7f49f80d2d30 msgr2=0x7f49f80d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:16.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.425+0000 7f49fca39700 1 -- 172.21.15.123:0/258999495 shutdown_connections 2024-09-13T17:07:16.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.425+0000 7f49fca39700 1 -- 172.21.15.123:0/258999495 wait complete. 2024-09-13T17:07:16.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49fca39700 1 Processor -- start 2024-09-13T17:07:16.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49fca39700 1 -- start start 2024-09-13T17:07:16.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49fca39700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49f80cfd10 0x7f49f815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49fca39700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49f8160430 0x7f49f814e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49fca39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f8160810 0x7f49f80ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49fca39700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80b72c0 con 0x7f49f80cfd10 2024-09-13T17:07:16.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49fca39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80cb2d0 con 0x7f49f8160810 2024-09-13T17:07:16.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49fca39700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80cb5b0 con 0x7f49f8160430 2024-09-13T17:07:16.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49f659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49f80cfd10 0x7f49f815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49f659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49f80cfd10 0x7f49f815a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56978/0 (socket says 172.21.15.123:56978) 2024-09-13T17:07:16.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49f659c700 1 -- 172.21.15.123:0/669526731 learned_addr learned my addr 172.21.15.123:0/669526731 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:16.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49f6d9d700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f8160810 0x7f49f80ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49f5d9b700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49f8160430 0x7f49f814e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49f659c700 1 -- 172.21.15.123:0/669526731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49f8160430 msgr2=0x7f49f814e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49f659c700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49f8160430 0x7f49f814e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49f659c700 1 -- 172.21.15.123:0/669526731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f8160810 msgr2=0x7f49f80ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49f659c700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f8160810 0x7f49f80ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49f659c700 1 -- 172.21.15.123:0/669526731 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00094b0 con 0x7f49f80cfd10 2024-09-13T17:07:16.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49f5d9b700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49f8160430 0x7f49f814e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:16.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49f659c700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49f80cfd10 0x7f49f815a9d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f49e8001f00 tx=0x7f49e800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:16.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49eeffd700 1 -- 172.21.15.123:0/669526731 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8003c20 con 0x7f49f80cfd10 2024-09-13T17:07:16.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.429+0000 7f49eeffd700 1 -- 172.21.15.123:0/669526731 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e8003d80 con 0x7f49f80cfd10 2024-09-13T17:07:16.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.433+0000 7f49fca39700 1 -- 172.21.15.123:0/669526731 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f80b6c70 con 0x7f49f80cfd10 2024-09-13T17:07:16.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.433+0000 7f49eeffd700 1 -- 172.21.15.123:0/669526731 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800ac60 con 0x7f49f80cfd10 2024-09-13T17:07:16.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.433+0000 7f49fca39700 1 -- 172.21.15.123:0/669526731 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f8071830 con 0x7f49f80cfd10 2024-09-13T17:07:16.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.433+0000 7f49fca39700 1 -- 172.21.15.123:0/669526731 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f80d3820 con 0x7f49f80cfd10 2024-09-13T17:07:16.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.433+0000 7f49eeffd700 1 -- 172.21.15.123:0/669526731 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f49e80050d0 con 0x7f49f80cfd10 2024-09-13T17:07:16.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.433+0000 7f49eeffd700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f49d8066760 0x7f49d8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.433+0000 7f49eeffd700 1 -- 172.21.15.123:0/669526731 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49e80843a0 con 0x7f49f80cfd10 2024-09-13T17:07:16.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.433+0000 7f49f5d9b700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f49d8066760 0x7f49d8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.437+0000 7f49f5d9b700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f49d8066760 0x7f49d8068c20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f49f8159af0 tx=0x7f49e0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:16.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.441+0000 7f49eeffd700 1 -- 172.21.15.123:0/669526731 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f49e80515f0 con 0x7f49f80cfd10 2024-09-13T17:07:16.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.613+0000 7f49fca39700 1 -- 172.21.15.123:0/669526731 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49f80ce0e0 con 0x7f49f80cfd10 2024-09-13T17:07:16.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.613+0000 7f49eeffd700 1 -- 172.21.15.123:0/669526731 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f49e8054c10 con 0x7f49f80cfd10 2024-09-13T17:07:16.622 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:07:16.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.617+0000 7f49fca39700 1 -- 172.21.15.123:0/669526731 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f49d8066760 msgr2=0x7f49d8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.617+0000 7f49fca39700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f49d8066760 0x7f49d8068c20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f49f8159af0 tx=0x7f49e0009040 comp rx=0 tx=0).stop 2024-09-13T17:07:16.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.617+0000 7f49fca39700 1 -- 172.21.15.123:0/669526731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49f80cfd10 msgr2=0x7f49f815a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.617+0000 7f49fca39700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49f80cfd10 0x7f49f815a9d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f49e8001f00 tx=0x7f49e800a060 comp rx=0 tx=0).stop 2024-09-13T17:07:16.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.617+0000 7f49fca39700 1 -- 172.21.15.123:0/669526731 shutdown_connections 2024-09-13T17:07:16.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.617+0000 7f49fca39700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f49d8066760 0x7f49d8068c20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.617+0000 7f49fca39700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49f8160810 0x7f49f80ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.617+0000 7f49fca39700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49f8160430 0x7f49f814e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.617+0000 7f49fca39700 1 --2- 172.21.15.123:0/669526731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49f80cfd10 0x7f49f815a9d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.617+0000 7f49fca39700 1 -- 172.21.15.123:0/669526731 >> 172.21.15.123:0/669526731 conn(0x7f49f80d2d30 msgr2=0x7f49f80cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:16.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.617+0000 7f49fca39700 1 -- 172.21.15.123:0/669526731 shutdown_connections 2024-09-13T17:07:16.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.617+0000 7f49fca39700 1 -- 172.21.15.123:0/669526731 wait complete. 2024-09-13T17:07:16.636 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:07:16.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.745+0000 7f507883e700 1 Processor -- start 2024-09-13T17:07:16.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.745+0000 7f507883e700 1 -- start start 2024-09-13T17:07:16.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.745+0000 7f507883e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f50740cb070 0x7f50740cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.745+0000 7f507883e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f507415a2f0 0x7f507415a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.745+0000 7f507883e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50740ce180 con 0x7f50740b3990 2024-09-13T17:07:16.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.745+0000 7f507883e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50740cba20 con 0x7f50740cb070 2024-09-13T17:07:16.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.745+0000 7f507883e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50740cd990 con 0x7f507415a2f0 2024-09-13T17:07:16.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.745+0000 7f50737fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f50740b3990 0x7f50740cc580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56074/0 (socket says 172.21.15.123:56074) 2024-09-13T17:07:16.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.745+0000 7f50737fe700 1 -- 172.21.15.123:0/779625450 learned_addr learned my addr 172.21.15.123:0/779625450 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:16.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.745+0000 7f5072ffd700 1 --2- 172.21.15.123:0/779625450 >> v2:172.21.15.153:3300/0 conn(0x7f50740cb070 0x7f50740cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.745+0000 7f5073fff700 1 --2- 172.21.15.123:0/779625450 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f507415a2f0 0x7f507415a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.745+0000 7f50727fc700 1 -- 172.21.15.123:0/779625450 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222645420 0 0) 0x7f50740ce180 con 0x7f50740b3990 2024-09-13T17:07:16.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f50727fc700 1 -- 172.21.15.123:0/779625450 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f505c0035d0 con 0x7f50740b3990 2024-09-13T17:07:16.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f5072ffd700 1 -- 172.21.15.123:0/779625450 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f507415a2f0 msgr2=0x7f507415a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:16.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f5072ffd700 1 --2- 172.21.15.123:0/779625450 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f507415a2f0 0x7f507415a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f5072ffd700 1 -- 172.21.15.123:0/779625450 >> v1:172.21.15.123:6789/0 conn(0x7f50740b3990 legacy=0x7f50740cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f5072ffd700 1 -- 172.21.15.123:0/779625450 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50740cd0f0 con 0x7f50740cb070 2024-09-13T17:07:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f5072ffd700 1 --2- 172.21.15.123:0/779625450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50740cb070 0x7f50740cb4e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5068009850 tx=0x7f5068009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=264c76e3b2f172d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f50727fc700 1 -- 172.21.15.123:0/779625450 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068011830 con 0x7f50740cb070 2024-09-13T17:07:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f50727fc700 1 -- 172.21.15.123:0/779625450 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5068011990 con 0x7f50740cb070 2024-09-13T17:07:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f50727fc700 1 -- 172.21.15.123:0/779625450 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068011d40 con 0x7f50740cb070 2024-09-13T17:07:16.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f507883e700 1 -- 172.21.15.123:0/779625450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50740cb070 msgr2=0x7f50740cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f507883e700 1 --2- 172.21.15.123:0/779625450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50740cb070 0x7f50740cb4e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5068009850 tx=0x7f5068009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:16.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f507883e700 1 -- 172.21.15.123:0/779625450 shutdown_connections 2024-09-13T17:07:16.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f507883e700 1 --2- 172.21.15.123:0/779625450 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f507415a2f0 0x7f507415a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f507883e700 1 --2- 172.21.15.123:0/779625450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50740cb070 0x7f50740cb4e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f507883e700 1 -- 172.21.15.123:0/779625450 >> 172.21.15.123:0/779625450 conn(0x7f50740b01d0 msgr2=0x7f50740b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:16.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f507883e700 1 -- 172.21.15.123:0/779625450 shutdown_connections 2024-09-13T17:07:16.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f507883e700 1 -- 172.21.15.123:0/779625450 wait complete. 2024-09-13T17:07:16.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f507883e700 1 Processor -- start 2024-09-13T17:07:16.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.749+0000 7f507883e700 1 -- start start 2024-09-13T17:07:16.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f507883e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50740b3990 0x7f50741f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f507883e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50740cb070 0x7f50740b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f507883e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f507415a2f0 0x7f5074154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f507883e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50741f6cf0 con 0x7f50740b3990 2024-09-13T17:07:16.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f507883e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50740cad30 con 0x7f50740cb070 2024-09-13T17:07:16.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f507883e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50740c40c0 con 0x7f507415a2f0 2024-09-13T17:07:16.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f50737fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50740b3990 0x7f50741f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f50737fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50740b3990 0x7f50741f67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56982/0 (socket says 172.21.15.123:56982) 2024-09-13T17:07:16.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f50737fe700 1 -- 172.21.15.123:0/2182092160 learned_addr learned my addr 172.21.15.123:0/2182092160 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:16.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f5072ffd700 1 --2- 172.21.15.123:0/2182092160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50740cb070 0x7f50740b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f5073fff700 1 --2- 172.21.15.123:0/2182092160 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f507415a2f0 0x7f5074154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f50737fe700 1 -- 172.21.15.123:0/2182092160 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f507415a2f0 msgr2=0x7f5074154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f50737fe700 1 --2- 172.21.15.123:0/2182092160 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f507415a2f0 0x7f5074154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f50737fe700 1 -- 172.21.15.123:0/2182092160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50740cb070 msgr2=0x7f50740b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f50737fe700 1 --2- 172.21.15.123:0/2182092160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50740cb070 0x7f50740b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f50737fe700 1 -- 172.21.15.123:0/2182092160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50680094b0 con 0x7f50740b3990 2024-09-13T17:07:16.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f50737fe700 1 --2- 172.21.15.123:0/2182092160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50740b3990 0x7f50741f67b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f506400c700 tx=0x7f506400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:16.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f505bfff700 1 -- 172.21.15.123:0/2182092160 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064005d90 con 0x7f50740b3990 2024-09-13T17:07:16.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f505bfff700 1 -- 172.21.15.123:0/2182092160 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50640070d0 con 0x7f50740b3990 2024-09-13T17:07:16.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f505bfff700 1 -- 172.21.15.123:0/2182092160 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064007460 con 0x7f50740b3990 2024-09-13T17:07:16.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f507883e700 1 -- 172.21.15.123:0/2182092160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50740b1a10 con 0x7f50740b3990 2024-09-13T17:07:16.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.753+0000 7f507883e700 1 -- 172.21.15.123:0/2182092160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50740caa50 con 0x7f50740b3990 2024-09-13T17:07:16.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.757+0000 7f505bfff700 1 -- 172.21.15.123:0/2182092160 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50640075c0 con 0x7f50740b3990 2024-09-13T17:07:16.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.757+0000 7f507883e700 1 -- 172.21.15.123:0/2182092160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50740cb4e0 con 0x7f50740b3990 2024-09-13T17:07:16.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.757+0000 7f505bfff700 1 --2- 172.21.15.123:0/2182092160 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5060066730 0x7f5060068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:16.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.757+0000 7f505bfff700 1 -- 172.21.15.123:0/2182092160 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5064083530 con 0x7f50740b3990 2024-09-13T17:07:16.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.757+0000 7f5072ffd700 1 --2- 172.21.15.123:0/2182092160 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5060066730 0x7f5060068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:16.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.757+0000 7f5072ffd700 1 --2- 172.21.15.123:0/2182092160 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5060066730 0x7f5060068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f50680090b0 tx=0x7f5068008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:16.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.765+0000 7f505bfff700 1 -- 172.21.15.123:0/2182092160 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5064050930 con 0x7f50740b3990 2024-09-13T17:07:16.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.937+0000 7f507883e700 1 -- 172.21.15.123:0/2182092160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f507406c190 con 0x7f50740b3990 2024-09-13T17:07:16.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.937+0000 7f505bfff700 1 -- 172.21.15.123:0/2182092160 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5064053f50 con 0x7f50740b3990 2024-09-13T17:07:16.944 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:07:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.941+0000 7f507883e700 1 -- 172.21.15.123:0/2182092160 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5060066730 msgr2=0x7f5060068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.941+0000 7f507883e700 1 --2- 172.21.15.123:0/2182092160 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5060066730 0x7f5060068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f50680090b0 tx=0x7f5068008030 comp rx=0 tx=0).stop 2024-09-13T17:07:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.941+0000 7f507883e700 1 -- 172.21.15.123:0/2182092160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50740b3990 msgr2=0x7f50741f67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.941+0000 7f507883e700 1 --2- 172.21.15.123:0/2182092160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50740b3990 0x7f50741f67b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f506400c700 tx=0x7f506400ca10 comp rx=0 tx=0).stop 2024-09-13T17:07:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.941+0000 7f507883e700 1 -- 172.21.15.123:0/2182092160 shutdown_connections 2024-09-13T17:07:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.941+0000 7f507883e700 1 --2- 172.21.15.123:0/2182092160 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5060066730 0x7f5060068bf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.941+0000 7f507883e700 1 --2- 172.21.15.123:0/2182092160 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f507415a2f0 0x7f5074154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.941+0000 7f507883e700 1 --2- 172.21.15.123:0/2182092160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50740cb070 0x7f50740b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.941+0000 7f507883e700 1 --2- 172.21.15.123:0/2182092160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50740b3990 0x7f50741f67b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.941+0000 7f507883e700 1 -- 172.21.15.123:0/2182092160 >> 172.21.15.123:0/2182092160 conn(0x7f50740b01d0 msgr2=0x7f50740ae000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.941+0000 7f507883e700 1 -- 172.21.15.123:0/2182092160 shutdown_connections 2024-09-13T17:07:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:16.941+0000 7f507883e700 1 -- 172.21.15.123:0/2182092160 wait complete. 2024-09-13T17:07:16.974 INFO:tasks.cephfs_test_runner:Starting test: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) test: 2024-09-13T17:07:16.974 INFO:tasks.cephfs_test_runner:test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2024-09-13T17:07:16.975 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:17.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.081+0000 7f83fb193700 1 Processor -- start 2024-09-13T17:07:17.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.081+0000 7f83fb193700 1 -- start start 2024-09-13T17:07:17.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83fb193700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83f40cf470 0x7f83f415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83fb193700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f83f415ab80 0x7f83f415da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83fb193700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f415a6f0 con 0x7f83f40add70 2024-09-13T17:07:17.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83fb193700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f4159ed0 con 0x7f83f40cf470 2024-09-13T17:07:17.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83fb193700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f415df40 con 0x7f83f415ab80 2024-09-13T17:07:17.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83f3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83f40cf470 0x7f83f415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83f3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83f40cf470 0x7f83f415d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56998/0 (socket says 172.21.15.123:56998) 2024-09-13T17:07:17.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83f3fff700 1 -- 172.21.15.123:0/3332370462 learned_addr learned my addr 172.21.15.123:0/3332370462 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:17.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83f9730700 1 --2- 172.21.15.123:0/3332370462 >> v2:172.21.15.153:3300/0 conn(0x7f83f415ab80 0x7f83f415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83f3fff700 1 -- 172.21.15.123:0/3332370462 >> v2:172.21.15.153:3300/0 conn(0x7f83f415ab80 msgr2=0x7f83f415da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:17.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83f3fff700 1 --2- 172.21.15.123:0/3332370462 >> v2:172.21.15.153:3300/0 conn(0x7f83f415ab80 0x7f83f415da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83f3fff700 1 -- 172.21.15.123:0/3332370462 >> v1:172.21.15.153:6789/0 conn(0x7f83f40add70 legacy=0x7f83f40ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83f3fff700 1 -- 172.21.15.123:0/3332370462 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f415a0c0 con 0x7f83f40cf470 2024-09-13T17:07:17.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83f3fff700 1 --2- 172.21.15.123:0/3332370462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83f40cf470 0x7f83f415d4c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f83f406cd70 tx=0x7f83e4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b2f06bf6c273c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83f37fe700 1 -- 172.21.15.123:0/3332370462 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4011830 con 0x7f83f40cf470 2024-09-13T17:07:17.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83f37fe700 1 -- 172.21.15.123:0/3332370462 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e4011990 con 0x7f83f40cf470 2024-09-13T17:07:17.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83f37fe700 1 -- 172.21.15.123:0/3332370462 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4011d20 con 0x7f83f40cf470 2024-09-13T17:07:17.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83fb193700 1 -- 172.21.15.123:0/3332370462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83f40cf470 msgr2=0x7f83f415d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83fb193700 1 --2- 172.21.15.123:0/3332370462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83f40cf470 0x7f83f415d4c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f83f406cd70 tx=0x7f83e4009bf0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83fb193700 1 -- 172.21.15.123:0/3332370462 shutdown_connections 2024-09-13T17:07:17.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83fb193700 1 --2- 172.21.15.123:0/3332370462 >> v2:172.21.15.153:3300/0 conn(0x7f83f415ab80 0x7f83f415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83fb193700 1 --2- 172.21.15.123:0/3332370462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83f40cf470 0x7f83f415d4c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83fb193700 1 -- 172.21.15.123:0/3332370462 >> 172.21.15.123:0/3332370462 conn(0x7f83f4066570 msgr2=0x7f83f4066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:17.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83fb193700 1 -- 172.21.15.123:0/3332370462 shutdown_connections 2024-09-13T17:07:17.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.085+0000 7f83fb193700 1 -- 172.21.15.123:0/3332370462 wait complete. 2024-09-13T17:07:17.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83fb193700 1 Processor -- start 2024-09-13T17:07:17.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83fb193700 1 -- start start 2024-09-13T17:07:17.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83fb193700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83f40add70 0x7f83f4146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83fb193700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83f415ab80 0x7f83f40af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83fb193700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83f40afc20 0x7f83f40b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83fb193700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f415dbb0 con 0x7f83f415ab80 2024-09-13T17:07:17.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83fb193700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f415d610 con 0x7f83f40add70 2024-09-13T17:07:17.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83fb193700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f40b0dd0 con 0x7f83f40afc20 2024-09-13T17:07:17.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83f3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83f415ab80 0x7f83f40af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83f3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83f415ab80 0x7f83f40af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57006/0 (socket says 172.21.15.123:57006) 2024-09-13T17:07:17.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83f3fff700 1 -- 172.21.15.123:0/1123212493 learned_addr learned my addr 172.21.15.123:0/1123212493 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:17.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83f9730700 1 --2- 172.21.15.123:0/1123212493 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83f40afc20 0x7f83f40b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83f8f2f700 1 --2- 172.21.15.123:0/1123212493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83f40add70 0x7f83f4146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83f3fff700 1 -- 172.21.15.123:0/1123212493 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83f40afc20 msgr2=0x7f83f40b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83f3fff700 1 --2- 172.21.15.123:0/1123212493 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83f40afc20 0x7f83f40b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83f3fff700 1 -- 172.21.15.123:0/1123212493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83f40add70 msgr2=0x7f83f4146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83f3fff700 1 --2- 172.21.15.123:0/1123212493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83f40add70 0x7f83f4146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83f3fff700 1 -- 172.21.15.123:0/1123212493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e4009570 con 0x7f83f415ab80 2024-09-13T17:07:17.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83f3fff700 1 --2- 172.21.15.123:0/1123212493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83f415ab80 0x7f83f40af200 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f83e4013000 tx=0x7f83e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83f17fa700 1 -- 172.21.15.123:0/1123212493 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40044d0 con 0x7f83f415ab80 2024-09-13T17:07:17.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83f17fa700 1 -- 172.21.15.123:0/1123212493 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e401f070 con 0x7f83f415ab80 2024-09-13T17:07:17.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83fb193700 1 -- 172.21.15.123:0/1123212493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f40b10b0 con 0x7f83f415ab80 2024-09-13T17:07:17.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83f17fa700 1 -- 172.21.15.123:0/1123212493 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40038c0 con 0x7f83f415ab80 2024-09-13T17:07:17.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83fb193700 1 -- 172.21.15.123:0/1123212493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f40af740 con 0x7f83f415ab80 2024-09-13T17:07:17.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.089+0000 7f83fb193700 1 -- 172.21.15.123:0/1123212493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f406de40 con 0x7f83f415ab80 2024-09-13T17:07:17.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.093+0000 7f83f17fa700 1 -- 172.21.15.123:0/1123212493 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f83e4003a20 con 0x7f83f415ab80 2024-09-13T17:07:17.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.093+0000 7f83f17fa700 1 --2- 172.21.15.123:0/1123212493 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f83d4066760 0x7f83d4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.093+0000 7f83f17fa700 1 -- 172.21.15.123:0/1123212493 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83e4021070 con 0x7f83f415ab80 2024-09-13T17:07:17.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.093+0000 7f83f8f2f700 1 --2- 172.21.15.123:0/1123212493 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f83d4066760 0x7f83d4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.093+0000 7f83f8f2f700 1 --2- 172.21.15.123:0/1123212493 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f83d4066760 0x7f83d4068c20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f83dc000f60 tx=0x7f83dc009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.101+0000 7f83f17fa700 1 -- 172.21.15.123:0/1123212493 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83e4052860 con 0x7f83f415ab80 2024-09-13T17:07:17.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.269+0000 7f83fb193700 1 -- 172.21.15.123:0/1123212493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83f4152a50 con 0x7f83f415ab80 2024-09-13T17:07:17.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.273+0000 7f83f17fa700 1 -- 172.21.15.123:0/1123212493 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f83e4055e80 con 0x7f83f415ab80 2024-09-13T17:07:17.279 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:17.279 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:17.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.273+0000 7f83fb193700 1 -- 172.21.15.123:0/1123212493 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f83d4066760 msgr2=0x7f83d4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.273+0000 7f83fb193700 1 --2- 172.21.15.123:0/1123212493 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f83d4066760 0x7f83d4068c20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f83dc000f60 tx=0x7f83dc009040 comp rx=0 tx=0).stop 2024-09-13T17:07:17.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.273+0000 7f83fb193700 1 -- 172.21.15.123:0/1123212493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83f415ab80 msgr2=0x7f83f40af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.273+0000 7f83fb193700 1 --2- 172.21.15.123:0/1123212493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83f415ab80 0x7f83f40af200 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f83e4013000 tx=0x7f83e4004770 comp rx=0 tx=0).stop 2024-09-13T17:07:17.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.273+0000 7f83fb193700 1 -- 172.21.15.123:0/1123212493 shutdown_connections 2024-09-13T17:07:17.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.273+0000 7f83fb193700 1 --2- 172.21.15.123:0/1123212493 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f83d4066760 0x7f83d4068c20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.273+0000 7f83fb193700 1 --2- 172.21.15.123:0/1123212493 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f83f40afc20 0x7f83f40b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.273+0000 7f83fb193700 1 --2- 172.21.15.123:0/1123212493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83f415ab80 0x7f83f40af200 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.273+0000 7f83fb193700 1 --2- 172.21.15.123:0/1123212493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83f40add70 0x7f83f4146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.273+0000 7f83fb193700 1 -- 172.21.15.123:0/1123212493 >> 172.21.15.123:0/1123212493 conn(0x7f83f4066570 msgr2=0x7f83f4070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:17.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.273+0000 7f83fb193700 1 -- 172.21.15.123:0/1123212493 shutdown_connections 2024-09-13T17:07:17.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.273+0000 7f83fb193700 1 -- 172.21.15.123:0/1123212493 wait complete. 2024-09-13T17:07:17.294 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:17.294 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:17.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.405+0000 7f6b7e24c700 1 Processor -- start 2024-09-13T17:07:17.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.405+0000 7f6b7e24c700 1 -- start start 2024-09-13T17:07:17.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.405+0000 7f6b7e24c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b780cb7e0 0x7f6b780c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.405+0000 7f6b7e24c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6b7806bdb0 0x7f6b78071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.405+0000 7f6b7e24c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b780ca750 con 0x7f6b780c1480 2024-09-13T17:07:17.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.405+0000 7f6b7e24c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b780c9210 con 0x7f6b7806bdb0 2024-09-13T17:07:17.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.405+0000 7f6b7e24c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b781617b0 con 0x7f6b780cb7e0 2024-09-13T17:07:17.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.405+0000 7f6b7ca49700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6b7806bdb0 0x7f6b78071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.405+0000 7f6b7da4b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6b780c1480 0x7f6b780706a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56078/0 (socket says 172.21.15.123:56078) 2024-09-13T17:07:17.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.405+0000 7f6b7da4b700 1 -- 172.21.15.123:0/2366552718 learned_addr learned my addr 172.21.15.123:0/2366552718 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:17.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.405+0000 7f6b7d24a700 1 --2- 172.21.15.123:0/2366552718 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b780cb7e0 0x7f6b780c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.405+0000 7f6b77fff700 1 -- 172.21.15.123:0/2366552718 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959165574 0 0) 0x7f6b780ca750 con 0x7f6b780c1480 2024-09-13T17:07:17.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.405+0000 7f6b77fff700 1 -- 172.21.15.123:0/2366552718 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b600035d0 con 0x7f6b780c1480 2024-09-13T17:07:17.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b7ca49700 1 -- 172.21.15.123:0/2366552718 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b780cb7e0 msgr2=0x7f6b780c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:17.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b7ca49700 1 --2- 172.21.15.123:0/2366552718 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b780cb7e0 0x7f6b780c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b7ca49700 1 -- 172.21.15.123:0/2366552718 >> v1:172.21.15.123:6789/0 conn(0x7f6b780c1480 legacy=0x7f6b780706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b7ca49700 1 -- 172.21.15.123:0/2366552718 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780cbbc0 con 0x7f6b7806bdb0 2024-09-13T17:07:17.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b7ca49700 1 --2- 172.21.15.123:0/2366552718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b7806bdb0 0x7f6b78071b50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009850 tx=0x7f6b68009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b0a0173cfc5f4c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b77fff700 1 -- 172.21.15.123:0/2366552718 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68011830 con 0x7f6b7806bdb0 2024-09-13T17:07:17.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b77fff700 1 -- 172.21.15.123:0/2366552718 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b68011990 con 0x7f6b7806bdb0 2024-09-13T17:07:17.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b77fff700 1 -- 172.21.15.123:0/2366552718 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68011d40 con 0x7f6b7806bdb0 2024-09-13T17:07:17.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b7e24c700 1 -- 172.21.15.123:0/2366552718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b7806bdb0 msgr2=0x7f6b78071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b7e24c700 1 --2- 172.21.15.123:0/2366552718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b7806bdb0 0x7f6b78071b50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009850 tx=0x7f6b68009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:17.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b7e24c700 1 -- 172.21.15.123:0/2366552718 shutdown_connections 2024-09-13T17:07:17.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b7e24c700 1 --2- 172.21.15.123:0/2366552718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b7806bdb0 0x7f6b78071b50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b7e24c700 1 --2- 172.21.15.123:0/2366552718 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b780cb7e0 0x7f6b780c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b7e24c700 1 -- 172.21.15.123:0/2366552718 >> 172.21.15.123:0/2366552718 conn(0x7f6b780b01d0 msgr2=0x7f6b780b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:17.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b7e24c700 1 -- 172.21.15.123:0/2366552718 shutdown_connections 2024-09-13T17:07:17.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.409+0000 7f6b7e24c700 1 -- 172.21.15.123:0/2366552718 wait complete. 2024-09-13T17:07:17.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7e24c700 1 Processor -- start 2024-09-13T17:07:17.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7e24c700 1 -- start start 2024-09-13T17:07:17.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7e24c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b7806bdb0 0x7f6b780c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7e24c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b780c1480 0x7f6b780c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7e24c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b780cb7e0 0x7f6b781fa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7e24c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780c2ab0 con 0x7f6b7806bdb0 2024-09-13T17:07:17.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7e24c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780b2520 con 0x7f6b780c1480 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7e24c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780c5110 con 0x7f6b780cb7e0 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7d24a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b7806bdb0 0x7f6b780c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7d24a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b7806bdb0 0x7f6b780c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57034/0 (socket says 172.21.15.123:57034) 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7d24a700 1 -- 172.21.15.123:0/1426494077 learned_addr learned my addr 172.21.15.123:0/1426494077 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7da4b700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b780cb7e0 0x7f6b781fa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7ca49700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b780c1480 0x7f6b780c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7d24a700 1 -- 172.21.15.123:0/1426494077 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b780cb7e0 msgr2=0x7f6b781fa0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7d24a700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b780cb7e0 0x7f6b781fa0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7d24a700 1 -- 172.21.15.123:0/1426494077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b780c1480 msgr2=0x7f6b780c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7d24a700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b780c1480 0x7f6b780c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7d24a700 1 -- 172.21.15.123:0/1426494077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b680094b0 con 0x7f6b7806bdb0 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7da4b700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b780cb7e0 0x7f6b781fa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7ca49700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b780c1480 0x7f6b780c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:17.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b7d24a700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b7806bdb0 0x7f6b780c4a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00e9d0 tx=0x7f6b6c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.413+0000 7f6b75ffb700 1 -- 172.21.15.123:0/1426494077 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c009720 con 0x7f6b7806bdb0 2024-09-13T17:07:17.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.417+0000 7f6b75ffb700 1 -- 172.21.15.123:0/1426494077 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c00c850 con 0x7f6b7806bdb0 2024-09-13T17:07:17.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.417+0000 7f6b7e24c700 1 -- 172.21.15.123:0/1426494077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b780c53f0 con 0x7f6b7806bdb0 2024-09-13T17:07:17.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.417+0000 7f6b75ffb700 1 -- 172.21.15.123:0/1426494077 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c00cbc0 con 0x7f6b7806bdb0 2024-09-13T17:07:17.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.417+0000 7f6b7e24c700 1 -- 172.21.15.123:0/1426494077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b780b2aa0 con 0x7f6b7806bdb0 2024-09-13T17:07:17.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.417+0000 7f6b7e24c700 1 -- 172.21.15.123:0/1426494077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b780c8cd0 con 0x7f6b7806bdb0 2024-09-13T17:07:17.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.417+0000 7f6b75ffb700 1 -- 172.21.15.123:0/1426494077 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6b6c00cd20 con 0x7f6b7806bdb0 2024-09-13T17:07:17.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.417+0000 7f6b75ffb700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6b64066730 0x7f6b64068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.417+0000 7f6b75ffb700 1 -- 172.21.15.123:0/1426494077 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b6c0842f0 con 0x7f6b7806bdb0 2024-09-13T17:07:17.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.417+0000 7f6b7ca49700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6b64066730 0x7f6b64068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.417+0000 7f6b7ca49700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6b64066730 0x7f6b64068bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009850 tx=0x7f6b68008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.425+0000 7f6b75ffb700 1 -- 172.21.15.123:0/1426494077 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6b6c051660 con 0x7f6b7806bdb0 2024-09-13T17:07:17.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.601+0000 7f6b7e24c700 1 -- 172.21.15.123:0/1426494077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b781649d0 con 0x7f6b7806bdb0 2024-09-13T17:07:17.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.601+0000 7f6b75ffb700 1 -- 172.21.15.123:0/1426494077 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b6c054c80 con 0x7f6b7806bdb0 2024-09-13T17:07:17.608 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:17.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.605+0000 7f6b7e24c700 1 -- 172.21.15.123:0/1426494077 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6b64066730 msgr2=0x7f6b64068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.605+0000 7f6b7e24c700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6b64066730 0x7f6b64068bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009850 tx=0x7f6b68008030 comp rx=0 tx=0).stop 2024-09-13T17:07:17.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.605+0000 7f6b7e24c700 1 -- 172.21.15.123:0/1426494077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b7806bdb0 msgr2=0x7f6b780c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.605+0000 7f6b7e24c700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b7806bdb0 0x7f6b780c4a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00e9d0 tx=0x7f6b6c00ed90 comp rx=0 tx=0).stop 2024-09-13T17:07:17.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.605+0000 7f6b7e24c700 1 -- 172.21.15.123:0/1426494077 shutdown_connections 2024-09-13T17:07:17.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.605+0000 7f6b7e24c700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6b64066730 0x7f6b64068bf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.605+0000 7f6b7e24c700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b780cb7e0 0x7f6b781fa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.605+0000 7f6b7e24c700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b780c1480 0x7f6b780c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.605+0000 7f6b7e24c700 1 --2- 172.21.15.123:0/1426494077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b7806bdb0 0x7f6b780c4a10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.605+0000 7f6b7e24c700 1 -- 172.21.15.123:0/1426494077 >> 172.21.15.123:0/1426494077 conn(0x7f6b780b01d0 msgr2=0x7f6b78163950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:17.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.605+0000 7f6b7e24c700 1 -- 172.21.15.123:0/1426494077 shutdown_connections 2024-09-13T17:07:17.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.605+0000 7f6b7e24c700 1 -- 172.21.15.123:0/1426494077 wait complete. 2024-09-13T17:07:17.626 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:07:17.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872f9b9700 1 Processor -- start 2024-09-13T17:07:17.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872f9b9700 1 -- start start 2024-09-13T17:07:17.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872f9b9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87280d0010 0x7f87280cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872f9b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f872806a260 0x7f87280b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872f9b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872806ba70 con 0x7f8728142a30 2024-09-13T17:07:17.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872f9b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872806b650 con 0x7f872806a260 2024-09-13T17:07:17.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872f9b9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8728142e10 con 0x7f87280d0010 2024-09-13T17:07:17.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872cf54700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87280d0010 0x7f87280cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872df56700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f872806a260 0x7f87280b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872df56700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f872806a260 0x7f87280b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:48232/0 (socket says 172.21.15.123:48232) 2024-09-13T17:07:17.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872cf54700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87280d0010 0x7f87280cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:36408/0 (socket says 172.21.15.123:36408) 2024-09-13T17:07:17.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872df56700 1 -- 172.21.15.123:0/80771607 learned_addr learned my addr 172.21.15.123:0/80771607 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:17.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872d755700 1 --1- 172.21.15.123:0/80771607 >> v1:172.21.15.153:6789/0 conn(0x7f8728142a30 0x7f87280cf900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:37878/0 (socket says 172.21.15.123:37878) 2024-09-13T17:07:17.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872df56700 1 -- 172.21.15.123:0/80771607 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87280d0010 msgr2=0x7f87280cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:17.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872df56700 1 --2- 172.21.15.123:0/80771607 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87280d0010 0x7f87280cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872df56700 1 -- 172.21.15.123:0/80771607 >> v1:172.21.15.153:6789/0 conn(0x7f8728142a30 legacy=0x7f87280cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872df56700 1 -- 172.21.15.123:0/80771607 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872806a9d0 con 0x7f872806a260 2024-09-13T17:07:17.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f872df56700 1 --2- 172.21.15.123:0/80771607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872806a260 0x7f87280b2a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8720009e50 tx=0x7f872000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c0f10ff120e6943 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.737+0000 7f871ffff700 1 -- 172.21.15.123:0/80771607 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872000e070 con 0x7f872806a260 2024-09-13T17:07:17.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f871ffff700 1 -- 172.21.15.123:0/80771607 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872000b910 con 0x7f872806a260 2024-09-13T17:07:17.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f871ffff700 1 -- 172.21.15.123:0/80771607 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872000bcc0 con 0x7f872806a260 2024-09-13T17:07:17.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 -- 172.21.15.123:0/80771607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872806a260 msgr2=0x7f87280b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 --2- 172.21.15.123:0/80771607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872806a260 0x7f87280b2a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8720009e50 tx=0x7f872000b330 comp rx=0 tx=0).stop 2024-09-13T17:07:17.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 -- 172.21.15.123:0/80771607 shutdown_connections 2024-09-13T17:07:17.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 --2- 172.21.15.123:0/80771607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872806a260 0x7f87280b2a00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 --2- 172.21.15.123:0/80771607 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87280d0010 0x7f87280cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 -- 172.21.15.123:0/80771607 >> 172.21.15.123:0/80771607 conn(0x7f87280b1700 msgr2=0x7f87280b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:17.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 -- 172.21.15.123:0/80771607 shutdown_connections 2024-09-13T17:07:17.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 -- 172.21.15.123:0/80771607 wait complete. 2024-09-13T17:07:17.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 Processor -- start 2024-09-13T17:07:17.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 -- start start 2024-09-13T17:07:17.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f872806a260 0x7f87280c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87280d0010 0x7f87280c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8728142a30 0x7f8728159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87280c9330 con 0x7f872806a260 2024-09-13T17:07:17.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87280c8720 con 0x7f87280d0010 2024-09-13T17:07:17.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.741+0000 7f872f9b9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87280c8a00 con 0x7f8728142a30 2024-09-13T17:07:17.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872cf54700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87280d0010 0x7f87280c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872df56700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8728142a30 0x7f8728159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872d755700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f872806a260 0x7f87280c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872cf54700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87280d0010 0x7f87280c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:48246/0 (socket says 172.21.15.123:48246) 2024-09-13T17:07:17.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872df56700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8728142a30 0x7f8728159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:36424/0 (socket says 172.21.15.123:36424) 2024-09-13T17:07:17.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872cf54700 1 -- 172.21.15.123:0/2954594511 learned_addr learned my addr 172.21.15.123:0/2954594511 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:17.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872df56700 1 -- 172.21.15.123:0/2954594511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87280d0010 msgr2=0x7f87280c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872df56700 1 --2- 172.21.15.123:0/2954594511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87280d0010 0x7f87280c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872df56700 1 -- 172.21.15.123:0/2954594511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f872806a260 msgr2=0x7f87280c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872df56700 1 --2- 172.21.15.123:0/2954594511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f872806a260 0x7f87280c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872df56700 1 -- 172.21.15.123:0/2954594511 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8720009b30 con 0x7f8728142a30 2024-09-13T17:07:17.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872cf54700 1 --2- 172.21.15.123:0/2954594511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87280d0010 0x7f87280c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:17.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872df56700 1 --2- 172.21.15.123:0/2954594511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8728142a30 0x7f8728159fe0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8720015000 tx=0x7f8720004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f871dffb700 1 -- 172.21.15.123:0/2954594511 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720004800 con 0x7f8728142a30 2024-09-13T17:07:17.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f871dffb700 1 -- 172.21.15.123:0/2954594511 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87200099b0 con 0x7f8728142a30 2024-09-13T17:07:17.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872f9b9700 1 -- 172.21.15.123:0/2954594511 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87280c8ce0 con 0x7f8728142a30 2024-09-13T17:07:17.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f871dffb700 1 -- 172.21.15.123:0/2954594511 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872001c680 con 0x7f8728142a30 2024-09-13T17:07:17.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872f9b9700 1 -- 172.21.15.123:0/2954594511 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87280c58e0 con 0x7f8728142a30 2024-09-13T17:07:17.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.745+0000 7f872f9b9700 1 -- 172.21.15.123:0/2954594511 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87280c94a0 con 0x7f8728142a30 2024-09-13T17:07:17.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.749+0000 7f871dffb700 1 -- 172.21.15.123:0/2954594511 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f872001c7e0 con 0x7f8728142a30 2024-09-13T17:07:17.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.749+0000 7f871dffb700 1 --2- 172.21.15.123:0/2954594511 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f870c066730 0x7f870c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:17.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.749+0000 7f872d755700 1 --2- 172.21.15.123:0/2954594511 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f870c066730 0x7f870c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:17.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.749+0000 7f871dffb700 1 -- 172.21.15.123:0/2954594511 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8720085960 con 0x7f8728142a30 2024-09-13T17:07:17.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.749+0000 7f872d755700 1 --2- 172.21.15.123:0/2954594511 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f870c066730 0x7f870c068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8718000f60 tx=0x7f8718007ef0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:17.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.757+0000 7f871dffb700 1 -- 172.21.15.123:0/2954594511 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8720052d60 con 0x7f8728142a30 2024-09-13T17:07:17.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.925+0000 7f872f9b9700 1 -- 172.21.15.123:0/2954594511 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87280cda30 con 0x7f8728142a30 2024-09-13T17:07:17.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.929+0000 7f871dffb700 1 -- 172.21.15.123:0/2954594511 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8720056380 con 0x7f8728142a30 2024-09-13T17:07:17.935 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:07:17.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.929+0000 7f872f9b9700 1 -- 172.21.15.123:0/2954594511 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f870c066730 msgr2=0x7f870c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.929+0000 7f872f9b9700 1 --2- 172.21.15.123:0/2954594511 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f870c066730 0x7f870c068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8718000f60 tx=0x7f8718007ef0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.929+0000 7f872f9b9700 1 -- 172.21.15.123:0/2954594511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8728142a30 msgr2=0x7f8728159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:17.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.929+0000 7f872f9b9700 1 --2- 172.21.15.123:0/2954594511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8728142a30 0x7f8728159fe0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8720015000 tx=0x7f8720004af0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.929+0000 7f872f9b9700 1 -- 172.21.15.123:0/2954594511 shutdown_connections 2024-09-13T17:07:17.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.929+0000 7f872f9b9700 1 --2- 172.21.15.123:0/2954594511 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f870c066730 0x7f870c068bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.929+0000 7f872f9b9700 1 --2- 172.21.15.123:0/2954594511 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8728142a30 0x7f8728159fe0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.929+0000 7f872f9b9700 1 --2- 172.21.15.123:0/2954594511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87280d0010 0x7f87280c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.929+0000 7f872f9b9700 1 --2- 172.21.15.123:0/2954594511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f872806a260 0x7f87280c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:17.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.929+0000 7f872f9b9700 1 -- 172.21.15.123:0/2954594511 >> 172.21.15.123:0/2954594511 conn(0x7f87280b1700 msgr2=0x7f87280b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:17.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.929+0000 7f872f9b9700 1 -- 172.21.15.123:0/2954594511 shutdown_connections 2024-09-13T17:07:17.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:17.929+0000 7f872f9b9700 1 -- 172.21.15.123:0/2954594511 wait complete. 2024-09-13T17:07:17.950 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:07:18.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 Processor -- start 2024-09-13T17:07:18.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 -- start start 2024-09-13T17:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19d00cb7e0 0x7f19d00c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f19d006bdb0 0x7f19d0071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d00ca750 con 0x7f19d00c1480 2024-09-13T17:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d00c9210 con 0x7f19d006bdb0 2024-09-13T17:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d01617b0 con 0x7f19d00cb7e0 2024-09-13T17:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19ceffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f19d006bdb0 0x7f19d0071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19ceffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f19d006bdb0 0x7f19d0071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57050/0 (socket says 172.21.15.123:57050) 2024-09-13T17:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19ceffd700 1 -- 172.21.15.123:0/346140463 learned_addr learned my addr 172.21.15.123:0/346140463 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19cf7fe700 1 --2- 172.21.15.123:0/346140463 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19d00cb7e0 0x7f19d00c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19ceffd700 1 -- 172.21.15.123:0/346140463 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19d00cb7e0 msgr2=0x7f19d00c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:18.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19ceffd700 1 --2- 172.21.15.123:0/346140463 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19d00cb7e0 0x7f19d00c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19ceffd700 1 -- 172.21.15.123:0/346140463 >> v1:172.21.15.153:6789/0 conn(0x7f19d00c1480 legacy=0x7f19d00706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19ceffd700 1 -- 172.21.15.123:0/346140463 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d00cbbc0 con 0x7f19d006bdb0 2024-09-13T17:07:18.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19cf7fe700 1 --2- 172.21.15.123:0/346140463 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19d00cb7e0 0x7f19d00c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:18.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19ceffd700 1 --2- 172.21.15.123:0/346140463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d006bdb0 0x7f19d0071b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009910 tx=0x7f19c4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22da41efc2d91d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:18.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19ce7fc700 1 -- 172.21.15.123:0/346140463 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c400ba60 con 0x7f19d006bdb0 2024-09-13T17:07:18.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19ce7fc700 1 -- 172.21.15.123:0/346140463 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c400bbc0 con 0x7f19d006bdb0 2024-09-13T17:07:18.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19ce7fc700 1 -- 172.21.15.123:0/346140463 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4009e60 con 0x7f19d006bdb0 2024-09-13T17:07:18.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 -- 172.21.15.123:0/346140463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d006bdb0 msgr2=0x7f19d0071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 --2- 172.21.15.123:0/346140463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d006bdb0 0x7f19d0071b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009910 tx=0x7f19c4009c20 comp rx=0 tx=0).stop 2024-09-13T17:07:18.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 -- 172.21.15.123:0/346140463 shutdown_connections 2024-09-13T17:07:18.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 --2- 172.21.15.123:0/346140463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d006bdb0 0x7f19d0071b50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 --2- 172.21.15.123:0/346140463 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19d00cb7e0 0x7f19d00c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 -- 172.21.15.123:0/346140463 >> 172.21.15.123:0/346140463 conn(0x7f19d00b01d0 msgr2=0x7f19d00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:18.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 -- 172.21.15.123:0/346140463 shutdown_connections 2024-09-13T17:07:18.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.061+0000 7f19d4e85700 1 -- 172.21.15.123:0/346140463 wait complete. 2024-09-13T17:07:18.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19d4e85700 1 Processor -- start 2024-09-13T17:07:18.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19d4e85700 1 -- start start 2024-09-13T17:07:18.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19d4e85700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d006bdb0 0x7f19d01f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19d4e85700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19d00c1480 0x7f19d0160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19d4e85700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d00cb7e0 0x7f19d00b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19d4e85700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00c36d0 con 0x7f19d00cb7e0 2024-09-13T17:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19d4e85700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d01f7ad0 con 0x7f19d006bdb0 2024-09-13T17:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19d4e85700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00c2ac0 con 0x7f19d00c1480 2024-09-13T17:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19cffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d00cb7e0 0x7f19d00b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19ceffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19d00c1480 0x7f19d0160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19cffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d00cb7e0 0x7f19d00b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57052/0 (socket says 172.21.15.123:57052) 2024-09-13T17:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19cffff700 1 -- 172.21.15.123:0/2217224807 learned_addr learned my addr 172.21.15.123:0/2217224807 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19cf7fe700 1 --2- 172.21.15.123:0/2217224807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d006bdb0 0x7f19d01f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19cffff700 1 -- 172.21.15.123:0/2217224807 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19d00c1480 msgr2=0x7f19d0160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19cffff700 1 --2- 172.21.15.123:0/2217224807 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19d00c1480 0x7f19d0160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19cffff700 1 -- 172.21.15.123:0/2217224807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d006bdb0 msgr2=0x7f19d01f7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19cffff700 1 --2- 172.21.15.123:0/2217224807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d006bdb0 0x7f19d01f7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19cffff700 1 -- 172.21.15.123:0/2217224807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c4009570 con 0x7f19d00cb7e0 2024-09-13T17:07:18.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19cffff700 1 --2- 172.21.15.123:0/2217224807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d00cb7e0 0x7f19d00b36a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f19c800cbc0 tx=0x7f19c800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:18.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19b7fff700 1 -- 172.21.15.123:0/2217224807 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8003c20 con 0x7f19d00cb7e0 2024-09-13T17:07:18.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19b7fff700 1 -- 172.21.15.123:0/2217224807 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c8003d80 con 0x7f19d00cb7e0 2024-09-13T17:07:18.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19d4e85700 1 -- 172.21.15.123:0/2217224807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d00c2da0 con 0x7f19d00cb7e0 2024-09-13T17:07:18.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19b7fff700 1 -- 172.21.15.123:0/2217224807 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c800aa20 con 0x7f19d00cb7e0 2024-09-13T17:07:18.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.065+0000 7f19d4e85700 1 -- 172.21.15.123:0/2217224807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d00c3360 con 0x7f19d00cb7e0 2024-09-13T17:07:18.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.069+0000 7f19d4e85700 1 -- 172.21.15.123:0/2217224807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d00c94d0 con 0x7f19d00cb7e0 2024-09-13T17:07:18.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.069+0000 7f19b7fff700 1 -- 172.21.15.123:0/2217224807 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f19c800ab80 con 0x7f19d00cb7e0 2024-09-13T17:07:18.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.069+0000 7f19b7fff700 1 --2- 172.21.15.123:0/2217224807 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f19bc066730 0x7f19bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.069+0000 7f19b7fff700 1 -- 172.21.15.123:0/2217224807 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19c8084b50 con 0x7f19d00cb7e0 2024-09-13T17:07:18.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.069+0000 7f19cf7fe700 1 --2- 172.21.15.123:0/2217224807 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f19bc066730 0x7f19bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.069+0000 7f19cf7fe700 1 --2- 172.21.15.123:0/2217224807 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f19bc066730 0x7f19bc068bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f19d00c5670 tx=0x7f19c0008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:18.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.077+0000 7f19b7fff700 1 -- 172.21.15.123:0/2217224807 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f19c8051ea0 con 0x7f19d00cb7e0 2024-09-13T17:07:18.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.241+0000 7f19d4e85700 1 -- 172.21.15.123:0/2217224807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19d00c8cd0 con 0x7f19d00cb7e0 2024-09-13T17:07:18.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.245+0000 7f19b7fff700 1 -- 172.21.15.123:0/2217224807 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19c8084030 con 0x7f19d00cb7e0 2024-09-13T17:07:18.250 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:07:18.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.245+0000 7f19d4e85700 1 -- 172.21.15.123:0/2217224807 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f19bc066730 msgr2=0x7f19bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.245+0000 7f19d4e85700 1 --2- 172.21.15.123:0/2217224807 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f19bc066730 0x7f19bc068bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f19d00c5670 tx=0x7f19c0008040 comp rx=0 tx=0).stop 2024-09-13T17:07:18.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.245+0000 7f19d4e85700 1 -- 172.21.15.123:0/2217224807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d00cb7e0 msgr2=0x7f19d00b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.245+0000 7f19d4e85700 1 --2- 172.21.15.123:0/2217224807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d00cb7e0 0x7f19d00b36a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f19c800cbc0 tx=0x7f19c800ced0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.245+0000 7f19d4e85700 1 -- 172.21.15.123:0/2217224807 shutdown_connections 2024-09-13T17:07:18.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.245+0000 7f19d4e85700 1 --2- 172.21.15.123:0/2217224807 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f19bc066730 0x7f19bc068bf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.245+0000 7f19d4e85700 1 --2- 172.21.15.123:0/2217224807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d00cb7e0 0x7f19d00b36a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.245+0000 7f19d4e85700 1 --2- 172.21.15.123:0/2217224807 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19d00c1480 0x7f19d0160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.245+0000 7f19d4e85700 1 --2- 172.21.15.123:0/2217224807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d006bdb0 0x7f19d01f7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.245+0000 7f19d4e85700 1 -- 172.21.15.123:0/2217224807 >> 172.21.15.123:0/2217224807 conn(0x7f19d00b01d0 msgr2=0x7f19d00af280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:18.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.245+0000 7f19d4e85700 1 -- 172.21.15.123:0/2217224807 shutdown_connections 2024-09-13T17:07:18.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.245+0000 7f19d4e85700 1 -- 172.21.15.123:0/2217224807 wait complete. 2024-09-13T17:07:18.265 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values' 2024-09-13T17:07:18.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.369+0000 7f28fb59e700 1 Processor -- start 2024-09-13T17:07:18.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.369+0000 7f28fb59e700 1 -- start start 2024-09-13T17:07:18.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.369+0000 7f28fb59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28fc160210 0x7f28fc0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.369+0000 7f28fb59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f28fc0cd100 0x7f28fc0b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.369+0000 7f28fb59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f28fc0b2000 0x7f28fc06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.369+0000 7f28fb59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc0b24b0 con 0x7f28fc0cd100 2024-09-13T17:07:18.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.369+0000 7f28fb59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc06cfb0 con 0x7f28fc0b2000 2024-09-13T17:07:18.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.369+0000 7f28fb59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc06d290 con 0x7f28fc160210 2024-09-13T17:07:18.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.369+0000 7f28f9d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f28fc0cd100 0x7f28fc0b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.369+0000 7f28f9d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f28fc0cd100 0x7f28fc0b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57066/0 (socket says 172.21.15.123:57066) 2024-09-13T17:07:18.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.369+0000 7f28f9d9b700 1 -- 172.21.15.123:0/897640397 learned_addr learned my addr 172.21.15.123:0/897640397 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:18.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28fa59c700 1 --2- 172.21.15.123:0/897640397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28fc160210 0x7f28fc0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.369+0000 7f28fad9d700 1 --2- 172.21.15.123:0/897640397 >> v2:172.21.15.153:3300/0 conn(0x7f28fc0b2000 0x7f28fc06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28f9d9b700 1 -- 172.21.15.123:0/897640397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28fc160210 msgr2=0x7f28fc0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:18.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28f9d9b700 1 --2- 172.21.15.123:0/897640397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28fc160210 0x7f28fc0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28f9d9b700 1 -- 172.21.15.123:0/897640397 >> v2:172.21.15.153:3300/0 conn(0x7f28fc0b2000 msgr2=0x7f28fc06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:18.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28f9d9b700 1 --2- 172.21.15.123:0/897640397 >> v2:172.21.15.153:3300/0 conn(0x7f28fc0b2000 0x7f28fc06f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28f9d9b700 1 -- 172.21.15.123:0/897640397 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc06d570 con 0x7f28fc0cd100 2024-09-13T17:07:18.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28fad9d700 1 --2- 172.21.15.123:0/897640397 >> v2:172.21.15.153:3300/0 conn(0x7f28fc0b2000 0x7f28fc06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:18.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28f9d9b700 1 --2- 172.21.15.123:0/897640397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28fc0cd100 0x7f28fc0b1ac0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f28fc072150 tx=0x7f28e4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fb12038acd63df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:18.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28f959a700 1 -- 172.21.15.123:0/897640397 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400b8a0 con 0x7f28fc0cd100 2024-09-13T17:07:18.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28f959a700 1 -- 172.21.15.123:0/897640397 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e400ba00 con 0x7f28fc0cd100 2024-09-13T17:07:18.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28f959a700 1 -- 172.21.15.123:0/897640397 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400bd90 con 0x7f28fc0cd100 2024-09-13T17:07:18.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28fb59e700 1 -- 172.21.15.123:0/897640397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28fc0cd100 msgr2=0x7f28fc0b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28fb59e700 1 --2- 172.21.15.123:0/897640397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28fc0cd100 0x7f28fc0b1ac0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f28fc072150 tx=0x7f28e4009bf0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28fb59e700 1 -- 172.21.15.123:0/897640397 shutdown_connections 2024-09-13T17:07:18.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28fb59e700 1 --2- 172.21.15.123:0/897640397 >> v2:172.21.15.153:3300/0 conn(0x7f28fc0b2000 0x7f28fc06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28fb59e700 1 --2- 172.21.15.123:0/897640397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28fc0cd100 0x7f28fc0b1ac0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28fb59e700 1 --2- 172.21.15.123:0/897640397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28fc160210 0x7f28fc0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28fb59e700 1 -- 172.21.15.123:0/897640397 >> 172.21.15.123:0/897640397 conn(0x7f28fc066570 msgr2=0x7f28fc066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:18.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28fb59e700 1 -- 172.21.15.123:0/897640397 shutdown_connections 2024-09-13T17:07:18.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28fb59e700 1 -- 172.21.15.123:0/897640397 wait complete. 2024-09-13T17:07:18.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28fb59e700 1 Processor -- start 2024-09-13T17:07:18.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.373+0000 7f28fb59e700 1 -- start start 2024-09-13T17:07:18.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fb59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28fc0b2000 0x7f28fc157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fb59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28fc0cd100 0x7f28fc142e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fb59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28fc160210 0x7f28fc0b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fb59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc1454b0 con 0x7f28fc160210 2024-09-13T17:07:18.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fb59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc149c00 con 0x7f28fc0cd100 2024-09-13T17:07:18.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fb59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc158250 con 0x7f28fc0b2000 2024-09-13T17:07:18.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28fc160210 0x7f28fc0b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28f9d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28fc0cd100 0x7f28fc142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fa59c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28fc0b2000 0x7f28fc157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28f9d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28fc0cd100 0x7f28fc142e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:48282/0 (socket says 172.21.15.123:48282) 2024-09-13T17:07:18.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28f9d9b700 1 -- 172.21.15.123:0/1743731012 learned_addr learned my addr 172.21.15.123:0/1743731012 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:18.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28fc160210 0x7f28fc0b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57068/0 (socket says 172.21.15.123:57068) 2024-09-13T17:07:18.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fad9d700 1 -- 172.21.15.123:0/1743731012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28fc0b2000 msgr2=0x7f28fc157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fad9d700 1 --2- 172.21.15.123:0/1743731012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28fc0b2000 0x7f28fc157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fad9d700 1 -- 172.21.15.123:0/1743731012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28fc0cd100 msgr2=0x7f28fc142e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fad9d700 1 --2- 172.21.15.123:0/1743731012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28fc0cd100 0x7f28fc142e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fad9d700 1 -- 172.21.15.123:0/1743731012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e4009570 con 0x7f28fc160210 2024-09-13T17:07:18.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fad9d700 1 --2- 172.21.15.123:0/1743731012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28fc160210 0x7f28fc0b0050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f28f400cdd0 tx=0x7f28f400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:18.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28f2ffd700 1 -- 172.21.15.123:0/1743731012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f400abe0 con 0x7f28fc160210 2024-09-13T17:07:18.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28f2ffd700 1 -- 172.21.15.123:0/1743731012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f400ad40 con 0x7f28fc160210 2024-09-13T17:07:18.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fb59e700 1 -- 172.21.15.123:0/1743731012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc143380 con 0x7f28fc160210 2024-09-13T17:07:18.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28f2ffd700 1 -- 172.21.15.123:0/1743731012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4015680 con 0x7f28fc160210 2024-09-13T17:07:18.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fb59e700 1 -- 172.21.15.123:0/1743731012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc1446f0 con 0x7f28fc160210 2024-09-13T17:07:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.377+0000 7f28fb59e700 1 -- 172.21.15.123:0/1743731012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc0677f0 con 0x7f28fc160210 2024-09-13T17:07:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.381+0000 7f28f2ffd700 1 -- 172.21.15.123:0/1743731012 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f28f400d430 con 0x7f28fc160210 2024-09-13T17:07:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.381+0000 7f28f2ffd700 1 --2- 172.21.15.123:0/1743731012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28dc066730 0x7f28dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.381+0000 7f28f2ffd700 1 -- 172.21.15.123:0/1743731012 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28f4084290 con 0x7f28fc160210 2024-09-13T17:07:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.381+0000 7f28fa59c700 1 --2- 172.21.15.123:0/1743731012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28dc066730 0x7f28dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.381+0000 7f28fa59c700 1 --2- 172.21.15.123:0/1743731012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28dc066730 0x7f28dc068bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f28ec006b40 tx=0x7f28ec008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:18.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.385+0000 7f28f2ffd700 1 -- 172.21.15.123:0/1743731012 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f28f4051690 con 0x7f28fc160210 2024-09-13T17:07:18.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.617+0000 7f28fb59e700 1 -- 172.21.15.123:0/1743731012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]} v 0) v1 -- 0x7f28fc072a10 con 0x7f28fc160210 2024-09-13T17:07:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.837+0000 7f28f2ffd700 1 -- 172.21.15.123:0/1743731012 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]}]=0 v51) v1 ==== 163+0+0 (secure 0 0 0) 0x7f28f4054cb0 con 0x7f28fc160210 2024-09-13T17:07:18.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.841+0000 7f28fb59e700 1 -- 172.21.15.123:0/1743731012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28dc066730 msgr2=0x7f28dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.841+0000 7f28fb59e700 1 --2- 172.21.15.123:0/1743731012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28dc066730 0x7f28dc068bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f28ec006b40 tx=0x7f28ec008040 comp rx=0 tx=0).stop 2024-09-13T17:07:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.841+0000 7f28fb59e700 1 -- 172.21.15.123:0/1743731012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28fc160210 msgr2=0x7f28fc0b0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.841+0000 7f28fb59e700 1 --2- 172.21.15.123:0/1743731012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28fc160210 0x7f28fc0b0050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f28f400cdd0 tx=0x7f28f400ce00 comp rx=0 tx=0).stop 2024-09-13T17:07:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.841+0000 7f28fb59e700 1 -- 172.21.15.123:0/1743731012 shutdown_connections 2024-09-13T17:07:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.841+0000 7f28fb59e700 1 --2- 172.21.15.123:0/1743731012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28dc066730 0x7f28dc068bf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.841+0000 7f28fb59e700 1 --2- 172.21.15.123:0/1743731012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28fc160210 0x7f28fc0b0050 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.841+0000 7f28fb59e700 1 --2- 172.21.15.123:0/1743731012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28fc0cd100 0x7f28fc142e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.841+0000 7f28fb59e700 1 --2- 172.21.15.123:0/1743731012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28fc0b2000 0x7f28fc157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.841+0000 7f28fb59e700 1 -- 172.21.15.123:0/1743731012 >> 172.21.15.123:0/1743731012 conn(0x7f28fc066570 msgr2=0x7f28fc0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.841+0000 7f28fb59e700 1 -- 172.21.15.123:0/1743731012 shutdown_connections 2024-09-13T17:07:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.841+0000 7f28fb59e700 1 -- 172.21.15.123:0/1743731012 wait complete. 2024-09-13T17:07:18.865 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T17:07:18.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.985+0000 7f70d96cd700 1 Processor -- start 2024-09-13T17:07:18.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.985+0000 7f70d96cd700 1 -- start start 2024-09-13T17:07:18.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.985+0000 7f70d96cd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f70d40cd2b0 0x7f70d415a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.985+0000 7f70d96cd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f70d40ceb70 0x7f70d415ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:18.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.985+0000 7f70d96cd700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d40cf740 con 0x7f70d40ce790 2024-09-13T17:07:18.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.985+0000 7f70d96cd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d40b61f0 con 0x7f70d40cd2b0 2024-09-13T17:07:18.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.985+0000 7f70d96cd700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d40cb2c0 con 0x7f70d40ceb70 2024-09-13T17:07:18.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.985+0000 7f70d37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f70d40cd2b0 0x7f70d415a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.985+0000 7f70d37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f70d40cd2b0 0x7f70d415a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57084/0 (socket says 172.21.15.123:57084) 2024-09-13T17:07:18.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.985+0000 7f70d37fe700 1 -- 172.21.15.123:0/2599888191 learned_addr learned my addr 172.21.15.123:0/2599888191 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:18.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.985+0000 7f70d8ecc700 1 --2- 172.21.15.123:0/2599888191 >> v2:172.21.15.153:3300/0 conn(0x7f70d40ceb70 0x7f70d415ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:18.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d37fe700 1 -- 172.21.15.123:0/2599888191 >> v2:172.21.15.153:3300/0 conn(0x7f70d40ceb70 msgr2=0x7f70d415ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:18.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d37fe700 1 --2- 172.21.15.123:0/2599888191 >> v2:172.21.15.153:3300/0 conn(0x7f70d40ceb70 0x7f70d415ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d37fe700 1 -- 172.21.15.123:0/2599888191 >> v1:172.21.15.153:6789/0 conn(0x7f70d40ce790 legacy=0x7f70d406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d37fe700 1 -- 172.21.15.123:0/2599888191 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d415b250 con 0x7f70d40cd2b0 2024-09-13T17:07:18.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d37fe700 1 --2- 172.21.15.123:0/2599888191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70d40cd2b0 0x7f70d415a7d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f70d40b6500 tx=0x7f70c4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d9cbd4ba45b145 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:18.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d2ffd700 1 -- 172.21.15.123:0/2599888191 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4011830 con 0x7f70d40cd2b0 2024-09-13T17:07:18.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d2ffd700 1 -- 172.21.15.123:0/2599888191 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c4011990 con 0x7f70d40cd2b0 2024-09-13T17:07:18.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d2ffd700 1 -- 172.21.15.123:0/2599888191 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4011d20 con 0x7f70d40cd2b0 2024-09-13T17:07:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d96cd700 1 -- 172.21.15.123:0/2599888191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70d40cd2b0 msgr2=0x7f70d415a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d96cd700 1 --2- 172.21.15.123:0/2599888191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70d40cd2b0 0x7f70d415a7d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f70d40b6500 tx=0x7f70c4009bf0 comp rx=0 tx=0).stop 2024-09-13T17:07:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d96cd700 1 -- 172.21.15.123:0/2599888191 shutdown_connections 2024-09-13T17:07:19.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d96cd700 1 --2- 172.21.15.123:0/2599888191 >> v2:172.21.15.153:3300/0 conn(0x7f70d40ceb70 0x7f70d415ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d96cd700 1 --2- 172.21.15.123:0/2599888191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70d40cd2b0 0x7f70d415a7d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d96cd700 1 -- 172.21.15.123:0/2599888191 >> 172.21.15.123:0/2599888191 conn(0x7f70d406e090 msgr2=0x7f70d406e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:19.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d96cd700 1 -- 172.21.15.123:0/2599888191 shutdown_connections 2024-09-13T17:07:19.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d96cd700 1 -- 172.21.15.123:0/2599888191 wait complete. 2024-09-13T17:07:19.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d96cd700 1 Processor -- start 2024-09-13T17:07:19.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.989+0000 7f70d96cd700 1 -- start start 2024-09-13T17:07:19.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d96cd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70d40cd2b0 0x7f70d4156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d96cd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70d40ce790 0x7f70d41f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d96cd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d40ceb70 0x7f70d40ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d96cd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d41f3b70 con 0x7f70d40ce790 2024-09-13T17:07:19.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d96cd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d41f3e50 con 0x7f70d40ceb70 2024-09-13T17:07:19.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d96cd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d41f4130 con 0x7f70d40cd2b0 2024-09-13T17:07:19.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70d40ce790 0x7f70d41f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70d40ce790 0x7f70d41f3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57088/0 (socket says 172.21.15.123:57088) 2024-09-13T17:07:19.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d37fe700 1 -- 172.21.15.123:0/3550096650 learned_addr learned my addr 172.21.15.123:0/3550096650 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:19.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d8ecc700 1 --2- 172.21.15.123:0/3550096650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d40ceb70 0x7f70d40ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d3fff700 1 --2- 172.21.15.123:0/3550096650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70d40cd2b0 0x7f70d4156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d37fe700 1 -- 172.21.15.123:0/3550096650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70d40cd2b0 msgr2=0x7f70d4156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d37fe700 1 --2- 172.21.15.123:0/3550096650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70d40cd2b0 0x7f70d4156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d37fe700 1 -- 172.21.15.123:0/3550096650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d40ceb70 msgr2=0x7f70d40ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d37fe700 1 --2- 172.21.15.123:0/3550096650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d40ceb70 0x7f70d40ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d37fe700 1 -- 172.21.15.123:0/3550096650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c4009570 con 0x7f70d40ce790 2024-09-13T17:07:19.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d37fe700 1 --2- 172.21.15.123:0/3550096650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70d40ce790 0x7f70d41f3190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f70d406dd80 tx=0x7f70c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:19.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d0ff9700 1 -- 172.21.15.123:0/3550096650 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4004450 con 0x7f70d40ce790 2024-09-13T17:07:19.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d0ff9700 1 -- 172.21.15.123:0/3550096650 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c401f070 con 0x7f70d40ce790 2024-09-13T17:07:19.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d96cd700 1 -- 172.21.15.123:0/3550096650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d41f4410 con 0x7f70d40ce790 2024-09-13T17:07:19.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d0ff9700 1 -- 172.21.15.123:0/3550096650 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4003900 con 0x7f70d40ce790 2024-09-13T17:07:19.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d96cd700 1 -- 172.21.15.123:0/3550096650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d4157240 con 0x7f70d40ce790 2024-09-13T17:07:19.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.993+0000 7f70d96cd700 1 -- 172.21.15.123:0/3550096650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d41f4930 con 0x7f70d40ce790 2024-09-13T17:07:19.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.997+0000 7f70d0ff9700 1 -- 172.21.15.123:0/3550096650 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f70c4003a60 con 0x7f70d40ce790 2024-09-13T17:07:19.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.997+0000 7f70d0ff9700 1 --2- 172.21.15.123:0/3550096650 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70b8066730 0x7f70b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.997+0000 7f70d3fff700 1 --2- 172.21.15.123:0/3550096650 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70b8066730 0x7f70b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.997+0000 7f70d0ff9700 1 -- 172.21.15.123:0/3550096650 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70c4021070 con 0x7f70d40ce790 2024-09-13T17:07:19.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:18.997+0000 7f70d3fff700 1 --2- 172.21.15.123:0/3550096650 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70b8066730 0x7f70b8068bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f70bc000f60 tx=0x7f70bc009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:19.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.005+0000 7f70d0ff9700 1 -- 172.21.15.123:0/3550096650 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f70d41f4930 con 0x7f70d40ce790 2024-09-13T17:07:19.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.173+0000 7f70d96cd700 1 -- 172.21.15.123:0/3550096650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f70d41f4930 con 0x7f70d40ce790 2024-09-13T17:07:19.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.181+0000 7f70d0ff9700 1 -- 172.21.15.123:0/3550096650 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f70d41f4930 con 0x7f70d40ce790 2024-09-13T17:07:19.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.185+0000 7f70d96cd700 1 -- 172.21.15.123:0/3550096650 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70b8066730 msgr2=0x7f70b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.185+0000 7f70d96cd700 1 --2- 172.21.15.123:0/3550096650 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70b8066730 0x7f70b8068bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f70bc000f60 tx=0x7f70bc009040 comp rx=0 tx=0).stop 2024-09-13T17:07:19.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.185+0000 7f70d96cd700 1 -- 172.21.15.123:0/3550096650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70d40ce790 msgr2=0x7f70d41f3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.185+0000 7f70d96cd700 1 --2- 172.21.15.123:0/3550096650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70d40ce790 0x7f70d41f3190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f70d406dd80 tx=0x7f70c4004770 comp rx=0 tx=0).stop 2024-09-13T17:07:19.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.185+0000 7f70d96cd700 1 -- 172.21.15.123:0/3550096650 shutdown_connections 2024-09-13T17:07:19.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.185+0000 7f70d96cd700 1 --2- 172.21.15.123:0/3550096650 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70b8066730 0x7f70b8068bf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.185+0000 7f70d96cd700 1 --2- 172.21.15.123:0/3550096650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d40ceb70 0x7f70d40ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.185+0000 7f70d96cd700 1 --2- 172.21.15.123:0/3550096650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70d40ce790 0x7f70d41f3190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.185+0000 7f70d96cd700 1 --2- 172.21.15.123:0/3550096650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70d40cd2b0 0x7f70d4156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.185+0000 7f70d96cd700 1 -- 172.21.15.123:0/3550096650 >> 172.21.15.123:0/3550096650 conn(0x7f70d406e090 msgr2=0x7f70d4070390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:19.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.185+0000 7f70d96cd700 1 -- 172.21.15.123:0/3550096650 shutdown_connections 2024-09-13T17:07:19.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.185+0000 7f70d96cd700 1 -- 172.21.15.123:0/3550096650 wait complete. 2024-09-13T17:07:19.203 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:07:19.203 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:07:19.217 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:07:19.240 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:07:19.240 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:07:19.240 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:07:19.264 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:07:19.265 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:07:19.272 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:19.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.377+0000 7f197daaa700 1 Processor -- start 2024-09-13T17:07:19.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.377+0000 7f197daaa700 1 -- start start 2024-09-13T17:07:19.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.377+0000 7f197daaa700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19781602d0 0x7f19780d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.377+0000 7f197daaa700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19780d0ea0 con 0x7f19780cf920 2024-09-13T17:07:19.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.377+0000 7f197daaa700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19780d0c70 con 0x7f19780d3680 2024-09-13T17:07:19.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.377+0000 7f197daaa700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19780ceab0 con 0x7f19781602d0 2024-09-13T17:07:19.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.377+0000 7f197d2a9700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f19780cf920 0x7f19780b59b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56080/0 (socket says 172.21.15.123:56080) 2024-09-13T17:07:19.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.377+0000 7f197d2a9700 1 -- 172.21.15.123:0/2630640866 learned_addr learned my addr 172.21.15.123:0/2630640866 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:19.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.377+0000 7f197caa8700 1 --2- 172.21.15.123:0/2630640866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19781602d0 0x7f19780d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.377+0000 7f19777fe700 1 -- 172.21.15.123:0/2630640866 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663744314 0 0) 0x7f19780d0ea0 con 0x7f19780cf920 2024-09-13T17:07:19.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.377+0000 7f19777fe700 1 -- 172.21.15.123:0/2630640866 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19580035d0 con 0x7f19780cf920 2024-09-13T17:07:19.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197caa8700 1 -- 172.21.15.123:0/2630640866 >> v1:172.21.15.153:6789/0 conn(0x7f19780d3680 legacy=0x7f19780cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197caa8700 1 -- 172.21.15.123:0/2630640866 >> v1:172.21.15.123:6789/0 conn(0x7f19780cf920 legacy=0x7f19780b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197caa8700 1 -- 172.21.15.123:0/2630640866 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19780cff00 con 0x7f19781602d0 2024-09-13T17:07:19.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197caa8700 1 --2- 172.21.15.123:0/2630640866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19781602d0 0x7f19780d0730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1960009880 tx=0x7f1960009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff96610255202a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:19.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f19777fe700 1 -- 172.21.15.123:0/2630640866 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960011830 con 0x7f19781602d0 2024-09-13T17:07:19.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f19777fe700 1 -- 172.21.15.123:0/2630640866 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1960011990 con 0x7f19781602d0 2024-09-13T17:07:19.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f19777fe700 1 -- 172.21.15.123:0/2630640866 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960011d00 con 0x7f19781602d0 2024-09-13T17:07:19.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 -- 172.21.15.123:0/2630640866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19781602d0 msgr2=0x7f19780d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 --2- 172.21.15.123:0/2630640866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19781602d0 0x7f19780d0730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1960009880 tx=0x7f1960009b90 comp rx=0 tx=0).stop 2024-09-13T17:07:19.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 -- 172.21.15.123:0/2630640866 shutdown_connections 2024-09-13T17:07:19.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 --2- 172.21.15.123:0/2630640866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19781602d0 0x7f19780d0730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 -- 172.21.15.123:0/2630640866 >> 172.21.15.123:0/2630640866 conn(0x7f19780d2b60 msgr2=0x7f19780d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:19.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 -- 172.21.15.123:0/2630640866 shutdown_connections 2024-09-13T17:07:19.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 -- 172.21.15.123:0/2630640866 wait complete. 2024-09-13T17:07:19.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 Processor -- start 2024-09-13T17:07:19.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 -- start start 2024-09-13T17:07:19.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19780cf920 0x7f19781f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19780d3680 0x7f19780c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19781602d0 0x7f19780b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197815b760 con 0x7f19780d3680 2024-09-13T17:07:19.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19780c7540 con 0x7f19780cf920 2024-09-13T17:07:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197daaa700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19780c6690 con 0x7f19781602d0 2024-09-13T17:07:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f1977fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19780d3680 0x7f19780c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f1977fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19780d3680 0x7f19780c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57104/0 (socket says 172.21.15.123:57104) 2024-09-13T17:07:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f1977fff700 1 -- 172.21.15.123:0/1300887646 learned_addr learned my addr 172.21.15.123:0/1300887646 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197caa8700 1 --2- 172.21.15.123:0/1300887646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19780cf920 0x7f19781f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.381+0000 7f197d2a9700 1 --2- 172.21.15.123:0/1300887646 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19781602d0 0x7f19780b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f1977fff700 1 -- 172.21.15.123:0/1300887646 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19781602d0 msgr2=0x7f19780b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f1977fff700 1 --2- 172.21.15.123:0/1300887646 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19781602d0 0x7f19780b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f1977fff700 1 -- 172.21.15.123:0/1300887646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19780cf920 msgr2=0x7f19781f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f1977fff700 1 --2- 172.21.15.123:0/1300887646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19780cf920 0x7f19781f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f1977fff700 1 -- 172.21.15.123:0/1300887646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19600094b0 con 0x7f19780d3680 2024-09-13T17:07:19.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f1977fff700 1 --2- 172.21.15.123:0/1300887646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19780d3680 0x7f19780c79d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f196800c530 tx=0x7f196800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:19.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f19757fa700 1 -- 172.21.15.123:0/1300887646 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19680052d0 con 0x7f19780d3680 2024-09-13T17:07:19.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f19757fa700 1 -- 172.21.15.123:0/1300887646 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1968005430 con 0x7f19780d3680 2024-09-13T17:07:19.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f197daaa700 1 -- 172.21.15.123:0/1300887646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19780c6930 con 0x7f19780d3680 2024-09-13T17:07:19.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f19757fa700 1 -- 172.21.15.123:0/1300887646 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19680055a0 con 0x7f19780d3680 2024-09-13T17:07:19.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f197daaa700 1 -- 172.21.15.123:0/1300887646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19780c6ef0 con 0x7f19780d3680 2024-09-13T17:07:19.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f197daaa700 1 -- 172.21.15.123:0/1300887646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19780d0390 con 0x7f19780d3680 2024-09-13T17:07:19.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f19757fa700 1 -- 172.21.15.123:0/1300887646 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f19680038e0 con 0x7f19780d3680 2024-09-13T17:07:19.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f19757fa700 1 --2- 172.21.15.123:0/1300887646 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f195c066730 0x7f195c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f197caa8700 1 --2- 172.21.15.123:0/1300887646 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f195c066730 0x7f195c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.385+0000 7f19757fa700 1 -- 172.21.15.123:0/1300887646 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1968083570 con 0x7f19780d3680 2024-09-13T17:07:19.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.389+0000 7f197caa8700 1 --2- 172.21.15.123:0/1300887646 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f195c066730 0x7f195c068bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f19600090b0 tx=0x7f1960010000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:19.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.397+0000 7f19757fa700 1 -- 172.21.15.123:0/1300887646 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1968050860 con 0x7f19780d3680 2024-09-13T17:07:19.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.569+0000 7f197daaa700 1 -- 172.21.15.123:0/1300887646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19780b3370 con 0x7f19780d3680 2024-09-13T17:07:19.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.573+0000 7f19757fa700 1 -- 172.21.15.123:0/1300887646 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f1968053e80 con 0x7f19780d3680 2024-09-13T17:07:19.578 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:19.579 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.573+0000 7f197daaa700 1 -- 172.21.15.123:0/1300887646 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f195c066730 msgr2=0x7f195c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.573+0000 7f197daaa700 1 --2- 172.21.15.123:0/1300887646 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f195c066730 0x7f195c068bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f19600090b0 tx=0x7f1960010000 comp rx=0 tx=0).stop 2024-09-13T17:07:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.573+0000 7f197daaa700 1 -- 172.21.15.123:0/1300887646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19780d3680 msgr2=0x7f19780c79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.573+0000 7f197daaa700 1 --2- 172.21.15.123:0/1300887646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19780d3680 0x7f19780c79d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f196800c530 tx=0x7f196800c840 comp rx=0 tx=0).stop 2024-09-13T17:07:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.573+0000 7f197daaa700 1 -- 172.21.15.123:0/1300887646 shutdown_connections 2024-09-13T17:07:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.573+0000 7f197daaa700 1 --2- 172.21.15.123:0/1300887646 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f195c066730 0x7f195c068bf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.573+0000 7f197daaa700 1 --2- 172.21.15.123:0/1300887646 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f19781602d0 0x7f19780b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.573+0000 7f197daaa700 1 --2- 172.21.15.123:0/1300887646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19780d3680 0x7f19780c79d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.573+0000 7f197daaa700 1 --2- 172.21.15.123:0/1300887646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19780cf920 0x7f19781f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.573+0000 7f197daaa700 1 -- 172.21.15.123:0/1300887646 >> 172.21.15.123:0/1300887646 conn(0x7f19780d2b60 msgr2=0x7f1978070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.573+0000 7f197daaa700 1 -- 172.21.15.123:0/1300887646 shutdown_connections 2024-09-13T17:07:19.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.573+0000 7f197daaa700 1 -- 172.21.15.123:0/1300887646 wait complete. 2024-09-13T17:07:19.593 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:19.594 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:19.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.705+0000 7f8bb8e4b700 1 Processor -- start 2024-09-13T17:07:19.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.705+0000 7f8bb8e4b700 1 -- start start 2024-09-13T17:07:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb8e4b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bb40cb7e0 0x7f8bb40c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb8e4b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8bb4072260 0x7f8bb40cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb8e4b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb40ca750 con 0x7f8bb406bdb0 2024-09-13T17:07:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb8e4b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb40c9210 con 0x7f8bb4072260 2024-09-13T17:07:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb8e4b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41617b0 con 0x7f8bb40cb7e0 2024-09-13T17:07:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb2ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8bb406bdb0 0x7f8bb4071b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56092/0 (socket says 172.21.15.123:56092) 2024-09-13T17:07:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb2ffd700 1 -- 172.21.15.123:0/4219421956 learned_addr learned my addr 172.21.15.123:0/4219421956 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb3fff700 1 --2- 172.21.15.123:0/4219421956 >> v2:172.21.15.153:3300/0 conn(0x7f8bb4072260 0x7f8bb40cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb37fe700 1 --2- 172.21.15.123:0/4219421956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bb40cb7e0 0x7f8bb40c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb27fc700 1 -- 172.21.15.123:0/4219421956 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839600284 0 0) 0x7f8bb40ca750 con 0x7f8bb406bdb0 2024-09-13T17:07:19.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb27fc700 1 -- 172.21.15.123:0/4219421956 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ba00035d0 con 0x7f8bb406bdb0 2024-09-13T17:07:19.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb3fff700 1 -- 172.21.15.123:0/4219421956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bb40cb7e0 msgr2=0x7f8bb40c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:19.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb3fff700 1 --2- 172.21.15.123:0/4219421956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bb40cb7e0 0x7f8bb40c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb3fff700 1 -- 172.21.15.123:0/4219421956 >> v1:172.21.15.123:6789/0 conn(0x7f8bb406bdb0 legacy=0x7f8bb4071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb3fff700 1 -- 172.21.15.123:0/4219421956 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb40cbbc0 con 0x7f8bb4072260 2024-09-13T17:07:19.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb3fff700 1 --2- 172.21.15.123:0/4219421956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bb4072260 0x7f8bb40cc580 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009d90 tx=0x7f8ba400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5927773bf76d8d64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:19.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb27fc700 1 -- 172.21.15.123:0/4219421956 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400e070 con 0x7f8bb4072260 2024-09-13T17:07:19.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb27fc700 1 -- 172.21.15.123:0/4219421956 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba400bb20 con 0x7f8bb4072260 2024-09-13T17:07:19.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb27fc700 1 -- 172.21.15.123:0/4219421956 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4012430 con 0x7f8bb4072260 2024-09-13T17:07:19.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/4219421956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bb4072260 msgr2=0x7f8bb40cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb8e4b700 1 --2- 172.21.15.123:0/4219421956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bb4072260 0x7f8bb40cc580 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009d90 tx=0x7f8ba400b330 comp rx=0 tx=0).stop 2024-09-13T17:07:19.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/4219421956 shutdown_connections 2024-09-13T17:07:19.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb8e4b700 1 --2- 172.21.15.123:0/4219421956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bb4072260 0x7f8bb40cc580 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb8e4b700 1 --2- 172.21.15.123:0/4219421956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bb40cb7e0 0x7f8bb40c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/4219421956 >> 172.21.15.123:0/4219421956 conn(0x7f8bb40b01d0 msgr2=0x7f8bb40b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:19.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/4219421956 shutdown_connections 2024-09-13T17:07:19.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.709+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/4219421956 wait complete. 2024-09-13T17:07:19.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.713+0000 7f8bb8e4b700 1 Processor -- start 2024-09-13T17:07:19.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.713+0000 7f8bb8e4b700 1 -- start start 2024-09-13T17:07:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.713+0000 7f8bb8e4b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bb406bdb0 0x7f8bb415ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.713+0000 7f8bb8e4b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bb4072260 0x7f8bb40c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.713+0000 7f8bb8e4b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bb40cb7e0 0x7f8bb40c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.713+0000 7f8bb8e4b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40c6160 con 0x7f8bb4072260 2024-09-13T17:07:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.713+0000 7f8bb8e4b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40b4420 con 0x7f8bb40cb7e0 2024-09-13T17:07:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.713+0000 7f8bb8e4b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40c6370 con 0x7f8bb406bdb0 2024-09-13T17:07:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.713+0000 7f8bb2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bb4072260 0x7f8bb40c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.713+0000 7f8bb2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bb4072260 0x7f8bb40c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57114/0 (socket says 172.21.15.123:57114) 2024-09-13T17:07:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.713+0000 7f8bb2ffd700 1 -- 172.21.15.123:0/587039027 learned_addr learned my addr 172.21.15.123:0/587039027 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.713+0000 7f8bb37fe700 1 --2- 172.21.15.123:0/587039027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bb406bdb0 0x7f8bb415ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.713+0000 7f8bb3fff700 1 --2- 172.21.15.123:0/587039027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bb40cb7e0 0x7f8bb40c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.717+0000 7f8bb2ffd700 1 -- 172.21.15.123:0/587039027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bb406bdb0 msgr2=0x7f8bb415ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.717+0000 7f8bb2ffd700 1 --2- 172.21.15.123:0/587039027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bb406bdb0 0x7f8bb415ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.717+0000 7f8bb2ffd700 1 -- 172.21.15.123:0/587039027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bb40cb7e0 msgr2=0x7f8bb40c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.717+0000 7f8bb2ffd700 1 --2- 172.21.15.123:0/587039027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bb40cb7e0 0x7f8bb40c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.717+0000 7f8bb2ffd700 1 -- 172.21.15.123:0/587039027 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba4009a70 con 0x7f8bb4072260 2024-09-13T17:07:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.717+0000 7f8bb2ffd700 1 --2- 172.21.15.123:0/587039027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bb4072260 0x7f8bb40c77c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c520 tx=0x7f8bac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:19.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.717+0000 7f8babfff700 1 -- 172.21.15.123:0/587039027 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac005d90 con 0x7f8bb4072260 2024-09-13T17:07:19.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.717+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/587039027 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb40c6650 con 0x7f8bb4072260 2024-09-13T17:07:19.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.717+0000 7f8babfff700 1 -- 172.21.15.123:0/587039027 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac0070d0 con 0x7f8bb4072260 2024-09-13T17:07:19.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.717+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/587039027 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb40c6e50 con 0x7f8bb4072260 2024-09-13T17:07:19.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.717+0000 7f8babfff700 1 -- 172.21.15.123:0/587039027 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac007440 con 0x7f8bb4072260 2024-09-13T17:07:19.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.717+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/587039027 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb40c6b70 con 0x7f8bb4072260 2024-09-13T17:07:19.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.717+0000 7f8babfff700 1 -- 172.21.15.123:0/587039027 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8bac0075a0 con 0x7f8bb4072260 2024-09-13T17:07:19.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.717+0000 7f8babfff700 1 --2- 172.21.15.123:0/587039027 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b94066730 0x7f8b94068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:19.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.721+0000 7f8babfff700 1 -- 172.21.15.123:0/587039027 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8bac083460 con 0x7f8bb4072260 2024-09-13T17:07:19.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.721+0000 7f8bb37fe700 1 --2- 172.21.15.123:0/587039027 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b94066730 0x7f8b94068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:19.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.721+0000 7f8bb37fe700 1 --2- 172.21.15.123:0/587039027 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b94066730 0x7f8b94068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009b50 tx=0x7f8b9c009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:19.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.729+0000 7f8babfff700 1 -- 172.21.15.123:0/587039027 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8bb40c6b70 con 0x7f8bb4072260 2024-09-13T17:07:19.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.897+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/587039027 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8bb40c6b70 con 0x7f8bb4072260 2024-09-13T17:07:19.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.897+0000 7f8babfff700 1 -- 172.21.15.123:0/587039027 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8bb40c6b70 con 0x7f8bb4072260 2024-09-13T17:07:19.904 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:19.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.901+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/587039027 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b94066730 msgr2=0x7f8b94068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.901+0000 7f8bb8e4b700 1 --2- 172.21.15.123:0/587039027 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b94066730 0x7f8b94068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009b50 tx=0x7f8b9c009240 comp rx=0 tx=0).stop 2024-09-13T17:07:19.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.901+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/587039027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bb4072260 msgr2=0x7f8bb40c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:19.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.901+0000 7f8bb8e4b700 1 --2- 172.21.15.123:0/587039027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bb4072260 0x7f8bb40c77c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c520 tx=0x7f8bac00c830 comp rx=0 tx=0).stop 2024-09-13T17:07:19.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.901+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/587039027 shutdown_connections 2024-09-13T17:07:19.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.901+0000 7f8bb8e4b700 1 --2- 172.21.15.123:0/587039027 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b94066730 0x7f8b94068bf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.901+0000 7f8bb8e4b700 1 --2- 172.21.15.123:0/587039027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bb40cb7e0 0x7f8bb40c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.901+0000 7f8bb8e4b700 1 --2- 172.21.15.123:0/587039027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bb4072260 0x7f8bb40c77c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.901+0000 7f8bb8e4b700 1 --2- 172.21.15.123:0/587039027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8bb406bdb0 0x7f8bb415ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:19.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.901+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/587039027 >> 172.21.15.123:0/587039027 conn(0x7f8bb40b01d0 msgr2=0x7f8bb4070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:19.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.901+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/587039027 shutdown_connections 2024-09-13T17:07:19.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:19.901+0000 7f8bb8e4b700 1 -- 172.21.15.123:0/587039027 wait complete. 2024-09-13T17:07:19.923 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:07:20.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.033+0000 7f33f5504700 1 Processor -- start 2024-09-13T17:07:20.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.033+0000 7f33f5504700 1 -- start start 2024-09-13T17:07:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.033+0000 7f33f5504700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33f00d0f40 0x7f33f00d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.033+0000 7f33f5504700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f00d0cb0 con 0x7f33f00cd5e0 2024-09-13T17:07:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.033+0000 7f33f5504700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f00b0060 con 0x7f33f00b58b0 2024-09-13T17:07:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.033+0000 7f33f5504700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f00b0340 con 0x7f33f00d0f40 2024-09-13T17:07:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.033+0000 7f33effff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33f00d0f40 0x7f33f00d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.033+0000 7f33f4d03700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f33f00cd5e0 0x7f33f00cd9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56096/0 (socket says 172.21.15.123:56096) 2024-09-13T17:07:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.033+0000 7f33f4d03700 1 -- 172.21.15.123:0/525933480 learned_addr learned my addr 172.21.15.123:0/525933480 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33effff700 1 -- 172.21.15.123:0/525933480 >> v1:172.21.15.153:6789/0 conn(0x7f33f00b58b0 legacy=0x7f33f00d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33effff700 1 -- 172.21.15.123:0/525933480 >> v1:172.21.15.123:6789/0 conn(0x7f33f00cd5e0 legacy=0x7f33f00cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33effff700 1 -- 172.21.15.123:0/525933480 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f00b0620 con 0x7f33f00d0f40 2024-09-13T17:07:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33eeffd700 1 -- 172.21.15.123:0/525933480 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987415657 0 0) 0x7f33f00d0cb0 con 0x7f33f00cd5e0 2024-09-13T17:07:20.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33effff700 1 --2- 172.21.15.123:0/525933480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f00d0f40 0x7f33f00d1320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009850 tx=0x7f33d8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c618daaafb18121e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:20.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33eeffd700 1 -- 172.21.15.123:0/525933480 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8011830 con 0x7f33f00d0f40 2024-09-13T17:07:20.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33eeffd700 1 -- 172.21.15.123:0/525933480 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d8011990 con 0x7f33f00d0f40 2024-09-13T17:07:20.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33eeffd700 1 -- 172.21.15.123:0/525933480 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8011d20 con 0x7f33f00d0f40 2024-09-13T17:07:20.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33f5504700 1 -- 172.21.15.123:0/525933480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f00d0f40 msgr2=0x7f33f00d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33f5504700 1 --2- 172.21.15.123:0/525933480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f00d0f40 0x7f33f00d1320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009850 tx=0x7f33d8009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:20.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33f5504700 1 -- 172.21.15.123:0/525933480 shutdown_connections 2024-09-13T17:07:20.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33f5504700 1 --2- 172.21.15.123:0/525933480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f00d0f40 0x7f33f00d1320 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33f5504700 1 -- 172.21.15.123:0/525933480 >> 172.21.15.123:0/525933480 conn(0x7f33f00d2a60 msgr2=0x7f33f00d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:20.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33f5504700 1 -- 172.21.15.123:0/525933480 shutdown_connections 2024-09-13T17:07:20.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.037+0000 7f33f5504700 1 -- 172.21.15.123:0/525933480 wait complete. 2024-09-13T17:07:20.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.041+0000 7f33f5504700 1 Processor -- start 2024-09-13T17:07:20.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.041+0000 7f33f5504700 1 -- start start 2024-09-13T17:07:20.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.041+0000 7f33f5504700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33f00b58b0 0x7f33f0152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.041+0000 7f33f5504700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f00cd5e0 0x7f33f009c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.041+0000 7f33f5504700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f00d0f40 0x7f33f00b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.041+0000 7f33f5504700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0153440 con 0x7f33f00d0f40 2024-09-13T17:07:20.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.041+0000 7f33f5504700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f009eff0 con 0x7f33f00cd5e0 2024-09-13T17:07:20.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.041+0000 7f33f5504700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f009f2d0 con 0x7f33f00b58b0 2024-09-13T17:07:20.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.041+0000 7f33f4d03700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f00d0f40 0x7f33f00b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33f4d03700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f00d0f40 0x7f33f00b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57132/0 (socket says 172.21.15.123:57132) 2024-09-13T17:07:20.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33f4d03700 1 -- 172.21.15.123:0/160896204 learned_addr learned my addr 172.21.15.123:0/160896204 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:20.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33effff700 1 --2- 172.21.15.123:0/160896204 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33f00b58b0 0x7f33f0152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33ef7fe700 1 --2- 172.21.15.123:0/160896204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f00cd5e0 0x7f33f009c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33f4d03700 1 -- 172.21.15.123:0/160896204 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33f00b58b0 msgr2=0x7f33f0152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33f4d03700 1 --2- 172.21.15.123:0/160896204 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33f00b58b0 0x7f33f0152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33f4d03700 1 -- 172.21.15.123:0/160896204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f00cd5e0 msgr2=0x7f33f009c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33f4d03700 1 --2- 172.21.15.123:0/160896204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f00cd5e0 0x7f33f009c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33f4d03700 1 -- 172.21.15.123:0/160896204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80094b0 con 0x7f33f00d0f40 2024-09-13T17:07:20.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33f4d03700 1 --2- 172.21.15.123:0/160896204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f00d0f40 0x7f33f00b2c70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f33e800cb90 tx=0x7f33e800cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:20.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33ecff9700 1 -- 172.21.15.123:0/160896204 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800aaa0 con 0x7f33f00d0f40 2024-09-13T17:07:20.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33ecff9700 1 -- 172.21.15.123:0/160896204 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e800ac20 con 0x7f33f00d0f40 2024-09-13T17:07:20.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33ecff9700 1 -- 172.21.15.123:0/160896204 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80070d0 con 0x7f33f00d0f40 2024-09-13T17:07:20.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33f5504700 1 -- 172.21.15.123:0/160896204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f009f5b0 con 0x7f33f00d0f40 2024-09-13T17:07:20.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33f5504700 1 -- 172.21.15.123:0/160896204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f009fb70 con 0x7f33f00d0f40 2024-09-13T17:07:20.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.045+0000 7f33f5504700 1 -- 172.21.15.123:0/160896204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f009fd90 con 0x7f33f00d0f40 2024-09-13T17:07:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.049+0000 7f33ecff9700 1 -- 172.21.15.123:0/160896204 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f33e8007230 con 0x7f33f00d0f40 2024-09-13T17:07:20.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.049+0000 7f33ecff9700 1 --2- 172.21.15.123:0/160896204 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f33d0066730 0x7f33d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.049+0000 7f33ecff9700 1 -- 172.21.15.123:0/160896204 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33e8083ba0 con 0x7f33f00d0f40 2024-09-13T17:07:20.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.049+0000 7f33effff700 1 --2- 172.21.15.123:0/160896204 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f33d0066730 0x7f33d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.049+0000 7f33effff700 1 --2- 172.21.15.123:0/160896204 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f33d0066730 0x7f33d0068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f33d80090b0 tx=0x7f33d801c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:20.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.053+0000 7f33ecff9700 1 -- 172.21.15.123:0/160896204 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f33e8050f10 con 0x7f33f00d0f40 2024-09-13T17:07:20.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.221+0000 7f33f5504700 1 -- 172.21.15.123:0/160896204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33f006f940 con 0x7f33f00d0f40 2024-09-13T17:07:20.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.221+0000 7f33ecff9700 1 -- 172.21.15.123:0/160896204 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33e8018020 con 0x7f33f00d0f40 2024-09-13T17:07:20.229 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:07:20.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.225+0000 7f33f5504700 1 -- 172.21.15.123:0/160896204 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f33d0066730 msgr2=0x7f33d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.225+0000 7f33f5504700 1 --2- 172.21.15.123:0/160896204 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f33d0066730 0x7f33d0068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f33d80090b0 tx=0x7f33d801c040 comp rx=0 tx=0).stop 2024-09-13T17:07:20.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.225+0000 7f33f5504700 1 -- 172.21.15.123:0/160896204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f00d0f40 msgr2=0x7f33f00b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.225+0000 7f33f5504700 1 --2- 172.21.15.123:0/160896204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f00d0f40 0x7f33f00b2c70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f33e800cb90 tx=0x7f33e800cea0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.225+0000 7f33f5504700 1 -- 172.21.15.123:0/160896204 shutdown_connections 2024-09-13T17:07:20.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.225+0000 7f33f5504700 1 --2- 172.21.15.123:0/160896204 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f33d0066730 0x7f33d0068bf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.225+0000 7f33f5504700 1 --2- 172.21.15.123:0/160896204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f00d0f40 0x7f33f00b2c70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.225+0000 7f33f5504700 1 --2- 172.21.15.123:0/160896204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f00cd5e0 0x7f33f009c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.225+0000 7f33f5504700 1 --2- 172.21.15.123:0/160896204 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33f00b58b0 0x7f33f0152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.225+0000 7f33f5504700 1 -- 172.21.15.123:0/160896204 >> 172.21.15.123:0/160896204 conn(0x7f33f00d2a60 msgr2=0x7f33f00af650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:20.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.225+0000 7f33f5504700 1 -- 172.21.15.123:0/160896204 shutdown_connections 2024-09-13T17:07:20.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.225+0000 7f33f5504700 1 -- 172.21.15.123:0/160896204 wait complete. 2024-09-13T17:07:20.244 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:07:20.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f63a48ef700 1 Processor -- start 2024-09-13T17:07:20.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f63a48ef700 1 -- start start 2024-09-13T17:07:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f63a48ef700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63a0159c60 0x7f63a015e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f63a48ef700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f63a0070f90 0x7f63a00cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f63a48ef700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f63a00cdbd0 0x7f63a00cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f63a48ef700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a00ce060 con 0x7f63a0070f90 2024-09-13T17:07:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f63a48ef700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a00ada60 con 0x7f63a00cdbd0 2024-09-13T17:07:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f63a48ef700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a015e680 con 0x7f63a0159c60 2024-09-13T17:07:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f639659c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f63a0070f90 0x7f63a00cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f639659c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f63a0070f90 0x7f63a00cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57148/0 (socket says 172.21.15.123:57148) 2024-09-13T17:07:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f639659c700 1 -- 172.21.15.123:0/500411810 learned_addr learned my addr 172.21.15.123:0/500411810 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f639ed9d700 1 --2- 172.21.15.123:0/500411810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63a0159c60 0x7f63a015e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f639f59e700 1 --2- 172.21.15.123:0/500411810 >> v2:172.21.15.153:3300/0 conn(0x7f63a00cdbd0 0x7f63a00cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f639659c700 1 -- 172.21.15.123:0/500411810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63a0159c60 msgr2=0x7f63a015e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f639659c700 1 --2- 172.21.15.123:0/500411810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63a0159c60 0x7f63a015e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f639659c700 1 -- 172.21.15.123:0/500411810 >> v2:172.21.15.153:3300/0 conn(0x7f63a00cdbd0 msgr2=0x7f63a00cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f639659c700 1 --2- 172.21.15.123:0/500411810 >> v2:172.21.15.153:3300/0 conn(0x7f63a00cdbd0 0x7f63a00cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f639659c700 1 -- 172.21.15.123:0/500411810 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a00720a0 con 0x7f63a0070f90 2024-09-13T17:07:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f639ed9d700 1 --2- 172.21.15.123:0/500411810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63a0159c60 0x7f63a015e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f639f59e700 1 --2- 172.21.15.123:0/500411810 >> v2:172.21.15.153:3300/0 conn(0x7f63a00cdbd0 0x7f63a00cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.357+0000 7f639659c700 1 --2- 172.21.15.123:0/500411810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a0070f90 0x7f63a00cd690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f63a006bd40 tx=0x7f6388009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487477ea8b08fa34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.361+0000 7f639e59c700 1 -- 172.21.15.123:0/500411810 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388011830 con 0x7f63a0070f90 2024-09-13T17:07:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.361+0000 7f639e59c700 1 -- 172.21.15.123:0/500411810 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6388011990 con 0x7f63a0070f90 2024-09-13T17:07:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.361+0000 7f639e59c700 1 -- 172.21.15.123:0/500411810 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388011d20 con 0x7f63a0070f90 2024-09-13T17:07:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.361+0000 7f63a48ef700 1 -- 172.21.15.123:0/500411810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a0070f90 msgr2=0x7f63a00cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.361+0000 7f63a48ef700 1 --2- 172.21.15.123:0/500411810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a0070f90 0x7f63a00cd690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f63a006bd40 tx=0x7f6388009bf0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.361+0000 7f63a48ef700 1 -- 172.21.15.123:0/500411810 shutdown_connections 2024-09-13T17:07:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.361+0000 7f63a48ef700 1 --2- 172.21.15.123:0/500411810 >> v2:172.21.15.153:3300/0 conn(0x7f63a00cdbd0 0x7f63a00cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.361+0000 7f63a48ef700 1 --2- 172.21.15.123:0/500411810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a0070f90 0x7f63a00cd690 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.361+0000 7f63a48ef700 1 --2- 172.21.15.123:0/500411810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63a0159c60 0x7f63a015e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.361+0000 7f63a48ef700 1 -- 172.21.15.123:0/500411810 >> 172.21.15.123:0/500411810 conn(0x7f63a00b01d0 msgr2=0x7f63a00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.361+0000 7f63a48ef700 1 -- 172.21.15.123:0/500411810 shutdown_connections 2024-09-13T17:07:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.361+0000 7f63a48ef700 1 -- 172.21.15.123:0/500411810 wait complete. 2024-09-13T17:07:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.361+0000 7f63a48ef700 1 Processor -- start 2024-09-13T17:07:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.361+0000 7f63a48ef700 1 -- start start 2024-09-13T17:07:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f63a48ef700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63a0070f90 0x7f63a015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f63a48ef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a00cdbd0 0x7f63a0158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f63a48ef700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63a0159c60 0x7f63a015d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f63a48ef700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a0158fd0 con 0x7f63a00cdbd0 2024-09-13T17:07:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f63a48ef700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a015c4c0 con 0x7f63a0159c60 2024-09-13T17:07:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f63a48ef700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a015b8b0 con 0x7f63a0070f90 2024-09-13T17:07:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f639659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a00cdbd0 0x7f63a0158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f639659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a00cdbd0 0x7f63a0158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57158/0 (socket says 172.21.15.123:57158) 2024-09-13T17:07:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f639659c700 1 -- 172.21.15.123:0/840992864 learned_addr learned my addr 172.21.15.123:0/840992864 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f639ed9d700 1 --2- 172.21.15.123:0/840992864 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63a0070f90 0x7f63a015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f639f59e700 1 --2- 172.21.15.123:0/840992864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63a0159c60 0x7f63a015d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f639659c700 1 -- 172.21.15.123:0/840992864 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63a0070f90 msgr2=0x7f63a015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f639659c700 1 --2- 172.21.15.123:0/840992864 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63a0070f90 0x7f63a015b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f639659c700 1 -- 172.21.15.123:0/840992864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63a0159c60 msgr2=0x7f63a015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f639659c700 1 --2- 172.21.15.123:0/840992864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63a0159c60 0x7f63a015d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f639659c700 1 -- 172.21.15.123:0/840992864 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6398009a70 con 0x7f63a00cdbd0 2024-09-13T17:07:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f639659c700 1 --2- 172.21.15.123:0/840992864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a00cdbd0 0x7f63a0158a90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6388009c30 tx=0x7f6388004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f6397fff700 1 -- 172.21.15.123:0/840992864 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388004450 con 0x7f63a00cdbd0 2024-09-13T17:07:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f6397fff700 1 -- 172.21.15.123:0/840992864 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63880045b0 con 0x7f63a00cdbd0 2024-09-13T17:07:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f63a48ef700 1 -- 172.21.15.123:0/840992864 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63900094b0 con 0x7f63a00cdbd0 2024-09-13T17:07:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f6397fff700 1 -- 172.21.15.123:0/840992864 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63880038e0 con 0x7f63a00cdbd0 2024-09-13T17:07:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.365+0000 7f63a48ef700 1 -- 172.21.15.123:0/840992864 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6388009570 con 0x7f63a00cdbd0 2024-09-13T17:07:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.369+0000 7f6397fff700 1 -- 172.21.15.123:0/840992864 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6388003a40 con 0x7f63a00cdbd0 2024-09-13T17:07:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.369+0000 7f63a48ef700 1 -- 172.21.15.123:0/840992864 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a0071a50 con 0x7f63a00cdbd0 2024-09-13T17:07:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.369+0000 7f6397fff700 1 --2- 172.21.15.123:0/840992864 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6380066730 0x7f6380068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.369+0000 7f6397fff700 1 -- 172.21.15.123:0/840992864 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63880872d0 con 0x7f63a00cdbd0 2024-09-13T17:07:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.369+0000 7f639ed9d700 1 --2- 172.21.15.123:0/840992864 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6380066730 0x7f6380068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.369+0000 7f639ed9d700 1 --2- 172.21.15.123:0/840992864 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6380066730 0x7f6380068bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f63a00ad610 tx=0x7f6390009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:20.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.373+0000 7f6397fff700 1 -- 172.21.15.123:0/840992864 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f63880546d0 con 0x7f63a00cdbd0 2024-09-13T17:07:20.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.545+0000 7f63a48ef700 1 -- 172.21.15.123:0/840992864 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63a00b4600 con 0x7f63a00cdbd0 2024-09-13T17:07:20.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.545+0000 7f6397fff700 1 -- 172.21.15.123:0/840992864 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6388057cf0 con 0x7f63a00cdbd0 2024-09-13T17:07:20.552 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:07:20.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.549+0000 7f63a48ef700 1 -- 172.21.15.123:0/840992864 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6380066730 msgr2=0x7f6380068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.549+0000 7f63a48ef700 1 --2- 172.21.15.123:0/840992864 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6380066730 0x7f6380068bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f63a00ad610 tx=0x7f6390009240 comp rx=0 tx=0).stop 2024-09-13T17:07:20.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.549+0000 7f63a48ef700 1 -- 172.21.15.123:0/840992864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a00cdbd0 msgr2=0x7f63a0158a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.549+0000 7f63a48ef700 1 --2- 172.21.15.123:0/840992864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a00cdbd0 0x7f63a0158a90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6388009c30 tx=0x7f6388004770 comp rx=0 tx=0).stop 2024-09-13T17:07:20.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.549+0000 7f63a48ef700 1 -- 172.21.15.123:0/840992864 shutdown_connections 2024-09-13T17:07:20.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.549+0000 7f63a48ef700 1 --2- 172.21.15.123:0/840992864 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6380066730 0x7f6380068bf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.549+0000 7f63a48ef700 1 --2- 172.21.15.123:0/840992864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63a0159c60 0x7f63a015d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.549+0000 7f63a48ef700 1 --2- 172.21.15.123:0/840992864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63a00cdbd0 0x7f63a0158a90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.549+0000 7f63a48ef700 1 --2- 172.21.15.123:0/840992864 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63a0070f90 0x7f63a015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.549+0000 7f63a48ef700 1 -- 172.21.15.123:0/840992864 >> 172.21.15.123:0/840992864 conn(0x7f63a00b01d0 msgr2=0x7f63a00ae320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:20.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.549+0000 7f63a48ef700 1 -- 172.21.15.123:0/840992864 shutdown_connections 2024-09-13T17:07:20.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.549+0000 7f63a48ef700 1 -- 172.21.15.123:0/840992864 wait complete. 2024-09-13T17:07:20.568 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:07:20.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.677+0000 7f64cbfff700 1 Processor -- start 2024-09-13T17:07:20.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.677+0000 7f64cbfff700 1 -- start start 2024-09-13T17:07:20.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f64cc0c9f80 0x7f64cc0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f64cc06c610 0x7f64cc06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64cc0cd690 0x7f64cc0cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64cc0ce060 con 0x7f64cc06c610 2024-09-13T17:07:20.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64cc0c95f0 con 0x7f64cc0c9f80 2024-09-13T17:07:20.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc15b180 con 0x7f64cc0cd690 2024-09-13T17:07:20.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64ca7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f64cc06c610 0x7f64cc06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64ca7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f64cc06c610 0x7f64cc06ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57162/0 (socket says 172.21.15.123:57162) 2024-09-13T17:07:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64ca7fc700 1 -- 172.21.15.123:0/3874348272 learned_addr learned my addr 172.21.15.123:0/3874348272 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cb7fe700 1 --2- 172.21.15.123:0/3874348272 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64cc0cd690 0x7f64cc0cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64caffd700 1 --2- 172.21.15.123:0/3874348272 >> v2:172.21.15.153:3300/0 conn(0x7f64cc0c9f80 0x7f64cc0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64ca7fc700 1 -- 172.21.15.123:0/3874348272 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64cc0cd690 msgr2=0x7f64cc0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64ca7fc700 1 --2- 172.21.15.123:0/3874348272 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64cc0cd690 0x7f64cc0cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64ca7fc700 1 -- 172.21.15.123:0/3874348272 >> v2:172.21.15.153:3300/0 conn(0x7f64cc0c9f80 msgr2=0x7f64cc0c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64ca7fc700 1 --2- 172.21.15.123:0/3874348272 >> v2:172.21.15.153:3300/0 conn(0x7f64cc0c9f80 0x7f64cc0c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64ca7fc700 1 -- 172.21.15.123:0/3874348272 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc0cae70 con 0x7f64cc06c610 2024-09-13T17:07:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64caffd700 1 --2- 172.21.15.123:0/3874348272 >> v2:172.21.15.153:3300/0 conn(0x7f64cc0c9f80 0x7f64cc0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cb7fe700 1 --2- 172.21.15.123:0/3874348272 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64cc0cd690 0x7f64cc0cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64ca7fc700 1 --2- 172.21.15.123:0/3874348272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64cc06c610 0x7f64cc06ca70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f64cc06e260 tx=0x7f64bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277ff118635be666 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64c9ffb700 1 -- 172.21.15.123:0/3874348272 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc00e070 con 0x7f64cc06c610 2024-09-13T17:07:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64c9ffb700 1 -- 172.21.15.123:0/3874348272 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc00b940 con 0x7f64cc06c610 2024-09-13T17:07:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64c9ffb700 1 -- 172.21.15.123:0/3874348272 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc00bcf0 con 0x7f64cc06c610 2024-09-13T17:07:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 -- 172.21.15.123:0/3874348272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64cc06c610 msgr2=0x7f64cc06ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 --2- 172.21.15.123:0/3874348272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64cc06c610 0x7f64cc06ca70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f64cc06e260 tx=0x7f64bc00b330 comp rx=0 tx=0).stop 2024-09-13T17:07:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 -- 172.21.15.123:0/3874348272 shutdown_connections 2024-09-13T17:07:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 --2- 172.21.15.123:0/3874348272 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64cc0cd690 0x7f64cc0cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 --2- 172.21.15.123:0/3874348272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64cc06c610 0x7f64cc06ca70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 --2- 172.21.15.123:0/3874348272 >> v2:172.21.15.153:3300/0 conn(0x7f64cc0c9f80 0x7f64cc0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 -- 172.21.15.123:0/3874348272 >> 172.21.15.123:0/3874348272 conn(0x7f64cc0b01d0 msgr2=0x7f64cc0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 -- 172.21.15.123:0/3874348272 shutdown_connections 2024-09-13T17:07:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 -- 172.21.15.123:0/3874348272 wait complete. 2024-09-13T17:07:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 Processor -- start 2024-09-13T17:07:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.681+0000 7f64cbfff700 1 -- start start 2024-09-13T17:07:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64cbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64cc06c610 0x7f64cc0c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64cbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64cc0c9f80 0x7f64cc150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64cbfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64cc0cd690 0x7f64cc1f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64cbfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc1e42a0 con 0x7f64cc0c9f80 2024-09-13T17:07:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64cbfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc151080 con 0x7f64cc06c610 2024-09-13T17:07:20.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64cbfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc1e3940 con 0x7f64cc0cd690 2024-09-13T17:07:20.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64ca7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64cc0c9f80 0x7f64cc150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64ca7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64cc0c9f80 0x7f64cc150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57168/0 (socket says 172.21.15.123:57168) 2024-09-13T17:07:20.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64ca7fc700 1 -- 172.21.15.123:0/965182560 learned_addr learned my addr 172.21.15.123:0/965182560 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:20.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64caffd700 1 --2- 172.21.15.123:0/965182560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64cc06c610 0x7f64cc0c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64cb7fe700 1 --2- 172.21.15.123:0/965182560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64cc0cd690 0x7f64cc1f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64ca7fc700 1 -- 172.21.15.123:0/965182560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64cc0cd690 msgr2=0x7f64cc1f29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64ca7fc700 1 --2- 172.21.15.123:0/965182560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64cc0cd690 0x7f64cc1f29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64ca7fc700 1 -- 172.21.15.123:0/965182560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64cc06c610 msgr2=0x7f64cc0c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64ca7fc700 1 --2- 172.21.15.123:0/965182560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64cc06c610 0x7f64cc0c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64ca7fc700 1 -- 172.21.15.123:0/965182560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc009b30 con 0x7f64cc0c9f80 2024-09-13T17:07:20.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64ca7fc700 1 --2- 172.21.15.123:0/965182560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64cc0c9f80 0x7f64cc150b40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f64bc000f80 tx=0x7f64bc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:20.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64c37fe700 1 -- 172.21.15.123:0/965182560 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc004250 con 0x7f64cc0c9f80 2024-09-13T17:07:20.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64c37fe700 1 -- 172.21.15.123:0/965182560 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc0043b0 con 0x7f64cc0c9f80 2024-09-13T17:07:20.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64cbfff700 1 -- 172.21.15.123:0/965182560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64cc1e3be0 con 0x7f64cc0c9f80 2024-09-13T17:07:20.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64c37fe700 1 -- 172.21.15.123:0/965182560 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc004760 con 0x7f64cc0c9f80 2024-09-13T17:07:20.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.685+0000 7f64cbfff700 1 -- 172.21.15.123:0/965182560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64cc0c2600 con 0x7f64cc0c9f80 2024-09-13T17:07:20.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.689+0000 7f64cbfff700 1 -- 172.21.15.123:0/965182560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64cc0ca360 con 0x7f64cc0c9f80 2024-09-13T17:07:20.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.689+0000 7f64c37fe700 1 -- 172.21.15.123:0/965182560 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f64bc01c440 con 0x7f64cc0c9f80 2024-09-13T17:07:20.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.689+0000 7f64c37fe700 1 --2- 172.21.15.123:0/965182560 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64ac066730 0x7f64ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:20.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.689+0000 7f64c37fe700 1 -- 172.21.15.123:0/965182560 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64bc085570 con 0x7f64cc0c9f80 2024-09-13T17:07:20.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.689+0000 7f64caffd700 1 --2- 172.21.15.123:0/965182560 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64ac066730 0x7f64ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:20.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.689+0000 7f64caffd700 1 --2- 172.21.15.123:0/965182560 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64ac066730 0x7f64ac068bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f64b4006bc0 tx=0x7f64b4008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:20.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.697+0000 7f64c37fe700 1 -- 172.21.15.123:0/965182560 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f64bc052980 con 0x7f64cc0c9f80 2024-09-13T17:07:20.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.877+0000 7f64cbfff700 1 -- 172.21.15.123:0/965182560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f64cc0b4600 con 0x7f64cc0c9f80 2024-09-13T17:07:20.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.881+0000 7f64c37fe700 1 -- 172.21.15.123:0/965182560 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f64bc055fa0 con 0x7f64cc0c9f80 2024-09-13T17:07:20.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.881+0000 7f64cbfff700 1 -- 172.21.15.123:0/965182560 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64ac066730 msgr2=0x7f64ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.881+0000 7f64cbfff700 1 --2- 172.21.15.123:0/965182560 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64ac066730 0x7f64ac068bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f64b4006bc0 tx=0x7f64b4008040 comp rx=0 tx=0).stop 2024-09-13T17:07:20.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.881+0000 7f64cbfff700 1 -- 172.21.15.123:0/965182560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64cc0c9f80 msgr2=0x7f64cc150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:20.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.881+0000 7f64cbfff700 1 --2- 172.21.15.123:0/965182560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64cc0c9f80 0x7f64cc150b40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f64bc000f80 tx=0x7f64bc004af0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.881+0000 7f64cbfff700 1 -- 172.21.15.123:0/965182560 shutdown_connections 2024-09-13T17:07:20.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.881+0000 7f64cbfff700 1 --2- 172.21.15.123:0/965182560 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64ac066730 0x7f64ac068bf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.881+0000 7f64cbfff700 1 --2- 172.21.15.123:0/965182560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64cc0cd690 0x7f64cc1f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.881+0000 7f64cbfff700 1 --2- 172.21.15.123:0/965182560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64cc0c9f80 0x7f64cc150b40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.881+0000 7f64cbfff700 1 --2- 172.21.15.123:0/965182560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64cc06c610 0x7f64cc0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:20.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.881+0000 7f64cbfff700 1 -- 172.21.15.123:0/965182560 >> 172.21.15.123:0/965182560 conn(0x7f64cc0b01d0 msgr2=0x7f64cc15b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:20.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.881+0000 7f64cbfff700 1 -- 172.21.15.123:0/965182560 shutdown_connections 2024-09-13T17:07:20.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:20.881+0000 7f64cbfff700 1 -- 172.21.15.123:0/965182560 wait complete. 2024-09-13T17:07:20.891 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:07:20.901 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:07:20.901 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:07:20.907 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:21.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.013+0000 7f05a2038700 1 Processor -- start 2024-09-13T17:07:21.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.013+0000 7f05a2038700 1 -- start start 2024-09-13T17:07:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a2038700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f059c15a9d0 0x7f059c071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a2038700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059c0cce80 0x7f059c070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a2038700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c15bd10 con 0x7f059c0ce690 2024-09-13T17:07:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a2038700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c070a80 con 0x7f059c15a9d0 2024-09-13T17:07:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a2038700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0cd2c0 con 0x7f059c0cce80 2024-09-13T17:07:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a1036700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f059c15a9d0 0x7f059c071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a1036700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f059c15a9d0 0x7f059c071760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57176/0 (socket says 172.21.15.123:57176) 2024-09-13T17:07:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a0835700 1 --2- 172.21.15.123:0/3139362047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059c0cce80 0x7f059c070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a1036700 1 -- 172.21.15.123:0/3139362047 learned_addr learned my addr 172.21.15.123:0/3139362047 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a0835700 1 -- 172.21.15.123:0/3139362047 >> v2:172.21.15.123:3300/0 conn(0x7f059c15a9d0 msgr2=0x7f059c071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a0835700 1 --2- 172.21.15.123:0/3139362047 >> v2:172.21.15.123:3300/0 conn(0x7f059c15a9d0 0x7f059c071760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a0835700 1 -- 172.21.15.123:0/3139362047 >> v1:172.21.15.153:6789/0 conn(0x7f059c0ce690 legacy=0x7f059c15e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a0835700 1 -- 172.21.15.123:0/3139362047 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c15b100 con 0x7f059c0cce80 2024-09-13T17:07:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a0835700 1 --2- 172.21.15.123:0/3139362047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059c0cce80 0x7f059c070540 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f059000dc70 tx=0x7f059000df80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7127fee62d011ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f058ffff700 1 -- 172.21.15.123:0/3139362047 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590012070 con 0x7f059c0cce80 2024-09-13T17:07:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f058ffff700 1 -- 172.21.15.123:0/3139362047 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059000d2e0 con 0x7f059c0cce80 2024-09-13T17:07:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f058ffff700 1 -- 172.21.15.123:0/3139362047 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059000f8e0 con 0x7f059c0cce80 2024-09-13T17:07:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a2038700 1 -- 172.21.15.123:0/3139362047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059c0cce80 msgr2=0x7f059c070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a2038700 1 --2- 172.21.15.123:0/3139362047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059c0cce80 0x7f059c070540 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f059000dc70 tx=0x7f059000df80 comp rx=0 tx=0).stop 2024-09-13T17:07:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a2038700 1 -- 172.21.15.123:0/3139362047 shutdown_connections 2024-09-13T17:07:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a2038700 1 --2- 172.21.15.123:0/3139362047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059c0cce80 0x7f059c070540 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a2038700 1 --2- 172.21.15.123:0/3139362047 >> v2:172.21.15.123:3300/0 conn(0x7f059c15a9d0 0x7f059c071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a2038700 1 -- 172.21.15.123:0/3139362047 >> 172.21.15.123:0/3139362047 conn(0x7f059c066150 msgr2=0x7f059c066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:21.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a2038700 1 -- 172.21.15.123:0/3139362047 shutdown_connections 2024-09-13T17:07:21.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.017+0000 7f05a2038700 1 -- 172.21.15.123:0/3139362047 wait complete. 2024-09-13T17:07:21.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a2038700 1 Processor -- start 2024-09-13T17:07:21.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a2038700 1 -- start start 2024-09-13T17:07:21.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a2038700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059c0cce80 0x7f059c1546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a2038700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f059c0ce690 0x7f059c154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a2038700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f059c15a9d0 0x7f059c1edf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a2038700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c155170 con 0x7f059c0ce690 2024-09-13T17:07:21.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a2038700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c155fc0 con 0x7f059c15a9d0 2024-09-13T17:07:21.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a2038700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c1553b0 con 0x7f059c0cce80 2024-09-13T17:07:21.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a0835700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f059c0ce690 0x7f059c154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a0835700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f059c0ce690 0x7f059c154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57182/0 (socket says 172.21.15.123:57182) 2024-09-13T17:07:21.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a0835700 1 -- 172.21.15.123:0/2025141891 learned_addr learned my addr 172.21.15.123:0/2025141891 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:21.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a1036700 1 --2- 172.21.15.123:0/2025141891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059c0cce80 0x7f059c1546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a1837700 1 --2- 172.21.15.123:0/2025141891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f059c15a9d0 0x7f059c1edf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a0835700 1 -- 172.21.15.123:0/2025141891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059c0cce80 msgr2=0x7f059c1546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a0835700 1 --2- 172.21.15.123:0/2025141891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059c0cce80 0x7f059c1546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a0835700 1 -- 172.21.15.123:0/2025141891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f059c15a9d0 msgr2=0x7f059c1edf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a0835700 1 --2- 172.21.15.123:0/2025141891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f059c15a9d0 0x7f059c1edf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a0835700 1 -- 172.21.15.123:0/2025141891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059000d950 con 0x7f059c0ce690 2024-09-13T17:07:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a0835700 1 --2- 172.21.15.123:0/2025141891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f059c0ce690 0x7f059c154c30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0590016000 tx=0x7f0590004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f058dffb700 1 -- 172.21.15.123:0/2025141891 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059000d7d0 con 0x7f059c0ce690 2024-09-13T17:07:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a2038700 1 -- 172.21.15.123:0/2025141891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c155690 con 0x7f059c0ce690 2024-09-13T17:07:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f058dffb700 1 -- 172.21.15.123:0/2025141891 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05900036c0 con 0x7f059c0ce690 2024-09-13T17:07:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f05a2038700 1 -- 172.21.15.123:0/2025141891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c155c50 con 0x7f059c0ce690 2024-09-13T17:07:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.021+0000 7f058dffb700 1 -- 172.21.15.123:0/2025141891 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590003a30 con 0x7f059c0ce690 2024-09-13T17:07:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.025+0000 7f05a2038700 1 -- 172.21.15.123:0/2025141891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c0677f0 con 0x7f059c0ce690 2024-09-13T17:07:21.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.025+0000 7f058dffb700 1 -- 172.21.15.123:0/2025141891 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0590003b90 con 0x7f059c0ce690 2024-09-13T17:07:21.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.025+0000 7f058dffb700 1 --2- 172.21.15.123:0/2025141891 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0580066730 0x7f0580068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.025+0000 7f058dffb700 1 -- 172.21.15.123:0/2025141891 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05900893a0 con 0x7f059c0ce690 2024-09-13T17:07:21.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.025+0000 7f05a1036700 1 --2- 172.21.15.123:0/2025141891 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0580066730 0x7f0580068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.025+0000 7f05a1036700 1 --2- 172.21.15.123:0/2025141891 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0580066730 0x7f0580068bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0598006d70 tx=0x7f05980092e0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:21.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.033+0000 7f058dffb700 1 -- 172.21.15.123:0/2025141891 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0590056840 con 0x7f059c0ce690 2024-09-13T17:07:21.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.205+0000 7f05a2038700 1 -- 172.21.15.123:0/2025141891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f059c066a60 con 0x7f059c0ce690 2024-09-13T17:07:21.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.209+0000 7f058dffb700 1 -- 172.21.15.123:0/2025141891 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f0590059e60 con 0x7f059c0ce690 2024-09-13T17:07:21.216 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:21.217 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:21.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.213+0000 7f05a2038700 1 -- 172.21.15.123:0/2025141891 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0580066730 msgr2=0x7f0580068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.213+0000 7f05a2038700 1 --2- 172.21.15.123:0/2025141891 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0580066730 0x7f0580068bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0598006d70 tx=0x7f05980092e0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.213+0000 7f05a2038700 1 -- 172.21.15.123:0/2025141891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f059c0ce690 msgr2=0x7f059c154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.213+0000 7f05a2038700 1 --2- 172.21.15.123:0/2025141891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f059c0ce690 0x7f059c154c30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0590016000 tx=0x7f0590004770 comp rx=0 tx=0).stop 2024-09-13T17:07:21.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.213+0000 7f05a2038700 1 -- 172.21.15.123:0/2025141891 shutdown_connections 2024-09-13T17:07:21.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.213+0000 7f05a2038700 1 --2- 172.21.15.123:0/2025141891 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0580066730 0x7f0580068bf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.213+0000 7f05a2038700 1 --2- 172.21.15.123:0/2025141891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f059c15a9d0 0x7f059c1edf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.213+0000 7f05a2038700 1 --2- 172.21.15.123:0/2025141891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f059c0ce690 0x7f059c154c30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.213+0000 7f05a2038700 1 --2- 172.21.15.123:0/2025141891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f059c0cce80 0x7f059c1546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.213+0000 7f05a2038700 1 -- 172.21.15.123:0/2025141891 >> 172.21.15.123:0/2025141891 conn(0x7f059c066150 msgr2=0x7f059c06c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:21.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.213+0000 7f05a2038700 1 -- 172.21.15.123:0/2025141891 shutdown_connections 2024-09-13T17:07:21.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.213+0000 7f05a2038700 1 -- 172.21.15.123:0/2025141891 wait complete. 2024-09-13T17:07:21.231 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:21.232 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:21.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.345+0000 7f8463352700 1 Processor -- start 2024-09-13T17:07:21.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.345+0000 7f8463352700 1 -- start start 2024-09-13T17:07:21.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.345+0000 7f8463352700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f845c0d0f40 0x7f845c0d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.345+0000 7f8463352700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c0d0cb0 con 0x7f845c0b58b0 2024-09-13T17:07:21.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.345+0000 7f8463352700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c0b0060 con 0x7f845c0cd5e0 2024-09-13T17:07:21.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.345+0000 7f8463352700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c0b0340 con 0x7f845c0d0f40 2024-09-13T17:07:21.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.345+0000 7f8462350700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f845c0d0f40 0x7f845c0d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.345+0000 7f8462350700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f845c0d0f40 0x7f845c0d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57186/0 (socket says 172.21.15.123:57186) 2024-09-13T17:07:21.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.345+0000 7f8462350700 1 -- 172.21.15.123:0/2628487333 learned_addr learned my addr 172.21.15.123:0/2628487333 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:21.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.345+0000 7f8462350700 1 -- 172.21.15.123:0/2628487333 >> v1:172.21.15.153:6789/0 conn(0x7f845c0cd5e0 legacy=0x7f845c0cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.345+0000 7f8462350700 1 -- 172.21.15.123:0/2628487333 >> v1:172.21.15.123:6789/0 conn(0x7f845c0b58b0 legacy=0x7f845c0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.345+0000 7f8462350700 1 -- 172.21.15.123:0/2628487333 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c0b0620 con 0x7f845c0d0f40 2024-09-13T17:07:21.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.349+0000 7f8462350700 1 --2- 172.21.15.123:0/2628487333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c0d0f40 0x7f845c0d1320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8454009e50 tx=0x7f845400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807f4336c430a09a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:21.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.349+0000 7f846134e700 1 -- 172.21.15.123:0/2628487333 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845400e070 con 0x7f845c0d0f40 2024-09-13T17:07:21.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.349+0000 7f846134e700 1 -- 172.21.15.123:0/2628487333 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845400b9c0 con 0x7f845c0d0f40 2024-09-13T17:07:21.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.349+0000 7f846134e700 1 -- 172.21.15.123:0/2628487333 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845400bd70 con 0x7f845c0d0f40 2024-09-13T17:07:21.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.349+0000 7f8463352700 1 -- 172.21.15.123:0/2628487333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c0d0f40 msgr2=0x7f845c0d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.349+0000 7f8463352700 1 --2- 172.21.15.123:0/2628487333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c0d0f40 0x7f845c0d1320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8454009e50 tx=0x7f845400b330 comp rx=0 tx=0).stop 2024-09-13T17:07:21.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.349+0000 7f8463352700 1 -- 172.21.15.123:0/2628487333 shutdown_connections 2024-09-13T17:07:21.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.349+0000 7f8463352700 1 --2- 172.21.15.123:0/2628487333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c0d0f40 0x7f845c0d1320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.349+0000 7f8463352700 1 -- 172.21.15.123:0/2628487333 >> 172.21.15.123:0/2628487333 conn(0x7f845c0d2a60 msgr2=0x7f845c0d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:21.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.349+0000 7f8463352700 1 -- 172.21.15.123:0/2628487333 shutdown_connections 2024-09-13T17:07:21.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.349+0000 7f8463352700 1 -- 172.21.15.123:0/2628487333 wait complete. 2024-09-13T17:07:21.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.349+0000 7f8463352700 1 Processor -- start 2024-09-13T17:07:21.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.349+0000 7f8463352700 1 -- start start 2024-09-13T17:07:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8463352700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c0b58b0 0x7f845c0c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8463352700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f845c0cd5e0 0x7f845c14ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8463352700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f845c0d0f40 0x7f845c14cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8463352700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c14d480 con 0x7f845c0b58b0 2024-09-13T17:07:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8463352700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0b27b0 con 0x7f845c0d0f40 2024-09-13T17:07:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8463352700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c1e7320 con 0x7f845c0cd5e0 2024-09-13T17:07:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8462350700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c0b58b0 0x7f845c0c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8462350700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c0b58b0 0x7f845c0c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57200/0 (socket says 172.21.15.123:57200) 2024-09-13T17:07:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8462350700 1 -- 172.21.15.123:0/4016251047 learned_addr learned my addr 172.21.15.123:0/4016251047 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8462b51700 1 --2- 172.21.15.123:0/4016251047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f845c0d0f40 0x7f845c14cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8461b4f700 1 --2- 172.21.15.123:0/4016251047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f845c0cd5e0 0x7f845c14ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8462350700 1 -- 172.21.15.123:0/4016251047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f845c0cd5e0 msgr2=0x7f845c14ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8462350700 1 --2- 172.21.15.123:0/4016251047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f845c0cd5e0 0x7f845c14ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8462350700 1 -- 172.21.15.123:0/4016251047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f845c0d0f40 msgr2=0x7f845c14cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8462350700 1 --2- 172.21.15.123:0/4016251047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f845c0d0f40 0x7f845c14cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8462350700 1 -- 172.21.15.123:0/4016251047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8454009b30 con 0x7f845c0b58b0 2024-09-13T17:07:21.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8462350700 1 --2- 172.21.15.123:0/4016251047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c0b58b0 0x7f845c0c8410 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f845c0d29c0 tx=0x7f8454004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:21.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f845affd700 1 -- 172.21.15.123:0/4016251047 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454004880 con 0x7f845c0b58b0 2024-09-13T17:07:21.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f845affd700 1 -- 172.21.15.123:0/4016251047 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84540099b0 con 0x7f845c0b58b0 2024-09-13T17:07:21.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8463352700 1 -- 172.21.15.123:0/4016251047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c0b29c0 con 0x7f845c0b58b0 2024-09-13T17:07:21.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f845affd700 1 -- 172.21.15.123:0/4016251047 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845401b670 con 0x7f845c0b58b0 2024-09-13T17:07:21.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.353+0000 7f8463352700 1 -- 172.21.15.123:0/4016251047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c0b2f80 con 0x7f845c0b58b0 2024-09-13T17:07:21.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.357+0000 7f8463352700 1 -- 172.21.15.123:0/4016251047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c0712b0 con 0x7f845c0b58b0 2024-09-13T17:07:21.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.357+0000 7f845affd700 1 -- 172.21.15.123:0/4016251047 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f845401b7d0 con 0x7f845c0b58b0 2024-09-13T17:07:21.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.357+0000 7f845affd700 1 --2- 172.21.15.123:0/4016251047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8448066730 0x7f8448068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.357+0000 7f845affd700 1 -- 172.21.15.123:0/4016251047 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84540857f0 con 0x7f845c0b58b0 2024-09-13T17:07:21.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.357+0000 7f8461b4f700 1 --2- 172.21.15.123:0/4016251047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8448066730 0x7f8448068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.357+0000 7f8461b4f700 1 --2- 172.21.15.123:0/4016251047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8448066730 0x7f8448068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f845c1e7810 tx=0x7f8450009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:21.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.365+0000 7f845affd700 1 -- 172.21.15.123:0/4016251047 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8454052b50 con 0x7f845c0b58b0 2024-09-13T17:07:21.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.537+0000 7f8463352700 1 -- 172.21.15.123:0/4016251047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f845c0b7c00 con 0x7f845c0b58b0 2024-09-13T17:07:21.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.537+0000 7f845affd700 1 -- 172.21.15.123:0/4016251047 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8454056170 con 0x7f845c0b58b0 2024-09-13T17:07:21.545 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:21.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.541+0000 7f8463352700 1 -- 172.21.15.123:0/4016251047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8448066730 msgr2=0x7f8448068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.541+0000 7f8463352700 1 --2- 172.21.15.123:0/4016251047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8448066730 0x7f8448068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f845c1e7810 tx=0x7f8450009040 comp rx=0 tx=0).stop 2024-09-13T17:07:21.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.541+0000 7f8463352700 1 -- 172.21.15.123:0/4016251047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c0b58b0 msgr2=0x7f845c0c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.541+0000 7f8463352700 1 --2- 172.21.15.123:0/4016251047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c0b58b0 0x7f845c0c8410 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f845c0d29c0 tx=0x7f8454004af0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.541+0000 7f8463352700 1 -- 172.21.15.123:0/4016251047 shutdown_connections 2024-09-13T17:07:21.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.541+0000 7f8463352700 1 --2- 172.21.15.123:0/4016251047 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8448066730 0x7f8448068bf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.541+0000 7f8463352700 1 --2- 172.21.15.123:0/4016251047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f845c0d0f40 0x7f845c14cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.541+0000 7f8463352700 1 --2- 172.21.15.123:0/4016251047 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f845c0cd5e0 0x7f845c14ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.541+0000 7f8463352700 1 --2- 172.21.15.123:0/4016251047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f845c0b58b0 0x7f845c0c8410 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.541+0000 7f8463352700 1 -- 172.21.15.123:0/4016251047 >> 172.21.15.123:0/4016251047 conn(0x7f845c0d2a60 msgr2=0x7f845c070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:21.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.541+0000 7f8463352700 1 -- 172.21.15.123:0/4016251047 shutdown_connections 2024-09-13T17:07:21.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.541+0000 7f8463352700 1 -- 172.21.15.123:0/4016251047 wait complete. 2024-09-13T17:07:21.560 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:07:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.673+0000 7fec22e75700 1 Processor -- start 2024-09-13T17:07:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.673+0000 7fec22e75700 1 -- start start 2024-09-13T17:07:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.673+0000 7fec22e75700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec1c159c60 0x7fec1c15e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.673+0000 7fec22e75700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fec1c070f90 0x7fec1c0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.673+0000 7fec22e75700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1c0ada60 con 0x7fec1c0cdbd0 2024-09-13T17:07:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.673+0000 7fec22e75700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c15e680 con 0x7fec1c159c60 2024-09-13T17:07:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.673+0000 7fec22e75700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c0ce020 con 0x7fec1c070f90 2024-09-13T17:07:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.673+0000 7fec21e73700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec1c159c60 0x7fec1c15e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.673+0000 7fec22674700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fec1c0cdbd0 0x7fec1c0cb090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56100/0 (socket says 172.21.15.123:56100) 2024-09-13T17:07:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.673+0000 7fec22674700 1 -- 172.21.15.123:0/3366502544 learned_addr learned my addr 172.21.15.123:0/3366502544 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.673+0000 7fec21672700 1 --2- 172.21.15.123:0/3366502544 >> v2:172.21.15.153:3300/0 conn(0x7fec1c070f90 0x7fec1c0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.673+0000 7fec20e71700 1 -- 172.21.15.123:0/3366502544 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221423085 0 0) 0x7fec1c0ada60 con 0x7fec1c0cdbd0 2024-09-13T17:07:21.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec20e71700 1 -- 172.21.15.123:0/3366502544 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec080035d0 con 0x7fec1c0cdbd0 2024-09-13T17:07:21.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec21e73700 1 -- 172.21.15.123:0/3366502544 >> v2:172.21.15.153:3300/0 conn(0x7fec1c070f90 msgr2=0x7fec1c0cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:21.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec21e73700 1 --2- 172.21.15.123:0/3366502544 >> v2:172.21.15.153:3300/0 conn(0x7fec1c070f90 0x7fec1c0cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec21e73700 1 -- 172.21.15.123:0/3366502544 >> v1:172.21.15.123:6789/0 conn(0x7fec1c0cdbd0 legacy=0x7fec1c0cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec21e73700 1 -- 172.21.15.123:0/3366502544 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c0720a0 con 0x7fec1c159c60 2024-09-13T17:07:21.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec21e73700 1 --2- 172.21.15.123:0/3366502544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec1c159c60 0x7fec1c15e140 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0c2160 tx=0x7fec0c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b57a9c8c354bd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:21.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec20e71700 1 -- 172.21.15.123:0/3366502544 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c011830 con 0x7fec1c159c60 2024-09-13T17:07:21.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec20e71700 1 -- 172.21.15.123:0/3366502544 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c011990 con 0x7fec1c159c60 2024-09-13T17:07:21.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec20e71700 1 -- 172.21.15.123:0/3366502544 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c011d20 con 0x7fec1c159c60 2024-09-13T17:07:21.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec22e75700 1 -- 172.21.15.123:0/3366502544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec1c159c60 msgr2=0x7fec1c15e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec22e75700 1 --2- 172.21.15.123:0/3366502544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec1c159c60 0x7fec1c15e140 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0c2160 tx=0x7fec0c009b30 comp rx=0 tx=0).stop 2024-09-13T17:07:21.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec22e75700 1 -- 172.21.15.123:0/3366502544 shutdown_connections 2024-09-13T17:07:21.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec22e75700 1 --2- 172.21.15.123:0/3366502544 >> v2:172.21.15.153:3300/0 conn(0x7fec1c070f90 0x7fec1c0cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec22e75700 1 --2- 172.21.15.123:0/3366502544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec1c159c60 0x7fec1c15e140 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec22e75700 1 -- 172.21.15.123:0/3366502544 >> 172.21.15.123:0/3366502544 conn(0x7fec1c0b01d0 msgr2=0x7fec1c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:21.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec22e75700 1 -- 172.21.15.123:0/3366502544 shutdown_connections 2024-09-13T17:07:21.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec22e75700 1 -- 172.21.15.123:0/3366502544 wait complete. 2024-09-13T17:07:21.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec22e75700 1 Processor -- start 2024-09-13T17:07:21.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.677+0000 7fec22e75700 1 -- start start 2024-09-13T17:07:21.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22e75700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec1c070f90 0x7fec1c1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22e75700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec1c0cdbd0 0x7fec1c0c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22e75700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec1c1533d0 0x7fec1c06d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22e75700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0b14d0 con 0x7fec1c1533d0 2024-09-13T17:07:21.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22e75700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0b1a90 con 0x7fec1c0cdbd0 2024-09-13T17:07:21.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22e75700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c1538d0 con 0x7fec1c070f90 2024-09-13T17:07:21.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22674700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec1c1533d0 0x7fec1c06d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22674700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec1c1533d0 0x7fec1c06d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57218/0 (socket says 172.21.15.123:57218) 2024-09-13T17:07:21.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22674700 1 -- 172.21.15.123:0/2496885808 learned_addr learned my addr 172.21.15.123:0/2496885808 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:21.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec21e73700 1 --2- 172.21.15.123:0/2496885808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec1c070f90 0x7fec1c1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec21672700 1 --2- 172.21.15.123:0/2496885808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec1c0cdbd0 0x7fec1c0c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22674700 1 -- 172.21.15.123:0/2496885808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec1c070f90 msgr2=0x7fec1c1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22674700 1 --2- 172.21.15.123:0/2496885808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec1c070f90 0x7fec1c1521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22674700 1 -- 172.21.15.123:0/2496885808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec1c0cdbd0 msgr2=0x7fec1c0c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22674700 1 --2- 172.21.15.123:0/2496885808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec1c0cdbd0 0x7fec1c0c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22674700 1 -- 172.21.15.123:0/2496885808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0094b0 con 0x7fec1c1533d0 2024-09-13T17:07:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22674700 1 --2- 172.21.15.123:0/2496885808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec1c1533d0 0x7fec1c06d6a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fec1400cb70 tx=0x7fec1400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec127fc700 1 -- 172.21.15.123:0/2496885808 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400a9a0 con 0x7fec1c1533d0 2024-09-13T17:07:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec127fc700 1 -- 172.21.15.123:0/2496885808 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1400ce90 con 0x7fec1c1533d0 2024-09-13T17:07:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22e75700 1 -- 172.21.15.123:0/2496885808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1c153bb0 con 0x7fec1c1533d0 2024-09-13T17:07:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec127fc700 1 -- 172.21.15.123:0/2496885808 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400ad20 con 0x7fec1c1533d0 2024-09-13T17:07:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22e75700 1 -- 172.21.15.123:0/2496885808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c152700 con 0x7fec1c1533d0 2024-09-13T17:07:21.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.681+0000 7fec22e75700 1 -- 172.21.15.123:0/2496885808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1c072510 con 0x7fec1c1533d0 2024-09-13T17:07:21.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.685+0000 7fec127fc700 1 -- 172.21.15.123:0/2496885808 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fec1401b3b0 con 0x7fec1c1533d0 2024-09-13T17:07:21.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.685+0000 7fec127fc700 1 --2- 172.21.15.123:0/2496885808 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec00066730 0x7fec00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:21.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.685+0000 7fec21e73700 1 --2- 172.21.15.123:0/2496885808 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec00066730 0x7fec00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:21.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.685+0000 7fec127fc700 1 -- 172.21.15.123:0/2496885808 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec14083f70 con 0x7fec1c1533d0 2024-09-13T17:07:21.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.685+0000 7fec21e73700 1 --2- 172.21.15.123:0/2496885808 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec00066730 0x7fec00068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0cf780 tx=0x7fec0c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:21.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.697+0000 7fec127fc700 1 -- 172.21.15.123:0/2496885808 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fec140512c0 con 0x7fec1c1533d0 2024-09-13T17:07:21.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.865+0000 7fec22e75700 1 -- 172.21.15.123:0/2496885808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec1c072510 con 0x7fec1c1533d0 2024-09-13T17:07:21.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.865+0000 7fec127fc700 1 -- 172.21.15.123:0/2496885808 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fec1c072510 con 0x7fec1c1533d0 2024-09-13T17:07:21.873 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:07:21.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.865+0000 7fec22e75700 1 -- 172.21.15.123:0/2496885808 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec00066730 msgr2=0x7fec00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.865+0000 7fec22e75700 1 --2- 172.21.15.123:0/2496885808 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec00066730 0x7fec00068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0cf780 tx=0x7fec0c008030 comp rx=0 tx=0).stop 2024-09-13T17:07:21.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.865+0000 7fec22e75700 1 -- 172.21.15.123:0/2496885808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec1c1533d0 msgr2=0x7fec1c06d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:21.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.865+0000 7fec22e75700 1 --2- 172.21.15.123:0/2496885808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec1c1533d0 0x7fec1c06d6a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fec1400cb70 tx=0x7fec1400cc50 comp rx=0 tx=0).stop 2024-09-13T17:07:21.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.865+0000 7fec22e75700 1 -- 172.21.15.123:0/2496885808 shutdown_connections 2024-09-13T17:07:21.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.865+0000 7fec22e75700 1 --2- 172.21.15.123:0/2496885808 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec00066730 0x7fec00068bf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.865+0000 7fec22e75700 1 --2- 172.21.15.123:0/2496885808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec1c1533d0 0x7fec1c06d6a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.865+0000 7fec22e75700 1 --2- 172.21.15.123:0/2496885808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec1c0cdbd0 0x7fec1c0c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.865+0000 7fec22e75700 1 --2- 172.21.15.123:0/2496885808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec1c070f90 0x7fec1c1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:21.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.865+0000 7fec22e75700 1 -- 172.21.15.123:0/2496885808 >> 172.21.15.123:0/2496885808 conn(0x7fec1c0b01d0 msgr2=0x7fec1c0af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:21.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.865+0000 7fec22e75700 1 -- 172.21.15.123:0/2496885808 shutdown_connections 2024-09-13T17:07:21.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.865+0000 7fec22e75700 1 -- 172.21.15.123:0/2496885808 wait complete. 2024-09-13T17:07:21.885 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:07:22.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.997+0000 7fdf71e6e700 1 Processor -- start 2024-09-13T17:07:22.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:21.997+0000 7fdf71e6e700 1 -- start start 2024-09-13T17:07:22.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf71e6e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdf6c0d0f40 0x7fdf6c0d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf71e6e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c0cd5e0 0x7fdf6c0cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf71e6e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6c0d0cb0 con 0x7fdf6c0b58b0 2024-09-13T17:07:22.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf71e6e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c0b0060 con 0x7fdf6c0d0f40 2024-09-13T17:07:22.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf71e6e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c0b0340 con 0x7fdf6c0cd5e0 2024-09-13T17:07:22.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf70e6c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdf6c0d0f40 0x7fdf6c0d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf6bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdf6c0b58b0 0x7fdf6c0d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49818/0 (socket says 172.21.15.123:49818) 2024-09-13T17:07:22.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf6bfff700 1 -- 172.21.15.123:0/892622748 learned_addr learned my addr 172.21.15.123:0/892622748 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:22.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf7166d700 1 --2- 172.21.15.123:0/892622748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c0cd5e0 0x7fdf6c0cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf6b7fe700 1 -- 172.21.15.123:0/892622748 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166375272 0 0) 0x7fdf6c0d0cb0 con 0x7fdf6c0b58b0 2024-09-13T17:07:22.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf6b7fe700 1 -- 172.21.15.123:0/892622748 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf580035d0 con 0x7fdf6c0b58b0 2024-09-13T17:07:22.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf70e6c700 1 -- 172.21.15.123:0/892622748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c0cd5e0 msgr2=0x7fdf6c0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:22.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf70e6c700 1 --2- 172.21.15.123:0/892622748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c0cd5e0 0x7fdf6c0cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf70e6c700 1 -- 172.21.15.123:0/892622748 >> v1:172.21.15.123:6789/0 conn(0x7fdf6c0b58b0 legacy=0x7fdf6c0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf70e6c700 1 -- 172.21.15.123:0/892622748 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c0b0620 con 0x7fdf6c0d0f40 2024-09-13T17:07:22.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf70e6c700 1 --2- 172.21.15.123:0/892622748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf6c0d0f40 0x7fdf6c0d1320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009850 tx=0x7fdf5c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b76f03ecd7de6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf6b7fe700 1 -- 172.21.15.123:0/892622748 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c011830 con 0x7fdf6c0d0f40 2024-09-13T17:07:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf6b7fe700 1 -- 172.21.15.123:0/892622748 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5c011990 con 0x7fdf6c0d0f40 2024-09-13T17:07:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf6b7fe700 1 -- 172.21.15.123:0/892622748 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c011d40 con 0x7fdf6c0d0f40 2024-09-13T17:07:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf71e6e700 1 -- 172.21.15.123:0/892622748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf6c0d0f40 msgr2=0x7fdf6c0d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf71e6e700 1 --2- 172.21.15.123:0/892622748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf6c0d0f40 0x7fdf6c0d1320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009850 tx=0x7fdf5c009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf71e6e700 1 -- 172.21.15.123:0/892622748 shutdown_connections 2024-09-13T17:07:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf71e6e700 1 --2- 172.21.15.123:0/892622748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c0cd5e0 0x7fdf6c0cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf71e6e700 1 --2- 172.21.15.123:0/892622748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf6c0d0f40 0x7fdf6c0d1320 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf71e6e700 1 -- 172.21.15.123:0/892622748 >> 172.21.15.123:0/892622748 conn(0x7fdf6c0d2a60 msgr2=0x7fdf6c0d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf71e6e700 1 -- 172.21.15.123:0/892622748 shutdown_connections 2024-09-13T17:07:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.001+0000 7fdf71e6e700 1 -- 172.21.15.123:0/892622748 wait complete. 2024-09-13T17:07:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf71e6e700 1 Processor -- start 2024-09-13T17:07:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf71e6e700 1 -- start start 2024-09-13T17:07:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf71e6e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c0b58b0 0x7fdf6c0b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf71e6e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf6c0cd5e0 0x7fdf6c14ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf71e6e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf6c0d0f40 0x7fdf6c0b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf71e6e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c0b5490 con 0x7fdf6c0cd5e0 2024-09-13T17:07:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf71e6e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c157510 con 0x7fdf6c0d0f40 2024-09-13T17:07:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf71e6e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c0b6b30 con 0x7fdf6c0b58b0 2024-09-13T17:07:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf6bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf6c0cd5e0 0x7fdf6c14ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf6bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf6c0cd5e0 0x7fdf6c14ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48728/0 (socket says 172.21.15.123:48728) 2024-09-13T17:07:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf6bfff700 1 -- 172.21.15.123:0/3842916434 learned_addr learned my addr 172.21.15.123:0/3842916434 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf70e6c700 1 --2- 172.21.15.123:0/3842916434 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c0b58b0 0x7fdf6c0b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf7166d700 1 --2- 172.21.15.123:0/3842916434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf6c0d0f40 0x7fdf6c0b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf6bfff700 1 -- 172.21.15.123:0/3842916434 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c0b58b0 msgr2=0x7fdf6c0b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf6bfff700 1 --2- 172.21.15.123:0/3842916434 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c0b58b0 0x7fdf6c0b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf6bfff700 1 -- 172.21.15.123:0/3842916434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf6c0d0f40 msgr2=0x7fdf6c0b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf6bfff700 1 --2- 172.21.15.123:0/3842916434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf6c0d0f40 0x7fdf6c0b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf6bfff700 1 -- 172.21.15.123:0/3842916434 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c0094b0 con 0x7fdf6c0cd5e0 2024-09-13T17:07:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.005+0000 7fdf6bfff700 1 --2- 172.21.15.123:0/3842916434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf6c0cd5e0 0x7fdf6c14ad50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c4d0 tx=0x7fdf5400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.009+0000 7fdf697fa700 1 -- 172.21.15.123:0/3842916434 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54005d90 con 0x7fdf6c0cd5e0 2024-09-13T17:07:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.009+0000 7fdf697fa700 1 -- 172.21.15.123:0/3842916434 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf540070d0 con 0x7fdf6c0cd5e0 2024-09-13T17:07:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.009+0000 7fdf71e6e700 1 -- 172.21.15.123:0/3842916434 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf6c0b6df0 con 0x7fdf6c0cd5e0 2024-09-13T17:07:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.009+0000 7fdf697fa700 1 -- 172.21.15.123:0/3842916434 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54007480 con 0x7fdf6c0cd5e0 2024-09-13T17:07:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.009+0000 7fdf71e6e700 1 -- 172.21.15.123:0/3842916434 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6c0b73b0 con 0x7fdf6c0cd5e0 2024-09-13T17:07:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.009+0000 7fdf71e6e700 1 -- 172.21.15.123:0/3842916434 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6c08c250 con 0x7fdf6c0cd5e0 2024-09-13T17:07:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.009+0000 7fdf697fa700 1 -- 172.21.15.123:0/3842916434 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdf540075e0 con 0x7fdf6c0cd5e0 2024-09-13T17:07:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.009+0000 7fdf697fa700 1 --2- 172.21.15.123:0/3842916434 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdf4c066760 0x7fdf4c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.013+0000 7fdf70e6c700 1 --2- 172.21.15.123:0/3842916434 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdf4c066760 0x7fdf4c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.013+0000 7fdf697fa700 1 -- 172.21.15.123:0/3842916434 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf54083650 con 0x7fdf6c0cd5e0 2024-09-13T17:07:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.013+0000 7fdf70e6c700 1 --2- 172.21.15.123:0/3842916434 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdf4c066760 0x7fdf4c068c20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c0090b0 tx=0x7fdf5c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:22.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.017+0000 7fdf697fa700 1 -- 172.21.15.123:0/3842916434 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdf540509d0 con 0x7fdf6c0cd5e0 2024-09-13T17:07:22.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.185+0000 7fdf71e6e700 1 -- 172.21.15.123:0/3842916434 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf6c0742e0 con 0x7fdf6c0cd5e0 2024-09-13T17:07:22.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.185+0000 7fdf697fa700 1 -- 172.21.15.123:0/3842916434 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf54053ff0 con 0x7fdf6c0cd5e0 2024-09-13T17:07:22.191 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:07:22.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.185+0000 7fdf71e6e700 1 -- 172.21.15.123:0/3842916434 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdf4c066760 msgr2=0x7fdf4c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.185+0000 7fdf71e6e700 1 --2- 172.21.15.123:0/3842916434 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdf4c066760 0x7fdf4c068c20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c0090b0 tx=0x7fdf5c008030 comp rx=0 tx=0).stop 2024-09-13T17:07:22.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.185+0000 7fdf71e6e700 1 -- 172.21.15.123:0/3842916434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf6c0cd5e0 msgr2=0x7fdf6c14ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.185+0000 7fdf71e6e700 1 --2- 172.21.15.123:0/3842916434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf6c0cd5e0 0x7fdf6c14ad50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c4d0 tx=0x7fdf5400c890 comp rx=0 tx=0).stop 2024-09-13T17:07:22.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.185+0000 7fdf71e6e700 1 -- 172.21.15.123:0/3842916434 shutdown_connections 2024-09-13T17:07:22.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.185+0000 7fdf71e6e700 1 --2- 172.21.15.123:0/3842916434 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdf4c066760 0x7fdf4c068c20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.185+0000 7fdf71e6e700 1 --2- 172.21.15.123:0/3842916434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf6c0d0f40 0x7fdf6c0b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.185+0000 7fdf71e6e700 1 --2- 172.21.15.123:0/3842916434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf6c0cd5e0 0x7fdf6c14ad50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.185+0000 7fdf71e6e700 1 --2- 172.21.15.123:0/3842916434 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf6c0b58b0 0x7fdf6c0b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.185+0000 7fdf71e6e700 1 -- 172.21.15.123:0/3842916434 >> 172.21.15.123:0/3842916434 conn(0x7fdf6c0d2a60 msgr2=0x7fdf6c0c9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:22.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.185+0000 7fdf71e6e700 1 -- 172.21.15.123:0/3842916434 shutdown_connections 2024-09-13T17:07:22.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.185+0000 7fdf71e6e700 1 -- 172.21.15.123:0/3842916434 wait complete. 2024-09-13T17:07:22.206 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:07:22.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 Processor -- start 2024-09-13T17:07:22.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 -- start start 2024-09-13T17:07:22.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd71815ae50 0x7fd7180cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd7180cb040 0x7fd71806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7180cbd80 con 0x7fd71806c140 2024-09-13T17:07:22.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7180b1910 con 0x7fd7180cb040 2024-09-13T17:07:22.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7180cb4e0 con 0x7fd71815ae50 2024-09-13T17:07:22.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71cc11700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd7180cb040 0x7fd71806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71d412700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd71815ae50 0x7fd7180cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71cc11700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd7180cb040 0x7fd71806d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48732/0 (socket says 172.21.15.123:48732) 2024-09-13T17:07:22.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71cc11700 1 -- 172.21.15.123:0/3772581199 learned_addr learned my addr 172.21.15.123:0/3772581199 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:22.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71dc13700 1 --1- 172.21.15.123:0/3772581199 >> v1:172.21.15.153:6789/0 conn(0x7fd71806c140 0x7fd7180ae510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:50982/0 (socket says 172.21.15.123:50982) 2024-09-13T17:07:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd717fff700 1 -- 172.21.15.123:0/3772581199 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486883207 0 0) 0x7fd7180cbd80 con 0x7fd71806c140 2024-09-13T17:07:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd717fff700 1 -- 172.21.15.123:0/3772581199 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7000035d0 con 0x7fd71806c140 2024-09-13T17:07:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71d412700 1 -- 172.21.15.123:0/3772581199 >> v2:172.21.15.123:3300/0 conn(0x7fd7180cb040 msgr2=0x7fd71806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71d412700 1 --2- 172.21.15.123:0/3772581199 >> v2:172.21.15.123:3300/0 conn(0x7fd7180cb040 0x7fd71806d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71d412700 1 -- 172.21.15.123:0/3772581199 >> v1:172.21.15.153:6789/0 conn(0x7fd71806c140 legacy=0x7fd7180ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71d412700 1 -- 172.21.15.123:0/3772581199 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7180cb7c0 con 0x7fd71815ae50 2024-09-13T17:07:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71cc11700 1 --2- 172.21.15.123:0/3772581199 >> v2:172.21.15.123:3300/0 conn(0x7fd7180cb040 0x7fd71806d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71d412700 1 --2- 172.21.15.123:0/3772581199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71815ae50 0x7fd7180cab00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd7180ce660 tx=0x7fd71000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89d665e40e1f78d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd717fff700 1 -- 172.21.15.123:0/3772581199 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71000e070 con 0x7fd71815ae50 2024-09-13T17:07:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd717fff700 1 -- 172.21.15.123:0/3772581199 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71000bb20 con 0x7fd71815ae50 2024-09-13T17:07:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd717fff700 1 -- 172.21.15.123:0/3772581199 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd710012430 con 0x7fd71815ae50 2024-09-13T17:07:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 -- 172.21.15.123:0/3772581199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71815ae50 msgr2=0x7fd7180cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 --2- 172.21.15.123:0/3772581199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71815ae50 0x7fd7180cab00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd7180ce660 tx=0x7fd71000b330 comp rx=0 tx=0).stop 2024-09-13T17:07:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 -- 172.21.15.123:0/3772581199 shutdown_connections 2024-09-13T17:07:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 --2- 172.21.15.123:0/3772581199 >> v2:172.21.15.123:3300/0 conn(0x7fd7180cb040 0x7fd71806d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 --2- 172.21.15.123:0/3772581199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71815ae50 0x7fd7180cab00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 -- 172.21.15.123:0/3772581199 >> 172.21.15.123:0/3772581199 conn(0x7fd7180b0450 msgr2=0x7fd7180b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 -- 172.21.15.123:0/3772581199 shutdown_connections 2024-09-13T17:07:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.313+0000 7fd71f676700 1 -- 172.21.15.123:0/3772581199 wait complete. 2024-09-13T17:07:22.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71f676700 1 Processor -- start 2024-09-13T17:07:22.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71f676700 1 -- start start 2024-09-13T17:07:22.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71f676700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd71806c140 0x7fd718149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71f676700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7180cb040 0x7fd71814fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71f676700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71815ae50 0x7fd718150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71f676700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180c4dc0 con 0x7fd7180cb040 2024-09-13T17:07:22.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71f676700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71814d6c0 con 0x7fd71815ae50 2024-09-13T17:07:22.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71f676700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180c4ae0 con 0x7fd71806c140 2024-09-13T17:07:22.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71cc11700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7180cb040 0x7fd71814fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71cc11700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7180cb040 0x7fd71814fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48746/0 (socket says 172.21.15.123:48746) 2024-09-13T17:07:22.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71cc11700 1 -- 172.21.15.123:0/237305104 learned_addr learned my addr 172.21.15.123:0/237305104 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:22.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71d412700 1 --2- 172.21.15.123:0/237305104 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd71806c140 0x7fd718149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71dc13700 1 --2- 172.21.15.123:0/237305104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71815ae50 0x7fd718150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71cc11700 1 -- 172.21.15.123:0/237305104 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd71806c140 msgr2=0x7fd718149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71cc11700 1 --2- 172.21.15.123:0/237305104 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd71806c140 0x7fd718149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71cc11700 1 -- 172.21.15.123:0/237305104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71815ae50 msgr2=0x7fd718150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71cc11700 1 --2- 172.21.15.123:0/237305104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71815ae50 0x7fd718150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71cc11700 1 -- 172.21.15.123:0/237305104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c009570 con 0x7fd7180cb040 2024-09-13T17:07:22.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71cc11700 1 --2- 172.21.15.123:0/237305104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7180cb040 0x7fd71814fd20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00ec10 tx=0x7fd70c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:22.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd715ffb700 1 -- 172.21.15.123:0/237305104 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00c850 con 0x7fd7180cb040 2024-09-13T17:07:22.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd715ffb700 1 -- 172.21.15.123:0/237305104 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c00c9b0 con 0x7fd7180cb040 2024-09-13T17:07:22.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71f676700 1 -- 172.21.15.123:0/237305104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd710009a70 con 0x7fd7180cb040 2024-09-13T17:07:22.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd715ffb700 1 -- 172.21.15.123:0/237305104 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00cd20 con 0x7fd7180cb040 2024-09-13T17:07:22.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.317+0000 7fd71f676700 1 -- 172.21.15.123:0/237305104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71814a650 con 0x7fd7180cb040 2024-09-13T17:07:22.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.321+0000 7fd71f676700 1 -- 172.21.15.123:0/237305104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71814a1d0 con 0x7fd7180cb040 2024-09-13T17:07:22.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.321+0000 7fd715ffb700 1 -- 172.21.15.123:0/237305104 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd70c013470 con 0x7fd7180cb040 2024-09-13T17:07:22.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.321+0000 7fd715ffb700 1 --2- 172.21.15.123:0/237305104 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd704066730 0x7fd704068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.321+0000 7fd715ffb700 1 -- 172.21.15.123:0/237305104 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd70c0840e0 con 0x7fd7180cb040 2024-09-13T17:07:22.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.321+0000 7fd71d412700 1 --2- 172.21.15.123:0/237305104 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd704066730 0x7fd704068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.321+0000 7fd71d412700 1 --2- 172.21.15.123:0/237305104 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd704066730 0x7fd704068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd710014040 tx=0x7fd710011000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:22.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.329+0000 7fd715ffb700 1 -- 172.21.15.123:0/237305104 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd71814a1d0 con 0x7fd7180cb040 2024-09-13T17:07:22.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.505+0000 7fd71f676700 1 -- 172.21.15.123:0/237305104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd71814a1d0 con 0x7fd7180cb040 2024-09-13T17:07:22.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.505+0000 7fd715ffb700 1 -- 172.21.15.123:0/237305104 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd71814a1d0 con 0x7fd7180cb040 2024-09-13T17:07:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.509+0000 7fd71f676700 1 -- 172.21.15.123:0/237305104 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd704066730 msgr2=0x7fd704068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.509+0000 7fd71f676700 1 --2- 172.21.15.123:0/237305104 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd704066730 0x7fd704068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd710014040 tx=0x7fd710011000 comp rx=0 tx=0).stop 2024-09-13T17:07:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.509+0000 7fd71f676700 1 -- 172.21.15.123:0/237305104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7180cb040 msgr2=0x7fd71814fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.509+0000 7fd71f676700 1 --2- 172.21.15.123:0/237305104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7180cb040 0x7fd71814fd20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00ec10 tx=0x7fd70c00ef20 comp rx=0 tx=0).stop 2024-09-13T17:07:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.509+0000 7fd71f676700 1 -- 172.21.15.123:0/237305104 shutdown_connections 2024-09-13T17:07:22.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.509+0000 7fd71f676700 1 --2- 172.21.15.123:0/237305104 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd704066730 0x7fd704068bf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.509+0000 7fd71f676700 1 --2- 172.21.15.123:0/237305104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71815ae50 0x7fd718150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.509+0000 7fd71f676700 1 --2- 172.21.15.123:0/237305104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7180cb040 0x7fd71814fd20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.509+0000 7fd71f676700 1 --2- 172.21.15.123:0/237305104 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd71806c140 0x7fd718149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.509+0000 7fd71f676700 1 -- 172.21.15.123:0/237305104 >> 172.21.15.123:0/237305104 conn(0x7fd7180b0450 msgr2=0x7fd7180b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:22.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.509+0000 7fd71f676700 1 -- 172.21.15.123:0/237305104 shutdown_connections 2024-09-13T17:07:22.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.509+0000 7fd71f676700 1 -- 172.21.15.123:0/237305104 wait complete. 2024-09-13T17:07:22.517 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:07:22.528 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2024-09-13T17:07:22.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:22.528 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:07:22.556 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:07:22.556 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:07:22.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:22.556 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:07:22.596 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:07:22.596 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:07:22.604 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:07:22.604 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:07:22.612 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:22.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee357c9700 1 Processor -- start 2024-09-13T17:07:22.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee357c9700 1 -- start start 2024-09-13T17:07:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee357c9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee300b1760 0x7fee3015d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee357c9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee3015d750 0x7fee300ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee357c9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3015df80 con 0x7fee3013fa60 2024-09-13T17:07:22.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee357c9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee300ac9e0 con 0x7fee3015d750 2024-09-13T17:07:22.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee357c9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee300accc0 con 0x7fee300b1760 2024-09-13T17:07:22.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee2ffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fee3013fa60 0x7fee300b1050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49832/0 (socket says 172.21.15.123:49832) 2024-09-13T17:07:22.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee34fc8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee3015d750 0x7fee300ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee2ffff700 1 -- 172.21.15.123:0/3907179594 learned_addr learned my addr 172.21.15.123:0/3907179594 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:22.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee27fff700 1 --2- 172.21.15.123:0/3907179594 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee300b1760 0x7fee3015d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee34fc8700 1 -- 172.21.15.123:0/3907179594 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee300b1760 msgr2=0x7fee3015d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:22.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee34fc8700 1 --2- 172.21.15.123:0/3907179594 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee300b1760 0x7fee3015d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee34fc8700 1 -- 172.21.15.123:0/3907179594 >> v1:172.21.15.123:6789/0 conn(0x7fee3013fa60 legacy=0x7fee300b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee34fc8700 1 -- 172.21.15.123:0/3907179594 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee300acfa0 con 0x7fee3015d750 2024-09-13T17:07:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee2f7fe700 1 -- 172.21.15.123:0/3907179594 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800986860 0 0) 0x7fee3015df80 con 0x7fee3013fa60 2024-09-13T17:07:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee34fc8700 1 --2- 172.21.15.123:0/3907179594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee3015d750 0x7fee300ad7a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fee28009d90 tx=0x7fee2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd99b5a8b66771a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee2f7fe700 1 -- 172.21.15.123:0/3907179594 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2800e070 con 0x7fee3015d750 2024-09-13T17:07:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee2f7fe700 1 -- 172.21.15.123:0/3907179594 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2800bb20 con 0x7fee3015d750 2024-09-13T17:07:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.729+0000 7fee2f7fe700 1 -- 172.21.15.123:0/3907179594 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28012430 con 0x7fee3015d750 2024-09-13T17:07:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.733+0000 7fee357c9700 1 -- 172.21.15.123:0/3907179594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee3015d750 msgr2=0x7fee300ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.733+0000 7fee357c9700 1 --2- 172.21.15.123:0/3907179594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee3015d750 0x7fee300ad7a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fee28009d90 tx=0x7fee2800b330 comp rx=0 tx=0).stop 2024-09-13T17:07:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.733+0000 7fee357c9700 1 -- 172.21.15.123:0/3907179594 shutdown_connections 2024-09-13T17:07:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.733+0000 7fee357c9700 1 --2- 172.21.15.123:0/3907179594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee3015d750 0x7fee300ad7a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.733+0000 7fee357c9700 1 --2- 172.21.15.123:0/3907179594 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee300b1760 0x7fee3015d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.733+0000 7fee357c9700 1 -- 172.21.15.123:0/3907179594 >> 172.21.15.123:0/3907179594 conn(0x7fee300b4630 msgr2=0x7fee300b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.733+0000 7fee357c9700 1 -- 172.21.15.123:0/3907179594 shutdown_connections 2024-09-13T17:07:22.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.733+0000 7fee357c9700 1 -- 172.21.15.123:0/3907179594 wait complete. 2024-09-13T17:07:22.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee357c9700 1 Processor -- start 2024-09-13T17:07:22.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee357c9700 1 -- start start 2024-09-13T17:07:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee357c9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee300b1760 0x7fee300aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee357c9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee3013fa60 0x7fee301f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee357c9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee3015d750 0x7fee30160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee357c9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee30155290 con 0x7fee3015d750 2024-09-13T17:07:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee357c9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee30154680 con 0x7fee3013fa60 2024-09-13T17:07:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee357c9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee30154960 con 0x7fee300b1760 2024-09-13T17:07:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee34fc8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee3015d750 0x7fee30160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee34fc8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee3015d750 0x7fee30160b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48764/0 (socket says 172.21.15.123:48764) 2024-09-13T17:07:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee34fc8700 1 -- 172.21.15.123:0/4243014996 learned_addr learned my addr 172.21.15.123:0/4243014996 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:22.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee2ffff700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee300b1760 0x7fee300aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee27fff700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee3013fa60 0x7fee301f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee34fc8700 1 -- 172.21.15.123:0/4243014996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee300b1760 msgr2=0x7fee300aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee34fc8700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee300b1760 0x7fee300aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee34fc8700 1 -- 172.21.15.123:0/4243014996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee3013fa60 msgr2=0x7fee301f19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee34fc8700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee3013fa60 0x7fee301f19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee34fc8700 1 -- 172.21.15.123:0/4243014996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee28009a70 con 0x7fee3015d750 2024-09-13T17:07:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee27fff700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee3013fa60 0x7fee301f19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee34fc8700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee3015d750 0x7fee30160b00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fee28014040 tx=0x7fee28004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee2d7fa700 1 -- 172.21.15.123:0/4243014996 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28012430 con 0x7fee3015d750 2024-09-13T17:07:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee2d7fa700 1 -- 172.21.15.123:0/4243014996 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee28020070 con 0x7fee3015d750 2024-09-13T17:07:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee357c9700 1 -- 172.21.15.123:0/4243014996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee30154c40 con 0x7fee3015d750 2024-09-13T17:07:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee2d7fa700 1 -- 172.21.15.123:0/4243014996 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28004280 con 0x7fee3015d750 2024-09-13T17:07:22.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.737+0000 7fee357c9700 1 -- 172.21.15.123:0/4243014996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee300af110 con 0x7fee3015d750 2024-09-13T17:07:22.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.741+0000 7fee357c9700 1 -- 172.21.15.123:0/4243014996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3015d210 con 0x7fee3015d750 2024-09-13T17:07:22.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.741+0000 7fee2d7fa700 1 -- 172.21.15.123:0/4243014996 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fee280043e0 con 0x7fee3015d750 2024-09-13T17:07:22.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.741+0000 7fee2d7fa700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fee10066730 0x7fee10068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:22.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.741+0000 7fee2ffff700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fee10066730 0x7fee10068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:22.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.741+0000 7fee2d7fa700 1 -- 172.21.15.123:0/4243014996 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee28022070 con 0x7fee3015d750 2024-09-13T17:07:22.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.741+0000 7fee2ffff700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fee10066730 0x7fee10068bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fee20000f60 tx=0x7fee20007e00 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:22.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.749+0000 7fee2d7fa700 1 -- 172.21.15.123:0/4243014996 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fee28053630 con 0x7fee3015d750 2024-09-13T17:07:22.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.929+0000 7fee357c9700 1 -- 172.21.15.123:0/4243014996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee30071a80 con 0x7fee3015d750 2024-09-13T17:07:22.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.929+0000 7fee2d7fa700 1 -- 172.21.15.123:0/4243014996 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7fee28056c50 con 0x7fee3015d750 2024-09-13T17:07:22.937 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:22.938 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:22.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.933+0000 7fee357c9700 1 -- 172.21.15.123:0/4243014996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fee10066730 msgr2=0x7fee10068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.933+0000 7fee357c9700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fee10066730 0x7fee10068bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fee20000f60 tx=0x7fee20007e00 comp rx=0 tx=0).stop 2024-09-13T17:07:22.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.933+0000 7fee357c9700 1 -- 172.21.15.123:0/4243014996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee3015d750 msgr2=0x7fee30160b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.933+0000 7fee357c9700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee3015d750 0x7fee30160b00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fee28014040 tx=0x7fee28004af0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.933+0000 7fee357c9700 1 -- 172.21.15.123:0/4243014996 shutdown_connections 2024-09-13T17:07:22.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.933+0000 7fee357c9700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fee10066730 0x7fee10068bf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.933+0000 7fee357c9700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee3015d750 0x7fee30160b00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.933+0000 7fee357c9700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee3013fa60 0x7fee301f19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.933+0000 7fee357c9700 1 --2- 172.21.15.123:0/4243014996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fee300b1760 0x7fee300aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.933+0000 7fee357c9700 1 -- 172.21.15.123:0/4243014996 >> 172.21.15.123:0/4243014996 conn(0x7fee300b4630 msgr2=0x7fee3015ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:22.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.933+0000 7fee357c9700 1 -- 172.21.15.123:0/4243014996 shutdown_connections 2024-09-13T17:07:22.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:22.933+0000 7fee357c9700 1 -- 172.21.15.123:0/4243014996 wait complete. 2024-09-13T17:07:22.953 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:22.954 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:23.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.057+0000 7f67ff505700 1 Processor -- start 2024-09-13T17:07:23.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.057+0000 7f67ff505700 1 -- start start 2024-09-13T17:07:23.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67ff505700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67f80cb7e0 0x7f67f80c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67ff505700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f67f8072260 0x7f67f80cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67ff505700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f80ca750 con 0x7f67f806bdb0 2024-09-13T17:07:23.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67ff505700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f80c9210 con 0x7f67f8072260 2024-09-13T17:07:23.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67ff505700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f81617b0 con 0x7f67f80cb7e0 2024-09-13T17:07:23.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67fed04700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f67f8072260 0x7f67f80cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67fdd02700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f67f806bdb0 0x7f67f8071b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:50986/0 (socket says 172.21.15.123:50986) 2024-09-13T17:07:23.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67fe503700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67f80cb7e0 0x7f67f80c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67fdd02700 1 -- 172.21.15.123:0/4174030053 learned_addr learned my addr 172.21.15.123:0/4174030053 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:23.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67fe503700 1 -- 172.21.15.123:0/4174030053 >> v2:172.21.15.153:3300/0 conn(0x7f67f8072260 msgr2=0x7f67f80cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67fe503700 1 --2- 172.21.15.123:0/4174030053 >> v2:172.21.15.153:3300/0 conn(0x7f67f8072260 0x7f67f80cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67fe503700 1 -- 172.21.15.123:0/4174030053 >> v1:172.21.15.153:6789/0 conn(0x7f67f806bdb0 legacy=0x7f67f8071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67fd501700 1 -- 172.21.15.123:0/4174030053 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050781259 0 0) 0x7f67f80ca750 con 0x7f67f806bdb0 2024-09-13T17:07:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67fe503700 1 -- 172.21.15.123:0/4174030053 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f80cbbc0 con 0x7f67f80cb7e0 2024-09-13T17:07:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67fed04700 1 --2- 172.21.15.123:0/4174030053 >> v2:172.21.15.153:3300/0 conn(0x7f67f8072260 0x7f67f80cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67fe503700 1 --2- 172.21.15.123:0/4174030053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67f80cb7e0 0x7f67f80c8cd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009850 tx=0x7f67ec009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca37020c99f65d06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67fd501700 1 -- 172.21.15.123:0/4174030053 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec011830 con 0x7f67f80cb7e0 2024-09-13T17:07:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67fd501700 1 -- 172.21.15.123:0/4174030053 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec011990 con 0x7f67f80cb7e0 2024-09-13T17:07:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67fd501700 1 -- 172.21.15.123:0/4174030053 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec011d40 con 0x7f67f80cb7e0 2024-09-13T17:07:23.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67ff505700 1 -- 172.21.15.123:0/4174030053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67f80cb7e0 msgr2=0x7f67f80c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67ff505700 1 --2- 172.21.15.123:0/4174030053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67f80cb7e0 0x7f67f80c8cd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009850 tx=0x7f67ec009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:23.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67ff505700 1 -- 172.21.15.123:0/4174030053 shutdown_connections 2024-09-13T17:07:23.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67ff505700 1 --2- 172.21.15.123:0/4174030053 >> v2:172.21.15.153:3300/0 conn(0x7f67f8072260 0x7f67f80cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67ff505700 1 --2- 172.21.15.123:0/4174030053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67f80cb7e0 0x7f67f80c8cd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67ff505700 1 -- 172.21.15.123:0/4174030053 >> 172.21.15.123:0/4174030053 conn(0x7f67f80b01d0 msgr2=0x7f67f80b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:23.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67ff505700 1 -- 172.21.15.123:0/4174030053 shutdown_connections 2024-09-13T17:07:23.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.061+0000 7f67ff505700 1 -- 172.21.15.123:0/4174030053 wait complete. 2024-09-13T17:07:23.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.065+0000 7f67ff505700 1 Processor -- start 2024-09-13T17:07:23.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.065+0000 7f67ff505700 1 -- start start 2024-09-13T17:07:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.065+0000 7f67ff505700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67f806bdb0 0x7f67f815d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.065+0000 7f67ff505700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67f8072260 0x7f67f8164290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.065+0000 7f67ff505700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67f80cb7e0 0x7f67f8162290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67ff505700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f815dab0 con 0x7f67f806bdb0 2024-09-13T17:07:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67ff505700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f80c4c40 con 0x7f67f80cb7e0 2024-09-13T17:07:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67ff505700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f80c40c0 con 0x7f67f8072260 2024-09-13T17:07:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67fe503700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67f806bdb0 0x7f67f815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67fe503700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67f806bdb0 0x7f67f815d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48774/0 (socket says 172.21.15.123:48774) 2024-09-13T17:07:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67fe503700 1 -- 172.21.15.123:0/1583034918 learned_addr learned my addr 172.21.15.123:0/1583034918 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67fdd02700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67f8072260 0x7f67f8164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67fed04700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67f80cb7e0 0x7f67f8162290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67fe503700 1 -- 172.21.15.123:0/1583034918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67f8072260 msgr2=0x7f67f8164290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67fe503700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67f8072260 0x7f67f8164290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67fe503700 1 -- 172.21.15.123:0/1583034918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67f80cb7e0 msgr2=0x7f67f8162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67fe503700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67f80cb7e0 0x7f67f8162290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67fe503700 1 -- 172.21.15.123:0/1583034918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f00094b0 con 0x7f67f806bdb0 2024-09-13T17:07:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67fed04700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67f80cb7e0 0x7f67f8162290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67fe503700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67f806bdb0 0x7f67f815d570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009ba0 tx=0x7f67ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67f6ffd700 1 -- 172.21.15.123:0/1583034918 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec01aa40 con 0x7f67f806bdb0 2024-09-13T17:07:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67f6ffd700 1 -- 172.21.15.123:0/1583034918 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec01f070 con 0x7f67f806bdb0 2024-09-13T17:07:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67f6ffd700 1 -- 172.21.15.123:0/1583034918 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec01ada0 con 0x7f67f806bdb0 2024-09-13T17:07:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67ff505700 1 -- 172.21.15.123:0/1583034918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ec0094b0 con 0x7f67f806bdb0 2024-09-13T17:07:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.069+0000 7f67ff505700 1 -- 172.21.15.123:0/1583034918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f80c4680 con 0x7f67f806bdb0 2024-09-13T17:07:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.073+0000 7f67ff505700 1 -- 172.21.15.123:0/1583034918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f80c1480 con 0x7f67f806bdb0 2024-09-13T17:07:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.073+0000 7f67f6ffd700 1 -- 172.21.15.123:0/1583034918 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f67ec01b430 con 0x7f67f806bdb0 2024-09-13T17:07:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.073+0000 7f67f6ffd700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f67e4066730 0x7f67e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.073+0000 7f67f6ffd700 1 -- 172.21.15.123:0/1583034918 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67ec085130 con 0x7f67f806bdb0 2024-09-13T17:07:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.073+0000 7f67fdd02700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f67e4066730 0x7f67e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.073+0000 7f67fdd02700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f67e4066730 0x7f67e4068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f67f806a430 tx=0x7f67e8001aa0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:23.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.077+0000 7f67f6ffd700 1 -- 172.21.15.123:0/1583034918 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f67ec052530 con 0x7f67f806bdb0 2024-09-13T17:07:23.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.245+0000 7f67ff505700 1 -- 172.21.15.123:0/1583034918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67f806d090 con 0x7f67f806bdb0 2024-09-13T17:07:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.245+0000 7f67f6ffd700 1 -- 172.21.15.123:0/1583034918 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67ec055b50 con 0x7f67f806bdb0 2024-09-13T17:07:23.254 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.249+0000 7f67ff505700 1 -- 172.21.15.123:0/1583034918 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f67e4066730 msgr2=0x7f67e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.249+0000 7f67ff505700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f67e4066730 0x7f67e4068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f67f806a430 tx=0x7f67e8001aa0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.249+0000 7f67ff505700 1 -- 172.21.15.123:0/1583034918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67f806bdb0 msgr2=0x7f67f815d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.249+0000 7f67ff505700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67f806bdb0 0x7f67f815d570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009ba0 tx=0x7f67ec004770 comp rx=0 tx=0).stop 2024-09-13T17:07:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.249+0000 7f67ff505700 1 -- 172.21.15.123:0/1583034918 shutdown_connections 2024-09-13T17:07:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.249+0000 7f67ff505700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f67e4066730 0x7f67e4068bf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.249+0000 7f67ff505700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67f80cb7e0 0x7f67f8162290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.249+0000 7f67ff505700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67f8072260 0x7f67f8164290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.249+0000 7f67ff505700 1 --2- 172.21.15.123:0/1583034918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67f806bdb0 0x7f67f815d570 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.249+0000 7f67ff505700 1 -- 172.21.15.123:0/1583034918 >> 172.21.15.123:0/1583034918 conn(0x7f67f80b01d0 msgr2=0x7f67f80aed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.249+0000 7f67ff505700 1 -- 172.21.15.123:0/1583034918 shutdown_connections 2024-09-13T17:07:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.249+0000 7f67ff505700 1 -- 172.21.15.123:0/1583034918 wait complete. 2024-09-13T17:07:23.268 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:07:23.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.381+0000 7f2b48c56700 1 Processor -- start 2024-09-13T17:07:23.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.381+0000 7f2b48c56700 1 -- start start 2024-09-13T17:07:23.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.381+0000 7f2b48c56700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b440d0f40 0x7f2b440d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.381+0000 7f2b48c56700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b440cd5e0 0x7f2b440cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.381+0000 7f2b48c56700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b440d0cb0 con 0x7f2b440b58b0 2024-09-13T17:07:23.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.381+0000 7f2b48c56700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b440b0060 con 0x7f2b440d0f40 2024-09-13T17:07:23.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.381+0000 7f2b48c56700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440b0340 con 0x7f2b440cd5e0 2024-09-13T17:07:23.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b437fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b440d0f40 0x7f2b440d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b42ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2b440b58b0 0x7f2b440d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49836/0 (socket says 172.21.15.123:49836) 2024-09-13T17:07:23.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b42ffd700 1 -- 172.21.15.123:0/656346980 learned_addr learned my addr 172.21.15.123:0/656346980 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:23.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b43fff700 1 --2- 172.21.15.123:0/656346980 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b440cd5e0 0x7f2b440cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b427fc700 1 -- 172.21.15.123:0/656346980 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514449489 0 0) 0x7f2b440d0cb0 con 0x7f2b440b58b0 2024-09-13T17:07:23.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b427fc700 1 -- 172.21.15.123:0/656346980 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b2c0035d0 con 0x7f2b440b58b0 2024-09-13T17:07:23.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b437fe700 1 -- 172.21.15.123:0/656346980 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b440cd5e0 msgr2=0x7f2b440cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:23.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b437fe700 1 --2- 172.21.15.123:0/656346980 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b440cd5e0 0x7f2b440cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b437fe700 1 -- 172.21.15.123:0/656346980 >> v1:172.21.15.123:6789/0 conn(0x7f2b440b58b0 legacy=0x7f2b440d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b437fe700 1 -- 172.21.15.123:0/656346980 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b440b0620 con 0x7f2b440d0f40 2024-09-13T17:07:23.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b43fff700 1 --2- 172.21.15.123:0/656346980 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b440cd5e0 0x7f2b440cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:23.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b437fe700 1 --2- 172.21.15.123:0/656346980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b440d0f40 0x7f2b440d1320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009850 tx=0x7f2b38009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c1ac08e30502b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:23.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b427fc700 1 -- 172.21.15.123:0/656346980 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b38011830 con 0x7f2b440d0f40 2024-09-13T17:07:23.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b427fc700 1 -- 172.21.15.123:0/656346980 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b38011990 con 0x7f2b440d0f40 2024-09-13T17:07:23.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b427fc700 1 -- 172.21.15.123:0/656346980 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b38011d40 con 0x7f2b440d0f40 2024-09-13T17:07:23.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b48c56700 1 -- 172.21.15.123:0/656346980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b440d0f40 msgr2=0x7f2b440d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b48c56700 1 --2- 172.21.15.123:0/656346980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b440d0f40 0x7f2b440d1320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009850 tx=0x7f2b38009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:23.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b48c56700 1 -- 172.21.15.123:0/656346980 shutdown_connections 2024-09-13T17:07:23.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b48c56700 1 --2- 172.21.15.123:0/656346980 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b440cd5e0 0x7f2b440cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b48c56700 1 --2- 172.21.15.123:0/656346980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b440d0f40 0x7f2b440d1320 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b48c56700 1 -- 172.21.15.123:0/656346980 >> 172.21.15.123:0/656346980 conn(0x7f2b440d2a60 msgr2=0x7f2b440d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:23.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b48c56700 1 -- 172.21.15.123:0/656346980 shutdown_connections 2024-09-13T17:07:23.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b48c56700 1 -- 172.21.15.123:0/656346980 wait complete. 2024-09-13T17:07:23.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.385+0000 7f2b48c56700 1 Processor -- start 2024-09-13T17:07:23.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b48c56700 1 -- start start 2024-09-13T17:07:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b48c56700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b440b58b0 0x7f2b44159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b48c56700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b440cd5e0 0x7f2b440c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b48c56700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b441590f0 0x7f2b440c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b48c56700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4415e6d0 con 0x7f2b440cd5e0 2024-09-13T17:07:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b48c56700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440c94a0 con 0x7f2b440b58b0 2024-09-13T17:07:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b48c56700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440c91c0 con 0x7f2b441590f0 2024-09-13T17:07:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b42ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b440cd5e0 0x7f2b440c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b42ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b440cd5e0 0x7f2b440c6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48788/0 (socket says 172.21.15.123:48788) 2024-09-13T17:07:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b42ffd700 1 -- 172.21.15.123:0/1537947300 learned_addr learned my addr 172.21.15.123:0/1537947300 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b43fff700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b441590f0 0x7f2b440c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b437fe700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b440b58b0 0x7f2b44159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b42ffd700 1 -- 172.21.15.123:0/1537947300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b441590f0 msgr2=0x7f2b440c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b42ffd700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b441590f0 0x7f2b440c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b42ffd700 1 -- 172.21.15.123:0/1537947300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b440b58b0 msgr2=0x7f2b44159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b42ffd700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b440b58b0 0x7f2b44159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b42ffd700 1 -- 172.21.15.123:0/1537947300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c009a70 con 0x7f2b440cd5e0 2024-09-13T17:07:23.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b437fe700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b440b58b0 0x7f2b44159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:23.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b42ffd700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b440cd5e0 0x7f2b440c6490 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400c700 tx=0x7f2b3400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:23.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b2bfff700 1 -- 172.21.15.123:0/1537947300 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34005d90 con 0x7f2b440cd5e0 2024-09-13T17:07:23.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b2bfff700 1 -- 172.21.15.123:0/1537947300 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b340070d0 con 0x7f2b440cd5e0 2024-09-13T17:07:23.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b48c56700 1 -- 172.21.15.123:0/1537947300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b380094b0 con 0x7f2b440cd5e0 2024-09-13T17:07:23.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b2bfff700 1 -- 172.21.15.123:0/1537947300 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34007480 con 0x7f2b440cd5e0 2024-09-13T17:07:23.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.389+0000 7f2b48c56700 1 -- 172.21.15.123:0/1537947300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b440cd170 con 0x7f2b440cd5e0 2024-09-13T17:07:23.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.393+0000 7f2b48c56700 1 -- 172.21.15.123:0/1537947300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4415e810 con 0x7f2b440cd5e0 2024-09-13T17:07:23.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.393+0000 7f2b2bfff700 1 -- 172.21.15.123:0/1537947300 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b340075e0 con 0x7f2b440cd5e0 2024-09-13T17:07:23.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.393+0000 7f2b2bfff700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2b30066730 0x7f2b30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.393+0000 7f2b437fe700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2b30066730 0x7f2b30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.393+0000 7f2b2bfff700 1 -- 172.21.15.123:0/1537947300 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b34083820 con 0x7f2b440cd5e0 2024-09-13T17:07:23.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.393+0000 7f2b437fe700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2b30066730 0x7f2b30068bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b4408bc30 tx=0x7f2b38008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:23.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.401+0000 7f2b2bfff700 1 -- 172.21.15.123:0/1537947300 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2b4415e810 con 0x7f2b440cd5e0 2024-09-13T17:07:23.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.569+0000 7f2b48c56700 1 -- 172.21.15.123:0/1537947300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b4415e810 con 0x7f2b440cd5e0 2024-09-13T17:07:23.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.569+0000 7f2b2bfff700 1 -- 172.21.15.123:0/1537947300 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b4415e810 con 0x7f2b440cd5e0 2024-09-13T17:07:23.577 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:07:23.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.573+0000 7f2b48c56700 1 -- 172.21.15.123:0/1537947300 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2b30066730 msgr2=0x7f2b30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.573+0000 7f2b48c56700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2b30066730 0x7f2b30068bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b4408bc30 tx=0x7f2b38008030 comp rx=0 tx=0).stop 2024-09-13T17:07:23.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.573+0000 7f2b48c56700 1 -- 172.21.15.123:0/1537947300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b440cd5e0 msgr2=0x7f2b440c6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.573+0000 7f2b48c56700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b440cd5e0 0x7f2b440c6490 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400c700 tx=0x7f2b3400cac0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.573+0000 7f2b48c56700 1 -- 172.21.15.123:0/1537947300 shutdown_connections 2024-09-13T17:07:23.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.573+0000 7f2b48c56700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2b30066730 0x7f2b30068bf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.573+0000 7f2b48c56700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b441590f0 0x7f2b440c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.573+0000 7f2b48c56700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b440cd5e0 0x7f2b440c6490 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.573+0000 7f2b48c56700 1 --2- 172.21.15.123:0/1537947300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b440b58b0 0x7f2b44159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.573+0000 7f2b48c56700 1 -- 172.21.15.123:0/1537947300 >> 172.21.15.123:0/1537947300 conn(0x7f2b440d2a60 msgr2=0x7f2b440708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:23.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.573+0000 7f2b48c56700 1 -- 172.21.15.123:0/1537947300 shutdown_connections 2024-09-13T17:07:23.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.573+0000 7f2b48c56700 1 -- 172.21.15.123:0/1537947300 wait complete. 2024-09-13T17:07:23.592 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:07:23.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.701+0000 7fbf17fff700 1 Processor -- start 2024-09-13T17:07:23.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.701+0000 7fbf17fff700 1 -- start start 2024-09-13T17:07:23.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf17fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbf1815ca90 0x7fbf1815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf17fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf181564f0 0x7fbf181569a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf17fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf18156ee0 con 0x7fbf1806a260 2024-09-13T17:07:23.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf17fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1815d440 con 0x7fbf181564f0 2024-09-13T17:07:23.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf17fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1815d9c0 con 0x7fbf1815ca90 2024-09-13T17:07:23.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf177fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf181564f0 0x7fbf181569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf177fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf181564f0 0x7fbf181569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48796/0 (socket says 172.21.15.123:48796) 2024-09-13T17:07:23.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf177fe700 1 -- 172.21.15.123:0/3255762721 learned_addr learned my addr 172.21.15.123:0/3255762721 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:23.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf167fc700 1 --2- 172.21.15.123:0/3255762721 >> v2:172.21.15.153:3300/0 conn(0x7fbf1815ca90 0x7fbf1815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf177fe700 1 -- 172.21.15.123:0/3255762721 >> v2:172.21.15.153:3300/0 conn(0x7fbf1815ca90 msgr2=0x7fbf1815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:23.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf177fe700 1 --2- 172.21.15.123:0/3255762721 >> v2:172.21.15.153:3300/0 conn(0x7fbf1815ca90 0x7fbf1815cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf177fe700 1 -- 172.21.15.123:0/3255762721 >> v1:172.21.15.153:6789/0 conn(0x7fbf1806a260 legacy=0x7fbf180cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf177fe700 1 -- 172.21.15.123:0/3255762721 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1815d6e0 con 0x7fbf181564f0 2024-09-13T17:07:23.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf177fe700 1 --2- 172.21.15.123:0/3255762721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf181564f0 0x7fbf181569a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbf180ca700 tx=0x7fbf1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452d6716bae19d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:23.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf15ffb700 1 -- 172.21.15.123:0/3255762721 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000e070 con 0x7fbf181564f0 2024-09-13T17:07:23.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf15ffb700 1 -- 172.21.15.123:0/3255762721 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1000b910 con 0x7fbf181564f0 2024-09-13T17:07:23.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf15ffb700 1 -- 172.21.15.123:0/3255762721 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000bcc0 con 0x7fbf181564f0 2024-09-13T17:07:23.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf17fff700 1 -- 172.21.15.123:0/3255762721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf181564f0 msgr2=0x7fbf181569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf17fff700 1 --2- 172.21.15.123:0/3255762721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf181564f0 0x7fbf181569a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbf180ca700 tx=0x7fbf1000b330 comp rx=0 tx=0).stop 2024-09-13T17:07:23.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf17fff700 1 -- 172.21.15.123:0/3255762721 shutdown_connections 2024-09-13T17:07:23.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf17fff700 1 --2- 172.21.15.123:0/3255762721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf181564f0 0x7fbf181569a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf17fff700 1 --2- 172.21.15.123:0/3255762721 >> v2:172.21.15.153:3300/0 conn(0x7fbf1815ca90 0x7fbf1815cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf17fff700 1 -- 172.21.15.123:0/3255762721 >> 172.21.15.123:0/3255762721 conn(0x7fbf180b01d0 msgr2=0x7fbf180b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:23.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf17fff700 1 -- 172.21.15.123:0/3255762721 shutdown_connections 2024-09-13T17:07:23.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.705+0000 7fbf17fff700 1 -- 172.21.15.123:0/3255762721 wait complete. 2024-09-13T17:07:23.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf17fff700 1 Processor -- start 2024-09-13T17:07:23.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf17fff700 1 -- start start 2024-09-13T17:07:23.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf17fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf1806a260 0x7fbf1814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf17fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf181564f0 0x7fbf180c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf17fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf1815ca90 0x7fbf1806ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf17fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1814c110 con 0x7fbf1806a260 2024-09-13T17:07:23.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf17fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180c6300 con 0x7fbf1815ca90 2024-09-13T17:07:23.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf17fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180c65a0 con 0x7fbf181564f0 2024-09-13T17:07:23.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf16ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf1806a260 0x7fbf1814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf16ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf1806a260 0x7fbf1814b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48800/0 (socket says 172.21.15.123:48800) 2024-09-13T17:07:23.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf16ffd700 1 -- 172.21.15.123:0/3159297605 learned_addr learned my addr 172.21.15.123:0/3159297605 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:23.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf177fe700 1 --2- 172.21.15.123:0/3159297605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf1815ca90 0x7fbf1806ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf167fc700 1 --2- 172.21.15.123:0/3159297605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf181564f0 0x7fbf180c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf16ffd700 1 -- 172.21.15.123:0/3159297605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf181564f0 msgr2=0x7fbf180c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf16ffd700 1 --2- 172.21.15.123:0/3159297605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf181564f0 0x7fbf180c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf16ffd700 1 -- 172.21.15.123:0/3159297605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf1815ca90 msgr2=0x7fbf1806ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf16ffd700 1 --2- 172.21.15.123:0/3159297605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf1815ca90 0x7fbf1806ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf16ffd700 1 -- 172.21.15.123:0/3159297605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf10009b30 con 0x7fbf1806a260 2024-09-13T17:07:23.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf16ffd700 1 --2- 172.21.15.123:0/3159297605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf1806a260 0x7fbf1814b6a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000c500 tx=0x7fbf0000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:23.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf0f7fe700 1 -- 172.21.15.123:0/3159297605 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000052d0 con 0x7fbf1806a260 2024-09-13T17:07:23.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf0f7fe700 1 -- 172.21.15.123:0/3159297605 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf00005430 con 0x7fbf1806a260 2024-09-13T17:07:23.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf17fff700 1 -- 172.21.15.123:0/3159297605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf180c6880 con 0x7fbf1806a260 2024-09-13T17:07:23.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf0f7fe700 1 -- 172.21.15.123:0/3159297605 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000055a0 con 0x7fbf1806a260 2024-09-13T17:07:23.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.709+0000 7fbf17fff700 1 -- 172.21.15.123:0/3159297605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf180c6e40 con 0x7fbf1806a260 2024-09-13T17:07:23.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.713+0000 7fbf17fff700 1 -- 172.21.15.123:0/3159297605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf180c92d0 con 0x7fbf1806a260 2024-09-13T17:07:23.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.713+0000 7fbf0f7fe700 1 -- 172.21.15.123:0/3159297605 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbf000038e0 con 0x7fbf1806a260 2024-09-13T17:07:23.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.713+0000 7fbf0f7fe700 1 --2- 172.21.15.123:0/3159297605 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbef8066730 0x7fbef8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:23.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.713+0000 7fbf0f7fe700 1 -- 172.21.15.123:0/3159297605 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf00083470 con 0x7fbf1806a260 2024-09-13T17:07:23.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.713+0000 7fbf167fc700 1 --2- 172.21.15.123:0/3159297605 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbef8066730 0x7fbef8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:23.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.713+0000 7fbf167fc700 1 --2- 172.21.15.123:0/3159297605 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbef8066730 0x7fbef8068bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbf180c1e90 tx=0x7fbf08009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:23.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.717+0000 7fbf0f7fe700 1 -- 172.21.15.123:0/3159297605 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbf00050870 con 0x7fbf1806a260 2024-09-13T17:07:23.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.885+0000 7fbf17fff700 1 -- 172.21.15.123:0/3159297605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf180c54d0 con 0x7fbf1806a260 2024-09-13T17:07:23.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.885+0000 7fbf0f7fe700 1 -- 172.21.15.123:0/3159297605 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf00053e90 con 0x7fbf1806a260 2024-09-13T17:07:23.893 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:07:23.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.889+0000 7fbf17fff700 1 -- 172.21.15.123:0/3159297605 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbef8066730 msgr2=0x7fbef8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.889+0000 7fbf17fff700 1 --2- 172.21.15.123:0/3159297605 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbef8066730 0x7fbef8068bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbf180c1e90 tx=0x7fbf08009240 comp rx=0 tx=0).stop 2024-09-13T17:07:23.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.889+0000 7fbf17fff700 1 -- 172.21.15.123:0/3159297605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf1806a260 msgr2=0x7fbf1814b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:23.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.889+0000 7fbf17fff700 1 --2- 172.21.15.123:0/3159297605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf1806a260 0x7fbf1814b6a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000c500 tx=0x7fbf0000c810 comp rx=0 tx=0).stop 2024-09-13T17:07:23.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.889+0000 7fbf17fff700 1 -- 172.21.15.123:0/3159297605 shutdown_connections 2024-09-13T17:07:23.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.889+0000 7fbf17fff700 1 --2- 172.21.15.123:0/3159297605 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbef8066730 0x7fbef8068bf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.889+0000 7fbf17fff700 1 --2- 172.21.15.123:0/3159297605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf1815ca90 0x7fbf1806ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.889+0000 7fbf17fff700 1 --2- 172.21.15.123:0/3159297605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbf181564f0 0x7fbf180c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.889+0000 7fbf17fff700 1 --2- 172.21.15.123:0/3159297605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf1806a260 0x7fbf1814b6a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:23.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.889+0000 7fbf17fff700 1 -- 172.21.15.123:0/3159297605 >> 172.21.15.123:0/3159297605 conn(0x7fbf180b01d0 msgr2=0x7fbf18157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:23.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.889+0000 7fbf17fff700 1 -- 172.21.15.123:0/3159297605 shutdown_connections 2024-09-13T17:07:23.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:23.889+0000 7fbf17fff700 1 -- 172.21.15.123:0/3159297605 wait complete. 2024-09-13T17:07:23.909 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:07:24.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.013+0000 7f5aee6cb700 1 Processor -- start 2024-09-13T17:07:24.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.013+0000 7f5aee6cb700 1 -- start start 2024-09-13T17:07:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aee6cb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5ae80ccfd0 0x7f5ae80cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aee6cb700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae80cdb90 con 0x7f5ae80cd410 2024-09-13T17:07:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aee6cb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae80cc580 con 0x7f5ae815b000 2024-09-13T17:07:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aee6cb700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae80cdde0 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aecec8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5ae80ccfd0 0x7f5ae80cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aedeca700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5ae80cd410 0x7f5ae80b14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49846/0 (socket says 172.21.15.123:49846) 2024-09-13T17:07:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aecec8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5ae80ccfd0 0x7f5ae80cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48806/0 (socket says 172.21.15.123:48806) 2024-09-13T17:07:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aedeca700 1 -- 172.21.15.123:0/3314847719 learned_addr learned my addr 172.21.15.123:0/3314847719 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aecec8700 1 -- 172.21.15.123:0/3314847719 >> v1:172.21.15.153:6789/0 conn(0x7f5ae815b000 legacy=0x7f5ae8071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aecec8700 1 -- 172.21.15.123:0/3314847719 >> v1:172.21.15.123:6789/0 conn(0x7f5ae80cd410 legacy=0x7f5ae80b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5adffff700 1 -- 172.21.15.123:0/3314847719 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936161106 0 0) 0x7f5ae80cdb90 con 0x7f5ae80cd410 2024-09-13T17:07:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aecec8700 1 -- 172.21.15.123:0/3314847719 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae80ce0c0 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aecec8700 1 --2- 172.21.15.123:0/3314847719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80ccfd0 0x7f5ae80cb070 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009850 tx=0x7f5ad8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd0ec0f47340178 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5adffff700 1 -- 172.21.15.123:0/3314847719 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8004230 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5adffff700 1 -- 172.21.15.123:0/3314847719 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad8004390 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5adffff700 1 -- 172.21.15.123:0/3314847719 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad80036c0 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3314847719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80ccfd0 msgr2=0x7f5ae80cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aee6cb700 1 --2- 172.21.15.123:0/3314847719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80ccfd0 0x7f5ae80cb070 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009850 tx=0x7f5ad8009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3314847719 shutdown_connections 2024-09-13T17:07:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aee6cb700 1 --2- 172.21.15.123:0/3314847719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80ccfd0 0x7f5ae80cb070 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3314847719 >> 172.21.15.123:0/3314847719 conn(0x7f5ae80b01d0 msgr2=0x7f5ae80b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3314847719 shutdown_connections 2024-09-13T17:07:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.017+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3314847719 wait complete. 2024-09-13T17:07:24.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.021+0000 7f5aee6cb700 1 Processor -- start 2024-09-13T17:07:24.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.021+0000 7f5aee6cb700 1 -- start start 2024-09-13T17:07:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.021+0000 7f5aee6cb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80ccfd0 0x7f5ae8151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.021+0000 7f5aee6cb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae80cd410 0x7f5ae80c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.021+0000 7f5aee6cb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ae815b000 0x7f5ae815d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.021+0000 7f5aee6cb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae81f4660 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.021+0000 7f5aee6cb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80c4080 con 0x7f5ae815b000 2024-09-13T17:07:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.021+0000 7f5aee6cb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae81f4010 con 0x7f5ae80cd410 2024-09-13T17:07:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.021+0000 7f5aed6c9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80ccfd0 0x7f5ae8151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5aed6c9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80ccfd0 0x7f5ae8151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48818/0 (socket says 172.21.15.123:48818) 2024-09-13T17:07:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5aed6c9700 1 -- 172.21.15.123:0/3024486197 learned_addr learned my addr 172.21.15.123:0/3024486197 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5aecec8700 1 --2- 172.21.15.123:0/3024486197 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae80cd410 0x7f5ae80c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5aedeca700 1 --2- 172.21.15.123:0/3024486197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ae815b000 0x7f5ae815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5aed6c9700 1 -- 172.21.15.123:0/3024486197 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae80cd410 msgr2=0x7f5ae80c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5aed6c9700 1 --2- 172.21.15.123:0/3024486197 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae80cd410 0x7f5ae80c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5aed6c9700 1 -- 172.21.15.123:0/3024486197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ae815b000 msgr2=0x7f5ae815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5aed6c9700 1 --2- 172.21.15.123:0/3024486197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ae815b000 0x7f5ae815d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5aed6c9700 1 -- 172.21.15.123:0/3024486197 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad80094b0 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5aed6c9700 1 --2- 172.21.15.123:0/3024486197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80ccfd0 0x7f5ae8151ae0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400b4a0 tx=0x7f5ae400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:24.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5addffb700 1 -- 172.21.15.123:0/3024486197 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011830 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5addffb700 1 -- 172.21.15.123:0/3024486197 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4011990 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3024486197 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae81f42f0 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5addffb700 1 -- 172.21.15.123:0/3024486197 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011d40 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.025+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3024486197 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae80c4360 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.029+0000 7f5addffb700 1 -- 172.21.15.123:0/3024486197 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ae401a400 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.029+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3024486197 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae81f4480 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.029+0000 7f5addffb700 1 --2- 172.21.15.123:0/3024486197 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5acc066730 0x7f5acc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.029+0000 7f5addffb700 1 -- 172.21.15.123:0/3024486197 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ae4084090 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.029+0000 7f5aecec8700 1 --2- 172.21.15.123:0/3024486197 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5acc066730 0x7f5acc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.029+0000 7f5aecec8700 1 --2- 172.21.15.123:0/3024486197 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5acc066730 0x7f5acc068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009850 tx=0x7f5ad8008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.037+0000 7f5addffb700 1 -- 172.21.15.123:0/3024486197 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5ae4051400 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.221+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3024486197 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5ae8071f50 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.221+0000 7f5addffb700 1 -- 172.21.15.123:0/3024486197 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5ae4054a20 con 0x7f5ae80ccfd0 2024-09-13T17:07:24.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.225+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3024486197 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5acc066730 msgr2=0x7f5acc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.225+0000 7f5aee6cb700 1 --2- 172.21.15.123:0/3024486197 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5acc066730 0x7f5acc068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009850 tx=0x7f5ad8008030 comp rx=0 tx=0).stop 2024-09-13T17:07:24.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.225+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3024486197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80ccfd0 msgr2=0x7f5ae8151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.225+0000 7f5aee6cb700 1 --2- 172.21.15.123:0/3024486197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80ccfd0 0x7f5ae8151ae0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400b4a0 tx=0x7f5ae400b7b0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.225+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3024486197 shutdown_connections 2024-09-13T17:07:24.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.225+0000 7f5aee6cb700 1 --2- 172.21.15.123:0/3024486197 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5acc066730 0x7f5acc068bf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.225+0000 7f5aee6cb700 1 --2- 172.21.15.123:0/3024486197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ae815b000 0x7f5ae815d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.225+0000 7f5aee6cb700 1 --2- 172.21.15.123:0/3024486197 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ae80cd410 0x7f5ae80c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.225+0000 7f5aee6cb700 1 --2- 172.21.15.123:0/3024486197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ae80ccfd0 0x7f5ae8151ae0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.225+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3024486197 >> 172.21.15.123:0/3024486197 conn(0x7f5ae80b01d0 msgr2=0x7f5ae80afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:24.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.225+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3024486197 shutdown_connections 2024-09-13T17:07:24.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.225+0000 7f5aee6cb700 1 -- 172.21.15.123:0/3024486197 wait complete. 2024-09-13T17:07:24.234 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:07:24.245 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:07:24.245 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:07:24.253 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:24.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.357+0000 7ff40d3da700 1 Processor -- start 2024-09-13T17:07:24.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.357+0000 7ff40d3da700 1 -- start start 2024-09-13T17:07:24.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.357+0000 7ff40d3da700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff408153390 0x7ff408159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.357+0000 7ff40d3da700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40815a4c0 con 0x7ff4080cdb70 2024-09-13T17:07:24.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.357+0000 7ff40d3da700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4080cb730 con 0x7ff408153770 2024-09-13T17:07:24.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.357+0000 7ff40d3da700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4081595a0 con 0x7ff408153390 2024-09-13T17:07:24.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.357+0000 7ff4077fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff4080cdb70 0x7ff4080cae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49854/0 (socket says 172.21.15.123:49854) 2024-09-13T17:07:24.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.357+0000 7ff4077fe700 1 -- 172.21.15.123:0/1730723825 learned_addr learned my addr 172.21.15.123:0/1730723825 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:24.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.357+0000 7ff407fff700 1 --2- 172.21.15.123:0/1730723825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff408153390 0x7ff408159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.357+0000 7ff406ffd700 1 -- 172.21.15.123:0/1730723825 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473450157 0 0) 0x7ff40815a4c0 con 0x7ff4080cdb70 2024-09-13T17:07:24.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff406ffd700 1 -- 172.21.15.123:0/1730723825 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3f00035d0 con 0x7ff4080cdb70 2024-09-13T17:07:24.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff406ffd700 1 -- 172.21.15.123:0/1730723825 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900323542 0 0) 0x7ff4080cb730 con 0x7ff408153770 2024-09-13T17:07:24.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff406ffd700 1 -- 172.21.15.123:0/1730723825 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff40815a4c0 con 0x7ff408153770 2024-09-13T17:07:24.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff407fff700 1 -- 172.21.15.123:0/1730723825 >> v1:172.21.15.153:6789/0 conn(0x7ff408153770 legacy=0x7ff4080ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff407fff700 1 -- 172.21.15.123:0/1730723825 >> v1:172.21.15.123:6789/0 conn(0x7ff4080cdb70 legacy=0x7ff4080cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff407fff700 1 -- 172.21.15.123:0/1730723825 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080cba10 con 0x7ff408153390 2024-09-13T17:07:24.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff407fff700 1 --2- 172.21.15.123:0/1730723825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff408153390 0x7ff408159f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009880 tx=0x7ff3fc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e60671ce4a1d0da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:24.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff406ffd700 1 -- 172.21.15.123:0/1730723825 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc011830 con 0x7ff408153390 2024-09-13T17:07:24.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff406ffd700 1 -- 172.21.15.123:0/1730723825 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc011990 con 0x7ff408153390 2024-09-13T17:07:24.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff406ffd700 1 -- 172.21.15.123:0/1730723825 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc011d00 con 0x7ff408153390 2024-09-13T17:07:24.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff40d3da700 1 -- 172.21.15.123:0/1730723825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff408153390 msgr2=0x7ff408159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff40d3da700 1 --2- 172.21.15.123:0/1730723825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff408153390 0x7ff408159f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009880 tx=0x7ff3fc009b90 comp rx=0 tx=0).stop 2024-09-13T17:07:24.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff40d3da700 1 -- 172.21.15.123:0/1730723825 shutdown_connections 2024-09-13T17:07:24.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff40d3da700 1 --2- 172.21.15.123:0/1730723825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff408153390 0x7ff408159f80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff40d3da700 1 -- 172.21.15.123:0/1730723825 >> 172.21.15.123:0/1730723825 conn(0x7ff408066150 msgr2=0x7ff408066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:24.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff40d3da700 1 -- 172.21.15.123:0/1730723825 shutdown_connections 2024-09-13T17:07:24.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.361+0000 7ff40d3da700 1 -- 172.21.15.123:0/1730723825 wait complete. 2024-09-13T17:07:24.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff40d3da700 1 Processor -- start 2024-09-13T17:07:24.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff40d3da700 1 -- start start 2024-09-13T17:07:24.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff40d3da700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4080cdb70 0x7ff4081454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff40d3da700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff408153390 0x7ff4080aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff40d3da700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff408153770 0x7ff4080aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff40d3da700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080a84a0 con 0x7ff408153390 2024-09-13T17:07:24.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff40d3da700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080a9300 con 0x7ff4080cdb70 2024-09-13T17:07:24.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff40d3da700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff408145a00 con 0x7ff408153770 2024-09-13T17:07:24.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff4077fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff408153390 0x7ff4080aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff4077fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff408153390 0x7ff4080aa420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48834/0 (socket says 172.21.15.123:48834) 2024-09-13T17:07:24.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff407fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4080cdb70 0x7ff4081454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff4077fe700 1 -- 172.21.15.123:0/1951063327 learned_addr learned my addr 172.21.15.123:0/1951063327 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:24.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff40cbd9700 1 --2- 172.21.15.123:0/1951063327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff408153770 0x7ff4080aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff4077fe700 1 -- 172.21.15.123:0/1951063327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff408153770 msgr2=0x7ff4080aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff4077fe700 1 --2- 172.21.15.123:0/1951063327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff408153770 0x7ff4080aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff4077fe700 1 -- 172.21.15.123:0/1951063327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4080cdb70 msgr2=0x7ff4081454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff4077fe700 1 --2- 172.21.15.123:0/1951063327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4080cdb70 0x7ff4081454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff4077fe700 1 -- 172.21.15.123:0/1951063327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0094b0 con 0x7ff408153390 2024-09-13T17:07:24.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff4077fe700 1 --2- 172.21.15.123:0/1951063327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff408153390 0x7ff4080aa420 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800cb90 tx=0x7ff3f800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:24.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.365+0000 7ff404ff9700 1 -- 172.21.15.123:0/1951063327 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f800a770 con 0x7ff408153390 2024-09-13T17:07:24.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.369+0000 7ff404ff9700 1 -- 172.21.15.123:0/1951063327 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f800a8f0 con 0x7ff408153390 2024-09-13T17:07:24.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.369+0000 7ff404ff9700 1 -- 172.21.15.123:0/1951063327 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f800aca0 con 0x7ff408153390 2024-09-13T17:07:24.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.369+0000 7ff40d3da700 1 -- 172.21.15.123:0/1951063327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4080a86f0 con 0x7ff408153390 2024-09-13T17:07:24.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.369+0000 7ff40d3da700 1 -- 172.21.15.123:0/1951063327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4080a8cb0 con 0x7ff408153390 2024-09-13T17:07:24.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.369+0000 7ff40d3da700 1 -- 172.21.15.123:0/1951063327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4080677f0 con 0x7ff408153390 2024-09-13T17:07:24.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.369+0000 7ff404ff9700 1 -- 172.21.15.123:0/1951063327 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3f80113a0 con 0x7ff408153390 2024-09-13T17:07:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.369+0000 7ff404ff9700 1 --2- 172.21.15.123:0/1951063327 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3f4066730 0x7ff3f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.369+0000 7ff404ff9700 1 -- 172.21.15.123:0/1951063327 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3f8083af0 con 0x7ff408153390 2024-09-13T17:07:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.369+0000 7ff407fff700 1 --2- 172.21.15.123:0/1951063327 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3f4066730 0x7ff3f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.369+0000 7ff407fff700 1 --2- 172.21.15.123:0/1951063327 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3f4066730 0x7ff3f4068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0090b0 tx=0x7ff3fc010000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.381+0000 7ff404ff9700 1 -- 172.21.15.123:0/1951063327 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3f8050e60 con 0x7ff408153390 2024-09-13T17:07:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.553+0000 7ff40d3da700 1 -- 172.21.15.123:0/1951063327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff408159f80 con 0x7ff408153390 2024-09-13T17:07:24.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.553+0000 7ff404ff9700 1 -- 172.21.15.123:0/1951063327 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7ff3f8054480 con 0x7ff408153390 2024-09-13T17:07:24.560 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:24.560 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.553+0000 7ff40d3da700 1 -- 172.21.15.123:0/1951063327 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3f4066730 msgr2=0x7ff3f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.553+0000 7ff40d3da700 1 --2- 172.21.15.123:0/1951063327 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3f4066730 0x7ff3f4068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0090b0 tx=0x7ff3fc010000 comp rx=0 tx=0).stop 2024-09-13T17:07:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.553+0000 7ff40d3da700 1 -- 172.21.15.123:0/1951063327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff408153390 msgr2=0x7ff4080aa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.553+0000 7ff40d3da700 1 --2- 172.21.15.123:0/1951063327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff408153390 0x7ff4080aa420 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800cb90 tx=0x7ff3f800cbc0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.553+0000 7ff40d3da700 1 -- 172.21.15.123:0/1951063327 shutdown_connections 2024-09-13T17:07:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.553+0000 7ff40d3da700 1 --2- 172.21.15.123:0/1951063327 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3f4066730 0x7ff3f4068bf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.553+0000 7ff40d3da700 1 --2- 172.21.15.123:0/1951063327 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff408153770 0x7ff4080aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.553+0000 7ff40d3da700 1 --2- 172.21.15.123:0/1951063327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff408153390 0x7ff4080aa420 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.553+0000 7ff40d3da700 1 --2- 172.21.15.123:0/1951063327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4080cdb70 0x7ff4081454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.553+0000 7ff40d3da700 1 -- 172.21.15.123:0/1951063327 >> 172.21.15.123:0/1951063327 conn(0x7ff408066150 msgr2=0x7ff4080cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:24.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.557+0000 7ff40d3da700 1 -- 172.21.15.123:0/1951063327 shutdown_connections 2024-09-13T17:07:24.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.557+0000 7ff40d3da700 1 -- 172.21.15.123:0/1951063327 wait complete. 2024-09-13T17:07:24.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:24.575 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:24.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.685+0000 7fce10c21700 1 Processor -- start 2024-09-13T17:07:24.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.685+0000 7fce10c21700 1 -- start start 2024-09-13T17:07:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.685+0000 7fce10c21700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fce0c159890 0x7fce0c0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce10c21700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce0c0cec50 0x7fce0c071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce10c21700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0c159c70 con 0x7fce0c0718f0 2024-09-13T17:07:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce10c21700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0c0cd730 con 0x7fce0c159890 2024-09-13T17:07:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce10c21700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0cf0a0 con 0x7fce0c0cec50 2024-09-13T17:07:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce0b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fce0c159890 0x7fce0c0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce0b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fce0c159890 0x7fce0c0b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48842/0 (socket says 172.21.15.123:48842) 2024-09-13T17:07:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce0b7fe700 1 -- 172.21.15.123:0/3461017073 learned_addr learned my addr 172.21.15.123:0/3461017073 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce0bfff700 1 --2- 172.21.15.123:0/3461017073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce0c0cec50 0x7fce0c071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce0b7fe700 1 -- 172.21.15.123:0/3461017073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce0c0cec50 msgr2=0x7fce0c071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce0b7fe700 1 --2- 172.21.15.123:0/3461017073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce0c0cec50 0x7fce0c071d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce0b7fe700 1 -- 172.21.15.123:0/3461017073 >> v1:172.21.15.153:6789/0 conn(0x7fce0c0718f0 legacy=0x7fce0c0b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce0b7fe700 1 -- 172.21.15.123:0/3461017073 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c0b2d40 con 0x7fce0c159890 2024-09-13T17:07:24.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce0b7fe700 1 --2- 172.21.15.123:0/3461017073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0c159890 0x7fce0c0b47c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009910 tx=0x7fcdfc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329cf5b1f319d2ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:24.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce0a7fc700 1 -- 172.21.15.123:0/3461017073 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc011830 con 0x7fce0c159890 2024-09-13T17:07:24.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce0a7fc700 1 -- 172.21.15.123:0/3461017073 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc011990 con 0x7fce0c159890 2024-09-13T17:07:24.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce0a7fc700 1 -- 172.21.15.123:0/3461017073 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc011d40 con 0x7fce0c159890 2024-09-13T17:07:24.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce10c21700 1 -- 172.21.15.123:0/3461017073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0c159890 msgr2=0x7fce0c0b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce10c21700 1 --2- 172.21.15.123:0/3461017073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0c159890 0x7fce0c0b47c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009910 tx=0x7fcdfc009c20 comp rx=0 tx=0).stop 2024-09-13T17:07:24.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce10c21700 1 -- 172.21.15.123:0/3461017073 shutdown_connections 2024-09-13T17:07:24.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce10c21700 1 --2- 172.21.15.123:0/3461017073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce0c0cec50 0x7fce0c071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce10c21700 1 --2- 172.21.15.123:0/3461017073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0c159890 0x7fce0c0b47c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce10c21700 1 -- 172.21.15.123:0/3461017073 >> 172.21.15.123:0/3461017073 conn(0x7fce0c0735c0 msgr2=0x7fce0c06a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:24.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce10c21700 1 -- 172.21.15.123:0/3461017073 shutdown_connections 2024-09-13T17:07:24.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.689+0000 7fce10c21700 1 -- 172.21.15.123:0/3461017073 wait complete. 2024-09-13T17:07:24.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce10c21700 1 Processor -- start 2024-09-13T17:07:24.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce10c21700 1 -- start start 2024-09-13T17:07:24.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce10c21700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0c0718f0 0x7fce0c138050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce10c21700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce0c0cec50 0x7fce0c14bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce10c21700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce0c159890 0x7fce0c149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce10c21700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c138590 con 0x7fce0c0718f0 2024-09-13T17:07:24.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce10c21700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c1e4510 con 0x7fce0c159890 2024-09-13T17:07:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce10c21700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c1e3900 con 0x7fce0c0cec50 2024-09-13T17:07:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce0b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0c0718f0 0x7fce0c138050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce0b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0c0718f0 0x7fce0c138050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48844/0 (socket says 172.21.15.123:48844) 2024-09-13T17:07:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce0b7fe700 1 -- 172.21.15.123:0/1120628392 learned_addr learned my addr 172.21.15.123:0/1120628392 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce0affd700 1 --2- 172.21.15.123:0/1120628392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce0c0cec50 0x7fce0c14bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce0bfff700 1 --2- 172.21.15.123:0/1120628392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce0c159890 0x7fce0c149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce0b7fe700 1 -- 172.21.15.123:0/1120628392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce0c0cec50 msgr2=0x7fce0c14bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce0b7fe700 1 --2- 172.21.15.123:0/1120628392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce0c0cec50 0x7fce0c14bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce0b7fe700 1 -- 172.21.15.123:0/1120628392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce0c159890 msgr2=0x7fce0c149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce0b7fe700 1 --2- 172.21.15.123:0/1120628392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce0c159890 0x7fce0c149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce0b7fe700 1 -- 172.21.15.123:0/1120628392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc009570 con 0x7fce0c0718f0 2024-09-13T17:07:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce0b7fe700 1 --2- 172.21.15.123:0/1120628392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0c0718f0 0x7fce0c138050 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fce0c06d780 tx=0x7fcdfc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce03fff700 1 -- 172.21.15.123:0/1120628392 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc004590 con 0x7fce0c0718f0 2024-09-13T17:07:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce03fff700 1 -- 172.21.15.123:0/1120628392 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc020070 con 0x7fce0c0718f0 2024-09-13T17:07:24.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce10c21700 1 -- 172.21.15.123:0/1120628392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0c1e3be0 con 0x7fce0c0718f0 2024-09-13T17:07:24.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce03fff700 1 -- 172.21.15.123:0/1120628392 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc003900 con 0x7fce0c0718f0 2024-09-13T17:07:24.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce10c21700 1 -- 172.21.15.123:0/1120628392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0c1e41a0 con 0x7fce0c0718f0 2024-09-13T17:07:24.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.693+0000 7fce10c21700 1 -- 172.21.15.123:0/1120628392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0c0b2920 con 0x7fce0c0718f0 2024-09-13T17:07:24.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.697+0000 7fce03fff700 1 -- 172.21.15.123:0/1120628392 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcdfc003a60 con 0x7fce0c0718f0 2024-09-13T17:07:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.697+0000 7fce03fff700 1 --2- 172.21.15.123:0/1120628392 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcdec066730 0x7fcdec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.697+0000 7fce03fff700 1 -- 172.21.15.123:0/1120628392 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdfc087070 con 0x7fce0c0718f0 2024-09-13T17:07:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.697+0000 7fce0affd700 1 --2- 172.21.15.123:0/1120628392 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcdec066730 0x7fcdec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:24.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.697+0000 7fce0affd700 1 --2- 172.21.15.123:0/1120628392 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcdec066730 0x7fcdec068bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce0c1f2ac0 tx=0x7fcdf4009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:24.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.705+0000 7fce03fff700 1 -- 172.21.15.123:0/1120628392 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcdfc054470 con 0x7fce0c0718f0 2024-09-13T17:07:24.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.865+0000 7fce10c21700 1 -- 172.21.15.123:0/1120628392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce0c1e26a0 con 0x7fce0c0718f0 2024-09-13T17:07:24.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.865+0000 7fce03fff700 1 -- 172.21.15.123:0/1120628392 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcdfc057a90 con 0x7fce0c0718f0 2024-09-13T17:07:24.873 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.869+0000 7fce10c21700 1 -- 172.21.15.123:0/1120628392 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcdec066730 msgr2=0x7fcdec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.869+0000 7fce10c21700 1 --2- 172.21.15.123:0/1120628392 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcdec066730 0x7fcdec068bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce0c1f2ac0 tx=0x7fcdf4009040 comp rx=0 tx=0).stop 2024-09-13T17:07:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.869+0000 7fce10c21700 1 -- 172.21.15.123:0/1120628392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0c0718f0 msgr2=0x7fce0c138050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.869+0000 7fce10c21700 1 --2- 172.21.15.123:0/1120628392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0c0718f0 0x7fce0c138050 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fce0c06d780 tx=0x7fcdfc004770 comp rx=0 tx=0).stop 2024-09-13T17:07:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.869+0000 7fce10c21700 1 -- 172.21.15.123:0/1120628392 shutdown_connections 2024-09-13T17:07:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.869+0000 7fce10c21700 1 --2- 172.21.15.123:0/1120628392 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcdec066730 0x7fcdec068bf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.869+0000 7fce10c21700 1 --2- 172.21.15.123:0/1120628392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce0c159890 0x7fce0c149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.869+0000 7fce10c21700 1 --2- 172.21.15.123:0/1120628392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce0c0cec50 0x7fce0c14bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.869+0000 7fce10c21700 1 --2- 172.21.15.123:0/1120628392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0c0718f0 0x7fce0c138050 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.869+0000 7fce10c21700 1 -- 172.21.15.123:0/1120628392 >> 172.21.15.123:0/1120628392 conn(0x7fce0c0735c0 msgr2=0x7fce0c15c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.869+0000 7fce10c21700 1 -- 172.21.15.123:0/1120628392 shutdown_connections 2024-09-13T17:07:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.869+0000 7fce10c21700 1 -- 172.21.15.123:0/1120628392 wait complete. 2024-09-13T17:07:24.888 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:07:25.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 Processor -- start 2024-09-13T17:07:25.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 -- start start 2024-09-13T17:07:25.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f856c0b3a20 0x7f856c06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f856c0cb730 0x7f856c15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c0ce070 con 0x7f856c06dc80 2024-09-13T17:07:25.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c0cd9d0 con 0x7f856c0cb730 2024-09-13T17:07:25.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c0cd130 con 0x7f856c0b3a20 2024-09-13T17:07:25.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f856c0cb730 0x7f856c15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856a7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f856c06dc80 0x7f856c0cb020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49864/0 (socket says 172.21.15.123:49864) 2024-09-13T17:07:25.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f856c0cb730 0x7f856c15a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48850/0 (socket says 172.21.15.123:48850) 2024-09-13T17:07:25.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856a7fc700 1 -- 172.21.15.123:0/1502467655 learned_addr learned my addr 172.21.15.123:0/1502467655 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:25.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856affd700 1 --2- 172.21.15.123:0/1502467655 >> v2:172.21.15.153:3300/0 conn(0x7f856c0b3a20 0x7f856c06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856b7fe700 1 -- 172.21.15.123:0/1502467655 >> v2:172.21.15.153:3300/0 conn(0x7f856c0b3a20 msgr2=0x7f856c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:25.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856b7fe700 1 --2- 172.21.15.123:0/1502467655 >> v2:172.21.15.153:3300/0 conn(0x7f856c0b3a20 0x7f856c06d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856b7fe700 1 -- 172.21.15.123:0/1502467655 >> v1:172.21.15.123:6789/0 conn(0x7f856c06dc80 legacy=0x7f856c0cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856b7fe700 1 -- 172.21.15.123:0/1502467655 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c0cd410 con 0x7f856c0cb730 2024-09-13T17:07:25.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856b7fe700 1 --2- 172.21.15.123:0/1502467655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0cb730 0x7f856c15a2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f856c0cf690 tx=0x7f855c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f173d3d411048f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:25.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f8569ffb700 1 -- 172.21.15.123:0/1502467655 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c011830 con 0x7f856c0cb730 2024-09-13T17:07:25.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f8569ffb700 1 -- 172.21.15.123:0/1502467655 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c011990 con 0x7f856c0cb730 2024-09-13T17:07:25.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f8569ffb700 1 -- 172.21.15.123:0/1502467655 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c011d40 con 0x7f856c0cb730 2024-09-13T17:07:25.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 -- 172.21.15.123:0/1502467655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0cb730 msgr2=0x7f856c15a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 --2- 172.21.15.123:0/1502467655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0cb730 0x7f856c15a2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f856c0cf690 tx=0x7f855c009b30 comp rx=0 tx=0).stop 2024-09-13T17:07:25.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 -- 172.21.15.123:0/1502467655 shutdown_connections 2024-09-13T17:07:25.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 --2- 172.21.15.123:0/1502467655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0cb730 0x7f856c15a2f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 --2- 172.21.15.123:0/1502467655 >> v2:172.21.15.153:3300/0 conn(0x7f856c0b3a20 0x7f856c06d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 -- 172.21.15.123:0/1502467655 >> 172.21.15.123:0/1502467655 conn(0x7f856c0b01d0 msgr2=0x7f856c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 -- 172.21.15.123:0/1502467655 shutdown_connections 2024-09-13T17:07:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 -- 172.21.15.123:0/1502467655 wait complete. 2024-09-13T17:07:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 Processor -- start 2024-09-13T17:07:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:24.997+0000 7f856bfff700 1 -- start start 2024-09-13T17:07:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f856c06dc80 0x7f856c0c5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f856c0b3a20 0x7f856c152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0cb730 0x7f856c0ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856bfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c15a030 con 0x7f856c0cb730 2024-09-13T17:07:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856bfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0c4ce0 con 0x7f856c06dc80 2024-09-13T17:07:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c152f70 con 0x7f856c0b3a20 2024-09-13T17:07:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0cb730 0x7f856c0ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0cb730 0x7f856c0ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48856/0 (socket says 172.21.15.123:48856) 2024-09-13T17:07:25.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856b7fe700 1 -- 172.21.15.123:0/1644681312 learned_addr learned my addr 172.21.15.123:0/1644681312 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:25.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856a7fc700 1 --2- 172.21.15.123:0/1644681312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f856c0b3a20 0x7f856c152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856affd700 1 --2- 172.21.15.123:0/1644681312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f856c06dc80 0x7f856c0c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856b7fe700 1 -- 172.21.15.123:0/1644681312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f856c0b3a20 msgr2=0x7f856c152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856b7fe700 1 --2- 172.21.15.123:0/1644681312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f856c0b3a20 0x7f856c152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856b7fe700 1 -- 172.21.15.123:0/1644681312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f856c06dc80 msgr2=0x7f856c0c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856b7fe700 1 --2- 172.21.15.123:0/1644681312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f856c06dc80 0x7f856c0c5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856b7fe700 1 -- 172.21.15.123:0/1644681312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c0094b0 con 0x7f856c0cb730 2024-09-13T17:07:25.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856b7fe700 1 --2- 172.21.15.123:0/1644681312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0cb730 0x7f856c0ceb90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f855c0090b0 tx=0x7f855c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:25.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f8563fff700 1 -- 172.21.15.123:0/1644681312 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c004590 con 0x7f856c0cb730 2024-09-13T17:07:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f8563fff700 1 -- 172.21.15.123:0/1644681312 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c01e070 con 0x7f856c0cb730 2024-09-13T17:07:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856bfff700 1 -- 172.21.15.123:0/1644681312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c0c40d0 con 0x7f856c0cb730 2024-09-13T17:07:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f8563fff700 1 -- 172.21.15.123:0/1644681312 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c003900 con 0x7f856c0cb730 2024-09-13T17:07:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.001+0000 7f856bfff700 1 -- 172.21.15.123:0/1644681312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c0c4690 con 0x7f856c0cb730 2024-09-13T17:07:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.005+0000 7f856bfff700 1 -- 172.21.15.123:0/1644681312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c0b33f0 con 0x7f856c0cb730 2024-09-13T17:07:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.005+0000 7f8563fff700 1 -- 172.21.15.123:0/1644681312 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f855c003a60 con 0x7f856c0cb730 2024-09-13T17:07:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.005+0000 7f8563fff700 1 --2- 172.21.15.123:0/1644681312 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f854c066730 0x7f854c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.005+0000 7f8563fff700 1 -- 172.21.15.123:0/1644681312 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f855c020070 con 0x7f856c0cb730 2024-09-13T17:07:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.005+0000 7f856affd700 1 --2- 172.21.15.123:0/1644681312 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f854c066730 0x7f854c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.005+0000 7f856affd700 1 --2- 172.21.15.123:0/1644681312 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f854c066730 0x7f854c068bf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8554009a00 tx=0x7f8554008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:25.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.013+0000 7f8563fff700 1 -- 172.21.15.123:0/1644681312 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f855c053020 con 0x7f856c0cb730 2024-09-13T17:07:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.181+0000 7f856bfff700 1 -- 172.21.15.123:0/1644681312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f856c06d740 con 0x7f856c0cb730 2024-09-13T17:07:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.185+0000 7f8563fff700 1 -- 172.21.15.123:0/1644681312 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f855c006ce0 con 0x7f856c0cb730 2024-09-13T17:07:25.191 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:07:25.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.185+0000 7f856bfff700 1 -- 172.21.15.123:0/1644681312 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f854c066730 msgr2=0x7f854c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.185+0000 7f856bfff700 1 --2- 172.21.15.123:0/1644681312 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f854c066730 0x7f854c068bf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8554009a00 tx=0x7f8554008040 comp rx=0 tx=0).stop 2024-09-13T17:07:25.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.185+0000 7f856bfff700 1 -- 172.21.15.123:0/1644681312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0cb730 msgr2=0x7f856c0ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.185+0000 7f856bfff700 1 --2- 172.21.15.123:0/1644681312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0cb730 0x7f856c0ceb90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f855c0090b0 tx=0x7f855c004770 comp rx=0 tx=0).stop 2024-09-13T17:07:25.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.185+0000 7f856bfff700 1 -- 172.21.15.123:0/1644681312 shutdown_connections 2024-09-13T17:07:25.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.185+0000 7f856bfff700 1 --2- 172.21.15.123:0/1644681312 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f854c066730 0x7f854c068bf0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.185+0000 7f856bfff700 1 --2- 172.21.15.123:0/1644681312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0cb730 0x7f856c0ceb90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.185+0000 7f856bfff700 1 --2- 172.21.15.123:0/1644681312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f856c0b3a20 0x7f856c152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.185+0000 7f856bfff700 1 --2- 172.21.15.123:0/1644681312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f856c06dc80 0x7f856c0c5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.185+0000 7f856bfff700 1 -- 172.21.15.123:0/1644681312 >> 172.21.15.123:0/1644681312 conn(0x7f856c0b01d0 msgr2=0x7f856c0c7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:25.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.185+0000 7f856bfff700 1 -- 172.21.15.123:0/1644681312 shutdown_connections 2024-09-13T17:07:25.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.185+0000 7f856bfff700 1 -- 172.21.15.123:0/1644681312 wait complete. 2024-09-13T17:07:25.205 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:07:25.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.317+0000 7f25359d5700 1 Processor -- start 2024-09-13T17:07:25.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.317+0000 7f25359d5700 1 -- start start 2024-09-13T17:07:25.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.317+0000 7f25359d5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2530165760 0x7f2530167b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.317+0000 7f25359d5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25300d0cb0 con 0x7f25300d0f40 2024-09-13T17:07:25.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.317+0000 7f25359d5700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25300b0060 con 0x7f25300b58b0 2024-09-13T17:07:25.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.317+0000 7f25359d5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25300b0340 con 0x7f2530165760 2024-09-13T17:07:25.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.317+0000 7f25349d3700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f25300d0f40 0x7f25300d1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49872/0 (socket says 172.21.15.123:49872) 2024-09-13T17:07:25.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.317+0000 7f25349d3700 1 -- 172.21.15.123:0/159910597 learned_addr learned my addr 172.21.15.123:0/159910597 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:25.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.317+0000 7f25351d4700 1 --2- 172.21.15.123:0/159910597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2530165760 0x7f2530167b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.317+0000 7f252f7fe700 1 -- 172.21.15.123:0/159910597 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850986607 0 0) 0x7f25300d0cb0 con 0x7f25300d0f40 2024-09-13T17:07:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.317+0000 7f252f7fe700 1 -- 172.21.15.123:0/159910597 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25180035d0 con 0x7f25300d0f40 2024-09-13T17:07:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f252f7fe700 1 -- 172.21.15.123:0/159910597 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56947384 0 0) 0x7f25300b0060 con 0x7f25300b58b0 2024-09-13T17:07:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f25351d4700 1 -- 172.21.15.123:0/159910597 >> v1:172.21.15.153:6789/0 conn(0x7f25300b58b0 legacy=0x7f25300d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f25351d4700 1 -- 172.21.15.123:0/159910597 >> v1:172.21.15.123:6789/0 conn(0x7f25300d0f40 legacy=0x7f25300d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f25351d4700 1 -- 172.21.15.123:0/159910597 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25300b0620 con 0x7f2530165760 2024-09-13T17:07:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f25351d4700 1 --2- 172.21.15.123:0/159910597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2530165760 0x7f2530167b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2528009dc0 tx=0x7f252800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9120142d5dcc375 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f252f7fe700 1 -- 172.21.15.123:0/159910597 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252800e070 con 0x7f2530165760 2024-09-13T17:07:25.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f252f7fe700 1 -- 172.21.15.123:0/159910597 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2528003a40 con 0x7f2530165760 2024-09-13T17:07:25.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f252f7fe700 1 -- 172.21.15.123:0/159910597 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524001670 con 0x7f2530165760 2024-09-13T17:07:25.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f25359d5700 1 -- 172.21.15.123:0/159910597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2530165760 msgr2=0x7f2530167b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f25359d5700 1 --2- 172.21.15.123:0/159910597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2530165760 0x7f2530167b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2528009dc0 tx=0x7f252800b330 comp rx=0 tx=0).stop 2024-09-13T17:07:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f25359d5700 1 -- 172.21.15.123:0/159910597 shutdown_connections 2024-09-13T17:07:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f25359d5700 1 --2- 172.21.15.123:0/159910597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2530165760 0x7f2530167b50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f25359d5700 1 -- 172.21.15.123:0/159910597 >> 172.21.15.123:0/159910597 conn(0x7f25300d2a60 msgr2=0x7f25300d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f25359d5700 1 -- 172.21.15.123:0/159910597 shutdown_connections 2024-09-13T17:07:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f25359d5700 1 -- 172.21.15.123:0/159910597 wait complete. 2024-09-13T17:07:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f25359d5700 1 Processor -- start 2024-09-13T17:07:25.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.321+0000 7f25359d5700 1 -- start start 2024-09-13T17:07:25.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25359d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25300b58b0 0x7f253015e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25359d5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25300d0f40 0x7f253015f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25359d5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2530165760 0x7f253015f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25359d5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300b23c0 con 0x7f25300b58b0 2024-09-13T17:07:25.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25359d5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300b26a0 con 0x7f25300d0f40 2024-09-13T17:07:25.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25359d5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25300b2980 con 0x7f2530165760 2024-09-13T17:07:25.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25349d3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25300b58b0 0x7f253015e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25349d3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25300b58b0 0x7f253015e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48866/0 (socket says 172.21.15.123:48866) 2024-09-13T17:07:25.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25349d3700 1 -- 172.21.15.123:0/1718024059 learned_addr learned my addr 172.21.15.123:0/1718024059 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:25.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25351d4700 1 --2- 172.21.15.123:0/1718024059 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2530165760 0x7f253015f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f252ffff700 1 --2- 172.21.15.123:0/1718024059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25300d0f40 0x7f253015f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25349d3700 1 -- 172.21.15.123:0/1718024059 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2530165760 msgr2=0x7f253015f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25349d3700 1 --2- 172.21.15.123:0/1718024059 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2530165760 0x7f253015f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25349d3700 1 -- 172.21.15.123:0/1718024059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25300d0f40 msgr2=0x7f253015f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25349d3700 1 --2- 172.21.15.123:0/1718024059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25300d0f40 0x7f253015f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25349d3700 1 -- 172.21.15.123:0/1718024059 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528009a70 con 0x7f25300b58b0 2024-09-13T17:07:25.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25349d3700 1 --2- 172.21.15.123:0/1718024059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25300b58b0 0x7f253015e710 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f252400c6d0 tx=0x7f252400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:25.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f252d7fa700 1 -- 172.21.15.123:0/1718024059 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524004ca0 con 0x7f25300b58b0 2024-09-13T17:07:25.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f252d7fa700 1 -- 172.21.15.123:0/1718024059 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2524004e20 con 0x7f25300b58b0 2024-09-13T17:07:25.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25359d5700 1 -- 172.21.15.123:0/1718024059 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25300b2c60 con 0x7f25300b58b0 2024-09-13T17:07:25.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f252d7fa700 1 -- 172.21.15.123:0/1718024059 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524007310 con 0x7f25300b58b0 2024-09-13T17:07:25.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.325+0000 7f25359d5700 1 -- 172.21.15.123:0/1718024059 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25300b3220 con 0x7f25300b58b0 2024-09-13T17:07:25.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.329+0000 7f25359d5700 1 -- 172.21.15.123:0/1718024059 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2530070ae0 con 0x7f25300b58b0 2024-09-13T17:07:25.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.329+0000 7f252d7fa700 1 -- 172.21.15.123:0/1718024059 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2524007470 con 0x7f25300b58b0 2024-09-13T17:07:25.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.329+0000 7f252d7fa700 1 --2- 172.21.15.123:0/1718024059 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f251c066730 0x7f251c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.329+0000 7f252ffff700 1 --2- 172.21.15.123:0/1718024059 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f251c066730 0x7f251c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.329+0000 7f252d7fa700 1 -- 172.21.15.123:0/1718024059 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2524083460 con 0x7f25300b58b0 2024-09-13T17:07:25.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.329+0000 7f252ffff700 1 --2- 172.21.15.123:0/1718024059 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f251c066730 0x7f251c068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2530067090 tx=0x7f2520009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:25.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.341+0000 7f252d7fa700 1 -- 172.21.15.123:0/1718024059 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2524050750 con 0x7f25300b58b0 2024-09-13T17:07:25.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.509+0000 7f25359d5700 1 -- 172.21.15.123:0/1718024059 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f253015ce70 con 0x7f25300b58b0 2024-09-13T17:07:25.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.513+0000 7f252d7fa700 1 -- 172.21.15.123:0/1718024059 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2524007720 con 0x7f25300b58b0 2024-09-13T17:07:25.515 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:07:25.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.513+0000 7f25359d5700 1 -- 172.21.15.123:0/1718024059 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f251c066730 msgr2=0x7f251c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.513+0000 7f25359d5700 1 --2- 172.21.15.123:0/1718024059 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f251c066730 0x7f251c068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2530067090 tx=0x7f2520009040 comp rx=0 tx=0).stop 2024-09-13T17:07:25.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.513+0000 7f25359d5700 1 -- 172.21.15.123:0/1718024059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25300b58b0 msgr2=0x7f253015e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.513+0000 7f25359d5700 1 --2- 172.21.15.123:0/1718024059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25300b58b0 0x7f253015e710 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f252400c6d0 tx=0x7f252400ca90 comp rx=0 tx=0).stop 2024-09-13T17:07:25.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.513+0000 7f25359d5700 1 -- 172.21.15.123:0/1718024059 shutdown_connections 2024-09-13T17:07:25.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.513+0000 7f25359d5700 1 --2- 172.21.15.123:0/1718024059 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f251c066730 0x7f251c068bf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.513+0000 7f25359d5700 1 --2- 172.21.15.123:0/1718024059 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2530165760 0x7f253015f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.513+0000 7f25359d5700 1 --2- 172.21.15.123:0/1718024059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25300d0f40 0x7f253015f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.513+0000 7f25359d5700 1 --2- 172.21.15.123:0/1718024059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25300b58b0 0x7f253015e710 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.513+0000 7f25359d5700 1 -- 172.21.15.123:0/1718024059 >> 172.21.15.123:0/1718024059 conn(0x7f25300d2a60 msgr2=0x7f25300ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:25.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.513+0000 7f25359d5700 1 -- 172.21.15.123:0/1718024059 shutdown_connections 2024-09-13T17:07:25.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.513+0000 7f25359d5700 1 -- 172.21.15.123:0/1718024059 wait complete. 2024-09-13T17:07:25.529 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:07:25.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.637+0000 7ff1eec28700 1 Processor -- start 2024-09-13T17:07:25.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.637+0000 7ff1eec28700 1 -- start start 2024-09-13T17:07:25.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.637+0000 7ff1eec28700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1e8159b30 0x7ff1e80af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.637+0000 7ff1eec28700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff1e80afa10 0x7ff1e80c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.637+0000 7ff1eec28700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e806d6f0 con 0x7ff1e8159750 2024-09-13T17:07:25.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.637+0000 7ff1eec28700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e80afea0 con 0x7ff1e80afa10 2024-09-13T17:07:25.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.637+0000 7ff1eec28700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e806d9d0 con 0x7ff1e8159b30 2024-09-13T17:07:25.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.637+0000 7ff1ed1c5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff1e80afa10 0x7ff1e80c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.637+0000 7ff1ed1c5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff1e80afa10 0x7ff1e80c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48872/0 (socket says 172.21.15.123:48872) 2024-09-13T17:07:25.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.637+0000 7ff1ed1c5700 1 -- 172.21.15.123:0/3414096954 learned_addr learned my addr 172.21.15.123:0/3414096954 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:25.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.637+0000 7ff1e7fff700 1 --2- 172.21.15.123:0/3414096954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1e8159b30 0x7ff1e80af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1ed1c5700 1 -- 172.21.15.123:0/3414096954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1e8159b30 msgr2=0x7ff1e80af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:25.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1ed1c5700 1 --2- 172.21.15.123:0/3414096954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1e8159b30 0x7ff1e80af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1ed1c5700 1 -- 172.21.15.123:0/3414096954 >> v1:172.21.15.153:6789/0 conn(0x7ff1e8159750 legacy=0x7ff1e80ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1ed1c5700 1 -- 172.21.15.123:0/3414096954 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e80c8f70 con 0x7ff1e80afa10 2024-09-13T17:07:25.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1ed1c5700 1 --2- 172.21.15.123:0/3414096954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1e80afa10 0x7ff1e80c9a50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009e50 tx=0x7ff1e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c115ea8c08a57c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:25.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1e77fe700 1 -- 172.21.15.123:0/3414096954 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e000e070 con 0x7ff1e80afa10 2024-09-13T17:07:25.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1e77fe700 1 -- 172.21.15.123:0/3414096954 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e000b910 con 0x7ff1e80afa10 2024-09-13T17:07:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1e77fe700 1 -- 172.21.15.123:0/3414096954 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e000bcc0 con 0x7ff1e80afa10 2024-09-13T17:07:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1eec28700 1 -- 172.21.15.123:0/3414096954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1e80afa10 msgr2=0x7ff1e80c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1eec28700 1 --2- 172.21.15.123:0/3414096954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1e80afa10 0x7ff1e80c9a50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009e50 tx=0x7ff1e000b330 comp rx=0 tx=0).stop 2024-09-13T17:07:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1eec28700 1 -- 172.21.15.123:0/3414096954 shutdown_connections 2024-09-13T17:07:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1eec28700 1 --2- 172.21.15.123:0/3414096954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1e80afa10 0x7ff1e80c9a50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1eec28700 1 --2- 172.21.15.123:0/3414096954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1e8159b30 0x7ff1e80af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1eec28700 1 -- 172.21.15.123:0/3414096954 >> 172.21.15.123:0/3414096954 conn(0x7ff1e80b0450 msgr2=0x7ff1e80b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1eec28700 1 -- 172.21.15.123:0/3414096954 shutdown_connections 2024-09-13T17:07:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.641+0000 7ff1eec28700 1 -- 172.21.15.123:0/3414096954 wait complete. 2024-09-13T17:07:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1eec28700 1 Processor -- start 2024-09-13T17:07:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1eec28700 1 -- start start 2024-09-13T17:07:25.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1eec28700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1e80afa10 0x7ff1e80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1eec28700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e8159750 0x7ff1e814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1eec28700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1e8159b30 0x7ff1e80c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1eec28700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e80b1d30 con 0x7ff1e8159b30 2024-09-13T17:07:25.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1eec28700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e80b2010 con 0x7ff1e8159750 2024-09-13T17:07:25.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1eec28700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e80b22f0 con 0x7ff1e80afa10 2024-09-13T17:07:25.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1ed1c5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1e8159b30 0x7ff1e80c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1e7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e8159750 0x7ff1e814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1ed1c5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1e8159b30 0x7ff1e80c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48878/0 (socket says 172.21.15.123:48878) 2024-09-13T17:07:25.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1ec9c4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1e80afa10 0x7ff1e80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1ed1c5700 1 -- 172.21.15.123:0/807879730 learned_addr learned my addr 172.21.15.123:0/807879730 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:25.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1e7fff700 1 -- 172.21.15.123:0/807879730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1e80afa10 msgr2=0x7ff1e80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1e7fff700 1 --2- 172.21.15.123:0/807879730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1e80afa10 0x7ff1e80b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1e7fff700 1 -- 172.21.15.123:0/807879730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1e8159b30 msgr2=0x7ff1e80c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1e7fff700 1 --2- 172.21.15.123:0/807879730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1e8159b30 0x7ff1e80c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1e7fff700 1 -- 172.21.15.123:0/807879730 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e0009b30 con 0x7ff1e8159750 2024-09-13T17:07:25.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1ed1c5700 1 --2- 172.21.15.123:0/807879730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1e8159b30 0x7ff1e80c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:25.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1e7fff700 1 --2- 172.21.15.123:0/807879730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e8159750 0x7ff1e814ab20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00e870 tx=0x7ff1dc00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:25.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1e57fa700 1 -- 172.21.15.123:0/807879730 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc013680 con 0x7ff1e8159750 2024-09-13T17:07:25.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1e57fa700 1 -- 172.21.15.123:0/807879730 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0137e0 con 0x7ff1e8159750 2024-09-13T17:07:25.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1eec28700 1 -- 172.21.15.123:0/807879730 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e80b25d0 con 0x7ff1e8159750 2024-09-13T17:07:25.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1e57fa700 1 -- 172.21.15.123:0/807879730 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc013b70 con 0x7ff1e8159750 2024-09-13T17:07:25.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.645+0000 7ff1eec28700 1 -- 172.21.15.123:0/807879730 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e80c8a70 con 0x7ff1e8159750 2024-09-13T17:07:25.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.649+0000 7ff1eec28700 1 -- 172.21.15.123:0/807879730 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e80ca320 con 0x7ff1e8159750 2024-09-13T17:07:25.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.649+0000 7ff1e57fa700 1 -- 172.21.15.123:0/807879730 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff1dc013cd0 con 0x7ff1e8159750 2024-09-13T17:07:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.649+0000 7ff1e57fa700 1 --2- 172.21.15.123:0/807879730 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff1d4066730 0x7ff1d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.649+0000 7ff1e57fa700 1 -- 172.21.15.123:0/807879730 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1dc083f50 con 0x7ff1e8159750 2024-09-13T17:07:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.649+0000 7ff1ec9c4700 1 --2- 172.21.15.123:0/807879730 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff1d4066730 0x7ff1d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.649+0000 7ff1ec9c4700 1 --2- 172.21.15.123:0/807879730 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff1d4066730 0x7ff1d4068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff1e814e6b0 tx=0x7ff1d8009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:25.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.661+0000 7ff1e57fa700 1 -- 172.21.15.123:0/807879730 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff1dc051220 con 0x7ff1e8159750 2024-09-13T17:07:25.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.841+0000 7ff1eec28700 1 -- 172.21.15.123:0/807879730 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff1e80b2150 con 0x7ff1e8159750 2024-09-13T17:07:25.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.841+0000 7ff1e57fa700 1 -- 172.21.15.123:0/807879730 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff1e80b2150 con 0x7ff1e8159750 2024-09-13T17:07:25.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.845+0000 7ff1eec28700 1 -- 172.21.15.123:0/807879730 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff1d4066730 msgr2=0x7ff1d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.845+0000 7ff1eec28700 1 --2- 172.21.15.123:0/807879730 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff1d4066730 0x7ff1d4068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff1e814e6b0 tx=0x7ff1d8009040 comp rx=0 tx=0).stop 2024-09-13T17:07:25.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.845+0000 7ff1eec28700 1 -- 172.21.15.123:0/807879730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e8159750 msgr2=0x7ff1e814ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:25.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.845+0000 7ff1eec28700 1 --2- 172.21.15.123:0/807879730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e8159750 0x7ff1e814ab20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00e870 tx=0x7ff1dc00eb80 comp rx=0 tx=0).stop 2024-09-13T17:07:25.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.845+0000 7ff1eec28700 1 -- 172.21.15.123:0/807879730 shutdown_connections 2024-09-13T17:07:25.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.845+0000 7ff1eec28700 1 --2- 172.21.15.123:0/807879730 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff1d4066730 0x7ff1d4068bf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.845+0000 7ff1eec28700 1 --2- 172.21.15.123:0/807879730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1e8159b30 0x7ff1e80c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.845+0000 7ff1eec28700 1 --2- 172.21.15.123:0/807879730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e8159750 0x7ff1e814ab20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.845+0000 7ff1eec28700 1 --2- 172.21.15.123:0/807879730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1e80afa10 0x7ff1e80b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:25.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.845+0000 7ff1eec28700 1 -- 172.21.15.123:0/807879730 >> 172.21.15.123:0/807879730 conn(0x7ff1e80b0450 msgr2=0x7ff1e815cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:25.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.845+0000 7ff1eec28700 1 -- 172.21.15.123:0/807879730 shutdown_connections 2024-09-13T17:07:25.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:25.845+0000 7ff1eec28700 1 -- 172.21.15.123:0/807879730 wait complete. 2024-09-13T17:07:25.849 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:07:25.864 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-09-13T17:07:25.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:25.865 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:07:25.892 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:07:25.893 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:07:25.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:25.893 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:07:25.912 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:07:25.913 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:07:25.921 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:07:25.921 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:07:25.928 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:26.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 Processor -- start 2024-09-13T17:07:26.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 -- start start 2024-09-13T17:07:26.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1c9c0cedc0 0x7f1c9c071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1c9c0cdfd0 0x7f1c9c159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9c15d360 con 0x7f1c9c1598b0 2024-09-13T17:07:26.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9c0ce3f0 con 0x7f1c9c0cdfd0 2024-09-13T17:07:26.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9c0724c0 con 0x7f1c9c0cedc0 2024-09-13T17:07:26.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca0adb700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1c9c1598b0 0x7f1c9c0ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49878/0 (socket says 172.21.15.123:49878) 2024-09-13T17:07:26.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca0adb700 1 -- 172.21.15.123:0/3349484451 learned_addr learned my addr 172.21.15.123:0/3349484451 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:26.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca12dc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1c9c0cdfd0 0x7f1c9c159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1c9bfff700 1 --2- 172.21.15.123:0/3349484451 >> v2:172.21.15.153:3300/0 conn(0x7f1c9c0cedc0 0x7f1c9c071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca12dc700 1 -- 172.21.15.123:0/3349484451 >> v2:172.21.15.153:3300/0 conn(0x7f1c9c0cedc0 msgr2=0x7f1c9c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:26.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca12dc700 1 --2- 172.21.15.123:0/3349484451 >> v2:172.21.15.153:3300/0 conn(0x7f1c9c0cedc0 0x7f1c9c071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca12dc700 1 -- 172.21.15.123:0/3349484451 >> v1:172.21.15.123:6789/0 conn(0x7f1c9c1598b0 legacy=0x7f1c9c0ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1c9b7fe700 1 -- 172.21.15.123:0/3349484451 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077355658 0 0) 0x7f1c9c15d360 con 0x7f1c9c1598b0 2024-09-13T17:07:26.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca12dc700 1 -- 172.21.15.123:0/3349484451 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c15d5b0 con 0x7f1c9c0cdfd0 2024-09-13T17:07:26.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca12dc700 1 --2- 172.21.15.123:0/3349484451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c9c0cdfd0 0x7f1c9c159c90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c06be20 tx=0x7f1c9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa01ff952a5fdba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:26.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1c9b7fe700 1 -- 172.21.15.123:0/3349484451 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9400e070 con 0x7f1c9c0cdfd0 2024-09-13T17:07:26.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1c9b7fe700 1 -- 172.21.15.123:0/3349484451 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9400bb20 con 0x7f1c9c0cdfd0 2024-09-13T17:07:26.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1c9b7fe700 1 -- 172.21.15.123:0/3349484451 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94012430 con 0x7f1c9c0cdfd0 2024-09-13T17:07:26.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 -- 172.21.15.123:0/3349484451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c9c0cdfd0 msgr2=0x7f1c9c159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 --2- 172.21.15.123:0/3349484451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c9c0cdfd0 0x7f1c9c159c90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c06be20 tx=0x7f1c9400b330 comp rx=0 tx=0).stop 2024-09-13T17:07:26.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 -- 172.21.15.123:0/3349484451 shutdown_connections 2024-09-13T17:07:26.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 --2- 172.21.15.123:0/3349484451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c9c0cdfd0 0x7f1c9c159c90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 --2- 172.21.15.123:0/3349484451 >> v2:172.21.15.153:3300/0 conn(0x7f1c9c0cedc0 0x7f1c9c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 -- 172.21.15.123:0/3349484451 >> 172.21.15.123:0/3349484451 conn(0x7f1c9c066150 msgr2=0x7f1c9c066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:26.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 -- 172.21.15.123:0/3349484451 shutdown_connections 2024-09-13T17:07:26.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.081+0000 7f1ca1add700 1 -- 172.21.15.123:0/3349484451 wait complete. 2024-09-13T17:07:26.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.085+0000 7f1ca1add700 1 Processor -- start 2024-09-13T17:07:26.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.085+0000 7f1ca1add700 1 -- start start 2024-09-13T17:07:26.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1ca1add700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c9c0cdfd0 0x7f1c9c142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1ca1add700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c9c0cedc0 0x7f1c9c145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1ca1add700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c9c1598b0 0x7f1c9c15bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1ca1add700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c143330 con 0x7f1c9c0cedc0 2024-09-13T17:07:26.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1ca1add700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c142ff0 con 0x7f1c9c1598b0 2024-09-13T17:07:26.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1ca1add700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c1462a0 con 0x7f1c9c0cdfd0 2024-09-13T17:07:26.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1c9bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c9c0cedc0 0x7f1c9c145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1ca0adb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c9c0cdfd0 0x7f1c9c142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1c9bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c9c0cedc0 0x7f1c9c145d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48894/0 (socket says 172.21.15.123:48894) 2024-09-13T17:07:26.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1c9bfff700 1 -- 172.21.15.123:0/2687526509 learned_addr learned my addr 172.21.15.123:0/2687526509 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:26.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1ca12dc700 1 --2- 172.21.15.123:0/2687526509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c9c1598b0 0x7f1c9c15bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1c9bfff700 1 -- 172.21.15.123:0/2687526509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c9c0cdfd0 msgr2=0x7f1c9c142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1c9bfff700 1 --2- 172.21.15.123:0/2687526509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c9c0cdfd0 0x7f1c9c142ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1c9bfff700 1 -- 172.21.15.123:0/2687526509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c9c1598b0 msgr2=0x7f1c9c15bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1c9bfff700 1 --2- 172.21.15.123:0/2687526509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c9c1598b0 0x7f1c9c15bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1c9bfff700 1 -- 172.21.15.123:0/2687526509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c94009a70 con 0x7f1c9c0cedc0 2024-09-13T17:07:26.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1c9bfff700 1 --2- 172.21.15.123:0/2687526509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c9c0cedc0 0x7f1c9c145d60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00ea00 tx=0x7f1c8c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:26.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1c997fa700 1 -- 172.21.15.123:0/2687526509 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c009720 con 0x7f1c9c0cedc0 2024-09-13T17:07:26.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1c997fa700 1 -- 172.21.15.123:0/2687526509 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c00eea0 con 0x7f1c9c0cedc0 2024-09-13T17:07:26.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1ca1add700 1 -- 172.21.15.123:0/2687526509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9c0ab160 con 0x7f1c9c0cedc0 2024-09-13T17:07:26.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1c997fa700 1 -- 172.21.15.123:0/2687526509 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c00ca50 con 0x7f1c9c0cedc0 2024-09-13T17:07:26.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.089+0000 7f1ca1add700 1 -- 172.21.15.123:0/2687526509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9c1f0bc0 con 0x7f1c9c0cedc0 2024-09-13T17:07:26.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.093+0000 7f1ca1add700 1 -- 172.21.15.123:0/2687526509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c0677f0 con 0x7f1c9c0cedc0 2024-09-13T17:07:26.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.093+0000 7f1c997fa700 1 -- 172.21.15.123:0/2687526509 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c8c00cbb0 con 0x7f1c9c0cedc0 2024-09-13T17:07:26.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.093+0000 7f1c997fa700 1 --2- 172.21.15.123:0/2687526509 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c7c066730 0x7f1c7c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.093+0000 7f1ca0adb700 1 --2- 172.21.15.123:0/2687526509 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c7c066730 0x7f1c7c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.093+0000 7f1c997fa700 1 -- 172.21.15.123:0/2687526509 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c8c0841a0 con 0x7f1c9c0cedc0 2024-09-13T17:07:26.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.093+0000 7f1ca0adb700 1 --2- 172.21.15.123:0/2687526509 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c7c066730 0x7f1c7c068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1c84000f60 tx=0x7f1c84007e00 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:26.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.101+0000 7f1c997fa700 1 -- 172.21.15.123:0/2687526509 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c8c051510 con 0x7f1c9c0cedc0 2024-09-13T17:07:26.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.269+0000 7f1ca1add700 1 -- 172.21.15.123:0/2687526509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c9c071e60 con 0x7f1c9c0cedc0 2024-09-13T17:07:26.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.269+0000 7f1c997fa700 1 -- 172.21.15.123:0/2687526509 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f1c8c054b30 con 0x7f1c9c0cedc0 2024-09-13T17:07:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:26.273 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:26.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.273+0000 7f1ca1add700 1 -- 172.21.15.123:0/2687526509 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c7c066730 msgr2=0x7f1c7c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.273+0000 7f1ca1add700 1 --2- 172.21.15.123:0/2687526509 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c7c066730 0x7f1c7c068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1c84000f60 tx=0x7f1c84007e00 comp rx=0 tx=0).stop 2024-09-13T17:07:26.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.273+0000 7f1ca1add700 1 -- 172.21.15.123:0/2687526509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c9c0cedc0 msgr2=0x7f1c9c145d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.273+0000 7f1ca1add700 1 --2- 172.21.15.123:0/2687526509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c9c0cedc0 0x7f1c9c145d60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00ea00 tx=0x7f1c8c00ed10 comp rx=0 tx=0).stop 2024-09-13T17:07:26.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.273+0000 7f1ca1add700 1 -- 172.21.15.123:0/2687526509 shutdown_connections 2024-09-13T17:07:26.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.273+0000 7f1ca1add700 1 --2- 172.21.15.123:0/2687526509 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c7c066730 0x7f1c7c068bf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.273+0000 7f1ca1add700 1 --2- 172.21.15.123:0/2687526509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c9c1598b0 0x7f1c9c15bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.273+0000 7f1ca1add700 1 --2- 172.21.15.123:0/2687526509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c9c0cedc0 0x7f1c9c145d60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.273+0000 7f1ca1add700 1 --2- 172.21.15.123:0/2687526509 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c9c0cdfd0 0x7f1c9c142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.273+0000 7f1ca1add700 1 -- 172.21.15.123:0/2687526509 >> 172.21.15.123:0/2687526509 conn(0x7f1c9c066150 msgr2=0x7f1c9c066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:26.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.273+0000 7f1ca1add700 1 -- 172.21.15.123:0/2687526509 shutdown_connections 2024-09-13T17:07:26.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.273+0000 7f1ca1add700 1 -- 172.21.15.123:0/2687526509 wait complete. 2024-09-13T17:07:26.288 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:26.288 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:26.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a508df700 1 Processor -- start 2024-09-13T17:07:26.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a508df700 1 -- start start 2024-09-13T17:07:26.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a508df700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a4c0cb760 0x7f3a4c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a508df700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3a4c0c5160 0x7f3a4c0ae720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a508df700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4c0adb40 con 0x7f3a4c161010 2024-09-13T17:07:26.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a508df700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c1613f0 con 0x7f3a4c0c5160 2024-09-13T17:07:26.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a508df700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0cdfc0 con 0x7f3a4c0cb760 2024-09-13T17:07:26.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a4ad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3a4c0c5160 0x7f3a4c0ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a4ad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3a4c0c5160 0x7f3a4c0ae720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48912/0 (socket says 172.21.15.123:48912) 2024-09-13T17:07:26.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a4ad9d700 1 -- 172.21.15.123:0/2989356532 learned_addr learned my addr 172.21.15.123:0/2989356532 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:26.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a49d9b700 1 --2- 172.21.15.123:0/2989356532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a4c0cb760 0x7f3a4c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a4ad9d700 1 -- 172.21.15.123:0/2989356532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a4c0cb760 msgr2=0x7f3a4c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:26.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a4ad9d700 1 --2- 172.21.15.123:0/2989356532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a4c0cb760 0x7f3a4c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a4ad9d700 1 -- 172.21.15.123:0/2989356532 >> v1:172.21.15.153:6789/0 conn(0x7f3a4c161010 legacy=0x7f3a4c0cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a4ad9d700 1 -- 172.21.15.123:0/2989356532 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c0c5660 con 0x7f3a4c0c5160 2024-09-13T17:07:26.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a4ad9d700 1 --2- 172.21.15.123:0/2989356532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a4c0c5160 0x7f3a4c0ae720 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3a44009e50 tx=0x7f3a4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc7243f6f1d5700 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:26.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a4959a700 1 -- 172.21.15.123:0/2989356532 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400e070 con 0x7f3a4c0c5160 2024-09-13T17:07:26.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a4959a700 1 -- 172.21.15.123:0/2989356532 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4400b910 con 0x7f3a4c0c5160 2024-09-13T17:07:26.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.409+0000 7f3a4959a700 1 -- 172.21.15.123:0/2989356532 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400bcc0 con 0x7f3a4c0c5160 2024-09-13T17:07:26.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 -- 172.21.15.123:0/2989356532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a4c0c5160 msgr2=0x7f3a4c0ae720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 --2- 172.21.15.123:0/2989356532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a4c0c5160 0x7f3a4c0ae720 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3a44009e50 tx=0x7f3a4400b330 comp rx=0 tx=0).stop 2024-09-13T17:07:26.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 -- 172.21.15.123:0/2989356532 shutdown_connections 2024-09-13T17:07:26.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 --2- 172.21.15.123:0/2989356532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a4c0c5160 0x7f3a4c0ae720 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 --2- 172.21.15.123:0/2989356532 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a4c0cb760 0x7f3a4c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 -- 172.21.15.123:0/2989356532 >> 172.21.15.123:0/2989356532 conn(0x7f3a4c066ac0 msgr2=0x7f3a4c0b0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:26.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 -- 172.21.15.123:0/2989356532 shutdown_connections 2024-09-13T17:07:26.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 -- 172.21.15.123:0/2989356532 wait complete. 2024-09-13T17:07:26.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 Processor -- start 2024-09-13T17:07:26.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 -- start start 2024-09-13T17:07:26.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a4c0c5160 0x7f3a4c14fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a4c0cb760 0x7f3a4c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a4c161010 0x7f3a4c0b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0b3a20 con 0x7f3a4c0c5160 2024-09-13T17:07:26.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c150020 con 0x7f3a4c0cb760 2024-09-13T17:07:26.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a508df700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0b2da0 con 0x7f3a4c161010 2024-09-13T17:07:26.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a4a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a4c0c5160 0x7f3a4c14fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a4a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a4c0c5160 0x7f3a4c14fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48914/0 (socket says 172.21.15.123:48914) 2024-09-13T17:07:26.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a4a59c700 1 -- 172.21.15.123:0/4164427454 learned_addr learned my addr 172.21.15.123:0/4164427454 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:26.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a4ad9d700 1 --2- 172.21.15.123:0/4164427454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a4c161010 0x7f3a4c0b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a49d9b700 1 --2- 172.21.15.123:0/4164427454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a4c0cb760 0x7f3a4c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a4a59c700 1 -- 172.21.15.123:0/4164427454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a4c161010 msgr2=0x7f3a4c0b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a4a59c700 1 --2- 172.21.15.123:0/4164427454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a4c161010 0x7f3a4c0b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a4a59c700 1 -- 172.21.15.123:0/4164427454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a4c0cb760 msgr2=0x7f3a4c15a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a4a59c700 1 --2- 172.21.15.123:0/4164427454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a4c0cb760 0x7f3a4c15a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a4a59c700 1 -- 172.21.15.123:0/4164427454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a44009b30 con 0x7f3a4c0c5160 2024-09-13T17:07:26.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.413+0000 7f3a4a59c700 1 --2- 172.21.15.123:0/4164427454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a4c0c5160 0x7f3a4c14fae0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400c500 tx=0x7f3a3400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:26.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.417+0000 7f3a42ffd700 1 -- 172.21.15.123:0/4164427454 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a340052d0 con 0x7f3a4c0c5160 2024-09-13T17:07:26.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.417+0000 7f3a42ffd700 1 -- 172.21.15.123:0/4164427454 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a34005430 con 0x7f3a4c0c5160 2024-09-13T17:07:26.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.417+0000 7f3a508df700 1 -- 172.21.15.123:0/4164427454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4c0b3080 con 0x7f3a4c0c5160 2024-09-13T17:07:26.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.417+0000 7f3a42ffd700 1 -- 172.21.15.123:0/4164427454 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a340055a0 con 0x7f3a4c0c5160 2024-09-13T17:07:26.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.417+0000 7f3a508df700 1 -- 172.21.15.123:0/4164427454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c0b3640 con 0x7f3a4c0c5160 2024-09-13T17:07:26.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.417+0000 7f3a508df700 1 -- 172.21.15.123:0/4164427454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4c0ce450 con 0x7f3a4c0c5160 2024-09-13T17:07:26.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.417+0000 7f3a42ffd700 1 -- 172.21.15.123:0/4164427454 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3a340038e0 con 0x7f3a4c0c5160 2024-09-13T17:07:26.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.417+0000 7f3a42ffd700 1 --2- 172.21.15.123:0/4164427454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3a2c066730 0x7f3a2c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.417+0000 7f3a49d9b700 1 --2- 172.21.15.123:0/4164427454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3a2c066730 0x7f3a2c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.417+0000 7f3a42ffd700 1 -- 172.21.15.123:0/4164427454 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a340838d0 con 0x7f3a4c0c5160 2024-09-13T17:07:26.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.421+0000 7f3a49d9b700 1 --2- 172.21.15.123:0/4164427454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3a2c066730 0x7f3a2c068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0721a0 tx=0x7f3a3c008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:26.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.425+0000 7f3a42ffd700 1 -- 172.21.15.123:0/4164427454 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3a34050db0 con 0x7f3a4c0c5160 2024-09-13T17:07:26.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.593+0000 7f3a508df700 1 -- 172.21.15.123:0/4164427454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a4c0b3c90 con 0x7f3a4c0c5160 2024-09-13T17:07:26.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.593+0000 7f3a42ffd700 1 -- 172.21.15.123:0/4164427454 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a340543d0 con 0x7f3a4c0c5160 2024-09-13T17:07:26.595 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:26.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.593+0000 7f3a508df700 1 -- 172.21.15.123:0/4164427454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3a2c066730 msgr2=0x7f3a2c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.593+0000 7f3a508df700 1 --2- 172.21.15.123:0/4164427454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3a2c066730 0x7f3a2c068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0721a0 tx=0x7f3a3c008040 comp rx=0 tx=0).stop 2024-09-13T17:07:26.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.593+0000 7f3a508df700 1 -- 172.21.15.123:0/4164427454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a4c0c5160 msgr2=0x7f3a4c14fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.593+0000 7f3a508df700 1 --2- 172.21.15.123:0/4164427454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a4c0c5160 0x7f3a4c14fae0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400c500 tx=0x7f3a3400c810 comp rx=0 tx=0).stop 2024-09-13T17:07:26.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.593+0000 7f3a508df700 1 -- 172.21.15.123:0/4164427454 shutdown_connections 2024-09-13T17:07:26.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.593+0000 7f3a508df700 1 --2- 172.21.15.123:0/4164427454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3a2c066730 0x7f3a2c068bf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.593+0000 7f3a508df700 1 --2- 172.21.15.123:0/4164427454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a4c161010 0x7f3a4c0b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.593+0000 7f3a508df700 1 --2- 172.21.15.123:0/4164427454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a4c0cb760 0x7f3a4c15a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.593+0000 7f3a508df700 1 --2- 172.21.15.123:0/4164427454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a4c0c5160 0x7f3a4c14fae0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.593+0000 7f3a508df700 1 -- 172.21.15.123:0/4164427454 >> 172.21.15.123:0/4164427454 conn(0x7f3a4c066ac0 msgr2=0x7f3a4c06d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:26.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.593+0000 7f3a508df700 1 -- 172.21.15.123:0/4164427454 shutdown_connections 2024-09-13T17:07:26.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.593+0000 7f3a508df700 1 -- 172.21.15.123:0/4164427454 wait complete. 2024-09-13T17:07:26.610 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:07:26.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.729+0000 7f9ae5a15700 1 Processor -- start 2024-09-13T17:07:26.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.729+0000 7f9ae5a15700 1 -- start start 2024-09-13T17:07:26.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5a15700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9ae01592e0 0x7f9ae015d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5a15700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ae01596c0 0x7f9ae015d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5a15700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae00cd2e0 con 0x7f9ae006dc90 2024-09-13T17:07:26.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5a15700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae00cb810 con 0x7f9ae01592e0 2024-09-13T17:07:26.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5a15700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae00cd5c0 con 0x7f9ae01596c0 2024-09-13T17:07:26.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae4a13700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9ae01592e0 0x7f9ae015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5214700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9ae006dc90 0x7f9ae00cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49894/0 (socket says 172.21.15.123:49894) 2024-09-13T17:07:26.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5214700 1 -- 172.21.15.123:0/2070653454 learned_addr learned my addr 172.21.15.123:0/2070653454 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:26.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9adffff700 1 --2- 172.21.15.123:0/2070653454 >> v2:172.21.15.153:3300/0 conn(0x7f9ae01596c0 0x7f9ae015d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9adf7fe700 1 -- 172.21.15.123:0/2070653454 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940029154 0 0) 0x7f9ae00cd2e0 con 0x7f9ae006dc90 2024-09-13T17:07:26.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9adf7fe700 1 -- 172.21.15.123:0/2070653454 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9acc0035d0 con 0x7f9ae006dc90 2024-09-13T17:07:26.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae4a13700 1 -- 172.21.15.123:0/2070653454 >> v2:172.21.15.153:3300/0 conn(0x7f9ae01596c0 msgr2=0x7f9ae015d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:26.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae4a13700 1 --2- 172.21.15.123:0/2070653454 >> v2:172.21.15.153:3300/0 conn(0x7f9ae01596c0 0x7f9ae015d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae4a13700 1 -- 172.21.15.123:0/2070653454 >> v1:172.21.15.123:6789/0 conn(0x7f9ae006dc90 legacy=0x7f9ae00cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae4a13700 1 -- 172.21.15.123:0/2070653454 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00cd8a0 con 0x7f9ae01592e0 2024-09-13T17:07:26.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae4a13700 1 --2- 172.21.15.123:0/2070653454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ae01592e0 0x7f9ae015d030 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9ae006bd60 tx=0x7f9ad0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc881ae5e51eeb2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:26.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9adf7fe700 1 -- 172.21.15.123:0/2070653454 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0011830 con 0x7f9ae01592e0 2024-09-13T17:07:26.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9adf7fe700 1 -- 172.21.15.123:0/2070653454 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad0011990 con 0x7f9ae01592e0 2024-09-13T17:07:26.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9adf7fe700 1 -- 172.21.15.123:0/2070653454 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0011d00 con 0x7f9ae01592e0 2024-09-13T17:07:26.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2070653454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ae01592e0 msgr2=0x7f9ae015d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5a15700 1 --2- 172.21.15.123:0/2070653454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ae01592e0 0x7f9ae015d030 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9ae006bd60 tx=0x7f9ad0009b30 comp rx=0 tx=0).stop 2024-09-13T17:07:26.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2070653454 shutdown_connections 2024-09-13T17:07:26.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5a15700 1 --2- 172.21.15.123:0/2070653454 >> v2:172.21.15.153:3300/0 conn(0x7f9ae01596c0 0x7f9ae015d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5a15700 1 --2- 172.21.15.123:0/2070653454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ae01592e0 0x7f9ae015d030 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2070653454 >> 172.21.15.123:0/2070653454 conn(0x7f9ae00b01d0 msgr2=0x7f9ae00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:26.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2070653454 shutdown_connections 2024-09-13T17:07:26.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.733+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2070653454 wait complete. 2024-09-13T17:07:26.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae5a15700 1 Processor -- start 2024-09-13T17:07:26.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae5a15700 1 -- start start 2024-09-13T17:07:26.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae5a15700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ae006dc90 0x7f9ae0149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae5a15700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ae01592e0 0x7f9ae00c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae5a15700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ae01596c0 0x7f9ae014a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae5a15700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00c6040 con 0x7f9ae006dc90 2024-09-13T17:07:26.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae5a15700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00c5750 con 0x7f9ae01592e0 2024-09-13T17:07:26.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae5a15700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00c7f10 con 0x7f9ae01596c0 2024-09-13T17:07:26.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae4a13700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ae006dc90 0x7f9ae0149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae4a13700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ae006dc90 0x7f9ae0149a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48934/0 (socket says 172.21.15.123:48934) 2024-09-13T17:07:26.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae4a13700 1 -- 172.21.15.123:0/2044983986 learned_addr learned my addr 172.21.15.123:0/2044983986 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:26.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae5214700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ae01596c0 0x7f9ae014a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9adffff700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ae01592e0 0x7f9ae00c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae4a13700 1 -- 172.21.15.123:0/2044983986 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ae01596c0 msgr2=0x7f9ae014a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae4a13700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ae01596c0 0x7f9ae014a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae4a13700 1 -- 172.21.15.123:0/2044983986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ae01592e0 msgr2=0x7f9ae00c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae4a13700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ae01592e0 0x7f9ae00c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae4a13700 1 -- 172.21.15.123:0/2044983986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad00094b0 con 0x7f9ae006dc90 2024-09-13T17:07:26.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9adffff700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ae01592e0 0x7f9ae00c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:26.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae4a13700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ae006dc90 0x7f9ae0149a60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009b70 tx=0x7f9ad0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:26.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9add7fa700 1 -- 172.21.15.123:0/2044983986 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00045d0 con 0x7f9ae006dc90 2024-09-13T17:07:26.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9add7fa700 1 -- 172.21.15.123:0/2044983986 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad001f070 con 0x7f9ae006dc90 2024-09-13T17:07:26.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2044983986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae00c59f0 con 0x7f9ae006dc90 2024-09-13T17:07:26.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9add7fa700 1 -- 172.21.15.123:0/2044983986 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00038c0 con 0x7f9ae006dc90 2024-09-13T17:07:26.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.737+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2044983986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae0149fa0 con 0x7f9ae006dc90 2024-09-13T17:07:26.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.741+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2044983986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae00cd2e0 con 0x7f9ae006dc90 2024-09-13T17:07:26.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.741+0000 7f9add7fa700 1 -- 172.21.15.123:0/2044983986 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ad0003a20 con 0x7f9ae006dc90 2024-09-13T17:07:26.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.741+0000 7f9add7fa700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ac0066760 0x7f9ac0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:26.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.741+0000 7f9adffff700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ac0066760 0x7f9ac0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:26.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.741+0000 7f9add7fa700 1 -- 172.21.15.123:0/2044983986 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ad0021070 con 0x7f9ae006dc90 2024-09-13T17:07:26.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.741+0000 7f9adffff700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ac0066760 0x7f9ac0068c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9ae01583a0 tx=0x7f9ac8008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:26.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.749+0000 7f9add7fa700 1 -- 172.21.15.123:0/2044983986 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ad0052da0 con 0x7f9ae006dc90 2024-09-13T17:07:26.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.917+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2044983986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ae00b4600 con 0x7f9ae006dc90 2024-09-13T17:07:26.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.917+0000 7f9add7fa700 1 -- 172.21.15.123:0/2044983986 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ad00150a0 con 0x7f9ae006dc90 2024-09-13T17:07:26.920 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:07:26.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.917+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2044983986 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ac0066760 msgr2=0x7f9ac0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.917+0000 7f9ae5a15700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ac0066760 0x7f9ac0068c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9ae01583a0 tx=0x7f9ac8008040 comp rx=0 tx=0).stop 2024-09-13T17:07:26.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.917+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2044983986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ae006dc90 msgr2=0x7f9ae0149a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:26.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.917+0000 7f9ae5a15700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ae006dc90 0x7f9ae0149a60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009b70 tx=0x7f9ad0004770 comp rx=0 tx=0).stop 2024-09-13T17:07:26.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.921+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2044983986 shutdown_connections 2024-09-13T17:07:26.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.921+0000 7f9ae5a15700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ac0066760 0x7f9ac0068c20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.921+0000 7f9ae5a15700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ae01596c0 0x7f9ae014a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.921+0000 7f9ae5a15700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ae01592e0 0x7f9ae00c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.921+0000 7f9ae5a15700 1 --2- 172.21.15.123:0/2044983986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ae006dc90 0x7f9ae0149a60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:26.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.921+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2044983986 >> 172.21.15.123:0/2044983986 conn(0x7f9ae00b01d0 msgr2=0x7f9ae0070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:26.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.921+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2044983986 shutdown_connections 2024-09-13T17:07:26.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:26.921+0000 7f9ae5a15700 1 -- 172.21.15.123:0/2044983986 wait complete. 2024-09-13T17:07:26.934 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:07:27.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.045+0000 7f57aedec700 1 Processor -- start 2024-09-13T17:07:27.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.045+0000 7f57aedec700 1 -- start start 2024-09-13T17:07:27.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57aedec700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57a8159c60 0x7f57a815e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57aedec700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f57a8070f90 0x7f57a80cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57aedec700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a80ada60 con 0x7f57a80cdbd0 2024-09-13T17:07:27.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57aedec700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a80ce060 con 0x7f57a8070f90 2024-09-13T17:07:27.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57aedec700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a815e680 con 0x7f57a8159c60 2024-09-13T17:07:27.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57addea700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57a8159c60 0x7f57a815e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57ad5e9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f57a8070f90 0x7f57a80cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57ae5eb700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f57a80cdbd0 0x7f57a80cb090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:51064/0 (socket says 172.21.15.123:51064) 2024-09-13T17:07:27.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57ae5eb700 1 -- 172.21.15.123:0/3249138372 learned_addr learned my addr 172.21.15.123:0/3249138372 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:27.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57ad5e9700 1 -- 172.21.15.123:0/3249138372 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57a8159c60 msgr2=0x7f57a815e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:27.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57ad5e9700 1 --2- 172.21.15.123:0/3249138372 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57a8159c60 0x7f57a815e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57ad5e9700 1 -- 172.21.15.123:0/3249138372 >> v1:172.21.15.153:6789/0 conn(0x7f57a80cdbd0 legacy=0x7f57a80cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57ad5e9700 1 -- 172.21.15.123:0/3249138372 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80720a0 con 0x7f57a8070f90 2024-09-13T17:07:27.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57ad5e9700 1 --2- 172.21.15.123:0/3249138372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a8070f90 0x7f57a80cd690 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009850 tx=0x7f57a4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6dc17e63bdd4903 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:27.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57acde8700 1 -- 172.21.15.123:0/3249138372 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4011830 con 0x7f57a8070f90 2024-09-13T17:07:27.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57acde8700 1 -- 172.21.15.123:0/3249138372 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a4011990 con 0x7f57a8070f90 2024-09-13T17:07:27.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57acde8700 1 -- 172.21.15.123:0/3249138372 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4011d40 con 0x7f57a8070f90 2024-09-13T17:07:27.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57aedec700 1 -- 172.21.15.123:0/3249138372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a8070f90 msgr2=0x7f57a80cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57aedec700 1 --2- 172.21.15.123:0/3249138372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a8070f90 0x7f57a80cd690 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009850 tx=0x7f57a4009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:27.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57aedec700 1 -- 172.21.15.123:0/3249138372 shutdown_connections 2024-09-13T17:07:27.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57aedec700 1 --2- 172.21.15.123:0/3249138372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a8070f90 0x7f57a80cd690 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57aedec700 1 --2- 172.21.15.123:0/3249138372 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57a8159c60 0x7f57a815e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57aedec700 1 -- 172.21.15.123:0/3249138372 >> 172.21.15.123:0/3249138372 conn(0x7f57a80b01d0 msgr2=0x7f57a80b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:27.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57aedec700 1 -- 172.21.15.123:0/3249138372 shutdown_connections 2024-09-13T17:07:27.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.049+0000 7f57aedec700 1 -- 172.21.15.123:0/3249138372 wait complete. 2024-09-13T17:07:27.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57aedec700 1 Processor -- start 2024-09-13T17:07:27.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57aedec700 1 -- start start 2024-09-13T17:07:27.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57aedec700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57a8070f90 0x7f57a815ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57aedec700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57a80cdbd0 0x7f57a815cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57aedec700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a8159c60 0x7f57a81519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57aedec700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a815d2c0 con 0x7f57a8070f90 2024-09-13T17:07:27.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57aedec700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a80b1b80 con 0x7f57a8159c60 2024-09-13T17:07:27.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57aedec700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a8151f10 con 0x7f57a80cdbd0 2024-09-13T17:07:27.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57addea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57a8070f90 0x7f57a815ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57addea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57a8070f90 0x7f57a815ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48946/0 (socket says 172.21.15.123:48946) 2024-09-13T17:07:27.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57addea700 1 -- 172.21.15.123:0/208791029 learned_addr learned my addr 172.21.15.123:0/208791029 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:27.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57ae5eb700 1 --2- 172.21.15.123:0/208791029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a8159c60 0x7f57a81519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57ad5e9700 1 --2- 172.21.15.123:0/208791029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57a80cdbd0 0x7f57a815cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57addea700 1 -- 172.21.15.123:0/208791029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57a80cdbd0 msgr2=0x7f57a815cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57addea700 1 --2- 172.21.15.123:0/208791029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57a80cdbd0 0x7f57a815cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57addea700 1 -- 172.21.15.123:0/208791029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a8159c60 msgr2=0x7f57a81519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57addea700 1 --2- 172.21.15.123:0/208791029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a8159c60 0x7f57a81519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.053+0000 7f57addea700 1 -- 172.21.15.123:0/208791029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a40094b0 con 0x7f57a8070f90 2024-09-13T17:07:27.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.057+0000 7f57addea700 1 --2- 172.21.15.123:0/208791029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57a8070f90 0x7f57a815ac20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f579c00e870 tx=0x7f579c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:27.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.057+0000 7f579a7fc700 1 -- 172.21.15.123:0/208791029 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c0095a0 con 0x7f57a8070f90 2024-09-13T17:07:27.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.057+0000 7f579a7fc700 1 -- 172.21.15.123:0/208791029 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579c013680 con 0x7f57a8070f90 2024-09-13T17:07:27.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.057+0000 7f57aedec700 1 -- 172.21.15.123:0/208791029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a80b1570 con 0x7f57a8070f90 2024-09-13T17:07:27.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.057+0000 7f579a7fc700 1 -- 172.21.15.123:0/208791029 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c0139f0 con 0x7f57a8070f90 2024-09-13T17:07:27.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.057+0000 7f57aedec700 1 -- 172.21.15.123:0/208791029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a80b1810 con 0x7f57a8070f90 2024-09-13T17:07:27.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.057+0000 7f57aedec700 1 -- 172.21.15.123:0/208791029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a8071d30 con 0x7f57a8070f90 2024-09-13T17:07:27.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.061+0000 7f579a7fc700 1 -- 172.21.15.123:0/208791029 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f579c013b50 con 0x7f57a8070f90 2024-09-13T17:07:27.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.061+0000 7f579a7fc700 1 --2- 172.21.15.123:0/208791029 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f578c066730 0x7f578c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.061+0000 7f579a7fc700 1 -- 172.21.15.123:0/208791029 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f579c083f40 con 0x7f57a8070f90 2024-09-13T17:07:27.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.061+0000 7f57ad5e9700 1 --2- 172.21.15.123:0/208791029 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f578c066730 0x7f578c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.061+0000 7f57ad5e9700 1 --2- 172.21.15.123:0/208791029 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f578c066730 0x7f578c068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009850 tx=0x7f57a4008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:27.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.069+0000 7f579a7fc700 1 -- 172.21.15.123:0/208791029 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f579c0512b0 con 0x7f57a8070f90 2024-09-13T17:07:27.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.233+0000 7f57aedec700 1 -- 172.21.15.123:0/208791029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f57a80b0ad0 con 0x7f57a8070f90 2024-09-13T17:07:27.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.233+0000 7f579a7fc700 1 -- 172.21.15.123:0/208791029 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f579c0548d0 con 0x7f57a8070f90 2024-09-13T17:07:27.235 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:07:27.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.233+0000 7f57aedec700 1 -- 172.21.15.123:0/208791029 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f578c066730 msgr2=0x7f578c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.233+0000 7f57aedec700 1 --2- 172.21.15.123:0/208791029 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f578c066730 0x7f578c068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009850 tx=0x7f57a4008030 comp rx=0 tx=0).stop 2024-09-13T17:07:27.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.233+0000 7f57aedec700 1 -- 172.21.15.123:0/208791029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57a8070f90 msgr2=0x7f57a815ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.233+0000 7f57aedec700 1 --2- 172.21.15.123:0/208791029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57a8070f90 0x7f57a815ac20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f579c00e870 tx=0x7f579c00eb80 comp rx=0 tx=0).stop 2024-09-13T17:07:27.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.233+0000 7f57aedec700 1 -- 172.21.15.123:0/208791029 shutdown_connections 2024-09-13T17:07:27.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.233+0000 7f57aedec700 1 --2- 172.21.15.123:0/208791029 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f578c066730 0x7f578c068bf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.233+0000 7f57aedec700 1 --2- 172.21.15.123:0/208791029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a8159c60 0x7f57a81519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.233+0000 7f57aedec700 1 --2- 172.21.15.123:0/208791029 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57a80cdbd0 0x7f57a815cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.233+0000 7f57aedec700 1 --2- 172.21.15.123:0/208791029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57a8070f90 0x7f57a815ac20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.233+0000 7f57aedec700 1 -- 172.21.15.123:0/208791029 >> 172.21.15.123:0/208791029 conn(0x7f57a80b01d0 msgr2=0x7f57a806c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:27.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.233+0000 7f57aedec700 1 -- 172.21.15.123:0/208791029 shutdown_connections 2024-09-13T17:07:27.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.237+0000 7f57aedec700 1 -- 172.21.15.123:0/208791029 wait complete. 2024-09-13T17:07:27.251 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:07:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc02ace4700 1 Processor -- start 2024-09-13T17:07:27.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc02ace4700 1 -- start start 2024-09-13T17:07:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc02ace4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc0240d0f40 0x7fc0240d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc02ace4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0240d0cb0 con 0x7fc0240b58b0 2024-09-13T17:07:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc02ace4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0240b0060 con 0x7fc0240cd5e0 2024-09-13T17:07:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc02ace4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0240b0340 con 0x7fc0240d0f40 2024-09-13T17:07:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc029ce2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc0240d0f40 0x7fc0240d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc029ce2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc0240d0f40 0x7fc0240d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48956/0 (socket says 172.21.15.123:48956) 2024-09-13T17:07:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc0294e1700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc0240b58b0 0x7fc0240d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49900/0 (socket says 172.21.15.123:49900) 2024-09-13T17:07:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc029ce2700 1 -- 172.21.15.123:0/1935658723 learned_addr learned my addr 172.21.15.123:0/1935658723 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc029ce2700 1 -- 172.21.15.123:0/1935658723 >> v1:172.21.15.153:6789/0 conn(0x7fc0240cd5e0 legacy=0x7fc0240cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc028ce0700 1 -- 172.21.15.123:0/1935658723 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834121142 0 0) 0x7fc0240d0cb0 con 0x7fc0240b58b0 2024-09-13T17:07:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc029ce2700 1 -- 172.21.15.123:0/1935658723 >> v1:172.21.15.123:6789/0 conn(0x7fc0240b58b0 legacy=0x7fc0240d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc029ce2700 1 -- 172.21.15.123:0/1935658723 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0240b0620 con 0x7fc0240d0f40 2024-09-13T17:07:27.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc029ce2700 1 --2- 172.21.15.123:0/1935658723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0240d0f40 0x7fc0240d1320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc018009910 tx=0x7fc018009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a6b8f69cdd772 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc028ce0700 1 -- 172.21.15.123:0/1935658723 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01800ba60 con 0x7fc0240d0f40 2024-09-13T17:07:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc028ce0700 1 -- 172.21.15.123:0/1935658723 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01800bbc0 con 0x7fc0240d0f40 2024-09-13T17:07:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc028ce0700 1 -- 172.21.15.123:0/1935658723 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018009e60 con 0x7fc0240d0f40 2024-09-13T17:07:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc02ace4700 1 -- 172.21.15.123:0/1935658723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0240d0f40 msgr2=0x7fc0240d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc02ace4700 1 --2- 172.21.15.123:0/1935658723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0240d0f40 0x7fc0240d1320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc018009910 tx=0x7fc018009c20 comp rx=0 tx=0).stop 2024-09-13T17:07:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc02ace4700 1 -- 172.21.15.123:0/1935658723 shutdown_connections 2024-09-13T17:07:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc02ace4700 1 --2- 172.21.15.123:0/1935658723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0240d0f40 0x7fc0240d1320 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.361+0000 7fc02ace4700 1 -- 172.21.15.123:0/1935658723 >> 172.21.15.123:0/1935658723 conn(0x7fc0240d2a60 msgr2=0x7fc0240d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02ace4700 1 -- 172.21.15.123:0/1935658723 shutdown_connections 2024-09-13T17:07:27.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02ace4700 1 -- 172.21.15.123:0/1935658723 wait complete. 2024-09-13T17:07:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02ace4700 1 Processor -- start 2024-09-13T17:07:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02ace4700 1 -- start start 2024-09-13T17:07:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02ace4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0240b58b0 0x7fc02414e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02ace4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0240cd5e0 0x7fc0241505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02ace4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0240d0f40 0x7fc0240b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02ace4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240b2c40 con 0x7fc0240d0f40 2024-09-13T17:07:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02ace4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc024150ae0 con 0x7fc0240b58b0 2024-09-13T17:07:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02ace4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240b2960 con 0x7fc0240cd5e0 2024-09-13T17:07:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02a4e3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0240d0f40 0x7fc0240b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02a4e3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0240d0f40 0x7fc0240b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48970/0 (socket says 172.21.15.123:48970) 2024-09-13T17:07:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02a4e3700 1 -- 172.21.15.123:0/636592003 learned_addr learned my addr 172.21.15.123:0/636592003 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:27.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc029ce2700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0240b58b0 0x7fc02414e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc0294e1700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0240cd5e0 0x7fc0241505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02a4e3700 1 -- 172.21.15.123:0/636592003 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0240cd5e0 msgr2=0x7fc0241505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02a4e3700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0240cd5e0 0x7fc0241505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02a4e3700 1 -- 172.21.15.123:0/636592003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0240b58b0 msgr2=0x7fc02414e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02a4e3700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0240b58b0 0x7fc02414e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02a4e3700 1 -- 172.21.15.123:0/636592003 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc018009570 con 0x7fc0240d0f40 2024-09-13T17:07:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc0294e1700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0240cd5e0 0x7fc0241505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02a4e3700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0240d0f40 0x7fc0240b5c90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc01c001eb0 tx=0x7fc01c00c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc0167fc700 1 -- 172.21.15.123:0/636592003 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0052d0 con 0x7fc0240d0f40 2024-09-13T17:07:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc0167fc700 1 -- 172.21.15.123:0/636592003 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c00ce90 con 0x7fc0240d0f40 2024-09-13T17:07:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02ace4700 1 -- 172.21.15.123:0/636592003 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0240cb220 con 0x7fc0240d0f40 2024-09-13T17:07:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc0167fc700 1 -- 172.21.15.123:0/636592003 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0036a0 con 0x7fc0240d0f40 2024-09-13T17:07:27.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.365+0000 7fc02ace4700 1 -- 172.21.15.123:0/636592003 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0240cb7e0 con 0x7fc0240d0f40 2024-09-13T17:07:27.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.369+0000 7fc02ace4700 1 -- 172.21.15.123:0/636592003 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0240cb080 con 0x7fc0240d0f40 2024-09-13T17:07:27.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.369+0000 7fc0167fc700 1 -- 172.21.15.123:0/636592003 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc01c003800 con 0x7fc0240d0f40 2024-09-13T17:07:27.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.369+0000 7fc0167fc700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc008066730 0x7fc008068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.369+0000 7fc0167fc700 1 -- 172.21.15.123:0/636592003 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc01c083640 con 0x7fc0240d0f40 2024-09-13T17:07:27.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.369+0000 7fc029ce2700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc008066730 0x7fc008068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.369+0000 7fc029ce2700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc008066730 0x7fc008068bf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc018014040 tx=0x7fc01801c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:27.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.377+0000 7fc0167fc700 1 -- 172.21.15.123:0/636592003 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc01c050b20 con 0x7fc0240d0f40 2024-09-13T17:07:27.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.553+0000 7fc02ace4700 1 -- 172.21.15.123:0/636592003 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc0240cb080 con 0x7fc0240d0f40 2024-09-13T17:07:27.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.557+0000 7fc0167fc700 1 -- 172.21.15.123:0/636592003 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc0240cb080 con 0x7fc0240d0f40 2024-09-13T17:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.557+0000 7fc02ace4700 1 -- 172.21.15.123:0/636592003 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc008066730 msgr2=0x7fc008068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.557+0000 7fc02ace4700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc008066730 0x7fc008068bf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc018014040 tx=0x7fc01801c040 comp rx=0 tx=0).stop 2024-09-13T17:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.557+0000 7fc02ace4700 1 -- 172.21.15.123:0/636592003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0240d0f40 msgr2=0x7fc0240b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.557+0000 7fc02ace4700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0240d0f40 0x7fc0240b5c90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc01c001eb0 tx=0x7fc01c00c6e0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.557+0000 7fc02ace4700 1 -- 172.21.15.123:0/636592003 shutdown_connections 2024-09-13T17:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.557+0000 7fc02ace4700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc008066730 0x7fc008068bf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.557+0000 7fc02ace4700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0240d0f40 0x7fc0240b5c90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.557+0000 7fc02ace4700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0240cd5e0 0x7fc0241505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.557+0000 7fc02ace4700 1 --2- 172.21.15.123:0/636592003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0240b58b0 0x7fc02414e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.557+0000 7fc02ace4700 1 -- 172.21.15.123:0/636592003 >> 172.21.15.123:0/636592003 conn(0x7fc0240d2a60 msgr2=0x7fc0240b7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.557+0000 7fc02ace4700 1 -- 172.21.15.123:0/636592003 shutdown_connections 2024-09-13T17:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.557+0000 7fc02ace4700 1 -- 172.21.15.123:0/636592003 wait complete. 2024-09-13T17:07:27.562 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:07:27.573 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:07:27.573 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:07:27.581 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:27.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.733+0000 7ff8b3375700 1 Processor -- start 2024-09-13T17:07:27.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.733+0000 7ff8b3375700 1 -- start start 2024-09-13T17:07:27.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.733+0000 7ff8b3375700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8a40df8e0 0x7ff8a401c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.733+0000 7ff8b3375700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8a404fe30 0x7ff8a4050480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.733+0000 7ff8b3375700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff8a40509c0 0x7ff8a404ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.733+0000 7ff8b3375700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a4050e50 con 0x7ff8a40df8e0 2024-09-13T17:07:27.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.733+0000 7ff8b3375700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a40e3310 con 0x7ff8a40509c0 2024-09-13T17:07:27.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.733+0000 7ff8b3375700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40e35f0 con 0x7ff8a404fe30 2024-09-13T17:07:27.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b2373700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8a40df8e0 0x7ff8a401c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b2373700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8a40df8e0 0x7ff8a401c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48972/0 (socket says 172.21.15.123:48972) 2024-09-13T17:07:27.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b2373700 1 -- 172.21.15.123:0/2170707817 learned_addr learned my addr 172.21.15.123:0/2170707817 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:27.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b1b72700 1 --2- 172.21.15.123:0/2170707817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8a404fe30 0x7ff8a4050480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b2b74700 1 --2- 172.21.15.123:0/2170707817 >> v2:172.21.15.153:3300/0 conn(0x7ff8a40509c0 0x7ff8a404ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b2373700 1 -- 172.21.15.123:0/2170707817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8a404fe30 msgr2=0x7ff8a4050480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:27.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b2373700 1 --2- 172.21.15.123:0/2170707817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8a404fe30 0x7ff8a4050480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b2373700 1 -- 172.21.15.123:0/2170707817 >> v2:172.21.15.153:3300/0 conn(0x7ff8a40509c0 msgr2=0x7ff8a404ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:27.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b2373700 1 --2- 172.21.15.123:0/2170707817 >> v2:172.21.15.153:3300/0 conn(0x7ff8a40509c0 0x7ff8a404ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b2373700 1 -- 172.21.15.123:0/2170707817 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a40e38d0 con 0x7ff8a40df8e0 2024-09-13T17:07:27.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b2373700 1 --2- 172.21.15.123:0/2170707817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a40df8e0 0x7ff8a401c5d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009a50 tx=0x7ff8a8009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a283bf6868d49e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:27.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b1371700 1 -- 172.21.15.123:0/2170707817 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8011830 con 0x7ff8a40df8e0 2024-09-13T17:07:27.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b1371700 1 -- 172.21.15.123:0/2170707817 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a8011990 con 0x7ff8a40df8e0 2024-09-13T17:07:27.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b1371700 1 -- 172.21.15.123:0/2170707817 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8011d20 con 0x7ff8a40df8e0 2024-09-13T17:07:27.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b3375700 1 -- 172.21.15.123:0/2170707817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a40df8e0 msgr2=0x7ff8a401c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b3375700 1 --2- 172.21.15.123:0/2170707817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a40df8e0 0x7ff8a401c5d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009a50 tx=0x7ff8a8009be0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b3375700 1 -- 172.21.15.123:0/2170707817 shutdown_connections 2024-09-13T17:07:27.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b3375700 1 --2- 172.21.15.123:0/2170707817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8a404fe30 0x7ff8a4050480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b3375700 1 --2- 172.21.15.123:0/2170707817 >> v2:172.21.15.153:3300/0 conn(0x7ff8a40509c0 0x7ff8a404ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b3375700 1 --2- 172.21.15.123:0/2170707817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a40df8e0 0x7ff8a401c5d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b3375700 1 -- 172.21.15.123:0/2170707817 >> 172.21.15.123:0/2170707817 conn(0x7ff8a4036140 msgr2=0x7ff8a4036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:27.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b3375700 1 -- 172.21.15.123:0/2170707817 shutdown_connections 2024-09-13T17:07:27.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.737+0000 7ff8b3375700 1 -- 172.21.15.123:0/2170707817 wait complete. 2024-09-13T17:07:27.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.741+0000 7ff8b3375700 1 Processor -- start 2024-09-13T17:07:27.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.741+0000 7ff8b3375700 1 -- start start 2024-09-13T17:07:27.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.741+0000 7ff8b3375700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a404fe30 0x7ff8a404db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.741+0000 7ff8b3375700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8a40509c0 0x7ff8a40d4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.741+0000 7ff8b3375700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8a40df8e0 0x7ff8a40d38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.741+0000 7ff8b3375700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40d4980 con 0x7ff8a404fe30 2024-09-13T17:07:27.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.741+0000 7ff8b3375700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4037540 con 0x7ff8a40df8e0 2024-09-13T17:07:27.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.741+0000 7ff8b3375700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a404e180 con 0x7ff8a40509c0 2024-09-13T17:07:27.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.741+0000 7ff8b2373700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a404fe30 0x7ff8a404db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.741+0000 7ff8b2373700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a404fe30 0x7ff8a404db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48978/0 (socket says 172.21.15.123:48978) 2024-09-13T17:07:27.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.741+0000 7ff8b2373700 1 -- 172.21.15.123:0/405329505 learned_addr learned my addr 172.21.15.123:0/405329505 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:27.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.741+0000 7ff8b1b72700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8a40509c0 0x7ff8a40d4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.741+0000 7ff8b2b74700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8a40df8e0 0x7ff8a40d38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff8b2373700 1 -- 172.21.15.123:0/405329505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8a40509c0 msgr2=0x7ff8a40d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff8b2373700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8a40509c0 0x7ff8a40d4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff8b2373700 1 -- 172.21.15.123:0/405329505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8a40df8e0 msgr2=0x7ff8a40d38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff8b2373700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8a40df8e0 0x7ff8a40d38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff8b2373700 1 -- 172.21.15.123:0/405329505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a8009510 con 0x7ff8a404fe30 2024-09-13T17:07:27.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff8b2b74700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8a40df8e0 0x7ff8a40d38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:27.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff8b2373700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a404fe30 0x7ff8a404db10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8014040 tx=0x7ff8a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:27.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff89effd700 1 -- 172.21.15.123:0/405329505 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80044d0 con 0x7ff8a404fe30 2024-09-13T17:07:27.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff89effd700 1 -- 172.21.15.123:0/405329505 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a801e070 con 0x7ff8a404fe30 2024-09-13T17:07:27.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff8b3375700 1 -- 172.21.15.123:0/405329505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a40377e0 con 0x7ff8a404fe30 2024-09-13T17:07:27.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff89effd700 1 -- 172.21.15.123:0/405329505 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80038e0 con 0x7ff8a404fe30 2024-09-13T17:07:27.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff8b3375700 1 -- 172.21.15.123:0/405329505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a404e460 con 0x7ff8a404fe30 2024-09-13T17:07:27.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff8b3375700 1 -- 172.21.15.123:0/405329505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a4037d00 con 0x7ff8a404fe30 2024-09-13T17:07:27.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff89effd700 1 -- 172.21.15.123:0/405329505 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff8a8003a40 con 0x7ff8a404fe30 2024-09-13T17:07:27.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff89effd700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff890066730 0x7ff890068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff8b1b72700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff890066730 0x7ff890068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.745+0000 7ff89effd700 1 -- 172.21.15.123:0/405329505 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8a8084fc0 con 0x7ff8a404fe30 2024-09-13T17:07:27.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.749+0000 7ff8b1b72700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff890066730 0x7ff890068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff8a404af40 tx=0x7ff8a0009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:27.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.753+0000 7ff89effd700 1 -- 172.21.15.123:0/405329505 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff8a80b6db0 con 0x7ff8a404fe30 2024-09-13T17:07:27.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.929+0000 7ff8b3375700 1 -- 172.21.15.123:0/405329505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8a404ec10 con 0x7ff8a404fe30 2024-09-13T17:07:27.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.933+0000 7ff89effd700 1 -- 172.21.15.123:0/405329505 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7ff8a8052480 con 0x7ff8a404fe30 2024-09-13T17:07:27.936 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:27.936 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:27.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.933+0000 7ff8b3375700 1 -- 172.21.15.123:0/405329505 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff890066730 msgr2=0x7ff890068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.933+0000 7ff8b3375700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff890066730 0x7ff890068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff8a404af40 tx=0x7ff8a0009240 comp rx=0 tx=0).stop 2024-09-13T17:07:27.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.933+0000 7ff8b3375700 1 -- 172.21.15.123:0/405329505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a404fe30 msgr2=0x7ff8a404db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.933+0000 7ff8b3375700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a404fe30 0x7ff8a404db10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8014040 tx=0x7ff8a8004770 comp rx=0 tx=0).stop 2024-09-13T17:07:27.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.933+0000 7ff8b3375700 1 -- 172.21.15.123:0/405329505 shutdown_connections 2024-09-13T17:07:27.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.933+0000 7ff8b3375700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff890066730 0x7ff890068bf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.933+0000 7ff8b3375700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8a40df8e0 0x7ff8a40d38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.933+0000 7ff8b3375700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8a40509c0 0x7ff8a40d4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.933+0000 7ff8b3375700 1 --2- 172.21.15.123:0/405329505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8a404fe30 0x7ff8a404db10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.933+0000 7ff8b3375700 1 -- 172.21.15.123:0/405329505 >> 172.21.15.123:0/405329505 conn(0x7ff8a4036140 msgr2=0x7ff8a4006650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:27.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.933+0000 7ff8b3375700 1 -- 172.21.15.123:0/405329505 shutdown_connections 2024-09-13T17:07:27.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:27.933+0000 7ff8b3375700 1 -- 172.21.15.123:0/405329505 wait complete. 2024-09-13T17:07:27.951 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:27.951 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:28.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.065+0000 7faca0f55700 1 Processor -- start 2024-09-13T17:07:28.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.065+0000 7faca0f55700 1 -- start start 2024-09-13T17:07:28.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7faca0f55700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac9c06f990 0x7fac9c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7faca0f55700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9c15d660 con 0x7fac9c1574a0 2024-09-13T17:07:28.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7faca0f55700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9c15d940 con 0x7fac9c1570c0 2024-09-13T17:07:28.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7faca0f55700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c15e2e0 con 0x7fac9c06f990 2024-09-13T17:07:28.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac99d9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fac9c1574a0 0x7fac9c06f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49912/0 (socket says 172.21.15.123:49912) 2024-09-13T17:07:28.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac99d9b700 1 -- 172.21.15.123:0/2954063039 learned_addr learned my addr 172.21.15.123:0/2954063039 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:28.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9ad9d700 1 --2- 172.21.15.123:0/2954063039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac9c06f990 0x7fac9c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 -- 172.21.15.123:0/2954063039 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089223365 0 0) 0x7fac9c15d660 con 0x7fac9c1574a0 2024-09-13T17:07:28.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 -- 172.21.15.123:0/2954063039 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac880035d0 con 0x7fac9c1574a0 2024-09-13T17:07:28.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 -- 172.21.15.123:0/2954063039 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1473695190 0 0) 0x7fac880035d0 con 0x7fac9c1574a0 2024-09-13T17:07:28.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 -- 172.21.15.123:0/2954063039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac9c06f990 msgr2=0x7fac9c0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:28.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 --2- 172.21.15.123:0/2954063039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac9c06f990 0x7fac9c0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 -- 172.21.15.123:0/2954063039 >> v1:172.21.15.153:6789/0 conn(0x7fac9c1570c0 legacy=0x7fac9c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 -- 172.21.15.123:0/2954063039 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c15dc20 con 0x7fac9c1574a0 2024-09-13T17:07:28.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 -- 172.21.15.123:0/2954063039 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7fac84001670 con 0x7fac9c1574a0 2024-09-13T17:07:28.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 -- 172.21.15.123:0/2954063039 >> v1:172.21.15.123:6789/0 conn(0x7fac9c1574a0 legacy=0x7fac9c06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 --2- 172.21.15.123:0/2954063039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac88003a50 0x7fac88003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 --2- 172.21.15.123:0/2954063039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac9c06f990 0x7fac88004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 --2- 172.21.15.123:0/2954063039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac88004db0 0x7fac88005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 -- 172.21.15.123:0/2954063039 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c15e2e0 con 0x7fac88004db0 2024-09-13T17:07:28.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 -- 172.21.15.123:0/2954063039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8800bb10 con 0x7fac88003a50 2024-09-13T17:07:28.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 -- 172.21.15.123:0/2954063039 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8800bcd0 con 0x7fac9c06f990 2024-09-13T17:07:28.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9ad9d700 1 --2- 172.21.15.123:0/2954063039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac88004db0 0x7fac88005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9a59c700 1 --2- 172.21.15.123:0/2954063039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac88003a50 0x7fac88003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac99d9b700 1 --2- 172.21.15.123:0/2954063039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac9c06f990 0x7fac88004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9ad9d700 1 -- 172.21.15.123:0/2954063039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac9c06f990 msgr2=0x7fac88004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:28.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9ad9d700 1 --2- 172.21.15.123:0/2954063039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac9c06f990 0x7fac88004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9ad9d700 1 -- 172.21.15.123:0/2954063039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac88003a50 msgr2=0x7fac88003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:28.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9ad9d700 1 --2- 172.21.15.123:0/2954063039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac88003a50 0x7fac88003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9ad9d700 1 -- 172.21.15.123:0/2954063039 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac880035d0 con 0x7fac88004db0 2024-09-13T17:07:28.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9ad9d700 1 --2- 172.21.15.123:0/2954063039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac88004db0 0x7fac88005230 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fac94009f90 tx=0x7fac880058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d299a867019acb49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:28.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 -- 172.21.15.123:0/2954063039 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9400ec30 con 0x7fac88004db0 2024-09-13T17:07:28.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 -- 172.21.15.123:0/2954063039 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9400f040 con 0x7fac88004db0 2024-09-13T17:07:28.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9959a700 1 -- 172.21.15.123:0/2954063039 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac94014480 con 0x7fac88004db0 2024-09-13T17:07:28.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7faca0f55700 1 -- 172.21.15.123:0/2954063039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac88004db0 msgr2=0x7fac88005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7faca0f55700 1 --2- 172.21.15.123:0/2954063039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac88004db0 0x7fac88005230 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fac94009f90 tx=0x7fac880058a0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7fac9ad9d700 1 -- 172.21.15.123:0/2954063039 reap_dead start 2024-09-13T17:07:28.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7faca0f55700 1 -- 172.21.15.123:0/2954063039 shutdown_connections 2024-09-13T17:07:28.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.069+0000 7faca0f55700 1 -- 172.21.15.123:0/2954063039 >> 172.21.15.123:0/2954063039 conn(0x7fac9c0b1700 msgr2=0x7fac9c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:28.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.073+0000 7faca0f55700 1 -- 172.21.15.123:0/2954063039 shutdown_connections 2024-09-13T17:07:28.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.073+0000 7faca0f55700 1 -- 172.21.15.123:0/2954063039 wait complete. 2024-09-13T17:07:28.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.073+0000 7faca0f55700 1 Processor -- start 2024-09-13T17:07:28.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.073+0000 7faca0f55700 1 -- start start 2024-09-13T17:07:28.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.073+0000 7faca0f55700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac9c14b290 0x7fac9c0aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.073+0000 7faca0f55700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0af340 0x7fac9c0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.073+0000 7faca0f55700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c14b670 0x7fac9c0ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7faca0f55700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c0ada20 con 0x7fac9c14b670 2024-09-13T17:07:28.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7faca0f55700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c0af8a0 con 0x7fac9c0af340 2024-09-13T17:07:28.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7faca0f55700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c0afb80 con 0x7fac9c14b290 2024-09-13T17:07:28.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac9ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c14b670 0x7fac9c0ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac9ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c14b670 0x7fac9c0ad4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48992/0 (socket says 172.21.15.123:48992) 2024-09-13T17:07:28.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac9a59c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac9c14b290 0x7fac9c0aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac9ad9d700 1 -- 172.21.15.123:0/2889681319 learned_addr learned my addr 172.21.15.123:0/2889681319 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:28.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac99d9b700 1 --2- 172.21.15.123:0/2889681319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0af340 0x7fac9c0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac9ad9d700 1 -- 172.21.15.123:0/2889681319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac9c14b290 msgr2=0x7fac9c0aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac9ad9d700 1 --2- 172.21.15.123:0/2889681319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac9c14b290 0x7fac9c0aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac9ad9d700 1 -- 172.21.15.123:0/2889681319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0af340 msgr2=0x7fac9c0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac9ad9d700 1 --2- 172.21.15.123:0/2889681319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0af340 0x7fac9c0acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac9ad9d700 1 -- 172.21.15.123:0/2889681319 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c0afe60 con 0x7fac9c14b670 2024-09-13T17:07:28.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac99d9b700 1 --2- 172.21.15.123:0/2889681319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0af340 0x7fac9c0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:28.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac9ad9d700 1 --2- 172.21.15.123:0/2889681319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c14b670 0x7fac9c0ad4e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fac94016000 tx=0x7fac94009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:28.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac92ffd700 1 -- 172.21.15.123:0/2889681319 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac94007000 con 0x7fac9c14b670 2024-09-13T17:07:28.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac92ffd700 1 -- 172.21.15.123:0/2889681319 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac94003e70 con 0x7fac9c14b670 2024-09-13T17:07:28.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7faca0f55700 1 -- 172.21.15.123:0/2889681319 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9c0b0140 con 0x7fac9c14b670 2024-09-13T17:07:28.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac92ffd700 1 -- 172.21.15.123:0/2889681319 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac94015b40 con 0x7fac9c14b670 2024-09-13T17:07:28.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7faca0f55700 1 -- 172.21.15.123:0/2889681319 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9c15a810 con 0x7fac9c14b670 2024-09-13T17:07:28.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7faca0f55700 1 -- 172.21.15.123:0/2889681319 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9c0b0660 con 0x7fac9c14b670 2024-09-13T17:07:28.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.077+0000 7fac92ffd700 1 -- 172.21.15.123:0/2889681319 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fac94024070 con 0x7fac9c14b670 2024-09-13T17:07:28.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.081+0000 7fac92ffd700 1 --2- 172.21.15.123:0/2889681319 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fac7c066760 0x7fac7c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.081+0000 7fac92ffd700 1 -- 172.21.15.123:0/2889681319 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac94085860 con 0x7fac9c14b670 2024-09-13T17:07:28.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.081+0000 7fac9a59c700 1 --2- 172.21.15.123:0/2889681319 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fac7c066760 0x7fac7c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.081+0000 7fac9a59c700 1 --2- 172.21.15.123:0/2889681319 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fac7c066760 0x7fac7c068c20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fac8c000c00 tx=0x7fac8c009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:28.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.085+0000 7fac92ffd700 1 -- 172.21.15.123:0/2889681319 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fac9c0b0660 con 0x7fac9c14b670 2024-09-13T17:07:28.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.245+0000 7faca0f55700 1 -- 172.21.15.123:0/2889681319 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac9c0b0660 con 0x7fac9c14b670 2024-09-13T17:07:28.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.245+0000 7fac92ffd700 1 -- 172.21.15.123:0/2889681319 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac94018020 con 0x7fac9c14b670 2024-09-13T17:07:28.249 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:28.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.249+0000 7faca0f55700 1 -- 172.21.15.123:0/2889681319 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fac7c066760 msgr2=0x7fac7c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.249+0000 7faca0f55700 1 --2- 172.21.15.123:0/2889681319 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fac7c066760 0x7fac7c068c20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fac8c000c00 tx=0x7fac8c009040 comp rx=0 tx=0).stop 2024-09-13T17:07:28.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.249+0000 7faca0f55700 1 -- 172.21.15.123:0/2889681319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c14b670 msgr2=0x7fac9c0ad4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.249+0000 7faca0f55700 1 --2- 172.21.15.123:0/2889681319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c14b670 0x7fac9c0ad4e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fac94016000 tx=0x7fac94009750 comp rx=0 tx=0).stop 2024-09-13T17:07:28.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.249+0000 7faca0f55700 1 -- 172.21.15.123:0/2889681319 shutdown_connections 2024-09-13T17:07:28.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.249+0000 7faca0f55700 1 --2- 172.21.15.123:0/2889681319 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fac7c066760 0x7fac7c068c20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.249+0000 7faca0f55700 1 --2- 172.21.15.123:0/2889681319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c14b670 0x7fac9c0ad4e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.249+0000 7faca0f55700 1 --2- 172.21.15.123:0/2889681319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac9c0af340 0x7fac9c0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.249+0000 7faca0f55700 1 --2- 172.21.15.123:0/2889681319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fac9c14b290 0x7fac9c0aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.249+0000 7faca0f55700 1 -- 172.21.15.123:0/2889681319 >> 172.21.15.123:0/2889681319 conn(0x7fac9c0b1700 msgr2=0x7fac9c0cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:28.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.249+0000 7faca0f55700 1 -- 172.21.15.123:0/2889681319 shutdown_connections 2024-09-13T17:07:28.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.249+0000 7faca0f55700 1 -- 172.21.15.123:0/2889681319 wait complete. 2024-09-13T17:07:28.264 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:07:28.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.381+0000 7f55aa351700 1 Processor -- start 2024-09-13T17:07:28.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.381+0000 7f55aa351700 1 -- start start 2024-09-13T17:07:28.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.381+0000 7f55aa351700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55a40d0f40 0x7f55a40d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.381+0000 7f55aa351700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55a40cd5e0 0x7f55a40cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.381+0000 7f55aa351700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a40d0cb0 con 0x7f55a40b58b0 2024-09-13T17:07:28.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.381+0000 7f55aa351700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40b0060 con 0x7f55a40cd5e0 2024-09-13T17:07:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.381+0000 7f55aa351700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a40b0340 con 0x7f55a40d0f40 2024-09-13T17:07:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.381+0000 7f55a9b50700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55a40cd5e0 0x7f55a40cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.381+0000 7f55a9b50700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55a40cd5e0 0x7f55a40cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48998/0 (socket says 172.21.15.123:48998) 2024-09-13T17:07:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.381+0000 7f55a9b50700 1 -- 172.21.15.123:0/4232858244 learned_addr learned my addr 172.21.15.123:0/4232858244 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.381+0000 7f55a934f700 1 --2- 172.21.15.123:0/4232858244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55a40d0f40 0x7f55a40d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f55a9b50700 1 -- 172.21.15.123:0/4232858244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55a40d0f40 msgr2=0x7f55a40d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f55a9b50700 1 --2- 172.21.15.123:0/4232858244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55a40d0f40 0x7f55a40d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f55a9b50700 1 -- 172.21.15.123:0/4232858244 >> v1:172.21.15.153:6789/0 conn(0x7f55a40b58b0 legacy=0x7f55a40d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f55a9b50700 1 -- 172.21.15.123:0/4232858244 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a40b0620 con 0x7f55a40cd5e0 2024-09-13T17:07:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f55a934f700 1 --2- 172.21.15.123:0/4232858244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55a40d0f40 0x7f55a40d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f55a9b50700 1 --2- 172.21.15.123:0/4232858244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a40cd5e0 0x7f55a40cda30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f559c009e50 tx=0x7f559c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a271ad01210ce9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f559bfff700 1 -- 172.21.15.123:0/4232858244 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c00e070 con 0x7f55a40cd5e0 2024-09-13T17:07:28.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f559bfff700 1 -- 172.21.15.123:0/4232858244 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c00b9c0 con 0x7f55a40cd5e0 2024-09-13T17:07:28.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f559bfff700 1 -- 172.21.15.123:0/4232858244 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c00bd70 con 0x7f55a40cd5e0 2024-09-13T17:07:28.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f55aa351700 1 -- 172.21.15.123:0/4232858244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a40cd5e0 msgr2=0x7f55a40cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f55aa351700 1 --2- 172.21.15.123:0/4232858244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a40cd5e0 0x7f55a40cda30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f559c009e50 tx=0x7f559c00b330 comp rx=0 tx=0).stop 2024-09-13T17:07:28.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f55aa351700 1 -- 172.21.15.123:0/4232858244 shutdown_connections 2024-09-13T17:07:28.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f55aa351700 1 --2- 172.21.15.123:0/4232858244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a40cd5e0 0x7f55a40cda30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f55aa351700 1 --2- 172.21.15.123:0/4232858244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55a40d0f40 0x7f55a40d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f55aa351700 1 -- 172.21.15.123:0/4232858244 >> 172.21.15.123:0/4232858244 conn(0x7f55a40d2a60 msgr2=0x7f55a40d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:28.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f55aa351700 1 -- 172.21.15.123:0/4232858244 shutdown_connections 2024-09-13T17:07:28.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.385+0000 7f55aa351700 1 -- 172.21.15.123:0/4232858244 wait complete. 2024-09-13T17:07:28.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55aa351700 1 Processor -- start 2024-09-13T17:07:28.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55aa351700 1 -- start start 2024-09-13T17:07:28.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55aa351700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55a40b58b0 0x7f55a415d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55aa351700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55a40cd5e0 0x7f55a415a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55aa351700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a40d0f40 0x7f55a40b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55aa351700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a415d5c0 con 0x7f55a40d0f40 2024-09-13T17:07:28.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55aa351700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a41e6190 con 0x7f55a40b58b0 2024-09-13T17:07:28.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55aa351700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a41e6c30 con 0x7f55a40cd5e0 2024-09-13T17:07:28.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55a9b50700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a40d0f40 0x7f55a40b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55a9b50700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a40d0f40 0x7f55a40b5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49012/0 (socket says 172.21.15.123:49012) 2024-09-13T17:07:28.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55a9b50700 1 -- 172.21.15.123:0/2665244724 learned_addr learned my addr 172.21.15.123:0/2665244724 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:28.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55a934f700 1 --2- 172.21.15.123:0/2665244724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55a40b58b0 0x7f55a415d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55a8b4e700 1 --2- 172.21.15.123:0/2665244724 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55a40cd5e0 0x7f55a415a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55a9b50700 1 -- 172.21.15.123:0/2665244724 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55a40cd5e0 msgr2=0x7f55a415a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55a9b50700 1 --2- 172.21.15.123:0/2665244724 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55a40cd5e0 0x7f55a415a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55a9b50700 1 -- 172.21.15.123:0/2665244724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55a40b58b0 msgr2=0x7f55a415d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55a9b50700 1 --2- 172.21.15.123:0/2665244724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55a40b58b0 0x7f55a415d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.389+0000 7f55a9b50700 1 -- 172.21.15.123:0/2665244724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c009b30 con 0x7f55a40d0f40 2024-09-13T17:07:28.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.393+0000 7f55a9b50700 1 --2- 172.21.15.123:0/2665244724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a40d0f40 0x7f55a40b5f60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f55a40d29c0 tx=0x7f559c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:28.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.393+0000 7f5599ffb700 1 -- 172.21.15.123:0/2665244724 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c004800 con 0x7f55a40d0f40 2024-09-13T17:07:28.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.393+0000 7f5599ffb700 1 -- 172.21.15.123:0/2665244724 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c0099b0 con 0x7f55a40d0f40 2024-09-13T17:07:28.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.393+0000 7f5599ffb700 1 -- 172.21.15.123:0/2665244724 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c01c680 con 0x7f55a40d0f40 2024-09-13T17:07:28.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.393+0000 7f55aa351700 1 -- 172.21.15.123:0/2665244724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a41e6670 con 0x7f55a40d0f40 2024-09-13T17:07:28.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.393+0000 7f55aa351700 1 -- 172.21.15.123:0/2665244724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a41e7000 con 0x7f55a40d0f40 2024-09-13T17:07:28.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.393+0000 7f55aa351700 1 -- 172.21.15.123:0/2665244724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a41e6e50 con 0x7f55a40d0f40 2024-09-13T17:07:28.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.393+0000 7f5599ffb700 1 -- 172.21.15.123:0/2665244724 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f559c01c7e0 con 0x7f55a40d0f40 2024-09-13T17:07:28.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.393+0000 7f5599ffb700 1 --2- 172.21.15.123:0/2665244724 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5588066730 0x7f5588068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.393+0000 7f5599ffb700 1 -- 172.21.15.123:0/2665244724 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f559c085be0 con 0x7f55a40d0f40 2024-09-13T17:07:28.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.393+0000 7f55a934f700 1 --2- 172.21.15.123:0/2665244724 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5588066730 0x7f5588068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.393+0000 7f55a934f700 1 --2- 172.21.15.123:0/2665244724 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5588066730 0x7f5588068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f559400c960 tx=0x7f5594008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:28.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.405+0000 7f5599ffb700 1 -- 172.21.15.123:0/2665244724 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f559c052fe0 con 0x7f55a40d0f40 2024-09-13T17:07:28.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.573+0000 7f55aa351700 1 -- 172.21.15.123:0/2665244724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55a415ce70 con 0x7f55a40d0f40 2024-09-13T17:07:28.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.577+0000 7f5599ffb700 1 -- 172.21.15.123:0/2665244724 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f559c056600 con 0x7f55a40d0f40 2024-09-13T17:07:28.579 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:07:28.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.581+0000 7f55aa351700 1 -- 172.21.15.123:0/2665244724 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5588066730 msgr2=0x7f5588068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.581+0000 7f55aa351700 1 --2- 172.21.15.123:0/2665244724 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5588066730 0x7f5588068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f559400c960 tx=0x7f5594008040 comp rx=0 tx=0).stop 2024-09-13T17:07:28.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.581+0000 7f55aa351700 1 -- 172.21.15.123:0/2665244724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a40d0f40 msgr2=0x7f55a40b5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.581+0000 7f55aa351700 1 --2- 172.21.15.123:0/2665244724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a40d0f40 0x7f55a40b5f60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f55a40d29c0 tx=0x7f559c004af0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.581+0000 7f55aa351700 1 -- 172.21.15.123:0/2665244724 shutdown_connections 2024-09-13T17:07:28.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.581+0000 7f55aa351700 1 --2- 172.21.15.123:0/2665244724 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5588066730 0x7f5588068bf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.581+0000 7f55aa351700 1 --2- 172.21.15.123:0/2665244724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a40d0f40 0x7f55a40b5f60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.581+0000 7f55aa351700 1 --2- 172.21.15.123:0/2665244724 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f55a40cd5e0 0x7f55a415a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.581+0000 7f55aa351700 1 --2- 172.21.15.123:0/2665244724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55a40b58b0 0x7f55a415d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.581+0000 7f55aa351700 1 -- 172.21.15.123:0/2665244724 >> 172.21.15.123:0/2665244724 conn(0x7f55a40d2a60 msgr2=0x7f55a40706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:28.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.581+0000 7f55aa351700 1 -- 172.21.15.123:0/2665244724 shutdown_connections 2024-09-13T17:07:28.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.581+0000 7f55aa351700 1 -- 172.21.15.123:0/2665244724 wait complete. 2024-09-13T17:07:28.599 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:07:28.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.713+0000 7f122e818700 1 Processor -- start 2024-09-13T17:07:28.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.713+0000 7f122e818700 1 -- start start 2024-09-13T17:07:28.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12280d0f40 0x7f12280d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f12280b58b0 0x7f12280d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12280b1100 0x7f12280b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12280b0060 con 0x7f12280d0f40 2024-09-13T17:07:28.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12280b0340 con 0x7f12280b58b0 2024-09-13T17:07:28.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12280b0620 con 0x7f12280b1100 2024-09-13T17:07:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122d816700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12280d0f40 0x7f12280d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122d816700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12280d0f40 0x7f12280d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49022/0 (socket says 172.21.15.123:49022) 2024-09-13T17:07:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122d816700 1 -- 172.21.15.123:0/2764484293 learned_addr learned my addr 172.21.15.123:0/2764484293 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e017700 1 --2- 172.21.15.123:0/2764484293 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12280b1100 0x7f12280b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122d015700 1 --2- 172.21.15.123:0/2764484293 >> v2:172.21.15.153:3300/0 conn(0x7f12280b58b0 0x7f12280d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122d816700 1 -- 172.21.15.123:0/2764484293 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12280b1100 msgr2=0x7f12280b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122d816700 1 --2- 172.21.15.123:0/2764484293 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12280b1100 0x7f12280b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122d816700 1 -- 172.21.15.123:0/2764484293 >> v2:172.21.15.153:3300/0 conn(0x7f12280b58b0 msgr2=0x7f12280d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122d816700 1 --2- 172.21.15.123:0/2764484293 >> v2:172.21.15.153:3300/0 conn(0x7f12280b58b0 0x7f12280d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122d816700 1 -- 172.21.15.123:0/2764484293 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12280b0900 con 0x7f12280d0f40 2024-09-13T17:07:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122d816700 1 --2- 172.21.15.123:0/2764484293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12280d0f40 0x7f12280d1320 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1228067070 tx=0x7f1224009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea6dd6fbf8cb378 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:28.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122c814700 1 -- 172.21.15.123:0/2764484293 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224011830 con 0x7f12280d0f40 2024-09-13T17:07:28.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122c814700 1 -- 172.21.15.123:0/2764484293 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1224011990 con 0x7f12280d0f40 2024-09-13T17:07:28.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122c814700 1 -- 172.21.15.123:0/2764484293 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224011d20 con 0x7f12280d0f40 2024-09-13T17:07:28.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 -- 172.21.15.123:0/2764484293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12280d0f40 msgr2=0x7f12280d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 --2- 172.21.15.123:0/2764484293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12280d0f40 0x7f12280d1320 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1228067070 tx=0x7f1224009bf0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 -- 172.21.15.123:0/2764484293 shutdown_connections 2024-09-13T17:07:28.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 --2- 172.21.15.123:0/2764484293 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12280b1100 0x7f12280b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 --2- 172.21.15.123:0/2764484293 >> v2:172.21.15.153:3300/0 conn(0x7f12280b58b0 0x7f12280d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 --2- 172.21.15.123:0/2764484293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12280d0f40 0x7f12280d1320 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 -- 172.21.15.123:0/2764484293 >> 172.21.15.123:0/2764484293 conn(0x7f12280d2a60 msgr2=0x7f12280d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:28.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 -- 172.21.15.123:0/2764484293 shutdown_connections 2024-09-13T17:07:28.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.717+0000 7f122e818700 1 -- 172.21.15.123:0/2764484293 wait complete. 2024-09-13T17:07:28.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.721+0000 7f122e818700 1 Processor -- start 2024-09-13T17:07:28.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.721+0000 7f122e818700 1 -- start start 2024-09-13T17:07:28.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122e818700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12280b1100 0x7f122815c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122e818700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12280b58b0 0x7f1228152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122e818700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12280d0f40 0x7f12280ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122e818700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122809f8f0 con 0x7f12280b58b0 2024-09-13T17:07:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122e818700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12280b68a0 con 0x7f12280d0f40 2024-09-13T17:07:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122e818700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12280b6b80 con 0x7f12280b1100 2024-09-13T17:07:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122d015700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12280b58b0 0x7f1228152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122d816700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12280b1100 0x7f122815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122d015700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12280b58b0 0x7f1228152b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49038/0 (socket says 172.21.15.123:49038) 2024-09-13T17:07:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122d015700 1 -- 172.21.15.123:0/2919118381 learned_addr learned my addr 172.21.15.123:0/2919118381 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122e017700 1 --2- 172.21.15.123:0/2919118381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12280d0f40 0x7f12280ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122d015700 1 -- 172.21.15.123:0/2919118381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12280b1100 msgr2=0x7f122815c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122d015700 1 --2- 172.21.15.123:0/2919118381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12280b1100 0x7f122815c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122d015700 1 -- 172.21.15.123:0/2919118381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12280d0f40 msgr2=0x7f12280ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122d015700 1 --2- 172.21.15.123:0/2919118381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12280d0f40 0x7f12280ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122d015700 1 -- 172.21.15.123:0/2919118381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1224009570 con 0x7f12280b58b0 2024-09-13T17:07:28.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122d015700 1 --2- 172.21.15.123:0/2919118381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12280b58b0 0x7f1228152b40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f121800e9d0 tx=0x7f121800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:28.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f121e7fc700 1 -- 172.21.15.123:0/2919118381 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218009720 con 0x7f12280b58b0 2024-09-13T17:07:28.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f121e7fc700 1 -- 172.21.15.123:0/2919118381 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121800ee70 con 0x7f12280b58b0 2024-09-13T17:07:28.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122e818700 1 -- 172.21.15.123:0/2919118381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122809fb90 con 0x7f12280b58b0 2024-09-13T17:07:28.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f121e7fc700 1 -- 172.21.15.123:0/2919118381 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121800ca50 con 0x7f12280b58b0 2024-09-13T17:07:28.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122e818700 1 -- 172.21.15.123:0/2919118381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122809c930 con 0x7f12280b58b0 2024-09-13T17:07:28.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.725+0000 7f122e818700 1 -- 172.21.15.123:0/2919118381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12280b7de0 con 0x7f12280b58b0 2024-09-13T17:07:28.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.729+0000 7f121e7fc700 1 -- 172.21.15.123:0/2919118381 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f121800cbb0 con 0x7f12280b58b0 2024-09-13T17:07:28.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.729+0000 7f121e7fc700 1 --2- 172.21.15.123:0/2919118381 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f120c066730 0x7f120c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:28.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.729+0000 7f122d816700 1 --2- 172.21.15.123:0/2919118381 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f120c066730 0x7f120c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:28.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.729+0000 7f121e7fc700 1 -- 172.21.15.123:0/2919118381 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1218084120 con 0x7f12280b58b0 2024-09-13T17:07:28.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.729+0000 7f122d816700 1 --2- 172.21.15.123:0/2919118381 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f120c066730 0x7f120c068bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1224000c00 tx=0x7f1224008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:28.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.737+0000 7f121e7fc700 1 -- 172.21.15.123:0/2919118381 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1218051480 con 0x7f12280b58b0 2024-09-13T17:07:28.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.909+0000 7f122e818700 1 -- 172.21.15.123:0/2919118381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f122815dff0 con 0x7f12280b58b0 2024-09-13T17:07:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.909+0000 7f121e7fc700 1 -- 172.21.15.123:0/2919118381 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f121800ce60 con 0x7f12280b58b0 2024-09-13T17:07:28.913 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:07:28.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.913+0000 7f122e818700 1 -- 172.21.15.123:0/2919118381 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f120c066730 msgr2=0x7f120c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.913+0000 7f122e818700 1 --2- 172.21.15.123:0/2919118381 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f120c066730 0x7f120c068bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1224000c00 tx=0x7f1224008030 comp rx=0 tx=0).stop 2024-09-13T17:07:28.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.913+0000 7f122e818700 1 -- 172.21.15.123:0/2919118381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12280b58b0 msgr2=0x7f1228152b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:28.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.913+0000 7f122e818700 1 --2- 172.21.15.123:0/2919118381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12280b58b0 0x7f1228152b40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f121800e9d0 tx=0x7f121800ece0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.913+0000 7f122e818700 1 -- 172.21.15.123:0/2919118381 shutdown_connections 2024-09-13T17:07:28.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.913+0000 7f122e818700 1 --2- 172.21.15.123:0/2919118381 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f120c066730 0x7f120c068bf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.913+0000 7f122e818700 1 --2- 172.21.15.123:0/2919118381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12280d0f40 0x7f12280ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.913+0000 7f122e818700 1 --2- 172.21.15.123:0/2919118381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12280b58b0 0x7f1228152b40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.913+0000 7f122e818700 1 --2- 172.21.15.123:0/2919118381 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f12280b1100 0x7f122815c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:28.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.913+0000 7f122e818700 1 -- 172.21.15.123:0/2919118381 >> 172.21.15.123:0/2919118381 conn(0x7f12280d2a60 msgr2=0x7f12280b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:28.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.913+0000 7f122e818700 1 -- 172.21.15.123:0/2919118381 shutdown_connections 2024-09-13T17:07:28.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:28.913+0000 7f122e818700 1 -- 172.21.15.123:0/2919118381 wait complete. 2024-09-13T17:07:28.928 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:07:29.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.037+0000 7f3980c6a700 1 Processor -- start 2024-09-13T17:07:29.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.037+0000 7f3980c6a700 1 -- start start 2024-09-13T17:07:29.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f3980c6a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f397c0b2db0 0x7f397c0ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f3980c6a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397c0cbd80 con 0x7f397c06c140 2024-09-13T17:07:29.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f3980c6a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397c0b1910 con 0x7f397c15ae50 2024-09-13T17:07:29.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f3980c6a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397c0cb210 con 0x7f397c0b2db0 2024-09-13T17:07:29.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f3979d9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f397c06c140 0x7f397c06d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49924/0 (socket says 172.21.15.123:49924) 2024-09-13T17:07:29.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f3979d9b700 1 -- 172.21.15.123:0/3707579976 learned_addr learned my addr 172.21.15.123:0/3707579976 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:29.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f397ad9d700 1 --2- 172.21.15.123:0/3707579976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f397c0b2db0 0x7f397c0ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f397959a700 1 -- 172.21.15.123:0/3707579976 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193751125 0 0) 0x7f397c0cbd80 con 0x7f397c06c140 2024-09-13T17:07:29.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f397959a700 1 -- 172.21.15.123:0/3707579976 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39680035d0 con 0x7f397c06c140 2024-09-13T17:07:29.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f397ad9d700 1 -- 172.21.15.123:0/3707579976 >> v1:172.21.15.153:6789/0 conn(0x7f397c15ae50 legacy=0x7f397c0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f397ad9d700 1 -- 172.21.15.123:0/3707579976 >> v1:172.21.15.123:6789/0 conn(0x7f397c06c140 legacy=0x7f397c06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f397ad9d700 1 -- 172.21.15.123:0/3707579976 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c0cb4e0 con 0x7f397c0b2db0 2024-09-13T17:07:29.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f397ad9d700 1 --2- 172.21.15.123:0/3707579976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f397c0b2db0 0x7f397c0ae510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f396c009880 tx=0x7f396c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a9130ba39e844c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:29.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f397959a700 1 -- 172.21.15.123:0/3707579976 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c011830 con 0x7f397c0b2db0 2024-09-13T17:07:29.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f397959a700 1 -- 172.21.15.123:0/3707579976 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396c011990 con 0x7f397c0b2db0 2024-09-13T17:07:29.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f397959a700 1 -- 172.21.15.123:0/3707579976 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c011d00 con 0x7f397c0b2db0 2024-09-13T17:07:29.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f3980c6a700 1 -- 172.21.15.123:0/3707579976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f397c0b2db0 msgr2=0x7f397c0ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f3980c6a700 1 --2- 172.21.15.123:0/3707579976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f397c0b2db0 0x7f397c0ae510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f396c009880 tx=0x7f396c009b90 comp rx=0 tx=0).stop 2024-09-13T17:07:29.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f3980c6a700 1 -- 172.21.15.123:0/3707579976 shutdown_connections 2024-09-13T17:07:29.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f3980c6a700 1 --2- 172.21.15.123:0/3707579976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f397c0b2db0 0x7f397c0ae510 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f3980c6a700 1 -- 172.21.15.123:0/3707579976 >> 172.21.15.123:0/3707579976 conn(0x7f397c0b0450 msgr2=0x7f397c0b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:29.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f3980c6a700 1 -- 172.21.15.123:0/3707579976 shutdown_connections 2024-09-13T17:07:29.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.041+0000 7f3980c6a700 1 -- 172.21.15.123:0/3707579976 wait complete. 2024-09-13T17:07:29.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f3980c6a700 1 Processor -- start 2024-09-13T17:07:29.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f3980c6a700 1 -- start start 2024-09-13T17:07:29.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f3980c6a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f397c06c140 0x7f397c1f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f3980c6a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f397c0b2db0 0x7f397c0adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f3980c6a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f397c15ae50 0x7f397c0ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f3980c6a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c159860 con 0x7f397c06c140 2024-09-13T17:07:29.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f3980c6a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c15c7a0 con 0x7f397c15ae50 2024-09-13T17:07:29.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f3980c6a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397c15bf00 con 0x7f397c0b2db0 2024-09-13T17:07:29.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f397a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f397c06c140 0x7f397c1f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f397a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f397c06c140 0x7f397c1f3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49044/0 (socket says 172.21.15.123:49044) 2024-09-13T17:07:29.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f397a59c700 1 -- 172.21.15.123:0/134255518 learned_addr learned my addr 172.21.15.123:0/134255518 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:29.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f3979d9b700 1 --2- 172.21.15.123:0/134255518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f397c0b2db0 0x7f397c0adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f397ad9d700 1 --2- 172.21.15.123:0/134255518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f397c15ae50 0x7f397c0ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f397a59c700 1 -- 172.21.15.123:0/134255518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f397c0b2db0 msgr2=0x7f397c0adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f397a59c700 1 --2- 172.21.15.123:0/134255518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f397c0b2db0 0x7f397c0adb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f397a59c700 1 -- 172.21.15.123:0/134255518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f397c15ae50 msgr2=0x7f397c0ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f397a59c700 1 --2- 172.21.15.123:0/134255518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f397c15ae50 0x7f397c0ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f397a59c700 1 -- 172.21.15.123:0/134255518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c0094b0 con 0x7f397c06c140 2024-09-13T17:07:29.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f397a59c700 1 --2- 172.21.15.123:0/134255518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f397c06c140 0x7f397c1f3b10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f396400c500 tx=0x7f396400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:29.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f3972ffd700 1 -- 172.21.15.123:0/134255518 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640052d0 con 0x7f397c06c140 2024-09-13T17:07:29.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f3972ffd700 1 -- 172.21.15.123:0/134255518 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3964005430 con 0x7f397c06c140 2024-09-13T17:07:29.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f3980c6a700 1 -- 172.21.15.123:0/134255518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397c15c1e0 con 0x7f397c06c140 2024-09-13T17:07:29.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f3972ffd700 1 -- 172.21.15.123:0/134255518 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640055a0 con 0x7f397c06c140 2024-09-13T17:07:29.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.045+0000 7f3980c6a700 1 -- 172.21.15.123:0/134255518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397c0c3540 con 0x7f397c06c140 2024-09-13T17:07:29.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.049+0000 7f3980c6a700 1 -- 172.21.15.123:0/134255518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397c06d870 con 0x7f397c06c140 2024-09-13T17:07:29.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.049+0000 7f3972ffd700 1 -- 172.21.15.123:0/134255518 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f39640036a0 con 0x7f397c06c140 2024-09-13T17:07:29.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.049+0000 7f3972ffd700 1 --2- 172.21.15.123:0/134255518 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f395c066730 0x7f395c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.049+0000 7f3972ffd700 1 -- 172.21.15.123:0/134255518 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3964083380 con 0x7f397c06c140 2024-09-13T17:07:29.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.049+0000 7f3979d9b700 1 --2- 172.21.15.123:0/134255518 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f395c066730 0x7f395c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.053+0000 7f3979d9b700 1 --2- 172.21.15.123:0/134255518 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f395c066730 0x7f395c068bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3974001560 tx=0x7f39740019f0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:29.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.057+0000 7f3972ffd700 1 -- 172.21.15.123:0/134255518 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3964050670 con 0x7f397c06c140 2024-09-13T17:07:29.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.241+0000 7f3980c6a700 1 -- 172.21.15.123:0/134255518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f397c0c3700 con 0x7f397c06c140 2024-09-13T17:07:29.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.241+0000 7f3972ffd700 1 -- 172.21.15.123:0/134255518 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3964053c90 con 0x7f397c06c140 2024-09-13T17:07:29.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.241+0000 7f3980c6a700 1 -- 172.21.15.123:0/134255518 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f395c066730 msgr2=0x7f395c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.241+0000 7f3980c6a700 1 --2- 172.21.15.123:0/134255518 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f395c066730 0x7f395c068bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3974001560 tx=0x7f39740019f0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.241+0000 7f3980c6a700 1 -- 172.21.15.123:0/134255518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f397c06c140 msgr2=0x7f397c1f3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.241+0000 7f3980c6a700 1 --2- 172.21.15.123:0/134255518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f397c06c140 0x7f397c1f3b10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f396400c500 tx=0x7f396400c810 comp rx=0 tx=0).stop 2024-09-13T17:07:29.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.245+0000 7f3980c6a700 1 -- 172.21.15.123:0/134255518 shutdown_connections 2024-09-13T17:07:29.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.245+0000 7f3980c6a700 1 --2- 172.21.15.123:0/134255518 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f395c066730 0x7f395c068bf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.245+0000 7f3980c6a700 1 --2- 172.21.15.123:0/134255518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f397c15ae50 0x7f397c0ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.245+0000 7f3980c6a700 1 --2- 172.21.15.123:0/134255518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f397c0b2db0 0x7f397c0adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.245+0000 7f3980c6a700 1 --2- 172.21.15.123:0/134255518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f397c06c140 0x7f397c1f3b10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.245+0000 7f3980c6a700 1 -- 172.21.15.123:0/134255518 >> 172.21.15.123:0/134255518 conn(0x7f397c0b0450 msgr2=0x7f397c0b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:29.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.245+0000 7f3980c6a700 1 -- 172.21.15.123:0/134255518 shutdown_connections 2024-09-13T17:07:29.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.245+0000 7f3980c6a700 1 -- 172.21.15.123:0/134255518 wait complete. 2024-09-13T17:07:29.247 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:07:29.258 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2024-09-13T17:07:29.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:29.258 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-13T17:07:29.273 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:07:29.273 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:07:29.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:29.273 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:07:29.280 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:07:29.280 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:07:29.288 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:07:29.288 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:07:29.338 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:29.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f2bb1700 1 Processor -- start 2024-09-13T17:07:29.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f2bb1700 1 -- start start 2024-09-13T17:07:29.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f2bb1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8ec1602d0 0x7fe8ec0d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f2bb1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8ec0cf920 0x7fe8ec0b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f2bb1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ec0d0ea0 con 0x7fe8ec0d3680 2024-09-13T17:07:29.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f2bb1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ec0ceab0 con 0x7fe8ec1602d0 2024-09-13T17:07:29.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f2bb1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ec0cff00 con 0x7fe8ec0cf920 2024-09-13T17:07:29.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f1baf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8ec1602d0 0x7fe8ec0d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f1baf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8ec1602d0 0x7fe8ec0d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49046/0 (socket says 172.21.15.123:49046) 2024-09-13T17:07:29.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f1baf700 1 -- 172.21.15.123:0/2051334985 learned_addr learned my addr 172.21.15.123:0/2051334985 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:29.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f23b0700 1 --2- 172.21.15.123:0/2051334985 >> v2:172.21.15.153:3300/0 conn(0x7fe8ec0cf920 0x7fe8ec0b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f1baf700 1 -- 172.21.15.123:0/2051334985 >> v2:172.21.15.153:3300/0 conn(0x7fe8ec0cf920 msgr2=0x7fe8ec0b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:29.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f1baf700 1 --2- 172.21.15.123:0/2051334985 >> v2:172.21.15.153:3300/0 conn(0x7fe8ec0cf920 0x7fe8ec0b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f1baf700 1 -- 172.21.15.123:0/2051334985 >> v1:172.21.15.153:6789/0 conn(0x7fe8ec0d3680 legacy=0x7fe8ec0cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.453+0000 7fe8f0bad700 1 -- 172.21.15.123:0/2051334985 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1328866852 0 0) 0x7fe8ec0d0ea0 con 0x7fe8ec0d3680 2024-09-13T17:07:29.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.457+0000 7fe8f1baf700 1 -- 172.21.15.123:0/2051334985 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec0d0c70 con 0x7fe8ec1602d0 2024-09-13T17:07:29.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.457+0000 7fe8f1baf700 1 --2- 172.21.15.123:0/2051334985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec1602d0 0x7fe8ec0d0730 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009910 tx=0x7fe8dc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22534f5f8db3769d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:29.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.457+0000 7fe8f0bad700 1 -- 172.21.15.123:0/2051334985 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc011830 con 0x7fe8ec1602d0 2024-09-13T17:07:29.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.457+0000 7fe8f0bad700 1 -- 172.21.15.123:0/2051334985 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc011990 con 0x7fe8ec1602d0 2024-09-13T17:07:29.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.457+0000 7fe8f0bad700 1 -- 172.21.15.123:0/2051334985 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc011d40 con 0x7fe8ec1602d0 2024-09-13T17:07:29.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.457+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/2051334985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec1602d0 msgr2=0x7fe8ec0d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.457+0000 7fe8f2bb1700 1 --2- 172.21.15.123:0/2051334985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec1602d0 0x7fe8ec0d0730 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009910 tx=0x7fe8dc009c20 comp rx=0 tx=0).stop 2024-09-13T17:07:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.457+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/2051334985 shutdown_connections 2024-09-13T17:07:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.457+0000 7fe8f2bb1700 1 --2- 172.21.15.123:0/2051334985 >> v2:172.21.15.153:3300/0 conn(0x7fe8ec0cf920 0x7fe8ec0b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.457+0000 7fe8f2bb1700 1 --2- 172.21.15.123:0/2051334985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec1602d0 0x7fe8ec0d0730 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.457+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/2051334985 >> 172.21.15.123:0/2051334985 conn(0x7fe8ec0d2b60 msgr2=0x7fe8ec0d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.457+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/2051334985 shutdown_connections 2024-09-13T17:07:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.457+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/2051334985 wait complete. 2024-09-13T17:07:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f2bb1700 1 Processor -- start 2024-09-13T17:07:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f2bb1700 1 -- start start 2024-09-13T17:07:29.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f2bb1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec0cf920 0x7fe8ec0c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f2bb1700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8ec0d3680 0x7fe8ec0c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f2bb1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec1602d0 0x7fe8ec0cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f2bb1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0ca170 con 0x7fe8ec0cf920 2024-09-13T17:07:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f2bb1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0ca410 con 0x7fe8ec1602d0 2024-09-13T17:07:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f2bb1700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0ca6f0 con 0x7fe8ec0d3680 2024-09-13T17:07:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f1baf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec0cf920 0x7fe8ec0c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f1baf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec0cf920 0x7fe8ec0c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49050/0 (socket says 172.21.15.123:49050) 2024-09-13T17:07:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f1baf700 1 -- 172.21.15.123:0/4159222321 learned_addr learned my addr 172.21.15.123:0/4159222321 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f13ae700 1 --2- 172.21.15.123:0/4159222321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8ec0d3680 0x7fe8ec0c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f23b0700 1 --2- 172.21.15.123:0/4159222321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec1602d0 0x7fe8ec0cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f1baf700 1 -- 172.21.15.123:0/4159222321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8ec0d3680 msgr2=0x7fe8ec0c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f1baf700 1 --2- 172.21.15.123:0/4159222321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8ec0d3680 0x7fe8ec0c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f1baf700 1 -- 172.21.15.123:0/4159222321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec1602d0 msgr2=0x7fe8ec0cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f1baf700 1 --2- 172.21.15.123:0/4159222321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec1602d0 0x7fe8ec0cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f1baf700 1 -- 172.21.15.123:0/4159222321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc009570 con 0x7fe8ec0cf920 2024-09-13T17:07:29.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f1baf700 1 --2- 172.21.15.123:0/4159222321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec0cf920 0x7fe8ec0c8980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc014040 tx=0x7fe8dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:29.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8e27fc700 1 -- 172.21.15.123:0/4159222321 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc01a830 con 0x7fe8ec0cf920 2024-09-13T17:07:29.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8e27fc700 1 -- 172.21.15.123:0/4159222321 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc01a990 con 0x7fe8ec0cf920 2024-09-13T17:07:29.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/4159222321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec0ca9d0 con 0x7fe8ec0cf920 2024-09-13T17:07:29.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/4159222321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec0caf90 con 0x7fe8ec0cf920 2024-09-13T17:07:29.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.461+0000 7fe8e27fc700 1 -- 172.21.15.123:0/4159222321 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc01ad40 con 0x7fe8ec0cf920 2024-09-13T17:07:29.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.465+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/4159222321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ec0cb180 con 0x7fe8ec0cf920 2024-09-13T17:07:29.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.465+0000 7fe8e27fc700 1 -- 172.21.15.123:0/4159222321 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe8dc019430 con 0x7fe8ec0cf920 2024-09-13T17:07:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.465+0000 7fe8e27fc700 1 --2- 172.21.15.123:0/4159222321 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe8d0066760 0x7fe8d0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.465+0000 7fe8e27fc700 1 -- 172.21.15.123:0/4159222321 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8dc085560 con 0x7fe8ec0cf920 2024-09-13T17:07:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.465+0000 7fe8f13ae700 1 --2- 172.21.15.123:0/4159222321 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe8d0066760 0x7fe8d0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.465+0000 7fe8f13ae700 1 --2- 172.21.15.123:0/4159222321 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe8d0066760 0x7fe8d0068c20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec1f5870 tx=0x7fe8e8009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:29.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.473+0000 7fe8e27fc700 1 -- 172.21.15.123:0/4159222321 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe8dc0528e0 con 0x7fe8ec0cf920 2024-09-13T17:07:29.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.645+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/4159222321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8ec0d0390 con 0x7fe8ec0cf920 2024-09-13T17:07:29.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.649+0000 7fe8e27fc700 1 -- 172.21.15.123:0/4159222321 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16553 (secure 0 0 0) 0x7fe8dc055f00 con 0x7fe8ec0cf920 2024-09-13T17:07:29.651 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:29.652 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:06:49.422039+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.649+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/4159222321 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe8d0066760 msgr2=0x7fe8d0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.649+0000 7fe8f2bb1700 1 --2- 172.21.15.123:0/4159222321 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe8d0066760 0x7fe8d0068c20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec1f5870 tx=0x7fe8e8009040 comp rx=0 tx=0).stop 2024-09-13T17:07:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.649+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/4159222321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec0cf920 msgr2=0x7fe8ec0c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.649+0000 7fe8f2bb1700 1 --2- 172.21.15.123:0/4159222321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec0cf920 0x7fe8ec0c8980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc014040 tx=0x7fe8dc004770 comp rx=0 tx=0).stop 2024-09-13T17:07:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.649+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/4159222321 shutdown_connections 2024-09-13T17:07:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.649+0000 7fe8f2bb1700 1 --2- 172.21.15.123:0/4159222321 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe8d0066760 0x7fe8d0068c20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.649+0000 7fe8f2bb1700 1 --2- 172.21.15.123:0/4159222321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec1602d0 0x7fe8ec0cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.649+0000 7fe8f2bb1700 1 --2- 172.21.15.123:0/4159222321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8ec0d3680 0x7fe8ec0c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.649+0000 7fe8f2bb1700 1 --2- 172.21.15.123:0/4159222321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8ec0cf920 0x7fe8ec0c8980 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.649+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/4159222321 >> 172.21.15.123:0/4159222321 conn(0x7fe8ec0d2b60 msgr2=0x7fe8ec0b8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:29.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.649+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/4159222321 shutdown_connections 2024-09-13T17:07:29.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.653+0000 7fe8f2bb1700 1 -- 172.21.15.123:0/4159222321 wait complete. 2024-09-13T17:07:29.666 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:29.667 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:29.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05deede700 1 Processor -- start 2024-09-13T17:07:29.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05deede700 1 -- start start 2024-09-13T17:07:29.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05deede700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05d80d0f40 0x7f05d80d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05deede700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05d80b58b0 0x7f05d80d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05deede700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d80b0060 con 0x7f05d80b1100 2024-09-13T17:07:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05deede700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d80b0340 con 0x7f05d80d0f40 2024-09-13T17:07:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05deede700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80b0620 con 0x7f05d80b58b0 2024-09-13T17:07:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05de6dd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f05d80b1100 0x7f05d80b1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49934/0 (socket says 172.21.15.123:49934) 2024-09-13T17:07:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05de6dd700 1 -- 172.21.15.123:0/2427867479 learned_addr learned my addr 172.21.15.123:0/2427867479 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05ddedc700 1 --2- 172.21.15.123:0/2427867479 >> v2:172.21.15.123:3300/0 conn(0x7f05d80d0f40 0x7f05d80d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05dd6db700 1 --2- 172.21.15.123:0/2427867479 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05d80b58b0 0x7f05d80d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05dceda700 1 -- 172.21.15.123:0/2427867479 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054827263 0 0) 0x7f05d80b0060 con 0x7f05d80b1100 2024-09-13T17:07:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05dceda700 1 -- 172.21.15.123:0/2427867479 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05c40035d0 con 0x7f05d80b1100 2024-09-13T17:07:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05ddedc700 1 -- 172.21.15.123:0/2427867479 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05d80b58b0 msgr2=0x7f05d80d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:29.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05ddedc700 1 --2- 172.21.15.123:0/2427867479 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05d80b58b0 0x7f05d80d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05ddedc700 1 -- 172.21.15.123:0/2427867479 >> v1:172.21.15.123:6789/0 conn(0x7f05d80b1100 legacy=0x7f05d80b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.785+0000 7f05ddedc700 1 -- 172.21.15.123:0/2427867479 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d80b0900 con 0x7f05d80d0f40 2024-09-13T17:07:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.789+0000 7f05ddedc700 1 --2- 172.21.15.123:0/2427867479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05d80d0f40 0x7f05d80d1320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009850 tx=0x7f05c8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b70951baad8dc4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.789+0000 7f05dceda700 1 -- 172.21.15.123:0/2427867479 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8011830 con 0x7f05d80d0f40 2024-09-13T17:07:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.789+0000 7f05dceda700 1 -- 172.21.15.123:0/2427867479 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c8011990 con 0x7f05d80d0f40 2024-09-13T17:07:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.789+0000 7f05dceda700 1 -- 172.21.15.123:0/2427867479 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8011d00 con 0x7f05d80d0f40 2024-09-13T17:07:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.789+0000 7f05deede700 1 -- 172.21.15.123:0/2427867479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05d80d0f40 msgr2=0x7f05d80d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.789+0000 7f05deede700 1 --2- 172.21.15.123:0/2427867479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05d80d0f40 0x7f05d80d1320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009850 tx=0x7f05c8009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.789+0000 7f05deede700 1 -- 172.21.15.123:0/2427867479 shutdown_connections 2024-09-13T17:07:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.789+0000 7f05deede700 1 --2- 172.21.15.123:0/2427867479 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05d80b58b0 0x7f05d80d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.789+0000 7f05deede700 1 --2- 172.21.15.123:0/2427867479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05d80d0f40 0x7f05d80d1320 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.789+0000 7f05deede700 1 -- 172.21.15.123:0/2427867479 >> 172.21.15.123:0/2427867479 conn(0x7f05d80d2a60 msgr2=0x7f05d80d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:29.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.789+0000 7f05deede700 1 -- 172.21.15.123:0/2427867479 shutdown_connections 2024-09-13T17:07:29.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.789+0000 7f05deede700 1 -- 172.21.15.123:0/2427867479 wait complete. 2024-09-13T17:07:29.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.789+0000 7f05deede700 1 Processor -- start 2024-09-13T17:07:29.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.789+0000 7f05deede700 1 -- start start 2024-09-13T17:07:29.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05deede700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05d80b1100 0x7f05d80c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05deede700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d80b58b0 0x7f05d815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05deede700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05d80d0f40 0x7f05d81e8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05deede700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d815c210 con 0x7f05d80d0f40 2024-09-13T17:07:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05deede700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80c7ac0 con 0x7f05d80b58b0 2024-09-13T17:07:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05deede700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80c7da0 con 0x7f05d80b1100 2024-09-13T17:07:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05de6dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05d80d0f40 0x7f05d81e8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05de6dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05d80d0f40 0x7f05d81e8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49072/0 (socket says 172.21.15.123:49072) 2024-09-13T17:07:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05de6dd700 1 -- 172.21.15.123:0/2540486339 learned_addr learned my addr 172.21.15.123:0/2540486339 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05ddedc700 1 --2- 172.21.15.123:0/2540486339 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05d80b1100 0x7f05d80c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05dd6db700 1 --2- 172.21.15.123:0/2540486339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d80b58b0 0x7f05d815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05de6dd700 1 -- 172.21.15.123:0/2540486339 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05d80b1100 msgr2=0x7f05d80c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05de6dd700 1 --2- 172.21.15.123:0/2540486339 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05d80b1100 0x7f05d80c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05de6dd700 1 -- 172.21.15.123:0/2540486339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d80b58b0 msgr2=0x7f05d815bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05de6dd700 1 --2- 172.21.15.123:0/2540486339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d80b58b0 0x7f05d815bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05de6dd700 1 -- 172.21.15.123:0/2540486339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c80094b0 con 0x7f05d80d0f40 2024-09-13T17:07:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05de6dd700 1 --2- 172.21.15.123:0/2540486339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05d80d0f40 0x7f05d81e8650 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f05d000caa0 tx=0x7f05d000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05ce7fc700 1 -- 172.21.15.123:0/2540486339 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0007480 con 0x7f05d80d0f40 2024-09-13T17:07:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05ce7fc700 1 -- 172.21.15.123:0/2540486339 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d00075e0 con 0x7f05d80d0f40 2024-09-13T17:07:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05deede700 1 -- 172.21.15.123:0/2540486339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d80c8080 con 0x7f05d80d0f40 2024-09-13T17:07:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05ce7fc700 1 -- 172.21.15.123:0/2540486339 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0007970 con 0x7f05d80d0f40 2024-09-13T17:07:29.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.793+0000 7f05deede700 1 -- 172.21.15.123:0/2540486339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d80c8640 con 0x7f05d80d0f40 2024-09-13T17:07:29.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.797+0000 7f05deede700 1 -- 172.21.15.123:0/2540486339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d806f8b0 con 0x7f05d80d0f40 2024-09-13T17:07:29.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.797+0000 7f05ce7fc700 1 -- 172.21.15.123:0/2540486339 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f05d001b3b0 con 0x7f05d80d0f40 2024-09-13T17:07:29.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.797+0000 7f05ce7fc700 1 --2- 172.21.15.123:0/2540486339 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f05bc066730 0x7f05bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:29.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.797+0000 7f05ddedc700 1 --2- 172.21.15.123:0/2540486339 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f05bc066730 0x7f05bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:29.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.797+0000 7f05ce7fc700 1 -- 172.21.15.123:0/2540486339 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05d0083a30 con 0x7f05d80d0f40 2024-09-13T17:07:29.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.797+0000 7f05ddedc700 1 --2- 172.21.15.123:0/2540486339 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f05bc066730 0x7f05bc068bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f05c80090b0 tx=0x7f05c8008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:29.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.805+0000 7f05ce7fc700 1 -- 172.21.15.123:0/2540486339 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f05d0050da0 con 0x7f05d80d0f40 2024-09-13T17:07:29.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.969+0000 7f05deede700 1 -- 172.21.15.123:0/2540486339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05d80c8830 con 0x7f05d80d0f40 2024-09-13T17:07:29.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.969+0000 7f05ce7fc700 1 -- 172.21.15.123:0/2540486339 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05d00543c0 con 0x7f05d80d0f40 2024-09-13T17:07:29.971 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:29.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.969+0000 7f05deede700 1 -- 172.21.15.123:0/2540486339 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f05bc066730 msgr2=0x7f05bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.969+0000 7f05deede700 1 --2- 172.21.15.123:0/2540486339 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f05bc066730 0x7f05bc068bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f05c80090b0 tx=0x7f05c8008030 comp rx=0 tx=0).stop 2024-09-13T17:07:29.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.969+0000 7f05deede700 1 -- 172.21.15.123:0/2540486339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05d80d0f40 msgr2=0x7f05d81e8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:29.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.969+0000 7f05deede700 1 --2- 172.21.15.123:0/2540486339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05d80d0f40 0x7f05d81e8650 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f05d000caa0 tx=0x7f05d000cad0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.969+0000 7f05deede700 1 -- 172.21.15.123:0/2540486339 shutdown_connections 2024-09-13T17:07:29.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.969+0000 7f05deede700 1 --2- 172.21.15.123:0/2540486339 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f05bc066730 0x7f05bc068bf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.969+0000 7f05deede700 1 --2- 172.21.15.123:0/2540486339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05d80d0f40 0x7f05d81e8650 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.969+0000 7f05deede700 1 --2- 172.21.15.123:0/2540486339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d80b58b0 0x7f05d815bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.969+0000 7f05deede700 1 --2- 172.21.15.123:0/2540486339 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05d80b1100 0x7f05d80c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:29.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.969+0000 7f05deede700 1 -- 172.21.15.123:0/2540486339 >> 172.21.15.123:0/2540486339 conn(0x7f05d80d2a60 msgr2=0x7f05d81e73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:29.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.973+0000 7f05deede700 1 -- 172.21.15.123:0/2540486339 shutdown_connections 2024-09-13T17:07:29.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:29.973+0000 7f05deede700 1 -- 172.21.15.123:0/2540486339 wait complete. 2024-09-13T17:07:29.986 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:07:30.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.101+0000 7fd4b6bdf700 1 Processor -- start 2024-09-13T17:07:30.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.101+0000 7fd4b6bdf700 1 -- start start 2024-09-13T17:07:30.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd4b01597c0 0x7fd4b00b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd4b006dc70 0x7fd4b0071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4b0071590 0x7fd4b00b3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b00cc030 con 0x7fd4b006dc70 2024-09-13T17:07:30.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b00719e0 con 0x7fd4b01597c0 2024-09-13T17:07:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b00b2e60 con 0x7fd4b0071590 2024-09-13T17:07:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b53dc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd4b006dc70 0x7fd4b0071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b53dc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd4b006dc70 0x7fd4b0071050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49084/0 (socket says 172.21.15.123:49084) 2024-09-13T17:07:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b53dc700 1 -- 172.21.15.123:0/4246624790 learned_addr learned my addr 172.21.15.123:0/4246624790 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b5bdd700 1 --2- 172.21.15.123:0/4246624790 >> v2:172.21.15.153:3300/0 conn(0x7fd4b01597c0 0x7fd4b00b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b63de700 1 --2- 172.21.15.123:0/4246624790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4b0071590 0x7fd4b00b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b53dc700 1 -- 172.21.15.123:0/4246624790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4b0071590 msgr2=0x7fd4b00b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b53dc700 1 --2- 172.21.15.123:0/4246624790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4b0071590 0x7fd4b00b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b53dc700 1 -- 172.21.15.123:0/4246624790 >> v2:172.21.15.153:3300/0 conn(0x7fd4b01597c0 msgr2=0x7fd4b00b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b53dc700 1 --2- 172.21.15.123:0/4246624790 >> v2:172.21.15.153:3300/0 conn(0x7fd4b01597c0 0x7fd4b00b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b53dc700 1 -- 172.21.15.123:0/4246624790 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b00b17d0 con 0x7fd4b006dc70 2024-09-13T17:07:30.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b53dc700 1 --2- 172.21.15.123:0/4246624790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4b006dc70 0x7fd4b0071050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00d0020 tx=0x7fd4a0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7010c4f479a3c75f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:30.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b4bdb700 1 -- 172.21.15.123:0/4246624790 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0011830 con 0x7fd4b006dc70 2024-09-13T17:07:30.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b4bdb700 1 -- 172.21.15.123:0/4246624790 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a0011990 con 0x7fd4b006dc70 2024-09-13T17:07:30.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b4bdb700 1 -- 172.21.15.123:0/4246624790 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0011d20 con 0x7fd4b006dc70 2024-09-13T17:07:30.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/4246624790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4b006dc70 msgr2=0x7fd4b0071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 --2- 172.21.15.123:0/4246624790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4b006dc70 0x7fd4b0071050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00d0020 tx=0x7fd4a0009bf0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/4246624790 shutdown_connections 2024-09-13T17:07:30.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 --2- 172.21.15.123:0/4246624790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4b0071590 0x7fd4b00b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 --2- 172.21.15.123:0/4246624790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4b006dc70 0x7fd4b0071050 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 --2- 172.21.15.123:0/4246624790 >> v2:172.21.15.153:3300/0 conn(0x7fd4b01597c0 0x7fd4b00b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/4246624790 >> 172.21.15.123:0/4246624790 conn(0x7fd4b006f940 msgr2=0x7fd4b00b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:30.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/4246624790 shutdown_connections 2024-09-13T17:07:30.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.105+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/4246624790 wait complete. 2024-09-13T17:07:30.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b6bdf700 1 Processor -- start 2024-09-13T17:07:30.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b6bdf700 1 -- start start 2024-09-13T17:07:30.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b6bdf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b006dc70 0x7fd4b0154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b6bdf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4b0071590 0x7fd4b0155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b6bdf700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4b01597c0 0x7fd4b014ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b6bdf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b0154ed0 con 0x7fd4b0071590 2024-09-13T17:07:30.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b6bdf700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b01551b0 con 0x7fd4b006dc70 2024-09-13T17:07:30.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b6bdf700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b0155490 con 0x7fd4b01597c0 2024-09-13T17:07:30.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b53dc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4b0071590 0x7fd4b0155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b53dc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4b0071590 0x7fd4b0155f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49094/0 (socket says 172.21.15.123:49094) 2024-09-13T17:07:30.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b53dc700 1 -- 172.21.15.123:0/811119129 learned_addr learned my addr 172.21.15.123:0/811119129 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:30.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b63de700 1 --2- 172.21.15.123:0/811119129 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4b01597c0 0x7fd4b014ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b5bdd700 1 --2- 172.21.15.123:0/811119129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b006dc70 0x7fd4b0154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b53dc700 1 -- 172.21.15.123:0/811119129 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4b01597c0 msgr2=0x7fd4b014ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b53dc700 1 --2- 172.21.15.123:0/811119129 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4b01597c0 0x7fd4b014ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b53dc700 1 -- 172.21.15.123:0/811119129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b006dc70 msgr2=0x7fd4b0154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b53dc700 1 --2- 172.21.15.123:0/811119129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b006dc70 0x7fd4b0154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b53dc700 1 -- 172.21.15.123:0/811119129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a0009570 con 0x7fd4b0071590 2024-09-13T17:07:30.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b53dc700 1 --2- 172.21.15.123:0/811119129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4b0071590 0x7fd4b0155f70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0073300 tx=0x7fd4a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:30.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4a67fc700 1 -- 172.21.15.123:0/811119129 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00044d0 con 0x7fd4b0071590 2024-09-13T17:07:30.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4a67fc700 1 -- 172.21.15.123:0/811119129 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a001f070 con 0x7fd4b0071590 2024-09-13T17:07:30.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/811119129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b0155770 con 0x7fd4b0071590 2024-09-13T17:07:30.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4a67fc700 1 -- 172.21.15.123:0/811119129 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0003900 con 0x7fd4b0071590 2024-09-13T17:07:30.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.109+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/811119129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b014de40 con 0x7fd4b0071590 2024-09-13T17:07:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.113+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/811119129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b0155c90 con 0x7fd4b0071590 2024-09-13T17:07:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.113+0000 7fd4a67fc700 1 -- 172.21.15.123:0/811119129 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd4a0003a60 con 0x7fd4b0071590 2024-09-13T17:07:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.113+0000 7fd4a67fc700 1 --2- 172.21.15.123:0/811119129 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd494066730 0x7fd494068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.113+0000 7fd4b5bdd700 1 --2- 172.21.15.123:0/811119129 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd494066730 0x7fd494068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.113+0000 7fd4a67fc700 1 -- 172.21.15.123:0/811119129 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4a0021070 con 0x7fd4b0071590 2024-09-13T17:07:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.113+0000 7fd4b5bdd700 1 --2- 172.21.15.123:0/811119129 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd494066730 0x7fd494068bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009ae0 tx=0x7fd4ac008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:30.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.121+0000 7fd4a67fc700 1 -- 172.21.15.123:0/811119129 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd4b0155c90 con 0x7fd4b0071590 2024-09-13T17:07:30.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.285+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/811119129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4b0155c90 con 0x7fd4b0071590 2024-09-13T17:07:30.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.285+0000 7fd4a67fc700 1 -- 172.21.15.123:0/811119129 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd4b0155c90 con 0x7fd4b0071590 2024-09-13T17:07:30.289 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:07:30.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.289+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/811119129 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd494066730 msgr2=0x7fd494068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.289+0000 7fd4b6bdf700 1 --2- 172.21.15.123:0/811119129 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd494066730 0x7fd494068bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009ae0 tx=0x7fd4ac008040 comp rx=0 tx=0).stop 2024-09-13T17:07:30.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.289+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/811119129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4b0071590 msgr2=0x7fd4b0155f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.289+0000 7fd4b6bdf700 1 --2- 172.21.15.123:0/811119129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4b0071590 0x7fd4b0155f70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0073300 tx=0x7fd4a0004770 comp rx=0 tx=0).stop 2024-09-13T17:07:30.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.289+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/811119129 shutdown_connections 2024-09-13T17:07:30.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.289+0000 7fd4b6bdf700 1 --2- 172.21.15.123:0/811119129 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd494066730 0x7fd494068bf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.289+0000 7fd4b6bdf700 1 --2- 172.21.15.123:0/811119129 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4b01597c0 0x7fd4b014ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.289+0000 7fd4b6bdf700 1 --2- 172.21.15.123:0/811119129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4b0071590 0x7fd4b0155f70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.289+0000 7fd4b6bdf700 1 --2- 172.21.15.123:0/811119129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b006dc70 0x7fd4b0154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.289+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/811119129 >> 172.21.15.123:0/811119129 conn(0x7fd4b006f940 msgr2=0x7fd4b01572d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:30.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.289+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/811119129 shutdown_connections 2024-09-13T17:07:30.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.289+0000 7fd4b6bdf700 1 -- 172.21.15.123:0/811119129 wait complete. 2024-09-13T17:07:30.304 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:07:30.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.425+0000 7fd6c8fda700 1 Processor -- start 2024-09-13T17:07:30.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.425+0000 7fd6c8fda700 1 -- start start 2024-09-13T17:07:30.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.425+0000 7fd6c8fda700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c40b58b0 0x7fd6c40d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.425+0000 7fd6c8fda700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6c40cd5e0 0x7fd6c40cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.425+0000 7fd6c8fda700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c40b0060 con 0x7fd6c40d0f40 2024-09-13T17:07:30.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.425+0000 7fd6c8fda700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c40b0340 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.425+0000 7fd6c8fda700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40b0620 con 0x7fd6c40b58b0 2024-09-13T17:07:30.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.425+0000 7fd6c3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6c40cd5e0 0x7fd6c40cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.425+0000 7fd6c3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6c40cd5e0 0x7fd6c40cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49110/0 (socket says 172.21.15.123:49110) 2024-09-13T17:07:30.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.425+0000 7fd6c3fff700 1 -- 172.21.15.123:0/1210851188 learned_addr learned my addr 172.21.15.123:0/1210851188 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:30.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.425+0000 7fd6c2ffd700 1 --2- 172.21.15.123:0/1210851188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c40b58b0 0x7fd6c40d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c3fff700 1 -- 172.21.15.123:0/1210851188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c40b58b0 msgr2=0x7fd6c40d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:30.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c3fff700 1 --2- 172.21.15.123:0/1210851188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c40b58b0 0x7fd6c40d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c3fff700 1 -- 172.21.15.123:0/1210851188 >> v1:172.21.15.153:6789/0 conn(0x7fd6c40d0f40 legacy=0x7fd6c40d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c3fff700 1 -- 172.21.15.123:0/1210851188 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c40b0900 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c3fff700 1 --2- 172.21.15.123:0/1210851188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c40cd5e0 0x7fd6c40cda30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009e50 tx=0x7fd6bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00aec4bfa16fa54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:30.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c27fc700 1 -- 172.21.15.123:0/1210851188 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc00e070 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c27fc700 1 -- 172.21.15.123:0/1210851188 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc00b9c0 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c27fc700 1 -- 172.21.15.123:0/1210851188 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc00bd70 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c8fda700 1 -- 172.21.15.123:0/1210851188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c40cd5e0 msgr2=0x7fd6c40cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c8fda700 1 --2- 172.21.15.123:0/1210851188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c40cd5e0 0x7fd6c40cda30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009e50 tx=0x7fd6bc00b330 comp rx=0 tx=0).stop 2024-09-13T17:07:30.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c8fda700 1 -- 172.21.15.123:0/1210851188 shutdown_connections 2024-09-13T17:07:30.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c8fda700 1 --2- 172.21.15.123:0/1210851188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c40cd5e0 0x7fd6c40cda30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c8fda700 1 --2- 172.21.15.123:0/1210851188 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c40b58b0 0x7fd6c40d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c8fda700 1 -- 172.21.15.123:0/1210851188 >> 172.21.15.123:0/1210851188 conn(0x7fd6c40d2a60 msgr2=0x7fd6c40d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:30.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c8fda700 1 -- 172.21.15.123:0/1210851188 shutdown_connections 2024-09-13T17:07:30.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c8fda700 1 -- 172.21.15.123:0/1210851188 wait complete. 2024-09-13T17:07:30.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c8fda700 1 Processor -- start 2024-09-13T17:07:30.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.429+0000 7fd6c8fda700 1 -- start start 2024-09-13T17:07:30.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c8fda700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c40b58b0 0x7fd6c40c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c8fda700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c40cd5e0 0x7fd6c415b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c8fda700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c40d0f40 0x7fd6c415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c8fda700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40c73c0 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c8fda700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c415ba80 con 0x7fd6c40b58b0 2024-09-13T17:07:30.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c8fda700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c415e050 con 0x7fd6c40d0f40 2024-09-13T17:07:30.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c40cd5e0 0x7fd6c415b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c40cd5e0 0x7fd6c415b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49114/0 (socket says 172.21.15.123:49114) 2024-09-13T17:07:30.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c2ffd700 1 -- 172.21.15.123:0/464091753 learned_addr learned my addr 172.21.15.123:0/464091753 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:30.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c37fe700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c40b58b0 0x7fd6c40c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c3fff700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c40d0f40 0x7fd6c415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c2ffd700 1 -- 172.21.15.123:0/464091753 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c40d0f40 msgr2=0x7fd6c415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c2ffd700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c40d0f40 0x7fd6c415f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c2ffd700 1 -- 172.21.15.123:0/464091753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c40b58b0 msgr2=0x7fd6c40c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c2ffd700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c40b58b0 0x7fd6c40c6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c2ffd700 1 -- 172.21.15.123:0/464091753 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc009b30 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c3fff700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c40d0f40 0x7fd6c415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:30.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c2ffd700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c40cd5e0 0x7fd6c415b540 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00e730 tx=0x7fd6ac00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:30.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6bbfff700 1 -- 172.21.15.123:0/464091753 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac00c070 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6bbfff700 1 -- 172.21.15.123:0/464091753 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac013610 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6bbfff700 1 -- 172.21.15.123:0/464091753 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac0139c0 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c8fda700 1 -- 172.21.15.123:0/464091753 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c415e330 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c8fda700 1 -- 172.21.15.123:0/464091753 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c415e8f0 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.433+0000 7fd6c8fda700 1 -- 172.21.15.123:0/464091753 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c40d1320 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.437+0000 7fd6bbfff700 1 -- 172.21.15.123:0/464091753 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd6ac013b20 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.437+0000 7fd6bbfff700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd6a4066730 0x7fd6a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.437+0000 7fd6bbfff700 1 -- 172.21.15.123:0/464091753 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6ac084480 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.437+0000 7fd6c37fe700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd6a4066730 0x7fd6a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.437+0000 7fd6c37fe700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd6a4066730 0x7fd6a4068bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd6c415df80 tx=0x7fd6b4009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:30.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.445+0000 7fd6bbfff700 1 -- 172.21.15.123:0/464091753 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd6ac051930 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.609+0000 7fd6c8fda700 1 -- 172.21.15.123:0/464091753 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6c408c250 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.609+0000 7fd6bbfff700 1 -- 172.21.15.123:0/464091753 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6ac054f50 con 0x7fd6c40cd5e0 2024-09-13T17:07:30.613 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:07:30.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.613+0000 7fd6c8fda700 1 -- 172.21.15.123:0/464091753 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd6a4066730 msgr2=0x7fd6a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.613+0000 7fd6c8fda700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd6a4066730 0x7fd6a4068bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd6c415df80 tx=0x7fd6b4009040 comp rx=0 tx=0).stop 2024-09-13T17:07:30.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.613+0000 7fd6c8fda700 1 -- 172.21.15.123:0/464091753 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c40cd5e0 msgr2=0x7fd6c415b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.613+0000 7fd6c8fda700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c40cd5e0 0x7fd6c415b540 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00e730 tx=0x7fd6ac00ea40 comp rx=0 tx=0).stop 2024-09-13T17:07:30.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.613+0000 7fd6c8fda700 1 -- 172.21.15.123:0/464091753 shutdown_connections 2024-09-13T17:07:30.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.613+0000 7fd6c8fda700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd6a4066730 0x7fd6a4068bf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.613+0000 7fd6c8fda700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd6c40d0f40 0x7fd6c415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.613+0000 7fd6c8fda700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c40cd5e0 0x7fd6c415b540 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.613+0000 7fd6c8fda700 1 --2- 172.21.15.123:0/464091753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c40b58b0 0x7fd6c40c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.613+0000 7fd6c8fda700 1 -- 172.21.15.123:0/464091753 >> 172.21.15.123:0/464091753 conn(0x7fd6c40d2a60 msgr2=0x7fd6c4070710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:30.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.613+0000 7fd6c8fda700 1 -- 172.21.15.123:0/464091753 shutdown_connections 2024-09-13T17:07:30.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.613+0000 7fd6c8fda700 1 -- 172.21.15.123:0/464091753 wait complete. 2024-09-13T17:07:30.628 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:07:30.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.737+0000 7fd435c06700 1 Processor -- start 2024-09-13T17:07:30.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.737+0000 7fd435c06700 1 -- start start 2024-09-13T17:07:30.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.737+0000 7fd435c06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd4280df8e0 0x7fd42801c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.737+0000 7fd435c06700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4280e3310 con 0x7fd428050b90 2024-09-13T17:07:30.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.737+0000 7fd435c06700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4280e35f0 con 0x7fd42804fe30 2024-09-13T17:07:30.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.737+0000 7fd435c06700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4280e38d0 con 0x7fd4280df8e0 2024-09-13T17:07:30.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd435405700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd428050b90 0x7fd428005b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49950/0 (socket says 172.21.15.123:49950) 2024-09-13T17:07:30.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd435405700 1 -- 172.21.15.123:0/1475913391 learned_addr learned my addr 172.21.15.123:0/1475913391 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:30.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd434c04700 1 --2- 172.21.15.123:0/1475913391 >> v2:172.21.15.153:3300/0 conn(0x7fd4280df8e0 0x7fd42801c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd42f7fe700 1 -- 172.21.15.123:0/1475913391 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592145837 0 0) 0x7fd4280e3310 con 0x7fd428050b90 2024-09-13T17:07:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd42f7fe700 1 -- 172.21.15.123:0/1475913391 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4180035d0 con 0x7fd428050b90 2024-09-13T17:07:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd434c04700 1 -- 172.21.15.123:0/1475913391 >> v1:172.21.15.153:6789/0 conn(0x7fd42804fe30 legacy=0x7fd428050480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd434c04700 1 -- 172.21.15.123:0/1475913391 >> v1:172.21.15.123:6789/0 conn(0x7fd428050b90 legacy=0x7fd428005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd434c04700 1 -- 172.21.15.123:0/1475913391 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4280e3bb0 con 0x7fd4280df8e0 2024-09-13T17:07:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd434c04700 1 --2- 172.21.15.123:0/1475913391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4280df8e0 0x7fd42801c5d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd424009840 tx=0x7fd424009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4aad9b966d046c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd42f7fe700 1 -- 172.21.15.123:0/1475913391 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424005e50 con 0x7fd4280df8e0 2024-09-13T17:07:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd42f7fe700 1 -- 172.21.15.123:0/1475913391 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd424006030 con 0x7fd4280df8e0 2024-09-13T17:07:30.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd42f7fe700 1 -- 172.21.15.123:0/1475913391 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4240063c0 con 0x7fd4280df8e0 2024-09-13T17:07:30.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd435c06700 1 -- 172.21.15.123:0/1475913391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4280df8e0 msgr2=0x7fd42801c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd435c06700 1 --2- 172.21.15.123:0/1475913391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4280df8e0 0x7fd42801c5d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd424009840 tx=0x7fd424009b50 comp rx=0 tx=0).stop 2024-09-13T17:07:30.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd435c06700 1 -- 172.21.15.123:0/1475913391 shutdown_connections 2024-09-13T17:07:30.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd435c06700 1 --2- 172.21.15.123:0/1475913391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4280df8e0 0x7fd42801c5d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd435c06700 1 -- 172.21.15.123:0/1475913391 >> 172.21.15.123:0/1475913391 conn(0x7fd428036140 msgr2=0x7fd428036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:30.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd435c06700 1 -- 172.21.15.123:0/1475913391 shutdown_connections 2024-09-13T17:07:30.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.741+0000 7fd435c06700 1 -- 172.21.15.123:0/1475913391 wait complete. 2024-09-13T17:07:30.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd435c06700 1 Processor -- start 2024-09-13T17:07:30.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd435c06700 1 -- start start 2024-09-13T17:07:30.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd435c06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd42804fe30 0x7fd428037c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd435c06700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd428050b90 0x7fd42804d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd435c06700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4280df8e0 0x7fd42804dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd435c06700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd428039500 con 0x7fd428050b90 2024-09-13T17:07:30.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd435c06700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280cb710 con 0x7fd42804fe30 2024-09-13T17:07:30.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd435c06700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd428039780 con 0x7fd4280df8e0 2024-09-13T17:07:30.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd42ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd428050b90 0x7fd42804d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd42ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd428050b90 0x7fd42804d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49124/0 (socket says 172.21.15.123:49124) 2024-09-13T17:07:30.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd42ffff700 1 -- 172.21.15.123:0/3835606192 learned_addr learned my addr 172.21.15.123:0/3835606192 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:30.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd435405700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4280df8e0 0x7fd42804dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd434c04700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd42804fe30 0x7fd428037c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd42ffff700 1 -- 172.21.15.123:0/3835606192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4280df8e0 msgr2=0x7fd42804dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd42ffff700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4280df8e0 0x7fd42804dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd42ffff700 1 -- 172.21.15.123:0/3835606192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd42804fe30 msgr2=0x7fd428037c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd42ffff700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd42804fe30 0x7fd428037c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd42ffff700 1 -- 172.21.15.123:0/3835606192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd424009450 con 0x7fd428050b90 2024-09-13T17:07:30.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd434c04700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd42804fe30 0x7fd428037c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:30.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd42ffff700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd428050b90 0x7fd42804d8a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd42000c500 tx=0x7fd42000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:30.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd42d7fa700 1 -- 172.21.15.123:0/3835606192 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200052d0 con 0x7fd428050b90 2024-09-13T17:07:30.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd42d7fa700 1 -- 172.21.15.123:0/3835606192 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd420005430 con 0x7fd428050b90 2024-09-13T17:07:30.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd435c06700 1 -- 172.21.15.123:0/3835606192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd428039a60 con 0x7fd428050b90 2024-09-13T17:07:30.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd42d7fa700 1 -- 172.21.15.123:0/3835606192 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200055a0 con 0x7fd428050b90 2024-09-13T17:07:30.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.745+0000 7fd435c06700 1 -- 172.21.15.123:0/3835606192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42803a260 con 0x7fd428050b90 2024-09-13T17:07:30.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.749+0000 7fd435c06700 1 -- 172.21.15.123:0/3835606192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4280e3310 con 0x7fd428050b90 2024-09-13T17:07:30.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.749+0000 7fd42d7fa700 1 -- 172.21.15.123:0/3835606192 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd4200036a0 con 0x7fd428050b90 2024-09-13T17:07:30.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.749+0000 7fd42d7fa700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd41c066730 0x7fd41c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:30.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.749+0000 7fd434c04700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd41c066730 0x7fd41c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:30.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.749+0000 7fd42d7fa700 1 -- 172.21.15.123:0/3835606192 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd420083360 con 0x7fd428050b90 2024-09-13T17:07:30.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.753+0000 7fd434c04700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd41c066730 0x7fd41c068bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd424013040 tx=0x7fd424008070 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:30.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.761+0000 7fd42d7fa700 1 -- 172.21.15.123:0/3835606192 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd420050760 con 0x7fd428050b90 2024-09-13T17:07:30.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.949+0000 7fd435c06700 1 -- 172.21.15.123:0/3835606192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd428036e40 con 0x7fd428050b90 2024-09-13T17:07:30.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.949+0000 7fd42d7fa700 1 -- 172.21.15.123:0/3835606192 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd42005a020 con 0x7fd428050b90 2024-09-13T17:07:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.949+0000 7fd435c06700 1 -- 172.21.15.123:0/3835606192 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd41c066730 msgr2=0x7fd41c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.949+0000 7fd435c06700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd41c066730 0x7fd41c068bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd424013040 tx=0x7fd424008070 comp rx=0 tx=0).stop 2024-09-13T17:07:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.949+0000 7fd435c06700 1 -- 172.21.15.123:0/3835606192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd428050b90 msgr2=0x7fd42804d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.949+0000 7fd435c06700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd428050b90 0x7fd42804d8a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd42000c500 tx=0x7fd42000c810 comp rx=0 tx=0).stop 2024-09-13T17:07:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.949+0000 7fd435c06700 1 -- 172.21.15.123:0/3835606192 shutdown_connections 2024-09-13T17:07:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.949+0000 7fd435c06700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd41c066730 0x7fd41c068bf0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.949+0000 7fd435c06700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd4280df8e0 0x7fd42804dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.949+0000 7fd435c06700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd428050b90 0x7fd42804d8a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.949+0000 7fd435c06700 1 --2- 172.21.15.123:0/3835606192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd42804fe30 0x7fd428037c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.949+0000 7fd435c06700 1 -- 172.21.15.123:0/3835606192 >> 172.21.15.123:0/3835606192 conn(0x7fd428036140 msgr2=0x7fd428035780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.949+0000 7fd435c06700 1 -- 172.21.15.123:0/3835606192 shutdown_connections 2024-09-13T17:07:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:30.949+0000 7fd435c06700 1 -- 172.21.15.123:0/3835606192 wait complete. 2024-09-13T17:07:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:07:30.966 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:07:30.966 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:07:30.974 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:31.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6ffff700 1 Processor -- start 2024-09-13T17:07:31.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6ffff700 1 -- start start 2024-09-13T17:07:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fda7015ed00 0x7fda70161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda70161a80 0x7fda700cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6ffff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda70162550 con 0x7fda7015e920 2024-09-13T17:07:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6ffff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda700cd690 con 0x7fda7015ed00 2024-09-13T17:07:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6ffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda70161f90 con 0x7fda70161a80 2024-09-13T17:07:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6e7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fda7015ed00 0x7fda70161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6e7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fda7015ed00 0x7fda70161540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49132/0 (socket says 172.21.15.123:49132) 2024-09-13T17:07:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6e7fc700 1 -- 172.21.15.123:0/2013290746 learned_addr learned my addr 172.21.15.123:0/2013290746 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6f7fe700 1 --2- 172.21.15.123:0/2013290746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda70161a80 0x7fda700cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6e7fc700 1 -- 172.21.15.123:0/2013290746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda70161a80 msgr2=0x7fda700cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6e7fc700 1 --2- 172.21.15.123:0/2013290746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda70161a80 0x7fda700cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6e7fc700 1 -- 172.21.15.123:0/2013290746 >> v1:172.21.15.153:6789/0 conn(0x7fda7015e920 legacy=0x7fda700caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6e7fc700 1 -- 172.21.15.123:0/2013290746 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda70162270 con 0x7fda7015ed00 2024-09-13T17:07:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6f7fe700 1 --2- 172.21.15.123:0/2013290746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda70161a80 0x7fda700cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6e7fc700 1 --2- 172.21.15.123:0/2013290746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda7015ed00 0x7fda70161540 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fda60009e50 tx=0x7fda6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6579e716367ebeb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6dffb700 1 -- 172.21.15.123:0/2013290746 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6000e070 con 0x7fda7015ed00 2024-09-13T17:07:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6dffb700 1 -- 172.21.15.123:0/2013290746 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda60003a40 con 0x7fda7015ed00 2024-09-13T17:07:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.081+0000 7fda6dffb700 1 -- 172.21.15.123:0/2013290746 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60003df0 con 0x7fda7015ed00 2024-09-13T17:07:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 -- 172.21.15.123:0/2013290746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda7015ed00 msgr2=0x7fda70161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 --2- 172.21.15.123:0/2013290746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda7015ed00 0x7fda70161540 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fda60009e50 tx=0x7fda6000b330 comp rx=0 tx=0).stop 2024-09-13T17:07:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 -- 172.21.15.123:0/2013290746 shutdown_connections 2024-09-13T17:07:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 --2- 172.21.15.123:0/2013290746 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda70161a80 0x7fda700cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 --2- 172.21.15.123:0/2013290746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda7015ed00 0x7fda70161540 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 -- 172.21.15.123:0/2013290746 >> 172.21.15.123:0/2013290746 conn(0x7fda70066150 msgr2=0x7fda70066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:31.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 -- 172.21.15.123:0/2013290746 shutdown_connections 2024-09-13T17:07:31.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 -- 172.21.15.123:0/2013290746 wait complete. 2024-09-13T17:07:31.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 Processor -- start 2024-09-13T17:07:31.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 -- start start 2024-09-13T17:07:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda7015e920 0x7fda7015ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda7015ed00 0x7fda701488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda70161a80 0x7fda70148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7015a180 con 0x7fda70161a80 2024-09-13T17:07:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda70146850 con 0x7fda7015ed00 2024-09-13T17:07:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6ffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda70149430 con 0x7fda7015e920 2024-09-13T17:07:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda70161a80 0x7fda70148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda7015ed00 0x7fda701488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda70161a80 0x7fda70148e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49148/0 (socket says 172.21.15.123:49148) 2024-09-13T17:07:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6f7fe700 1 -- 172.21.15.123:0/1104604498 learned_addr learned my addr 172.21.15.123:0/1104604498 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6effd700 1 --2- 172.21.15.123:0/1104604498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda7015e920 0x7fda7015ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6f7fe700 1 -- 172.21.15.123:0/1104604498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda7015e920 msgr2=0x7fda7015ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6f7fe700 1 --2- 172.21.15.123:0/1104604498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda7015e920 0x7fda7015ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6f7fe700 1 -- 172.21.15.123:0/1104604498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda7015ed00 msgr2=0x7fda701488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6f7fe700 1 --2- 172.21.15.123:0/1104604498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda7015ed00 0x7fda701488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6f7fe700 1 -- 172.21.15.123:0/1104604498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda60009b30 con 0x7fda70161a80 2024-09-13T17:07:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.085+0000 7fda6f7fe700 1 --2- 172.21.15.123:0/1104604498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda70161a80 0x7fda70148e20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fda6800c7f0 tx=0x7fda6800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.089+0000 7fda677fe700 1 -- 172.21.15.123:0/1104604498 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68004220 con 0x7fda70161a80 2024-09-13T17:07:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.089+0000 7fda6ffff700 1 -- 172.21.15.123:0/1104604498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda70149710 con 0x7fda70161a80 2024-09-13T17:07:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.089+0000 7fda677fe700 1 -- 172.21.15.123:0/1104604498 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda680043a0 con 0x7fda70161a80 2024-09-13T17:07:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.089+0000 7fda6ffff700 1 -- 172.21.15.123:0/1104604498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda70146df0 con 0x7fda70161a80 2024-09-13T17:07:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.089+0000 7fda677fe700 1 -- 172.21.15.123:0/1104604498 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda680036c0 con 0x7fda70161a80 2024-09-13T17:07:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.089+0000 7fda6ffff700 1 -- 172.21.15.123:0/1104604498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda700677f0 con 0x7fda70161a80 2024-09-13T17:07:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.089+0000 7fda677fe700 1 -- 172.21.15.123:0/1104604498 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fda68003820 con 0x7fda70161a80 2024-09-13T17:07:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.089+0000 7fda677fe700 1 --2- 172.21.15.123:0/1104604498 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fda50066730 0x7fda50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.089+0000 7fda677fe700 1 -- 172.21.15.123:0/1104604498 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fda68083c30 con 0x7fda70161a80 2024-09-13T17:07:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.089+0000 7fda6effd700 1 --2- 172.21.15.123:0/1104604498 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fda50066730 0x7fda50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.089+0000 7fda6effd700 1 --2- 172.21.15.123:0/1104604498 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fda50066730 0x7fda50068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fda58005150 tx=0x7fda58007ee0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:31.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.097+0000 7fda677fe700 1 -- 172.21.15.123:0/1104604498 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fda68050ea0 con 0x7fda70161a80 2024-09-13T17:07:31.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.269+0000 7fda6ffff700 1 -- 172.21.15.123:0/1104604498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda70161540 con 0x7fda70161a80 2024-09-13T17:07:31.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.273+0000 7fda677fe700 1 -- 172.21.15.123:0/1104604498 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16803 (secure 0 0 0) 0x7fda680544c0 con 0x7fda70161a80 2024-09-13T17:07:31.275 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:31.275 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:07:30.891158+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:31.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.273+0000 7fda6ffff700 1 -- 172.21.15.123:0/1104604498 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fda50066730 msgr2=0x7fda50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.273+0000 7fda6ffff700 1 --2- 172.21.15.123:0/1104604498 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fda50066730 0x7fda50068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fda58005150 tx=0x7fda58007ee0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.273+0000 7fda6ffff700 1 -- 172.21.15.123:0/1104604498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda70161a80 msgr2=0x7fda70148e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.273+0000 7fda6ffff700 1 --2- 172.21.15.123:0/1104604498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda70161a80 0x7fda70148e20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fda6800c7f0 tx=0x7fda6800cb00 comp rx=0 tx=0).stop 2024-09-13T17:07:31.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.273+0000 7fda6ffff700 1 -- 172.21.15.123:0/1104604498 shutdown_connections 2024-09-13T17:07:31.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.273+0000 7fda6ffff700 1 --2- 172.21.15.123:0/1104604498 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fda50066730 0x7fda50068bf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.273+0000 7fda6ffff700 1 --2- 172.21.15.123:0/1104604498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda70161a80 0x7fda70148e20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.273+0000 7fda6ffff700 1 --2- 172.21.15.123:0/1104604498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda7015ed00 0x7fda701488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.273+0000 7fda6ffff700 1 --2- 172.21.15.123:0/1104604498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda7015e920 0x7fda7015ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.273+0000 7fda6ffff700 1 -- 172.21.15.123:0/1104604498 >> 172.21.15.123:0/1104604498 conn(0x7fda70066150 msgr2=0x7fda70071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:31.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.273+0000 7fda6ffff700 1 -- 172.21.15.123:0/1104604498 shutdown_connections 2024-09-13T17:07:31.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.273+0000 7fda6ffff700 1 -- 172.21.15.123:0/1104604498 wait complete. 2024-09-13T17:07:31.290 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:31.291 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:31.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.401+0000 7f593e268700 1 Processor -- start 2024-09-13T17:07:31.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.401+0000 7f593e268700 1 -- start start 2024-09-13T17:07:31.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593e268700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f593815cfb0 0x7f59380c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593e268700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f59380cb6e0 0x7f59380ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593e268700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59380c9b70 con 0x7f59380c9530 2024-09-13T17:07:31.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593e268700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59380c9970 con 0x7f59380cb6e0 2024-09-13T17:07:31.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593e268700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593815d390 con 0x7f593815cfb0 2024-09-13T17:07:31.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593ca65700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f59380c9530 0x7f59380cafd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49962/0 (socket says 172.21.15.123:49962) 2024-09-13T17:07:31.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593ca65700 1 -- 172.21.15.123:0/2982346830 learned_addr learned my addr 172.21.15.123:0/2982346830 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:31.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593d266700 1 --2- 172.21.15.123:0/2982346830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f593815cfb0 0x7f59380c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593da67700 1 --2- 172.21.15.123:0/2982346830 >> v2:172.21.15.153:3300/0 conn(0x7f59380cb6e0 0x7f59380ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 -- 172.21.15.123:0/2982346830 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663637778 0 0) 0x7f59380c9b70 con 0x7f59380c9530 2024-09-13T17:07:31.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 -- 172.21.15.123:0/2982346830 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59200035d0 con 0x7f59380c9530 2024-09-13T17:07:31.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 -- 172.21.15.123:0/2982346830 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4250764272 0 0) 0x7f59200035d0 con 0x7f59380c9530 2024-09-13T17:07:31.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 -- 172.21.15.123:0/2982346830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f593815cfb0 msgr2=0x7f59380c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:31.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 --2- 172.21.15.123:0/2982346830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f593815cfb0 0x7f59380c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 -- 172.21.15.123:0/2982346830 >> v2:172.21.15.153:3300/0 conn(0x7f59380cb6e0 msgr2=0x7f59380ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:31.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 --2- 172.21.15.123:0/2982346830 >> v2:172.21.15.153:3300/0 conn(0x7f59380cb6e0 0x7f59380ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 -- 172.21.15.123:0/2982346830 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59380c9e50 con 0x7f59380c9530 2024-09-13T17:07:31.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 -- 172.21.15.123:0/2982346830 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f59300019f0 con 0x7f59380c9530 2024-09-13T17:07:31.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 -- 172.21.15.123:0/2982346830 >> v1:172.21.15.123:6789/0 conn(0x7f59380c9530 legacy=0x7f59380cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 --2- 172.21.15.123:0/2982346830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5920003a20 0x7f5920003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 --2- 172.21.15.123:0/2982346830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f593815cfb0 0x7f5920004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 --2- 172.21.15.123:0/2982346830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5920004db0 0x7f5920005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 -- 172.21.15.123:0/2982346830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59380c9970 con 0x7f5920003a20 2024-09-13T17:07:31.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 -- 172.21.15.123:0/2982346830 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593815d390 con 0x7f5920004db0 2024-09-13T17:07:31.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 -- 172.21.15.123:0/2982346830 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592000ba30 con 0x7f593815cfb0 2024-09-13T17:07:31.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593d266700 1 --2- 172.21.15.123:0/2982346830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5920003a20 0x7f5920003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593ca65700 1 --2- 172.21.15.123:0/2982346830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f593815cfb0 0x7f5920004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593da67700 1 --2- 172.21.15.123:0/2982346830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5920004db0 0x7f5920005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593d266700 1 -- 172.21.15.123:0/2982346830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f593815cfb0 msgr2=0x7f5920004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:31.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593d266700 1 --2- 172.21.15.123:0/2982346830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f593815cfb0 0x7f5920004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593d266700 1 -- 172.21.15.123:0/2982346830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5920004db0 msgr2=0x7f5920005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:31.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593d266700 1 --2- 172.21.15.123:0/2982346830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5920004db0 0x7f5920005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593d266700 1 -- 172.21.15.123:0/2982346830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59200035d0 con 0x7f5920003a20 2024-09-13T17:07:31.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593ca65700 1 --2- 172.21.15.123:0/2982346830 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f593815cfb0 0x7f5920004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:31.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593da67700 1 --2- 172.21.15.123:0/2982346830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5920004db0 0x7f5920005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:31.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593d266700 1 --2- 172.21.15.123:0/2982346830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5920003a20 0x7f5920003e40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f592c009b70 tx=0x7f59200058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bc5e4322b3558a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:31.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 -- 172.21.15.123:0/2982346830 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c00e6c0 con 0x7f5920003a20 2024-09-13T17:07:31.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 -- 172.21.15.123:0/2982346830 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c00e820 con 0x7f5920003a20 2024-09-13T17:07:31.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f5937fff700 1 -- 172.21.15.123:0/2982346830 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c00eb90 con 0x7f5920003a20 2024-09-13T17:07:31.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593e268700 1 -- 172.21.15.123:0/2982346830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5920003a20 msgr2=0x7f5920003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593e268700 1 --2- 172.21.15.123:0/2982346830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5920003a20 0x7f5920003e40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f592c009b70 tx=0x7f59200058a0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593da67700 1 -- 172.21.15.123:0/2982346830 reap_dead start 2024-09-13T17:07:31.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593e268700 1 -- 172.21.15.123:0/2982346830 shutdown_connections 2024-09-13T17:07:31.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593e268700 1 -- 172.21.15.123:0/2982346830 >> 172.21.15.123:0/2982346830 conn(0x7f59380b01d0 msgr2=0x7f59380b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:31.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593e268700 1 -- 172.21.15.123:0/2982346830 shutdown_connections 2024-09-13T17:07:31.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.405+0000 7f593e268700 1 -- 172.21.15.123:0/2982346830 wait complete. 2024-09-13T17:07:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593e268700 1 Processor -- start 2024-09-13T17:07:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593e268700 1 -- start start 2024-09-13T17:07:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593e268700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5920003a20 0x7f5938151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593e268700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f59380c7690 0x7f59380b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593e268700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59380c7b10 0x7f593815bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593e268700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59380b2c90 con 0x7f59380c7b10 2024-09-13T17:07:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593e268700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59380b2080 con 0x7f5920003a20 2024-09-13T17:07:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593e268700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59380b2360 con 0x7f59380c7690 2024-09-13T17:07:31.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593da67700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59380c7b10 0x7f593815bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593da67700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59380c7b10 0x7f593815bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49162/0 (socket says 172.21.15.123:49162) 2024-09-13T17:07:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593da67700 1 -- 172.21.15.123:0/2293141982 learned_addr learned my addr 172.21.15.123:0/2293141982 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593ca65700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f59380c7690 0x7f59380b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593d266700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5920003a20 0x7f5938151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593da67700 1 -- 172.21.15.123:0/2293141982 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f59380c7690 msgr2=0x7f59380b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593da67700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f59380c7690 0x7f59380b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593da67700 1 -- 172.21.15.123:0/2293141982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5920003a20 msgr2=0x7f5938151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593da67700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5920003a20 0x7f5938151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593da67700 1 -- 172.21.15.123:0/2293141982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59380b2640 con 0x7f59380c7b10 2024-09-13T17:07:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593d266700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5920003a20 0x7f5938151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593ca65700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f59380c7690 0x7f59380b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.409+0000 7f593da67700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59380c7b10 0x7f593815bb10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f59380c8de0 tx=0x7f5928010b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:31.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.413+0000 7f5935ffb700 1 -- 172.21.15.123:0/2293141982 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928004300 con 0x7f59380c7b10 2024-09-13T17:07:31.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.413+0000 7f5935ffb700 1 -- 172.21.15.123:0/2293141982 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5928004480 con 0x7f59380c7b10 2024-09-13T17:07:31.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.413+0000 7f593e268700 1 -- 172.21.15.123:0/2293141982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59380b2920 con 0x7f59380c7b10 2024-09-13T17:07:31.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.413+0000 7f5935ffb700 1 -- 172.21.15.123:0/2293141982 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928003900 con 0x7f59380c7b10 2024-09-13T17:07:31.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.413+0000 7f593e268700 1 -- 172.21.15.123:0/2293141982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59380b3660 con 0x7f59380c7b10 2024-09-13T17:07:31.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.413+0000 7f593e268700 1 -- 172.21.15.123:0/2293141982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59380caa90 con 0x7f59380c7b10 2024-09-13T17:07:31.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.413+0000 7f5935ffb700 1 -- 172.21.15.123:0/2293141982 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5928003a60 con 0x7f59380c7b10 2024-09-13T17:07:31.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.417+0000 7f5935ffb700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5924066730 0x7f5924068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.417+0000 7f5935ffb700 1 -- 172.21.15.123:0/2293141982 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5928083e40 con 0x7f59380c7b10 2024-09-13T17:07:31.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.417+0000 7f593d266700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5924066730 0x7f5924068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.417+0000 7f593d266700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5924066730 0x7f5924068bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f592c0090b0 tx=0x7f592c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.421+0000 7f5935ffb700 1 -- 172.21.15.123:0/2293141982 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f59280511c0 con 0x7f59380c7b10 2024-09-13T17:07:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.589+0000 7f593e268700 1 -- 172.21.15.123:0/2293141982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59380c8ff0 con 0x7f59380c7b10 2024-09-13T17:07:31.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.593+0000 7f5935ffb700 1 -- 172.21.15.123:0/2293141982 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59280547e0 con 0x7f59380c7b10 2024-09-13T17:07:31.594 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:31.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.593+0000 7f593e268700 1 -- 172.21.15.123:0/2293141982 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5924066730 msgr2=0x7f5924068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.593+0000 7f593e268700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5924066730 0x7f5924068bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f592c0090b0 tx=0x7f592c008030 comp rx=0 tx=0).stop 2024-09-13T17:07:31.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.593+0000 7f593e268700 1 -- 172.21.15.123:0/2293141982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59380c7b10 msgr2=0x7f593815bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.593+0000 7f593e268700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59380c7b10 0x7f593815bb10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f59380c8de0 tx=0x7f5928010b80 comp rx=0 tx=0).stop 2024-09-13T17:07:31.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.593+0000 7f593e268700 1 -- 172.21.15.123:0/2293141982 shutdown_connections 2024-09-13T17:07:31.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.593+0000 7f593e268700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5924066730 0x7f5924068bf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.593+0000 7f593e268700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59380c7b10 0x7f593815bb10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.593+0000 7f593e268700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f59380c7690 0x7f59380b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.593+0000 7f593e268700 1 --2- 172.21.15.123:0/2293141982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5920003a20 0x7f5938151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.593+0000 7f593e268700 1 -- 172.21.15.123:0/2293141982 >> 172.21.15.123:0/2293141982 conn(0x7f59380b01d0 msgr2=0x7f5938070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:31.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.593+0000 7f593e268700 1 -- 172.21.15.123:0/2293141982 shutdown_connections 2024-09-13T17:07:31.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.593+0000 7f593e268700 1 -- 172.21.15.123:0/2293141982 wait complete. 2024-09-13T17:07:31.609 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:07:31.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.729+0000 7f431288e700 1 Processor -- start 2024-09-13T17:07:31.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.729+0000 7f431288e700 1 -- start start 2024-09-13T17:07:31.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431288e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f430c0cc6e0 0x7f430c0cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431288e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f430c0d08e0 0x7f430c0d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431288e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430c0cc250 con 0x7f430c15ceb0 2024-09-13T17:07:31.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431288e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c0d12b0 con 0x7f430c0d08e0 2024-09-13T17:07:31.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431288e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c0cb960 con 0x7f430c0cc6e0 2024-09-13T17:07:31.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431188c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f430c15ceb0 0x7f430c06c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49966/0 (socket says 172.21.15.123:49966) 2024-09-13T17:07:31.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431208d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f430c0d08e0 0x7f430c0d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431188c700 1 -- 172.21.15.123:0/2369073796 learned_addr learned my addr 172.21.15.123:0/2369073796 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:31.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431108b700 1 --2- 172.21.15.123:0/2369073796 >> v2:172.21.15.153:3300/0 conn(0x7f430c0cc6e0 0x7f430c0cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431088a700 1 -- 172.21.15.123:0/2369073796 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890942962 0 0) 0x7f430c0cc250 con 0x7f430c15ceb0 2024-09-13T17:07:31.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431088a700 1 -- 172.21.15.123:0/2369073796 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42f80035d0 con 0x7f430c15ceb0 2024-09-13T17:07:31.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431208d700 1 -- 172.21.15.123:0/2369073796 >> v2:172.21.15.153:3300/0 conn(0x7f430c0cc6e0 msgr2=0x7f430c0cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:31.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431208d700 1 --2- 172.21.15.123:0/2369073796 >> v2:172.21.15.153:3300/0 conn(0x7f430c0cc6e0 0x7f430c0cfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431208d700 1 -- 172.21.15.123:0/2369073796 >> v1:172.21.15.123:6789/0 conn(0x7f430c15ceb0 legacy=0x7f430c06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431208d700 1 -- 172.21.15.123:0/2369073796 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c0d0560 con 0x7f430c0d08e0 2024-09-13T17:07:31.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431208d700 1 --2- 172.21.15.123:0/2369073796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430c0d08e0 0x7f430c0d0d70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f430c0caf50 tx=0x7f430400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff4548403e100b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:31.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431088a700 1 -- 172.21.15.123:0/2369073796 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430400e070 con 0x7f430c0d08e0 2024-09-13T17:07:31.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431088a700 1 -- 172.21.15.123:0/2369073796 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430400bb20 con 0x7f430c0d08e0 2024-09-13T17:07:31.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431088a700 1 -- 172.21.15.123:0/2369073796 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304012430 con 0x7f430c0d08e0 2024-09-13T17:07:31.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431288e700 1 -- 172.21.15.123:0/2369073796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430c0d08e0 msgr2=0x7f430c0d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431288e700 1 --2- 172.21.15.123:0/2369073796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430c0d08e0 0x7f430c0d0d70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f430c0caf50 tx=0x7f430400b330 comp rx=0 tx=0).stop 2024-09-13T17:07:31.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431288e700 1 -- 172.21.15.123:0/2369073796 shutdown_connections 2024-09-13T17:07:31.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431288e700 1 --2- 172.21.15.123:0/2369073796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430c0d08e0 0x7f430c0d0d70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.733+0000 7f431288e700 1 --2- 172.21.15.123:0/2369073796 >> v2:172.21.15.153:3300/0 conn(0x7f430c0cc6e0 0x7f430c0cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.737+0000 7f431288e700 1 -- 172.21.15.123:0/2369073796 >> 172.21.15.123:0/2369073796 conn(0x7f430c06e090 msgr2=0x7f430c06e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:31.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.737+0000 7f431288e700 1 -- 172.21.15.123:0/2369073796 shutdown_connections 2024-09-13T17:07:31.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.737+0000 7f431288e700 1 -- 172.21.15.123:0/2369073796 wait complete. 2024-09-13T17:07:31.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.737+0000 7f431288e700 1 Processor -- start 2024-09-13T17:07:31.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.737+0000 7f431288e700 1 -- start start 2024-09-13T17:07:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431288e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f430c0cc6e0 0x7f430c15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431288e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430c0d08e0 0x7f430c0c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431288e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c15ceb0 0x7f430c0b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431288e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c0b4270 con 0x7f430c0d08e0 2024-09-13T17:07:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431288e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c15a7c0 con 0x7f430c15ceb0 2024-09-13T17:07:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431288e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c0c54d0 con 0x7f430c0cc6e0 2024-09-13T17:07:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431108b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430c0d08e0 0x7f430c0c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431108b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430c0d08e0 0x7f430c0c4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49180/0 (socket says 172.21.15.123:49180) 2024-09-13T17:07:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431108b700 1 -- 172.21.15.123:0/1280567236 learned_addr learned my addr 172.21.15.123:0/1280567236 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431188c700 1 --2- 172.21.15.123:0/1280567236 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f430c0cc6e0 0x7f430c15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431108b700 1 -- 172.21.15.123:0/1280567236 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f430c0cc6e0 msgr2=0x7f430c15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431108b700 1 --2- 172.21.15.123:0/1280567236 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f430c0cc6e0 0x7f430c15a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431108b700 1 -- 172.21.15.123:0/1280567236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c15ceb0 msgr2=0x7f430c0b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431208d700 1 --2- 172.21.15.123:0/1280567236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c15ceb0 0x7f430c0b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431108b700 1 --2- 172.21.15.123:0/1280567236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c15ceb0 0x7f430c0b5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431108b700 1 -- 172.21.15.123:0/1280567236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4304009a70 con 0x7f430c0d08e0 2024-09-13T17:07:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431108b700 1 --2- 172.21.15.123:0/1280567236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430c0d08e0 0x7f430c0c4f90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f430000e9d0 tx=0x7f430000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f42fe7fc700 1 -- 172.21.15.123:0/1280567236 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300009720 con 0x7f430c0d08e0 2024-09-13T17:07:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f42fe7fc700 1 -- 172.21.15.123:0/1280567236 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430000c7f0 con 0x7f430c0d08e0 2024-09-13T17:07:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f42fe7fc700 1 -- 172.21.15.123:0/1280567236 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000cb60 con 0x7f430c0d08e0 2024-09-13T17:07:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431288e700 1 -- 172.21.15.123:0/1280567236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430c15d410 con 0x7f430c0d08e0 2024-09-13T17:07:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431288e700 1 -- 172.21.15.123:0/1280567236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c0b3bb0 con 0x7f430c0d08e0 2024-09-13T17:07:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f431288e700 1 -- 172.21.15.123:0/1280567236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430c072520 con 0x7f430c0d08e0 2024-09-13T17:07:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.741+0000 7f42fe7fc700 1 -- 172.21.15.123:0/1280567236 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f430000ccc0 con 0x7f430c0d08e0 2024-09-13T17:07:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.745+0000 7f42fe7fc700 1 --2- 172.21.15.123:0/1280567236 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f42f0066730 0x7f42f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.745+0000 7f42fe7fc700 1 -- 172.21.15.123:0/1280567236 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f43000842f0 con 0x7f430c0d08e0 2024-09-13T17:07:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.745+0000 7f431188c700 1 --2- 172.21.15.123:0/1280567236 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f42f0066730 0x7f42f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.745+0000 7f431188c700 1 --2- 172.21.15.123:0/1280567236 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f42f0066730 0x7f42f0068bf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f43080011e0 tx=0x7f4308009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:31.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.753+0000 7f42fe7fc700 1 -- 172.21.15.123:0/1280567236 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f43000515e0 con 0x7f430c0d08e0 2024-09-13T17:07:31.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.921+0000 7f431288e700 1 -- 172.21.15.123:0/1280567236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f430c0cfef0 con 0x7f430c0d08e0 2024-09-13T17:07:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:07:31.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.921+0000 7f42fe7fc700 1 -- 172.21.15.123:0/1280567236 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4300054c00 con 0x7f430c0d08e0 2024-09-13T17:07:31.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.925+0000 7f431288e700 1 -- 172.21.15.123:0/1280567236 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f42f0066730 msgr2=0x7f42f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.925+0000 7f431288e700 1 --2- 172.21.15.123:0/1280567236 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f42f0066730 0x7f42f0068bf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f43080011e0 tx=0x7f4308009040 comp rx=0 tx=0).stop 2024-09-13T17:07:31.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.925+0000 7f431288e700 1 -- 172.21.15.123:0/1280567236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430c0d08e0 msgr2=0x7f430c0c4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:31.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.925+0000 7f431288e700 1 --2- 172.21.15.123:0/1280567236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430c0d08e0 0x7f430c0c4f90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f430000e9d0 tx=0x7f430000ed90 comp rx=0 tx=0).stop 2024-09-13T17:07:31.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.925+0000 7f431288e700 1 -- 172.21.15.123:0/1280567236 shutdown_connections 2024-09-13T17:07:31.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.925+0000 7f431288e700 1 --2- 172.21.15.123:0/1280567236 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f42f0066730 0x7f42f0068bf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.925+0000 7f431288e700 1 --2- 172.21.15.123:0/1280567236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c15ceb0 0x7f430c0b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.925+0000 7f431288e700 1 --2- 172.21.15.123:0/1280567236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430c0d08e0 0x7f430c0c4f90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.925+0000 7f431288e700 1 --2- 172.21.15.123:0/1280567236 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f430c0cc6e0 0x7f430c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:31.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.925+0000 7f431288e700 1 -- 172.21.15.123:0/1280567236 >> 172.21.15.123:0/1280567236 conn(0x7f430c06e090 msgr2=0x7f430c0718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:31.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.925+0000 7f431288e700 1 -- 172.21.15.123:0/1280567236 shutdown_connections 2024-09-13T17:07:31.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:31.925+0000 7f431288e700 1 -- 172.21.15.123:0/1280567236 wait complete. 2024-09-13T17:07:31.938 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:07:32.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.045+0000 7f8d7f0c6700 1 Processor -- start 2024-09-13T17:07:32.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.045+0000 7f8d7f0c6700 1 -- start start 2024-09-13T17:07:32.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d780d0f40 0x7f8d780d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d780b58b0 0x7f8d780d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8d780b1100 0x7f8d780b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d780b0060 con 0x7f8d780b58b0 2024-09-13T17:07:32.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d780b0340 con 0x7f8d780b1100 2024-09-13T17:07:32.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780b0620 con 0x7f8d780d0f40 2024-09-13T17:07:32.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7d8c3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d780b58b0 0x7f8d780d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7d8c3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d780b58b0 0x7f8d780d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46166/0 (socket says 172.21.15.123:46166) 2024-09-13T17:07:32.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7d8c3700 1 -- 172.21.15.123:0/3870973459 learned_addr learned my addr 172.21.15.123:0/3870973459 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:32.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7e8c5700 1 --2- 172.21.15.123:0/3870973459 >> v2:172.21.15.153:3300/0 conn(0x7f8d780b1100 0x7f8d780b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7e0c4700 1 --2- 172.21.15.123:0/3870973459 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d780d0f40 0x7f8d780d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7d8c3700 1 -- 172.21.15.123:0/3870973459 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d780d0f40 msgr2=0x7f8d780d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:32.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7d8c3700 1 --2- 172.21.15.123:0/3870973459 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d780d0f40 0x7f8d780d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7d8c3700 1 -- 172.21.15.123:0/3870973459 >> v2:172.21.15.153:3300/0 conn(0x7f8d780b1100 msgr2=0x7f8d780b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:32.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7d8c3700 1 --2- 172.21.15.123:0/3870973459 >> v2:172.21.15.153:3300/0 conn(0x7f8d780b1100 0x7f8d780b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7d8c3700 1 -- 172.21.15.123:0/3870973459 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d780b0900 con 0x7f8d780b58b0 2024-09-13T17:07:32.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7d8c3700 1 --2- 172.21.15.123:0/3870973459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d780b58b0 0x7f8d780d05a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8d780d28f0 tx=0x7f8d74009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fadc4ff140a129 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:32.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7d0c2700 1 -- 172.21.15.123:0/3870973459 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74011830 con 0x7f8d780b58b0 2024-09-13T17:07:32.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7d0c2700 1 -- 172.21.15.123:0/3870973459 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d74011990 con 0x7f8d780b58b0 2024-09-13T17:07:32.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7d0c2700 1 -- 172.21.15.123:0/3870973459 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74011d20 con 0x7f8d780b58b0 2024-09-13T17:07:32.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/3870973459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d780b58b0 msgr2=0x7f8d780d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 --2- 172.21.15.123:0/3870973459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d780b58b0 0x7f8d780d05a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8d780d28f0 tx=0x7f8d74009bf0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/3870973459 shutdown_connections 2024-09-13T17:07:32.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 --2- 172.21.15.123:0/3870973459 >> v2:172.21.15.153:3300/0 conn(0x7f8d780b1100 0x7f8d780b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 --2- 172.21.15.123:0/3870973459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d780b58b0 0x7f8d780d05a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 --2- 172.21.15.123:0/3870973459 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d780d0f40 0x7f8d780d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/3870973459 >> 172.21.15.123:0/3870973459 conn(0x7f8d780d2a60 msgr2=0x7f8d780d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:32.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/3870973459 shutdown_connections 2024-09-13T17:07:32.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.049+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/3870973459 wait complete. 2024-09-13T17:07:32.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7f0c6700 1 Processor -- start 2024-09-13T17:07:32.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7f0c6700 1 -- start start 2024-09-13T17:07:32.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7f0c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d780b1100 0x7f8d78150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7f0c6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d780b58b0 0x7f8d7815d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7f0c6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d780d0f40 0x7f8d7815ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7f0c6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780b2b70 con 0x7f8d780b1100 2024-09-13T17:07:32.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7f0c6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78150540 con 0x7f8d780d0f40 2024-09-13T17:07:32.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7f0c6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780b2860 con 0x7f8d780b58b0 2024-09-13T17:07:32.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7e0c4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d780b1100 0x7f8d78150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7e0c4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d780b1100 0x7f8d78150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46170/0 (socket says 172.21.15.123:46170) 2024-09-13T17:07:32.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7e0c4700 1 -- 172.21.15.123:0/1446751061 learned_addr learned my addr 172.21.15.123:0/1446751061 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:32.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7d8c3700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d780b58b0 0x7f8d7815d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7e8c5700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d780d0f40 0x7f8d7815ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7e0c4700 1 -- 172.21.15.123:0/1446751061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d780b58b0 msgr2=0x7f8d7815d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7e0c4700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d780b58b0 0x7f8d7815d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7e0c4700 1 -- 172.21.15.123:0/1446751061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d780d0f40 msgr2=0x7f8d7815ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7e0c4700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d780d0f40 0x7f8d7815ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7e0c4700 1 -- 172.21.15.123:0/1446751061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74009570 con 0x7f8d780b1100 2024-09-13T17:07:32.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7d8c3700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d780b58b0 0x7f8d7815d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:32.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.053+0000 7f8d7e0c4700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d780b1100 0x7f8d78150000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00d800 tx=0x7f8d6c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:32.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.057+0000 7f8d6affd700 1 -- 172.21.15.123:0/1446751061 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0125f0 con 0x7f8d780b1100 2024-09-13T17:07:32.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.057+0000 7f8d6affd700 1 -- 172.21.15.123:0/1446751061 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c012750 con 0x7f8d780b1100 2024-09-13T17:07:32.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.057+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/1446751061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7815fb70 con 0x7f8d780b1100 2024-09-13T17:07:32.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.057+0000 7f8d6affd700 1 -- 172.21.15.123:0/1446751061 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c012ac0 con 0x7f8d780b1100 2024-09-13T17:07:32.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.057+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/1446751061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d78160130 con 0x7f8d780b1100 2024-09-13T17:07:32.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.057+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/1446751061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d781602f0 con 0x7f8d780b1100 2024-09-13T17:07:32.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.057+0000 7f8d6affd700 1 -- 172.21.15.123:0/1446751061 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8d6c012c20 con 0x7f8d780b1100 2024-09-13T17:07:32.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.057+0000 7f8d6affd700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8d5c066760 0x7f8d5c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.057+0000 7f8d7d8c3700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8d5c066760 0x7f8d5c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.057+0000 7f8d6affd700 1 -- 172.21.15.123:0/1446751061 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8d6c084180 con 0x7f8d780b1100 2024-09-13T17:07:32.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.061+0000 7f8d7d8c3700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8d5c066760 0x7f8d5c068c20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8d780b5c90 tx=0x7f8d74008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:32.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.065+0000 7f8d6affd700 1 -- 172.21.15.123:0/1446751061 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8d6c051530 con 0x7f8d780b1100 2024-09-13T17:07:32.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.237+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/1446751061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8d7815ce70 con 0x7f8d780b1100 2024-09-13T17:07:32.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.237+0000 7f8d6affd700 1 -- 172.21.15.123:0/1446751061 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8d6c054b50 con 0x7f8d780b1100 2024-09-13T17:07:32.239 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:07:32.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.237+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/1446751061 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8d5c066760 msgr2=0x7f8d5c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.237+0000 7f8d7f0c6700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8d5c066760 0x7f8d5c068c20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8d780b5c90 tx=0x7f8d74008030 comp rx=0 tx=0).stop 2024-09-13T17:07:32.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.237+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/1446751061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d780b1100 msgr2=0x7f8d78150000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.237+0000 7f8d7f0c6700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d780b1100 0x7f8d78150000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00d800 tx=0x7f8d6c00db10 comp rx=0 tx=0).stop 2024-09-13T17:07:32.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.237+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/1446751061 shutdown_connections 2024-09-13T17:07:32.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.237+0000 7f8d7f0c6700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8d5c066760 0x7f8d5c068c20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.237+0000 7f8d7f0c6700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d780d0f40 0x7f8d7815ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.237+0000 7f8d7f0c6700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8d780b58b0 0x7f8d7815d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.237+0000 7f8d7f0c6700 1 --2- 172.21.15.123:0/1446751061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d780b1100 0x7f8d78150000 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.237+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/1446751061 >> 172.21.15.123:0/1446751061 conn(0x7f8d780d2a60 msgr2=0x7f8d780cca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:32.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.241+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/1446751061 shutdown_connections 2024-09-13T17:07:32.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.241+0000 7f8d7f0c6700 1 -- 172.21.15.123:0/1446751061 wait complete. 2024-09-13T17:07:32.254 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:07:32.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d32b3700 1 Processor -- start 2024-09-13T17:07:32.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d32b3700 1 -- start start 2024-09-13T17:07:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d32b3700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11cc0cb090 0x7f11cc0c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d32b3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f11cc0c1280 0x7f11cc0c1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d32b3700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11cc0c93b0 con 0x7f11cc0ca950 2024-09-13T17:07:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d32b3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11cc0cc580 con 0x7f11cc0c1280 2024-09-13T17:07:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d32b3700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc0cd100 con 0x7f11cc0cb090 2024-09-13T17:07:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d2ab2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f11cc0c1280 0x7f11cc0c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d2ab2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f11cc0c1280 0x7f11cc0c1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46184/0 (socket says 172.21.15.123:46184) 2024-09-13T17:07:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d2ab2700 1 -- 172.21.15.123:0/2077989400 learned_addr learned my addr 172.21.15.123:0/2077989400 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:32.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d22b1700 1 --2- 172.21.15.123:0/2077989400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11cc0cb090 0x7f11cc0c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d2ab2700 1 -- 172.21.15.123:0/2077989400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11cc0cb090 msgr2=0x7f11cc0c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:32.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d2ab2700 1 --2- 172.21.15.123:0/2077989400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11cc0cb090 0x7f11cc0c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d2ab2700 1 -- 172.21.15.123:0/2077989400 >> v1:172.21.15.153:6789/0 conn(0x7f11cc0ca950 legacy=0x7f11cc0cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d2ab2700 1 -- 172.21.15.123:0/2077989400 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc1617b0 con 0x7f11cc0c1280 2024-09-13T17:07:32.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d2ab2700 1 --2- 172.21.15.123:0/2077989400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11cc0c1280 0x7f11cc0c1730 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009910 tx=0x7f11c8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5966db2f7a11632 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:32.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d12af700 1 -- 172.21.15.123:0/2077989400 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8011830 con 0x7f11cc0c1280 2024-09-13T17:07:32.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d12af700 1 -- 172.21.15.123:0/2077989400 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c8011990 con 0x7f11cc0c1280 2024-09-13T17:07:32.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d12af700 1 -- 172.21.15.123:0/2077989400 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8011d40 con 0x7f11cc0c1280 2024-09-13T17:07:32.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d32b3700 1 -- 172.21.15.123:0/2077989400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11cc0c1280 msgr2=0x7f11cc0c1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d32b3700 1 --2- 172.21.15.123:0/2077989400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11cc0c1280 0x7f11cc0c1730 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009910 tx=0x7f11c8009c20 comp rx=0 tx=0).stop 2024-09-13T17:07:32.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d32b3700 1 -- 172.21.15.123:0/2077989400 shutdown_connections 2024-09-13T17:07:32.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d32b3700 1 --2- 172.21.15.123:0/2077989400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11cc0c1280 0x7f11cc0c1730 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d32b3700 1 --2- 172.21.15.123:0/2077989400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11cc0cb090 0x7f11cc0c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.369+0000 7f11d32b3700 1 -- 172.21.15.123:0/2077989400 >> 172.21.15.123:0/2077989400 conn(0x7f11cc0b01d0 msgr2=0x7f11cc0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:32.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d32b3700 1 -- 172.21.15.123:0/2077989400 shutdown_connections 2024-09-13T17:07:32.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d32b3700 1 -- 172.21.15.123:0/2077989400 wait complete. 2024-09-13T17:07:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d32b3700 1 Processor -- start 2024-09-13T17:07:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d32b3700 1 -- start start 2024-09-13T17:07:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d32b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11cc0c1280 0x7f11cc0b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d32b3700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11cc0ca950 0x7f11cc14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d32b3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11cc0cb090 0x7f11cc15b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d32b3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc0c85b0 con 0x7f11cc0c1280 2024-09-13T17:07:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d32b3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc0b4420 con 0x7f11cc0cb090 2024-09-13T17:07:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d32b3700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc0c6d60 con 0x7f11cc0ca950 2024-09-13T17:07:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d22b1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11cc0c1280 0x7f11cc0b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d22b1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11cc0c1280 0x7f11cc0b3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46200/0 (socket says 172.21.15.123:46200) 2024-09-13T17:07:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d22b1700 1 -- 172.21.15.123:0/3947177630 learned_addr learned my addr 172.21.15.123:0/3947177630 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d2ab2700 1 --2- 172.21.15.123:0/3947177630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11cc0cb090 0x7f11cc15b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d1ab0700 1 --2- 172.21.15.123:0/3947177630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11cc0ca950 0x7f11cc14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d22b1700 1 -- 172.21.15.123:0/3947177630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11cc0ca950 msgr2=0x7f11cc14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d22b1700 1 --2- 172.21.15.123:0/3947177630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11cc0ca950 0x7f11cc14fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d22b1700 1 -- 172.21.15.123:0/3947177630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11cc0cb090 msgr2=0x7f11cc15b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d22b1700 1 --2- 172.21.15.123:0/3947177630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11cc0cb090 0x7f11cc15b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d22b1700 1 -- 172.21.15.123:0/3947177630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c8009570 con 0x7f11cc0c1280 2024-09-13T17:07:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d22b1700 1 --2- 172.21.15.123:0/3947177630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11cc0c1280 0x7f11cc0b3ee0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f11c400efc0 tx=0x7f11c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11beffd700 1 -- 172.21.15.123:0/3947177630 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c400cd10 con 0x7f11cc0c1280 2024-09-13T17:07:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11beffd700 1 -- 172.21.15.123:0/3947177630 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c400f040 con 0x7f11cc0c1280 2024-09-13T17:07:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d32b3700 1 -- 172.21.15.123:0/3947177630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11cc0b1530 con 0x7f11cc0c1280 2024-09-13T17:07:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11beffd700 1 -- 172.21.15.123:0/3947177630 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c40146a0 con 0x7f11cc0c1280 2024-09-13T17:07:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.373+0000 7f11d32b3700 1 -- 172.21.15.123:0/3947177630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11cc0b1d70 con 0x7f11cc0c1280 2024-09-13T17:07:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.377+0000 7f11d32b3700 1 -- 172.21.15.123:0/3947177630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11cc0b1710 con 0x7f11cc0c1280 2024-09-13T17:07:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.377+0000 7f11beffd700 1 -- 172.21.15.123:0/3947177630 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f11c4014800 con 0x7f11cc0c1280 2024-09-13T17:07:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.377+0000 7f11beffd700 1 --2- 172.21.15.123:0/3947177630 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f11b0066760 0x7f11b0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.377+0000 7f11beffd700 1 -- 172.21.15.123:0/3947177630 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f11c4084b50 con 0x7f11cc0c1280 2024-09-13T17:07:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.377+0000 7f11d1ab0700 1 --2- 172.21.15.123:0/3947177630 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f11b0066760 0x7f11b0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.377+0000 7f11d1ab0700 1 --2- 172.21.15.123:0/3947177630 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f11b0066760 0x7f11b0068c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f11cc15d840 tx=0x7f11c0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:32.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.385+0000 7f11beffd700 1 -- 172.21.15.123:0/3947177630 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f11c4051c90 con 0x7f11cc0c1280 2024-09-13T17:07:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.569+0000 7f11d32b3700 1 -- 172.21.15.123:0/3947177630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f11cc06bdb0 con 0x7f11cc0c1280 2024-09-13T17:07:32.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.569+0000 7f11beffd700 1 -- 172.21.15.123:0/3947177630 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f11c40552b0 con 0x7f11cc0c1280 2024-09-13T17:07:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.573+0000 7f11d32b3700 1 -- 172.21.15.123:0/3947177630 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f11b0066760 msgr2=0x7f11b0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.573+0000 7f11d32b3700 1 --2- 172.21.15.123:0/3947177630 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f11b0066760 0x7f11b0068c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f11cc15d840 tx=0x7f11c0009040 comp rx=0 tx=0).stop 2024-09-13T17:07:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.573+0000 7f11d32b3700 1 -- 172.21.15.123:0/3947177630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11cc0c1280 msgr2=0x7f11cc0b3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.573+0000 7f11d32b3700 1 --2- 172.21.15.123:0/3947177630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11cc0c1280 0x7f11cc0b3ee0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f11c400efc0 tx=0x7f11c400c3a0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.573+0000 7f11d32b3700 1 -- 172.21.15.123:0/3947177630 shutdown_connections 2024-09-13T17:07:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.573+0000 7f11d32b3700 1 --2- 172.21.15.123:0/3947177630 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f11b0066760 0x7f11b0068c20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.573+0000 7f11d32b3700 1 --2- 172.21.15.123:0/3947177630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11cc0cb090 0x7f11cc15b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.573+0000 7f11d32b3700 1 --2- 172.21.15.123:0/3947177630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f11cc0ca950 0x7f11cc14fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.573+0000 7f11d32b3700 1 --2- 172.21.15.123:0/3947177630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11cc0c1280 0x7f11cc0b3ee0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.573+0000 7f11d32b3700 1 -- 172.21.15.123:0/3947177630 >> 172.21.15.123:0/3947177630 conn(0x7f11cc0b01d0 msgr2=0x7f11cc070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.573+0000 7f11d32b3700 1 -- 172.21.15.123:0/3947177630 shutdown_connections 2024-09-13T17:07:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.573+0000 7f11d32b3700 1 -- 172.21.15.123:0/3947177630 wait complete. 2024-09-13T17:07:32.576 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:07:32.594 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-09-13T17:07:32.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:32.594 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-13T17:07:32.611 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:07:32.611 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:07:32.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:32.611 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:07:32.658 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T17:07:32.659 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:07:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.773+0000 7f7411289700 1 Processor -- start 2024-09-13T17:07:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.773+0000 7f7411289700 1 -- start start 2024-09-13T17:07:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.773+0000 7f7411289700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f740400acc0 0x7f74040e3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.773+0000 7f7411289700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74040507a0 0x7f74040de2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.773+0000 7f7411289700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7404005d80 con 0x7f7404033990 2024-09-13T17:07:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.773+0000 7f7411289700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740404f9e0 con 0x7f740400acc0 2024-09-13T17:07:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.773+0000 7f7411289700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740404fcc0 con 0x7f74040507a0 2024-09-13T17:07:32.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.773+0000 7f7410a88700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74040507a0 0x7f74040de2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.773+0000 7f740b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f740400acc0 0x7f74040e3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.773+0000 7f740bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7404033990 0x7f740400a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:43374/0 (socket says 172.21.15.123:43374) 2024-09-13T17:07:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.773+0000 7f740bfff700 1 -- 172.21.15.123:0/3011568267 learned_addr learned my addr 172.21.15.123:0/3011568267 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f7410a88700 1 -- 172.21.15.123:0/3011568267 >> v2:172.21.15.153:3300/0 conn(0x7f740400acc0 msgr2=0x7f74040e3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f7410a88700 1 --2- 172.21.15.123:0/3011568267 >> v2:172.21.15.153:3300/0 conn(0x7f740400acc0 0x7f74040e3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f7410a88700 1 -- 172.21.15.123:0/3011568267 >> v1:172.21.15.153:6789/0 conn(0x7f7404033990 legacy=0x7f740400a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f7410a88700 1 -- 172.21.15.123:0/3011568267 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740404ffa0 con 0x7f74040507a0 2024-09-13T17:07:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f7410a88700 1 --2- 172.21.15.123:0/3011568267 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74040507a0 0x7f74040de2a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f740c000b60 tx=0x7f740c069900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38860ecef054f21d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f740affd700 1 -- 172.21.15.123:0/3011568267 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c0675b0 con 0x7f74040507a0 2024-09-13T17:07:32.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f740affd700 1 -- 172.21.15.123:0/3011568267 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c073f10 con 0x7f74040507a0 2024-09-13T17:07:32.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f740affd700 1 -- 172.21.15.123:0/3011568267 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c067710 con 0x7f74040507a0 2024-09-13T17:07:32.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f7411289700 1 -- 172.21.15.123:0/3011568267 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74040507a0 msgr2=0x7f74040de2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f7411289700 1 --2- 172.21.15.123:0/3011568267 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74040507a0 0x7f74040de2a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f740c000b60 tx=0x7f740c069900 comp rx=0 tx=0).stop 2024-09-13T17:07:32.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f7411289700 1 -- 172.21.15.123:0/3011568267 shutdown_connections 2024-09-13T17:07:32.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f7411289700 1 --2- 172.21.15.123:0/3011568267 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74040507a0 0x7f74040de2a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f7411289700 1 --2- 172.21.15.123:0/3011568267 >> v2:172.21.15.153:3300/0 conn(0x7f740400acc0 0x7f74040e3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f7411289700 1 -- 172.21.15.123:0/3011568267 >> 172.21.15.123:0/3011568267 conn(0x7f7404036140 msgr2=0x7f7404036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:32.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f7411289700 1 -- 172.21.15.123:0/3011568267 shutdown_connections 2024-09-13T17:07:32.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.777+0000 7f7411289700 1 -- 172.21.15.123:0/3011568267 wait complete. 2024-09-13T17:07:32.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.781+0000 7f7411289700 1 Processor -- start 2024-09-13T17:07:32.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.781+0000 7f7411289700 1 -- start start 2024-09-13T17:07:32.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.781+0000 7f7411289700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f740400acc0 0x7f740404d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.781+0000 7f7411289700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7404033990 0x7f740404aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.781+0000 7f7411289700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74040507a0 0x7f74040067f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.781+0000 7f7411289700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74040489a0 con 0x7f740400acc0 2024-09-13T17:07:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.781+0000 7f7411289700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74040d4650 con 0x7f74040507a0 2024-09-13T17:07:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.781+0000 7f7411289700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740404d1b0 con 0x7f7404033990 2024-09-13T17:07:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.781+0000 7f740bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f740400acc0 0x7f740404d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.781+0000 7f740bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f740400acc0 0x7f740404d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46204/0 (socket says 172.21.15.123:46204) 2024-09-13T17:07:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.781+0000 7f740bfff700 1 -- 172.21.15.123:0/2930870704 learned_addr learned my addr 172.21.15.123:0/2930870704 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.781+0000 7f740b7fe700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7404033990 0x7f740404aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f7410a88700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74040507a0 0x7f74040067f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f740bfff700 1 -- 172.21.15.123:0/2930870704 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7404033990 msgr2=0x7f740404aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f740bfff700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7404033990 0x7f740404aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f740bfff700 1 -- 172.21.15.123:0/2930870704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74040507a0 msgr2=0x7f74040067f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f740bfff700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74040507a0 0x7f74040067f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f740bfff700 1 -- 172.21.15.123:0/2930870704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c04f5c0 con 0x7f740400acc0 2024-09-13T17:07:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f740b7fe700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7404033990 0x7f740404aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f7410a88700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74040507a0 0x7f74040067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f740bfff700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f740400acc0 0x7f740404d610 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f740000e940 tx=0x7f740000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f7408ff9700 1 -- 172.21.15.123:0/2930870704 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400005de0 con 0x7f740400acc0 2024-09-13T17:07:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f7408ff9700 1 -- 172.21.15.123:0/2930870704 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740000ee20 con 0x7f740400acc0 2024-09-13T17:07:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f7408ff9700 1 -- 172.21.15.123:0/2930870704 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000018e0 con 0x7f740400acc0 2024-09-13T17:07:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f7411289700 1 -- 172.21.15.123:0/2930870704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740404af90 con 0x7f740400acc0 2024-09-13T17:07:32.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f7411289700 1 -- 172.21.15.123:0/2930870704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740404bee0 con 0x7f740400acc0 2024-09-13T17:07:32.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f7411289700 1 -- 172.21.15.123:0/2930870704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7404048700 con 0x7f740400acc0 2024-09-13T17:07:32.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f7408ff9700 1 -- 172.21.15.123:0/2930870704 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7400001a40 con 0x7f740400acc0 2024-09-13T17:07:32.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f7408ff9700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f73f0066730 0x7f73f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:32.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f7408ff9700 1 -- 172.21.15.123:0/2930870704 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7400086510 con 0x7f740400acc0 2024-09-13T17:07:32.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.785+0000 7f740b7fe700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f73f0066730 0x7f73f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:32.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.789+0000 7f740b7fe700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f73f0066730 0x7f73f0068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7404177e70 tx=0x7f73f8008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:32.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:32.797+0000 7f7408ff9700 1 -- 172.21.15.123:0/2930870704 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7404048700 con 0x7f740400acc0 2024-09-13T17:07:33.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.001+0000 7f7411289700 1 -- 172.21.15.123:0/2930870704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7404048700 con 0x7f740400acc0 2024-09-13T17:07:33.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.001+0000 7f7408ff9700 1 -- 172.21.15.123:0/2930870704 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7f7404048700 con 0x7f740400acc0 2024-09-13T17:07:33.003 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:33.004 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/721071800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":721071800},{"type":"v1","addr":"172.21.15.123:6835","nonce":721071800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1472515409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1472515409},{"type":"v1","addr":"172.21.15.123:6837","nonce":1472515409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3017694841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3017694841},{"type":"v1","addr":"172.21.15.153:6833","nonce":3017694841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:06:48.418287+0000","modified":"2024-09-13T17:06:51.426119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/2848393496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2848393496},{"type":"v1","addr":"172.21.15.153:6835","nonce":2848393496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:07:33.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.001+0000 7f7411289700 1 -- 172.21.15.123:0/2930870704 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f73f0066730 msgr2=0x7f73f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.001+0000 7f7411289700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f73f0066730 0x7f73f0068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7404177e70 tx=0x7f73f8008040 comp rx=0 tx=0).stop 2024-09-13T17:07:33.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.001+0000 7f7411289700 1 -- 172.21.15.123:0/2930870704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f740400acc0 msgr2=0x7f740404d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.001+0000 7f7411289700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f740400acc0 0x7f740404d610 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f740000e940 tx=0x7f740000ed00 comp rx=0 tx=0).stop 2024-09-13T17:07:33.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.001+0000 7f7411289700 1 -- 172.21.15.123:0/2930870704 shutdown_connections 2024-09-13T17:07:33.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.001+0000 7f7411289700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f73f0066730 0x7f73f0068bf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.001+0000 7f7411289700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74040507a0 0x7f74040067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.001+0000 7f7411289700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7404033990 0x7f740404aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.001+0000 7f7411289700 1 --2- 172.21.15.123:0/2930870704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f740400acc0 0x7f740404d610 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.001+0000 7f7411289700 1 -- 172.21.15.123:0/2930870704 >> 172.21.15.123:0/2930870704 conn(0x7f7404036140 msgr2=0x7f740401c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:33.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.005+0000 7f7411289700 1 -- 172.21.15.123:0/2930870704 shutdown_connections 2024-09-13T17:07:33.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.005+0000 7f7411289700 1 -- 172.21.15.123:0/2930870704 wait complete. 2024-09-13T17:07:33.007 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 7 2024-09-13T17:07:33.019 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:33.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.125+0000 7f28bf59e700 1 Processor -- start 2024-09-13T17:07:33.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.125+0000 7f28bf59e700 1 -- start start 2024-09-13T17:07:33.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bf59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f28b8053790 0x7f28b8056fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bf59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f28b8055480 0x7f28b80523d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bf59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b8057520 con 0x7f28b80e0b50 2024-09-13T17:07:33.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bf59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b8052910 con 0x7f28b8055480 2024-09-13T17:07:33.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bf59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b8051680 con 0x7f28b8053790 2024-09-13T17:07:33.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bed9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f28b8055480 0x7f28b80523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bed9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f28b8055480 0x7f28b80523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46222/0 (socket says 172.21.15.123:46222) 2024-09-13T17:07:33.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bed9d700 1 -- 172.21.15.123:0/1776231558 learned_addr learned my addr 172.21.15.123:0/1776231558 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:33.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bdd9b700 1 --2- 172.21.15.123:0/1776231558 >> v2:172.21.15.153:3300/0 conn(0x7f28b8053790 0x7f28b8056fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bed9d700 1 -- 172.21.15.123:0/1776231558 >> v2:172.21.15.153:3300/0 conn(0x7f28b8053790 msgr2=0x7f28b8056fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bed9d700 1 --2- 172.21.15.123:0/1776231558 >> v2:172.21.15.153:3300/0 conn(0x7f28b8053790 0x7f28b8056fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bed9d700 1 -- 172.21.15.123:0/1776231558 >> v1:172.21.15.153:6789/0 conn(0x7f28b80e0b50 legacy=0x7f28b8053080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bed9d700 1 -- 172.21.15.123:0/1776231558 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b80518f0 con 0x7f28b8055480 2024-09-13T17:07:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bed9d700 1 --2- 172.21.15.123:0/1776231558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b8055480 0x7f28b80523d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f28c0064010 tx=0x7f28c0069900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d0cbdd08afc97e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bd59a700 1 -- 172.21.15.123:0/1776231558 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00675b0 con 0x7f28b8055480 2024-09-13T17:07:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bd59a700 1 -- 172.21.15.123:0/1776231558 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c0073f10 con 0x7f28b8055480 2024-09-13T17:07:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bd59a700 1 -- 172.21.15.123:0/1776231558 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0067710 con 0x7f28b8055480 2024-09-13T17:07:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bf59e700 1 -- 172.21.15.123:0/1776231558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b8055480 msgr2=0x7f28b80523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bf59e700 1 --2- 172.21.15.123:0/1776231558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b8055480 0x7f28b80523d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f28c0064010 tx=0x7f28c0069900 comp rx=0 tx=0).stop 2024-09-13T17:07:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bf59e700 1 -- 172.21.15.123:0/1776231558 shutdown_connections 2024-09-13T17:07:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bf59e700 1 --2- 172.21.15.123:0/1776231558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b8055480 0x7f28b80523d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bf59e700 1 --2- 172.21.15.123:0/1776231558 >> v2:172.21.15.153:3300/0 conn(0x7f28b8053790 0x7f28b8056fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bf59e700 1 -- 172.21.15.123:0/1776231558 >> 172.21.15.123:0/1776231558 conn(0x7f28b801fc00 msgr2=0x7f28b80568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bf59e700 1 -- 172.21.15.123:0/1776231558 shutdown_connections 2024-09-13T17:07:33.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.129+0000 7f28bf59e700 1 -- 172.21.15.123:0/1776231558 wait complete. 2024-09-13T17:07:33.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.133+0000 7f28bf59e700 1 Processor -- start 2024-09-13T17:07:33.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.133+0000 7f28bf59e700 1 -- start start 2024-09-13T17:07:33.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.133+0000 7f28bf59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28b8053790 0x7f28b80d93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.133+0000 7f28bf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b8055480 0x7f28b80e33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.133+0000 7f28bf59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b80e0b50 0x7f28b803c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.133+0000 7f28bf59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80d8880 con 0x7f28b80e0b50 2024-09-13T17:07:33.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.133+0000 7f28bf59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80e3930 con 0x7f28b8055480 2024-09-13T17:07:33.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.133+0000 7f28bf59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b803c600 con 0x7f28b8053790 2024-09-13T17:07:33.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28bed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b80e0b50 0x7f28b803c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28bed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b80e0b50 0x7f28b803c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46226/0 (socket says 172.21.15.123:46226) 2024-09-13T17:07:33.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28bed9d700 1 -- 172.21.15.123:0/829655827 learned_addr learned my addr 172.21.15.123:0/829655827 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:33.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28bdd9b700 1 --2- 172.21.15.123:0/829655827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b8055480 0x7f28b80e33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28be59c700 1 --2- 172.21.15.123:0/829655827 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28b8053790 0x7f28b80d93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28bed9d700 1 -- 172.21.15.123:0/829655827 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28b8053790 msgr2=0x7f28b80d93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28bed9d700 1 --2- 172.21.15.123:0/829655827 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28b8053790 0x7f28b80d93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28bed9d700 1 -- 172.21.15.123:0/829655827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b8055480 msgr2=0x7f28b80e33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28bed9d700 1 --2- 172.21.15.123:0/829655827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b8055480 0x7f28b80e33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28bed9d700 1 -- 172.21.15.123:0/829655827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c004f5c0 con 0x7f28b80e0b50 2024-09-13T17:07:33.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28bed9d700 1 --2- 172.21.15.123:0/829655827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b80e0b50 0x7f28b803c0c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f28c00641b0 tx=0x7f28c0069dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28aeffd700 1 -- 172.21.15.123:0/829655827 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c009a070 con 0x7f28b80e0b50 2024-09-13T17:07:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28aeffd700 1 -- 172.21.15.123:0/829655827 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c00720c0 con 0x7f28b80e0b50 2024-09-13T17:07:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28bf59e700 1 -- 172.21.15.123:0/829655827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b80d99c0 con 0x7f28b80e0b50 2024-09-13T17:07:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28aeffd700 1 -- 172.21.15.123:0/829655827 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0072470 con 0x7f28b80e0b50 2024-09-13T17:07:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28bf59e700 1 -- 172.21.15.123:0/829655827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b816a070 con 0x7f28b80e0b50 2024-09-13T17:07:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28bf59e700 1 -- 172.21.15.123:0/829655827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b8056fe0 con 0x7f28b80e0b50 2024-09-13T17:07:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.137+0000 7f28aeffd700 1 -- 172.21.15.123:0/829655827 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f28c006d040 con 0x7f28b80e0b50 2024-09-13T17:07:33.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.141+0000 7f28aeffd700 1 --2- 172.21.15.123:0/829655827 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28a0066730 0x7f28a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.141+0000 7f28aeffd700 1 -- 172.21.15.123:0/829655827 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f28c00ff670 con 0x7f28b80e0b50 2024-09-13T17:07:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.141+0000 7f28be59c700 1 --2- 172.21.15.123:0/829655827 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28a0066730 0x7f28a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.141+0000 7f28be59c700 1 --2- 172.21.15.123:0/829655827 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28a0066730 0x7f28a0068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f28b40018a0 tx=0x7f28b4009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:33.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.145+0000 7f28aeffd700 1 -- 172.21.15.123:0/829655827 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f28c00cca80 con 0x7f28b80e0b50 2024-09-13T17:07:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.317+0000 7f28bf59e700 1 -- 172.21.15.123:0/829655827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28b800de80 con 0x7f28b80e0b50 2024-09-13T17:07:33.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.317+0000 7f28aeffd700 1 -- 172.21.15.123:0/829655827 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16803 (secure 0 0 0) 0x7f28c00d00a0 con 0x7f28b80e0b50 2024-09-13T17:07:33.322 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:33.322 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:07:31.905768+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:33.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.321+0000 7f28bf59e700 1 -- 172.21.15.123:0/829655827 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28a0066730 msgr2=0x7f28a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.321+0000 7f28bf59e700 1 --2- 172.21.15.123:0/829655827 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28a0066730 0x7f28a0068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f28b40018a0 tx=0x7f28b4009040 comp rx=0 tx=0).stop 2024-09-13T17:07:33.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.321+0000 7f28bf59e700 1 -- 172.21.15.123:0/829655827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b80e0b50 msgr2=0x7f28b803c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.321+0000 7f28bf59e700 1 --2- 172.21.15.123:0/829655827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b80e0b50 0x7f28b803c0c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f28c00641b0 tx=0x7f28c0069dc0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.321+0000 7f28bf59e700 1 -- 172.21.15.123:0/829655827 shutdown_connections 2024-09-13T17:07:33.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.321+0000 7f28bf59e700 1 --2- 172.21.15.123:0/829655827 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f28a0066730 0x7f28a0068bf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.321+0000 7f28bf59e700 1 --2- 172.21.15.123:0/829655827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28b80e0b50 0x7f28b803c0c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.321+0000 7f28bf59e700 1 --2- 172.21.15.123:0/829655827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b8055480 0x7f28b80e33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.321+0000 7f28bf59e700 1 --2- 172.21.15.123:0/829655827 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f28b8053790 0x7f28b80d93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.321+0000 7f28bf59e700 1 -- 172.21.15.123:0/829655827 >> 172.21.15.123:0/829655827 conn(0x7f28b801fc00 msgr2=0x7f28b80383a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:33.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.321+0000 7f28bf59e700 1 -- 172.21.15.123:0/829655827 shutdown_connections 2024-09-13T17:07:33.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.321+0000 7f28bf59e700 1 -- 172.21.15.123:0/829655827 wait complete. 2024-09-13T17:07:33.341 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:06:47.016013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:06:47.420727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:33.341 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:33.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.461+0000 7f94b2432700 1 Processor -- start 2024-09-13T17:07:33.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.461+0000 7f94b2432700 1 -- start start 2024-09-13T17:07:33.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b2432700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94ac0b4b60 0x7f94ac15d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b2432700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94ac0b37a0 0x7f94ac15da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b2432700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac0b3310 con 0x7f94ac1506b0 2024-09-13T17:07:33.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b2432700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac15e280 con 0x7f94ac0b4b60 2024-09-13T17:07:33.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b2432700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac0b29e0 con 0x7f94ac0b37a0 2024-09-13T17:07:33.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b0c2f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94ac0b4b60 0x7f94ac15d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b1430700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f94ac1506b0 0x7f94ac0b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:43386/0 (socket says 172.21.15.123:43386) 2024-09-13T17:07:33.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b1c31700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94ac0b37a0 0x7f94ac15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b1430700 1 -- 172.21.15.123:0/1952529233 learned_addr learned my addr 172.21.15.123:0/1952529233 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:33.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b1c31700 1 -- 172.21.15.123:0/1952529233 >> v2:172.21.15.153:3300/0 conn(0x7f94ac0b4b60 msgr2=0x7f94ac15d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:33.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b1c31700 1 --2- 172.21.15.123:0/1952529233 >> v2:172.21.15.153:3300/0 conn(0x7f94ac0b4b60 0x7f94ac15d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b1c31700 1 -- 172.21.15.123:0/1952529233 >> v1:172.21.15.153:6789/0 conn(0x7f94ac1506b0 legacy=0x7f94ac0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94a3fff700 1 -- 172.21.15.123:0/1952529233 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752229286 0 0) 0x7f94ac0b3310 con 0x7f94ac1506b0 2024-09-13T17:07:33.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b1c31700 1 -- 172.21.15.123:0/1952529233 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac0b2cc0 con 0x7f94ac0b37a0 2024-09-13T17:07:33.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b1c31700 1 --2- 172.21.15.123:0/1952529233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94ac0b37a0 0x7f94ac15da00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009d90 tx=0x7f94a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8e0bcaf71882aa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:33.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94a3fff700 1 -- 172.21.15.123:0/1952529233 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a400bd20 con 0x7f94ac0b37a0 2024-09-13T17:07:33.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94a3fff700 1 -- 172.21.15.123:0/1952529233 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a400be80 con 0x7f94ac0b37a0 2024-09-13T17:07:33.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94a3fff700 1 -- 172.21.15.123:0/1952529233 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a40116a0 con 0x7f94ac0b37a0 2024-09-13T17:07:33.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b2432700 1 -- 172.21.15.123:0/1952529233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94ac0b37a0 msgr2=0x7f94ac15da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b2432700 1 --2- 172.21.15.123:0/1952529233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94ac0b37a0 0x7f94ac15da00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009d90 tx=0x7f94a400b330 comp rx=0 tx=0).stop 2024-09-13T17:07:33.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.465+0000 7f94b2432700 1 -- 172.21.15.123:0/1952529233 shutdown_connections 2024-09-13T17:07:33.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.469+0000 7f94b2432700 1 --2- 172.21.15.123:0/1952529233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94ac0b37a0 0x7f94ac15da00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.469+0000 7f94b2432700 1 --2- 172.21.15.123:0/1952529233 >> v2:172.21.15.153:3300/0 conn(0x7f94ac0b4b60 0x7f94ac15d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.469+0000 7f94b2432700 1 -- 172.21.15.123:0/1952529233 >> 172.21.15.123:0/1952529233 conn(0x7f94ac066780 msgr2=0x7f94ac0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:33.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.469+0000 7f94b2432700 1 -- 172.21.15.123:0/1952529233 shutdown_connections 2024-09-13T17:07:33.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.469+0000 7f94b2432700 1 -- 172.21.15.123:0/1952529233 wait complete. 2024-09-13T17:07:33.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.469+0000 7f94b2432700 1 Processor -- start 2024-09-13T17:07:33.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.469+0000 7f94b2432700 1 -- start start 2024-09-13T17:07:33.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b2432700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94ac0b37a0 0x7f94ac137c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b2432700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94ac0b4b60 0x7f94ac155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b2432700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94ac1506b0 0x7f94ac150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b2432700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac156ab0 con 0x7f94ac0b4b60 2024-09-13T17:07:33.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b2432700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac155e30 con 0x7f94ac0b37a0 2024-09-13T17:07:33.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b2432700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac156110 con 0x7f94ac1506b0 2024-09-13T17:07:33.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b0c2f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94ac0b4b60 0x7f94ac155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b0c2f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94ac0b4b60 0x7f94ac155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46228/0 (socket says 172.21.15.123:46228) 2024-09-13T17:07:33.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b0c2f700 1 -- 172.21.15.123:0/801691975 learned_addr learned my addr 172.21.15.123:0/801691975 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:33.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b1c31700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94ac1506b0 0x7f94ac150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b1430700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94ac0b37a0 0x7f94ac137c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b0c2f700 1 -- 172.21.15.123:0/801691975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94ac1506b0 msgr2=0x7f94ac150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b0c2f700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94ac1506b0 0x7f94ac150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b0c2f700 1 -- 172.21.15.123:0/801691975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94ac0b37a0 msgr2=0x7f94ac137c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b0c2f700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94ac0b37a0 0x7f94ac137c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b0c2f700 1 -- 172.21.15.123:0/801691975 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a4009a70 con 0x7f94ac0b4b60 2024-09-13T17:07:33.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b1430700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94ac0b37a0 0x7f94ac137c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:33.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b0c2f700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94ac0b4b60 0x7f94ac155450 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f949c00e840 tx=0x7f949c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:33.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94a1ffb700 1 -- 172.21.15.123:0/801691975 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0095a0 con 0x7f94ac0b4b60 2024-09-13T17:07:33.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94a1ffb700 1 -- 172.21.15.123:0/801691975 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c013680 con 0x7f94ac0b4b60 2024-09-13T17:07:33.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94a1ffb700 1 -- 172.21.15.123:0/801691975 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0139f0 con 0x7f94ac0b4b60 2024-09-13T17:07:33.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b2432700 1 -- 172.21.15.123:0/801691975 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ac1563f0 con 0x7f94ac0b4b60 2024-09-13T17:07:33.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.473+0000 7f94b2432700 1 -- 172.21.15.123:0/801691975 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac14ba70 con 0x7f94ac0b4b60 2024-09-13T17:07:33.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.477+0000 7f94b2432700 1 -- 172.21.15.123:0/801691975 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ac14bcc0 con 0x7f94ac0b4b60 2024-09-13T17:07:33.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.477+0000 7f94a1ffb700 1 -- 172.21.15.123:0/801691975 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f949c013b50 con 0x7f94ac0b4b60 2024-09-13T17:07:33.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.477+0000 7f94a1ffb700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9490066730 0x7f9490068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.477+0000 7f94a1ffb700 1 -- 172.21.15.123:0/801691975 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f949c084200 con 0x7f94ac0b4b60 2024-09-13T17:07:33.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.477+0000 7f94b1430700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9490066730 0x7f9490068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.477+0000 7f94b1430700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9490066730 0x7f9490068bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f94a8000f60 tx=0x7f94a8007cc0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:33.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.481+0000 7f94a1ffb700 1 -- 172.21.15.123:0/801691975 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f949c051460 con 0x7f94ac0b4b60 2024-09-13T17:07:33.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.653+0000 7f94b2432700 1 -- 172.21.15.123:0/801691975 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94ac15df10 con 0x7f94ac0b4b60 2024-09-13T17:07:33.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.653+0000 7f94a1ffb700 1 -- 172.21.15.123:0/801691975 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f949c054a80 con 0x7f94ac0b4b60 2024-09-13T17:07:33.657 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:33.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.657+0000 7f94b2432700 1 -- 172.21.15.123:0/801691975 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9490066730 msgr2=0x7f9490068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.657+0000 7f94b2432700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9490066730 0x7f9490068bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f94a8000f60 tx=0x7f94a8007cc0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.657+0000 7f94b2432700 1 -- 172.21.15.123:0/801691975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94ac0b4b60 msgr2=0x7f94ac155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.657+0000 7f94b2432700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94ac0b4b60 0x7f94ac155450 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f949c00e840 tx=0x7f949c00eb50 comp rx=0 tx=0).stop 2024-09-13T17:07:33.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.657+0000 7f94b2432700 1 -- 172.21.15.123:0/801691975 shutdown_connections 2024-09-13T17:07:33.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.657+0000 7f94b2432700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9490066730 0x7f9490068bf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.657+0000 7f94b2432700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94ac1506b0 0x7f94ac150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.657+0000 7f94b2432700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94ac0b4b60 0x7f94ac155450 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.657+0000 7f94b2432700 1 --2- 172.21.15.123:0/801691975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94ac0b37a0 0x7f94ac137c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.657+0000 7f94b2432700 1 -- 172.21.15.123:0/801691975 >> 172.21.15.123:0/801691975 conn(0x7f94ac066780 msgr2=0x7f94ac15d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:33.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.657+0000 7f94b2432700 1 -- 172.21.15.123:0/801691975 shutdown_connections 2024-09-13T17:07:33.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.661+0000 7f94b2432700 1 -- 172.21.15.123:0/801691975 wait complete. 2024-09-13T17:07:33.677 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:07:33.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.793+0000 7fe8edef8700 1 Processor -- start 2024-09-13T17:07:33.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.793+0000 7fe8edef8700 1 -- start start 2024-09-13T17:07:33.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.793+0000 7fe8edef8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8e80b58b0 0x7fe8e80d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.793+0000 7fe8edef8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8e80cd5e0 0x7fe8e80cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.793+0000 7fe8edef8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e80b0060 con 0x7fe8e80d0f40 2024-09-13T17:07:33.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.793+0000 7fe8edef8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e80b0340 con 0x7fe8e80b58b0 2024-09-13T17:07:33.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.793+0000 7fe8edef8700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e80b0620 con 0x7fe8e80cd5e0 2024-09-13T17:07:33.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.793+0000 7fe8e7fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8e80b58b0 0x7fe8e80d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.793+0000 7fe8ecef6700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe8e80d0f40 0x7fe8e80d1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50262/0 (socket says 172.21.15.123:50262) 2024-09-13T17:07:33.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.793+0000 7fe8ecef6700 1 -- 172.21.15.123:0/2689440771 learned_addr learned my addr 172.21.15.123:0/2689440771 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:33.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.793+0000 7fe8ed6f7700 1 --2- 172.21.15.123:0/2689440771 >> v2:172.21.15.153:3300/0 conn(0x7fe8e80cd5e0 0x7fe8e80cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8e7fff700 1 -- 172.21.15.123:0/2689440771 >> v2:172.21.15.153:3300/0 conn(0x7fe8e80cd5e0 msgr2=0x7fe8e80cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:33.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8e7fff700 1 --2- 172.21.15.123:0/2689440771 >> v2:172.21.15.153:3300/0 conn(0x7fe8e80cd5e0 0x7fe8e80cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8e7fff700 1 -- 172.21.15.123:0/2689440771 >> v1:172.21.15.123:6789/0 conn(0x7fe8e80d0f40 legacy=0x7fe8e80d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8e7fff700 1 -- 172.21.15.123:0/2689440771 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80b0900 con 0x7fe8e80b58b0 2024-09-13T17:07:33.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8e77fe700 1 -- 172.21.15.123:0/2689440771 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343674618 0 0) 0x7fe8e80b0060 con 0x7fe8e80d0f40 2024-09-13T17:07:33.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8e7fff700 1 --2- 172.21.15.123:0/2689440771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80b58b0 0x7fe8e80d05a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80b8ad0 tx=0x7fe8d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c8d8fe5b1aa9d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:33.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8e77fe700 1 -- 172.21.15.123:0/2689440771 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8011830 con 0x7fe8e80b58b0 2024-09-13T17:07:33.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8e77fe700 1 -- 172.21.15.123:0/2689440771 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d8011990 con 0x7fe8e80b58b0 2024-09-13T17:07:33.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8e77fe700 1 -- 172.21.15.123:0/2689440771 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8011d20 con 0x7fe8e80b58b0 2024-09-13T17:07:33.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8edef8700 1 -- 172.21.15.123:0/2689440771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80b58b0 msgr2=0x7fe8e80d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8edef8700 1 --2- 172.21.15.123:0/2689440771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80b58b0 0x7fe8e80d05a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80b8ad0 tx=0x7fe8d8009b30 comp rx=0 tx=0).stop 2024-09-13T17:07:33.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8edef8700 1 -- 172.21.15.123:0/2689440771 shutdown_connections 2024-09-13T17:07:33.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8edef8700 1 --2- 172.21.15.123:0/2689440771 >> v2:172.21.15.153:3300/0 conn(0x7fe8e80cd5e0 0x7fe8e80cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8edef8700 1 --2- 172.21.15.123:0/2689440771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80b58b0 0x7fe8e80d05a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8edef8700 1 -- 172.21.15.123:0/2689440771 >> 172.21.15.123:0/2689440771 conn(0x7fe8e80d2a60 msgr2=0x7fe8e80d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:33.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8edef8700 1 -- 172.21.15.123:0/2689440771 shutdown_connections 2024-09-13T17:07:33.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8edef8700 1 -- 172.21.15.123:0/2689440771 wait complete. 2024-09-13T17:07:33.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8edef8700 1 Processor -- start 2024-09-13T17:07:33.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.797+0000 7fe8edef8700 1 -- start start 2024-09-13T17:07:33.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8edef8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e80b58b0 0x7fe8e80b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8edef8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e80cd5e0 0x7fe8e80b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8edef8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80d0f40 0x7fe8e815f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8edef8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80b32c0 con 0x7fe8e80d0f40 2024-09-13T17:07:33.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8edef8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e815e360 con 0x7fe8e80cd5e0 2024-09-13T17:07:33.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8edef8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e815e640 con 0x7fe8e80b58b0 2024-09-13T17:07:33.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8ed6f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80d0f40 0x7fe8e815f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8ed6f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80d0f40 0x7fe8e815f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46258/0 (socket says 172.21.15.123:46258) 2024-09-13T17:07:33.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8ed6f7700 1 -- 172.21.15.123:0/1685136722 learned_addr learned my addr 172.21.15.123:0/1685136722 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:33.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8ecef6700 1 --2- 172.21.15.123:0/1685136722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e80b58b0 0x7fe8e80b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8e7fff700 1 --2- 172.21.15.123:0/1685136722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e80cd5e0 0x7fe8e80b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8ed6f7700 1 -- 172.21.15.123:0/1685136722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e80b58b0 msgr2=0x7fe8e80b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8ed6f7700 1 --2- 172.21.15.123:0/1685136722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e80b58b0 0x7fe8e80b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8ed6f7700 1 -- 172.21.15.123:0/1685136722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e80cd5e0 msgr2=0x7fe8e80b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8ed6f7700 1 --2- 172.21.15.123:0/1685136722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e80cd5e0 0x7fe8e80b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8ed6f7700 1 -- 172.21.15.123:0/1685136722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d80094b0 con 0x7fe8e80d0f40 2024-09-13T17:07:33.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8ed6f7700 1 --2- 172.21.15.123:0/1685136722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80d0f40 0x7fe8e815f400 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000efc0 tx=0x7fe8e000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:33.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8e57fa700 1 -- 172.21.15.123:0/1685136722 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e000caa0 con 0x7fe8e80d0f40 2024-09-13T17:07:33.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8e57fa700 1 -- 172.21.15.123:0/1685136722 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e000f040 con 0x7fe8e80d0f40 2024-09-13T17:07:33.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8edef8700 1 -- 172.21.15.123:0/1685136722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e815e920 con 0x7fe8e80d0f40 2024-09-13T17:07:33.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8e57fa700 1 -- 172.21.15.123:0/1685136722 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e000ce40 con 0x7fe8e80d0f40 2024-09-13T17:07:33.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8edef8700 1 -- 172.21.15.123:0/1685136722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e815eee0 con 0x7fe8e80d0f40 2024-09-13T17:07:33.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8e57fa700 1 -- 172.21.15.123:0/1685136722 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe8e0014480 con 0x7fe8e80d0f40 2024-09-13T17:07:33.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.801+0000 7fe8edef8700 1 -- 172.21.15.123:0/1685136722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e80d1320 con 0x7fe8e80d0f40 2024-09-13T17:07:33.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.805+0000 7fe8e57fa700 1 --2- 172.21.15.123:0/1685136722 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe8d4066730 0x7fe8d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:33.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.805+0000 7fe8e57fa700 1 -- 172.21.15.123:0/1685136722 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe8e0084bf0 con 0x7fe8e80d0f40 2024-09-13T17:07:33.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.805+0000 7fe8ecef6700 1 --2- 172.21.15.123:0/1685136722 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe8d4066730 0x7fe8d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:33.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.805+0000 7fe8ecef6700 1 --2- 172.21.15.123:0/1685136722 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe8d4066730 0x7fe8d4068bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc000f60 tx=0x7fe8dc009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:33.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.809+0000 7fe8e57fa700 1 -- 172.21.15.123:0/1685136722 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe8e0051ee0 con 0x7fe8e80d0f40 2024-09-13T17:07:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.977+0000 7fe8edef8700 1 -- 172.21.15.123:0/1685136722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8e815f0d0 con 0x7fe8e80d0f40 2024-09-13T17:07:33.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.977+0000 7fe8e57fa700 1 -- 172.21.15.123:0/1685136722 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8e0018020 con 0x7fe8e80d0f40 2024-09-13T17:07:33.980 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:07:33.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.981+0000 7fe8edef8700 1 -- 172.21.15.123:0/1685136722 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe8d4066730 msgr2=0x7fe8d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.981+0000 7fe8edef8700 1 --2- 172.21.15.123:0/1685136722 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe8d4066730 0x7fe8d4068bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc000f60 tx=0x7fe8dc009040 comp rx=0 tx=0).stop 2024-09-13T17:07:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.981+0000 7fe8edef8700 1 -- 172.21.15.123:0/1685136722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80d0f40 msgr2=0x7fe8e815f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.981+0000 7fe8edef8700 1 --2- 172.21.15.123:0/1685136722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80d0f40 0x7fe8e815f400 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000efc0 tx=0x7fe8e000c0c0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.981+0000 7fe8edef8700 1 -- 172.21.15.123:0/1685136722 shutdown_connections 2024-09-13T17:07:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.981+0000 7fe8edef8700 1 --2- 172.21.15.123:0/1685136722 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe8d4066730 0x7fe8d4068bf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.981+0000 7fe8edef8700 1 --2- 172.21.15.123:0/1685136722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8e80d0f40 0x7fe8e815f400 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.981+0000 7fe8edef8700 1 --2- 172.21.15.123:0/1685136722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e80cd5e0 0x7fe8e80b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.981+0000 7fe8edef8700 1 --2- 172.21.15.123:0/1685136722 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8e80b58b0 0x7fe8e80b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.981+0000 7fe8edef8700 1 -- 172.21.15.123:0/1685136722 >> 172.21.15.123:0/1685136722 conn(0x7fe8e80d2a60 msgr2=0x7fe8e80cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.981+0000 7fe8edef8700 1 -- 172.21.15.123:0/1685136722 shutdown_connections 2024-09-13T17:07:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:33.981+0000 7fe8edef8700 1 -- 172.21.15.123:0/1685136722 wait complete. 2024-09-13T17:07:33.994 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:07:34.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 Processor -- start 2024-09-13T17:07:34.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 -- start start 2024-09-13T17:07:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7aa015aa90 0x7f7aa006d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7aa00af090 0x7f7aa006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa006e210 con 0x7f7aa015ae70 2024-09-13T17:07:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa00af4c0 con 0x7f7aa00af090 2024-09-13T17:07:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa00ca250 con 0x7f7aa015aa90 2024-09-13T17:07:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7a9ed9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7aa00af090 0x7f7aa006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7a9ed9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7aa00af090 0x7f7aa006dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46272/0 (socket says 172.21.15.123:46272) 2024-09-13T17:07:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7a9ed9d700 1 -- 172.21.15.123:0/2486395506 learned_addr learned my addr 172.21.15.123:0/2486395506 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7a9ed9d700 1 -- 172.21.15.123:0/2486395506 >> v2:172.21.15.153:3300/0 conn(0x7f7aa015aa90 msgr2=0x7f7aa006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7a9ed9d700 1 --2- 172.21.15.123:0/2486395506 >> v2:172.21.15.153:3300/0 conn(0x7f7aa015aa90 0x7f7aa006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7a9ed9d700 1 -- 172.21.15.123:0/2486395506 >> v1:172.21.15.153:6789/0 conn(0x7f7aa015ae70 legacy=0x7f7aa00ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7a9ed9d700 1 -- 172.21.15.123:0/2486395506 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa00af720 con 0x7f7aa00af090 2024-09-13T17:07:34.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7a9ed9d700 1 --2- 172.21.15.123:0/2486395506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aa00af090 0x7f7aa006dcd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00b03b0 tx=0x7f7a9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d032795282afaf65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:34.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7a9d59a700 1 -- 172.21.15.123:0/2486395506 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800e070 con 0x7f7aa00af090 2024-09-13T17:07:34.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7a9d59a700 1 -- 172.21.15.123:0/2486395506 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a98003a40 con 0x7f7aa00af090 2024-09-13T17:07:34.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7a9d59a700 1 -- 172.21.15.123:0/2486395506 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a98003df0 con 0x7f7aa00af090 2024-09-13T17:07:34.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2486395506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aa00af090 msgr2=0x7f7aa006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 --2- 172.21.15.123:0/2486395506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aa00af090 0x7f7aa006dcd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00b03b0 tx=0x7f7a9800b330 comp rx=0 tx=0).stop 2024-09-13T17:07:34.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2486395506 shutdown_connections 2024-09-13T17:07:34.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 --2- 172.21.15.123:0/2486395506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aa00af090 0x7f7aa006dcd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 --2- 172.21.15.123:0/2486395506 >> v2:172.21.15.153:3300/0 conn(0x7f7aa015aa90 0x7f7aa006d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2486395506 >> 172.21.15.123:0/2486395506 conn(0x7f7aa00b0450 msgr2=0x7f7aa00b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:34.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2486395506 shutdown_connections 2024-09-13T17:07:34.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.113+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2486395506 wait complete. 2024-09-13T17:07:34.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7aa4bee700 1 Processor -- start 2024-09-13T17:07:34.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7aa4bee700 1 -- start start 2024-09-13T17:07:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7aa4bee700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aa00af090 0x7f7aa01e3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7aa4bee700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7aa015aa90 0x7f7aa00c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7aa4bee700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aa0156490 0x7f7aa01e6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7aa4bee700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa0156fa0 con 0x7f7aa0156490 2024-09-13T17:07:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7aa4bee700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa01e4140 con 0x7f7aa015aa90 2024-09-13T17:07:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7aa4bee700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa01e5b80 con 0x7f7aa00af090 2024-09-13T17:07:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7a9ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aa0156490 0x7f7aa01e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7a9ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aa0156490 0x7f7aa01e6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46274/0 (socket says 172.21.15.123:46274) 2024-09-13T17:07:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7a9ed9d700 1 -- 172.21.15.123:0/2265434916 learned_addr learned my addr 172.21.15.123:0/2265434916 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7a9e59c700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aa00af090 0x7f7aa01e3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7a9dd9b700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7aa015aa90 0x7f7aa00c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7a9e59c700 1 -- 172.21.15.123:0/2265434916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7aa015aa90 msgr2=0x7f7aa00c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7a9e59c700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7aa015aa90 0x7f7aa00c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7a9e59c700 1 -- 172.21.15.123:0/2265434916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aa0156490 msgr2=0x7f7aa01e6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7a9e59c700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aa0156490 0x7f7aa01e6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7a9e59c700 1 -- 172.21.15.123:0/2265434916 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a98009b30 con 0x7f7aa00af090 2024-09-13T17:07:34.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.117+0000 7f7a9ed9d700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aa0156490 0x7f7aa01e6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.121+0000 7f7a9e59c700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aa00af090 0x7f7aa01e3b60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000b4a0 tx=0x7f7a9000b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.121+0000 7f7a8effd700 1 -- 172.21.15.123:0/2265434916 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a90011830 con 0x7f7aa00af090 2024-09-13T17:07:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.121+0000 7f7a8effd700 1 -- 172.21.15.123:0/2265434916 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a90011990 con 0x7f7aa00af090 2024-09-13T17:07:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.121+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2265434916 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa01e5e60 con 0x7f7aa00af090 2024-09-13T17:07:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.121+0000 7f7a8effd700 1 -- 172.21.15.123:0/2265434916 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a90011d40 con 0x7f7aa00af090 2024-09-13T17:07:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.121+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2265434916 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa00c6b00 con 0x7f7aa00af090 2024-09-13T17:07:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.121+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2265434916 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa01e6380 con 0x7f7aa00af090 2024-09-13T17:07:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.121+0000 7f7a8effd700 1 -- 172.21.15.123:0/2265434916 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7a9001a400 con 0x7f7aa00af090 2024-09-13T17:07:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.121+0000 7f7a8effd700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7a80066730 0x7f7a80068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.121+0000 7f7a8effd700 1 -- 172.21.15.123:0/2265434916 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7a90084190 con 0x7f7aa00af090 2024-09-13T17:07:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.121+0000 7f7a9dd9b700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7a80066730 0x7f7a80068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.125+0000 7f7a9dd9b700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7a80066730 0x7f7a80068bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7aa01e37e0 tx=0x7f7a940090e0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:34.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.133+0000 7f7a8effd700 1 -- 172.21.15.123:0/2265434916 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7aa01e6380 con 0x7f7aa00af090 2024-09-13T17:07:34.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.301+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2265434916 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7aa01e6380 con 0x7f7aa00af090 2024-09-13T17:07:34.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.301+0000 7f7a8effd700 1 -- 172.21.15.123:0/2265434916 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7aa01e6380 con 0x7f7aa00af090 2024-09-13T17:07:34.304 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:07:34.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.305+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2265434916 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7a80066730 msgr2=0x7f7a80068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.305+0000 7f7aa4bee700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7a80066730 0x7f7a80068bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7aa01e37e0 tx=0x7f7a940090e0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.305+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2265434916 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aa00af090 msgr2=0x7f7aa01e3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.305+0000 7f7aa4bee700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aa00af090 0x7f7aa01e3b60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000b4a0 tx=0x7f7a9000b7b0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.305+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2265434916 shutdown_connections 2024-09-13T17:07:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.305+0000 7f7aa4bee700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7a80066730 0x7f7a80068bf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.305+0000 7f7aa4bee700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aa0156490 0x7f7aa01e6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.305+0000 7f7aa4bee700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7aa015aa90 0x7f7aa00c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.305+0000 7f7aa4bee700 1 --2- 172.21.15.123:0/2265434916 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7aa00af090 0x7f7aa01e3b60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.305+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2265434916 >> 172.21.15.123:0/2265434916 conn(0x7f7aa00b0450 msgr2=0x7f7aa00b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.305+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2265434916 shutdown_connections 2024-09-13T17:07:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.305+0000 7f7aa4bee700 1 -- 172.21.15.123:0/2265434916 wait complete. 2024-09-13T17:07:34.324 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:07:34.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.433+0000 7ff78cffd700 1 Processor -- start 2024-09-13T17:07:34.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.433+0000 7ff78cffd700 1 -- start start 2024-09-13T17:07:34.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff78cffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff7800df8e0 0x7ff78001c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff78cffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff78004fe30 0x7ff780050480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff78cffd700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7800e3310 con 0x7ff7800509c0 2024-09-13T17:07:34.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff78cffd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff780050e30 con 0x7ff78004fe30 2024-09-13T17:07:34.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff78cffd700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7800e35f0 con 0x7ff7800df8e0 2024-09-13T17:07:34.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff787fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff7800509c0 0x7ff78004ec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50266/0 (socket says 172.21.15.123:50266) 2024-09-13T17:07:34.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff786ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff78004fe30 0x7ff780050480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff787fff700 1 -- 172.21.15.123:0/2707732441 learned_addr learned my addr 172.21.15.123:0/2707732441 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:34.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff7877fe700 1 --2- 172.21.15.123:0/2707732441 >> v2:172.21.15.153:3300/0 conn(0x7ff7800df8e0 0x7ff78001c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff7867fc700 1 -- 172.21.15.123:0/2707732441 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062928127 0 0) 0x7ff7800e3310 con 0x7ff7800509c0 2024-09-13T17:07:34.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff7867fc700 1 -- 172.21.15.123:0/2707732441 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7780057e0 con 0x7ff7800509c0 2024-09-13T17:07:34.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff786ffd700 1 -- 172.21.15.123:0/2707732441 >> v2:172.21.15.153:3300/0 conn(0x7ff7800df8e0 msgr2=0x7ff78001c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:34.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff786ffd700 1 --2- 172.21.15.123:0/2707732441 >> v2:172.21.15.153:3300/0 conn(0x7ff7800df8e0 0x7ff78001c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff786ffd700 1 -- 172.21.15.123:0/2707732441 >> v1:172.21.15.123:6789/0 conn(0x7ff7800509c0 legacy=0x7ff78004ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff786ffd700 1 -- 172.21.15.123:0/2707732441 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7800e38d0 con 0x7ff78004fe30 2024-09-13T17:07:34.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff7877fe700 1 --2- 172.21.15.123:0/2707732441 >> v2:172.21.15.153:3300/0 conn(0x7ff7800df8e0 0x7ff78001c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:34.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff786ffd700 1 --2- 172.21.15.123:0/2707732441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff78004fe30 0x7ff780050480 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff7800080c0 tx=0x7ff774009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea4d233b337cd4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:34.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff7867fc700 1 -- 172.21.15.123:0/2707732441 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774011830 con 0x7ff78004fe30 2024-09-13T17:07:34.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff7867fc700 1 -- 172.21.15.123:0/2707732441 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff774011990 con 0x7ff78004fe30 2024-09-13T17:07:34.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff7867fc700 1 -- 172.21.15.123:0/2707732441 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774011d20 con 0x7ff78004fe30 2024-09-13T17:07:34.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff78cffd700 1 -- 172.21.15.123:0/2707732441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff78004fe30 msgr2=0x7ff780050480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff78cffd700 1 --2- 172.21.15.123:0/2707732441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff78004fe30 0x7ff780050480 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff7800080c0 tx=0x7ff774009b30 comp rx=0 tx=0).stop 2024-09-13T17:07:34.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff78cffd700 1 -- 172.21.15.123:0/2707732441 shutdown_connections 2024-09-13T17:07:34.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff78cffd700 1 --2- 172.21.15.123:0/2707732441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff78004fe30 0x7ff780050480 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff78cffd700 1 --2- 172.21.15.123:0/2707732441 >> v2:172.21.15.153:3300/0 conn(0x7ff7800df8e0 0x7ff78001c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff78cffd700 1 -- 172.21.15.123:0/2707732441 >> 172.21.15.123:0/2707732441 conn(0x7ff780036140 msgr2=0x7ff780036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:34.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff78cffd700 1 -- 172.21.15.123:0/2707732441 shutdown_connections 2024-09-13T17:07:34.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.437+0000 7ff78cffd700 1 -- 172.21.15.123:0/2707732441 wait complete. 2024-09-13T17:07:34.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff78cffd700 1 Processor -- start 2024-09-13T17:07:34.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff78cffd700 1 -- start start 2024-09-13T17:07:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff78cffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff78004fe30 0x7ff780039e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff78cffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800509c0 0x7ff7800355b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff78cffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7800df8e0 0x7ff7800d65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff78cffd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78003a3c0 con 0x7ff78004fe30 2024-09-13T17:07:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff78cffd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800e0030 con 0x7ff7800509c0 2024-09-13T17:07:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff78cffd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800e0310 con 0x7ff7800df8e0 2024-09-13T17:07:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff7877fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff78004fe30 0x7ff780039e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff7877fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff78004fe30 0x7ff780039e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46286/0 (socket says 172.21.15.123:46286) 2024-09-13T17:07:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff7877fe700 1 -- 172.21.15.123:0/2026570821 learned_addr learned my addr 172.21.15.123:0/2026570821 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff787fff700 1 --2- 172.21.15.123:0/2026570821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7800df8e0 0x7ff7800d65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff786ffd700 1 --2- 172.21.15.123:0/2026570821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800509c0 0x7ff7800355b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff7877fe700 1 -- 172.21.15.123:0/2026570821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7800df8e0 msgr2=0x7ff7800d65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff7877fe700 1 --2- 172.21.15.123:0/2026570821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7800df8e0 0x7ff7800d65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff7877fe700 1 -- 172.21.15.123:0/2026570821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800509c0 msgr2=0x7ff7800355b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff7877fe700 1 --2- 172.21.15.123:0/2026570821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800509c0 0x7ff7800355b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff7877fe700 1 -- 172.21.15.123:0/2026570821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7740094b0 con 0x7ff78004fe30 2024-09-13T17:07:34.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff7877fe700 1 --2- 172.21.15.123:0/2026570821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff78004fe30 0x7ff780039e80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00e810 tx=0x7ff77c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:34.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff773fff700 1 -- 172.21.15.123:0/2026570821 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c005c40 con 0x7ff78004fe30 2024-09-13T17:07:34.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff773fff700 1 -- 172.21.15.123:0/2026570821 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77c005da0 con 0x7ff78004fe30 2024-09-13T17:07:34.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff78cffd700 1 -- 172.21.15.123:0/2026570821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7800e05f0 con 0x7ff78004fe30 2024-09-13T17:07:34.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff773fff700 1 -- 172.21.15.123:0/2026570821 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c004250 con 0x7ff78004fe30 2024-09-13T17:07:34.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.441+0000 7ff78cffd700 1 -- 172.21.15.123:0/2026570821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7800e0bb0 con 0x7ff78004fe30 2024-09-13T17:07:34.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.445+0000 7ff78cffd700 1 -- 172.21.15.123:0/2026570821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff780007b40 con 0x7ff78004fe30 2024-09-13T17:07:34.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.445+0000 7ff773fff700 1 -- 172.21.15.123:0/2026570821 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff77c0043b0 con 0x7ff78004fe30 2024-09-13T17:07:34.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.445+0000 7ff773fff700 1 --2- 172.21.15.123:0/2026570821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff76c066730 0x7ff76c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.445+0000 7ff786ffd700 1 --2- 172.21.15.123:0/2026570821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff76c066730 0x7ff76c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.445+0000 7ff773fff700 1 -- 172.21.15.123:0/2026570821 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff77c084130 con 0x7ff78004fe30 2024-09-13T17:07:34.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.449+0000 7ff786ffd700 1 --2- 172.21.15.123:0/2026570821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff76c066730 0x7ff76c068bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff774000c00 tx=0x7ff774008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:34.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.449+0000 7ff773fff700 1 -- 172.21.15.123:0/2026570821 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff77c051380 con 0x7ff78004fe30 2024-09-13T17:07:34.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.653+0000 7ff78cffd700 1 -- 172.21.15.123:0/2026570821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7800e3310 con 0x7ff78004fe30 2024-09-13T17:07:34.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.657+0000 7ff773fff700 1 -- 172.21.15.123:0/2026570821 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7ff77c0549a0 con 0x7ff78004fe30 2024-09-13T17:07:34.659 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:34.659 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/721071800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":721071800},{"type":"v1","addr":"172.21.15.123:6835","nonce":721071800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1472515409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1472515409},{"type":"v1","addr":"172.21.15.123:6837","nonce":1472515409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3017694841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3017694841},{"type":"v1","addr":"172.21.15.153:6833","nonce":3017694841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:06:48.418287+0000","modified":"2024-09-13T17:06:51.426119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/2848393496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2848393496},{"type":"v1","addr":"172.21.15.153:6835","nonce":2848393496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:07:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.661+0000 7ff78cffd700 1 -- 172.21.15.123:0/2026570821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff76c066730 msgr2=0x7ff76c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.661+0000 7ff78cffd700 1 --2- 172.21.15.123:0/2026570821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff76c066730 0x7ff76c068bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff774000c00 tx=0x7ff774008030 comp rx=0 tx=0).stop 2024-09-13T17:07:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.661+0000 7ff78cffd700 1 -- 172.21.15.123:0/2026570821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff78004fe30 msgr2=0x7ff780039e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.661+0000 7ff78cffd700 1 --2- 172.21.15.123:0/2026570821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff78004fe30 0x7ff780039e80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00e810 tx=0x7ff77c00ebd0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.661+0000 7ff78cffd700 1 -- 172.21.15.123:0/2026570821 shutdown_connections 2024-09-13T17:07:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.661+0000 7ff78cffd700 1 --2- 172.21.15.123:0/2026570821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff76c066730 0x7ff76c068bf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.661+0000 7ff78cffd700 1 --2- 172.21.15.123:0/2026570821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7800df8e0 0x7ff7800d65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.661+0000 7ff78cffd700 1 --2- 172.21.15.123:0/2026570821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800509c0 0x7ff7800355b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.661+0000 7ff78cffd700 1 --2- 172.21.15.123:0/2026570821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff78004fe30 0x7ff780039e80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.661+0000 7ff78cffd700 1 -- 172.21.15.123:0/2026570821 >> 172.21.15.123:0/2026570821 conn(0x7ff780036140 msgr2=0x7ff78004ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:34.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.661+0000 7ff78cffd700 1 -- 172.21.15.123:0/2026570821 shutdown_connections 2024-09-13T17:07:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.661+0000 7ff78cffd700 1 -- 172.21.15.123:0/2026570821 wait complete. 2024-09-13T17:07:34.665 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 7 2024-09-13T17:07:34.678 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:34.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 Processor -- start 2024-09-13T17:07:34.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 -- start start 2024-09-13T17:07:34.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbeb0160fb0 0x7fbeb006de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbeb00cec90 0x7fbeb00cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb00cf5f0 con 0x7fbeb006c050 2024-09-13T17:07:34.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb006cb60 con 0x7fbeb00cec90 2024-09-13T17:07:34.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb006e340 con 0x7fbeb0160fb0 2024-09-13T17:07:34.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeae7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbeb00cec90 0x7fbeb00cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeae7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbeb00cec90 0x7fbeb00cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46298/0 (socket says 172.21.15.123:46298) 2024-09-13T17:07:34.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeae7fc700 1 -- 172.21.15.123:0/874385852 learned_addr learned my addr 172.21.15.123:0/874385852 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:34.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeaeffd700 1 --2- 172.21.15.123:0/874385852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbeb0160fb0 0x7fbeb006de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeae7fc700 1 -- 172.21.15.123:0/874385852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbeb0160fb0 msgr2=0x7fbeb006de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:34.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeae7fc700 1 --2- 172.21.15.123:0/874385852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbeb0160fb0 0x7fbeb006de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeae7fc700 1 -- 172.21.15.123:0/874385852 >> v1:172.21.15.153:6789/0 conn(0x7fbeb006c050 legacy=0x7fbeb006c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeae7fc700 1 -- 172.21.15.123:0/874385852 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb006cd60 con 0x7fbeb00cec90 2024-09-13T17:07:34.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeae7fc700 1 --2- 172.21.15.123:0/874385852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb00cec90 0x7fbeb00cf0b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbea8009e50 tx=0x7fbea800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3548369d5b0a3e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:34.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeadffb700 1 -- 172.21.15.123:0/874385852 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea800e070 con 0x7fbeb00cec90 2024-09-13T17:07:34.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeadffb700 1 -- 172.21.15.123:0/874385852 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea800b910 con 0x7fbeb00cec90 2024-09-13T17:07:34.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeadffb700 1 -- 172.21.15.123:0/874385852 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea800bcc0 con 0x7fbeb00cec90 2024-09-13T17:07:34.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 -- 172.21.15.123:0/874385852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb00cec90 msgr2=0x7fbeb00cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 --2- 172.21.15.123:0/874385852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb00cec90 0x7fbeb00cf0b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbea8009e50 tx=0x7fbea800b330 comp rx=0 tx=0).stop 2024-09-13T17:07:34.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 -- 172.21.15.123:0/874385852 shutdown_connections 2024-09-13T17:07:34.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 --2- 172.21.15.123:0/874385852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb00cec90 0x7fbeb00cf0b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 --2- 172.21.15.123:0/874385852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbeb0160fb0 0x7fbeb006de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 -- 172.21.15.123:0/874385852 >> 172.21.15.123:0/874385852 conn(0x7fbeb0066570 msgr2=0x7fbeb0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:34.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 -- 172.21.15.123:0/874385852 shutdown_connections 2024-09-13T17:07:34.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.785+0000 7fbeb5558700 1 -- 172.21.15.123:0/874385852 wait complete. 2024-09-13T17:07:34.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeb5558700 1 Processor -- start 2024-09-13T17:07:34.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeb5558700 1 -- start start 2024-09-13T17:07:34.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeb5558700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb006c050 0x7fbeb00b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeb5558700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbeb00cec90 0x7fbeb0158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeb5558700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb0160fb0 0x7fbeb0151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeb5558700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb0150f10 con 0x7fbeb006c050 2024-09-13T17:07:34.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeb5558700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb01511f0 con 0x7fbeb0160fb0 2024-09-13T17:07:34.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeb5558700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb01514d0 con 0x7fbeb00cec90 2024-09-13T17:07:34.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeaeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb006c050 0x7fbeb00b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeaeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb006c050 0x7fbeb00b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46300/0 (socket says 172.21.15.123:46300) 2024-09-13T17:07:34.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeaeffd700 1 -- 172.21.15.123:0/2387100086 learned_addr learned my addr 172.21.15.123:0/2387100086 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:34.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeae7fc700 1 --2- 172.21.15.123:0/2387100086 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbeb00cec90 0x7fbeb0158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeaf7fe700 1 --2- 172.21.15.123:0/2387100086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb0160fb0 0x7fbeb0151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeaeffd700 1 -- 172.21.15.123:0/2387100086 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbeb00cec90 msgr2=0x7fbeb0158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeaeffd700 1 --2- 172.21.15.123:0/2387100086 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbeb00cec90 0x7fbeb0158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeaeffd700 1 -- 172.21.15.123:0/2387100086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb0160fb0 msgr2=0x7fbeb0151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeaeffd700 1 --2- 172.21.15.123:0/2387100086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb0160fb0 0x7fbeb0151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeaeffd700 1 -- 172.21.15.123:0/2387100086 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea8009b30 con 0x7fbeb006c050 2024-09-13T17:07:34.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeaeffd700 1 --2- 172.21.15.123:0/2387100086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb006c050 0x7fbeb00b0640 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800e840 tx=0x7fbe9800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:34.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbea77fe700 1 -- 172.21.15.123:0/2387100086 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe980095a0 con 0x7fbeb006c050 2024-09-13T17:07:34.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbea77fe700 1 -- 172.21.15.123:0/2387100086 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe98013680 con 0x7fbeb006c050 2024-09-13T17:07:34.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeb5558700 1 -- 172.21.15.123:0/2387100086 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb01517b0 con 0x7fbeb006c050 2024-09-13T17:07:34.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbea77fe700 1 -- 172.21.15.123:0/2387100086 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe980139f0 con 0x7fbeb006c050 2024-09-13T17:07:34.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.789+0000 7fbeb5558700 1 -- 172.21.15.123:0/2387100086 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb00b0b80 con 0x7fbeb006c050 2024-09-13T17:07:34.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.793+0000 7fbeb5558700 1 -- 172.21.15.123:0/2387100086 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb00cf0b0 con 0x7fbeb006c050 2024-09-13T17:07:34.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.793+0000 7fbea77fe700 1 -- 172.21.15.123:0/2387100086 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbe98013b50 con 0x7fbeb006c050 2024-09-13T17:07:34.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.793+0000 7fbea77fe700 1 --2- 172.21.15.123:0/2387100086 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbe90066760 0x7fbe90068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:34.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.793+0000 7fbea77fe700 1 -- 172.21.15.123:0/2387100086 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbe98083fe0 con 0x7fbeb006c050 2024-09-13T17:07:34.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.793+0000 7fbeae7fc700 1 --2- 172.21.15.123:0/2387100086 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbe90066760 0x7fbe90068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:34.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.793+0000 7fbeae7fc700 1 --2- 172.21.15.123:0/2387100086 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbe90066760 0x7fbe90068c20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbea800b370 tx=0x7fbea8009000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:34.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.801+0000 7fbea77fe700 1 -- 172.21.15.123:0/2387100086 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbe980512d0 con 0x7fbeb006c050 2024-09-13T17:07:34.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.977+0000 7fbeb5558700 1 -- 172.21.15.123:0/2387100086 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbeb0160620 con 0x7fbeb006c050 2024-09-13T17:07:34.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.981+0000 7fbea77fe700 1 -- 172.21.15.123:0/2387100086 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16803 (secure 0 0 0) 0x7fbe980548f0 con 0x7fbeb006c050 2024-09-13T17:07:34.983 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:34.983 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:07:31.905768+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:34.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.981+0000 7fbeb5558700 1 -- 172.21.15.123:0/2387100086 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbe90066760 msgr2=0x7fbe90068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.981+0000 7fbeb5558700 1 --2- 172.21.15.123:0/2387100086 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbe90066760 0x7fbe90068c20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbea800b370 tx=0x7fbea8009000 comp rx=0 tx=0).stop 2024-09-13T17:07:34.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.981+0000 7fbeb5558700 1 -- 172.21.15.123:0/2387100086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb006c050 msgr2=0x7fbeb00b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:34.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.981+0000 7fbeb5558700 1 --2- 172.21.15.123:0/2387100086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb006c050 0x7fbeb00b0640 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800e840 tx=0x7fbe9800eb50 comp rx=0 tx=0).stop 2024-09-13T17:07:34.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.981+0000 7fbeb5558700 1 -- 172.21.15.123:0/2387100086 shutdown_connections 2024-09-13T17:07:34.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.981+0000 7fbeb5558700 1 --2- 172.21.15.123:0/2387100086 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbe90066760 0x7fbe90068c20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.981+0000 7fbeb5558700 1 --2- 172.21.15.123:0/2387100086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb0160fb0 0x7fbeb0151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.981+0000 7fbeb5558700 1 --2- 172.21.15.123:0/2387100086 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbeb00cec90 0x7fbeb0158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.981+0000 7fbeb5558700 1 --2- 172.21.15.123:0/2387100086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb006c050 0x7fbeb00b0640 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:34.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.981+0000 7fbeb5558700 1 -- 172.21.15.123:0/2387100086 >> 172.21.15.123:0/2387100086 conn(0x7fbeb0066570 msgr2=0x7fbeb015c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:34.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.981+0000 7fbeb5558700 1 -- 172.21.15.123:0/2387100086 shutdown_connections 2024-09-13T17:07:34.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:34.981+0000 7fbeb5558700 1 -- 172.21.15.123:0/2387100086 wait complete. 2024-09-13T17:07:35.000 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:07:35.000 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:07:35.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.109+0000 7f68c4c98700 1 Processor -- start 2024-09-13T17:07:35.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.109+0000 7f68c4c98700 1 -- start start 2024-09-13T17:07:35.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.109+0000 7f68c4c98700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f68c0153390 0x7f68c0159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.109+0000 7f68c4c98700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f68c0153770 0x7f68c00ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.109+0000 7f68c4c98700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c015a4c0 con 0x7f68c00cdb70 2024-09-13T17:07:35.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.109+0000 7f68c4c98700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c01595a0 con 0x7f68c0153390 2024-09-13T17:07:35.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.109+0000 7f68c4c98700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c00cb540 con 0x7f68c0153770 2024-09-13T17:07:35.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.109+0000 7f68bf7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f68c0153390 0x7f68c0159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.109+0000 7f68bf7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f68c0153390 0x7f68c0159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46306/0 (socket says 172.21.15.123:46306) 2024-09-13T17:07:35.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.109+0000 7f68bf7fe700 1 -- 172.21.15.123:0/1315768130 learned_addr learned my addr 172.21.15.123:0/1315768130 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:35.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.109+0000 7f68bffff700 1 --2- 172.21.15.123:0/1315768130 >> v2:172.21.15.153:3300/0 conn(0x7f68c0153770 0x7f68c00ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.109+0000 7f68bf7fe700 1 -- 172.21.15.123:0/1315768130 >> v2:172.21.15.153:3300/0 conn(0x7f68c0153770 msgr2=0x7f68c00ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:35.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.109+0000 7f68bf7fe700 1 --2- 172.21.15.123:0/1315768130 >> v2:172.21.15.153:3300/0 conn(0x7f68c0153770 0x7f68c00ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.109+0000 7f68bf7fe700 1 -- 172.21.15.123:0/1315768130 >> v1:172.21.15.153:6789/0 conn(0x7f68c00cdb70 legacy=0x7f68c00cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68bf7fe700 1 -- 172.21.15.123:0/1315768130 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00cb730 con 0x7f68c0153390 2024-09-13T17:07:35.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68bf7fe700 1 --2- 172.21.15.123:0/1315768130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68c0153390 0x7f68c0159f80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009970 tx=0x7f68b0009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c10f2ed696e9ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:35.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68be7fc700 1 -- 172.21.15.123:0/1315768130 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0011830 con 0x7f68c0153390 2024-09-13T17:07:35.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68be7fc700 1 -- 172.21.15.123:0/1315768130 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b0011990 con 0x7f68c0153390 2024-09-13T17:07:35.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68be7fc700 1 -- 172.21.15.123:0/1315768130 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0011d20 con 0x7f68c0153390 2024-09-13T17:07:35.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68c4c98700 1 -- 172.21.15.123:0/1315768130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68c0153390 msgr2=0x7f68c0159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68c4c98700 1 --2- 172.21.15.123:0/1315768130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68c0153390 0x7f68c0159f80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009970 tx=0x7f68b0009c80 comp rx=0 tx=0).stop 2024-09-13T17:07:35.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68c4c98700 1 -- 172.21.15.123:0/1315768130 shutdown_connections 2024-09-13T17:07:35.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68c4c98700 1 --2- 172.21.15.123:0/1315768130 >> v2:172.21.15.153:3300/0 conn(0x7f68c0153770 0x7f68c00ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68c4c98700 1 --2- 172.21.15.123:0/1315768130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68c0153390 0x7f68c0159f80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68c4c98700 1 -- 172.21.15.123:0/1315768130 >> 172.21.15.123:0/1315768130 conn(0x7f68c0066150 msgr2=0x7f68c0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:35.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68c4c98700 1 -- 172.21.15.123:0/1315768130 shutdown_connections 2024-09-13T17:07:35.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68c4c98700 1 -- 172.21.15.123:0/1315768130 wait complete. 2024-09-13T17:07:35.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68c4c98700 1 Processor -- start 2024-09-13T17:07:35.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.113+0000 7f68c4c98700 1 -- start start 2024-09-13T17:07:35.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68c4c98700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68c00cdb70 0x7f68c0148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68c4c98700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68c0153390 0x7f68c00a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68c4c98700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68c0153770 0x7f68c00b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68c4c98700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0148a00 con 0x7f68c0153770 2024-09-13T17:07:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68c4c98700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0166b10 con 0x7f68c00cdb70 2024-09-13T17:07:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68c4c98700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0167960 con 0x7f68c0153390 2024-09-13T17:07:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68bffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68c0153770 0x7f68c00b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68bffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68c0153770 0x7f68c00b0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46312/0 (socket says 172.21.15.123:46312) 2024-09-13T17:07:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68bffff700 1 -- 172.21.15.123:0/577618198 learned_addr learned my addr 172.21.15.123:0/577618198 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68beffd700 1 --2- 172.21.15.123:0/577618198 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68c0153390 0x7f68c00a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68bf7fe700 1 --2- 172.21.15.123:0/577618198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68c00cdb70 0x7f68c0148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68bffff700 1 -- 172.21.15.123:0/577618198 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68c0153390 msgr2=0x7f68c00a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68bffff700 1 --2- 172.21.15.123:0/577618198 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68c0153390 0x7f68c00a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68bffff700 1 -- 172.21.15.123:0/577618198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68c00cdb70 msgr2=0x7f68c0148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68bffff700 1 --2- 172.21.15.123:0/577618198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68c00cdb70 0x7f68c0148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68bffff700 1 -- 172.21.15.123:0/577618198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b0009570 con 0x7f68c0153770 2024-09-13T17:07:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68bffff700 1 --2- 172.21.15.123:0/577618198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68c0153770 0x7f68c00b0a30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f68b800efc0 tx=0x7f68b8009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68b7fff700 1 -- 172.21.15.123:0/577618198 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8009b20 con 0x7f68c0153770 2024-09-13T17:07:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68b7fff700 1 -- 172.21.15.123:0/577618198 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b800f040 con 0x7f68c0153770 2024-09-13T17:07:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68c4c98700 1 -- 172.21.15.123:0/577618198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c0167c40 con 0x7f68c0153770 2024-09-13T17:07:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68b7fff700 1 -- 172.21.15.123:0/577618198 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b800cc90 con 0x7f68c0153770 2024-09-13T17:07:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68c4c98700 1 -- 172.21.15.123:0/577618198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c00a8ac0 con 0x7f68c0153770 2024-09-13T17:07:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68c4c98700 1 -- 172.21.15.123:0/577618198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c00677f0 con 0x7f68c0153770 2024-09-13T17:07:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.117+0000 7f68b7fff700 1 -- 172.21.15.123:0/577618198 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f68b8014480 con 0x7f68c0153770 2024-09-13T17:07:35.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.121+0000 7f68b7fff700 1 --2- 172.21.15.123:0/577618198 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f68a0066730 0x7f68a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.121+0000 7f68b7fff700 1 -- 172.21.15.123:0/577618198 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f68b8084c50 con 0x7f68c0153770 2024-09-13T17:07:35.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.121+0000 7f68bf7fe700 1 --2- 172.21.15.123:0/577618198 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f68a0066730 0x7f68a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.121+0000 7f68bf7fe700 1 --2- 172.21.15.123:0/577618198 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f68a0066730 0x7f68a0068bf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f68b0000c00 tx=0x7f68b001d040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:35.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.129+0000 7f68b7fff700 1 -- 172.21.15.123:0/577618198 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f68b808a020 con 0x7f68c0153770 2024-09-13T17:07:35.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.337+0000 7f68c4c98700 1 -- 172.21.15.123:0/577618198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68c0166c80 con 0x7f68c0153770 2024-09-13T17:07:35.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.337+0000 7f68b7fff700 1 -- 172.21.15.123:0/577618198 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7f68b8018070 con 0x7f68c0153770 2024-09-13T17:07:35.340 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:35.340 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/721071800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":721071800},{"type":"v1","addr":"172.21.15.123:6835","nonce":721071800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1472515409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1472515409},{"type":"v1","addr":"172.21.15.123:6837","nonce":1472515409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3017694841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3017694841},{"type":"v1","addr":"172.21.15.153:6833","nonce":3017694841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:06:48.418287+0000","modified":"2024-09-13T17:06:51.426119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/2848393496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2848393496},{"type":"v1","addr":"172.21.15.153:6835","nonce":2848393496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:07:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.341+0000 7f68c4c98700 1 -- 172.21.15.123:0/577618198 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f68a0066730 msgr2=0x7f68a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.341+0000 7f68c4c98700 1 --2- 172.21.15.123:0/577618198 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f68a0066730 0x7f68a0068bf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f68b0000c00 tx=0x7f68b001d040 comp rx=0 tx=0).stop 2024-09-13T17:07:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.341+0000 7f68c4c98700 1 -- 172.21.15.123:0/577618198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68c0153770 msgr2=0x7f68c00b0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.341+0000 7f68c4c98700 1 --2- 172.21.15.123:0/577618198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68c0153770 0x7f68c00b0a30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f68b800efc0 tx=0x7f68b8009f60 comp rx=0 tx=0).stop 2024-09-13T17:07:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.341+0000 7f68c4c98700 1 -- 172.21.15.123:0/577618198 shutdown_connections 2024-09-13T17:07:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.341+0000 7f68c4c98700 1 --2- 172.21.15.123:0/577618198 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f68a0066730 0x7f68a0068bf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.341+0000 7f68c4c98700 1 --2- 172.21.15.123:0/577618198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68c0153770 0x7f68c00b0a30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.341+0000 7f68c4c98700 1 --2- 172.21.15.123:0/577618198 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68c0153390 0x7f68c00a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.341+0000 7f68c4c98700 1 --2- 172.21.15.123:0/577618198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68c00cdb70 0x7f68c0148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.341+0000 7f68c4c98700 1 -- 172.21.15.123:0/577618198 >> 172.21.15.123:0/577618198 conn(0x7f68c0066150 msgr2=0x7f68c0148f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:35.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.341+0000 7f68c4c98700 1 -- 172.21.15.123:0/577618198 shutdown_connections 2024-09-13T17:07:35.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.341+0000 7f68c4c98700 1 -- 172.21.15.123:0/577618198 wait complete. 2024-09-13T17:07:35.344 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 7 2024-09-13T17:07:35.356 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:07:35.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda577c5700 1 Processor -- start 2024-09-13T17:07:35.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda577c5700 1 -- start start 2024-09-13T17:07:35.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda577c5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fda5006c760 0x7fda500cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda577c5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda500cf600 con 0x7fda50160fb0 2024-09-13T17:07:35.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda577c5700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5006cd60 con 0x7fda500cec90 2024-09-13T17:07:35.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda577c5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5006d040 con 0x7fda5006c760 2024-09-13T17:07:35.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda55561700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fda50160fb0 0x7fda5006de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50276/0 (socket says 172.21.15.123:50276) 2024-09-13T17:07:35.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda55561700 1 -- 172.21.15.123:0/4240738676 learned_addr learned my addr 172.21.15.123:0/4240738676 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:35.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda55d62700 1 --2- 172.21.15.123:0/4240738676 >> v2:172.21.15.153:3300/0 conn(0x7fda5006c760 0x7fda500cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029752356 0 0) 0x7fda500cf600 con 0x7fda50160fb0 2024-09-13T17:07:35.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda3c0035d0 con 0x7fda50160fb0 2024-09-13T17:07:35.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114174799 0 0) 0x7fda5006cd60 con 0x7fda500cec90 2024-09-13T17:07:35.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda500cf600 con 0x7fda500cec90 2024-09-13T17:07:35.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 213742314 0 0) 0x7fda3c0035d0 con 0x7fda50160fb0 2024-09-13T17:07:35.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 >> v2:172.21.15.153:3300/0 conn(0x7fda5006c760 msgr2=0x7fda500cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:35.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 --2- 172.21.15.123:0/4240738676 >> v2:172.21.15.153:3300/0 conn(0x7fda5006c760 0x7fda500cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 >> v1:172.21.15.153:6789/0 conn(0x7fda500cec90 legacy=0x7fda5006c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5006d320 con 0x7fda50160fb0 2024-09-13T17:07:35.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7fda40001670 con 0x7fda50160fb0 2024-09-13T17:07:35.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 >> v1:172.21.15.123:6789/0 conn(0x7fda50160fb0 legacy=0x7fda5006de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 --2- 172.21.15.123:0/4240738676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda3c003bb0 0x7fda3c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 --2- 172.21.15.123:0/4240738676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda3c004870 0x7fda3c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 --2- 172.21.15.123:0/4240738676 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda3c005230 0x7fda3c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5006d040 con 0x7fda3c003bb0 2024-09-13T17:07:35.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c00c020 con 0x7fda3c004870 2024-09-13T17:07:35.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c00c1e0 con 0x7fda3c005230 2024-09-13T17:07:35.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda55561700 1 --2- 172.21.15.123:0/4240738676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda3c003bb0 0x7fda3c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda55561700 1 -- 172.21.15.123:0/4240738676 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda3c005230 msgr2=0x7fda3c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:35.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda55561700 1 --2- 172.21.15.123:0/4240738676 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda3c005230 0x7fda3c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda55561700 1 -- 172.21.15.123:0/4240738676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda3c004870 msgr2=0x7fda3c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:35.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda54d60700 1 --2- 172.21.15.123:0/4240738676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda3c004870 0x7fda3c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda55561700 1 --2- 172.21.15.123:0/4240738676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda3c004870 0x7fda3c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda55561700 1 -- 172.21.15.123:0/4240738676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c0035d0 con 0x7fda3c003bb0 2024-09-13T17:07:35.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda55d62700 1 -- 172.21.15.123:0/4240738676 reap_dead start 2024-09-13T17:07:35.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda54d60700 1 --2- 172.21.15.123:0/4240738676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda3c004870 0x7fda3c004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:35.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.469+0000 7fda55561700 1 --2- 172.21.15.123:0/4240738676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda3c003bb0 0x7fda3c003fb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fda40001eb0 tx=0x7fda3c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2ede6e8d5f33f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:35.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.473+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4000cd50 con 0x7fda3c003bb0 2024-09-13T17:07:35.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.473+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda40005980 con 0x7fda3c003bb0 2024-09-13T17:07:35.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.473+0000 7fda47fff700 1 -- 172.21.15.123:0/4240738676 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40005d30 con 0x7fda3c003bb0 2024-09-13T17:07:35.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.473+0000 7fda577c5700 1 -- 172.21.15.123:0/4240738676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda3c003bb0 msgr2=0x7fda3c003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.473+0000 7fda577c5700 1 --2- 172.21.15.123:0/4240738676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda3c003bb0 0x7fda3c003fb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fda40001eb0 tx=0x7fda3c0058a0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.473+0000 7fda577c5700 1 -- 172.21.15.123:0/4240738676 shutdown_connections 2024-09-13T17:07:35.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.473+0000 7fda577c5700 1 --2- 172.21.15.123:0/4240738676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda3c003bb0 0x7fda3c003fb0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.473+0000 7fda577c5700 1 -- 172.21.15.123:0/4240738676 >> 172.21.15.123:0/4240738676 conn(0x7fda50066570 msgr2=0x7fda50066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:35.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.473+0000 7fda577c5700 1 -- 172.21.15.123:0/4240738676 shutdown_connections 2024-09-13T17:07:35.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.473+0000 7fda577c5700 1 -- 172.21.15.123:0/4240738676 wait complete. 2024-09-13T17:07:35.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.473+0000 7fda577c5700 1 Processor -- start 2024-09-13T17:07:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.473+0000 7fda577c5700 1 -- start start 2024-09-13T17:07:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.473+0000 7fda577c5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda3c003bb0 0x7fda5014d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda577c5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda50155020 0x7fda501554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda577c5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda501559e0 0x7fda5014db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda577c5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5014d9d0 con 0x7fda50155020 2024-09-13T17:07:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda577c5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda501f6ed0 con 0x7fda501559e0 2024-09-13T17:07:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda577c5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda501e6fa0 con 0x7fda3c003bb0 2024-09-13T17:07:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda54d60700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda50155020 0x7fda501554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda54d60700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda50155020 0x7fda501554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46334/0 (socket says 172.21.15.123:46334) 2024-09-13T17:07:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda54d60700 1 -- 172.21.15.123:0/2818057064 learned_addr learned my addr 172.21.15.123:0/2818057064 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda55561700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda3c003bb0 0x7fda5014d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda55d62700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda501559e0 0x7fda5014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda54d60700 1 -- 172.21.15.123:0/2818057064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda3c003bb0 msgr2=0x7fda5014d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda54d60700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda3c003bb0 0x7fda5014d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda54d60700 1 -- 172.21.15.123:0/2818057064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda501559e0 msgr2=0x7fda5014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda54d60700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda501559e0 0x7fda5014db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda54d60700 1 -- 172.21.15.123:0/2818057064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda501e7fe0 con 0x7fda50155020 2024-09-13T17:07:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda55561700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda3c003bb0 0x7fda5014d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda54d60700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda50155020 0x7fda501554a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fda48001fc0 tx=0x7fda4800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda45ffb700 1 -- 172.21.15.123:0/2818057064 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4800bdd0 con 0x7fda50155020 2024-09-13T17:07:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda45ffb700 1 -- 172.21.15.123:0/2818057064 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda480123f0 con 0x7fda50155020 2024-09-13T17:07:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda577c5700 1 -- 172.21.15.123:0/2818057064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda501e7220 con 0x7fda50155020 2024-09-13T17:07:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda45ffb700 1 -- 172.21.15.123:0/2818057064 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda480127a0 con 0x7fda50155020 2024-09-13T17:07:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda577c5700 1 -- 172.21.15.123:0/2818057064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda501e77e0 con 0x7fda50155020 2024-09-13T17:07:35.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda577c5700 1 -- 172.21.15.123:0/2818057064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5006c050 con 0x7fda50155020 2024-09-13T17:07:35.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda45ffb700 1 -- 172.21.15.123:0/2818057064 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fda48012900 con 0x7fda50155020 2024-09-13T17:07:35.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.477+0000 7fda45ffb700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fda34066760 0x7fda34068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.481+0000 7fda45ffb700 1 -- 172.21.15.123:0/2818057064 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fda48084850 con 0x7fda50155020 2024-09-13T17:07:35.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.481+0000 7fda55561700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fda34066760 0x7fda34068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.481+0000 7fda55561700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fda34066760 0x7fda34068c20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fda40015040 tx=0x7fda4000a000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:35.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.489+0000 7fda45ffb700 1 -- 172.21.15.123:0/2818057064 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fda48051bd0 con 0x7fda50155020 2024-09-13T17:07:35.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.693+0000 7fda577c5700 1 -- 172.21.15.123:0/2818057064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda5015ef90 con 0x7fda50155020 2024-09-13T17:07:35.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.693+0000 7fda45ffb700 1 -- 172.21.15.123:0/2818057064 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4737 (secure 0 0 0) 0x7fda48020090 con 0x7fda50155020 2024-09-13T17:07:35.696 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:35.696 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/721071800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":721071800},{"type":"v1","addr":"172.21.15.123:6835","nonce":721071800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1472515409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1472515409},{"type":"v1","addr":"172.21.15.123:6837","nonce":1472515409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3017694841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3017694841},{"type":"v1","addr":"172.21.15.153:6833","nonce":3017694841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:06:48.418287+0000","modified":"2024-09-13T17:06:51.426119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/2848393496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2848393496},{"type":"v1","addr":"172.21.15.153:6835","nonce":2848393496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:07:35.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.697+0000 7fda577c5700 1 -- 172.21.15.123:0/2818057064 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fda34066760 msgr2=0x7fda34068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.697+0000 7fda577c5700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fda34066760 0x7fda34068c20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fda40015040 tx=0x7fda4000a000 comp rx=0 tx=0).stop 2024-09-13T17:07:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.697+0000 7fda577c5700 1 -- 172.21.15.123:0/2818057064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda50155020 msgr2=0x7fda501554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.697+0000 7fda577c5700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda50155020 0x7fda501554a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fda48001fc0 tx=0x7fda4800b3b0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.697+0000 7fda577c5700 1 -- 172.21.15.123:0/2818057064 shutdown_connections 2024-09-13T17:07:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.697+0000 7fda577c5700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fda34066760 0x7fda34068c20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.697+0000 7fda577c5700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda501559e0 0x7fda5014db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.697+0000 7fda577c5700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda50155020 0x7fda501554a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.697+0000 7fda577c5700 1 --2- 172.21.15.123:0/2818057064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda3c003bb0 0x7fda5014d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.697+0000 7fda577c5700 1 -- 172.21.15.123:0/2818057064 >> 172.21.15.123:0/2818057064 conn(0x7fda50066570 msgr2=0x7fda500ae410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.697+0000 7fda577c5700 1 -- 172.21.15.123:0/2818057064 shutdown_connections 2024-09-13T17:07:35.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.697+0000 7fda577c5700 1 -- 172.21.15.123:0/2818057064 wait complete. 2024-09-13T17:07:35.700 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 7 2024-09-13T17:07:35.710 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:35.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.817+0000 7f7501114700 1 Processor -- start 2024-09-13T17:07:35.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.817+0000 7f7501114700 1 -- start start 2024-09-13T17:07:35.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.817+0000 7f7501114700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f74fc1602d0 0x7f74fc0d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.817+0000 7f7501114700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f74fc0d3680 0x7f74fc0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.817+0000 7f7501114700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc0d0ea0 con 0x7f74fc0cf750 2024-09-13T17:07:35.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.817+0000 7f7501114700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc0ceab0 con 0x7f74fc0d3680 2024-09-13T17:07:35.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.817+0000 7f7501114700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc0cff00 con 0x7f74fc1602d0 2024-09-13T17:07:35.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.817+0000 7f74fb7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f74fc0d3680 0x7f74fc0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f74fb7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f74fc0d3680 0x7f74fc0cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46344/0 (socket says 172.21.15.123:46344) 2024-09-13T17:07:35.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f74fb7fe700 1 -- 172.21.15.123:0/2363759350 learned_addr learned my addr 172.21.15.123:0/2363759350 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:35.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f7500913700 1 --1- 172.21.15.123:0/2363759350 >> v1:172.21.15.123:6789/0 conn(0x7f74fc0cf750 0x7f74fc0cd670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50290/0 (socket says 172.21.15.123:50290) 2024-09-13T17:07:35.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f74fbfff700 1 --2- 172.21.15.123:0/2363759350 >> v2:172.21.15.153:3300/0 conn(0x7f74fc1602d0 0x7f74fc0d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f74fb7fe700 1 -- 172.21.15.123:0/2363759350 >> v2:172.21.15.153:3300/0 conn(0x7f74fc1602d0 msgr2=0x7f74fc0d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:35.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f74fb7fe700 1 --2- 172.21.15.123:0/2363759350 >> v2:172.21.15.153:3300/0 conn(0x7f74fc1602d0 0x7f74fc0d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f74fb7fe700 1 -- 172.21.15.123:0/2363759350 >> v1:172.21.15.123:6789/0 conn(0x7f74fc0cf750 legacy=0x7f74fc0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f74fb7fe700 1 -- 172.21.15.123:0/2363759350 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc0d0c70 con 0x7f74fc0d3680 2024-09-13T17:07:35.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f74fb7fe700 1 --2- 172.21.15.123:0/2363759350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74fc0d3680 0x7f74fc0cf210 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009910 tx=0x7f74e4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380a9c1f20f5fc64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:35.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f74faffd700 1 -- 172.21.15.123:0/2363759350 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e400ba20 con 0x7f74fc0d3680 2024-09-13T17:07:35.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f74faffd700 1 -- 172.21.15.123:0/2363759350 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e400bb80 con 0x7f74fc0d3680 2024-09-13T17:07:35.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f74faffd700 1 -- 172.21.15.123:0/2363759350 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4009e60 con 0x7f74fc0d3680 2024-09-13T17:07:35.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f7501114700 1 -- 172.21.15.123:0/2363759350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74fc0d3680 msgr2=0x7f74fc0cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f7501114700 1 --2- 172.21.15.123:0/2363759350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74fc0d3680 0x7f74fc0cf210 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009910 tx=0x7f74e4009c20 comp rx=0 tx=0).stop 2024-09-13T17:07:35.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f7501114700 1 -- 172.21.15.123:0/2363759350 shutdown_connections 2024-09-13T17:07:35.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f7501114700 1 --2- 172.21.15.123:0/2363759350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74fc0d3680 0x7f74fc0cf210 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f7501114700 1 --2- 172.21.15.123:0/2363759350 >> v2:172.21.15.153:3300/0 conn(0x7f74fc1602d0 0x7f74fc0d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f7501114700 1 -- 172.21.15.123:0/2363759350 >> 172.21.15.123:0/2363759350 conn(0x7f74fc0d2b60 msgr2=0x7f74fc0d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:35.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f7501114700 1 -- 172.21.15.123:0/2363759350 shutdown_connections 2024-09-13T17:07:35.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.821+0000 7f7501114700 1 -- 172.21.15.123:0/2363759350 wait complete. 2024-09-13T17:07:35.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.825+0000 7f7501114700 1 Processor -- start 2024-09-13T17:07:35.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.825+0000 7f7501114700 1 -- start start 2024-09-13T17:07:35.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.825+0000 7f7501114700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74fc0cf750 0x7f74fc1517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.825+0000 7f7501114700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74fc0d3680 0x7f74fc14e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.825+0000 7f7501114700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74fc1602d0 0x7f74fc0b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.825+0000 7f7501114700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0b1df0 con 0x7f74fc0d3680 2024-09-13T17:07:35.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.825+0000 7f7501114700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0b20c0 con 0x7f74fc0cf750 2024-09-13T17:07:35.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.825+0000 7f7501114700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0b23a0 con 0x7f74fc1602d0 2024-09-13T17:07:35.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.825+0000 7f74fb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74fc0d3680 0x7f74fc14e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.825+0000 7f74fb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74fc0d3680 0x7f74fc14e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46352/0 (socket says 172.21.15.123:46352) 2024-09-13T17:07:35.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.825+0000 7f74fb7fe700 1 -- 172.21.15.123:0/447499273 learned_addr learned my addr 172.21.15.123:0/447499273 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.825+0000 7f74fbfff700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74fc0cf750 0x7f74fc1517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.825+0000 7f7500913700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74fc1602d0 0x7f74fc0b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f74fb7fe700 1 -- 172.21.15.123:0/447499273 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74fc1602d0 msgr2=0x7f74fc0b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f74fb7fe700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74fc1602d0 0x7f74fc0b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f74fb7fe700 1 -- 172.21.15.123:0/447499273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74fc0cf750 msgr2=0x7f74fc1517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f74fb7fe700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74fc0cf750 0x7f74fc1517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f74fb7fe700 1 -- 172.21.15.123:0/447499273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e4009570 con 0x7f74fc0d3680 2024-09-13T17:07:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f7500913700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74fc1602d0 0x7f74fc0b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:35.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f74fb7fe700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74fc0d3680 0x7f74fc14e3b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f74fc08b160 tx=0x7f74e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:35.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f74f8ff9700 1 -- 172.21.15.123:0/447499273 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e401a710 con 0x7f74fc0d3680 2024-09-13T17:07:35.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f74f8ff9700 1 -- 172.21.15.123:0/447499273 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e401f070 con 0x7f74fc0d3680 2024-09-13T17:07:35.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f7501114700 1 -- 172.21.15.123:0/447499273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74fc0b2680 con 0x7f74fc0d3680 2024-09-13T17:07:35.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f74f8ff9700 1 -- 172.21.15.123:0/447499273 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e401aa90 con 0x7f74fc0d3680 2024-09-13T17:07:35.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f7501114700 1 -- 172.21.15.123:0/447499273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74fc0b43a0 con 0x7f74fc0d3680 2024-09-13T17:07:35.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f7501114700 1 -- 172.21.15.123:0/447499273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74fc1606b0 con 0x7f74fc0d3680 2024-09-13T17:07:35.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f74f8ff9700 1 -- 172.21.15.123:0/447499273 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f74e4021030 con 0x7f74fc0d3680 2024-09-13T17:07:35.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.829+0000 7f74f8ff9700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f74dc066730 0x7f74dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:35.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.833+0000 7f74fbfff700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f74dc066730 0x7f74dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:35.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.833+0000 7f74f8ff9700 1 -- 172.21.15.123:0/447499273 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f74e4085700 con 0x7f74fc0d3680 2024-09-13T17:07:35.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.833+0000 7f74fbfff700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f74dc066730 0x7f74dc068bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009a00 tx=0x7f74ec008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:35.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:35.837+0000 7f74f8ff9700 1 -- 172.21.15.123:0/447499273 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f74e40529e0 con 0x7f74fc0d3680 2024-09-13T17:07:36.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.009+0000 7f7501114700 1 -- 172.21.15.123:0/447499273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74fc071150 con 0x7f74fc0d3680 2024-09-13T17:07:36.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.013+0000 7f74f8ff9700 1 -- 172.21.15.123:0/447499273 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16803 (secure 0 0 0) 0x7f74e4056000 con 0x7f74fc0d3680 2024-09-13T17:07:36.014 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:36.015 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:07:31.905768+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:06:47.016013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:06:47.420727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.013+0000 7f7501114700 1 -- 172.21.15.123:0/447499273 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f74dc066730 msgr2=0x7f74dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.013+0000 7f7501114700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f74dc066730 0x7f74dc068bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009a00 tx=0x7f74ec008040 comp rx=0 tx=0).stop 2024-09-13T17:07:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.013+0000 7f7501114700 1 -- 172.21.15.123:0/447499273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74fc0d3680 msgr2=0x7f74fc14e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.013+0000 7f7501114700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74fc0d3680 0x7f74fc14e3b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f74fc08b160 tx=0x7f74e4004770 comp rx=0 tx=0).stop 2024-09-13T17:07:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.013+0000 7f7501114700 1 -- 172.21.15.123:0/447499273 shutdown_connections 2024-09-13T17:07:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.013+0000 7f7501114700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f74dc066730 0x7f74dc068bf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.013+0000 7f7501114700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74fc1602d0 0x7f74fc0b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.013+0000 7f7501114700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74fc0d3680 0x7f74fc14e3b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.013+0000 7f7501114700 1 --2- 172.21.15.123:0/447499273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74fc0cf750 0x7f74fc1517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.013+0000 7f7501114700 1 -- 172.21.15.123:0/447499273 >> 172.21.15.123:0/447499273 conn(0x7f74fc0d2b60 msgr2=0x7f74fc0cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.013+0000 7f7501114700 1 -- 172.21.15.123:0/447499273 shutdown_connections 2024-09-13T17:07:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.013+0000 7f7501114700 1 -- 172.21.15.123:0/447499273 wait complete. 2024-09-13T17:07:36.029 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:07:36.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.141+0000 7f582dd69700 1 Processor -- start 2024-09-13T17:07:36.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.141+0000 7f582dd69700 1 -- start start 2024-09-13T17:07:36.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f582dd69700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f58280b58b0 0x7f58280d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:36.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f582dd69700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58280b0060 con 0x7f58280d0f40 2024-09-13T17:07:36.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f582dd69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58280b0340 con 0x7f58280cd5e0 2024-09-13T17:07:36.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f582dd69700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58280b0620 con 0x7f58280b58b0 2024-09-13T17:07:36.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f582cd67700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f58280d0f40 0x7f58280d1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50302/0 (socket says 172.21.15.123:50302) 2024-09-13T17:07:36.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f5827fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f58280b58b0 0x7f58280d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:36.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f582cd67700 1 -- 172.21.15.123:0/3984277027 learned_addr learned my addr 172.21.15.123:0/3984277027 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:36.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f5827fff700 1 -- 172.21.15.123:0/3984277027 >> v1:172.21.15.153:6789/0 conn(0x7f58280cd5e0 legacy=0x7f58280cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:36.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f5827fff700 1 -- 172.21.15.123:0/3984277027 >> v1:172.21.15.123:6789/0 conn(0x7f58280d0f40 legacy=0x7f58280d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:36.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f5827fff700 1 -- 172.21.15.123:0/3984277027 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280b0900 con 0x7f58280b58b0 2024-09-13T17:07:36.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f5827fff700 1 --2- 172.21.15.123:0/3984277027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58280b58b0 0x7f58280d05a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5818009850 tx=0x7f5818009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56698109f788ca20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:36.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f58277fe700 1 -- 172.21.15.123:0/3984277027 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5818004230 con 0x7f58280b58b0 2024-09-13T17:07:36.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f58277fe700 1 -- 172.21.15.123:0/3984277027 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5818004390 con 0x7f58280b58b0 2024-09-13T17:07:36.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f58277fe700 1 -- 172.21.15.123:0/3984277027 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58180036c0 con 0x7f58280b58b0 2024-09-13T17:07:36.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f582dd69700 1 -- 172.21.15.123:0/3984277027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58280b58b0 msgr2=0x7f58280d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:36.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f582dd69700 1 --2- 172.21.15.123:0/3984277027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58280b58b0 0x7f58280d05a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5818009850 tx=0x7f5818009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:36.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f582dd69700 1 -- 172.21.15.123:0/3984277027 shutdown_connections 2024-09-13T17:07:36.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f582dd69700 1 --2- 172.21.15.123:0/3984277027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58280b58b0 0x7f58280d05a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f582dd69700 1 -- 172.21.15.123:0/3984277027 >> 172.21.15.123:0/3984277027 conn(0x7f58280d2a60 msgr2=0x7f58280d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:36.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f582dd69700 1 -- 172.21.15.123:0/3984277027 shutdown_connections 2024-09-13T17:07:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.145+0000 7f582dd69700 1 -- 172.21.15.123:0/3984277027 wait complete. 2024-09-13T17:07:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582dd69700 1 Processor -- start 2024-09-13T17:07:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582dd69700 1 -- start start 2024-09-13T17:07:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582dd69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58280b58b0 0x7f582815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582dd69700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58280cd5e0 0x7f58280c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582dd69700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58280d0f40 0x7f582815f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582dd69700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58281f3750 con 0x7f58280d0f40 2024-09-13T17:07:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582dd69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58281f2ad0 con 0x7f58280b58b0 2024-09-13T17:07:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582dd69700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58281f2db0 con 0x7f58280cd5e0 2024-09-13T17:07:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582d568700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58280d0f40 0x7f582815f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582cd67700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58280b58b0 0x7f582815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f5827fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58280cd5e0 0x7f58280c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582cd67700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58280b58b0 0x7f582815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:35748/0 (socket says 172.21.15.123:35748) 2024-09-13T17:07:36.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f5827fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58280cd5e0 0x7f58280c9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:50106/0 (socket says 172.21.15.123:50106) 2024-09-13T17:07:36.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582cd67700 1 -- 172.21.15.123:0/2934222675 learned_addr learned my addr 172.21.15.123:0/2934222675 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582d568700 1 -- 172.21.15.123:0/2934222675 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58280cd5e0 msgr2=0x7f58280c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582d568700 1 --2- 172.21.15.123:0/2934222675 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58280cd5e0 0x7f58280c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582d568700 1 -- 172.21.15.123:0/2934222675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58280b58b0 msgr2=0x7f582815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582d568700 1 --2- 172.21.15.123:0/2934222675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58280b58b0 0x7f582815bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582d568700 1 -- 172.21.15.123:0/2934222675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58180094b0 con 0x7f58280d0f40 2024-09-13T17:07:36.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.149+0000 7f582cd67700 1 --2- 172.21.15.123:0/2934222675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58280b58b0 0x7f582815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:36.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.153+0000 7f582d568700 1 --2- 172.21.15.123:0/2934222675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58280d0f40 0x7f582815f340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f582000ca30 tx=0x7f582000cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:36.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.153+0000 7f58257fa700 1 -- 172.21.15.123:0/2934222675 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820003c20 con 0x7f58280d0f40 2024-09-13T17:07:36.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.153+0000 7f58257fa700 1 -- 172.21.15.123:0/2934222675 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820003d80 con 0x7f58280d0f40 2024-09-13T17:07:36.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.153+0000 7f58257fa700 1 -- 172.21.15.123:0/2934222675 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000aa20 con 0x7f58280d0f40 2024-09-13T17:07:36.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.153+0000 7f582dd69700 1 -- 172.21.15.123:0/2934222675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58281f3090 con 0x7f58280d0f40 2024-09-13T17:07:36.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.153+0000 7f582dd69700 1 -- 172.21.15.123:0/2934222675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582815c420 con 0x7f58280d0f40 2024-09-13T17:07:36.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.153+0000 7f582dd69700 1 -- 172.21.15.123:0/2934222675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58280d1320 con 0x7f58280d0f40 2024-09-13T17:07:36.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.153+0000 7f58257fa700 1 -- 172.21.15.123:0/2934222675 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f582000ab80 con 0x7f58280d0f40 2024-09-13T17:07:36.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.157+0000 7f58257fa700 1 --2- 172.21.15.123:0/2934222675 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5808066730 0x7f5808068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:36.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.157+0000 7f58257fa700 1 -- 172.21.15.123:0/2934222675 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5820083f20 con 0x7f58280d0f40 2024-09-13T17:07:36.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.157+0000 7f582cd67700 1 --2- 172.21.15.123:0/2934222675 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5808066730 0x7f5808068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:36.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.157+0000 7f582cd67700 1 --2- 172.21.15.123:0/2934222675 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5808066730 0x7f5808068bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5810007d50 tx=0x7f5810007ca0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:36.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.165+0000 7f58257fa700 1 -- 172.21.15.123:0/2934222675 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f58200512a0 con 0x7f58280d0f40 2024-09-13T17:07:36.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.369+0000 7f582dd69700 1 -- 172.21.15.123:0/2934222675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f582808c250 con 0x7f58280d0f40 2024-09-13T17:07:36.373 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-13T17:07:36.369+0000 7f1c63ac9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:07:36.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.381+0000 7f58257fa700 1 -- 172.21.15.123:0/2934222675 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f58200548c0 con 0x7f58280d0f40 2024-09-13T17:07:36.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.385+0000 7f582dd69700 1 -- 172.21.15.123:0/2934222675 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5808066730 msgr2=0x7f5808068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:36.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.385+0000 7f582dd69700 1 --2- 172.21.15.123:0/2934222675 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5808066730 0x7f5808068bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5810007d50 tx=0x7f5810007ca0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.385+0000 7f582dd69700 1 -- 172.21.15.123:0/2934222675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58280d0f40 msgr2=0x7f582815f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:36.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.385+0000 7f582dd69700 1 --2- 172.21.15.123:0/2934222675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58280d0f40 0x7f582815f340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f582000ca30 tx=0x7f582000cd40 comp rx=0 tx=0).stop 2024-09-13T17:07:36.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.385+0000 7f582dd69700 1 -- 172.21.15.123:0/2934222675 shutdown_connections 2024-09-13T17:07:36.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.385+0000 7f582dd69700 1 --2- 172.21.15.123:0/2934222675 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5808066730 0x7f5808068bf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.385+0000 7f582dd69700 1 --2- 172.21.15.123:0/2934222675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58280d0f40 0x7f582815f340 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.385+0000 7f582dd69700 1 --2- 172.21.15.123:0/2934222675 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58280cd5e0 0x7f58280c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.385+0000 7f582dd69700 1 --2- 172.21.15.123:0/2934222675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58280b58b0 0x7f582815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.385+0000 7f582dd69700 1 -- 172.21.15.123:0/2934222675 >> 172.21.15.123:0/2934222675 conn(0x7f58280d2a60 msgr2=0x7f58280cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:36.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.385+0000 7f582dd69700 1 -- 172.21.15.123:0/2934222675 shutdown_connections 2024-09-13T17:07:36.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.385+0000 7f582dd69700 1 -- 172.21.15.123:0/2934222675 wait complete. 2024-09-13T17:07:36.390 INFO:tasks.ceph.mds.b.smithi153.stderr: -2850> 2024-09-13T17:06:53.452+0000 7f93cc231700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:07:36.391 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:07:36.402 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:07:36.423 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-09-13T17:07:36.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.529+0000 7fadfb57f700 1 Processor -- start 2024-09-13T17:07:36.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.529+0000 7fadfb57f700 1 -- start start 2024-09-13T17:07:36.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.529+0000 7fadfb57f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadf4158d90 0x7fadf406a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:36.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.529+0000 7fadfb57f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fadf40b2fb0 0x7fadf406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:36.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.529+0000 7fadfb57f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf40b35d0 con 0x7fadf4159170 2024-09-13T17:07:36.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.529+0000 7fadfb57f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf40b3b90 con 0x7fadf40b2fb0 2024-09-13T17:07:36.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.529+0000 7fadfb57f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40b38b0 con 0x7fadf4158d90 2024-09-13T17:07:36.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.529+0000 7fadfad7e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fadf40b2fb0 0x7fadf406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:36.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.529+0000 7fadfa57d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadf4158d90 0x7fadf406a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:36.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.529+0000 7fadfad7e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fadf40b2fb0 0x7fadf406a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:35750/0 (socket says 172.21.15.123:35750) 2024-09-13T17:07:36.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.529+0000 7fadfad7e700 1 -- 172.21.15.123:0/3347781600 learned_addr learned my addr 172.21.15.123:0/3347781600 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:36.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadfa57d700 1 -- 172.21.15.123:0/3347781600 >> v2:172.21.15.153:3300/0 conn(0x7fadf40b2fb0 msgr2=0x7fadf406a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:36.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadfa57d700 1 --2- 172.21.15.123:0/3347781600 >> v2:172.21.15.153:3300/0 conn(0x7fadf40b2fb0 0x7fadf406a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadfa57d700 1 -- 172.21.15.123:0/3347781600 >> v1:172.21.15.153:6789/0 conn(0x7fadf4159170 legacy=0x7fadf40b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:36.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadfa57d700 1 -- 172.21.15.123:0/3347781600 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf4159610 con 0x7fadf4158d90 2024-09-13T17:07:36.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadfa57d700 1 --2- 172.21.15.123:0/3347781600 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadf4158d90 0x7fadf406a260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009850 tx=0x7fadf0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8deca7339ffa0c82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:36.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadf957b700 1 -- 172.21.15.123:0/3347781600 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0011830 con 0x7fadf4158d90 2024-09-13T17:07:36.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadf957b700 1 -- 172.21.15.123:0/3347781600 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf0011990 con 0x7fadf4158d90 2024-09-13T17:07:36.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadf957b700 1 -- 172.21.15.123:0/3347781600 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0011d40 con 0x7fadf4158d90 2024-09-13T17:07:36.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadfb57f700 1 -- 172.21.15.123:0/3347781600 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadf4158d90 msgr2=0x7fadf406a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:36.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadfb57f700 1 --2- 172.21.15.123:0/3347781600 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadf4158d90 0x7fadf406a260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009850 tx=0x7fadf0009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:36.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadfb57f700 1 -- 172.21.15.123:0/3347781600 shutdown_connections 2024-09-13T17:07:36.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadfb57f700 1 --2- 172.21.15.123:0/3347781600 >> v2:172.21.15.153:3300/0 conn(0x7fadf40b2fb0 0x7fadf406a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadfb57f700 1 --2- 172.21.15.123:0/3347781600 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadf4158d90 0x7fadf406a260 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadfb57f700 1 -- 172.21.15.123:0/3347781600 >> 172.21.15.123:0/3347781600 conn(0x7fadf406f940 msgr2=0x7fadf40b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:36.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadfb57f700 1 -- 172.21.15.123:0/3347781600 shutdown_connections 2024-09-13T17:07:36.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.533+0000 7fadfb57f700 1 -- 172.21.15.123:0/3347781600 wait complete. 2024-09-13T17:07:36.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.537+0000 7fadfb57f700 1 Processor -- start 2024-09-13T17:07:36.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.537+0000 7fadfb57f700 1 -- start start 2024-09-13T17:07:36.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.537+0000 7fadfb57f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadf40b2fb0 0x7fadf41e2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:36.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.537+0000 7fadfb57f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadf4158d90 0x7fadf4153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:36.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.537+0000 7fadfb57f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadf4159170 0x7fadf4145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:36.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.537+0000 7fadfb57f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf41e3fa0 con 0x7fadf4159170 2024-09-13T17:07:36.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.537+0000 7fadfb57f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf41e1880 con 0x7fadf40b2fb0 2024-09-13T17:07:36.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.537+0000 7fadfb57f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf41e1b60 con 0x7fadf4158d90 2024-09-13T17:07:36.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.537+0000 7fadfad7e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadf4159170 0x7fadf4145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:36.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.537+0000 7fadfad7e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadf4159170 0x7fadf4145610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46368/0 (socket says 172.21.15.123:46368) 2024-09-13T17:07:36.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.537+0000 7fadfad7e700 1 -- 172.21.15.123:0/2614274860 learned_addr learned my addr 172.21.15.123:0/2614274860 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:36.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.537+0000 7fadfa57d700 1 --2- 172.21.15.123:0/2614274860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadf40b2fb0 0x7fadf41e2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:36.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.537+0000 7fadf9d7c700 1 --2- 172.21.15.123:0/2614274860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadf4158d90 0x7fadf4153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:36.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadfad7e700 1 -- 172.21.15.123:0/2614274860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadf4158d90 msgr2=0x7fadf4153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:36.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadfad7e700 1 --2- 172.21.15.123:0/2614274860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadf4158d90 0x7fadf4153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadfad7e700 1 -- 172.21.15.123:0/2614274860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadf40b2fb0 msgr2=0x7fadf41e2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:36.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadfad7e700 1 --2- 172.21.15.123:0/2614274860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadf40b2fb0 0x7fadf41e2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:36.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadfad7e700 1 -- 172.21.15.123:0/2614274860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00094b0 con 0x7fadf4159170 2024-09-13T17:07:36.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadfad7e700 1 --2- 172.21.15.123:0/2614274860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadf4159170 0x7fadf4145610 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fadec00efc0 tx=0x7fadec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:36.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadeaffd700 1 -- 172.21.15.123:0/2614274860 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec003c40 con 0x7fadf4159170 2024-09-13T17:07:36.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadeaffd700 1 -- 172.21.15.123:0/2614274860 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec00f040 con 0x7fadf4159170 2024-09-13T17:07:36.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadfb57f700 1 -- 172.21.15.123:0/2614274860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf41e1e40 con 0x7fadf4159170 2024-09-13T17:07:36.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadfb57f700 1 -- 172.21.15.123:0/2614274860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf41543e0 con 0x7fadf4159170 2024-09-13T17:07:36.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadeaffd700 1 -- 172.21.15.123:0/2614274860 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec00c930 con 0x7fadf4159170 2024-09-13T17:07:36.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadfb57f700 1 -- 172.21.15.123:0/2614274860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc005310 con 0x7fadf4159170 2024-09-13T17:07:36.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadeaffd700 1 -- 172.21.15.123:0/2614274860 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fadec00ca90 con 0x7fadf4159170 2024-09-13T17:07:36.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadeaffd700 1 --2- 172.21.15.123:0/2614274860 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fadd8066730 0x7fadd8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:36.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadfa57d700 1 --2- 172.21.15.123:0/2614274860 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fadd8066730 0x7fadd8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:36.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.541+0000 7fadeaffd700 1 -- 172.21.15.123:0/2614274860 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fadec0846d0 con 0x7fadf4159170 2024-09-13T17:07:36.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.545+0000 7fadfa57d700 1 --2- 172.21.15.123:0/2614274860 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fadd8066730 0x7fadd8068bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fadf00090b0 tx=0x7fadf0008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:36.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.553+0000 7fadeaffd700 1 -- 172.21.15.123:0/2614274860 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fadec051960 con 0x7fadf4159170 2024-09-13T17:07:36.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:36.757+0000 7fadfb57f700 1 -- 172.21.15.123:0/2614274860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faddc005b40 con 0x7fadf4159170 2024-09-13T17:07:37.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.393+0000 7fadeaffd700 1 -- 172.21.15.123:0/2614274860 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fadec054f80 con 0x7fadf4159170 2024-09-13T17:07:37.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.401+0000 7fadfb57f700 1 -- 172.21.15.123:0/2614274860 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fadd8066730 msgr2=0x7fadd8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:37.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.401+0000 7fadfb57f700 1 --2- 172.21.15.123:0/2614274860 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fadd8066730 0x7fadd8068bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fadf00090b0 tx=0x7fadf0008030 comp rx=0 tx=0).stop 2024-09-13T17:07:37.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.401+0000 7fadfb57f700 1 -- 172.21.15.123:0/2614274860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadf4159170 msgr2=0x7fadf4145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:37.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.401+0000 7fadfb57f700 1 --2- 172.21.15.123:0/2614274860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadf4159170 0x7fadf4145610 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fadec00efc0 tx=0x7fadec00c3a0 comp rx=0 tx=0).stop 2024-09-13T17:07:37.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.401+0000 7fadfb57f700 1 -- 172.21.15.123:0/2614274860 shutdown_connections 2024-09-13T17:07:37.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.401+0000 7fadfb57f700 1 --2- 172.21.15.123:0/2614274860 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fadd8066730 0x7fadd8068bf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:37.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.401+0000 7fadfb57f700 1 --2- 172.21.15.123:0/2614274860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadf4159170 0x7fadf4145610 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:37.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.401+0000 7fadfb57f700 1 --2- 172.21.15.123:0/2614274860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadf4158d90 0x7fadf4153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:37.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.401+0000 7fadfb57f700 1 --2- 172.21.15.123:0/2614274860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadf40b2fb0 0x7fadf41e2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:37.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.401+0000 7fadfb57f700 1 -- 172.21.15.123:0/2614274860 >> 172.21.15.123:0/2614274860 conn(0x7fadf406f940 msgr2=0x7fadf415b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:37.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.401+0000 7fadfb57f700 1 -- 172.21.15.123:0/2614274860 shutdown_connections 2024-09-13T17:07:37.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.401+0000 7fadfb57f700 1 -- 172.21.15.123:0/2614274860 wait complete. 2024-09-13T17:07:37.417 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:07:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.541+0000 7fe7f66ca700 1 Processor -- start 2024-09-13T17:07:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.541+0000 7fe7f66ca700 1 -- start start 2024-09-13T17:07:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.541+0000 7fe7f66ca700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe7f0155010 0x7fe7f0158a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.541+0000 7fe7f66ca700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7f015b870 0x7fe7f006dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.541+0000 7fe7f66ca700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f015c3f0 con 0x7fe7f006e500 2024-09-13T17:07:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.541+0000 7fe7f66ca700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f006e990 con 0x7fe7f015b870 2024-09-13T17:07:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.541+0000 7fe7f66ca700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f015c6d0 con 0x7fe7f0155010 2024-09-13T17:07:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.541+0000 7fe7f4ec7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7f015b870 0x7fe7f006dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.541+0000 7fe7f5ec9700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe7f006e500 0x7fe7f015d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50316/0 (socket says 172.21.15.123:50316) 2024-09-13T17:07:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.541+0000 7fe7f5ec9700 1 -- 172.21.15.123:0/1878124446 learned_addr learned my addr 172.21.15.123:0/1878124446 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f56c8700 1 --2- 172.21.15.123:0/1878124446 >> v2:172.21.15.153:3300/0 conn(0x7fe7f0155010 0x7fe7f0158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7effff700 1 -- 172.21.15.123:0/1878124446 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240167931 0 0) 0x7fe7f015c3f0 con 0x7fe7f006e500 2024-09-13T17:07:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7effff700 1 -- 172.21.15.123:0/1878124446 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7d80035d0 con 0x7fe7f006e500 2024-09-13T17:07:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f4ec7700 1 -- 172.21.15.123:0/1878124446 >> v2:172.21.15.153:3300/0 conn(0x7fe7f0155010 msgr2=0x7fe7f0158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f4ec7700 1 --2- 172.21.15.123:0/1878124446 >> v2:172.21.15.153:3300/0 conn(0x7fe7f0155010 0x7fe7f0158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f4ec7700 1 -- 172.21.15.123:0/1878124446 >> v1:172.21.15.123:6789/0 conn(0x7fe7f006e500 legacy=0x7fe7f015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f4ec7700 1 -- 172.21.15.123:0/1878124446 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f015c9b0 con 0x7fe7f015b870 2024-09-13T17:07:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f4ec7700 1 --2- 172.21.15.123:0/1878124446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f015b870 0x7fe7f006dfc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe7f006a490 tx=0x7fe7e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f558209f042e98c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7effff700 1 -- 172.21.15.123:0/1878124446 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e000e070 con 0x7fe7f015b870 2024-09-13T17:07:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7effff700 1 -- 172.21.15.123:0/1878124446 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e000bb20 con 0x7fe7f015b870 2024-09-13T17:07:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7effff700 1 -- 172.21.15.123:0/1878124446 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0012430 con 0x7fe7f015b870 2024-09-13T17:07:37.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f66ca700 1 -- 172.21.15.123:0/1878124446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f015b870 msgr2=0x7fe7f006dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:37.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f66ca700 1 --2- 172.21.15.123:0/1878124446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f015b870 0x7fe7f006dfc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe7f006a490 tx=0x7fe7e000b330 comp rx=0 tx=0).stop 2024-09-13T17:07:37.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f66ca700 1 -- 172.21.15.123:0/1878124446 shutdown_connections 2024-09-13T17:07:37.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f66ca700 1 --2- 172.21.15.123:0/1878124446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f015b870 0x7fe7f006dfc0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:37.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f66ca700 1 --2- 172.21.15.123:0/1878124446 >> v2:172.21.15.153:3300/0 conn(0x7fe7f0155010 0x7fe7f0158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:37.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f66ca700 1 -- 172.21.15.123:0/1878124446 >> 172.21.15.123:0/1878124446 conn(0x7fe7f0072730 msgr2=0x7fe7f0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:37.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f66ca700 1 -- 172.21.15.123:0/1878124446 shutdown_connections 2024-09-13T17:07:37.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f66ca700 1 -- 172.21.15.123:0/1878124446 wait complete. 2024-09-13T17:07:37.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f66ca700 1 Processor -- start 2024-09-13T17:07:37.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.545+0000 7fe7f66ca700 1 -- start start 2024-09-13T17:07:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f66ca700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f006e500 0x7fe7f014c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f66ca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7f0155010 0x7fe7f006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f66ca700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7f015b870 0x7fe7f00b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f66ca700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f006c630 con 0x7fe7f006e500 2024-09-13T17:07:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f66ca700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f006c910 con 0x7fe7f0155010 2024-09-13T17:07:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f66ca700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f006cbf0 con 0x7fe7f015b870 2024-09-13T17:07:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f56c8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f006e500 0x7fe7f014c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f56c8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f006e500 0x7fe7f014c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46390/0 (socket says 172.21.15.123:46390) 2024-09-13T17:07:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f56c8700 1 -- 172.21.15.123:0/4042230233 learned_addr learned my addr 172.21.15.123:0/4042230233 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f4ec7700 1 --2- 172.21.15.123:0/4042230233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7f0155010 0x7fe7f006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:37.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f5ec9700 1 --2- 172.21.15.123:0/4042230233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7f015b870 0x7fe7f00b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:37.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f56c8700 1 -- 172.21.15.123:0/4042230233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7f015b870 msgr2=0x7fe7f00b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:37.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f56c8700 1 --2- 172.21.15.123:0/4042230233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7f015b870 0x7fe7f00b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:37.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f56c8700 1 -- 172.21.15.123:0/4042230233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7f0155010 msgr2=0x7fe7f006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:37.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f56c8700 1 --2- 172.21.15.123:0/4042230233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7f0155010 0x7fe7f006d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:37.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f56c8700 1 -- 172.21.15.123:0/4042230233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e0009a70 con 0x7fe7f006e500 2024-09-13T17:07:37.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f56c8700 1 --2- 172.21.15.123:0/4042230233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f006e500 0x7fe7f014c360 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400e760 tx=0x7fe7e400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7edffb700 1 -- 172.21.15.123:0/4042230233 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e400c070 con 0x7fe7f006e500 2024-09-13T17:07:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7edffb700 1 -- 172.21.15.123:0/4042230233 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e4013610 con 0x7fe7f006e500 2024-09-13T17:07:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f66ca700 1 -- 172.21.15.123:0/4042230233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f006ced0 con 0x7fe7f006e500 2024-09-13T17:07:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7edffb700 1 -- 172.21.15.123:0/4042230233 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4013980 con 0x7fe7f006e500 2024-09-13T17:07:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.549+0000 7fe7f66ca700 1 -- 172.21.15.123:0/4042230233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f014c8a0 con 0x7fe7f006e500 2024-09-13T17:07:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.553+0000 7fe7f66ca700 1 -- 172.21.15.123:0/4042230233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f00677f0 con 0x7fe7f006e500 2024-09-13T17:07:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.553+0000 7fe7edffb700 1 -- 172.21.15.123:0/4042230233 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe7e4013ae0 con 0x7fe7f006e500 2024-09-13T17:07:37.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.553+0000 7fe7edffb700 1 --2- 172.21.15.123:0/4042230233 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7dc066760 0x7fe7dc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:37.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.553+0000 7fe7edffb700 1 -- 172.21.15.123:0/4042230233 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fe7e4083eb0 con 0x7fe7f006e500 2024-09-13T17:07:37.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.553+0000 7fe7f4ec7700 1 --2- 172.21.15.123:0/4042230233 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7dc066760 0x7fe7dc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:37.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.553+0000 7fe7f4ec7700 1 --2- 172.21.15.123:0/4042230233 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7dc066760 0x7fe7dc068c20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0014040 tx=0x7fe7e0011000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:37.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.561+0000 7fe7edffb700 1 -- 172.21.15.123:0/4042230233 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe7e40511e0 con 0x7fe7f006e500 2024-09-13T17:07:37.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:37.729+0000 7fe7f66ca700 1 -- 172.21.15.123:0/4042230233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe7f015c010 con 0x7fe7f006e500 2024-09-13T17:07:38.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.401+0000 7fe7edffb700 1 -- 172.21.15.123:0/4042230233 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe7e4054800 con 0x7fe7f006e500 2024-09-13T17:07:38.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.405+0000 7fe7f66ca700 1 -- 172.21.15.123:0/4042230233 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7dc066760 msgr2=0x7fe7dc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:38.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.405+0000 7fe7f66ca700 1 --2- 172.21.15.123:0/4042230233 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7dc066760 0x7fe7dc068c20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0014040 tx=0x7fe7e0011000 comp rx=0 tx=0).stop 2024-09-13T17:07:38.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.405+0000 7fe7f66ca700 1 -- 172.21.15.123:0/4042230233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f006e500 msgr2=0x7fe7f014c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:38.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.405+0000 7fe7f66ca700 1 --2- 172.21.15.123:0/4042230233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f006e500 0x7fe7f014c360 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400e760 tx=0x7fe7e400ea70 comp rx=0 tx=0).stop 2024-09-13T17:07:38.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.405+0000 7fe7f66ca700 1 -- 172.21.15.123:0/4042230233 shutdown_connections 2024-09-13T17:07:38.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.405+0000 7fe7f66ca700 1 --2- 172.21.15.123:0/4042230233 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7dc066760 0x7fe7dc068c20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:38.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.405+0000 7fe7f66ca700 1 --2- 172.21.15.123:0/4042230233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7f015b870 0x7fe7f00b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:38.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.405+0000 7fe7f66ca700 1 --2- 172.21.15.123:0/4042230233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7f0155010 0x7fe7f006d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:38.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.405+0000 7fe7f66ca700 1 --2- 172.21.15.123:0/4042230233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f006e500 0x7fe7f014c360 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:38.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.405+0000 7fe7f66ca700 1 -- 172.21.15.123:0/4042230233 >> 172.21.15.123:0/4042230233 conn(0x7fe7f0072730 msgr2=0x7fe7f0154180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:38.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.405+0000 7fe7f66ca700 1 -- 172.21.15.123:0/4042230233 shutdown_connections 2024-09-13T17:07:38.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.405+0000 7fe7f66ca700 1 -- 172.21.15.123:0/4042230233 wait complete. 2024-09-13T17:07:38.410 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:07:38.425 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:07:38.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.541+0000 7ff165f4e700 1 Processor -- start 2024-09-13T17:07:38.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.541+0000 7ff165f4e700 1 -- start start 2024-09-13T17:07:38.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff165f4e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1600cd220 0x7ff16013ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:38.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff165f4e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff1600cfab0 0x7ff16013f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff165f4e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16013c460 con 0x7ff1600cbe10 2024-09-13T17:07:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff165f4e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16013f550 con 0x7ff1600cfab0 2024-09-13T17:07:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff165f4e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600cecf0 con 0x7ff1600cd220 2024-09-13T17:07:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff164f4c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff1600cbe10 0x7ff1600ccb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50328/0 (socket says 172.21.15.123:50328) 2024-09-13T17:07:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff164f4c700 1 -- 172.21.15.123:0/11417365 learned_addr learned my addr 172.21.15.123:0/11417365 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff16574d700 1 --2- 172.21.15.123:0/11417365 >> v2:172.21.15.153:3300/0 conn(0x7ff1600cfab0 0x7ff16013f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15ffff700 1 --2- 172.21.15.123:0/11417365 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1600cd220 0x7ff16013ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 -- 172.21.15.123:0/11417365 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060667924 0 0) 0x7ff16013c460 con 0x7ff1600cbe10 2024-09-13T17:07:38.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 -- 172.21.15.123:0/11417365 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1480035d0 con 0x7ff1600cbe10 2024-09-13T17:07:38.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 -- 172.21.15.123:0/11417365 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2530825807 0 0) 0x7ff1480035d0 con 0x7ff1600cbe10 2024-09-13T17:07:38.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 -- 172.21.15.123:0/11417365 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1600cd220 msgr2=0x7ff16013ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:38.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 --2- 172.21.15.123:0/11417365 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1600cd220 0x7ff16013ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:38.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 -- 172.21.15.123:0/11417365 >> v2:172.21.15.153:3300/0 conn(0x7ff1600cfab0 msgr2=0x7ff16013f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:38.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 --2- 172.21.15.123:0/11417365 >> v2:172.21.15.153:3300/0 conn(0x7ff1600cfab0 0x7ff16013f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:38.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 -- 172.21.15.123:0/11417365 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1600cefd0 con 0x7ff1600cbe10 2024-09-13T17:07:38.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 -- 172.21.15.123:0/11417365 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7ff1500019f0 con 0x7ff1600cbe10 2024-09-13T17:07:38.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 -- 172.21.15.123:0/11417365 >> v1:172.21.15.123:6789/0 conn(0x7ff1600cbe10 legacy=0x7ff1600ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:38.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 --2- 172.21.15.123:0/11417365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff148003a20 0x7ff148003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:38.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 --2- 172.21.15.123:0/11417365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff148004870 0x7ff148004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:38.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 --2- 172.21.15.123:0/11417365 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1600cd220 0x7ff148005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:38.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 -- 172.21.15.123:0/11417365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16013f550 con 0x7ff148004870 2024-09-13T17:07:38.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 -- 172.21.15.123:0/11417365 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600cecf0 con 0x7ff148003a20 2024-09-13T17:07:38.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 -- 172.21.15.123:0/11417365 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14800dc40 con 0x7ff1600cd220 2024-09-13T17:07:38.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15ffff700 1 --2- 172.21.15.123:0/11417365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff148004870 0x7ff148004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:38.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff164f4c700 1 --2- 172.21.15.123:0/11417365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff148003a20 0x7ff148003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:38.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff16574d700 1 --2- 172.21.15.123:0/11417365 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1600cd220 0x7ff148005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:38.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15ffff700 1 -- 172.21.15.123:0/11417365 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1600cd220 msgr2=0x7ff148005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:38.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15ffff700 1 --2- 172.21.15.123:0/11417365 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1600cd220 0x7ff148005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:38.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15ffff700 1 -- 172.21.15.123:0/11417365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff148003a20 msgr2=0x7ff148003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:38.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15ffff700 1 --2- 172.21.15.123:0/11417365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff148003a20 0x7ff148003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:38.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15ffff700 1 -- 172.21.15.123:0/11417365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1480035d0 con 0x7ff148004870 2024-09-13T17:07:38.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15ffff700 1 --2- 172.21.15.123:0/11417365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff148004870 0x7ff148004cf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff154009b70 tx=0x7ff1480058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44df4b68ac2392f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:38.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 -- 172.21.15.123:0/11417365 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400e6c0 con 0x7ff148004870 2024-09-13T17:07:38.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 -- 172.21.15.123:0/11417365 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15400e820 con 0x7ff148004870 2024-09-13T17:07:38.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.545+0000 7ff15f7fe700 1 -- 172.21.15.123:0/11417365 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400eb90 con 0x7ff148004870 2024-09-13T17:07:38.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff165f4e700 1 -- 172.21.15.123:0/11417365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff148004870 msgr2=0x7ff148004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:38.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff165f4e700 1 --2- 172.21.15.123:0/11417365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff148004870 0x7ff148004cf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff154009b70 tx=0x7ff1480058a0 comp rx=0 tx=0).stop 2024-09-13T17:07:38.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff16574d700 1 -- 172.21.15.123:0/11417365 reap_dead start 2024-09-13T17:07:38.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff165f4e700 1 -- 172.21.15.123:0/11417365 shutdown_connections 2024-09-13T17:07:38.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff165f4e700 1 -- 172.21.15.123:0/11417365 >> 172.21.15.123:0/11417365 conn(0x7ff160070f80 msgr2=0x7ff160071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:38.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff165f4e700 1 -- 172.21.15.123:0/11417365 shutdown_connections 2024-09-13T17:07:38.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff165f4e700 1 -- 172.21.15.123:0/11417365 wait complete. 2024-09-13T17:07:38.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff165f4e700 1 Processor -- start 2024-09-13T17:07:38.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff165f4e700 1 -- start start 2024-09-13T17:07:38.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff165f4e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff148004870 0x7ff1600b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:38.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff165f4e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1600b4250 0x7ff1600af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:38.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff165f4e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff16013b4c0 0x7ff16006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:38.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff165f4e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600af8c0 con 0x7ff16013b4c0 2024-09-13T17:07:38.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff165f4e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600b46d0 con 0x7ff148004870 2024-09-13T17:07:38.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.549+0000 7ff165f4e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600b06e0 con 0x7ff1600b4250 2024-09-13T17:07:38.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff16574d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff16013b4c0 0x7ff16006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:38.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff16574d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff16013b4c0 0x7ff16006d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46422/0 (socket says 172.21.15.123:46422) 2024-09-13T17:07:38.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff16574d700 1 -- 172.21.15.123:0/1070467019 learned_addr learned my addr 172.21.15.123:0/1070467019 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:38.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff164f4c700 1 --2- 172.21.15.123:0/1070467019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff148004870 0x7ff1600b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:38.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff15ffff700 1 --2- 172.21.15.123:0/1070467019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1600b4250 0x7ff1600af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:38.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff16574d700 1 -- 172.21.15.123:0/1070467019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1600b4250 msgr2=0x7ff1600af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:38.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff16574d700 1 --2- 172.21.15.123:0/1070467019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1600b4250 0x7ff1600af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:38.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff16574d700 1 -- 172.21.15.123:0/1070467019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff148004870 msgr2=0x7ff1600b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:38.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff16574d700 1 --2- 172.21.15.123:0/1070467019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff148004870 0x7ff1600b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:38.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff16574d700 1 -- 172.21.15.123:0/1070467019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1601f2760 con 0x7ff16013b4c0 2024-09-13T17:07:38.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff16574d700 1 --2- 172.21.15.123:0/1070467019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff16013b4c0 0x7ff16006d7c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff1600ce260 tx=0x7ff158011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:38.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff15d7fa700 1 -- 172.21.15.123:0/1070467019 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158004240 con 0x7ff16013b4c0 2024-09-13T17:07:38.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff15d7fa700 1 -- 172.21.15.123:0/1070467019 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1580043a0 con 0x7ff16013b4c0 2024-09-13T17:07:38.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff165f4e700 1 -- 172.21.15.123:0/1070467019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1600afad0 con 0x7ff16013b4c0 2024-09-13T17:07:38.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff15d7fa700 1 -- 172.21.15.123:0/1070467019 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1580036c0 con 0x7ff16013b4c0 2024-09-13T17:07:38.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff165f4e700 1 -- 172.21.15.123:0/1070467019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1600b0090 con 0x7ff16013b4c0 2024-09-13T17:07:38.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.553+0000 7ff165f4e700 1 -- 172.21.15.123:0/1070467019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1600ccb10 con 0x7ff16013b4c0 2024-09-13T17:07:38.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.557+0000 7ff15d7fa700 1 -- 172.21.15.123:0/1070467019 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff158003820 con 0x7ff16013b4c0 2024-09-13T17:07:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.557+0000 7ff15d7fa700 1 --2- 172.21.15.123:0/1070467019 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff14c066760 0x7ff14c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.557+0000 7ff15d7fa700 1 -- 172.21.15.123:0/1070467019 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7ff1580842b0 con 0x7ff16013b4c0 2024-09-13T17:07:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.557+0000 7ff164f4c700 1 --2- 172.21.15.123:0/1070467019 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff14c066760 0x7ff14c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.557+0000 7ff164f4c700 1 --2- 172.21.15.123:0/1070467019 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff14c066760 0x7ff14c068c20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff150002230 tx=0x7ff150006040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:38.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.561+0000 7ff15d7fa700 1 -- 172.21.15.123:0/1070467019 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff158051700 con 0x7ff16013b4c0 2024-09-13T17:07:38.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:38.733+0000 7ff165f4e700 1 -- 172.21.15.123:0/1070467019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff1600b0820 con 0x7ff16013b4c0 2024-09-13T17:07:39.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.409+0000 7ff15d7fa700 1 -- 172.21.15.123:0/1070467019 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff158054d20 con 0x7ff16013b4c0 2024-09-13T17:07:39.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.413+0000 7ff165f4e700 1 -- 172.21.15.123:0/1070467019 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff14c066760 msgr2=0x7ff14c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:39.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.413+0000 7ff165f4e700 1 --2- 172.21.15.123:0/1070467019 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff14c066760 0x7ff14c068c20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff150002230 tx=0x7ff150006040 comp rx=0 tx=0).stop 2024-09-13T17:07:39.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.413+0000 7ff165f4e700 1 -- 172.21.15.123:0/1070467019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff16013b4c0 msgr2=0x7ff16006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:39.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.413+0000 7ff165f4e700 1 --2- 172.21.15.123:0/1070467019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff16013b4c0 0x7ff16006d7c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff1600ce260 tx=0x7ff158011a90 comp rx=0 tx=0).stop 2024-09-13T17:07:39.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.417+0000 7ff165f4e700 1 -- 172.21.15.123:0/1070467019 shutdown_connections 2024-09-13T17:07:39.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.417+0000 7ff165f4e700 1 --2- 172.21.15.123:0/1070467019 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff14c066760 0x7ff14c068c20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:39.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.417+0000 7ff165f4e700 1 --2- 172.21.15.123:0/1070467019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff16013b4c0 0x7ff16006d7c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:39.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.417+0000 7ff165f4e700 1 --2- 172.21.15.123:0/1070467019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff1600b4250 0x7ff1600af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:39.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.417+0000 7ff165f4e700 1 --2- 172.21.15.123:0/1070467019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff148004870 0x7ff1600b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:39.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.417+0000 7ff165f4e700 1 -- 172.21.15.123:0/1070467019 >> 172.21.15.123:0/1070467019 conn(0x7ff160070f80 msgr2=0x7ff16015be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:39.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.417+0000 7ff165f4e700 1 -- 172.21.15.123:0/1070467019 shutdown_connections 2024-09-13T17:07:39.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.417+0000 7ff165f4e700 1 -- 172.21.15.123:0/1070467019 wait complete. 2024-09-13T17:07:39.421 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-13T17:07:39.434 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:07:39.434 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:07:39.434 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:07:39.434 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:07:39.434 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:07:39.434 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:07:39.435 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:07:39.435 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:07:39.435 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:07:39.435 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:07:39.435 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:07:39.435 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:07:39.435 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:07:39.436 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:07:39.436 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:07:39.436 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:07:39.444 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:07:39.445 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:07:39.446 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:07:39.446 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:07:39.447 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:07:39.447 DEBUG:teuthology.parallel:result is None 2024-09-13T17:07:39.448 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:07:39.448 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:07:39.449 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:07:39.449 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:07:39.450 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:07:39.450 DEBUG:teuthology.parallel:result is None 2024-09-13T17:07:39.451 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:07:39.451 DEBUG:teuthology.parallel:result is None 2024-09-13T17:07:39.452 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:07:39.452 DEBUG:teuthology.parallel:result is None 2024-09-13T17:07:39.453 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T17:07:39.513 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-13T17:07:39.524 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-13T17:07:39.531 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-09-13T17:07:39.531 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-09-13T17:07:39.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.561+0000 7feb86efb700 1 Processor -- start 2024-09-13T17:07:39.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.561+0000 7feb86efb700 1 -- start start 2024-09-13T17:07:39.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feb80143470 0x7feb8006b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:39.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7feb800b23b0 0x7feb800b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:39.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb80143850 con 0x7feb8015a000 2024-09-13T17:07:39.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb800b36f0 con 0x7feb80143470 2024-09-13T17:07:39.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb800b39d0 con 0x7feb800b23b0 2024-09-13T17:07:39.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb84c97700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feb80143470 0x7feb8006b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:39.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb84c97700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feb80143470 0x7feb8006b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46488/0 (socket says 172.21.15.123:46488) 2024-09-13T17:07:39.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb84c97700 1 -- 172.21.15.123:0/2658455104 learned_addr learned my addr 172.21.15.123:0/2658455104 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:39.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb85498700 1 --2- 172.21.15.123:0/2658455104 >> v2:172.21.15.153:3300/0 conn(0x7feb800b23b0 0x7feb800b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:39.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb84c97700 1 -- 172.21.15.123:0/2658455104 >> v2:172.21.15.153:3300/0 conn(0x7feb800b23b0 msgr2=0x7feb800b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:39.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb84c97700 1 --2- 172.21.15.123:0/2658455104 >> v2:172.21.15.153:3300/0 conn(0x7feb800b23b0 0x7feb800b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:39.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb84c97700 1 -- 172.21.15.123:0/2658455104 >> v1:172.21.15.153:6789/0 conn(0x7feb8015a000 legacy=0x7feb800b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:39.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb84c97700 1 -- 172.21.15.123:0/2658455104 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb800b3cb0 con 0x7feb80143470 2024-09-13T17:07:39.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb84c97700 1 --2- 172.21.15.123:0/2658455104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb80143470 0x7feb8006b260 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feb800cf300 tx=0x7feb7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265d5589d9c0c0e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb7f7fe700 1 -- 172.21.15.123:0/2658455104 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7800e070 con 0x7feb80143470 2024-09-13T17:07:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb7f7fe700 1 -- 172.21.15.123:0/2658455104 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb78003a40 con 0x7feb80143470 2024-09-13T17:07:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb7f7fe700 1 -- 172.21.15.123:0/2658455104 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb78003df0 con 0x7feb80143470 2024-09-13T17:07:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 -- 172.21.15.123:0/2658455104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb80143470 msgr2=0x7feb8006b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 --2- 172.21.15.123:0/2658455104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb80143470 0x7feb8006b260 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feb800cf300 tx=0x7feb7800b330 comp rx=0 tx=0).stop 2024-09-13T17:07:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 -- 172.21.15.123:0/2658455104 shutdown_connections 2024-09-13T17:07:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 --2- 172.21.15.123:0/2658455104 >> v2:172.21.15.153:3300/0 conn(0x7feb800b23b0 0x7feb800b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:39.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 --2- 172.21.15.123:0/2658455104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb80143470 0x7feb8006b260 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:39.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 -- 172.21.15.123:0/2658455104 >> 172.21.15.123:0/2658455104 conn(0x7feb800cfde0 msgr2=0x7feb800d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:39.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 -- 172.21.15.123:0/2658455104 shutdown_connections 2024-09-13T17:07:39.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 -- 172.21.15.123:0/2658455104 wait complete. 2024-09-13T17:07:39.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 Processor -- start 2024-09-13T17:07:39.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.565+0000 7feb86efb700 1 -- start start 2024-09-13T17:07:39.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb86efb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb800b23b0 0x7feb801351a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:39.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb86efb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb80143470 0x7feb800c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:39.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb86efb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb8015a000 0x7feb8006f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:39.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb86efb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb80135dd0 con 0x7feb80143470 2024-09-13T17:07:39.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb86efb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb80135af0 con 0x7feb800b23b0 2024-09-13T17:07:39.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb86efb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb80132e70 con 0x7feb8015a000 2024-09-13T17:07:39.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb80143470 0x7feb800c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:39.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb80143470 0x7feb800c4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46502/0 (socket says 172.21.15.123:46502) 2024-09-13T17:07:39.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7ffff700 1 -- 172.21.15.123:0/2383091190 learned_addr learned my addr 172.21.15.123:0/2383091190 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:39.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb84c97700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb800b23b0 0x7feb801351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:39.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb85498700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb8015a000 0x7feb8006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:39.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7ffff700 1 -- 172.21.15.123:0/2383091190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb8015a000 msgr2=0x7feb8006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:39.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7ffff700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb8015a000 0x7feb8006f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:39.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7ffff700 1 -- 172.21.15.123:0/2383091190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb800b23b0 msgr2=0x7feb801351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:39.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7ffff700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb800b23b0 0x7feb801351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:39.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7ffff700 1 -- 172.21.15.123:0/2383091190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb78009b30 con 0x7feb80143470 2024-09-13T17:07:39.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb85498700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb8015a000 0x7feb8006f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:39.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7ffff700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb80143470 0x7feb800c4f30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7feb6800b450 tx=0x7feb6800b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:39.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7d7fa700 1 -- 172.21.15.123:0/2383091190 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68004020 con 0x7feb80143470 2024-09-13T17:07:39.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7d7fa700 1 -- 172.21.15.123:0/2383091190 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb68004180 con 0x7feb80143470 2024-09-13T17:07:39.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb86efb700 1 -- 172.21.15.123:0/2383091190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb80133150 con 0x7feb80143470 2024-09-13T17:07:39.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7d7fa700 1 -- 172.21.15.123:0/2383091190 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68004530 con 0x7feb80143470 2024-09-13T17:07:39.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb86efb700 1 -- 172.21.15.123:0/2383091190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb801356e0 con 0x7feb80143470 2024-09-13T17:07:39.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb86efb700 1 -- 172.21.15.123:0/2383091190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb80133670 con 0x7feb80143470 2024-09-13T17:07:39.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7d7fa700 1 -- 172.21.15.123:0/2383091190 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb680036a0 con 0x7feb80143470 2024-09-13T17:07:39.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7d7fa700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feb60066730 0x7feb60068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:39.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb7d7fa700 1 -- 172.21.15.123:0/2383091190 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feb68083970 con 0x7feb80143470 2024-09-13T17:07:39.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.569+0000 7feb84c97700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feb60066730 0x7feb60068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:39.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.573+0000 7feb84c97700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feb60066730 0x7feb60068bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feb7800b370 tx=0x7feb78009000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:39.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.577+0000 7feb7d7fa700 1 -- 172.21.15.123:0/2383091190 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb80133670 con 0x7feb80143470 2024-09-13T17:07:39.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:39.757+0000 7feb86efb700 1 -- 172.21.15.123:0/2383091190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7feb80133670 con 0x7feb80143470 2024-09-13T17:07:40.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.565+0000 7feb7d7fa700 1 -- 172.21.15.123:0/2383091190 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7feb80133670 con 0x7feb80143470 2024-09-13T17:07:40.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.573+0000 7feb86efb700 1 -- 172.21.15.123:0/2383091190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feb60066730 msgr2=0x7feb60068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:40.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.573+0000 7feb86efb700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feb60066730 0x7feb60068bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feb7800b370 tx=0x7feb78009000 comp rx=0 tx=0).stop 2024-09-13T17:07:40.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.573+0000 7feb86efb700 1 -- 172.21.15.123:0/2383091190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb80143470 msgr2=0x7feb800c4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:40.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.573+0000 7feb86efb700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb80143470 0x7feb800c4f30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7feb6800b450 tx=0x7feb6800b760 comp rx=0 tx=0).stop 2024-09-13T17:07:40.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.573+0000 7feb86efb700 1 -- 172.21.15.123:0/2383091190 shutdown_connections 2024-09-13T17:07:40.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.573+0000 7feb86efb700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feb60066730 0x7feb60068bf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:40.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.573+0000 7feb86efb700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb8015a000 0x7feb8006f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:40.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.573+0000 7feb86efb700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb80143470 0x7feb800c4f30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:40.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.573+0000 7feb86efb700 1 --2- 172.21.15.123:0/2383091190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb800b23b0 0x7feb801351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:40.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.573+0000 7feb86efb700 1 -- 172.21.15.123:0/2383091190 >> 172.21.15.123:0/2383091190 conn(0x7feb800cfde0 msgr2=0x7feb800b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:40.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.573+0000 7feb86efb700 1 -- 172.21.15.123:0/2383091190 shutdown_connections 2024-09-13T17:07:40.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.573+0000 7feb86efb700 1 -- 172.21.15.123:0/2383091190 wait complete. 2024-09-13T17:07:40.576 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-13T17:07:40.592 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T17:07:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.705+0000 7f4aaf59e700 1 Processor -- start 2024-09-13T17:07:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.705+0000 7f4aaf59e700 1 -- start start 2024-09-13T17:07:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaf59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ab015e920 0x7f4ab00caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaf59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4ab00cb020 0x7f4ab0161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaf59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab0162550 con 0x7f4ab015ed00 2024-09-13T17:07:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaf59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab00cd690 con 0x7f4ab00cb020 2024-09-13T17:07:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaf59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0161f90 con 0x7f4ab015e920 2024-09-13T17:07:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aadd9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4ab00cb020 0x7f4ab0161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaed9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4ab015ed00 0x7f4ab00cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50354/0 (socket says 172.21.15.123:50354) 2024-09-13T17:07:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaed9d700 1 -- 172.21.15.123:0/2100515424 learned_addr learned my addr 172.21.15.123:0/2100515424 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aae59c700 1 --2- 172.21.15.123:0/2100515424 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ab015e920 0x7f4ab00caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aadd9b700 1 -- 172.21.15.123:0/2100515424 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ab015e920 msgr2=0x7f4ab00caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aadd9b700 1 --2- 172.21.15.123:0/2100515424 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ab015e920 0x7f4ab00caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aadd9b700 1 -- 172.21.15.123:0/2100515424 >> v1:172.21.15.123:6789/0 conn(0x7f4ab015ed00 legacy=0x7f4ab00cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aad59a700 1 -- 172.21.15.123:0/2100515424 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773079431 0 0) 0x7f4ab0162550 con 0x7f4ab015ed00 2024-09-13T17:07:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aadd9b700 1 -- 172.21.15.123:0/2100515424 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab0162270 con 0x7f4ab00cb020 2024-09-13T17:07:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aadd9b700 1 --2- 172.21.15.123:0/2100515424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ab00cb020 0x7f4ab0161540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0009850 tx=0x7f4aa0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a621fe866b151dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:40.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aad59a700 1 -- 172.21.15.123:0/2100515424 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0011830 con 0x7f4ab00cb020 2024-09-13T17:07:40.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aad59a700 1 -- 172.21.15.123:0/2100515424 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa0011990 con 0x7f4ab00cb020 2024-09-13T17:07:40.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aad59a700 1 -- 172.21.15.123:0/2100515424 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0011d20 con 0x7f4ab00cb020 2024-09-13T17:07:40.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2100515424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ab00cb020 msgr2=0x7f4ab0161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:40.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaf59e700 1 --2- 172.21.15.123:0/2100515424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ab00cb020 0x7f4ab0161540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0009850 tx=0x7f4aa0009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:40.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2100515424 shutdown_connections 2024-09-13T17:07:40.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaf59e700 1 --2- 172.21.15.123:0/2100515424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ab00cb020 0x7f4ab0161540 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:40.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaf59e700 1 --2- 172.21.15.123:0/2100515424 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ab015e920 0x7f4ab00caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:40.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2100515424 >> 172.21.15.123:0/2100515424 conn(0x7f4ab0066150 msgr2=0x7f4ab0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:40.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2100515424 shutdown_connections 2024-09-13T17:07:40.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.709+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2100515424 wait complete. 2024-09-13T17:07:40.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.713+0000 7f4aaf59e700 1 Processor -- start 2024-09-13T17:07:40.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.713+0000 7f4aaf59e700 1 -- start start 2024-09-13T17:07:40.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aaf59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ab00cb020 0x7f4ab0157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:40.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aaf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab015e920 0x7f4ab00c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:40.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aaf59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ab015ed00 0x7f4ab00c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:40.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aaf59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab00c3d20 con 0x7f4ab00cb020 2024-09-13T17:07:40.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aaf59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0157f70 con 0x7f4ab015e920 2024-09-13T17:07:40.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aaf59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0158250 con 0x7f4ab015ed00 2024-09-13T17:07:40.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aae59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ab00cb020 0x7f4ab0157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:40.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aae59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ab00cb020 0x7f4ab0157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46530/0 (socket says 172.21.15.123:46530) 2024-09-13T17:07:40.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aae59c700 1 -- 172.21.15.123:0/2038241631 learned_addr learned my addr 172.21.15.123:0/2038241631 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:40.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aaed9d700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ab015ed00 0x7f4ab00c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:40.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aadd9b700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab015e920 0x7f4ab00c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:40.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aae59c700 1 -- 172.21.15.123:0/2038241631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ab015ed00 msgr2=0x7f4ab00c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:40.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aae59c700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ab015ed00 0x7f4ab00c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:40.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aae59c700 1 -- 172.21.15.123:0/2038241631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab015e920 msgr2=0x7f4ab00c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:40.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aae59c700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab015e920 0x7f4ab00c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:40.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aae59c700 1 -- 172.21.15.123:0/2038241631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa00094b0 con 0x7f4ab00cb020 2024-09-13T17:07:40.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aaed9d700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ab015ed00 0x7f4ab00c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:40.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aae59c700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ab00cb020 0x7f4ab0157870 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400e760 tx=0x7f4aa400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:40.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4a9effd700 1 -- 172.21.15.123:0/2038241631 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4013610 con 0x7f4ab00cb020 2024-09-13T17:07:40.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4a9effd700 1 -- 172.21.15.123:0/2038241631 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa4013770 con 0x7f4ab00cb020 2024-09-13T17:07:40.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2038241631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab0158530 con 0x7f4ab00cb020 2024-09-13T17:07:40.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4a9effd700 1 -- 172.21.15.123:0/2038241631 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4013ae0 con 0x7f4ab00cb020 2024-09-13T17:07:40.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2038241631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab0158af0 con 0x7f4ab00cb020 2024-09-13T17:07:40.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.717+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2038241631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab00677f0 con 0x7f4ab00cb020 2024-09-13T17:07:40.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.721+0000 7f4a9effd700 1 -- 172.21.15.123:0/2038241631 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4aa4013c40 con 0x7f4ab00cb020 2024-09-13T17:07:40.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.721+0000 7f4a9effd700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4a90066730 0x7f4a90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:40.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.721+0000 7f4a9effd700 1 -- 172.21.15.123:0/2038241631 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4aa4083ae0 con 0x7f4ab00cb020 2024-09-13T17:07:40.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.721+0000 7f4aadd9b700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4a90066730 0x7f4a90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:40.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.721+0000 7f4aadd9b700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4a90066730 0x7f4a90068bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00cc740 tx=0x7f4aa0008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:40.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.729+0000 7f4a9effd700 1 -- 172.21.15.123:0/2038241631 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4aa4051190 con 0x7f4ab00cb020 2024-09-13T17:07:40.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.957+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2038241631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4ab00caae0 con 0x7f4ab00cb020 2024-09-13T17:07:40.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.961+0000 7f4a9effd700 1 -- 172.21.15.123:0/2038241631 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f4aa4055e60 con 0x7f4ab00cb020 2024-09-13T17:07:40.963 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:40.963 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:07:40.963 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-13T17:07:40.963 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.964 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-13T17:07:40.964 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmcINWChAAjEdCM4Sk1OsLUQerqFqnGg==", 2024-09-13T17:07:40.964 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.964 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:07:40.964 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:07:40.964 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:07:40.965 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.965 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.965 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.965 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.965 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-13T17:07:40.966 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmesC1ERAA2ZS4r6KU9vqfDLLX+0kwwg==", 2024-09-13T17:07:40.966 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.966 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:07:40.966 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:07:40.966 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:07:40.966 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.967 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.967 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.967 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.967 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-13T17:07:40.967 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORm+dvcDRAA5o6AtNdAEM2RTXMTKTuwvA==", 2024-09-13T17:07:40.967 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.968 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:07:40.968 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:07:40.968 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:07:40.968 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.968 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.969 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.969 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.969 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-13T17:07:40.969 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmnFIgGBAAZbqUsdKOG1nN0iHsKRqyHA==", 2024-09-13T17:07:40.969 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.970 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:07:40.970 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:07:40.970 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:07:40.970 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.970 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.970 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.970 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.971 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-13T17:07:40.971 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDucORmpvNQEhAAg2TDxfqiCxv8rfzNXd8ghw==", 2024-09-13T17:07:40.971 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.971 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:07:40.971 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:07:40.972 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.972 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.972 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.972 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.972 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-13T17:07:40.972 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDxcORmnAU+FxAAxjWreGRwyuQT2RRMicHAXg==", 2024-09-13T17:07:40.973 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.973 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:07:40.973 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:07:40.973 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.973 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.973 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.973 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.974 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-13T17:07:40.974 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD0cORmMXQpGhAADjhpu3evLXhYS+YKeKf8WQ==", 2024-09-13T17:07:40.974 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.974 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:07:40.974 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:07:40.974 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.975 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.975 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.975 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.975 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-13T17:07:40.975 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD3cORmAo7hHxAA80EcAMAxPmMPuKxUg6RYhQ==", 2024-09-13T17:07:40.975 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.976 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:07:40.976 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:07:40.976 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.976 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.976 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.976 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.977 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-13T17:07:40.977 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD9cORm2j1KCxAA57ClQVuoJdhuk76L4nPHVQ==", 2024-09-13T17:07:40.977 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.977 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:07:40.977 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:07:40.978 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.978 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.978 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.978 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.978 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-13T17:07:40.979 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAAceRmu5IeExAAyUOWIVy5i703n829U0KSuw==", 2024-09-13T17:07:40.979 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.979 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:07:40.979 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:07:40.979 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.979 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.980 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.980 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.980 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-13T17:07:40.980 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQADceRmhiXfFhAAt6aAa3EUOvKclLyGEl84SA==", 2024-09-13T17:07:40.980 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.980 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:07:40.981 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:07:40.981 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.981 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.981 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.981 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.981 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-13T17:07:40.982 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAGceRmjYdfHBAAHn19wbVS72wMYHvMh+Cpyg==", 2024-09-13T17:07:40.982 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.982 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:07:40.982 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:07:40.982 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.982 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.983 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.983 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.983 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-13T17:07:40.983 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmieDjGxAA9C8qfFqgRul4Kzk+0+UMTA==", 2024-09-13T17:07:40.983 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.983 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:07:40.984 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:07:40.984 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:07:40.984 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:07:40.984 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.984 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.985 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.985 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-13T17:07:40.985 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmJvUUJRAAQci63exaXrtjPfssFai1jw==", 2024-09-13T17:07:40.985 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.985 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:07:40.986 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:07:40.986 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:07:40.986 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:07:40.986 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.986 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.986 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.986 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-13T17:07:40.987 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmgbzRIRAA8VlhYQpFRQUNOo6nplFySA==", 2024-09-13T17:07:40.987 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.987 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:07:40.987 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:07:40.987 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:07:40.987 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:07:40.988 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.988 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.988 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.988 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-13T17:07:40.988 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmwT+9KhAASidrLfvv55brtJ3Mk+qdxA==", 2024-09-13T17:07:40.989 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.989 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:07:40.989 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:07:40.989 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:07:40.989 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:07:40.989 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.989 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.990 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.990 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-13T17:07:40.990 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDqcORmn/ceNxAAxs8e7/yGRB9oykHDFVQ0lA==", 2024-09-13T17:07:40.990 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.990 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:07:40.990 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:07:40.990 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:07:40.990 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.990 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.990 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.990 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.990 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-mds", 2024-09-13T17:07:40.990 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAQceRm4ojyKhAAOcDSyKi52BX/QI8T25kZXQ==", 2024-09-13T17:07:40.991 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.991 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-mds" 2024-09-13T17:07:40.991 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.991 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.991 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.991 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-mgr", 2024-09-13T17:07:40.991 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAQceRm7aTyKhAABggHNC42DjIMpjmRD2K2Uw==", 2024-09-13T17:07:40.991 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.991 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-13T17:07:40.991 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.991 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.991 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.991 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-osd", 2024-09-13T17:07:40.992 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAQceRmU7vyKhAAZ+WTMrzISbhkF4UT/r7OQA==", 2024-09-13T17:07:40.992 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.992 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-osd" 2024-09-13T17:07:40.992 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.992 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.992 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.992 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rbd", 2024-09-13T17:07:40.992 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAQceRm7dDyKhAAcDpiA/U+vkeQWjRJ7VgdnQ==", 2024-09-13T17:07:40.992 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.992 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-13T17:07:40.992 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.992 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.992 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.993 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-13T17:07:40.993 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAQceRmH+fyKhAA1fwjOS1I6ykJ/vqjrlxP8w==", 2024-09-13T17:07:40.993 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.993 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-13T17:07:40.993 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.993 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.993 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.993 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rgw", 2024-09-13T17:07:40.993 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAQceRmsP7yKhAAs7IRbmnwtR5d8brCF68wwA==", 2024-09-13T17:07:40.993 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.993 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-13T17:07:40.993 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.994 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.994 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.994 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-13T17:07:40.994 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmFSRNBhAAbI1RASXCwIZPggcjMdXynw==", 2024-09-13T17:07:40.994 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.994 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:07:40.994 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-13T17:07:40.994 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.994 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.994 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:40.994 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:40.994 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-13T17:07:40.994 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmLhAcAxAAHSNEbQ2dLEBPGDMMKc7dQQ==", 2024-09-13T17:07:40.995 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:07:40.995 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:07:40.995 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-13T17:07:40.995 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:07:40.995 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.995 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:40.995 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-13T17:07:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:07:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.961+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2038241631 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4a90066730 msgr2=0x7f4a90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:40.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.961+0000 7f4aaf59e700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4a90066730 0x7f4a90068bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00cc740 tx=0x7f4aa0008030 comp rx=0 tx=0).stop 2024-09-13T17:07:40.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.961+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2038241631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ab00cb020 msgr2=0x7f4ab0157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:40.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.961+0000 7f4aaf59e700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ab00cb020 0x7f4ab0157870 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400e760 tx=0x7f4aa400eb20 comp rx=0 tx=0).stop 2024-09-13T17:07:40.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.961+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2038241631 shutdown_connections 2024-09-13T17:07:40.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.961+0000 7f4aaf59e700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4a90066730 0x7f4a90068bf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:40.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.961+0000 7f4aaf59e700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4ab015ed00 0x7f4ab00c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:40.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.961+0000 7f4aaf59e700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab015e920 0x7f4ab00c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:40.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.961+0000 7f4aaf59e700 1 --2- 172.21.15.123:0/2038241631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ab00cb020 0x7f4ab0157870 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:40.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.961+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2038241631 >> 172.21.15.123:0/2038241631 conn(0x7f4ab0066150 msgr2=0x7f4ab00ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:40.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.961+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2038241631 shutdown_connections 2024-09-13T17:07:40.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:40.961+0000 7f4aaf59e700 1 -- 172.21.15.123:0/2038241631 wait complete. 2024-09-13T17:07:40.998 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-13T17:07:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.109+0000 7f7fa7472700 1 Processor -- start 2024-09-13T17:07:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.109+0000 7f7fa7472700 1 -- start start 2024-09-13T17:07:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.109+0000 7f7fa7472700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa015cdc0 0x7f7fa00b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.109+0000 7f7fa7472700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa00b3eb0 con 0x7f7fa006fa70 2024-09-13T17:07:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.109+0000 7f7fa7472700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa00b4190 con 0x7f7fa0072000 2024-09-13T17:07:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.109+0000 7f7fa7472700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa006d480 con 0x7f7fa015cdc0 2024-09-13T17:07:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.109+0000 7f7fa5c6f700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7fa006fa70 0x7f7fa00718f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50358/0 (socket says 172.21.15.123:50358) 2024-09-13T17:07:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa5c6f700 1 -- 172.21.15.123:0/2460768336 learned_addr learned my addr 172.21.15.123:0/2460768336 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:41.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa6470700 1 --2- 172.21.15.123:0/2460768336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa015cdc0 0x7f7fa00b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380430884 0 0) 0x7f7fa00b3eb0 con 0x7f7fa006fa70 2024-09-13T17:07:41.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f8c0035d0 con 0x7f7fa006fa70 2024-09-13T17:07:41.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764787096 0 0) 0x7f7fa00b4190 con 0x7f7fa0072000 2024-09-13T17:07:41.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fa00b3eb0 con 0x7f7fa0072000 2024-09-13T17:07:41.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1606602009 0 0) 0x7f7f8c0035d0 con 0x7f7fa006fa70 2024-09-13T17:07:41.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa015cdc0 msgr2=0x7f7fa00b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:41.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 --2- 172.21.15.123:0/2460768336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa015cdc0 0x7f7fa00b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 >> v1:172.21.15.153:6789/0 conn(0x7f7fa0072000 legacy=0x7f7fa00ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa006d760 con 0x7f7fa006fa70 2024-09-13T17:07:41.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f7f90001670 con 0x7f7fa006fa70 2024-09-13T17:07:41.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 >> v1:172.21.15.123:6789/0 conn(0x7f7fa006fa70 legacy=0x7f7fa00718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 --2- 172.21.15.123:0/2460768336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa015cdc0 0x7f7f8c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 --2- 172.21.15.123:0/2460768336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f8c004140 0x7f7f8c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 --2- 172.21.15.123:0/2460768336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f8c004db0 0x7f7f8c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa006d480 con 0x7f7f8c004140 2024-09-13T17:07:41.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c00bb10 con 0x7f7f8c004db0 2024-09-13T17:07:41.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c00bcd0 con 0x7f7fa015cdc0 2024-09-13T17:07:41.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa5c6f700 1 --2- 172.21.15.123:0/2460768336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f8c004140 0x7f7f8c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa6c71700 1 --2- 172.21.15.123:0/2460768336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f8c004db0 0x7f7f8c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa6470700 1 --2- 172.21.15.123:0/2460768336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa015cdc0 0x7f7f8c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa5c6f700 1 -- 172.21.15.123:0/2460768336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa015cdc0 msgr2=0x7f7f8c003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:41.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa5c6f700 1 --2- 172.21.15.123:0/2460768336 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa015cdc0 0x7f7f8c003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa5c6f700 1 -- 172.21.15.123:0/2460768336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f8c004db0 msgr2=0x7f7f8c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:41.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa5c6f700 1 --2- 172.21.15.123:0/2460768336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f8c004db0 0x7f7f8c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa5c6f700 1 -- 172.21.15.123:0/2460768336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c0035d0 con 0x7f7f8c004140 2024-09-13T17:07:41.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa5c6f700 1 --2- 172.21.15.123:0/2460768336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f8c004140 0x7f7f8c004870 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00cf540 tx=0x7f7f8c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace41c3ab464d6f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:41.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9000cd50 con 0x7f7f8c004140 2024-09-13T17:07:41.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f90001af0 con 0x7f7f8c004140 2024-09-13T17:07:41.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa546e700 1 -- 172.21.15.123:0/2460768336 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90005bc0 con 0x7f7f8c004140 2024-09-13T17:07:41.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa7472700 1 -- 172.21.15.123:0/2460768336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f8c004140 msgr2=0x7f7f8c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa7472700 1 --2- 172.21.15.123:0/2460768336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f8c004140 0x7f7f8c004870 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00cf540 tx=0x7f7f8c0058a0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa6c71700 1 -- 172.21.15.123:0/2460768336 reap_dead start 2024-09-13T17:07:41.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa7472700 1 -- 172.21.15.123:0/2460768336 shutdown_connections 2024-09-13T17:07:41.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa7472700 1 -- 172.21.15.123:0/2460768336 >> 172.21.15.123:0/2460768336 conn(0x7f7fa00735c0 msgr2=0x7f7fa006a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:41.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa7472700 1 -- 172.21.15.123:0/2460768336 shutdown_connections 2024-09-13T17:07:41.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.113+0000 7f7fa7472700 1 -- 172.21.15.123:0/2460768336 wait complete. 2024-09-13T17:07:41.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa7472700 1 Processor -- start 2024-09-13T17:07:41.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa7472700 1 -- start start 2024-09-13T17:07:41.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa7472700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f8c004140 0x7f7fa0146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa7472700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa0147450 0x7f7fa015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa7472700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa015b240 0x7f7fa015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa7472700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa015bc00 con 0x7f7fa0147450 2024-09-13T17:07:41.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa7472700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa0147230 con 0x7f7f8c004140 2024-09-13T17:07:41.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa7472700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa015e940 con 0x7f7fa015b240 2024-09-13T17:07:41.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa5c6f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa0147450 0x7f7fa015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa5c6f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa0147450 0x7f7fa015d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46538/0 (socket says 172.21.15.123:46538) 2024-09-13T17:07:41.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa5c6f700 1 -- 172.21.15.123:0/3848594081 learned_addr learned my addr 172.21.15.123:0/3848594081 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:41.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa6c71700 1 --2- 172.21.15.123:0/3848594081 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa015b240 0x7f7fa015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa6470700 1 --2- 172.21.15.123:0/3848594081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f8c004140 0x7f7fa0146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa5c6f700 1 -- 172.21.15.123:0/3848594081 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa015b240 msgr2=0x7f7fa015b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa5c6f700 1 --2- 172.21.15.123:0/3848594081 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa015b240 0x7f7fa015b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa5c6f700 1 -- 172.21.15.123:0/3848594081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f8c004140 msgr2=0x7f7fa0146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa5c6f700 1 --2- 172.21.15.123:0/3848594081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f8c004140 0x7f7fa0146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa5c6f700 1 -- 172.21.15.123:0/3848594081 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa015e5f0 con 0x7f7fa0147450 2024-09-13T17:07:41.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa5c6f700 1 --2- 172.21.15.123:0/3848594081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa0147450 0x7f7fa015d1a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7f90007fd0 tx=0x7f7f90001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:41.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7f96ffd700 1 -- 172.21.15.123:0/3848594081 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f900072d0 con 0x7f7fa0147450 2024-09-13T17:07:41.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7f96ffd700 1 -- 172.21.15.123:0/3848594081 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f90007450 con 0x7f7fa0147450 2024-09-13T17:07:41.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa7472700 1 -- 172.21.15.123:0/3848594081 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa015daa0 con 0x7f7fa0147450 2024-09-13T17:07:41.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7f96ffd700 1 -- 172.21.15.123:0/3848594081 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90007800 con 0x7f7fa0147450 2024-09-13T17:07:41.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.117+0000 7f7fa7472700 1 -- 172.21.15.123:0/3848594081 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa015e060 con 0x7f7fa0147450 2024-09-13T17:07:41.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.121+0000 7f7fa7472700 1 -- 172.21.15.123:0/3848594081 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa00b4190 con 0x7f7fa0147450 2024-09-13T17:07:41.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.121+0000 7f7f96ffd700 1 -- 172.21.15.123:0/3848594081 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7f90019030 con 0x7f7fa0147450 2024-09-13T17:07:41.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.121+0000 7f7f96ffd700 1 --2- 172.21.15.123:0/3848594081 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f84066760 0x7f7f84068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.121+0000 7f7f96ffd700 1 -- 172.21.15.123:0/3848594081 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7f90084920 con 0x7f7fa0147450 2024-09-13T17:07:41.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.121+0000 7f7fa6470700 1 --2- 172.21.15.123:0/3848594081 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f84066760 0x7f7f84068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.125+0000 7f7fa6470700 1 --2- 172.21.15.123:0/3848594081 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f84066760 0x7f7f84068c20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009a90 tx=0x7f7f9c008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:41.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.133+0000 7f7f96ffd700 1 -- 172.21.15.123:0/3848594081 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f90052120 con 0x7f7fa0147450 2024-09-13T17:07:41.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.361+0000 7f7fa7472700 1 -- 172.21.15.123:0/3848594081 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7fa015bc00 con 0x7f7fa0147450 2024-09-13T17:07:41.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.365+0000 7f7f96ffd700 1 -- 172.21.15.123:0/3848594081 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7f90055740 con 0x7f7fa0147450 2024-09-13T17:07:41.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.369+0000 7f7fa7472700 1 -- 172.21.15.123:0/3848594081 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f84066760 msgr2=0x7f7f84068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.369+0000 7f7fa7472700 1 --2- 172.21.15.123:0/3848594081 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f84066760 0x7f7f84068c20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009a90 tx=0x7f7f9c008040 comp rx=0 tx=0).stop 2024-09-13T17:07:41.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.369+0000 7f7fa7472700 1 -- 172.21.15.123:0/3848594081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa0147450 msgr2=0x7f7fa015d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.369+0000 7f7fa7472700 1 --2- 172.21.15.123:0/3848594081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa0147450 0x7f7fa015d1a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7f90007fd0 tx=0x7f7f90001980 comp rx=0 tx=0).stop 2024-09-13T17:07:41.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.369+0000 7f7fa7472700 1 -- 172.21.15.123:0/3848594081 shutdown_connections 2024-09-13T17:07:41.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.369+0000 7f7fa7472700 1 --2- 172.21.15.123:0/3848594081 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f84066760 0x7f7f84068c20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.369+0000 7f7fa7472700 1 --2- 172.21.15.123:0/3848594081 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa015b240 0x7f7fa015b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.369+0000 7f7fa7472700 1 --2- 172.21.15.123:0/3848594081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa0147450 0x7f7fa015d1a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.369+0000 7f7fa7472700 1 --2- 172.21.15.123:0/3848594081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f8c004140 0x7f7fa0146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.369+0000 7f7fa7472700 1 -- 172.21.15.123:0/3848594081 >> 172.21.15.123:0/3848594081 conn(0x7f7fa00735c0 msgr2=0x7f7fa00af810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:41.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.373+0000 7f7fa7472700 1 -- 172.21.15.123:0/3848594081 shutdown_connections 2024-09-13T17:07:41.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.373+0000 7f7fa7472700 1 -- 172.21.15.123:0/3848594081 wait complete. 2024-09-13T17:07:41.389 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-13T17:07:41.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976a29700 1 Processor -- start 2024-09-13T17:07:41.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976a29700 1 -- start start 2024-09-13T17:07:41.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976a29700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f09700cb090 0x7f09700c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976a29700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09700c1280 0x7f09700c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976a29700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09700c93b0 con 0x7f09700ca950 2024-09-13T17:07:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976a29700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09700cc580 con 0x7f09700c1280 2024-09-13T17:07:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976a29700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09700cd100 con 0x7f09700cb090 2024-09-13T17:07:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976228700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09700c1280 0x7f09700c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976228700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09700c1280 0x7f09700c1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46554/0 (socket says 172.21.15.123:46554) 2024-09-13T17:07:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0975a27700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f09700cb090 0x7f09700c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976228700 1 -- 172.21.15.123:0/3696750890 learned_addr learned my addr 172.21.15.123:0/3696750890 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976228700 1 -- 172.21.15.123:0/3696750890 >> v2:172.21.15.153:3300/0 conn(0x7f09700cb090 msgr2=0x7f09700c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976228700 1 --2- 172.21.15.123:0/3696750890 >> v2:172.21.15.153:3300/0 conn(0x7f09700cb090 0x7f09700c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976228700 1 -- 172.21.15.123:0/3696750890 >> v1:172.21.15.153:6789/0 conn(0x7f09700ca950 legacy=0x7f09700cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976228700 1 -- 172.21.15.123:0/3696750890 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09701617b0 con 0x7f09700c1280 2024-09-13T17:07:41.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0976228700 1 --2- 172.21.15.123:0/3696750890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09700c1280 0x7f09700c1710 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f09700cf720 tx=0x7f0960009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626bd79b22825101 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:41.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0974a25700 1 -- 172.21.15.123:0/3696750890 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960011830 con 0x7f09700c1280 2024-09-13T17:07:41.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0974a25700 1 -- 172.21.15.123:0/3696750890 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0960011990 con 0x7f09700c1280 2024-09-13T17:07:41.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.501+0000 7f0974a25700 1 -- 172.21.15.123:0/3696750890 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960011d20 con 0x7f09700c1280 2024-09-13T17:07:41.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 -- 172.21.15.123:0/3696750890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09700c1280 msgr2=0x7f09700c1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 --2- 172.21.15.123:0/3696750890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09700c1280 0x7f09700c1710 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f09700cf720 tx=0x7f0960009bf0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 -- 172.21.15.123:0/3696750890 shutdown_connections 2024-09-13T17:07:41.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 --2- 172.21.15.123:0/3696750890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09700c1280 0x7f09700c1710 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 --2- 172.21.15.123:0/3696750890 >> v2:172.21.15.153:3300/0 conn(0x7f09700cb090 0x7f09700c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 -- 172.21.15.123:0/3696750890 >> 172.21.15.123:0/3696750890 conn(0x7f09700b01d0 msgr2=0x7f09700b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:41.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 -- 172.21.15.123:0/3696750890 shutdown_connections 2024-09-13T17:07:41.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 -- 172.21.15.123:0/3696750890 wait complete. 2024-09-13T17:07:41.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 Processor -- start 2024-09-13T17:07:41.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 -- start start 2024-09-13T17:07:41.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09700c1280 0x7f09701593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09700ca950 0x7f097015cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09700cb090 0x7f097015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09700c86e0 con 0x7f09700c1280 2024-09-13T17:07:41.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0970159900 con 0x7f09700ca950 2024-09-13T17:07:41.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0976a29700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09700c7b30 con 0x7f09700cb090 2024-09-13T17:07:41.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0975a27700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09700c1280 0x7f09701593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0975a27700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09700c1280 0x7f09701593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46568/0 (socket says 172.21.15.123:46568) 2024-09-13T17:07:41.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.505+0000 7f0975a27700 1 -- 172.21.15.123:0/4250183684 learned_addr learned my addr 172.21.15.123:0/4250183684 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:41.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f0976228700 1 --2- 172.21.15.123:0/4250183684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09700cb090 0x7f097015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f0975226700 1 --2- 172.21.15.123:0/4250183684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09700ca950 0x7f097015cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f0975a27700 1 -- 172.21.15.123:0/4250183684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09700cb090 msgr2=0x7f097015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f0975a27700 1 --2- 172.21.15.123:0/4250183684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09700cb090 0x7f097015d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f0975a27700 1 -- 172.21.15.123:0/4250183684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09700ca950 msgr2=0x7f097015cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f0975a27700 1 --2- 172.21.15.123:0/4250183684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09700ca950 0x7f097015cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f0975a27700 1 -- 172.21.15.123:0/4250183684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0960009570 con 0x7f09700c1280 2024-09-13T17:07:41.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f0975a27700 1 --2- 172.21.15.123:0/4250183684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09700c1280 0x7f09701593c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f096400e9d0 tx=0x7f096400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:41.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f096e7fc700 1 -- 172.21.15.123:0/4250183684 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0964009720 con 0x7f09700c1280 2024-09-13T17:07:41.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f096e7fc700 1 -- 172.21.15.123:0/4250183684 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096400ee70 con 0x7f09700c1280 2024-09-13T17:07:41.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f096e7fc700 1 -- 172.21.15.123:0/4250183684 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096400c9f0 con 0x7f09700c1280 2024-09-13T17:07:41.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f0976a29700 1 -- 172.21.15.123:0/4250183684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09700c7db0 con 0x7f09700c1280 2024-09-13T17:07:41.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f0976a29700 1 -- 172.21.15.123:0/4250183684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09700c8370 con 0x7f09700c1280 2024-09-13T17:07:41.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f0976a29700 1 -- 172.21.15.123:0/4250183684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09700ce400 con 0x7f09700c1280 2024-09-13T17:07:41.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.509+0000 7f096e7fc700 1 -- 172.21.15.123:0/4250183684 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f096400cb50 con 0x7f09700c1280 2024-09-13T17:07:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.513+0000 7f096e7fc700 1 --2- 172.21.15.123:0/4250183684 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f095c066730 0x7f095c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.513+0000 7f0975226700 1 --2- 172.21.15.123:0/4250183684 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f095c066730 0x7f095c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.513+0000 7f096e7fc700 1 -- 172.21.15.123:0/4250183684 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f09640841e0 con 0x7f09700c1280 2024-09-13T17:07:41.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.513+0000 7f0975226700 1 --2- 172.21.15.123:0/4250183684 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f095c066730 0x7f095c068bf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f09700add20 tx=0x7f0968009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:41.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.517+0000 7f096e7fc700 1 -- 172.21.15.123:0/4250183684 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0964051800 con 0x7f09700c1280 2024-09-13T17:07:41.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.749+0000 7f0976a29700 1 -- 172.21.15.123:0/4250183684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f097006bdb0 con 0x7f09700c1280 2024-09-13T17:07:41.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.757+0000 7f096e7fc700 1 -- 172.21.15.123:0/4250183684 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0964054e20 con 0x7f09700c1280 2024-09-13T17:07:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.761+0000 7f0976a29700 1 -- 172.21.15.123:0/4250183684 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f095c066730 msgr2=0x7f095c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.761+0000 7f0976a29700 1 --2- 172.21.15.123:0/4250183684 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f095c066730 0x7f095c068bf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f09700add20 tx=0x7f0968009040 comp rx=0 tx=0).stop 2024-09-13T17:07:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.761+0000 7f0976a29700 1 -- 172.21.15.123:0/4250183684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09700c1280 msgr2=0x7f09701593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.761+0000 7f0976a29700 1 --2- 172.21.15.123:0/4250183684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09700c1280 0x7f09701593c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f096400e9d0 tx=0x7f096400ece0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.761+0000 7f0976a29700 1 -- 172.21.15.123:0/4250183684 shutdown_connections 2024-09-13T17:07:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.761+0000 7f0976a29700 1 --2- 172.21.15.123:0/4250183684 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f095c066730 0x7f095c068bf0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.761+0000 7f0976a29700 1 --2- 172.21.15.123:0/4250183684 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f09700cb090 0x7f097015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.761+0000 7f0976a29700 1 --2- 172.21.15.123:0/4250183684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09700ca950 0x7f097015cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.761+0000 7f0976a29700 1 --2- 172.21.15.123:0/4250183684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09700c1280 0x7f09701593c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.761+0000 7f0976a29700 1 -- 172.21.15.123:0/4250183684 >> 172.21.15.123:0/4250183684 conn(0x7f09700b01d0 msgr2=0x7f09700ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.761+0000 7f0976a29700 1 -- 172.21.15.123:0/4250183684 shutdown_connections 2024-09-13T17:07:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.761+0000 7f0976a29700 1 -- 172.21.15.123:0/4250183684 wait complete. 2024-09-13T17:07:41.778 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-13T17:07:41.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.889+0000 7f0271ab9700 1 Processor -- start 2024-09-13T17:07:41.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.889+0000 7f0271ab9700 1 -- start start 2024-09-13T17:07:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0271ab9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f026c15cd60 0x7f026c0d10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0271ab9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f026c0cfb70 0x7f026c0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0271ab9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c0d1750 con 0x7f026c0d3600 2024-09-13T17:07:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0271ab9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026c0d1a30 con 0x7f026c15cd60 2024-09-13T17:07:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0271ab9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026c0b5930 con 0x7f026c0cfb70 2024-09-13T17:07:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0270ab7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f026c15cd60 0x7f026c0d10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0270ab7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f026c15cd60 0x7f026c0d10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46570/0 (socket says 172.21.15.123:46570) 2024-09-13T17:07:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0270ab7700 1 -- 172.21.15.123:0/2180010215 learned_addr learned my addr 172.21.15.123:0/2180010215 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f02712b8700 1 --2- 172.21.15.123:0/2180010215 >> v2:172.21.15.153:3300/0 conn(0x7f026c0cfb70 0x7f026c0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0270ab7700 1 -- 172.21.15.123:0/2180010215 >> v2:172.21.15.153:3300/0 conn(0x7f026c0cfb70 msgr2=0x7f026c0b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0270ab7700 1 --2- 172.21.15.123:0/2180010215 >> v2:172.21.15.153:3300/0 conn(0x7f026c0cfb70 0x7f026c0b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0270ab7700 1 -- 172.21.15.123:0/2180010215 >> v1:172.21.15.153:6789/0 conn(0x7f026c0d3600 legacy=0x7f026c0cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0270ab7700 1 -- 172.21.15.123:0/2180010215 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c0b5c10 con 0x7f026c15cd60 2024-09-13T17:07:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0270ab7700 1 --2- 172.21.15.123:0/2180010215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f026c15cd60 0x7f026c0d10c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f026c0d2260 tx=0x7f025c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baeb6293fb7f07b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f026b7fe700 1 -- 172.21.15.123:0/2180010215 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c00b8a0 con 0x7f026c15cd60 2024-09-13T17:07:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f026b7fe700 1 -- 172.21.15.123:0/2180010215 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c00ba00 con 0x7f026c15cd60 2024-09-13T17:07:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f026b7fe700 1 -- 172.21.15.123:0/2180010215 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c00bd90 con 0x7f026c15cd60 2024-09-13T17:07:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0271ab9700 1 -- 172.21.15.123:0/2180010215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f026c15cd60 msgr2=0x7f026c0d10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0271ab9700 1 --2- 172.21.15.123:0/2180010215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f026c15cd60 0x7f026c0d10c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f026c0d2260 tx=0x7f025c009bf0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0271ab9700 1 -- 172.21.15.123:0/2180010215 shutdown_connections 2024-09-13T17:07:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0271ab9700 1 --2- 172.21.15.123:0/2180010215 >> v2:172.21.15.153:3300/0 conn(0x7f026c0cfb70 0x7f026c0b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0271ab9700 1 --2- 172.21.15.123:0/2180010215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f026c15cd60 0x7f026c0d10c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0271ab9700 1 -- 172.21.15.123:0/2180010215 >> 172.21.15.123:0/2180010215 conn(0x7f026c0d2ae0 msgr2=0x7f026c0d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:41.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0271ab9700 1 -- 172.21.15.123:0/2180010215 shutdown_connections 2024-09-13T17:07:41.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.893+0000 7f0271ab9700 1 -- 172.21.15.123:0/2180010215 wait complete. 2024-09-13T17:07:41.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0271ab9700 1 Processor -- start 2024-09-13T17:07:41.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0271ab9700 1 -- start start 2024-09-13T17:07:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0271ab9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f026c0cfb70 0x7f026c0c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0271ab9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f026c0d3600 0x7f026c152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0271ab9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f026c15cd60 0x7f026c1f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0271ab9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0c92e0 con 0x7f026c0cfb70 2024-09-13T17:07:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0271ab9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0c7300 con 0x7f026c15cd60 2024-09-13T17:07:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0271ab9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0c75e0 con 0x7f026c0d3600 2024-09-13T17:07:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0270ab7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f026c0cfb70 0x7f026c0c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f02712b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f026c15cd60 0x7f026c1f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0270ab7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f026c0cfb70 0x7f026c0c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46582/0 (socket says 172.21.15.123:46582) 2024-09-13T17:07:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0270ab7700 1 -- 172.21.15.123:0/1345876740 learned_addr learned my addr 172.21.15.123:0/1345876740 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:41.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f026bfff700 1 --2- 172.21.15.123:0/1345876740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f026c0d3600 0x7f026c152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0270ab7700 1 -- 172.21.15.123:0/1345876740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f026c0d3600 msgr2=0x7f026c152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0270ab7700 1 --2- 172.21.15.123:0/1345876740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f026c0d3600 0x7f026c152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0270ab7700 1 -- 172.21.15.123:0/1345876740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f026c15cd60 msgr2=0x7f026c1f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:41.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0270ab7700 1 --2- 172.21.15.123:0/1345876740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f026c15cd60 0x7f026c1f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:41.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0270ab7700 1 -- 172.21.15.123:0/1345876740 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c009570 con 0x7f026c0cfb70 2024-09-13T17:07:41.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0270ab7700 1 --2- 172.21.15.123:0/1345876740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f026c0cfb70 0x7f026c0c7de0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f025c000c00 tx=0x7f025c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:41.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f02697fa700 1 -- 172.21.15.123:0/1345876740 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c0038c0 con 0x7f026c0cfb70 2024-09-13T17:07:41.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f02697fa700 1 -- 172.21.15.123:0/1345876740 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c01e070 con 0x7f026c0cfb70 2024-09-13T17:07:41.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0271ab9700 1 -- 172.21.15.123:0/1345876740 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026c15d2c0 con 0x7f026c0cfb70 2024-09-13T17:07:41.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f02697fa700 1 -- 172.21.15.123:0/1345876740 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c003c80 con 0x7f026c0cfb70 2024-09-13T17:07:41.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.897+0000 7f0271ab9700 1 -- 172.21.15.123:0/1345876740 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026c0cae50 con 0x7f026c0cfb70 2024-09-13T17:07:41.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.901+0000 7f02697fa700 1 -- 172.21.15.123:0/1345876740 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f025c011420 con 0x7f026c0cfb70 2024-09-13T17:07:41.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.901+0000 7f0271ab9700 1 -- 172.21.15.123:0/1345876740 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026c0c7b00 con 0x7f026c0cfb70 2024-09-13T17:07:41.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.901+0000 7f02697fa700 1 --2- 172.21.15.123:0/1345876740 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0250066760 0x7f0250068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:41.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.901+0000 7f02697fa700 1 -- 172.21.15.123:0/1345876740 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f025c020070 con 0x7f026c0cfb70 2024-09-13T17:07:41.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.901+0000 7f026bfff700 1 --2- 172.21.15.123:0/1345876740 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0250066760 0x7f0250068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:41.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.901+0000 7f026bfff700 1 --2- 172.21.15.123:0/1345876740 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0250066760 0x7f0250068c20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f026c157d70 tx=0x7f0254009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:41.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:41.913+0000 7f02697fa700 1 -- 172.21.15.123:0/1345876740 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f026c0c7b00 con 0x7f026c0cfb70 2024-09-13T17:07:42.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.145+0000 7f0271ab9700 1 -- 172.21.15.123:0/1345876740 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f026c0c7b00 con 0x7f026c0cfb70 2024-09-13T17:07:42.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.153+0000 7f02697fa700 1 -- 172.21.15.123:0/1345876740 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f026c0c7b00 con 0x7f026c0cfb70 2024-09-13T17:07:42.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.153+0000 7f0271ab9700 1 -- 172.21.15.123:0/1345876740 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0250066760 msgr2=0x7f0250068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:42.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.153+0000 7f0271ab9700 1 --2- 172.21.15.123:0/1345876740 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0250066760 0x7f0250068c20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f026c157d70 tx=0x7f0254009040 comp rx=0 tx=0).stop 2024-09-13T17:07:42.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.153+0000 7f0271ab9700 1 -- 172.21.15.123:0/1345876740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f026c0cfb70 msgr2=0x7f026c0c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:42.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.153+0000 7f0271ab9700 1 --2- 172.21.15.123:0/1345876740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f026c0cfb70 0x7f026c0c7de0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f025c000c00 tx=0x7f025c004770 comp rx=0 tx=0).stop 2024-09-13T17:07:42.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.153+0000 7f0271ab9700 1 -- 172.21.15.123:0/1345876740 shutdown_connections 2024-09-13T17:07:42.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.153+0000 7f0271ab9700 1 --2- 172.21.15.123:0/1345876740 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0250066760 0x7f0250068c20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.153+0000 7f0271ab9700 1 --2- 172.21.15.123:0/1345876740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f026c15cd60 0x7f026c1f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.153+0000 7f0271ab9700 1 --2- 172.21.15.123:0/1345876740 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f026c0d3600 0x7f026c152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.153+0000 7f0271ab9700 1 --2- 172.21.15.123:0/1345876740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f026c0cfb70 0x7f026c0c7de0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.153+0000 7f0271ab9700 1 -- 172.21.15.123:0/1345876740 >> 172.21.15.123:0/1345876740 conn(0x7f026c0d2ae0 msgr2=0x7f026c0b65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:42.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.153+0000 7f0271ab9700 1 -- 172.21.15.123:0/1345876740 shutdown_connections 2024-09-13T17:07:42.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.153+0000 7f0271ab9700 1 -- 172.21.15.123:0/1345876740 wait complete. 2024-09-13T17:07:42.170 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-13T17:07:42.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa36759e700 1 Processor -- start 2024-09-13T17:07:42.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa36759e700 1 -- start start 2024-09-13T17:07:42.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa36759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3680b3e40 0x7fa3680d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:42.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa36759e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa3680c5f70 0x7fa3680cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:42.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa36759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3680cebe0 con 0x7fa3680cf870 2024-09-13T17:07:42.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa36759e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3680b5eb0 con 0x7fa3680c5f70 2024-09-13T17:07:42.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa36759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680cfd20 con 0x7fa3680b3e40 2024-09-13T17:07:42.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa365d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa3680c5f70 0x7fa3680cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:42.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa365d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa3680c5f70 0x7fa3680cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44086/0 (socket says 172.21.15.123:44086) 2024-09-13T17:07:42.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa365d9b700 1 -- 172.21.15.123:0/2026847538 learned_addr learned my addr 172.21.15.123:0/2026847538 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:42.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa36659c700 1 --2- 172.21.15.123:0/2026847538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3680b3e40 0x7fa3680d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:42.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa365d9b700 1 -- 172.21.15.123:0/2026847538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3680b3e40 msgr2=0x7fa3680d3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:42.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa365d9b700 1 --2- 172.21.15.123:0/2026847538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3680b3e40 0x7fa3680d3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa365d9b700 1 -- 172.21.15.123:0/2026847538 >> v1:172.21.15.153:6789/0 conn(0x7fa3680cf870 legacy=0x7fa3680d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:42.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa365d9b700 1 -- 172.21.15.123:0/2026847538 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3680ce620 con 0x7fa3680c5f70 2024-09-13T17:07:42.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa365d9b700 1 --2- 172.21.15.123:0/2026847538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680c5f70 0x7fa3680cf330 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa360009e50 tx=0x7fa36000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5a160f4b54adb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:42.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa36559a700 1 -- 172.21.15.123:0/2026847538 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36000e070 con 0x7fa3680c5f70 2024-09-13T17:07:42.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa36559a700 1 -- 172.21.15.123:0/2026847538 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36000b910 con 0x7fa3680c5f70 2024-09-13T17:07:42.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.289+0000 7fa36559a700 1 -- 172.21.15.123:0/2026847538 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36000bcc0 con 0x7fa3680c5f70 2024-09-13T17:07:42.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 -- 172.21.15.123:0/2026847538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680c5f70 msgr2=0x7fa3680cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:42.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 --2- 172.21.15.123:0/2026847538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680c5f70 0x7fa3680cf330 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa360009e50 tx=0x7fa36000b330 comp rx=0 tx=0).stop 2024-09-13T17:07:42.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 -- 172.21.15.123:0/2026847538 shutdown_connections 2024-09-13T17:07:42.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 --2- 172.21.15.123:0/2026847538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680c5f70 0x7fa3680cf330 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 --2- 172.21.15.123:0/2026847538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3680b3e40 0x7fa3680d3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 -- 172.21.15.123:0/2026847538 >> 172.21.15.123:0/2026847538 conn(0x7fa3680d2ae0 msgr2=0x7fa3680d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:42.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 -- 172.21.15.123:0/2026847538 shutdown_connections 2024-09-13T17:07:42.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 -- 172.21.15.123:0/2026847538 wait complete. 2024-09-13T17:07:42.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 Processor -- start 2024-09-13T17:07:42.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 -- start start 2024-09-13T17:07:42.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680b3e40 0x7fa368164840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:42.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3680c5f70 0x7fa36815d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:42.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3680cf870 0x7fa3680c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:42.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680caca0 con 0x7fa3680b3e40 2024-09-13T17:07:42.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680ca400 con 0x7fa3680c5f70 2024-09-13T17:07:42.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680ca6e0 con 0x7fa3680cf870 2024-09-13T17:07:42.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680b3e40 0x7fa368164840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:42.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680b3e40 0x7fa368164840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44092/0 (socket says 172.21.15.123:44092) 2024-09-13T17:07:42.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36659c700 1 -- 172.21.15.123:0/2465835873 learned_addr learned my addr 172.21.15.123:0/2465835873 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:42.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa366d9d700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3680cf870 0x7fa3680c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:42.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa365d9b700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3680c5f70 0x7fa36815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:42.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36659c700 1 -- 172.21.15.123:0/2465835873 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3680cf870 msgr2=0x7fa3680c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:42.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36659c700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3680cf870 0x7fa3680c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36659c700 1 -- 172.21.15.123:0/2465835873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3680c5f70 msgr2=0x7fa36815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:42.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36659c700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3680c5f70 0x7fa36815d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa36659c700 1 -- 172.21.15.123:0/2465835873 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360009b30 con 0x7fa3680b3e40 2024-09-13T17:07:42.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.293+0000 7fa365d9b700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3680c5f70 0x7fa36815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:42.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.297+0000 7fa36659c700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680b3e40 0x7fa368164840 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00e9d0 tx=0x7fa35c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:42.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.297+0000 7fa356ffd700 1 -- 172.21.15.123:0/2465835873 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c009720 con 0x7fa3680b3e40 2024-09-13T17:07:42.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.297+0000 7fa356ffd700 1 -- 172.21.15.123:0/2465835873 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c00c850 con 0x7fa3680b3e40 2024-09-13T17:07:42.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.297+0000 7fa36759e700 1 -- 172.21.15.123:0/2465835873 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3680ca9c0 con 0x7fa3680b3e40 2024-09-13T17:07:42.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.297+0000 7fa356ffd700 1 -- 172.21.15.123:0/2465835873 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c00cbc0 con 0x7fa3680b3e40 2024-09-13T17:07:42.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.297+0000 7fa36759e700 1 -- 172.21.15.123:0/2465835873 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36815d8d0 con 0x7fa3680b3e40 2024-09-13T17:07:42.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.297+0000 7fa36759e700 1 -- 172.21.15.123:0/2465835873 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3680b4220 con 0x7fa3680b3e40 2024-09-13T17:07:42.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.297+0000 7fa356ffd700 1 -- 172.21.15.123:0/2465835873 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa35c00cd20 con 0x7fa3680b3e40 2024-09-13T17:07:42.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.301+0000 7fa356ffd700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa348066730 0x7fa348068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:42.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.301+0000 7fa365d9b700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa348066730 0x7fa348068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:42.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.301+0000 7fa356ffd700 1 -- 172.21.15.123:0/2465835873 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa35c083e40 con 0x7fa3680b3e40 2024-09-13T17:07:42.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.301+0000 7fa365d9b700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa348066730 0x7fa348068bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa360009e50 tx=0x7fa360009000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:42.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.305+0000 7fa356ffd700 1 -- 172.21.15.123:0/2465835873 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa35c051590 con 0x7fa3680b3e40 2024-09-13T17:07:42.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.529+0000 7fa36759e700 1 -- 172.21.15.123:0/2465835873 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa3680704b0 con 0x7fa3680b3e40 2024-09-13T17:07:42.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.537+0000 7fa356ffd700 1 -- 172.21.15.123:0/2465835873 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa35c054bb0 con 0x7fa3680b3e40 2024-09-13T17:07:42.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.541+0000 7fa36759e700 1 -- 172.21.15.123:0/2465835873 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa348066730 msgr2=0x7fa348068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:42.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.541+0000 7fa36759e700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa348066730 0x7fa348068bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa360009e50 tx=0x7fa360009000 comp rx=0 tx=0).stop 2024-09-13T17:07:42.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.541+0000 7fa36759e700 1 -- 172.21.15.123:0/2465835873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680b3e40 msgr2=0x7fa368164840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:42.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.541+0000 7fa36759e700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680b3e40 0x7fa368164840 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00e9d0 tx=0x7fa35c00ece0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.541+0000 7fa36759e700 1 -- 172.21.15.123:0/2465835873 shutdown_connections 2024-09-13T17:07:42.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.541+0000 7fa36759e700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa348066730 0x7fa348068bf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.541+0000 7fa36759e700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3680cf870 0x7fa3680c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.541+0000 7fa36759e700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3680c5f70 0x7fa36815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.541+0000 7fa36759e700 1 --2- 172.21.15.123:0/2465835873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3680b3e40 0x7fa368164840 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.541+0000 7fa36759e700 1 -- 172.21.15.123:0/2465835873 >> 172.21.15.123:0/2465835873 conn(0x7fa3680d2ae0 msgr2=0x7fa3680d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:42.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.541+0000 7fa36759e700 1 -- 172.21.15.123:0/2465835873 shutdown_connections 2024-09-13T17:07:42.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.541+0000 7fa36759e700 1 -- 172.21.15.123:0/2465835873 wait complete. 2024-09-13T17:07:42.555 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-13T17:07:42.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.665+0000 7fa163081700 1 Processor -- start 2024-09-13T17:07:42.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.665+0000 7fa163081700 1 -- start start 2024-09-13T17:07:42.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa163081700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa15c1593b0 0x7fa15c06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:42.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa163081700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa15c0c99d0 0x7fa15c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:42.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa163081700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15c0cd160 con 0x7fa15c158fd0 2024-09-13T17:07:42.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa163081700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15c0cd4b0 con 0x7fa15c0c99d0 2024-09-13T17:07:42.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa163081700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c06aa40 con 0x7fa15c1593b0 2024-09-13T17:07:42.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa16161e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa15c0c99d0 0x7fa15c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:42.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa16161e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa15c0c99d0 0x7fa15c0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44094/0 (socket says 172.21.15.123:44094) 2024-09-13T17:07:42.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa16161e700 1 -- 172.21.15.123:0/4068838974 learned_addr learned my addr 172.21.15.123:0/4068838974 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:42.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa160e1d700 1 --1- 172.21.15.123:0/4068838974 >> v1:172.21.15.123:6789/0 conn(0x7fa15c158fd0 0x7fa15c06a260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41756/0 (socket says 172.21.15.123:41756) 2024-09-13T17:07:42.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa15bfff700 1 --2- 172.21.15.123:0/4068838974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa15c1593b0 0x7fa15c06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa16161e700 1 -- 172.21.15.123:0/4068838974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa15c1593b0 msgr2=0x7fa15c06ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa16161e700 1 --2- 172.21.15.123:0/4068838974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa15c1593b0 0x7fa15c06ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa16161e700 1 -- 172.21.15.123:0/4068838974 >> v1:172.21.15.123:6789/0 conn(0x7fa15c158fd0 legacy=0x7fa15c06a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa15b7fe700 1 -- 172.21.15.123:0/4068838974 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237313547 0 0) 0x7fa15c0cd160 con 0x7fa15c158fd0 2024-09-13T17:07:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa16161e700 1 -- 172.21.15.123:0/4068838974 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c06ad20 con 0x7fa15c0c99d0 2024-09-13T17:07:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa16161e700 1 --2- 172.21.15.123:0/4068838974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c0c99d0 0x7fa15c0cbc50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa154009e50 tx=0x7fa15400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1628e669571cd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa15b7fe700 1 -- 172.21.15.123:0/4068838974 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15400e070 con 0x7fa15c0c99d0 2024-09-13T17:07:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa15b7fe700 1 -- 172.21.15.123:0/4068838974 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15400b910 con 0x7fa15c0c99d0 2024-09-13T17:07:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa15b7fe700 1 -- 172.21.15.123:0/4068838974 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15400bcc0 con 0x7fa15c0c99d0 2024-09-13T17:07:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa163081700 1 -- 172.21.15.123:0/4068838974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c0c99d0 msgr2=0x7fa15c0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa163081700 1 --2- 172.21.15.123:0/4068838974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c0c99d0 0x7fa15c0cbc50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa154009e50 tx=0x7fa15400b330 comp rx=0 tx=0).stop 2024-09-13T17:07:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa163081700 1 -- 172.21.15.123:0/4068838974 shutdown_connections 2024-09-13T17:07:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa163081700 1 --2- 172.21.15.123:0/4068838974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c0c99d0 0x7fa15c0cbc50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa163081700 1 --2- 172.21.15.123:0/4068838974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa15c1593b0 0x7fa15c06ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa163081700 1 -- 172.21.15.123:0/4068838974 >> 172.21.15.123:0/4068838974 conn(0x7fa15c0b0eb0 msgr2=0x7fa15c0b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa163081700 1 -- 172.21.15.123:0/4068838974 shutdown_connections 2024-09-13T17:07:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.669+0000 7fa163081700 1 -- 172.21.15.123:0/4068838974 wait complete. 2024-09-13T17:07:42.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa163081700 1 Processor -- start 2024-09-13T17:07:42.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa163081700 1 -- start start 2024-09-13T17:07:42.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa163081700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c0c99d0 0x7fa15c0b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:42.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa163081700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa15c158fd0 0x7fa15c0c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:42.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa163081700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa15c1593b0 0x7fa15c0c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa163081700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c0c4c70 con 0x7fa15c0c99d0 2024-09-13T17:07:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa163081700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c0c4f50 con 0x7fa15c158fd0 2024-09-13T17:07:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa163081700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c0c5230 con 0x7fa15c1593b0 2024-09-13T17:07:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa160e1d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c0c99d0 0x7fa15c0b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa160e1d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c0c99d0 0x7fa15c0b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44110/0 (socket says 172.21.15.123:44110) 2024-09-13T17:07:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa160e1d700 1 -- 172.21.15.123:0/4003201258 learned_addr learned my addr 172.21.15.123:0/4003201258 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa15bfff700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa15c158fd0 0x7fa15c0c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa16161e700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa15c1593b0 0x7fa15c0c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa160e1d700 1 -- 172.21.15.123:0/4003201258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa15c1593b0 msgr2=0x7fa15c0c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa160e1d700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa15c1593b0 0x7fa15c0c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa160e1d700 1 -- 172.21.15.123:0/4003201258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa15c158fd0 msgr2=0x7fa15c0c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa160e1d700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa15c158fd0 0x7fa15c0c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa160e1d700 1 -- 172.21.15.123:0/4003201258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa154009b30 con 0x7fa15c0c99d0 2024-09-13T17:07:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa15bfff700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa15c158fd0 0x7fa15c0c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:42.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa160e1d700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c0c99d0 0x7fa15c0b4630 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00c580 tx=0x7fa14c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:42.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa1597fa700 1 -- 172.21.15.123:0/4003201258 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c004ca0 con 0x7fa15c0c99d0 2024-09-13T17:07:42.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa1597fa700 1 -- 172.21.15.123:0/4003201258 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c004e20 con 0x7fa15c0c99d0 2024-09-13T17:07:42.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa163081700 1 -- 172.21.15.123:0/4003201258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15c0c5510 con 0x7fa15c0c99d0 2024-09-13T17:07:42.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa1597fa700 1 -- 172.21.15.123:0/4003201258 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c007310 con 0x7fa15c0c99d0 2024-09-13T17:07:42.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.673+0000 7fa163081700 1 -- 172.21.15.123:0/4003201258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15c153370 con 0x7fa15c0c99d0 2024-09-13T17:07:42.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.677+0000 7fa163081700 1 -- 172.21.15.123:0/4003201258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15c0c5a30 con 0x7fa15c0c99d0 2024-09-13T17:07:42.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.677+0000 7fa1597fa700 1 -- 172.21.15.123:0/4003201258 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa14c007470 con 0x7fa15c0c99d0 2024-09-13T17:07:42.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.677+0000 7fa1597fa700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa140066730 0x7fa140068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:42.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.677+0000 7fa1597fa700 1 -- 172.21.15.123:0/4003201258 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa14c083c40 con 0x7fa15c0c99d0 2024-09-13T17:07:42.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.677+0000 7fa15bfff700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa140066730 0x7fa140068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:42.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.677+0000 7fa15bfff700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa140066730 0x7fa140068bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa15c0c5e90 tx=0x7fa144008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:42.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.685+0000 7fa1597fa700 1 -- 172.21.15.123:0/4003201258 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa15c0c5a30 con 0x7fa15c0c99d0 2024-09-13T17:07:42.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.913+0000 7fa163081700 1 -- 172.21.15.123:0/4003201258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa15c0c5a30 con 0x7fa15c0c99d0 2024-09-13T17:07:42.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.921+0000 7fa1597fa700 1 -- 172.21.15.123:0/4003201258 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa14c051260 con 0x7fa15c0c99d0 2024-09-13T17:07:42.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.921+0000 7fa163081700 1 -- 172.21.15.123:0/4003201258 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa140066730 msgr2=0x7fa140068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:42.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.921+0000 7fa163081700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa140066730 0x7fa140068bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa15c0c5e90 tx=0x7fa144008040 comp rx=0 tx=0).stop 2024-09-13T17:07:42.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.921+0000 7fa163081700 1 -- 172.21.15.123:0/4003201258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c0c99d0 msgr2=0x7fa15c0b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:42.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.921+0000 7fa163081700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c0c99d0 0x7fa15c0b4630 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00c580 tx=0x7fa14c00c940 comp rx=0 tx=0).stop 2024-09-13T17:07:42.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.921+0000 7fa163081700 1 -- 172.21.15.123:0/4003201258 shutdown_connections 2024-09-13T17:07:42.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.921+0000 7fa163081700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa140066730 0x7fa140068bf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.921+0000 7fa163081700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa15c1593b0 0x7fa15c0c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.921+0000 7fa163081700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa15c158fd0 0x7fa15c0c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.921+0000 7fa163081700 1 --2- 172.21.15.123:0/4003201258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa15c0c99d0 0x7fa15c0b4630 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:42.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.921+0000 7fa163081700 1 -- 172.21.15.123:0/4003201258 >> 172.21.15.123:0/4003201258 conn(0x7fa15c0b0eb0 msgr2=0x7fa15c0b0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:42.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.925+0000 7fa163081700 1 -- 172.21.15.123:0/4003201258 shutdown_connections 2024-09-13T17:07:42.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:42.925+0000 7fa163081700 1 -- 172.21.15.123:0/4003201258 wait complete. 2024-09-13T17:07:42.939 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-13T17:07:43.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.053+0000 7efce1bb6700 1 Processor -- start 2024-09-13T17:07:43.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.053+0000 7efce1bb6700 1 -- start start 2024-09-13T17:07:43.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efcdc0cb4e0 0x7efcdc0ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efcdc0cb8c0 0x7efcdc0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efcdc15c960 0x7efcdc15cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc0ad7f0 con 0x7efcdc15c960 2024-09-13T17:07:43.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc0c9100 con 0x7efcdc0cb8c0 2024-09-13T17:07:43.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc15d330 con 0x7efcdc0cb4e0 2024-09-13T17:07:43.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efcdbfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efcdc15c960 0x7efcdc15cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efcdbfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efcdc15c960 0x7efcdc15cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44114/0 (socket says 172.21.15.123:44114) 2024-09-13T17:07:43.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efcdbfff700 1 -- 172.21.15.123:0/3463146361 learned_addr learned my addr 172.21.15.123:0/3463146361 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:43.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efcdb7fe700 1 --2- 172.21.15.123:0/3463146361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efcdc0cb4e0 0x7efcdc0ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efcdaffd700 1 --2- 172.21.15.123:0/3463146361 >> v2:172.21.15.153:3300/0 conn(0x7efcdc0cb8c0 0x7efcdc0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efcdbfff700 1 -- 172.21.15.123:0/3463146361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efcdc0cb4e0 msgr2=0x7efcdc0ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:43.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efcdbfff700 1 --2- 172.21.15.123:0/3463146361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efcdc0cb4e0 0x7efcdc0ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efcdbfff700 1 -- 172.21.15.123:0/3463146361 >> v2:172.21.15.153:3300/0 conn(0x7efcdc0cb8c0 msgr2=0x7efcdc0ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:43.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efcdbfff700 1 --2- 172.21.15.123:0/3463146361 >> v2:172.21.15.153:3300/0 conn(0x7efcdc0cb8c0 0x7efcdc0ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efcdbfff700 1 -- 172.21.15.123:0/3463146361 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0acf50 con 0x7efcdc15c960 2024-09-13T17:07:43.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efcdbfff700 1 --2- 172.21.15.123:0/3463146361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcdc15c960 0x7efcdc15cdf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0b1400 tx=0x7efcd4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef809db70be603b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:43.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efcda7fc700 1 -- 172.21.15.123:0/3463146361 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4011830 con 0x7efcdc15c960 2024-09-13T17:07:43.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efcda7fc700 1 -- 172.21.15.123:0/3463146361 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd4011990 con 0x7efcdc15c960 2024-09-13T17:07:43.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efcda7fc700 1 -- 172.21.15.123:0/3463146361 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4011d20 con 0x7efcdc15c960 2024-09-13T17:07:43.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 -- 172.21.15.123:0/3463146361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcdc15c960 msgr2=0x7efcdc15cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 --2- 172.21.15.123:0/3463146361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcdc15c960 0x7efcdc15cdf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0b1400 tx=0x7efcd4009bf0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 -- 172.21.15.123:0/3463146361 shutdown_connections 2024-09-13T17:07:43.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 --2- 172.21.15.123:0/3463146361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcdc15c960 0x7efcdc15cdf0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 --2- 172.21.15.123:0/3463146361 >> v2:172.21.15.153:3300/0 conn(0x7efcdc0cb8c0 0x7efcdc0ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 --2- 172.21.15.123:0/3463146361 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efcdc0cb4e0 0x7efcdc0ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 -- 172.21.15.123:0/3463146361 >> 172.21.15.123:0/3463146361 conn(0x7efcdc0b0450 msgr2=0x7efcdc0b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:43.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 -- 172.21.15.123:0/3463146361 shutdown_connections 2024-09-13T17:07:43.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.057+0000 7efce1bb6700 1 -- 172.21.15.123:0/3463146361 wait complete. 2024-09-13T17:07:43.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efce1bb6700 1 Processor -- start 2024-09-13T17:07:43.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efce1bb6700 1 -- start start 2024-09-13T17:07:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efce1bb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcdc0cb4e0 0x7efcdc15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efce1bb6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efcdc0cb8c0 0x7efcdc0c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efce1bb6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcdc15c960 0x7efcdc0c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efce1bb6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0c6640 con 0x7efcdc15c960 2024-09-13T17:07:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efce1bb6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0c6920 con 0x7efcdc0cb4e0 2024-09-13T17:07:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efce1bb6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0c6c00 con 0x7efcdc0cb8c0 2024-09-13T17:07:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efcdbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcdc15c960 0x7efcdc0c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efcdbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcdc15c960 0x7efcdc0c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44128/0 (socket says 172.21.15.123:44128) 2024-09-13T17:07:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efcdbfff700 1 -- 172.21.15.123:0/1944922643 learned_addr learned my addr 172.21.15.123:0/1944922643 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efcdb7fe700 1 --2- 172.21.15.123:0/1944922643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcdc0cb4e0 0x7efcdc15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efcdaffd700 1 --2- 172.21.15.123:0/1944922643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efcdc0cb8c0 0x7efcdc0c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efcdbfff700 1 -- 172.21.15.123:0/1944922643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efcdc0cb8c0 msgr2=0x7efcdc0c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efcdbfff700 1 --2- 172.21.15.123:0/1944922643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efcdc0cb8c0 0x7efcdc0c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efcdbfff700 1 -- 172.21.15.123:0/1944922643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcdc0cb4e0 msgr2=0x7efcdc15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efcdbfff700 1 --2- 172.21.15.123:0/1944922643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcdc0cb4e0 0x7efcdc15ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efcdbfff700 1 -- 172.21.15.123:0/1944922643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd4009570 con 0x7efcdc15c960 2024-09-13T17:07:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efcdbfff700 1 --2- 172.21.15.123:0/1944922643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcdc15c960 0x7efcdc0c83c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efcd4014040 tx=0x7efcd4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efcd3fff700 1 -- 172.21.15.123:0/1944922643 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4004450 con 0x7efcdc15c960 2024-09-13T17:07:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efcd3fff700 1 -- 172.21.15.123:0/1944922643 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd401e070 con 0x7efcdc15c960 2024-09-13T17:07:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efce1bb6700 1 -- 172.21.15.123:0/1944922643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc0c6ee0 con 0x7efcdc15c960 2024-09-13T17:07:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efcd3fff700 1 -- 172.21.15.123:0/1944922643 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4003900 con 0x7efcdc15c960 2024-09-13T17:07:43.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.061+0000 7efce1bb6700 1 -- 172.21.15.123:0/1944922643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc0c5950 con 0x7efcdc15c960 2024-09-13T17:07:43.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.065+0000 7efce1bb6700 1 -- 172.21.15.123:0/1944922643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc0c2650 con 0x7efcdc15c960 2024-09-13T17:07:43.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.065+0000 7efcd3fff700 1 -- 172.21.15.123:0/1944922643 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efcd4003a60 con 0x7efcdc15c960 2024-09-13T17:07:43.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.065+0000 7efcd3fff700 1 --2- 172.21.15.123:0/1944922643 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efcbc066730 0x7efcbc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.065+0000 7efcdb7fe700 1 --2- 172.21.15.123:0/1944922643 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efcbc066730 0x7efcbc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.065+0000 7efcd3fff700 1 -- 172.21.15.123:0/1944922643 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efcd4084d00 con 0x7efcdc15c960 2024-09-13T17:07:43.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.069+0000 7efcdb7fe700 1 --2- 172.21.15.123:0/1944922643 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efcbc066730 0x7efcbc068bf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009b70 tx=0x7efcc4009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.077+0000 7efcd3fff700 1 -- 172.21.15.123:0/1944922643 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efcd4052570 con 0x7efcdc15c960 2024-09-13T17:07:43.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.309+0000 7efce1bb6700 1 -- 172.21.15.123:0/1944922643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7efcdc0ad9f0 con 0x7efcdc15c960 2024-09-13T17:07:43.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.313+0000 7efcd3fff700 1 -- 172.21.15.123:0/1944922643 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7efcd40200a0 con 0x7efcdc15c960 2024-09-13T17:07:43.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.317+0000 7efce1bb6700 1 -- 172.21.15.123:0/1944922643 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efcbc066730 msgr2=0x7efcbc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.317+0000 7efce1bb6700 1 --2- 172.21.15.123:0/1944922643 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efcbc066730 0x7efcbc068bf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009b70 tx=0x7efcc4009240 comp rx=0 tx=0).stop 2024-09-13T17:07:43.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.317+0000 7efce1bb6700 1 -- 172.21.15.123:0/1944922643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcdc15c960 msgr2=0x7efcdc0c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.317+0000 7efce1bb6700 1 --2- 172.21.15.123:0/1944922643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcdc15c960 0x7efcdc0c83c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efcd4014040 tx=0x7efcd4004770 comp rx=0 tx=0).stop 2024-09-13T17:07:43.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.317+0000 7efce1bb6700 1 -- 172.21.15.123:0/1944922643 shutdown_connections 2024-09-13T17:07:43.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.317+0000 7efce1bb6700 1 --2- 172.21.15.123:0/1944922643 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efcbc066730 0x7efcbc068bf0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.317+0000 7efce1bb6700 1 --2- 172.21.15.123:0/1944922643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcdc15c960 0x7efcdc0c83c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.317+0000 7efce1bb6700 1 --2- 172.21.15.123:0/1944922643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efcdc0cb8c0 0x7efcdc0c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.317+0000 7efce1bb6700 1 --2- 172.21.15.123:0/1944922643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcdc0cb4e0 0x7efcdc15ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.317+0000 7efce1bb6700 1 -- 172.21.15.123:0/1944922643 >> 172.21.15.123:0/1944922643 conn(0x7efcdc0b0450 msgr2=0x7efcdc0ce880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:43.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.317+0000 7efce1bb6700 1 -- 172.21.15.123:0/1944922643 shutdown_connections 2024-09-13T17:07:43.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.317+0000 7efce1bb6700 1 -- 172.21.15.123:0/1944922643 wait complete. 2024-09-13T17:07:43.332 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:43.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbdb2c3700 1 Processor -- start 2024-09-13T17:07:43.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbdb2c3700 1 -- start start 2024-09-13T17:07:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbdb2c3700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcbd40cec90 0x7fcbd40cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbdb2c3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd40b1cf0 con 0x7fcbd415aa80 2024-09-13T17:07:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbdb2c3700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd40b37f0 con 0x7fcbd4072510 2024-09-13T17:07:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbdb2c3700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd415ae60 con 0x7fcbd40cec90 2024-09-13T17:07:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbd905f700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcbd415aa80 0x7fcbd415b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41762/0 (socket says 172.21.15.123:41762) 2024-09-13T17:07:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbd905f700 1 -- 172.21.15.123:0/2883929904 learned_addr learned my addr 172.21.15.123:0/2883929904 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbd9860700 1 --2- 172.21.15.123:0/2883929904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcbd40cec90 0x7fcbd40cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 -- 172.21.15.123:0/2883929904 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769742358 0 0) 0x7fcbd40b1cf0 con 0x7fcbd415aa80 2024-09-13T17:07:43.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 -- 172.21.15.123:0/2883929904 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc00035d0 con 0x7fcbd415aa80 2024-09-13T17:07:43.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 -- 172.21.15.123:0/2883929904 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2577335140 0 0) 0x7fcbc00035d0 con 0x7fcbd415aa80 2024-09-13T17:07:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 -- 172.21.15.123:0/2883929904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcbd40cec90 msgr2=0x7fcbd40cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 --2- 172.21.15.123:0/2883929904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcbd40cec90 0x7fcbd40cf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 -- 172.21.15.123:0/2883929904 >> v1:172.21.15.153:6789/0 conn(0x7fcbd4072510 legacy=0x7fcbd40cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 -- 172.21.15.123:0/2883929904 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd40b3ad0 con 0x7fcbd415aa80 2024-09-13T17:07:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 -- 172.21.15.123:0/2883929904 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7fcbcc0019f0 con 0x7fcbd415aa80 2024-09-13T17:07:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 -- 172.21.15.123:0/2883929904 >> v1:172.21.15.123:6789/0 conn(0x7fcbd415aa80 legacy=0x7fcbd415b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 --2- 172.21.15.123:0/2883929904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbc0003a50 0x7fcbc0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 --2- 172.21.15.123:0/2883929904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbc0004400 0x7fcbc00048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 --2- 172.21.15.123:0/2883929904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcbd40cec90 0x7fcbc0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 -- 172.21.15.123:0/2883929904 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc000ba30 con 0x7fcbc0004400 2024-09-13T17:07:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 -- 172.21.15.123:0/2883929904 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc000bb70 con 0x7fcbc0003a50 2024-09-13T17:07:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 -- 172.21.15.123:0/2883929904 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc000bd30 con 0x7fcbd40cec90 2024-09-13T17:07:43.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbd885e700 1 --2- 172.21.15.123:0/2883929904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbc0004400 0x7fcbc00048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbd905f700 1 --2- 172.21.15.123:0/2883929904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbc0003a50 0x7fcbc0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbd9860700 1 --2- 172.21.15.123:0/2883929904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcbd40cec90 0x7fcbc0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbd885e700 1 -- 172.21.15.123:0/2883929904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcbd40cec90 msgr2=0x7fcbc0005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:43.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbd885e700 1 --2- 172.21.15.123:0/2883929904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcbd40cec90 0x7fcbc0005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbd885e700 1 -- 172.21.15.123:0/2883929904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbc0003a50 msgr2=0x7fcbc0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:43.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbd885e700 1 --2- 172.21.15.123:0/2883929904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbc0003a50 0x7fcbc0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbd885e700 1 -- 172.21.15.123:0/2883929904 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc00035d0 con 0x7fcbc0004400 2024-09-13T17:07:43.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbd905f700 1 --2- 172.21.15.123:0/2883929904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbc0003a50 0x7fcbc0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:43.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbd9860700 1 --2- 172.21.15.123:0/2883929904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcbd40cec90 0x7fcbc0005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:43.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbd885e700 1 --2- 172.21.15.123:0/2883929904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbc0004400 0x7fcbc00048d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40019a0 tx=0x7fcbc00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd4720a09c5cfd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:43.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 -- 172.21.15.123:0/2883929904 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4001440 con 0x7fcbc0004400 2024-09-13T17:07:43.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 -- 172.21.15.123:0/2883929904 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc4006aa0 con 0x7fcbc0004400 2024-09-13T17:07:43.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.445+0000 7fcbcbfff700 1 -- 172.21.15.123:0/2883929904 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4006e50 con 0x7fcbc0004400 2024-09-13T17:07:43.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.449+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/2883929904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbc0004400 msgr2=0x7fcbc00048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.449+0000 7fcbdb2c3700 1 --2- 172.21.15.123:0/2883929904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbc0004400 0x7fcbc00048d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40019a0 tx=0x7fcbc00058a0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.449+0000 7fcbd9860700 1 -- 172.21.15.123:0/2883929904 reap_dead start 2024-09-13T17:07:43.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.449+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/2883929904 shutdown_connections 2024-09-13T17:07:43.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.449+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/2883929904 >> 172.21.15.123:0/2883929904 conn(0x7fcbd4066570 msgr2=0x7fcbd4066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:43.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.449+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/2883929904 shutdown_connections 2024-09-13T17:07:43.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.449+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/2883929904 wait complete. 2024-09-13T17:07:43.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbdb2c3700 1 Processor -- start 2024-09-13T17:07:43.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbdb2c3700 1 -- start start 2024-09-13T17:07:43.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbdb2c3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbc0004400 0x7fcbd414ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbdb2c3700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcbd415d970 0x7fcbd41549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbdb2c3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd415c2c0 0x7fcbd415c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbdb2c3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd414f550 con 0x7fcbc0004400 2024-09-13T17:07:43.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbdb2c3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd413dd60 con 0x7fcbd415c2c0 2024-09-13T17:07:43.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbdb2c3700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd4144370 con 0x7fcbd415d970 2024-09-13T17:07:43.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbd905f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbc0004400 0x7fcbd414ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbd905f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbc0004400 0x7fcbd414ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44140/0 (socket says 172.21.15.123:44140) 2024-09-13T17:07:43.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbd905f700 1 -- 172.21.15.123:0/70856829 learned_addr learned my addr 172.21.15.123:0/70856829 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:43.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbd885e700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcbd415d970 0x7fcbd41549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbd9860700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd415c2c0 0x7fcbd415c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbd905f700 1 -- 172.21.15.123:0/70856829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcbd415d970 msgr2=0x7fcbd41549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbd905f700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcbd415d970 0x7fcbd41549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbd905f700 1 -- 172.21.15.123:0/70856829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd415c2c0 msgr2=0x7fcbd415c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbd905f700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd415c2c0 0x7fcbd415c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbd905f700 1 -- 172.21.15.123:0/70856829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4151df0 con 0x7fcbc0004400 2024-09-13T17:07:43.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbd9860700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd415c2c0 0x7fcbd415c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:43.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbd905f700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbc0004400 0x7fcbd414ee50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0072c0 tx=0x7fcbcc0072f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:43.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbc9ffb700 1 -- 172.21.15.123:0/70856829 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc007a90 con 0x7fcbc0004400 2024-09-13T17:07:43.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbc9ffb700 1 -- 172.21.15.123:0/70856829 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc0133f0 con 0x7fcbc0004400 2024-09-13T17:07:43.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/70856829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd41544c0 con 0x7fcbc0004400 2024-09-13T17:07:43.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbc9ffb700 1 -- 172.21.15.123:0/70856829 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc013760 con 0x7fcbc0004400 2024-09-13T17:07:43.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.453+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/70856829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd4152370 con 0x7fcbc0004400 2024-09-13T17:07:43.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.457+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/70856829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd40b3150 con 0x7fcbc0004400 2024-09-13T17:07:43.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.457+0000 7fcbc9ffb700 1 -- 172.21.15.123:0/70856829 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcbcc0138c0 con 0x7fcbc0004400 2024-09-13T17:07:43.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.457+0000 7fcbc9ffb700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcbb8066730 0x7fcbb8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.457+0000 7fcbc9ffb700 1 -- 172.21.15.123:0/70856829 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcbcc084be0 con 0x7fcbc0004400 2024-09-13T17:07:43.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.457+0000 7fcbd885e700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcbb8066730 0x7fcbb8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.457+0000 7fcbd885e700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcbb8066730 0x7fcbb8068bf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcbd414dc80 tx=0x7fcbc4009030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:43.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.465+0000 7fcbc9ffb700 1 -- 172.21.15.123:0/70856829 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcbcc052330 con 0x7fcbc0004400 2024-09-13T17:07:43.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.637+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/70856829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbd40cf520 con 0x7fcbc0004400 2024-09-13T17:07:43.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.637+0000 7fcbc9ffb700 1 -- 172.21.15.123:0/70856829 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12905 (secure 0 0 0) 0x7fcbcc055950 con 0x7fcbc0004400 2024-09-13T17:07:43.642 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:43.642 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":30,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:07:40.560630+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.641+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/70856829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcbb8066730 msgr2=0x7fcbb8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.641+0000 7fcbdb2c3700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcbb8066730 0x7fcbb8068bf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcbd414dc80 tx=0x7fcbc4009030 comp rx=0 tx=0).stop 2024-09-13T17:07:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.641+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/70856829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbc0004400 msgr2=0x7fcbd414ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.641+0000 7fcbdb2c3700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbc0004400 0x7fcbd414ee50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0072c0 tx=0x7fcbcc0072f0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.641+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/70856829 shutdown_connections 2024-09-13T17:07:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.641+0000 7fcbdb2c3700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcbb8066730 0x7fcbb8068bf0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.641+0000 7fcbdb2c3700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbd415c2c0 0x7fcbd415c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.641+0000 7fcbdb2c3700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcbd415d970 0x7fcbd41549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.641+0000 7fcbdb2c3700 1 --2- 172.21.15.123:0/70856829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbc0004400 0x7fcbd414ee50 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.641+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/70856829 >> 172.21.15.123:0/70856829 conn(0x7fcbd4066570 msgr2=0x7fcbd40ae450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.641+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/70856829 shutdown_connections 2024-09-13T17:07:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.641+0000 7fcbdb2c3700 1 -- 172.21.15.123:0/70856829 wait complete. 2024-09-13T17:07:43.657 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:07:43.657 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:07:43.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 Processor -- start 2024-09-13T17:07:43.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 -- start start 2024-09-13T17:07:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2b1415abe0 0x7f2b140ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b140cfb20 0x7f2b140cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b140d0a80 0x7f2b140d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b140b6ae0 con 0x7f2b140d0a80 2024-09-13T17:07:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b140d0480 con 0x7f2b1415abe0 2024-09-13T17:07:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b140affb0 con 0x7f2b140cfb20 2024-09-13T17:07:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1a28f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b140d0a80 0x7f2b140d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1a28f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b140d0a80 0x7f2b140d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44150/0 (socket says 172.21.15.123:44150) 2024-09-13T17:07:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1a28f700 1 -- 172.21.15.123:0/287643001 learned_addr learned my addr 172.21.15.123:0/287643001 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1928d700 1 --2- 172.21.15.123:0/287643001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b140cfb20 0x7f2b140cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b19a8e700 1 --2- 172.21.15.123:0/287643001 >> v2:172.21.15.153:3300/0 conn(0x7f2b1415abe0 0x7f2b140ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1a28f700 1 -- 172.21.15.123:0/287643001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b140cfb20 msgr2=0x7f2b140cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:43.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1a28f700 1 --2- 172.21.15.123:0/287643001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b140cfb20 0x7f2b140cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1a28f700 1 -- 172.21.15.123:0/287643001 >> v2:172.21.15.153:3300/0 conn(0x7f2b1415abe0 msgr2=0x7f2b140ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:43.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1a28f700 1 --2- 172.21.15.123:0/287643001 >> v2:172.21.15.153:3300/0 conn(0x7f2b1415abe0 0x7f2b140ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1a28f700 1 -- 172.21.15.123:0/287643001 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b140b6800 con 0x7f2b140d0a80 2024-09-13T17:07:43.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b19a8e700 1 --2- 172.21.15.123:0/287643001 >> v2:172.21.15.153:3300/0 conn(0x7f2b1415abe0 0x7f2b140ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:43.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1a28f700 1 --2- 172.21.15.123:0/287643001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b140d0a80 0x7f2b140d0f10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2b1406dde0 tx=0x7f2b0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4424dab00e90935f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:43.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b18a8c700 1 -- 172.21.15.123:0/287643001 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c00e070 con 0x7f2b140d0a80 2024-09-13T17:07:43.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b18a8c700 1 -- 172.21.15.123:0/287643001 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c00b9c0 con 0x7f2b140d0a80 2024-09-13T17:07:43.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b18a8c700 1 -- 172.21.15.123:0/287643001 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c00bd70 con 0x7f2b140d0a80 2024-09-13T17:07:43.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/287643001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b140d0a80 msgr2=0x7f2b140d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 --2- 172.21.15.123:0/287643001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b140d0a80 0x7f2b140d0f10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2b1406dde0 tx=0x7f2b0c00b330 comp rx=0 tx=0).stop 2024-09-13T17:07:43.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/287643001 shutdown_connections 2024-09-13T17:07:43.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 --2- 172.21.15.123:0/287643001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b140cfb20 0x7f2b140cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 --2- 172.21.15.123:0/287643001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b140d0a80 0x7f2b140d0f10 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 --2- 172.21.15.123:0/287643001 >> v2:172.21.15.153:3300/0 conn(0x7f2b1415abe0 0x7f2b140ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/287643001 >> 172.21.15.123:0/287643001 conn(0x7f2b1406a260 msgr2=0x7f2b1406a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:43.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/287643001 shutdown_connections 2024-09-13T17:07:43.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.773+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/287643001 wait complete. 2024-09-13T17:07:43.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1bcf2700 1 Processor -- start 2024-09-13T17:07:43.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1bcf2700 1 -- start start 2024-09-13T17:07:43.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1bcf2700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b140cfb20 0x7f2b1415afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1bcf2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b140d0a80 0x7f2b1414b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1bcf2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1415abe0 0x7f2b141efe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1bcf2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b141f1370 con 0x7f2b140d0a80 2024-09-13T17:07:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1bcf2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1414bb70 con 0x7f2b1415abe0 2024-09-13T17:07:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1bcf2700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b141f0760 con 0x7f2b140cfb20 2024-09-13T17:07:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1928d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b140d0a80 0x7f2b1414b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1928d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b140d0a80 0x7f2b1414b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44156/0 (socket says 172.21.15.123:44156) 2024-09-13T17:07:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1928d700 1 -- 172.21.15.123:0/1438222752 learned_addr learned my addr 172.21.15.123:0/1438222752 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b19a8e700 1 --2- 172.21.15.123:0/1438222752 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b140cfb20 0x7f2b1415afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1a28f700 1 --2- 172.21.15.123:0/1438222752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1415abe0 0x7f2b141efe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1928d700 1 -- 172.21.15.123:0/1438222752 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b140cfb20 msgr2=0x7f2b1415afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1928d700 1 --2- 172.21.15.123:0/1438222752 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b140cfb20 0x7f2b1415afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1928d700 1 -- 172.21.15.123:0/1438222752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1415abe0 msgr2=0x7f2b141efe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1928d700 1 --2- 172.21.15.123:0/1438222752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1415abe0 0x7f2b141efe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1928d700 1 -- 172.21.15.123:0/1438222752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c009b30 con 0x7f2b140d0a80 2024-09-13T17:07:43.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.777+0000 7f2b1928d700 1 --2- 172.21.15.123:0/1438222752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b140d0a80 0x7f2b1414b630 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400d7d0 tx=0x7f2b0400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:43.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.781+0000 7f2b0a7fc700 1 -- 172.21.15.123:0/1438222752 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04017070 con 0x7f2b140d0a80 2024-09-13T17:07:43.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.781+0000 7f2b0a7fc700 1 -- 172.21.15.123:0/1438222752 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b04004020 con 0x7f2b140d0a80 2024-09-13T17:07:43.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.781+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/1438222752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b141f0a40 con 0x7f2b140d0a80 2024-09-13T17:07:43.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.781+0000 7f2b0a7fc700 1 -- 172.21.15.123:0/1438222752 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b040041b0 con 0x7f2b140d0a80 2024-09-13T17:07:43.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.781+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/1438222752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b141f1000 con 0x7f2b140d0a80 2024-09-13T17:07:43.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.781+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/1438222752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b140cbb60 con 0x7f2b140d0a80 2024-09-13T17:07:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.781+0000 7f2b0a7fc700 1 -- 172.21.15.123:0/1438222752 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b04004310 con 0x7f2b140d0a80 2024-09-13T17:07:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.781+0000 7f2b0a7fc700 1 --2- 172.21.15.123:0/1438222752 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2af8066730 0x7f2af8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:43.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.781+0000 7f2b0a7fc700 1 -- 172.21.15.123:0/1438222752 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2b04083750 con 0x7f2b140d0a80 2024-09-13T17:07:43.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.785+0000 7f2b19a8e700 1 --2- 172.21.15.123:0/1438222752 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2af8066730 0x7f2af8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:43.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.785+0000 7f2b19a8e700 1 --2- 172.21.15.123:0/1438222752 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2af8066730 0x7f2af8068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2b10004430 tx=0x7f2b10008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:43.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.789+0000 7f2b0a7fc700 1 -- 172.21.15.123:0/1438222752 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2b04050ea0 con 0x7f2b140d0a80 2024-09-13T17:07:43.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.953+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/1438222752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2b140b6460 con 0x7f2b140d0a80 2024-09-13T17:07:43.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.957+0000 7f2b0a7fc700 1 -- 172.21.15.123:0/1438222752 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2b040544c0 con 0x7f2b140d0a80 2024-09-13T17:07:43.959 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:07:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.957+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/1438222752 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2af8066730 msgr2=0x7f2af8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.957+0000 7f2b1bcf2700 1 --2- 172.21.15.123:0/1438222752 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2af8066730 0x7f2af8068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2b10004430 tx=0x7f2b10008040 comp rx=0 tx=0).stop 2024-09-13T17:07:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.957+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/1438222752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b140d0a80 msgr2=0x7f2b1414b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.957+0000 7f2b1bcf2700 1 --2- 172.21.15.123:0/1438222752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b140d0a80 0x7f2b1414b630 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400d7d0 tx=0x7f2b0400dae0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.957+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/1438222752 shutdown_connections 2024-09-13T17:07:43.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.957+0000 7f2b1bcf2700 1 --2- 172.21.15.123:0/1438222752 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2af8066730 0x7f2af8068bf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.957+0000 7f2b1bcf2700 1 --2- 172.21.15.123:0/1438222752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1415abe0 0x7f2b141efe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.957+0000 7f2b1bcf2700 1 --2- 172.21.15.123:0/1438222752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b140d0a80 0x7f2b1414b630 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.957+0000 7f2b1bcf2700 1 --2- 172.21.15.123:0/1438222752 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b140cfb20 0x7f2b1415afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:43.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.957+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/1438222752 >> 172.21.15.123:0/1438222752 conn(0x7f2b1406a260 msgr2=0x7f2b140b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:43.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.957+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/1438222752 shutdown_connections 2024-09-13T17:07:43.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:43.957+0000 7f2b1bcf2700 1 -- 172.21.15.123:0/1438222752 wait complete. 2024-09-13T17:07:43.973 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:07:44.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.077+0000 7f16a4d68700 1 Processor -- start 2024-09-13T17:07:44.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.077+0000 7f16a4d68700 1 -- start start 2024-09-13T17:07:44.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f16a4d68700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f16a00d3790 0x7f16a00d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:44.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f16a4d68700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a00d1210 con 0x7f16a015cf10 2024-09-13T17:07:44.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f16a4d68700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a00cec60 con 0x7f16a00cf4f0 2024-09-13T17:07:44.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f16a4d68700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a015d2f0 con 0x7f16a00d3790 2024-09-13T17:07:44.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f169dd9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f16a00d3790 0x7f16a00d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:44.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f169dd9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f16a00d3790 0x7f16a00d16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44172/0 (socket says 172.21.15.123:44172) 2024-09-13T17:07:44.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f169dd9b700 1 -- 172.21.15.123:0/3720620631 learned_addr learned my addr 172.21.15.123:0/3720620631 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f169e59c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f16a015cf10 0x7f16a00ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41776/0 (socket says 172.21.15.123:41776) 2024-09-13T17:07:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f169dd9b700 1 -- 172.21.15.123:0/3720620631 >> v1:172.21.15.153:6789/0 conn(0x7f16a00cf4f0 legacy=0x7f16a00cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f169dd9b700 1 -- 172.21.15.123:0/3720620631 >> v1:172.21.15.123:6789/0 conn(0x7f16a015cf10 legacy=0x7f16a00ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f169d59a700 1 -- 172.21.15.123:0/3720620631 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961915414 0 0) 0x7f16a00d1210 con 0x7f16a015cf10 2024-09-13T17:07:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f169dd9b700 1 -- 172.21.15.123:0/3720620631 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a00d08e0 con 0x7f16a00d3790 2024-09-13T17:07:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f169dd9b700 1 --2- 172.21.15.123:0/3720620631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00d3790 0x7f16a00d16a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1690009910 tx=0x7f1690009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fb979f1b517c44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f169d59a700 1 -- 172.21.15.123:0/3720620631 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169000ba60 con 0x7f16a00d3790 2024-09-13T17:07:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f169d59a700 1 -- 172.21.15.123:0/3720620631 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169000bbc0 con 0x7f16a00d3790 2024-09-13T17:07:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f169d59a700 1 -- 172.21.15.123:0/3720620631 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690009e60 con 0x7f16a00d3790 2024-09-13T17:07:44.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f16a4d68700 1 -- 172.21.15.123:0/3720620631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00d3790 msgr2=0x7f16a00d16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f16a4d68700 1 --2- 172.21.15.123:0/3720620631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00d3790 0x7f16a00d16a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1690009910 tx=0x7f1690009c20 comp rx=0 tx=0).stop 2024-09-13T17:07:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f16a4d68700 1 -- 172.21.15.123:0/3720620631 shutdown_connections 2024-09-13T17:07:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f16a4d68700 1 --2- 172.21.15.123:0/3720620631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00d3790 0x7f16a00d16a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f16a4d68700 1 -- 172.21.15.123:0/3720620631 >> 172.21.15.123:0/3720620631 conn(0x7f16a00d2c70 msgr2=0x7f16a00d3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f16a4d68700 1 -- 172.21.15.123:0/3720620631 shutdown_connections 2024-09-13T17:07:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.081+0000 7f16a4d68700 1 -- 172.21.15.123:0/3720620631 wait complete. 2024-09-13T17:07:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.085+0000 7f16a4d68700 1 Processor -- start 2024-09-13T17:07:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.085+0000 7f16a4d68700 1 -- start start 2024-09-13T17:07:44.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.085+0000 7f16a4d68700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00cf4f0 0x7f16a01596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:44.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.085+0000 7f16a4d68700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16a00d3790 0x7f16a00c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:44.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.085+0000 7f16a4d68700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16a015cf10 0x7f16a00c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:44.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.085+0000 7f16a4d68700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00c8e50 con 0x7f16a00cf4f0 2024-09-13T17:07:44.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.085+0000 7f16a4d68700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00c9130 con 0x7f16a00d3790 2024-09-13T17:07:44.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.085+0000 7f16a4d68700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00c9410 con 0x7f16a015cf10 2024-09-13T17:07:44.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.085+0000 7f169e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00cf4f0 0x7f16a01596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:44.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.085+0000 7f169e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00cf4f0 0x7f16a01596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44176/0 (socket says 172.21.15.123:44176) 2024-09-13T17:07:44.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.085+0000 7f169e59c700 1 -- 172.21.15.123:0/3451865766 learned_addr learned my addr 172.21.15.123:0/3451865766 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:44.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.085+0000 7f169dd9b700 1 --2- 172.21.15.123:0/3451865766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16a00d3790 0x7f16a00c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:44.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.085+0000 7f169ed9d700 1 --2- 172.21.15.123:0/3451865766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16a015cf10 0x7f16a00c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:44.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.089+0000 7f169e59c700 1 -- 172.21.15.123:0/3451865766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16a015cf10 msgr2=0x7f16a00c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:44.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.089+0000 7f169e59c700 1 --2- 172.21.15.123:0/3451865766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16a015cf10 0x7f16a00c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:44.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.089+0000 7f169e59c700 1 -- 172.21.15.123:0/3451865766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16a00d3790 msgr2=0x7f16a00c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:44.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.089+0000 7f169e59c700 1 --2- 172.21.15.123:0/3451865766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16a00d3790 0x7f16a00c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:44.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.089+0000 7f169e59c700 1 -- 172.21.15.123:0/3451865766 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1690009570 con 0x7f16a00cf4f0 2024-09-13T17:07:44.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.089+0000 7f169e59c700 1 --2- 172.21.15.123:0/3451865766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00cf4f0 0x7f16a01596c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f169400c550 tx=0x7f169400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:44.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.089+0000 7f168effd700 1 -- 172.21.15.123:0/3451865766 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16940074e0 con 0x7f16a00cf4f0 2024-09-13T17:07:44.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.089+0000 7f168effd700 1 -- 172.21.15.123:0/3451865766 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694007640 con 0x7f16a00cf4f0 2024-09-13T17:07:44.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.089+0000 7f168effd700 1 -- 172.21.15.123:0/3451865766 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694005a90 con 0x7f16a00cf4f0 2024-09-13T17:07:44.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.089+0000 7f16a4d68700 1 -- 172.21.15.123:0/3451865766 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a00c96f0 con 0x7f16a00cf4f0 2024-09-13T17:07:44.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.089+0000 7f16a4d68700 1 -- 172.21.15.123:0/3451865766 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a0159c00 con 0x7f16a00cf4f0 2024-09-13T17:07:44.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.089+0000 7f16a4d68700 1 -- 172.21.15.123:0/3451865766 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a015e050 con 0x7f16a00cf4f0 2024-09-13T17:07:44.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.089+0000 7f168effd700 1 -- 172.21.15.123:0/3451865766 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1694005bf0 con 0x7f16a00cf4f0 2024-09-13T17:07:44.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.093+0000 7f168effd700 1 --2- 172.21.15.123:0/3451865766 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1680066730 0x7f1680068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:44.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.093+0000 7f168effd700 1 -- 172.21.15.123:0/3451865766 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1694083300 con 0x7f16a00cf4f0 2024-09-13T17:07:44.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.093+0000 7f169dd9b700 1 --2- 172.21.15.123:0/3451865766 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1680066730 0x7f1680068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:44.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.093+0000 7f169dd9b700 1 --2- 172.21.15.123:0/3451865766 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1680066730 0x7f1680068bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1690014040 tx=0x7f169001c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:44.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.101+0000 7f168effd700 1 -- 172.21.15.123:0/3451865766 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f16a015e050 con 0x7f16a00cf4f0 2024-09-13T17:07:44.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.273+0000 7f16a4d68700 1 -- 172.21.15.123:0/3451865766 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f16a015e050 con 0x7f16a00cf4f0 2024-09-13T17:07:44.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.273+0000 7f168effd700 1 -- 172.21.15.123:0/3451865766 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f16a015e050 con 0x7f16a00cf4f0 2024-09-13T17:07:44.277 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:44.277 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-13T17:07:44.277 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:07:44.277 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-13T17:07:44.277 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-13T17:07:44.277 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:44.277 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-13T17:07:44.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.277+0000 7f16a4d68700 1 -- 172.21.15.123:0/3451865766 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1680066730 msgr2=0x7f1680068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:44.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.277+0000 7f16a4d68700 1 --2- 172.21.15.123:0/3451865766 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1680066730 0x7f1680068bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1690014040 tx=0x7f169001c040 comp rx=0 tx=0).stop 2024-09-13T17:07:44.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.277+0000 7f16a4d68700 1 -- 172.21.15.123:0/3451865766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00cf4f0 msgr2=0x7f16a01596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:44.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.277+0000 7f16a4d68700 1 --2- 172.21.15.123:0/3451865766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00cf4f0 0x7f16a01596c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f169400c550 tx=0x7f169400c860 comp rx=0 tx=0).stop 2024-09-13T17:07:44.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.277+0000 7f16a4d68700 1 -- 172.21.15.123:0/3451865766 shutdown_connections 2024-09-13T17:07:44.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.277+0000 7f16a4d68700 1 --2- 172.21.15.123:0/3451865766 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1680066730 0x7f1680068bf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:44.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.277+0000 7f16a4d68700 1 --2- 172.21.15.123:0/3451865766 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16a015cf10 0x7f16a00c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:44.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.277+0000 7f16a4d68700 1 --2- 172.21.15.123:0/3451865766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16a00d3790 0x7f16a00c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:44.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.277+0000 7f16a4d68700 1 --2- 172.21.15.123:0/3451865766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00cf4f0 0x7f16a01596c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:44.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.277+0000 7f16a4d68700 1 -- 172.21.15.123:0/3451865766 >> 172.21.15.123:0/3451865766 conn(0x7f16a00d2c70 msgr2=0x7f16a01610d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:44.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.277+0000 7f16a4d68700 1 -- 172.21.15.123:0/3451865766 shutdown_connections 2024-09-13T17:07:44.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.277+0000 7f16a4d68700 1 -- 172.21.15.123:0/3451865766 wait complete. 2024-09-13T17:07:44.291 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:07:44.291 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:07:44.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.401+0000 7fad4932f700 1 Processor -- start 2024-09-13T17:07:44.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.401+0000 7fad4932f700 1 -- start start 2024-09-13T17:07:44.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad4932f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad4406ec60 0x7fad440cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:44.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad4932f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fad4415ceb0 0x7fad440d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:44.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad4932f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4406df30 con 0x7fad4415cad0 2024-09-13T17:07:44.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad4932f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4406e840 con 0x7fad4415ceb0 2024-09-13T17:07:44.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad4932f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad440d05f0 con 0x7fad4406ec60 2024-09-13T17:07:44.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad48b2e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fad4415ceb0 0x7fad440d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:44.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad48b2e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fad4415ceb0 0x7fad440d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44180/0 (socket says 172.21.15.123:44180) 2024-09-13T17:07:44.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad48b2e700 1 -- 172.21.15.123:0/3727518186 learned_addr learned my addr 172.21.15.123:0/3727518186 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:44.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad437fe700 1 --2- 172.21.15.123:0/3727518186 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad4406ec60 0x7fad440cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:44.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad48b2e700 1 -- 172.21.15.123:0/3727518186 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad4406ec60 msgr2=0x7fad440cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:44.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad48b2e700 1 --2- 172.21.15.123:0/3727518186 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad4406ec60 0x7fad440cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:44.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad48b2e700 1 -- 172.21.15.123:0/3727518186 >> v1:172.21.15.153:6789/0 conn(0x7fad4415cad0 legacy=0x7fad440cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:44.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad48b2e700 1 -- 172.21.15.123:0/3727518186 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad440ce160 con 0x7fad4415ceb0 2024-09-13T17:07:44.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad48b2e700 1 --2- 172.21.15.123:0/3727518186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4415ceb0 0x7fad440d00b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009e50 tx=0x7fad3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab79e038ef2d7f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:44.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad42ffd700 1 -- 172.21.15.123:0/3727518186 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c00e070 con 0x7fad4415ceb0 2024-09-13T17:07:44.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad42ffd700 1 -- 172.21.15.123:0/3727518186 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c00b910 con 0x7fad4415ceb0 2024-09-13T17:07:44.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad42ffd700 1 -- 172.21.15.123:0/3727518186 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c00bcc0 con 0x7fad4415ceb0 2024-09-13T17:07:44.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad4932f700 1 -- 172.21.15.123:0/3727518186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4415ceb0 msgr2=0x7fad440d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:44.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad4932f700 1 --2- 172.21.15.123:0/3727518186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4415ceb0 0x7fad440d00b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009e50 tx=0x7fad3c00b330 comp rx=0 tx=0).stop 2024-09-13T17:07:44.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad4932f700 1 -- 172.21.15.123:0/3727518186 shutdown_connections 2024-09-13T17:07:44.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad4932f700 1 --2- 172.21.15.123:0/3727518186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4415ceb0 0x7fad440d00b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:44.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad4932f700 1 --2- 172.21.15.123:0/3727518186 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad4406ec60 0x7fad440cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:44.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad4932f700 1 -- 172.21.15.123:0/3727518186 >> 172.21.15.123:0/3727518186 conn(0x7fad4406a650 msgr2=0x7fad4406aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:44.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad4932f700 1 -- 172.21.15.123:0/3727518186 shutdown_connections 2024-09-13T17:07:44.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.405+0000 7fad4932f700 1 -- 172.21.15.123:0/3727518186 wait complete. 2024-09-13T17:07:44.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad4932f700 1 Processor -- start 2024-09-13T17:07:44.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad4932f700 1 -- start start 2024-09-13T17:07:44.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad4932f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad4406ec60 0x7fad441521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad4932f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4415cad0 0x7fad441f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad4932f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad4415ceb0 0x7fad441f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad4932f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4415e300 con 0x7fad4415cad0 2024-09-13T17:07:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad4932f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4415e880 con 0x7fad4415ceb0 2024-09-13T17:07:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad4932f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad441f3110 con 0x7fad4406ec60 2024-09-13T17:07:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad437fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4415cad0 0x7fad441f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad437fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4415cad0 0x7fad441f25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44182/0 (socket says 172.21.15.123:44182) 2024-09-13T17:07:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad437fe700 1 -- 172.21.15.123:0/4027676921 learned_addr learned my addr 172.21.15.123:0/4027676921 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad43fff700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad4406ec60 0x7fad441521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad48b2e700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad4415ceb0 0x7fad441f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad437fe700 1 -- 172.21.15.123:0/4027676921 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad4406ec60 msgr2=0x7fad441521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad437fe700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad4406ec60 0x7fad441521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:44.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad437fe700 1 -- 172.21.15.123:0/4027676921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad4415ceb0 msgr2=0x7fad441f2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:44.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad437fe700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad4415ceb0 0x7fad441f2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:44.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad437fe700 1 -- 172.21.15.123:0/4027676921 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c009b30 con 0x7fad4415cad0 2024-09-13T17:07:44.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.409+0000 7fad43fff700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad4406ec60 0x7fad441521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:44.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.413+0000 7fad437fe700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4415cad0 0x7fad441f25e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fad2c00e870 tx=0x7fad2c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:44.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.413+0000 7fad40ff9700 1 -- 172.21.15.123:0/4027676921 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c0095c0 con 0x7fad4415cad0 2024-09-13T17:07:44.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.413+0000 7fad40ff9700 1 -- 172.21.15.123:0/4027676921 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2c00ee70 con 0x7fad4415cad0 2024-09-13T17:07:44.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.413+0000 7fad4932f700 1 -- 172.21.15.123:0/4027676921 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad441f33f0 con 0x7fad4415cad0 2024-09-13T17:07:44.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.413+0000 7fad40ff9700 1 -- 172.21.15.123:0/4027676921 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c00ca70 con 0x7fad4415cad0 2024-09-13T17:07:44.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.413+0000 7fad4932f700 1 -- 172.21.15.123:0/4027676921 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad441526f0 con 0x7fad4415cad0 2024-09-13T17:07:44.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.413+0000 7fad4932f700 1 -- 172.21.15.123:0/4027676921 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad44072520 con 0x7fad4415cad0 2024-09-13T17:07:44.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.413+0000 7fad40ff9700 1 -- 172.21.15.123:0/4027676921 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fad2c00cbd0 con 0x7fad4415cad0 2024-09-13T17:07:44.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.417+0000 7fad40ff9700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fad24066730 0x7fad24068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:44.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.417+0000 7fad40ff9700 1 -- 172.21.15.123:0/4027676921 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad2c083ec0 con 0x7fad4415cad0 2024-09-13T17:07:44.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.417+0000 7fad43fff700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fad24066730 0x7fad24068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:44.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.417+0000 7fad43fff700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fad24066730 0x7fad24068bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fad340017a0 tx=0x7fad34009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:44.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.421+0000 7fad40ff9700 1 -- 172.21.15.123:0/4027676921 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fad2c051460 con 0x7fad4415cad0 2024-09-13T17:07:44.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:44.593+0000 7fad4932f700 1 -- 172.21.15.123:0/4027676921 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fad441f35e0 con 0x7fad4415cad0 2024-09-13T17:07:45.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.437+0000 7fad40ff9700 1 -- 172.21.15.123:0/4027676921 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7fad441f35e0 con 0x7fad4415cad0 2024-09-13T17:07:45.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.445+0000 7fad4932f700 1 -- 172.21.15.123:0/4027676921 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fad24066730 msgr2=0x7fad24068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:45.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.445+0000 7fad4932f700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fad24066730 0x7fad24068bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fad340017a0 tx=0x7fad34009040 comp rx=0 tx=0).stop 2024-09-13T17:07:45.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.445+0000 7fad4932f700 1 -- 172.21.15.123:0/4027676921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4415cad0 msgr2=0x7fad441f25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:45.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.445+0000 7fad4932f700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4415cad0 0x7fad441f25e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fad2c00e870 tx=0x7fad2c00ec30 comp rx=0 tx=0).stop 2024-09-13T17:07:45.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.445+0000 7fad4932f700 1 -- 172.21.15.123:0/4027676921 shutdown_connections 2024-09-13T17:07:45.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.445+0000 7fad4932f700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fad24066730 0x7fad24068bf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.445+0000 7fad4932f700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad4415ceb0 0x7fad441f2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.445+0000 7fad4932f700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad4415cad0 0x7fad441f25e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.445+0000 7fad4932f700 1 --2- 172.21.15.123:0/4027676921 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad4406ec60 0x7fad441521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.445+0000 7fad4932f700 1 -- 172.21.15.123:0/4027676921 >> 172.21.15.123:0/4027676921 conn(0x7fad4406a650 msgr2=0x7fad440afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:45.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.445+0000 7fad4932f700 1 -- 172.21.15.123:0/4027676921 shutdown_connections 2024-09-13T17:07:45.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.445+0000 7fad4932f700 1 -- 172.21.15.123:0/4027676921 wait complete. 2024-09-13T17:07:45.451 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-13T17:07:45.464 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:07:45.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.577+0000 7faba3fff700 1 Processor -- start 2024-09-13T17:07:45.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.577+0000 7faba3fff700 1 -- start start 2024-09-13T17:07:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.577+0000 7faba3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faba40d0f40 0x7faba40d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.577+0000 7faba3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faba40b58b0 0x7faba40d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.577+0000 7faba3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faba40b1100 0x7faba40b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.577+0000 7faba3fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40b0060 con 0x7faba40b1100 2024-09-13T17:07:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.577+0000 7faba3fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40b0340 con 0x7faba40b58b0 2024-09-13T17:07:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.577+0000 7faba3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba40b0620 con 0x7faba40d0f40 2024-09-13T17:07:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.577+0000 7faba37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faba40b1100 0x7faba40b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.577+0000 7faba37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faba40b1100 0x7faba40b1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44198/0 (socket says 172.21.15.123:44198) 2024-09-13T17:07:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.577+0000 7faba37fe700 1 -- 172.21.15.123:0/4151670692 learned_addr learned my addr 172.21.15.123:0/4151670692 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba2ffd700 1 --2- 172.21.15.123:0/4151670692 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faba40d0f40 0x7faba40d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba27fc700 1 --2- 172.21.15.123:0/4151670692 >> v2:172.21.15.153:3300/0 conn(0x7faba40b58b0 0x7faba40d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba37fe700 1 -- 172.21.15.123:0/4151670692 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faba40d0f40 msgr2=0x7faba40d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba37fe700 1 --2- 172.21.15.123:0/4151670692 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faba40d0f40 0x7faba40d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba37fe700 1 -- 172.21.15.123:0/4151670692 >> v2:172.21.15.153:3300/0 conn(0x7faba40b58b0 msgr2=0x7faba40d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba37fe700 1 --2- 172.21.15.123:0/4151670692 >> v2:172.21.15.153:3300/0 conn(0x7faba40b58b0 0x7faba40d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba37fe700 1 -- 172.21.15.123:0/4151670692 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40b0900 con 0x7faba40b1100 2024-09-13T17:07:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba27fc700 1 --2- 172.21.15.123:0/4151670692 >> v2:172.21.15.153:3300/0 conn(0x7faba40b58b0 0x7faba40d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba37fe700 1 --2- 172.21.15.123:0/4151670692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b1100 0x7faba40b1550 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7faba408cea0 tx=0x7fab9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb11de5e17fa735 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba1ffb700 1 -- 172.21.15.123:0/4151670692 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00e070 con 0x7faba40b1100 2024-09-13T17:07:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba1ffb700 1 -- 172.21.15.123:0/4151670692 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c00b9c0 con 0x7faba40b1100 2024-09-13T17:07:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba1ffb700 1 -- 172.21.15.123:0/4151670692 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00bd70 con 0x7faba40b1100 2024-09-13T17:07:45.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba3fff700 1 -- 172.21.15.123:0/4151670692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b1100 msgr2=0x7faba40b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:45.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba3fff700 1 --2- 172.21.15.123:0/4151670692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b1100 0x7faba40b1550 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7faba408cea0 tx=0x7fab9c00b330 comp rx=0 tx=0).stop 2024-09-13T17:07:45.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba3fff700 1 -- 172.21.15.123:0/4151670692 shutdown_connections 2024-09-13T17:07:45.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba3fff700 1 --2- 172.21.15.123:0/4151670692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b1100 0x7faba40b1550 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba3fff700 1 --2- 172.21.15.123:0/4151670692 >> v2:172.21.15.153:3300/0 conn(0x7faba40b58b0 0x7faba40d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba3fff700 1 --2- 172.21.15.123:0/4151670692 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faba40d0f40 0x7faba40d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba3fff700 1 -- 172.21.15.123:0/4151670692 >> 172.21.15.123:0/4151670692 conn(0x7faba40d2a60 msgr2=0x7faba40d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba3fff700 1 -- 172.21.15.123:0/4151670692 shutdown_connections 2024-09-13T17:07:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.581+0000 7faba3fff700 1 -- 172.21.15.123:0/4151670692 wait complete. 2024-09-13T17:07:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba3fff700 1 Processor -- start 2024-09-13T17:07:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba3fff700 1 -- start start 2024-09-13T17:07:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b1100 0x7faba40c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faba40b58b0 0x7faba415fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faba40d0f40 0x7faba4157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba3fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba41602d0 con 0x7faba40b1100 2024-09-13T17:07:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba40ca130 con 0x7faba40d0f40 2024-09-13T17:07:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba40ca410 con 0x7faba40b58b0 2024-09-13T17:07:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b1100 0x7faba40c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b1100 0x7faba40c9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44208/0 (socket says 172.21.15.123:44208) 2024-09-13T17:07:45.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba2ffd700 1 -- 172.21.15.123:0/1260786152 learned_addr learned my addr 172.21.15.123:0/1260786152 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:45.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba37fe700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faba40d0f40 0x7faba4157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:45.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba27fc700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faba40b58b0 0x7faba415fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:45.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba2ffd700 1 -- 172.21.15.123:0/1260786152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faba40b58b0 msgr2=0x7faba415fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:45.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba2ffd700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faba40b58b0 0x7faba415fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba2ffd700 1 -- 172.21.15.123:0/1260786152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faba40d0f40 msgr2=0x7faba4157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:45.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba2ffd700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faba40d0f40 0x7faba4157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba2ffd700 1 -- 172.21.15.123:0/1260786152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c009b30 con 0x7faba40b1100 2024-09-13T17:07:45.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba27fc700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faba40b58b0 0x7faba415fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:45.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba2ffd700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b1100 0x7faba40c9aa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fab9800d800 tx=0x7fab9800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:45.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7fab8b7fe700 1 -- 172.21.15.123:0/1260786152 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab980125f0 con 0x7faba40b1100 2024-09-13T17:07:45.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7fab8b7fe700 1 -- 172.21.15.123:0/1260786152 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab98012750 con 0x7faba40b1100 2024-09-13T17:07:45.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba3fff700 1 -- 172.21.15.123:0/1260786152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba40ca6f0 con 0x7faba40b1100 2024-09-13T17:07:45.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7fab8b7fe700 1 -- 172.21.15.123:0/1260786152 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98012b00 con 0x7faba40b1100 2024-09-13T17:07:45.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba3fff700 1 -- 172.21.15.123:0/1260786152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba40cacb0 con 0x7faba40b1100 2024-09-13T17:07:45.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.585+0000 7faba3fff700 1 -- 172.21.15.123:0/1260786152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba415ce70 con 0x7faba40b1100 2024-09-13T17:07:45.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.589+0000 7fab8b7fe700 1 -- 172.21.15.123:0/1260786152 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fab98012c60 con 0x7faba40b1100 2024-09-13T17:07:45.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.589+0000 7fab8b7fe700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fab90066730 0x7fab90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:45.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.589+0000 7fab8b7fe700 1 -- 172.21.15.123:0/1260786152 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fab98084430 con 0x7faba40b1100 2024-09-13T17:07:45.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.589+0000 7faba27fc700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fab90066730 0x7fab90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:45.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.589+0000 7faba27fc700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fab90066730 0x7fab90068bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab94006fd0 tx=0x7fab94008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:45.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.597+0000 7fab8b7fe700 1 -- 172.21.15.123:0/1260786152 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fab980518e0 con 0x7faba40b1100 2024-09-13T17:07:45.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:45.757+0000 7faba3fff700 1 -- 172.21.15.123:0/1260786152 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7faba408c250 con 0x7faba40b1100 2024-09-13T17:07:46.197 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:07:46.200 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:07:46.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.445+0000 7fab8b7fe700 1 -- 172.21.15.123:0/1260786152 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fab98054f00 con 0x7faba40b1100 2024-09-13T17:07:46.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.465+0000 7faba3fff700 1 -- 172.21.15.123:0/1260786152 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fab90066730 msgr2=0x7fab90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:46.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.465+0000 7faba3fff700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fab90066730 0x7fab90068bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab94006fd0 tx=0x7fab94008040 comp rx=0 tx=0).stop 2024-09-13T17:07:46.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.465+0000 7faba3fff700 1 -- 172.21.15.123:0/1260786152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b1100 msgr2=0x7faba40c9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:46.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.465+0000 7faba3fff700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b1100 0x7faba40c9aa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fab9800d800 tx=0x7fab9800dbc0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.465+0000 7faba3fff700 1 -- 172.21.15.123:0/1260786152 shutdown_connections 2024-09-13T17:07:46.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.465+0000 7faba3fff700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fab90066730 0x7fab90068bf0 secure :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab94006fd0 tx=0x7fab94008040 comp rx=0 tx=0).stop 2024-09-13T17:07:46.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.465+0000 7faba3fff700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faba40d0f40 0x7faba4157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.465+0000 7faba3fff700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faba40b58b0 0x7faba415fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.465+0000 7faba3fff700 1 --2- 172.21.15.123:0/1260786152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b1100 0x7faba40c9aa0 secure :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fab9800d800 tx=0x7fab9800dbc0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.465+0000 7faba3fff700 1 -- 172.21.15.123:0/1260786152 >> 172.21.15.123:0/1260786152 conn(0x7faba40d2a60 msgr2=0x7faba406fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:46.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.465+0000 7faba3fff700 1 -- 172.21.15.123:0/1260786152 shutdown_connections 2024-09-13T17:07:46.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.465+0000 7faba3fff700 1 -- 172.21.15.123:0/1260786152 wait complete. 2024-09-13T17:07:46.470 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-13T17:07:46.481 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:07:46.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.585+0000 7f3376133700 1 Processor -- start 2024-09-13T17:07:46.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.585+0000 7f3376133700 1 -- start start 2024-09-13T17:07:46.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.585+0000 7f3376133700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f337006dea0 0x7f33700b2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:46.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.585+0000 7f3376133700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33700b27c0 0x7f33700c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:46.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.585+0000 7f3376133700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33700b30c0 con 0x7f337015a970 2024-09-13T17:07:46.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f3376133700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33700b33a0 con 0x7f33700b27c0 2024-09-13T17:07:46.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f3376133700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33700b3680 con 0x7f337006dea0 2024-09-13T17:07:46.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f336ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33700b27c0 0x7f33700c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:46.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f336ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33700b27c0 0x7f33700c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44212/0 (socket says 172.21.15.123:44212) 2024-09-13T17:07:46.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f336ffff700 1 -- 172.21.15.123:0/1248254804 learned_addr learned my addr 172.21.15.123:0/1248254804 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:46.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f336effd700 1 --2- 172.21.15.123:0/1248254804 >> v2:172.21.15.153:3300/0 conn(0x7f337006dea0 0x7f33700b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:46.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f336ffff700 1 -- 172.21.15.123:0/1248254804 >> v2:172.21.15.153:3300/0 conn(0x7f337006dea0 msgr2=0x7f33700b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:46.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f336ffff700 1 --2- 172.21.15.123:0/1248254804 >> v2:172.21.15.153:3300/0 conn(0x7f337006dea0 0x7f33700b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f336ffff700 1 -- 172.21.15.123:0/1248254804 >> v1:172.21.15.153:6789/0 conn(0x7f337015a970 legacy=0x7f337006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:46.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f336ffff700 1 -- 172.21.15.123:0/1248254804 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33700b3960 con 0x7f33700b27c0 2024-09-13T17:07:46.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f336ffff700 1 --2- 172.21.15.123:0/1248254804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33700b27c0 0x7f33700c8f40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f337006bfb0 tx=0x7f336800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23b51dc200ca5ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:46.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f336e7fc700 1 -- 172.21.15.123:0/1248254804 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336800e070 con 0x7f33700b27c0 2024-09-13T17:07:46.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f336e7fc700 1 -- 172.21.15.123:0/1248254804 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336800b9c0 con 0x7f33700b27c0 2024-09-13T17:07:46.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f336e7fc700 1 -- 172.21.15.123:0/1248254804 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336800bd70 con 0x7f33700b27c0 2024-09-13T17:07:46.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f3376133700 1 -- 172.21.15.123:0/1248254804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33700b27c0 msgr2=0x7f33700c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:46.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f3376133700 1 --2- 172.21.15.123:0/1248254804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33700b27c0 0x7f33700c8f40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f337006bfb0 tx=0x7f336800b330 comp rx=0 tx=0).stop 2024-09-13T17:07:46.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f3376133700 1 -- 172.21.15.123:0/1248254804 shutdown_connections 2024-09-13T17:07:46.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f3376133700 1 --2- 172.21.15.123:0/1248254804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33700b27c0 0x7f33700c8f40 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f3376133700 1 --2- 172.21.15.123:0/1248254804 >> v2:172.21.15.153:3300/0 conn(0x7f337006dea0 0x7f33700b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f3376133700 1 -- 172.21.15.123:0/1248254804 >> 172.21.15.123:0/1248254804 conn(0x7f33700b0450 msgr2=0x7f33700b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:46.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f3376133700 1 -- 172.21.15.123:0/1248254804 shutdown_connections 2024-09-13T17:07:46.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f3376133700 1 -- 172.21.15.123:0/1248254804 wait complete. 2024-09-13T17:07:46.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.589+0000 7f3376133700 1 Processor -- start 2024-09-13T17:07:46.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f3376133700 1 -- start start 2024-09-13T17:07:46.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f3376133700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f337006dea0 0x7f33700c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:46.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f3376133700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33700b27c0 0x7f33700cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:46.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f3376133700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f337015a970 0x7f33700c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:46.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f3376133700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33700cc430 con 0x7f337015a970 2024-09-13T17:07:46.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f3376133700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33700cd720 con 0x7f337006dea0 2024-09-13T17:07:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f3376133700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33700c4e60 con 0x7f33700b27c0 2024-09-13T17:07:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f336ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f337015a970 0x7f33700c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f336ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f337015a970 0x7f33700c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44228/0 (socket says 172.21.15.123:44228) 2024-09-13T17:07:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f336ffff700 1 -- 172.21.15.123:0/3409290652 learned_addr learned my addr 172.21.15.123:0/3409290652 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f336effd700 1 --2- 172.21.15.123:0/3409290652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33700b27c0 0x7f33700cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f336f7fe700 1 --2- 172.21.15.123:0/3409290652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f337006dea0 0x7f33700c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f336ffff700 1 -- 172.21.15.123:0/3409290652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33700b27c0 msgr2=0x7f33700cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f336ffff700 1 --2- 172.21.15.123:0/3409290652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33700b27c0 0x7f33700cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f336ffff700 1 -- 172.21.15.123:0/3409290652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f337006dea0 msgr2=0x7f33700c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f336ffff700 1 --2- 172.21.15.123:0/3409290652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f337006dea0 0x7f33700c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f336ffff700 1 -- 172.21.15.123:0/3409290652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3368009b30 con 0x7f337015a970 2024-09-13T17:07:46.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f336ffff700 1 --2- 172.21.15.123:0/3409290652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f337015a970 0x7f33700c9d40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3370070530 tx=0x7f3368004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f3357fff700 1 -- 172.21.15.123:0/3409290652 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680099b0 con 0x7f337015a970 2024-09-13T17:07:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f3357fff700 1 -- 172.21.15.123:0/3409290652 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33680092e0 con 0x7f337015a970 2024-09-13T17:07:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f3376133700 1 -- 172.21.15.123:0/3409290652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33700cc680 con 0x7f337015a970 2024-09-13T17:07:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f3357fff700 1 -- 172.21.15.123:0/3409290652 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336801c640 con 0x7f337015a970 2024-09-13T17:07:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.593+0000 7f3376133700 1 -- 172.21.15.123:0/3409290652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33700ccc40 con 0x7f337015a970 2024-09-13T17:07:46.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.597+0000 7f3376133700 1 -- 172.21.15.123:0/3409290652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33700b2280 con 0x7f337015a970 2024-09-13T17:07:46.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.597+0000 7f3357fff700 1 -- 172.21.15.123:0/3409290652 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f336801c7a0 con 0x7f337015a970 2024-09-13T17:07:46.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.597+0000 7f3357fff700 1 --2- 172.21.15.123:0/3409290652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f335c066730 0x7f335c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:46.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.597+0000 7f3357fff700 1 -- 172.21.15.123:0/3409290652 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3368085e00 con 0x7f337015a970 2024-09-13T17:07:46.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.597+0000 7f336f7fe700 1 --2- 172.21.15.123:0/3409290652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f335c066730 0x7f335c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:46.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.597+0000 7f336f7fe700 1 --2- 172.21.15.123:0/3409290652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f335c066730 0x7f335c068bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3370072000 tx=0x7f3364009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:46.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.605+0000 7f3357fff700 1 -- 172.21.15.123:0/3409290652 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f33680531c0 con 0x7f337015a970 2024-09-13T17:07:46.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.793+0000 7f3376133700 1 -- 172.21.15.123:0/3409290652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3370071d50 con 0x7f337015a970 2024-09-13T17:07:46.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.809+0000 7f3357fff700 1 -- 172.21.15.123:0/3409290652 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f33680567e0 con 0x7f337015a970 2024-09-13T17:07:46.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.813+0000 7f3376133700 1 -- 172.21.15.123:0/3409290652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f335c066730 msgr2=0x7f335c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:46.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.813+0000 7f3376133700 1 --2- 172.21.15.123:0/3409290652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f335c066730 0x7f335c068bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3370072000 tx=0x7f3364009040 comp rx=0 tx=0).stop 2024-09-13T17:07:46.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.813+0000 7f3376133700 1 -- 172.21.15.123:0/3409290652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f337015a970 msgr2=0x7f33700c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:46.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.813+0000 7f3376133700 1 --2- 172.21.15.123:0/3409290652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f337015a970 0x7f33700c9d40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3370070530 tx=0x7f3368004af0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.813+0000 7f3376133700 1 -- 172.21.15.123:0/3409290652 shutdown_connections 2024-09-13T17:07:46.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.813+0000 7f3376133700 1 --2- 172.21.15.123:0/3409290652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f335c066730 0x7f335c068bf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.813+0000 7f3376133700 1 --2- 172.21.15.123:0/3409290652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f337015a970 0x7f33700c9d40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.813+0000 7f3376133700 1 --2- 172.21.15.123:0/3409290652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33700b27c0 0x7f33700cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.813+0000 7f3376133700 1 --2- 172.21.15.123:0/3409290652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f337006dea0 0x7f33700c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.813+0000 7f3376133700 1 -- 172.21.15.123:0/3409290652 >> 172.21.15.123:0/3409290652 conn(0x7f33700b0450 msgr2=0x7f33700709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:46.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.813+0000 7f3376133700 1 -- 172.21.15.123:0/3409290652 shutdown_connections 2024-09-13T17:07:46.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.813+0000 7f3376133700 1 -- 172.21.15.123:0/3409290652 wait complete. 2024-09-13T17:07:46.819 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 4 and data pool 5 2024-09-13T17:07:46.838 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:46.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 Processor -- start 2024-09-13T17:07:46.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 -- start start 2024-09-13T17:07:46.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f90b40b1fe0 0x7f90b40cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:46.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f90b40cfc50 0x7f90b40cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:46.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b40d1780 con 0x7f90b415cd60 2024-09-13T17:07:46.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b40d1c10 con 0x7f90b40b1fe0 2024-09-13T17:07:46.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b40d3670 con 0x7f90b40cfc50 2024-09-13T17:07:46.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f90b40b1fe0 0x7f90b40cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:46.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f90b40b1fe0 0x7f90b40cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44244/0 (socket says 172.21.15.123:44244) 2024-09-13T17:07:46.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b37fe700 1 -- 172.21.15.123:0/4007570799 learned_addr learned my addr 172.21.15.123:0/4007570799 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:46.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b8c7c700 1 --2- 172.21.15.123:0/4007570799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f90b40cfc50 0x7f90b40cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:46.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b37fe700 1 -- 172.21.15.123:0/4007570799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f90b40cfc50 msgr2=0x7f90b40cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:46.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b37fe700 1 --2- 172.21.15.123:0/4007570799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f90b40cfc50 0x7f90b40cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b37fe700 1 -- 172.21.15.123:0/4007570799 >> v1:172.21.15.153:6789/0 conn(0x7f90b415cd60 legacy=0x7f90b40cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:46.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b37fe700 1 -- 172.21.15.123:0/4007570799 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b40d3950 con 0x7f90b40b1fe0 2024-09-13T17:07:46.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b8c7c700 1 --2- 172.21.15.123:0/4007570799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f90b40cfc50 0x7f90b40cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:46.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b37fe700 1 --2- 172.21.15.123:0/4007570799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b40b1fe0 0x7f90b40cd760 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009910 tx=0x7f90a4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9eaa6b0312b2f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:46.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b2ffd700 1 -- 172.21.15.123:0/4007570799 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4004230 con 0x7f90b40b1fe0 2024-09-13T17:07:46.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b2ffd700 1 -- 172.21.15.123:0/4007570799 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a4004390 con 0x7f90b40b1fe0 2024-09-13T17:07:46.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b2ffd700 1 -- 172.21.15.123:0/4007570799 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4009e60 con 0x7f90b40b1fe0 2024-09-13T17:07:46.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 -- 172.21.15.123:0/4007570799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b40b1fe0 msgr2=0x7f90b40cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:46.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 --2- 172.21.15.123:0/4007570799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b40b1fe0 0x7f90b40cd760 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009910 tx=0x7f90a4009c20 comp rx=0 tx=0).stop 2024-09-13T17:07:46.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 -- 172.21.15.123:0/4007570799 shutdown_connections 2024-09-13T17:07:46.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 --2- 172.21.15.123:0/4007570799 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f90b40cfc50 0x7f90b40cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 --2- 172.21.15.123:0/4007570799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b40b1fe0 0x7f90b40cd760 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 -- 172.21.15.123:0/4007570799 >> 172.21.15.123:0/4007570799 conn(0x7f90b40d2b50 msgr2=0x7f90b40d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:46.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 -- 172.21.15.123:0/4007570799 shutdown_connections 2024-09-13T17:07:46.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.929+0000 7f90b947d700 1 -- 172.21.15.123:0/4007570799 wait complete. 2024-09-13T17:07:46.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b947d700 1 Processor -- start 2024-09-13T17:07:46.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b947d700 1 -- start start 2024-09-13T17:07:46.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b947d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b40b1fe0 0x7f90b4154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:46.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b947d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b40cfc50 0x7f90b41f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:46.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b947d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f90b415cd60 0x7f90b40cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:46.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b947d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b41f5c80 con 0x7f90b40b1fe0 2024-09-13T17:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b947d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b40b44f0 con 0x7f90b40cfc50 2024-09-13T17:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b947d700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b40b47d0 con 0x7f90b415cd60 2024-09-13T17:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b40b1fe0 0x7f90b4154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b40b1fe0 0x7f90b4154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44258/0 (socket says 172.21.15.123:44258) 2024-09-13T17:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b3fff700 1 -- 172.21.15.123:0/1140283283 learned_addr learned my addr 172.21.15.123:0/1140283283 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b8c7c700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f90b415cd60 0x7f90b40cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b37fe700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b40cfc50 0x7f90b41f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b3fff700 1 -- 172.21.15.123:0/1140283283 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f90b415cd60 msgr2=0x7f90b40cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b3fff700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f90b415cd60 0x7f90b40cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b3fff700 1 -- 172.21.15.123:0/1140283283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b40cfc50 msgr2=0x7f90b41f63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b3fff700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b40cfc50 0x7f90b41f63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b3fff700 1 -- 172.21.15.123:0/1140283283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a4009570 con 0x7f90b40b1fe0 2024-09-13T17:07:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b8c7c700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f90b415cd60 0x7f90b40cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b3fff700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b40b1fe0 0x7f90b4154190 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f909c00b4a0 tx=0x7f909c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b0ff9700 1 -- 172.21.15.123:0/1140283283 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c011830 con 0x7f90b40b1fe0 2024-09-13T17:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b0ff9700 1 -- 172.21.15.123:0/1140283283 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c011990 con 0x7f90b40b1fe0 2024-09-13T17:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b0ff9700 1 -- 172.21.15.123:0/1140283283 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c011d40 con 0x7f90b40b1fe0 2024-09-13T17:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b947d700 1 -- 172.21.15.123:0/1140283283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b40b4ab0 con 0x7f90b40b1fe0 2024-09-13T17:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.933+0000 7f90b947d700 1 -- 172.21.15.123:0/1140283283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b41546d0 con 0x7f90b40b1fe0 2024-09-13T17:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.937+0000 7f90b947d700 1 -- 172.21.15.123:0/1140283283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b40b4c40 con 0x7f90b40b1fe0 2024-09-13T17:07:46.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.937+0000 7f90b0ff9700 1 -- 172.21.15.123:0/1140283283 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f909c004020 con 0x7f90b40b1fe0 2024-09-13T17:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.937+0000 7f90b0ff9700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9094066730 0x7f9094068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.937+0000 7f90b37fe700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9094066730 0x7f9094068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:46.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.937+0000 7f90b0ff9700 1 -- 172.21.15.123:0/1140283283 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f909c084440 con 0x7f90b40b1fe0 2024-09-13T17:07:46.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.937+0000 7f90b37fe700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9094066730 0x7f9094068bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009910 tx=0x7f90a4008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:46.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:46.941+0000 7f90b0ff9700 1 -- 172.21.15.123:0/1140283283 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f909c051790 con 0x7f90b40b1fe0 2024-09-13T17:07:47.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.109+0000 7f90b947d700 1 -- 172.21.15.123:0/1140283283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90b40b1970 con 0x7f90b40b1fe0 2024-09-13T17:07:47.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.113+0000 7f90b0ff9700 1 -- 172.21.15.123:0/1140283283 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16630 (secure 0 0 0) 0x7f909c054db0 con 0x7f90b40b1fe0 2024-09-13T17:07:47.116 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:47.116 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":33,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:07:46.797685+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:07:44.636174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T17:07:45.802714+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.113+0000 7f90b947d700 1 -- 172.21.15.123:0/1140283283 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9094066730 msgr2=0x7f9094068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.113+0000 7f90b947d700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9094066730 0x7f9094068bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009910 tx=0x7f90a4008030 comp rx=0 tx=0).stop 2024-09-13T17:07:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.113+0000 7f90b947d700 1 -- 172.21.15.123:0/1140283283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b40b1fe0 msgr2=0x7f90b4154190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.113+0000 7f90b947d700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b40b1fe0 0x7f90b4154190 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f909c00b4a0 tx=0x7f909c00b860 comp rx=0 tx=0).stop 2024-09-13T17:07:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.113+0000 7f90b947d700 1 -- 172.21.15.123:0/1140283283 shutdown_connections 2024-09-13T17:07:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.113+0000 7f90b947d700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9094066730 0x7f9094068bf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.113+0000 7f90b947d700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f90b415cd60 0x7f90b40cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.113+0000 7f90b947d700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b40cfc50 0x7f90b41f63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.113+0000 7f90b947d700 1 --2- 172.21.15.123:0/1140283283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b40b1fe0 0x7f90b4154190 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.113+0000 7f90b947d700 1 -- 172.21.15.123:0/1140283283 >> 172.21.15.123:0/1140283283 conn(0x7f90b40d2b50 msgr2=0x7f90b40d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:47.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.113+0000 7f90b947d700 1 -- 172.21.15.123:0/1140283283 shutdown_connections 2024-09-13T17:07:47.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.117+0000 7f90b947d700 1 -- 172.21.15.123:0/1140283283 wait complete. 2024-09-13T17:07:47.131 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:47.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.241+0000 7fdf259b4700 1 Processor -- start 2024-09-13T17:07:47.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.241+0000 7fdf259b4700 1 -- start start 2024-09-13T17:07:47.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf259b4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdf200aca40 0x7fdf200b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf259b4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2006be90 con 0x7fdf20072210 2024-09-13T17:07:47.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf259b4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf20070540 con 0x7fdf200b2fc0 2024-09-13T17:07:47.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf259b4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf200b1c70 con 0x7fdf200aca40 2024-09-13T17:07:47.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf249b2700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdf20072210 0x7fdf2015dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41790/0 (socket says 172.21.15.123:41790) 2024-09-13T17:07:47.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf249b2700 1 -- 172.21.15.123:0/575683564 learned_addr learned my addr 172.21.15.123:0/575683564 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:47.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf1ffff700 1 --2- 172.21.15.123:0/575683564 >> v2:172.21.15.153:3300/0 conn(0x7fdf200aca40 0x7fdf200b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf1f7fe700 1 -- 172.21.15.123:0/575683564 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612855981 0 0) 0x7fdf2006be90 con 0x7fdf20072210 2024-09-13T17:07:47.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf1f7fe700 1 -- 172.21.15.123:0/575683564 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf100035d0 con 0x7fdf20072210 2024-09-13T17:07:47.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf1ffff700 1 -- 172.21.15.123:0/575683564 >> v1:172.21.15.153:6789/0 conn(0x7fdf200b2fc0 legacy=0x7fdf20166770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf1ffff700 1 -- 172.21.15.123:0/575683564 >> v1:172.21.15.123:6789/0 conn(0x7fdf20072210 legacy=0x7fdf2015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf1f7fe700 1 -- 172.21.15.123:0/575683564 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1332873929 0 0) 0x7fdf100035d0 con 0x7fdf20072210 2024-09-13T17:07:47.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf1ffff700 1 -- 172.21.15.123:0/575683564 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf200acfc0 con 0x7fdf200aca40 2024-09-13T17:07:47.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf1ffff700 1 --2- 172.21.15.123:0/575683564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf200aca40 0x7fdf200b2a80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009850 tx=0x7fdf0c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc41c25751786636 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:47.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf1f7fe700 1 -- 172.21.15.123:0/575683564 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14001670 con 0x7fdf200aca40 2024-09-13T17:07:47.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf1f7fe700 1 -- 172.21.15.123:0/575683564 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c004030 con 0x7fdf200aca40 2024-09-13T17:07:47.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf1f7fe700 1 -- 172.21.15.123:0/575683564 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0043a0 con 0x7fdf200aca40 2024-09-13T17:07:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf259b4700 1 -- 172.21.15.123:0/575683564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf200aca40 msgr2=0x7fdf200b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf259b4700 1 --2- 172.21.15.123:0/575683564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf200aca40 0x7fdf200b2a80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009850 tx=0x7fdf0c009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf259b4700 1 -- 172.21.15.123:0/575683564 shutdown_connections 2024-09-13T17:07:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf259b4700 1 --2- 172.21.15.123:0/575683564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf200aca40 0x7fdf200b2a80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf259b4700 1 -- 172.21.15.123:0/575683564 >> 172.21.15.123:0/575683564 conn(0x7fdf20066150 msgr2=0x7fdf20066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf259b4700 1 -- 172.21.15.123:0/575683564 shutdown_connections 2024-09-13T17:07:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.245+0000 7fdf259b4700 1 -- 172.21.15.123:0/575683564 wait complete. 2024-09-13T17:07:47.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf259b4700 1 Processor -- start 2024-09-13T17:07:47.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf259b4700 1 -- start start 2024-09-13T17:07:47.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf259b4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf20072210 0x7fdf2014a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf259b4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf200aca40 0x7fdf2015f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf259b4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf200b2fc0 0x7fdf2006cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf259b4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2014a950 con 0x7fdf200b2fc0 2024-09-13T17:07:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf259b4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf201e6300 con 0x7fdf20072210 2024-09-13T17:07:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf259b4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf201e65e0 con 0x7fdf200aca40 2024-09-13T17:07:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf251b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf200b2fc0 0x7fdf2006cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf251b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf200b2fc0 0x7fdf2006cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44262/0 (socket says 172.21.15.123:44262) 2024-09-13T17:07:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf251b3700 1 -- 172.21.15.123:0/2797208713 learned_addr learned my addr 172.21.15.123:0/2797208713 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf1ffff700 1 --2- 172.21.15.123:0/2797208713 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf200aca40 0x7fdf2015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf249b2700 1 --2- 172.21.15.123:0/2797208713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf20072210 0x7fdf2014a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf251b3700 1 -- 172.21.15.123:0/2797208713 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf200aca40 msgr2=0x7fdf2015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf251b3700 1 --2- 172.21.15.123:0/2797208713 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf200aca40 0x7fdf2015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf251b3700 1 -- 172.21.15.123:0/2797208713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf20072210 msgr2=0x7fdf2014a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf251b3700 1 --2- 172.21.15.123:0/2797208713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf20072210 0x7fdf2014a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf251b3700 1 -- 172.21.15.123:0/2797208713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c0094b0 con 0x7fdf200b2fc0 2024-09-13T17:07:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf251b3700 1 --2- 172.21.15.123:0/2797208713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf200b2fc0 0x7fdf2006cba0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800cbc0 tx=0x7fdf1800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf1d7fa700 1 -- 172.21.15.123:0/2797208713 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18003c20 con 0x7fdf200b2fc0 2024-09-13T17:07:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf1d7fa700 1 -- 172.21.15.123:0/2797208713 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf18003d80 con 0x7fdf200b2fc0 2024-09-13T17:07:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf259b4700 1 -- 172.21.15.123:0/2797208713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf201e68c0 con 0x7fdf200b2fc0 2024-09-13T17:07:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.249+0000 7fdf1d7fa700 1 -- 172.21.15.123:0/2797208713 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1800aa20 con 0x7fdf200b2fc0 2024-09-13T17:07:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.253+0000 7fdf259b4700 1 -- 172.21.15.123:0/2797208713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf201e6e80 con 0x7fdf200b2fc0 2024-09-13T17:07:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.253+0000 7fdf259b4700 1 -- 172.21.15.123:0/2797208713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf200677f0 con 0x7fdf200b2fc0 2024-09-13T17:07:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.253+0000 7fdf1d7fa700 1 -- 172.21.15.123:0/2797208713 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdf1800ab80 con 0x7fdf200b2fc0 2024-09-13T17:07:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.253+0000 7fdf1d7fa700 1 --2- 172.21.15.123:0/2797208713 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdf04066730 0x7fdf04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.257+0000 7fdf249b2700 1 --2- 172.21.15.123:0/2797208713 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdf04066730 0x7fdf04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.257+0000 7fdf1d7fa700 1 -- 172.21.15.123:0/2797208713 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf18084ae0 con 0x7fdf200b2fc0 2024-09-13T17:07:47.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.257+0000 7fdf249b2700 1 --2- 172.21.15.123:0/2797208713 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdf04066730 0x7fdf04068bf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdf14001eb0 tx=0x7fdf14001e40 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.261+0000 7fdf1d7fa700 1 -- 172.21.15.123:0/2797208713 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdf18051ec0 con 0x7fdf200b2fc0 2024-09-13T17:07:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.437+0000 7fdf259b4700 1 -- 172.21.15.123:0/2797208713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf200b2a80 con 0x7fdf200b2fc0 2024-09-13T17:07:47.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.441+0000 7fdf1d7fa700 1 -- 172.21.15.123:0/2797208713 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16630 (secure 0 0 0) 0x7fdf180554e0 con 0x7fdf200b2fc0 2024-09-13T17:07:47.442 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:47.443 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":33,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:07:46.797685+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:07:44.636174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T17:07:45.802714+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.441+0000 7fdf259b4700 1 -- 172.21.15.123:0/2797208713 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdf04066730 msgr2=0x7fdf04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.441+0000 7fdf259b4700 1 --2- 172.21.15.123:0/2797208713 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdf04066730 0x7fdf04068bf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdf14001eb0 tx=0x7fdf14001e40 comp rx=0 tx=0).stop 2024-09-13T17:07:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.441+0000 7fdf259b4700 1 -- 172.21.15.123:0/2797208713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf200b2fc0 msgr2=0x7fdf2006cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.441+0000 7fdf259b4700 1 --2- 172.21.15.123:0/2797208713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf200b2fc0 0x7fdf2006cba0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800cbc0 tx=0x7fdf1800ced0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.441+0000 7fdf259b4700 1 -- 172.21.15.123:0/2797208713 shutdown_connections 2024-09-13T17:07:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.441+0000 7fdf259b4700 1 --2- 172.21.15.123:0/2797208713 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdf04066730 0x7fdf04068bf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.441+0000 7fdf259b4700 1 --2- 172.21.15.123:0/2797208713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf200b2fc0 0x7fdf2006cba0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.441+0000 7fdf259b4700 1 --2- 172.21.15.123:0/2797208713 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdf200aca40 0x7fdf2015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.441+0000 7fdf259b4700 1 --2- 172.21.15.123:0/2797208713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf20072210 0x7fdf2014a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.441+0000 7fdf259b4700 1 -- 172.21.15.123:0/2797208713 >> 172.21.15.123:0/2797208713 conn(0x7fdf20066150 msgr2=0x7fdf200ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:47.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.441+0000 7fdf259b4700 1 -- 172.21.15.123:0/2797208713 shutdown_connections 2024-09-13T17:07:47.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.441+0000 7fdf259b4700 1 -- 172.21.15.123:0/2797208713 wait complete. 2024-09-13T17:07:47.457 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:07:47.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.569+0000 7f42bab92700 1 Processor -- start 2024-09-13T17:07:47.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.569+0000 7f42bab92700 1 -- start start 2024-09-13T17:07:47.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.569+0000 7f42bab92700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f42b40cb070 0x7f42b40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.569+0000 7f42bab92700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b40ce180 con 0x7f42b415a2f0 2024-09-13T17:07:47.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.569+0000 7f42bab92700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b40cd990 con 0x7f42b40b3990 2024-09-13T17:07:47.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.569+0000 7f42bab92700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b40cba20 con 0x7f42b40cb070 2024-09-13T17:07:47.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.569+0000 7f42b938f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f42b40cb070 0x7f42b40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.569+0000 7f42b938f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f42b40cb070 0x7f42b40cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44278/0 (socket says 172.21.15.123:44278) 2024-09-13T17:07:47.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.569+0000 7f42b938f700 1 -- 172.21.15.123:0/1336158077 learned_addr learned my addr 172.21.15.123:0/1336158077 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:47.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.569+0000 7f42ba391700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f42b415a2f0 0x7f42b415a760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41806/0 (socket says 172.21.15.123:41806) 2024-09-13T17:07:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.569+0000 7f42b938f700 1 -- 172.21.15.123:0/1336158077 >> v1:172.21.15.153:6789/0 conn(0x7f42b40b3990 legacy=0x7f42b40cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.569+0000 7f42b938f700 1 -- 172.21.15.123:0/1336158077 >> v1:172.21.15.123:6789/0 conn(0x7f42b415a2f0 legacy=0x7f42b415a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.569+0000 7f42b938f700 1 -- 172.21.15.123:0/1336158077 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b40cd0f0 con 0x7f42b40cb070 2024-09-13T17:07:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.569+0000 7f42b938f700 1 --2- 172.21.15.123:0/1336158077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42b40cb070 0x7f42b40cb4e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009e50 tx=0x7f42a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f331f632e060af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42b8b8e700 1 -- 172.21.15.123:0/1336158077 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a400e070 con 0x7f42b40cb070 2024-09-13T17:07:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42b8b8e700 1 -- 172.21.15.123:0/1336158077 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a400b9c0 con 0x7f42b40cb070 2024-09-13T17:07:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42b8b8e700 1 -- 172.21.15.123:0/1336158077 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a400bd70 con 0x7f42b40cb070 2024-09-13T17:07:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 -- 172.21.15.123:0/1336158077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42b40cb070 msgr2=0x7f42b40cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 --2- 172.21.15.123:0/1336158077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42b40cb070 0x7f42b40cb4e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009e50 tx=0x7f42a400b330 comp rx=0 tx=0).stop 2024-09-13T17:07:47.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 -- 172.21.15.123:0/1336158077 shutdown_connections 2024-09-13T17:07:47.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 --2- 172.21.15.123:0/1336158077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42b40cb070 0x7f42b40cb4e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 -- 172.21.15.123:0/1336158077 >> 172.21.15.123:0/1336158077 conn(0x7f42b40b01d0 msgr2=0x7f42b40b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:47.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 -- 172.21.15.123:0/1336158077 shutdown_connections 2024-09-13T17:07:47.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 -- 172.21.15.123:0/1336158077 wait complete. 2024-09-13T17:07:47.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 Processor -- start 2024-09-13T17:07:47.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 -- start start 2024-09-13T17:07:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42b40b3990 0x7f42b415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42b40cb070 0x7f42b4158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42b415a2f0 0x7f42b40c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b41594b0 con 0x7f42b40cb070 2024-09-13T17:07:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40ad440 con 0x7f42b40b3990 2024-09-13T17:07:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42bab92700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40c6e10 con 0x7f42b415a2f0 2024-09-13T17:07:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42b938f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42b40cb070 0x7f42b4158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42b938f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42b40cb070 0x7f42b4158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44282/0 (socket says 172.21.15.123:44282) 2024-09-13T17:07:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42b938f700 1 -- 172.21.15.123:0/3691584091 learned_addr learned my addr 172.21.15.123:0/3691584091 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42b9b90700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42b40b3990 0x7f42b415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.573+0000 7f42ba391700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42b415a2f0 0x7f42b40c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b938f700 1 -- 172.21.15.123:0/3691584091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42b415a2f0 msgr2=0x7f42b40c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b938f700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42b415a2f0 0x7f42b40c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b938f700 1 -- 172.21.15.123:0/3691584091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42b40b3990 msgr2=0x7f42b415c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b938f700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42b40b3990 0x7f42b415c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b938f700 1 -- 172.21.15.123:0/3691584091 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a4009b30 con 0x7f42b40cb070 2024-09-13T17:07:47.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b9b90700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42b40b3990 0x7f42b415c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:47.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42ba391700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42b415a2f0 0x7f42b40c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b938f700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42b40cb070 0x7f42b4158f70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f42b406b4a0 tx=0x7f42a4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b27fc700 1 -- 172.21.15.123:0/3691584091 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a40099b0 con 0x7f42b40cb070 2024-09-13T17:07:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b27fc700 1 -- 172.21.15.123:0/3691584091 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a40092e0 con 0x7f42b40cb070 2024-09-13T17:07:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42bab92700 1 -- 172.21.15.123:0/3691584091 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b40c70f0 con 0x7f42b40cb070 2024-09-13T17:07:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b27fc700 1 -- 172.21.15.123:0/3691584091 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a401c640 con 0x7f42b40cb070 2024-09-13T17:07:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42bab92700 1 -- 172.21.15.123:0/3691584091 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b40c76b0 con 0x7f42b40cb070 2024-09-13T17:07:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42bab92700 1 -- 172.21.15.123:0/3691584091 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b40cb4e0 con 0x7f42b40cb070 2024-09-13T17:07:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b27fc700 1 -- 172.21.15.123:0/3691584091 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f42a401c7a0 con 0x7f42b40cb070 2024-09-13T17:07:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b27fc700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f42a0066730 0x7f42a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b27fc700 1 -- 172.21.15.123:0/3691584091 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42a4085c10 con 0x7f42b40cb070 2024-09-13T17:07:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b9b90700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f42a0066730 0x7f42a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.577+0000 7f42b9b90700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f42a0066730 0x7f42a0068bf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f42a8000f60 tx=0x7f42a8009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:47.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.585+0000 7f42b27fc700 1 -- 172.21.15.123:0/3691584091 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f42a4053010 con 0x7f42b40cb070 2024-09-13T17:07:47.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.789+0000 7f42bab92700 1 -- 172.21.15.123:0/3691584091 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f42b406c190 con 0x7f42b40cb070 2024-09-13T17:07:47.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.801+0000 7f42b27fc700 1 -- 172.21.15.123:0/3691584091 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f42a4056630 con 0x7f42b40cb070 2024-09-13T17:07:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.809+0000 7f42bab92700 1 -- 172.21.15.123:0/3691584091 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f42a0066730 msgr2=0x7f42a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.809+0000 7f42bab92700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f42a0066730 0x7f42a0068bf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f42a8000f60 tx=0x7f42a8009040 comp rx=0 tx=0).stop 2024-09-13T17:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.809+0000 7f42bab92700 1 -- 172.21.15.123:0/3691584091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42b40cb070 msgr2=0x7f42b4158f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.809+0000 7f42bab92700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42b40cb070 0x7f42b4158f70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f42b406b4a0 tx=0x7f42a4004af0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.809+0000 7f42bab92700 1 -- 172.21.15.123:0/3691584091 shutdown_connections 2024-09-13T17:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.809+0000 7f42bab92700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f42a0066730 0x7f42a0068bf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.809+0000 7f42bab92700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f42b415a2f0 0x7f42b40c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.809+0000 7f42bab92700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42b40cb070 0x7f42b4158f70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.809+0000 7f42bab92700 1 --2- 172.21.15.123:0/3691584091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42b40b3990 0x7f42b415c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.809+0000 7f42bab92700 1 -- 172.21.15.123:0/3691584091 >> 172.21.15.123:0/3691584091 conn(0x7f42b40b01d0 msgr2=0x7f42b40ae700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.809+0000 7f42bab92700 1 -- 172.21.15.123:0/3691584091 shutdown_connections 2024-09-13T17:07:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.809+0000 7f42bab92700 1 -- 172.21.15.123:0/3691584091 wait complete. 2024-09-13T17:07:47.826 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:07:47.826 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:07:47.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.941+0000 7f6147fff700 1 Processor -- start 2024-09-13T17:07:47.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.941+0000 7f6147fff700 1 -- start start 2024-09-13T17:07:47.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6147fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61480d0f40 0x7f61480d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6147fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f61480b58b0 0x7f61480d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6147fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61480b0060 con 0x7f61480b1100 2024-09-13T17:07:47.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6147fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61480b0340 con 0x7f61480b58b0 2024-09-13T17:07:47.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6147fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61480b0620 con 0x7f61480d0f40 2024-09-13T17:07:47.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f61467fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f61480b58b0 0x7f61480d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f61467fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f61480b58b0 0x7f61480d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44286/0 (socket says 172.21.15.123:44286) 2024-09-13T17:07:47.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f61467fc700 1 -- 172.21.15.123:0/3559218759 learned_addr learned my addr 172.21.15.123:0/3559218759 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:47.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6146ffd700 1 --2- 172.21.15.123:0/3559218759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61480d0f40 0x7f61480d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f61467fc700 1 -- 172.21.15.123:0/3559218759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61480d0f40 msgr2=0x7f61480d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:47.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f61467fc700 1 --2- 172.21.15.123:0/3559218759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61480d0f40 0x7f61480d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6145ffb700 1 -- 172.21.15.123:0/3559218759 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027721266 0 0) 0x7f61480b0060 con 0x7f61480b1100 2024-09-13T17:07:47.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f61467fc700 1 -- 172.21.15.123:0/3559218759 >> v1:172.21.15.153:6789/0 conn(0x7f61480b1100 legacy=0x7f61480b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f61467fc700 1 -- 172.21.15.123:0/3559218759 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61480b0900 con 0x7f61480b58b0 2024-09-13T17:07:47.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f61467fc700 1 --2- 172.21.15.123:0/3559218759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61480b58b0 0x7f61480d05a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f613c009910 tx=0x7f613c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ee70d4a4ad0987 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:47.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6145ffb700 1 -- 172.21.15.123:0/3559218759 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c011830 con 0x7f61480b58b0 2024-09-13T17:07:47.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6145ffb700 1 -- 172.21.15.123:0/3559218759 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c011990 con 0x7f61480b58b0 2024-09-13T17:07:47.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6145ffb700 1 -- 172.21.15.123:0/3559218759 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c011d40 con 0x7f61480b58b0 2024-09-13T17:07:47.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6147fff700 1 -- 172.21.15.123:0/3559218759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61480b58b0 msgr2=0x7f61480d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6147fff700 1 --2- 172.21.15.123:0/3559218759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61480b58b0 0x7f61480d05a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f613c009910 tx=0x7f613c009c20 comp rx=0 tx=0).stop 2024-09-13T17:07:47.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6147fff700 1 -- 172.21.15.123:0/3559218759 shutdown_connections 2024-09-13T17:07:47.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6147fff700 1 --2- 172.21.15.123:0/3559218759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61480b58b0 0x7f61480d05a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6147fff700 1 --2- 172.21.15.123:0/3559218759 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61480d0f40 0x7f61480d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.945+0000 7f6147fff700 1 -- 172.21.15.123:0/3559218759 >> 172.21.15.123:0/3559218759 conn(0x7f61480d2a60 msgr2=0x7f61480d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:47.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f6147fff700 1 -- 172.21.15.123:0/3559218759 shutdown_connections 2024-09-13T17:07:47.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f6147fff700 1 -- 172.21.15.123:0/3559218759 wait complete. 2024-09-13T17:07:47.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f6147fff700 1 Processor -- start 2024-09-13T17:07:47.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f6147fff700 1 -- start start 2024-09-13T17:07:47.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f6147fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61480b1100 0x7f61480c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f6147fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61480b58b0 0x7f61480b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f6147fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61480d0f40 0x7f614815a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f6147fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61481603c0 con 0x7f61480b1100 2024-09-13T17:07:47.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f6147fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61480c9fe0 con 0x7f61480b58b0 2024-09-13T17:07:47.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f6147fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61480b5370 con 0x7f61480d0f40 2024-09-13T17:07:47.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f6146ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61480b1100 0x7f61480c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f6146ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61480b1100 0x7f61480c9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44298/0 (socket says 172.21.15.123:44298) 2024-09-13T17:07:47.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f6146ffd700 1 -- 172.21.15.123:0/3914264587 learned_addr learned my addr 172.21.15.123:0/3914264587 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:47.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f61467fc700 1 --2- 172.21.15.123:0/3914264587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61480b58b0 0x7f61480b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.949+0000 7f61477fe700 1 --2- 172.21.15.123:0/3914264587 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61480d0f40 0x7f614815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.953+0000 7f6146ffd700 1 -- 172.21.15.123:0/3914264587 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61480d0f40 msgr2=0x7f614815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.953+0000 7f6146ffd700 1 --2- 172.21.15.123:0/3914264587 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61480d0f40 0x7f614815a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.953+0000 7f6146ffd700 1 -- 172.21.15.123:0/3914264587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61480b58b0 msgr2=0x7f61480b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:47.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.953+0000 7f6146ffd700 1 --2- 172.21.15.123:0/3914264587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61480b58b0 0x7f61480b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:47.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.953+0000 7f6146ffd700 1 -- 172.21.15.123:0/3914264587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c009570 con 0x7f61480b1100 2024-09-13T17:07:47.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.953+0000 7f6146ffd700 1 --2- 172.21.15.123:0/3914264587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61480b1100 0x7f61480c9aa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f613800e870 tx=0x7f613800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:47.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.953+0000 7f612f7fe700 1 -- 172.21.15.123:0/3914264587 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61380095a0 con 0x7f61480b1100 2024-09-13T17:07:47.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.953+0000 7f6147fff700 1 -- 172.21.15.123:0/3914264587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614815e020 con 0x7f61480b1100 2024-09-13T17:07:47.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.953+0000 7f612f7fe700 1 -- 172.21.15.123:0/3914264587 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6138013680 con 0x7f61480b1100 2024-09-13T17:07:47.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.953+0000 7f612f7fe700 1 -- 172.21.15.123:0/3914264587 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61380139f0 con 0x7f61480b1100 2024-09-13T17:07:47.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.953+0000 7f6147fff700 1 -- 172.21.15.123:0/3914264587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614815fe00 con 0x7f61480b1100 2024-09-13T17:07:47.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.953+0000 7f6147fff700 1 -- 172.21.15.123:0/3914264587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614815ce70 con 0x7f61480b1100 2024-09-13T17:07:47.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.957+0000 7f612f7fe700 1 -- 172.21.15.123:0/3914264587 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6138013b50 con 0x7f61480b1100 2024-09-13T17:07:47.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.957+0000 7f612f7fe700 1 --2- 172.21.15.123:0/3914264587 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6134066730 0x7f6134068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:47.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.957+0000 7f612f7fe700 1 -- 172.21.15.123:0/3914264587 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6138084010 con 0x7f61480b1100 2024-09-13T17:07:47.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.957+0000 7f61467fc700 1 --2- 172.21.15.123:0/3914264587 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6134066730 0x7f6134068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:47.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.957+0000 7f61467fc700 1 --2- 172.21.15.123:0/3914264587 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6134066730 0x7f6134068bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f61480b5c90 tx=0x7f613c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:47.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:47.961+0000 7f612f7fe700 1 -- 172.21.15.123:0/3914264587 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6138051300 con 0x7f61480b1100 2024-09-13T17:07:48.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.165+0000 7f6147fff700 1 -- 172.21.15.123:0/3914264587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f614808c250 con 0x7f61480b1100 2024-09-13T17:07:48.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.813+0000 7f612f7fe700 1 -- 172.21.15.123:0/3914264587 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6138054920 con 0x7f61480b1100 2024-09-13T17:07:48.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.817+0000 7f6147fff700 1 -- 172.21.15.123:0/3914264587 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6134066730 msgr2=0x7f6134068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:48.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.817+0000 7f6147fff700 1 --2- 172.21.15.123:0/3914264587 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6134066730 0x7f6134068bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f61480b5c90 tx=0x7f613c008030 comp rx=0 tx=0).stop 2024-09-13T17:07:48.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.817+0000 7f6147fff700 1 -- 172.21.15.123:0/3914264587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61480b1100 msgr2=0x7f61480c9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:48.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.817+0000 7f6147fff700 1 --2- 172.21.15.123:0/3914264587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61480b1100 0x7f61480c9aa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f613800e870 tx=0x7f613800eb80 comp rx=0 tx=0).stop 2024-09-13T17:07:48.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.817+0000 7f6147fff700 1 -- 172.21.15.123:0/3914264587 shutdown_connections 2024-09-13T17:07:48.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.817+0000 7f6147fff700 1 --2- 172.21.15.123:0/3914264587 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6134066730 0x7f6134068bf0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:48.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.817+0000 7f6147fff700 1 --2- 172.21.15.123:0/3914264587 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f61480d0f40 0x7f614815a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:48.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.817+0000 7f6147fff700 1 --2- 172.21.15.123:0/3914264587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61480b58b0 0x7f61480b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:48.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.817+0000 7f6147fff700 1 --2- 172.21.15.123:0/3914264587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61480b1100 0x7f61480c9aa0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:48.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.817+0000 7f6147fff700 1 -- 172.21.15.123:0/3914264587 >> 172.21.15.123:0/3914264587 conn(0x7f61480d2a60 msgr2=0x7f61480b6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:48.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.817+0000 7f6147fff700 1 -- 172.21.15.123:0/3914264587 shutdown_connections 2024-09-13T17:07:48.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.817+0000 7f6147fff700 1 -- 172.21.15.123:0/3914264587 wait complete. 2024-09-13T17:07:48.837 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:07:48.837 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:07:48.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.953+0000 7f1f3759e700 1 Processor -- start 2024-09-13T17:07:48.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.953+0000 7f1f3759e700 1 -- start start 2024-09-13T17:07:48.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f3759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f3815cd60 0x7f1f380cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:48.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f3759e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f380b1970 0x7f1f380ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:48.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f3759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f380d1780 con 0x7f1f380b1fe0 2024-09-13T17:07:48.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f3759e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f380d1c10 con 0x7f1f380b1970 2024-09-13T17:07:48.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f3759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380d3670 con 0x7f1f3815cd60 2024-09-13T17:07:48.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f36d9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f380b1970 0x7f1f380ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:48.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f36d9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f380b1970 0x7f1f380ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44300/0 (socket says 172.21.15.123:44300) 2024-09-13T17:07:48.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f36d9d700 1 -- 172.21.15.123:0/1275139733 learned_addr learned my addr 172.21.15.123:0/1275139733 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:48.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f3659c700 1 --2- 172.21.15.123:0/1275139733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f3815cd60 0x7f1f380cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:48.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f36d9d700 1 -- 172.21.15.123:0/1275139733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f3815cd60 msgr2=0x7f1f380cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:48.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f36d9d700 1 --2- 172.21.15.123:0/1275139733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f3815cd60 0x7f1f380cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:48.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f36d9d700 1 -- 172.21.15.123:0/1275139733 >> v1:172.21.15.153:6789/0 conn(0x7f1f380b1fe0 legacy=0x7f1f380af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:48.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f36d9d700 1 -- 172.21.15.123:0/1275139733 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f380d3950 con 0x7f1f380b1970 2024-09-13T17:07:48.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f36d9d700 1 --2- 172.21.15.123:0/1275139733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f380b1970 0x7f1f380ce770 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009e50 tx=0x7f1f3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8a29443d0e5b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:48.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f35d9b700 1 -- 172.21.15.123:0/1275139733 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000e070 con 0x7f1f380b1970 2024-09-13T17:07:48.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f35d9b700 1 -- 172.21.15.123:0/1275139733 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3000b9c0 con 0x7f1f380b1970 2024-09-13T17:07:48.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f35d9b700 1 -- 172.21.15.123:0/1275139733 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000bd70 con 0x7f1f380b1970 2024-09-13T17:07:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f3759e700 1 -- 172.21.15.123:0/1275139733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f380b1970 msgr2=0x7f1f380ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f3759e700 1 --2- 172.21.15.123:0/1275139733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f380b1970 0x7f1f380ce770 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009e50 tx=0x7f1f3000b330 comp rx=0 tx=0).stop 2024-09-13T17:07:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f3759e700 1 -- 172.21.15.123:0/1275139733 shutdown_connections 2024-09-13T17:07:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f3759e700 1 --2- 172.21.15.123:0/1275139733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f380b1970 0x7f1f380ce770 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f3759e700 1 --2- 172.21.15.123:0/1275139733 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f3815cd60 0x7f1f380cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f3759e700 1 -- 172.21.15.123:0/1275139733 >> 172.21.15.123:0/1275139733 conn(0x7f1f380d2b50 msgr2=0x7f1f380d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f3759e700 1 -- 172.21.15.123:0/1275139733 shutdown_connections 2024-09-13T17:07:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.957+0000 7f1f3759e700 1 -- 172.21.15.123:0/1275139733 wait complete. 2024-09-13T17:07:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f3759e700 1 Processor -- start 2024-09-13T17:07:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f3759e700 1 -- start start 2024-09-13T17:07:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f3759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f380b1970 0x7f1f3815d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f3759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f380b1fe0 0x7f1f3814df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f3759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f3815cd60 0x7f1f380b7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f3759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3815dbc0 con 0x7f1f380b1fe0 2024-09-13T17:07:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f3759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3814e450 con 0x7f1f3815cd60 2024-09-13T17:07:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f3759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380b2490 con 0x7f1f380b1970 2024-09-13T17:07:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f2dd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f380b1fe0 0x7f1f3814df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:48.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f36d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f3815cd60 0x7f1f380b7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:48.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f3659c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f380b1970 0x7f1f3815d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:48.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f2dd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f380b1fe0 0x7f1f3814df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44316/0 (socket says 172.21.15.123:44316) 2024-09-13T17:07:48.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f36d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f3815cd60 0x7f1f380b7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:42752/0 (socket says 172.21.15.123:42752) 2024-09-13T17:07:48.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f2dd9b700 1 -- 172.21.15.123:0/565908565 learned_addr learned my addr 172.21.15.123:0/565908565 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:48.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f2dd9b700 1 -- 172.21.15.123:0/565908565 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f380b1970 msgr2=0x7f1f3815d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f2dd9b700 1 --2- 172.21.15.123:0/565908565 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f380b1970 0x7f1f3815d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f2dd9b700 1 -- 172.21.15.123:0/565908565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f3815cd60 msgr2=0x7f1f380b7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f2dd9b700 1 --2- 172.21.15.123:0/565908565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f3815cd60 0x7f1f380b7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f2dd9b700 1 -- 172.21.15.123:0/565908565 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f30009b30 con 0x7f1f380b1fe0 2024-09-13T17:07:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f2dd9b700 1 --2- 172.21.15.123:0/565908565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f380b1fe0 0x7f1f3814df10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000c480 tx=0x7f1f2000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f2f7fe700 1 -- 172.21.15.123:0/565908565 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f200052d0 con 0x7f1f380b1fe0 2024-09-13T17:07:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f2f7fe700 1 -- 172.21.15.123:0/565908565 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f20005430 con 0x7f1f380b1fe0 2024-09-13T17:07:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f3759e700 1 -- 172.21.15.123:0/565908565 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f380b2770 con 0x7f1f380b1fe0 2024-09-13T17:07:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f2f7fe700 1 -- 172.21.15.123:0/565908565 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f200055a0 con 0x7f1f380b1fe0 2024-09-13T17:07:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.961+0000 7f1f3759e700 1 -- 172.21.15.123:0/565908565 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f380b2d30 con 0x7f1f380b1fe0 2024-09-13T17:07:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.965+0000 7f1f3759e700 1 -- 172.21.15.123:0/565908565 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f380cf540 con 0x7f1f380b1fe0 2024-09-13T17:07:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.965+0000 7f1f2f7fe700 1 -- 172.21.15.123:0/565908565 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1f200038e0 con 0x7f1f380b1fe0 2024-09-13T17:07:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.965+0000 7f1f2f7fe700 1 --2- 172.21.15.123:0/565908565 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1f18066730 0x7f1f18068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.965+0000 7f1f2f7fe700 1 -- 172.21.15.123:0/565908565 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f200834a0 con 0x7f1f380b1fe0 2024-09-13T17:07:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.965+0000 7f1f3659c700 1 --2- 172.21.15.123:0/565908565 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1f18066730 0x7f1f18068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.969+0000 7f1f3659c700 1 --2- 172.21.15.123:0/565908565 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1f18066730 0x7f1f18068bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1f28007a60 tx=0x7f1f28008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:48.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:48.973+0000 7f1f2f7fe700 1 -- 172.21.15.123:0/565908565 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1f20050790 con 0x7f1f380b1fe0 2024-09-13T17:07:49.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.181+0000 7f1f3759e700 1 -- 172.21.15.123:0/565908565 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f38074730 con 0x7f1f380b1fe0 2024-09-13T17:07:49.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.185+0000 7f1f2f7fe700 1 -- 172.21.15.123:0/565908565 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4737 (secure 0 0 0) 0x7f1f20053db0 con 0x7f1f380b1fe0 2024-09-13T17:07:49.187 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:49.187 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/675597916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":675597916},{"type":"v1","addr":"172.21.15.153:6835","nonce":675597916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/943744723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":943744723},{"type":"v1","addr":"172.21.15.153:6834","nonce":943744723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/625103317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":625103317},{"type":"v1","addr":"172.21.15.123:6835","nonce":625103317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:07:46.797973+0000","modified":"2024-09-13T17:07:48.808133+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2359124958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2359124958},{"type":"v1","addr":"172.21.15.123:6837","nonce":2359124958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:07:49.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.185+0000 7f1f3759e700 1 -- 172.21.15.123:0/565908565 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1f18066730 msgr2=0x7f1f18068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.185+0000 7f1f3759e700 1 --2- 172.21.15.123:0/565908565 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1f18066730 0x7f1f18068bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1f28007a60 tx=0x7f1f28008040 comp rx=0 tx=0).stop 2024-09-13T17:07:49.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.185+0000 7f1f3759e700 1 -- 172.21.15.123:0/565908565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f380b1fe0 msgr2=0x7f1f3814df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.185+0000 7f1f3759e700 1 --2- 172.21.15.123:0/565908565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f380b1fe0 0x7f1f3814df10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000c480 tx=0x7f1f2000c790 comp rx=0 tx=0).stop 2024-09-13T17:07:49.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.185+0000 7f1f3759e700 1 -- 172.21.15.123:0/565908565 shutdown_connections 2024-09-13T17:07:49.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.185+0000 7f1f3759e700 1 --2- 172.21.15.123:0/565908565 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1f18066730 0x7f1f18068bf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.185+0000 7f1f3759e700 1 --2- 172.21.15.123:0/565908565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f3815cd60 0x7f1f380b7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.185+0000 7f1f3759e700 1 --2- 172.21.15.123:0/565908565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f380b1fe0 0x7f1f3814df10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.185+0000 7f1f3759e700 1 --2- 172.21.15.123:0/565908565 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1f380b1970 0x7f1f3815d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.185+0000 7f1f3759e700 1 -- 172.21.15.123:0/565908565 >> 172.21.15.123:0/565908565 conn(0x7f1f380d2b50 msgr2=0x7f1f38071590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:49.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.185+0000 7f1f3759e700 1 -- 172.21.15.123:0/565908565 shutdown_connections 2024-09-13T17:07:49.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.185+0000 7f1f3759e700 1 -- 172.21.15.123:0/565908565 wait complete. 2024-09-13T17:07:49.191 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 13 2024-09-13T17:07:49.206 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:07:49.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 Processor -- start 2024-09-13T17:07:49.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 -- start start 2024-09-13T17:07:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f770015ff90 0x7f77000cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f77000cf1d0 0x7f770006c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f770006c590 0x7f7700160720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77000cf640 con 0x7f770015ff90 2024-09-13T17:07:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77000acc00 con 0x7f77000cf1d0 2024-09-13T17:07:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770006ca00 con 0x7f770006c590 2024-09-13T17:07:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7705e14700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f770006c590 0x7f7700160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7705e14700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f770006c590 0x7f7700160720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:46896/0 (socket says 172.21.15.123:46896) 2024-09-13T17:07:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7704e12700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f77000cf1d0 0x7f770006c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7705e14700 1 -- 172.21.15.123:0/4188403142 learned_addr learned my addr 172.21.15.123:0/4188403142 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7705613700 1 --2- 172.21.15.123:0/4188403142 >> v2:172.21.15.123:3300/0 conn(0x7f770015ff90 0x7f77000cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7704e12700 1 -- 172.21.15.123:0/4188403142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f770006c590 msgr2=0x7f7700160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7704e12700 1 --2- 172.21.15.123:0/4188403142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f770006c590 0x7f7700160720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7704e12700 1 -- 172.21.15.123:0/4188403142 >> v2:172.21.15.123:3300/0 conn(0x7f770015ff90 msgr2=0x7f77000cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7704e12700 1 --2- 172.21.15.123:0/4188403142 >> v2:172.21.15.123:3300/0 conn(0x7f770015ff90 0x7f77000cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7704e12700 1 -- 172.21.15.123:0/4188403142 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770006cc30 con 0x7f77000cf1d0 2024-09-13T17:07:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7705613700 1 --2- 172.21.15.123:0/4188403142 >> v2:172.21.15.123:3300/0 conn(0x7f770015ff90 0x7f77000cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7704e12700 1 --2- 172.21.15.123:0/4188403142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77000cf1d0 0x7f770006c050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f77000adb00 tx=0x7f76f4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bf1d2d952ceaae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f76f3fff700 1 -- 172.21.15.123:0/4188403142 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4011830 con 0x7f77000cf1d0 2024-09-13T17:07:49.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f76f3fff700 1 -- 172.21.15.123:0/4188403142 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f4011990 con 0x7f77000cf1d0 2024-09-13T17:07:49.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f76f3fff700 1 -- 172.21.15.123:0/4188403142 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4011d20 con 0x7f77000cf1d0 2024-09-13T17:07:49.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 -- 172.21.15.123:0/4188403142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77000cf1d0 msgr2=0x7f770006c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 --2- 172.21.15.123:0/4188403142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77000cf1d0 0x7f770006c050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f77000adb00 tx=0x7f76f4009b30 comp rx=0 tx=0).stop 2024-09-13T17:07:49.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 -- 172.21.15.123:0/4188403142 shutdown_connections 2024-09-13T17:07:49.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 --2- 172.21.15.123:0/4188403142 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f770006c590 0x7f7700160720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 --2- 172.21.15.123:0/4188403142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77000cf1d0 0x7f770006c050 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 --2- 172.21.15.123:0/4188403142 >> v2:172.21.15.123:3300/0 conn(0x7f770015ff90 0x7f77000cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 -- 172.21.15.123:0/4188403142 >> 172.21.15.123:0/4188403142 conn(0x7f7700066570 msgr2=0x7f7700066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:49.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 -- 172.21.15.123:0/4188403142 shutdown_connections 2024-09-13T17:07:49.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.317+0000 7f7707877700 1 -- 172.21.15.123:0/4188403142 wait complete. 2024-09-13T17:07:49.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7707877700 1 Processor -- start 2024-09-13T17:07:49.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7707877700 1 -- start start 2024-09-13T17:07:49.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7707877700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f770006c590 0x7f77000cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7707877700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77000cf1d0 0x7f77000cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7707877700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f770015ff90 0x7f7700154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7707877700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7700155d90 con 0x7f770015ff90 2024-09-13T17:07:49.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7707877700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7700155180 con 0x7f77000cf1d0 2024-09-13T17:07:49.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7707877700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7700155460 con 0x7f770006c590 2024-09-13T17:07:49.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7705e14700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f770015ff90 0x7f7700154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7705e14700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f770015ff90 0x7f7700154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44338/0 (socket says 172.21.15.123:44338) 2024-09-13T17:07:49.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7705e14700 1 -- 172.21.15.123:0/3325930187 learned_addr learned my addr 172.21.15.123:0/3325930187 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:49.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7704e12700 1 --2- 172.21.15.123:0/3325930187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77000cf1d0 0x7f77000cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7705613700 1 --2- 172.21.15.123:0/3325930187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f770006c590 0x7f77000cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7705e14700 1 -- 172.21.15.123:0/3325930187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f770006c590 msgr2=0x7f77000cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7705e14700 1 --2- 172.21.15.123:0/3325930187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f770006c590 0x7f77000cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7705e14700 1 -- 172.21.15.123:0/3325930187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77000cf1d0 msgr2=0x7f77000cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7705e14700 1 --2- 172.21.15.123:0/3325930187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77000cf1d0 0x7f77000cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7705e14700 1 -- 172.21.15.123:0/3325930187 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc0094b0 con 0x7f770015ff90 2024-09-13T17:07:49.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7705e14700 1 --2- 172.21.15.123:0/3325930187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f770015ff90 0x7f7700154550 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f76f800efc0 tx=0x7f76f800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f76f1ffb700 1 -- 172.21.15.123:0/3325930187 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8003c40 con 0x7f770015ff90 2024-09-13T17:07:49.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f76f1ffb700 1 -- 172.21.15.123:0/3325930187 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f800f040 con 0x7f770015ff90 2024-09-13T17:07:49.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f76f1ffb700 1 -- 172.21.15.123:0/3325930187 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8009e60 con 0x7f770015ff90 2024-09-13T17:07:49.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7707877700 1 -- 172.21.15.123:0/3325930187 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f40094b0 con 0x7f770015ff90 2024-09-13T17:07:49.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.321+0000 7f7707877700 1 -- 172.21.15.123:0/3325930187 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7700155a20 con 0x7f770015ff90 2024-09-13T17:07:49.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.325+0000 7f7707877700 1 -- 172.21.15.123:0/3325930187 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7700160370 con 0x7f770015ff90 2024-09-13T17:07:49.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.325+0000 7f76f1ffb700 1 -- 172.21.15.123:0/3325930187 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f76f800c930 con 0x7f770015ff90 2024-09-13T17:07:49.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.325+0000 7f76f1ffb700 1 --2- 172.21.15.123:0/3325930187 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f76e4066730 0x7f76e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.325+0000 7f76f1ffb700 1 -- 172.21.15.123:0/3325930187 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76f8085230 con 0x7f770015ff90 2024-09-13T17:07:49.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.325+0000 7f7705613700 1 --2- 172.21.15.123:0/3325930187 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f76e4066730 0x7f76e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.325+0000 7f7705613700 1 --2- 172.21.15.123:0/3325930187 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f76e4066730 0x7f76e4068bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f76fc009bf0 tx=0x7f76fc008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.333+0000 7f76f1ffb700 1 -- 172.21.15.123:0/3325930187 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f76f8052630 con 0x7f770015ff90 2024-09-13T17:07:49.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.505+0000 7f7707877700 1 -- 172.21.15.123:0/3325930187 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77000cef50 con 0x7f770015ff90 2024-09-13T17:07:49.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.505+0000 7f76f1ffb700 1 -- 172.21.15.123:0/3325930187 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f76f8055c50 con 0x7f770015ff90 2024-09-13T17:07:49.510 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:49.510 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":34,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:07:47.800958+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:07:44.636174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T17:07:45.802714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:07:49.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.509+0000 7f7707877700 1 -- 172.21.15.123:0/3325930187 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f76e4066730 msgr2=0x7f76e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.509+0000 7f7707877700 1 --2- 172.21.15.123:0/3325930187 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f76e4066730 0x7f76e4068bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f76fc009bf0 tx=0x7f76fc008040 comp rx=0 tx=0).stop 2024-09-13T17:07:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.509+0000 7f7707877700 1 -- 172.21.15.123:0/3325930187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f770015ff90 msgr2=0x7f7700154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.509+0000 7f7707877700 1 --2- 172.21.15.123:0/3325930187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f770015ff90 0x7f7700154550 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f76f800efc0 tx=0x7f76f800c3a0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.509+0000 7f7707877700 1 -- 172.21.15.123:0/3325930187 shutdown_connections 2024-09-13T17:07:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.509+0000 7f7707877700 1 --2- 172.21.15.123:0/3325930187 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f76e4066730 0x7f76e4068bf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.509+0000 7f7707877700 1 --2- 172.21.15.123:0/3325930187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f770015ff90 0x7f7700154550 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.509+0000 7f7707877700 1 --2- 172.21.15.123:0/3325930187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77000cf1d0 0x7f77000cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.509+0000 7f7707877700 1 --2- 172.21.15.123:0/3325930187 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f770006c590 0x7f77000cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.509+0000 7f7707877700 1 -- 172.21.15.123:0/3325930187 >> 172.21.15.123:0/3325930187 conn(0x7f7700066570 msgr2=0x7f77000b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.509+0000 7f7707877700 1 -- 172.21.15.123:0/3325930187 shutdown_connections 2024-09-13T17:07:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.509+0000 7f7707877700 1 -- 172.21.15.123:0/3325930187 wait complete. 2024-09-13T17:07:49.525 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:07:49.525 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:07:49.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af359e700 1 Processor -- start 2024-09-13T17:07:49.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af359e700 1 -- start start 2024-09-13T17:07:49.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af359e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af4153390 0x7f9af4159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af359e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9af40cdb70 0x7f9af40cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af359e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af415a4c0 con 0x7f9af4153770 2024-09-13T17:07:49.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af359e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af41595a0 con 0x7f9af40cdb70 2024-09-13T17:07:49.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af359e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40cee30 con 0x7f9af4153390 2024-09-13T17:07:49.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af2d9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9af4153770 0x7f9af40ce720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41820/0 (socket says 172.21.15.123:41820) 2024-09-13T17:07:49.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af2d9d700 1 -- 172.21.15.123:0/613056016 learned_addr learned my addr 172.21.15.123:0/613056016 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:49.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9aebfff700 1 --2- 172.21.15.123:0/613056016 >> v2:172.21.15.123:3300/0 conn(0x7f9af40cdb70 0x7f9af40cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af259c700 1 --2- 172.21.15.123:0/613056016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af4153390 0x7f9af4159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af1d9b700 1 -- 172.21.15.123:0/613056016 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789520765 0 0) 0x7f9af415a4c0 con 0x7f9af4153770 2024-09-13T17:07:49.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af1d9b700 1 -- 172.21.15.123:0/613056016 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae00035d0 con 0x7f9af4153770 2024-09-13T17:07:49.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af1d9b700 1 -- 172.21.15.123:0/613056016 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3366762730 0 0) 0x7f9ae00035d0 con 0x7f9af4153770 2024-09-13T17:07:49.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9aebfff700 1 -- 172.21.15.123:0/613056016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af4153390 msgr2=0x7f9af4159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:49.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9aebfff700 1 --2- 172.21.15.123:0/613056016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af4153390 0x7f9af4159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9aebfff700 1 -- 172.21.15.123:0/613056016 >> v1:172.21.15.123:6789/0 conn(0x7f9af4153770 legacy=0x7f9af40ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9aebfff700 1 -- 172.21.15.123:0/613056016 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40cb730 con 0x7f9af40cdb70 2024-09-13T17:07:49.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9aebfff700 1 --2- 172.21.15.123:0/613056016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af40cdb70 0x7f9af40cae30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009880 tx=0x7f9adc009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f818c2036273b022 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af1d9b700 1 -- 172.21.15.123:0/613056016 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0019f0 con 0x7f9af40cdb70 2024-09-13T17:07:49.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af1d9b700 1 -- 172.21.15.123:0/613056016 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9adc004030 con 0x7f9af40cdb70 2024-09-13T17:07:49.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.637+0000 7f9af1d9b700 1 -- 172.21.15.123:0/613056016 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0043c0 con 0x7f9af40cdb70 2024-09-13T17:07:49.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.641+0000 7f9af359e700 1 -- 172.21.15.123:0/613056016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af40cdb70 msgr2=0x7f9af40cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.641+0000 7f9af359e700 1 --2- 172.21.15.123:0/613056016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af40cdb70 0x7f9af40cae30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009880 tx=0x7f9adc009b90 comp rx=0 tx=0).stop 2024-09-13T17:07:49.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.641+0000 7f9af359e700 1 -- 172.21.15.123:0/613056016 shutdown_connections 2024-09-13T17:07:49.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.641+0000 7f9af359e700 1 --2- 172.21.15.123:0/613056016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af40cdb70 0x7f9af40cae30 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.641+0000 7f9af359e700 1 --2- 172.21.15.123:0/613056016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af4153390 0x7f9af4159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.641+0000 7f9af359e700 1 -- 172.21.15.123:0/613056016 >> 172.21.15.123:0/613056016 conn(0x7f9af4066150 msgr2=0x7f9af4066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:49.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.641+0000 7f9af359e700 1 -- 172.21.15.123:0/613056016 shutdown_connections 2024-09-13T17:07:49.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.641+0000 7f9af359e700 1 -- 172.21.15.123:0/613056016 wait complete. 2024-09-13T17:07:49.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.641+0000 7f9af359e700 1 Processor -- start 2024-09-13T17:07:49.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af359e700 1 -- start start 2024-09-13T17:07:49.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af40cdb70 0x7f9af40ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af359e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af4153390 0x7f9af40aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af4153770 0x7f9af4071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af359e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40ae600 con 0x7f9af40cdb70 2024-09-13T17:07:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af41f0a70 con 0x7f9af4153770 2024-09-13T17:07:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af359e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40af080 con 0x7f9af4153390 2024-09-13T17:07:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af40cdb70 0x7f9af40ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af40cdb70 0x7f9af40ad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44364/0 (socket says 172.21.15.123:44364) 2024-09-13T17:07:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af259c700 1 -- 172.21.15.123:0/4112020878 learned_addr learned my addr 172.21.15.123:0/4112020878 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9aebfff700 1 --2- 172.21.15.123:0/4112020878 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af4153390 0x7f9af40aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af2d9d700 1 --2- 172.21.15.123:0/4112020878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af4153770 0x7f9af4071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af259c700 1 -- 172.21.15.123:0/4112020878 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af4153390 msgr2=0x7f9af40aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af259c700 1 --2- 172.21.15.123:0/4112020878 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af4153390 0x7f9af40aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af259c700 1 -- 172.21.15.123:0/4112020878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af4153770 msgr2=0x7f9af4071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af259c700 1 --2- 172.21.15.123:0/4112020878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af4153770 0x7f9af4071d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af259c700 1 -- 172.21.15.123:0/4112020878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc0094b0 con 0x7f9af40cdb70 2024-09-13T17:07:49.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af259c700 1 --2- 172.21.15.123:0/4112020878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af40cdb70 0x7f9af40ad750 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400e9d0 tx=0x7f9ae400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9aeaffd700 1 -- 172.21.15.123:0/4112020878 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4009720 con 0x7f9af40cdb70 2024-09-13T17:07:49.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9aeaffd700 1 -- 172.21.15.123:0/4112020878 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae400c850 con 0x7f9af40cdb70 2024-09-13T17:07:49.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af359e700 1 -- 172.21.15.123:0/4112020878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af40add60 con 0x7f9af40cdb70 2024-09-13T17:07:49.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9aeaffd700 1 -- 172.21.15.123:0/4112020878 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae400cbc0 con 0x7f9af40cdb70 2024-09-13T17:07:49.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af359e700 1 -- 172.21.15.123:0/4112020878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af40ae320 con 0x7f9af40cdb70 2024-09-13T17:07:49.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.645+0000 7f9af359e700 1 -- 172.21.15.123:0/4112020878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af40677f0 con 0x7f9af40cdb70 2024-09-13T17:07:49.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.649+0000 7f9aeaffd700 1 -- 172.21.15.123:0/4112020878 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ae400cd20 con 0x7f9af40cdb70 2024-09-13T17:07:49.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.649+0000 7f9aeaffd700 1 --2- 172.21.15.123:0/4112020878 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad4066730 0x7f9ad4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.649+0000 7f9aebfff700 1 --2- 172.21.15.123:0/4112020878 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad4066730 0x7f9ad4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.649+0000 7f9aeaffd700 1 -- 172.21.15.123:0/4112020878 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ae4084280 con 0x7f9af40cdb70 2024-09-13T17:07:49.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.649+0000 7f9aebfff700 1 --2- 172.21.15.123:0/4112020878 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad4066730 0x7f9ad4068bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9af40cdfb0 tx=0x7f9adc010000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.657+0000 7f9aeaffd700 1 -- 172.21.15.123:0/4112020878 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ae40515f0 con 0x7f9af40cdb70 2024-09-13T17:07:49.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.821+0000 7f9af359e700 1 -- 172.21.15.123:0/4112020878 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9af4159a60 con 0x7f9ad4066730 2024-09-13T17:07:49.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.829+0000 7f9aeaffd700 1 -- 172.21.15.123:0/4112020878 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286895 (secure 0 0 0) 0x7f9adc022090 con 0x7f9ad4066730 2024-09-13T17:07:49.838 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.837+0000 7f9af359e700 1 -- 172.21.15.123:0/4112020878 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad4066730 msgr2=0x7f9ad4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.837+0000 7f9af359e700 1 --2- 172.21.15.123:0/4112020878 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad4066730 0x7f9ad4068bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9af40cdfb0 tx=0x7f9adc010000 comp rx=0 tx=0).stop 2024-09-13T17:07:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.837+0000 7f9af359e700 1 -- 172.21.15.123:0/4112020878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af40cdb70 msgr2=0x7f9af40ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.837+0000 7f9af359e700 1 --2- 172.21.15.123:0/4112020878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af40cdb70 0x7f9af40ad750 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400e9d0 tx=0x7f9ae400ed90 comp rx=0 tx=0).stop 2024-09-13T17:07:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.837+0000 7f9af359e700 1 -- 172.21.15.123:0/4112020878 shutdown_connections 2024-09-13T17:07:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.837+0000 7f9af359e700 1 --2- 172.21.15.123:0/4112020878 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad4066730 0x7f9ad4068bf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.837+0000 7f9af359e700 1 --2- 172.21.15.123:0/4112020878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af4153770 0x7f9af4071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.837+0000 7f9af359e700 1 --2- 172.21.15.123:0/4112020878 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af4153390 0x7f9af40aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.837+0000 7f9af359e700 1 --2- 172.21.15.123:0/4112020878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af40cdb70 0x7f9af40ad750 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.837+0000 7f9af359e700 1 -- 172.21.15.123:0/4112020878 >> 172.21.15.123:0/4112020878 conn(0x7f9af4066150 msgr2=0x7f9af41583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.837+0000 7f9af359e700 1 -- 172.21.15.123:0/4112020878 shutdown_connections 2024-09-13T17:07:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.837+0000 7f9af359e700 1 -- 172.21.15.123:0/4112020878 wait complete. 2024-09-13T17:07:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:07:49.851 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-13T17:07:48.754491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220068,"kb_used_data":3904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754652,"statfs":{"total":773094113280,"available":772868763648,"internally_reserved":0,"allocated":3997696,"data_stored":2253630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001092"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825404+0000","last_change":"2024-09-13T17:07:46.825404+0000","last_active":"2024-09-13T17:07:46.825404+0000","last_peered":"2024-09-13T17:07:46.825404+0000","last_clean":"2024-09-13T17:07:46.825404+0000","last_became_active":"2024-09-13T17:07:46.825157+0000","last_became_peered":"2024-09-13T17:07:46.825157+0000","last_unstale":"2024-09-13T17:07:46.825404+0000","last_undegraded":"2024-09-13T17:07:46.825404+0000","last_fullsized":"2024-09-13T17:07:46.825404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:08.819755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821865+0000","last_change":"2024-09-13T17:07:46.821865+0000","last_active":"2024-09-13T17:07:46.821865+0000","last_peered":"2024-09-13T17:07:46.821865+0000","last_clean":"2024-09-13T17:07:46.821865+0000","last_became_active":"2024-09-13T17:07:46.821335+0000","last_became_peered":"2024-09-13T17:07:46.821335+0000","last_unstale":"2024-09-13T17:07:46.821865+0000","last_undegraded":"2024-09-13T17:07:46.821865+0000","last_fullsized":"2024-09-13T17:07:46.821865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:19.871674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821251+0000","last_change":"2024-09-13T17:07:46.821251+0000","last_active":"2024-09-13T17:07:46.821251+0000","last_peered":"2024-09-13T17:07:46.821251+0000","last_clean":"2024-09-13T17:07:46.821251+0000","last_became_active":"2024-09-13T17:07:46.820956+0000","last_became_peered":"2024-09-13T17:07:46.820956+0000","last_unstale":"2024-09-13T17:07:46.821251+0000","last_undegraded":"2024-09-13T17:07:46.821251+0000","last_fullsized":"2024-09-13T17:07:46.821251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807336+0000","last_change":"2024-09-13T17:07:46.807336+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807336+0000","last_undegraded":"2024-09-13T17:07:46.807336+0000","last_fullsized":"2024-09-13T17:07:46.807336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.815482+0000","last_change":"2024-09-13T17:07:46.815482+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.815482+0000","last_undegraded":"2024-09-13T17:07:46.815482+0000","last_fullsized":"2024-09-13T17:07:46.815482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.812028+0000","last_change":"2024-09-13T17:07:46.812028+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.812028+0000","last_undegraded":"2024-09-13T17:07:46.812028+0000","last_fullsized":"2024-09-13T17:07:46.812028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807911+0000","last_change":"2024-09-13T17:07:46.807911+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807911+0000","last_undegraded":"2024-09-13T17:07:46.807911+0000","last_fullsized":"2024-09-13T17:07:46.807911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808191+0000","last_change":"2024-09-13T17:07:46.808191+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808191+0000","last_undegraded":"2024-09-13T17:07:46.808191+0000","last_fullsized":"2024-09-13T17:07:46.808191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:34.528334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.826617+0000","last_change":"2024-09-13T17:07:46.826617+0000","last_active":"2024-09-13T17:07:46.826617+0000","last_peered":"2024-09-13T17:07:46.826617+0000","last_clean":"2024-09-13T17:07:46.826617+0000","last_became_active":"2024-09-13T17:07:46.826339+0000","last_became_peered":"2024-09-13T17:07:46.826339+0000","last_unstale":"2024-09-13T17:07:46.826617+0000","last_undegraded":"2024-09-13T17:07:46.826617+0000","last_fullsized":"2024-09-13T17:07:46.826617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:27.800734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815960+0000","last_change":"2024-09-13T17:07:46.815960+0000","last_active":"2024-09-13T17:07:46.815960+0000","last_peered":"2024-09-13T17:07:46.815960+0000","last_clean":"2024-09-13T17:07:46.815960+0000","last_became_active":"2024-09-13T17:07:46.815778+0000","last_became_peered":"2024-09-13T17:07:46.815778+0000","last_unstale":"2024-09-13T17:07:46.815960+0000","last_undegraded":"2024-09-13T17:07:46.815960+0000","last_fullsized":"2024-09-13T17:07:46.815960+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.813819+0000","last_change":"2024-09-13T17:07:46.812036+0000","last_active":"2024-09-13T17:07:46.813819+0000","last_peered":"2024-09-13T17:07:46.813819+0000","last_clean":"2024-09-13T17:07:46.813819+0000","last_became_active":"2024-09-13T17:07:46.811777+0000","last_became_peered":"2024-09-13T17:07:46.811777+0000","last_unstale":"2024-09-13T17:07:46.813819+0000","last_undegraded":"2024-09-13T17:07:46.813819+0000","last_fullsized":"2024-09-13T17:07:46.813819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824951+0000","last_change":"2024-09-13T17:07:46.824951+0000","last_active":"2024-09-13T17:07:46.824951+0000","last_peered":"2024-09-13T17:07:46.824951+0000","last_clean":"2024-09-13T17:07:46.824951+0000","last_became_active":"2024-09-13T17:07:46.824657+0000","last_became_peered":"2024-09-13T17:07:46.824657+0000","last_unstale":"2024-09-13T17:07:46.824951+0000","last_undegraded":"2024-09-13T17:07:46.824951+0000","last_fullsized":"2024-09-13T17:07:46.824951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:19.871674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.819466+0000","last_change":"2024-09-13T17:07:46.819466+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.819466+0000","last_undegraded":"2024-09-13T17:07:46.819466+0000","last_fullsized":"2024-09-13T17:07:46.819466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:12.951389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824808+0000","last_change":"2024-09-13T17:07:46.824808+0000","last_active":"2024-09-13T17:07:46.824808+0000","last_peered":"2024-09-13T17:07:46.824808+0000","last_clean":"2024-09-13T17:07:46.824808+0000","last_became_active":"2024-09-13T17:07:46.824588+0000","last_became_peered":"2024-09-13T17:07:46.824588+0000","last_unstale":"2024-09-13T17:07:46.824808+0000","last_undegraded":"2024-09-13T17:07:46.824808+0000","last_fullsized":"2024-09-13T17:07:46.824808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824436+0000","last_change":"2024-09-13T17:07:46.824436+0000","last_active":"2024-09-13T17:07:46.824436+0000","last_peered":"2024-09-13T17:07:46.824436+0000","last_clean":"2024-09-13T17:07:46.824436+0000","last_became_active":"2024-09-13T17:07:46.822126+0000","last_became_peered":"2024-09-13T17:07:46.822126+0000","last_unstale":"2024-09-13T17:07:46.824436+0000","last_undegraded":"2024-09-13T17:07:46.824436+0000","last_fullsized":"2024-09-13T17:07:46.824436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:26.583203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.817868+0000","last_change":"2024-09-13T17:07:46.814681+0000","last_active":"2024-09-13T17:07:46.817868+0000","last_peered":"2024-09-13T17:07:46.817868+0000","last_clean":"2024-09-13T17:07:46.817868+0000","last_became_active":"2024-09-13T17:07:46.814398+0000","last_became_peered":"2024-09-13T17:07:46.814398+0000","last_unstale":"2024-09-13T17:07:46.817868+0000","last_undegraded":"2024-09-13T17:07:46.817868+0000","last_fullsized":"2024-09-13T17:07:46.817868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807614+0000","last_change":"2024-09-13T17:07:46.807614+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807614+0000","last_undegraded":"2024-09-13T17:07:46.807614+0000","last_fullsized":"2024-09-13T17:07:46.807614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824754+0000","last_change":"2024-09-13T17:07:46.824754+0000","last_active":"2024-09-13T17:07:46.824754+0000","last_peered":"2024-09-13T17:07:46.824754+0000","last_clean":"2024-09-13T17:07:46.824754+0000","last_became_active":"2024-09-13T17:07:46.824491+0000","last_became_peered":"2024-09-13T17:07:46.824491+0000","last_unstale":"2024-09-13T17:07:46.824754+0000","last_undegraded":"2024-09-13T17:07:46.824754+0000","last_fullsized":"2024-09-13T17:07:46.824754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822199+0000","last_change":"2024-09-13T17:07:46.822199+0000","last_active":"2024-09-13T17:07:46.822199+0000","last_peered":"2024-09-13T17:07:46.822199+0000","last_clean":"2024-09-13T17:07:46.822199+0000","last_became_active":"2024-09-13T17:07:46.821039+0000","last_became_peered":"2024-09-13T17:07:46.821039+0000","last_unstale":"2024-09-13T17:07:46.822199+0000","last_undegraded":"2024-09-13T17:07:46.822199+0000","last_fullsized":"2024-09-13T17:07:46.822199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.815297+0000","last_change":"2024-09-13T17:07:46.815297+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.815297+0000","last_undegraded":"2024-09-13T17:07:46.815297+0000","last_fullsized":"2024-09-13T17:07:46.815297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:56.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824875+0000","last_change":"2024-09-13T17:07:46.824875+0000","last_active":"2024-09-13T17:07:46.824875+0000","last_peered":"2024-09-13T17:07:46.824875+0000","last_clean":"2024-09-13T17:07:46.824875+0000","last_became_active":"2024-09-13T17:07:46.819999+0000","last_became_peered":"2024-09-13T17:07:46.819999+0000","last_unstale":"2024-09-13T17:07:46.824875+0000","last_undegraded":"2024-09-13T17:07:46.824875+0000","last_fullsized":"2024-09-13T17:07:46.824875+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:20.464724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824665+0000","last_change":"2024-09-13T17:07:46.824665+0000","last_active":"2024-09-13T17:07:46.824665+0000","last_peered":"2024-09-13T17:07:46.824665+0000","last_clean":"2024-09-13T17:07:46.824665+0000","last_became_active":"2024-09-13T17:07:46.820399+0000","last_became_peered":"2024-09-13T17:07:46.820399+0000","last_unstale":"2024-09-13T17:07:46.824665+0000","last_undegraded":"2024-09-13T17:07:46.824665+0000","last_fullsized":"2024-09-13T17:07:46.824665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:50.541570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815664+0000","last_change":"2024-09-13T17:07:46.811674+0000","last_active":"2024-09-13T17:07:46.815664+0000","last_peered":"2024-09-13T17:07:46.815664+0000","last_clean":"2024-09-13T17:07:46.815664+0000","last_became_active":"2024-09-13T17:07:46.811449+0000","last_became_peered":"2024-09-13T17:07:46.811449+0000","last_unstale":"2024-09-13T17:07:46.815664+0000","last_undegraded":"2024-09-13T17:07:46.815664+0000","last_fullsized":"2024-09-13T17:07:46.815664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:20.464724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.812767+0000","last_change":"2024-09-13T17:07:46.812767+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.812767+0000","last_undegraded":"2024-09-13T17:07:46.812767+0000","last_fullsized":"2024-09-13T17:07:46.812767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818395+0000","last_change":"2024-09-13T17:07:46.818395+0000","last_active":"2024-09-13T17:07:46.818395+0000","last_peered":"2024-09-13T17:07:46.818395+0000","last_clean":"2024-09-13T17:07:46.818395+0000","last_became_active":"2024-09-13T17:07:46.817022+0000","last_became_peered":"2024-09-13T17:07:46.817022+0000","last_unstale":"2024-09-13T17:07:46.818395+0000","last_undegraded":"2024-09-13T17:07:46.818395+0000","last_fullsized":"2024-09-13T17:07:46.818395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822031+0000","last_change":"2024-09-13T17:07:46.822031+0000","last_active":"2024-09-13T17:07:46.822031+0000","last_peered":"2024-09-13T17:07:46.822031+0000","last_clean":"2024-09-13T17:07:46.822031+0000","last_became_active":"2024-09-13T17:07:46.821647+0000","last_became_peered":"2024-09-13T17:07:46.821647+0000","last_unstale":"2024-09-13T17:07:46.822031+0000","last_undegraded":"2024-09-13T17:07:46.822031+0000","last_fullsized":"2024-09-13T17:07:46.822031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807893+0000","last_change":"2024-09-13T17:07:46.807893+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807893+0000","last_undegraded":"2024-09-13T17:07:46.807893+0000","last_fullsized":"2024-09-13T17:07:46.807893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820791+0000","last_change":"2024-09-13T17:07:46.820791+0000","last_active":"2024-09-13T17:07:46.820791+0000","last_peered":"2024-09-13T17:07:46.820791+0000","last_clean":"2024-09-13T17:07:46.820791+0000","last_became_active":"2024-09-13T17:07:46.820457+0000","last_became_peered":"2024-09-13T17:07:46.820457+0000","last_unstale":"2024-09-13T17:07:46.820791+0000","last_undegraded":"2024-09-13T17:07:46.820791+0000","last_fullsized":"2024-09-13T17:07:46.820791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825418+0000","last_change":"2024-09-13T17:07:46.825418+0000","last_active":"2024-09-13T17:07:46.825418+0000","last_peered":"2024-09-13T17:07:46.825418+0000","last_clean":"2024-09-13T17:07:46.825418+0000","last_became_active":"2024-09-13T17:07:46.825165+0000","last_became_peered":"2024-09-13T17:07:46.825165+0000","last_unstale":"2024-09-13T17:07:46.825418+0000","last_undegraded":"2024-09-13T17:07:46.825418+0000","last_fullsized":"2024-09-13T17:07:46.825418+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:58.908098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.819149+0000","last_change":"2024-09-13T17:07:46.819149+0000","last_active":"2024-09-13T17:07:46.819149+0000","last_peered":"2024-09-13T17:07:46.819149+0000","last_clean":"2024-09-13T17:07:46.819149+0000","last_became_active":"2024-09-13T17:07:46.818880+0000","last_became_peered":"2024-09-13T17:07:46.818880+0000","last_unstale":"2024-09-13T17:07:46.819149+0000","last_undegraded":"2024-09-13T17:07:46.819149+0000","last_fullsized":"2024-09-13T17:07:46.819149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824186+0000","last_change":"2024-09-13T17:07:46.824186+0000","last_active":"2024-09-13T17:07:46.824186+0000","last_peered":"2024-09-13T17:07:46.824186+0000","last_clean":"2024-09-13T17:07:46.824186+0000","last_became_active":"2024-09-13T17:07:46.823935+0000","last_became_peered":"2024-09-13T17:07:46.823935+0000","last_unstale":"2024-09-13T17:07:46.824186+0000","last_undegraded":"2024-09-13T17:07:46.824186+0000","last_fullsized":"2024-09-13T17:07:46.824186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:58.908098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807784+0000","last_change":"2024-09-13T17:07:46.807784+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807784+0000","last_undegraded":"2024-09-13T17:07:46.807784+0000","last_fullsized":"2024-09-13T17:07:46.807784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815878+0000","last_change":"2024-09-13T17:07:46.812039+0000","last_active":"2024-09-13T17:07:46.815878+0000","last_peered":"2024-09-13T17:07:46.815878+0000","last_clean":"2024-09-13T17:07:46.815878+0000","last_became_active":"2024-09-13T17:07:46.811670+0000","last_became_peered":"2024-09-13T17:07:46.811670+0000","last_unstale":"2024-09-13T17:07:46.815878+0000","last_undegraded":"2024-09-13T17:07:46.815878+0000","last_fullsized":"2024-09-13T17:07:46.815878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:47.788741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818961+0000","last_change":"2024-09-13T17:07:46.462013+0000","last_active":"2024-09-13T17:07:46.818961+0000","last_peered":"2024-09-13T17:07:46.818961+0000","last_clean":"2024-09-13T17:07:46.818961+0000","last_became_active":"2024-09-13T17:07:46.461748+0000","last_became_peered":"2024-09-13T17:07:46.461748+0000","last_unstale":"2024-09-13T17:07:46.818961+0000","last_undegraded":"2024-09-13T17:07:46.818961+0000","last_fullsized":"2024-09-13T17:07:46.818961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.816525+0000","last_change":"2024-09-13T17:07:46.816525+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.816525+0000","last_undegraded":"2024-09-13T17:07:46.816525+0000","last_fullsized":"2024-09-13T17:07:46.816525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:56.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.805711+0000","last_change":"2024-09-13T17:07:46.460122+0000","last_active":"2024-09-13T17:07:46.805711+0000","last_peered":"2024-09-13T17:07:46.805711+0000","last_clean":"2024-09-13T17:07:46.805711+0000","last_became_active":"2024-09-13T17:07:46.459873+0000","last_became_peered":"2024-09-13T17:07:46.459873+0000","last_unstale":"2024-09-13T17:07:46.805711+0000","last_undegraded":"2024-09-13T17:07:46.805711+0000","last_fullsized":"2024-09-13T17:07:46.805711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:32.873876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824847+0000","last_change":"2024-09-13T17:07:46.824847+0000","last_active":"2024-09-13T17:07:46.824847+0000","last_peered":"2024-09-13T17:07:46.824847+0000","last_clean":"2024-09-13T17:07:46.824847+0000","last_became_active":"2024-09-13T17:07:46.820127+0000","last_became_peered":"2024-09-13T17:07:46.820127+0000","last_unstale":"2024-09-13T17:07:46.824847+0000","last_undegraded":"2024-09-13T17:07:46.824847+0000","last_fullsized":"2024-09-13T17:07:46.824847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:08.819755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812174+0000","last_change":"2024-09-13T17:07:46.460323+0000","last_active":"2024-09-13T17:07:46.812174+0000","last_peered":"2024-09-13T17:07:46.812174+0000","last_clean":"2024-09-13T17:07:46.812174+0000","last_became_active":"2024-09-13T17:07:46.459957+0000","last_became_peered":"2024-09-13T17:07:46.459957+0000","last_unstale":"2024-09-13T17:07:46.812174+0000","last_undegraded":"2024-09-13T17:07:46.812174+0000","last_fullsized":"2024-09-13T17:07:46.812174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:28.877530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.806382+0000","last_change":"2024-09-13T17:07:46.806382+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.806382+0000","last_undegraded":"2024-09-13T17:07:46.806382+0000","last_fullsized":"2024-09-13T17:07:46.806382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818133+0000","last_change":"2024-09-13T17:07:46.466176+0000","last_active":"2024-09-13T17:07:46.818133+0000","last_peered":"2024-09-13T17:07:46.818133+0000","last_clean":"2024-09-13T17:07:46.818133+0000","last_became_active":"2024-09-13T17:07:46.465971+0000","last_became_peered":"2024-09-13T17:07:46.465971+0000","last_unstale":"2024-09-13T17:07:46.818133+0000","last_undegraded":"2024-09-13T17:07:46.818133+0000","last_fullsized":"2024-09-13T17:07:46.818133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:16.394194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808020+0000","last_change":"2024-09-13T17:07:46.808020+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808020+0000","last_undegraded":"2024-09-13T17:07:46.808020+0000","last_fullsized":"2024-09-13T17:07:46.808020+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812955+0000","last_change":"2024-09-13T17:07:46.463243+0000","last_active":"2024-09-13T17:07:46.812955+0000","last_peered":"2024-09-13T17:07:46.812955+0000","last_clean":"2024-09-13T17:07:46.812955+0000","last_became_active":"2024-09-13T17:07:46.458515+0000","last_became_peered":"2024-09-13T17:07:46.458515+0000","last_unstale":"2024-09-13T17:07:46.812955+0000","last_undegraded":"2024-09-13T17:07:46.812955+0000","last_fullsized":"2024-09-13T17:07:46.812955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:50.939498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820780+0000","last_change":"2024-09-13T17:07:46.820780+0000","last_active":"2024-09-13T17:07:46.820780+0000","last_peered":"2024-09-13T17:07:46.820780+0000","last_clean":"2024-09-13T17:07:46.820780+0000","last_became_active":"2024-09-13T17:07:46.820475+0000","last_became_peered":"2024-09-13T17:07:46.820475+0000","last_unstale":"2024-09-13T17:07:46.820780+0000","last_undegraded":"2024-09-13T17:07:46.820780+0000","last_fullsized":"2024-09-13T17:07:46.820780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.827386+0000","last_change":"2024-09-13T17:07:46.458577+0000","last_active":"2024-09-13T17:07:46.827386+0000","last_peered":"2024-09-13T17:07:46.827386+0000","last_clean":"2024-09-13T17:07:46.827386+0000","last_became_active":"2024-09-13T17:07:46.458092+0000","last_became_peered":"2024-09-13T17:07:46.458092+0000","last_unstale":"2024-09-13T17:07:46.827386+0000","last_undegraded":"2024-09-13T17:07:46.827386+0000","last_fullsized":"2024-09-13T17:07:46.827386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:40.898298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825572+0000","last_change":"2024-09-13T17:07:46.825572+0000","last_active":"2024-09-13T17:07:46.825572+0000","last_peered":"2024-09-13T17:07:46.825572+0000","last_clean":"2024-09-13T17:07:46.825572+0000","last_became_active":"2024-09-13T17:07:46.825347+0000","last_became_peered":"2024-09-13T17:07:46.825347+0000","last_unstale":"2024-09-13T17:07:46.825572+0000","last_undegraded":"2024-09-13T17:07:46.825572+0000","last_fullsized":"2024-09-13T17:07:46.825572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811858+0000","last_change":"2024-09-13T17:07:46.468729+0000","last_active":"2024-09-13T17:07:46.811858+0000","last_peered":"2024-09-13T17:07:46.811858+0000","last_clean":"2024-09-13T17:07:46.811858+0000","last_became_active":"2024-09-13T17:07:46.468433+0000","last_became_peered":"2024-09-13T17:07:46.468433+0000","last_unstale":"2024-09-13T17:07:46.811858+0000","last_undegraded":"2024-09-13T17:07:46.811858+0000","last_fullsized":"2024-09-13T17:07:46.811858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:31.087286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.806606+0000","last_change":"2024-09-13T17:07:46.806606+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.806606+0000","last_undegraded":"2024-09-13T17:07:46.806606+0000","last_fullsized":"2024-09-13T17:07:46.806606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.819903+0000","last_change":"2024-09-13T17:07:46.459288+0000","last_active":"2024-09-13T17:07:46.819903+0000","last_peered":"2024-09-13T17:07:46.819903+0000","last_clean":"2024-09-13T17:07:46.819903+0000","last_became_active":"2024-09-13T17:07:46.459007+0000","last_became_peered":"2024-09-13T17:07:46.459007+0000","last_unstale":"2024-09-13T17:07:46.819903+0000","last_undegraded":"2024-09-13T17:07:46.819903+0000","last_fullsized":"2024-09-13T17:07:46.819903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:29.395885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.826627+0000","last_change":"2024-09-13T17:07:46.826627+0000","last_active":"2024-09-13T17:07:46.826627+0000","last_peered":"2024-09-13T17:07:46.826627+0000","last_clean":"2024-09-13T17:07:46.826627+0000","last_became_active":"2024-09-13T17:07:46.826393+0000","last_became_peered":"2024-09-13T17:07:46.826393+0000","last_unstale":"2024-09-13T17:07:46.826627+0000","last_undegraded":"2024-09-13T17:07:46.826627+0000","last_fullsized":"2024-09-13T17:07:46.826627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815309+0000","last_change":"2024-09-13T17:07:46.461106+0000","last_active":"2024-09-13T17:07:46.815309+0000","last_peered":"2024-09-13T17:07:46.815309+0000","last_clean":"2024-09-13T17:07:46.815309+0000","last_became_active":"2024-09-13T17:07:46.460874+0000","last_became_peered":"2024-09-13T17:07:46.460874+0000","last_unstale":"2024-09-13T17:07:46.815309+0000","last_undegraded":"2024-09-13T17:07:46.815309+0000","last_fullsized":"2024-09-13T17:07:46.815309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:32.873876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821371+0000","last_change":"2024-09-13T17:07:46.821371+0000","last_active":"2024-09-13T17:07:46.821371+0000","last_peered":"2024-09-13T17:07:46.821371+0000","last_clean":"2024-09-13T17:07:46.821371+0000","last_became_active":"2024-09-13T17:07:46.821128+0000","last_became_peered":"2024-09-13T17:07:46.821128+0000","last_unstale":"2024-09-13T17:07:46.821371+0000","last_undegraded":"2024-09-13T17:07:46.821371+0000","last_fullsized":"2024-09-13T17:07:46.821371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.805842+0000","last_change":"2024-09-13T17:07:46.463906+0000","last_active":"2024-09-13T17:07:46.805842+0000","last_peered":"2024-09-13T17:07:46.805842+0000","last_clean":"2024-09-13T17:07:46.805842+0000","last_became_active":"2024-09-13T17:07:46.463601+0000","last_became_peered":"2024-09-13T17:07:46.463601+0000","last_unstale":"2024-09-13T17:07:46.805842+0000","last_undegraded":"2024-09-13T17:07:46.805842+0000","last_fullsized":"2024-09-13T17:07:46.805842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:31.087286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824192+0000","last_change":"2024-09-13T17:07:46.818746+0000","last_active":"2024-09-13T17:07:46.824192+0000","last_peered":"2024-09-13T17:07:46.824192+0000","last_clean":"2024-09-13T17:07:46.824192+0000","last_became_active":"2024-09-13T17:07:46.818495+0000","last_became_peered":"2024-09-13T17:07:46.818495+0000","last_unstale":"2024-09-13T17:07:46.824192+0000","last_undegraded":"2024-09-13T17:07:46.824192+0000","last_fullsized":"2024-09-13T17:07:46.824192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.816473+0000","last_change":"2024-09-13T17:07:46.461668+0000","last_active":"2024-09-13T17:07:46.816473+0000","last_peered":"2024-09-13T17:07:46.816473+0000","last_clean":"2024-09-13T17:07:46.816473+0000","last_became_active":"2024-09-13T17:07:46.461382+0000","last_became_peered":"2024-09-13T17:07:46.461382+0000","last_unstale":"2024-09-13T17:07:46.816473+0000","last_undegraded":"2024-09-13T17:07:46.816473+0000","last_fullsized":"2024-09-13T17:07:46.816473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:36.337890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825662+0000","last_change":"2024-09-13T17:07:46.825662+0000","last_active":"2024-09-13T17:07:46.825662+0000","last_peered":"2024-09-13T17:07:46.825662+0000","last_clean":"2024-09-13T17:07:46.825662+0000","last_became_active":"2024-09-13T17:07:46.825407+0000","last_became_peered":"2024-09-13T17:07:46.825407+0000","last_unstale":"2024-09-13T17:07:46.825662+0000","last_undegraded":"2024-09-13T17:07:46.825662+0000","last_fullsized":"2024-09-13T17:07:46.825662+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812710+0000","last_change":"2024-09-13T17:07:46.463093+0000","last_active":"2024-09-13T17:07:46.812710+0000","last_peered":"2024-09-13T17:07:46.812710+0000","last_clean":"2024-09-13T17:07:46.812710+0000","last_became_active":"2024-09-13T17:07:46.462889+0000","last_became_peered":"2024-09-13T17:07:46.462889+0000","last_unstale":"2024-09-13T17:07:46.812710+0000","last_undegraded":"2024-09-13T17:07:46.812710+0000","last_fullsized":"2024-09-13T17:07:46.812710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.806237+0000","last_change":"2024-09-13T17:07:46.806237+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.806237+0000","last_undegraded":"2024-09-13T17:07:46.806237+0000","last_fullsized":"2024-09-13T17:07:46.806237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.814816+0000","last_change":"2024-09-13T17:07:46.463442+0000","last_active":"2024-09-13T17:07:46.814816+0000","last_peered":"2024-09-13T17:07:46.814816+0000","last_clean":"2024-09-13T17:07:46.814816+0000","last_became_active":"2024-09-13T17:07:46.459612+0000","last_became_peered":"2024-09-13T17:07:46.459612+0000","last_unstale":"2024-09-13T17:07:46.814816+0000","last_undegraded":"2024-09-13T17:07:46.814816+0000","last_fullsized":"2024-09-13T17:07:46.814816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:24.900637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820438+0000","last_change":"2024-09-13T17:07:46.820438+0000","last_active":"2024-09-13T17:07:46.820438+0000","last_peered":"2024-09-13T17:07:46.820438+0000","last_clean":"2024-09-13T17:07:46.820438+0000","last_became_active":"2024-09-13T17:07:46.820201+0000","last_became_peered":"2024-09-13T17:07:46.820201+0000","last_unstale":"2024-09-13T17:07:46.820438+0000","last_undegraded":"2024-09-13T17:07:46.820438+0000","last_fullsized":"2024-09-13T17:07:46.820438+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.807423+0000","last_change":"2024-09-13T17:07:46.459435+0000","last_active":"2024-09-13T17:07:46.807423+0000","last_peered":"2024-09-13T17:07:46.807423+0000","last_clean":"2024-09-13T17:07:46.807423+0000","last_became_active":"2024-09-13T17:07:46.459153+0000","last_became_peered":"2024-09-13T17:07:46.459153+0000","last_unstale":"2024-09-13T17:07:46.807423+0000","last_undegraded":"2024-09-13T17:07:46.807423+0000","last_fullsized":"2024-09-13T17:07:46.807423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:07.809881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808836+0000","last_change":"2024-09-13T17:07:46.808836+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808836+0000","last_undegraded":"2024-09-13T17:07:46.808836+0000","last_fullsized":"2024-09-13T17:07:46.808836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.810926+0000","last_change":"2024-09-13T17:07:46.459612+0000","last_active":"2024-09-13T17:07:46.810926+0000","last_peered":"2024-09-13T17:07:46.810926+0000","last_clean":"2024-09-13T17:07:46.810926+0000","last_became_active":"2024-09-13T17:07:46.459303+0000","last_became_peered":"2024-09-13T17:07:46.459303+0000","last_unstale":"2024-09-13T17:07:46.810926+0000","last_undegraded":"2024-09-13T17:07:46.810926+0000","last_fullsized":"2024-09-13T17:07:46.810926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:25.626757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.816307+0000","last_change":"2024-09-13T17:07:46.816307+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.816307+0000","last_undegraded":"2024-09-13T17:07:46.816307+0000","last_fullsized":"2024-09-13T17:07:46.816307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:37.347764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811516+0000","last_change":"2024-09-13T17:07:46.462541+0000","last_active":"2024-09-13T17:07:46.811516+0000","last_peered":"2024-09-13T17:07:46.811516+0000","last_clean":"2024-09-13T17:07:46.811516+0000","last_became_active":"2024-09-13T17:07:46.460577+0000","last_became_peered":"2024-09-13T17:07:46.460577+0000","last_unstale":"2024-09-13T17:07:46.811516+0000","last_undegraded":"2024-09-13T17:07:46.811516+0000","last_fullsized":"2024-09-13T17:07:46.811516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:11.941516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.813451+0000","last_change":"2024-09-13T17:07:46.813451+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.813451+0000","last_undegraded":"2024-09-13T17:07:46.813451+0000","last_fullsized":"2024-09-13T17:07:46.813451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:47.788741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.806869+0000","last_change":"2024-09-13T17:07:46.466551+0000","last_active":"2024-09-13T17:07:46.806869+0000","last_peered":"2024-09-13T17:07:46.806869+0000","last_clean":"2024-09-13T17:07:46.806869+0000","last_became_active":"2024-09-13T17:07:46.466298+0000","last_became_peered":"2024-09-13T17:07:46.466298+0000","last_unstale":"2024-09-13T17:07:46.806869+0000","last_undegraded":"2024-09-13T17:07:46.806869+0000","last_fullsized":"2024-09-13T17:07:46.806869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:49.531696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-09-13T17:07:46.829660+0000","last_change":"2024-09-13T17:07:46.829622+0000","last_active":"2024-09-13T17:07:46.829660+0000","last_peered":"2024-09-13T17:07:46.829660+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"2024-09-13T17:07:46.829622+0000","last_became_peered":"2024-09-13T17:07:46.829622+0000","last_unstale":"2024-09-13T17:07:46.829660+0000","last_undegraded":"2024-09-13T17:07:46.829660+0000","last_fullsized":"2024-09-13T17:07:46.829660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.814018+0000","last_change":"2024-09-13T17:07:46.459751+0000","last_active":"2024-09-13T17:07:46.814018+0000","last_peered":"2024-09-13T17:07:46.814018+0000","last_clean":"2024-09-13T17:07:46.814018+0000","last_became_active":"2024-09-13T17:07:46.458678+0000","last_became_peered":"2024-09-13T17:07:46.458678+0000","last_unstale":"2024-09-13T17:07:46.814018+0000","last_undegraded":"2024-09-13T17:07:46.814018+0000","last_fullsized":"2024-09-13T17:07:46.814018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:13.965041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808768+0000","last_change":"2024-09-13T17:07:46.808768+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808768+0000","last_undegraded":"2024-09-13T17:07:46.808768+0000","last_fullsized":"2024-09-13T17:07:46.808768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820618+0000","last_change":"2024-09-13T17:07:46.464282+0000","last_active":"2024-09-13T17:07:46.820618+0000","last_peered":"2024-09-13T17:07:46.820618+0000","last_clean":"2024-09-13T17:07:46.820618+0000","last_became_active":"2024-09-13T17:07:46.463984+0000","last_became_peered":"2024-09-13T17:07:46.463984+0000","last_unstale":"2024-09-13T17:07:46.820618+0000","last_undegraded":"2024-09-13T17:07:46.820618+0000","last_fullsized":"2024-09-13T17:07:46.820618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:41.634119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":4,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.819042+0000","last_change":"2024-09-13T17:07:46.814192+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.819042+0000","last_undegraded":"2024-09-13T17:07:46.819042+0000","last_fullsized":"2024-09-13T17:07:46.819042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:32.097160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.814648+0000","last_change":"2024-09-13T17:07:46.458932+0000","last_active":"2024-09-13T17:07:46.814648+0000","last_peered":"2024-09-13T17:07:46.814648+0000","last_clean":"2024-09-13T17:07:46.814648+0000","last_became_active":"2024-09-13T17:07:46.458642+0000","last_became_peered":"2024-09-13T17:07:46.458642+0000","last_unstale":"2024-09-13T17:07:46.814648+0000","last_undegraded":"2024-09-13T17:07:46.814648+0000","last_fullsized":"2024-09-13T17:07:46.814648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:35.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.814124+0000","last_change":"2024-09-13T17:07:46.814124+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.814124+0000","last_undegraded":"2024-09-13T17:07:46.814124+0000","last_fullsized":"2024-09-13T17:07:46.814124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:26.636631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.806555+0000","last_change":"2024-09-13T17:07:46.460097+0000","last_active":"2024-09-13T17:07:46.806555+0000","last_peered":"2024-09-13T17:07:46.806555+0000","last_clean":"2024-09-13T17:07:46.806555+0000","last_became_active":"2024-09-13T17:07:46.459833+0000","last_became_peered":"2024-09-13T17:07:46.459833+0000","last_unstale":"2024-09-13T17:07:46.806555+0000","last_undegraded":"2024-09-13T17:07:46.806555+0000","last_fullsized":"2024-09-13T17:07:46.806555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:06.069380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":4,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.819701+0000","last_change":"2024-09-13T17:07:46.814919+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.819701+0000","last_undegraded":"2024-09-13T17:07:46.819701+0000","last_fullsized":"2024-09-13T17:07:46.819701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:07.079254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818652+0000","last_change":"2024-09-13T17:07:46.460821+0000","last_active":"2024-09-13T17:07:46.818652+0000","last_peered":"2024-09-13T17:07:46.818652+0000","last_clean":"2024-09-13T17:07:46.818652+0000","last_became_active":"2024-09-13T17:07:46.460540+0000","last_became_peered":"2024-09-13T17:07:46.460540+0000","last_unstale":"2024-09-13T17:07:46.818652+0000","last_undegraded":"2024-09-13T17:07:46.818652+0000","last_fullsized":"2024-09-13T17:07:46.818652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:35.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":4,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.817655+0000","last_change":"2024-09-13T17:07:46.813515+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.817655+0000","last_undegraded":"2024-09-13T17:07:46.817655+0000","last_fullsized":"2024-09-13T17:07:46.817655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:33.883750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812803+0000","last_change":"2024-09-13T17:07:46.463183+0000","last_active":"2024-09-13T17:07:46.812803+0000","last_peered":"2024-09-13T17:07:46.812803+0000","last_clean":"2024-09-13T17:07:46.812803+0000","last_became_active":"2024-09-13T17:07:46.462872+0000","last_became_peered":"2024-09-13T17:07:46.462872+0000","last_unstale":"2024-09-13T17:07:46.812803+0000","last_undegraded":"2024-09-13T17:07:46.812803+0000","last_fullsized":"2024-09-13T17:07:46.812803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807398+0000","last_change":"2024-09-13T17:07:46.807398+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807398+0000","last_undegraded":"2024-09-13T17:07:46.807398+0000","last_fullsized":"2024-09-13T17:07:46.807398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.816280+0000","last_change":"2024-09-13T17:07:46.461826+0000","last_active":"2024-09-13T17:07:46.816280+0000","last_peered":"2024-09-13T17:07:46.816280+0000","last_clean":"2024-09-13T17:07:46.816280+0000","last_became_active":"2024-09-13T17:07:46.461348+0000","last_became_peered":"2024-09-13T17:07:46.461348+0000","last_unstale":"2024-09-13T17:07:46.816280+0000","last_undegraded":"2024-09-13T17:07:46.816280+0000","last_fullsized":"2024-09-13T17:07:46.816280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:25.626757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.814196+0000","last_change":"2024-09-13T17:07:46.814196+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.814196+0000","last_undegraded":"2024-09-13T17:07:46.814196+0000","last_fullsized":"2024-09-13T17:07:46.814196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:37.347764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.807359+0000","last_change":"2024-09-13T17:07:46.466282+0000","last_active":"2024-09-13T17:07:46.807359+0000","last_peered":"2024-09-13T17:07:46.807359+0000","last_clean":"2024-09-13T17:07:46.807359+0000","last_became_active":"2024-09-13T17:07:46.466008+0000","last_became_peered":"2024-09-13T17:07:46.466008+0000","last_unstale":"2024-09-13T17:07:46.807359+0000","last_undegraded":"2024-09-13T17:07:46.807359+0000","last_fullsized":"2024-09-13T17:07:46.807359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:57.898224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821732+0000","last_change":"2024-09-13T17:07:46.821732+0000","last_active":"2024-09-13T17:07:46.821732+0000","last_peered":"2024-09-13T17:07:46.821732+0000","last_clean":"2024-09-13T17:07:46.821732+0000","last_became_active":"2024-09-13T17:07:46.821507+0000","last_became_peered":"2024-09-13T17:07:46.821507+0000","last_unstale":"2024-09-13T17:07:46.821732+0000","last_undegraded":"2024-09-13T17:07:46.821732+0000","last_fullsized":"2024-09-13T17:07:46.821732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.805993+0000","last_change":"2024-09-13T17:07:46.459158+0000","last_active":"2024-09-13T17:07:46.805993+0000","last_peered":"2024-09-13T17:07:46.805993+0000","last_clean":"2024-09-13T17:07:46.805993+0000","last_became_active":"2024-09-13T17:07:46.458901+0000","last_became_peered":"2024-09-13T17:07:46.458901+0000","last_unstale":"2024-09-13T17:07:46.805993+0000","last_undegraded":"2024-09-13T17:07:46.805993+0000","last_fullsized":"2024-09-13T17:07:46.805993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:53.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811930+0000","last_change":"2024-09-13T17:07:46.811040+0000","last_active":"2024-09-13T17:07:46.811930+0000","last_peered":"2024-09-13T17:07:46.811930+0000","last_clean":"2024-09-13T17:07:46.811930+0000","last_became_active":"2024-09-13T17:07:46.810738+0000","last_became_peered":"2024-09-13T17:07:46.810738+0000","last_unstale":"2024-09-13T17:07:46.811930+0000","last_undegraded":"2024-09-13T17:07:46.811930+0000","last_fullsized":"2024-09-13T17:07:46.811930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:40.468817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.809276+0000","last_change":"2024-09-13T17:07:46.469077+0000","last_active":"2024-09-13T17:07:46.809276+0000","last_peered":"2024-09-13T17:07:46.809276+0000","last_clean":"2024-09-13T17:07:46.809276+0000","last_became_active":"2024-09-13T17:07:46.468808+0000","last_became_peered":"2024-09-13T17:07:46.468808+0000","last_unstale":"2024-09-13T17:07:46.809276+0000","last_undegraded":"2024-09-13T17:07:46.809276+0000","last_fullsized":"2024-09-13T17:07:46.809276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:55.638425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821584+0000","last_change":"2024-09-13T17:07:46.820219+0000","last_active":"2024-09-13T17:07:46.821584+0000","last_peered":"2024-09-13T17:07:46.821584+0000","last_clean":"2024-09-13T17:07:46.821584+0000","last_became_active":"2024-09-13T17:07:46.819114+0000","last_became_peered":"2024-09-13T17:07:46.819114+0000","last_unstale":"2024-09-13T17:07:46.821584+0000","last_undegraded":"2024-09-13T17:07:46.821584+0000","last_fullsized":"2024-09-13T17:07:46.821584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.806777+0000","last_change":"2024-09-13T17:07:46.462465+0000","last_active":"2024-09-13T17:07:46.806777+0000","last_peered":"2024-09-13T17:07:46.806777+0000","last_clean":"2024-09-13T17:07:46.806777+0000","last_became_active":"2024-09-13T17:07:46.462216+0000","last_became_peered":"2024-09-13T17:07:46.462216+0000","last_unstale":"2024-09-13T17:07:46.806777+0000","last_undegraded":"2024-09-13T17:07:46.806777+0000","last_fullsized":"2024-09-13T17:07:46.806777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:11.941516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822778+0000","last_change":"2024-09-13T17:07:46.822778+0000","last_active":"2024-09-13T17:07:46.822778+0000","last_peered":"2024-09-13T17:07:46.822778+0000","last_clean":"2024-09-13T17:07:46.822778+0000","last_became_active":"2024-09-13T17:07:46.822504+0000","last_became_peered":"2024-09-13T17:07:46.822504+0000","last_unstale":"2024-09-13T17:07:46.822778+0000","last_undegraded":"2024-09-13T17:07:46.822778+0000","last_fullsized":"2024-09-13T17:07:46.822778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:50.541570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.807707+0000","last_change":"2024-09-13T17:07:46.466175+0000","last_active":"2024-09-13T17:07:46.807707+0000","last_peered":"2024-09-13T17:07:46.807707+0000","last_clean":"2024-09-13T17:07:46.807707+0000","last_became_active":"2024-09-13T17:07:46.465896+0000","last_became_peered":"2024-09-13T17:07:46.465896+0000","last_unstale":"2024-09-13T17:07:46.807707+0000","last_undegraded":"2024-09-13T17:07:46.807707+0000","last_fullsized":"2024-09-13T17:07:46.807707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:36.337890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820250+0000","last_change":"2024-09-13T17:07:46.820250+0000","last_active":"2024-09-13T17:07:46.820250+0000","last_peered":"2024-09-13T17:07:46.820250+0000","last_clean":"2024-09-13T17:07:46.820250+0000","last_became_active":"2024-09-13T17:07:46.820005+0000","last_became_peered":"2024-09-13T17:07:46.820005+0000","last_unstale":"2024-09-13T17:07:46.820250+0000","last_undegraded":"2024-09-13T17:07:46.820250+0000","last_fullsized":"2024-09-13T17:07:46.820250+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812911+0000","last_change":"2024-09-13T17:07:46.463288+0000","last_active":"2024-09-13T17:07:46.812911+0000","last_peered":"2024-09-13T17:07:46.812911+0000","last_clean":"2024-09-13T17:07:46.812911+0000","last_became_active":"2024-09-13T17:07:46.462965+0000","last_became_peered":"2024-09-13T17:07:46.462965+0000","last_unstale":"2024-09-13T17:07:46.812911+0000","last_undegraded":"2024-09-13T17:07:46.812911+0000","last_fullsized":"2024-09-13T17:07:46.812911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:59.219013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825815+0000","last_change":"2024-09-13T17:07:46.825815+0000","last_active":"2024-09-13T17:07:46.825815+0000","last_peered":"2024-09-13T17:07:46.825815+0000","last_clean":"2024-09-13T17:07:46.825815+0000","last_became_active":"2024-09-13T17:07:46.825560+0000","last_became_peered":"2024-09-13T17:07:46.825560+0000","last_unstale":"2024-09-13T17:07:46.825815+0000","last_undegraded":"2024-09-13T17:07:46.825815+0000","last_fullsized":"2024-09-13T17:07:46.825815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:40.468817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811434+0000","last_change":"2024-09-13T17:07:46.463686+0000","last_active":"2024-09-13T17:07:46.811434+0000","last_peered":"2024-09-13T17:07:46.811434+0000","last_clean":"2024-09-13T17:07:46.811434+0000","last_became_active":"2024-09-13T17:07:46.463437+0000","last_became_peered":"2024-09-13T17:07:46.463437+0000","last_unstale":"2024-09-13T17:07:46.811434+0000","last_undegraded":"2024-09-13T17:07:46.811434+0000","last_fullsized":"2024-09-13T17:07:46.811434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:53.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-09-13T17:07:46.821323+0000","last_change":"2024-09-13T17:07:46.821260+0000","last_active":"2024-09-13T17:07:46.821323+0000","last_peered":"2024-09-13T17:07:46.821323+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"2024-09-13T17:07:46.821260+0000","last_became_peered":"2024-09-13T17:07:46.821260+0000","last_unstale":"2024-09-13T17:07:46.821323+0000","last_undegraded":"2024-09-13T17:07:46.821323+0000","last_fullsized":"2024-09-13T17:07:46.821323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:36.033290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818687+0000","last_change":"2024-09-13T17:07:46.464490+0000","last_active":"2024-09-13T17:07:46.818687+0000","last_peered":"2024-09-13T17:07:46.818687+0000","last_clean":"2024-09-13T17:07:46.818687+0000","last_became_active":"2024-09-13T17:07:46.464175+0000","last_became_peered":"2024-09-13T17:07:46.464175+0000","last_unstale":"2024-09-13T17:07:46.818687+0000","last_undegraded":"2024-09-13T17:07:46.818687+0000","last_fullsized":"2024-09-13T17:07:46.818687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:50.939498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.453001+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:07:46.453001+0000","last_peered":"2024-09-13T17:07:46.453001+0000","last_clean":"2024-09-13T17:07:46.453001+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:07:46.453001+0000","last_undegraded":"2024-09-13T17:07:46.453001+0000","last_fullsized":"2024-09-13T17:07:46.453001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.032}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.83599999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.89500000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.054}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.006}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.86699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.72699999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.026}]},{"osd":4,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.754}]},{"osd":5,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.008}]},{"osd":7,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.073}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.89000000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.0249999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.91600000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.98199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.002},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.0940000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.0189999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.98399999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.0469999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":1.0700000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.127}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.1080000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.202},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.2270000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.626},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.77300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.83299999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.875},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.81100000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.91500000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.028}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.92700000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.84999999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.89800000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.0589999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.995}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.434}]},{"osd":3,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.999},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.79700000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.876},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.95799999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.83099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":729180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.25,"5min":3.25,"15min":3.25},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.80900000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.5590000000000002,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":6.4089999999999998,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.7060000000000004,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":6.2729999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.746}]},{"osd":4,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":5.3019999999999996,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.9039999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":0.86499999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":4.2599999999999998,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.018},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.105}]},{"osd":7,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":5.7510000000000003,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:07:49.857 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:07:49.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.969+0000 7fd69ea9b700 1 Processor -- start 2024-09-13T17:07:49.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.969+0000 7fd69ea9b700 1 -- start start 2024-09-13T17:07:49.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.969+0000 7fd69ea9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd69815e0d0 0x7fd6980cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.969+0000 7fd69ea9b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69815ab30 0x7fd6980cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69ea9b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6981542e0 con 0x7fd698153f00 2024-09-13T17:07:49.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69ea9b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6980ced30 con 0x7fd69815e0d0 2024-09-13T17:07:49.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69ea9b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd698159df0 con 0x7fd69815ab30 2024-09-13T17:07:49.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69d298700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd69815e0d0 0x7fd6980cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69d298700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd69815e0d0 0x7fd6980cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44378/0 (socket says 172.21.15.123:44378) 2024-09-13T17:07:49.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69d298700 1 -- 172.21.15.123:0/3082962374 learned_addr learned my addr 172.21.15.123:0/3082962374 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:49.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69da99700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd698153f00 0x7fd6980ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41822/0 (socket says 172.21.15.123:41822) 2024-09-13T17:07:49.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69e29a700 1 --2- 172.21.15.123:0/3082962374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69815ab30 0x7fd6980cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69d298700 1 -- 172.21.15.123:0/3082962374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69815ab30 msgr2=0x7fd6980cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:49.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69d298700 1 --2- 172.21.15.123:0/3082962374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69815ab30 0x7fd6980cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69d298700 1 -- 172.21.15.123:0/3082962374 >> v1:172.21.15.123:6789/0 conn(0x7fd698153f00 legacy=0x7fd6980ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69d298700 1 -- 172.21.15.123:0/3082962374 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6980ce7f0 con 0x7fd69815e0d0 2024-09-13T17:07:49.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69e29a700 1 --2- 172.21.15.123:0/3082962374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69815ab30 0x7fd6980cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:49.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69d298700 1 --2- 172.21.15.123:0/3082962374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69815e0d0 0x7fd6980cc220 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009910 tx=0x7fd68c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9881bd4e7cec0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69ca97700 1 -- 172.21.15.123:0/3082962374 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00ba60 con 0x7fd69815e0d0 2024-09-13T17:07:49.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69ca97700 1 -- 172.21.15.123:0/3082962374 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c00bbc0 con 0x7fd69815e0d0 2024-09-13T17:07:49.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69ca97700 1 -- 172.21.15.123:0/3082962374 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c009e60 con 0x7fd69815e0d0 2024-09-13T17:07:49.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3082962374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69815e0d0 msgr2=0x7fd6980cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69ea9b700 1 --2- 172.21.15.123:0/3082962374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69815e0d0 0x7fd6980cc220 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009910 tx=0x7fd68c009c20 comp rx=0 tx=0).stop 2024-09-13T17:07:49.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3082962374 shutdown_connections 2024-09-13T17:07:49.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69ea9b700 1 --2- 172.21.15.123:0/3082962374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69815ab30 0x7fd6980cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69ea9b700 1 --2- 172.21.15.123:0/3082962374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69815e0d0 0x7fd6980cc220 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3082962374 >> 172.21.15.123:0/3082962374 conn(0x7fd698066780 msgr2=0x7fd6980719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:49.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3082962374 shutdown_connections 2024-09-13T17:07:49.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.973+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3082962374 wait complete. 2024-09-13T17:07:49.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69ea9b700 1 Processor -- start 2024-09-13T17:07:49.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69ea9b700 1 -- start start 2024-09-13T17:07:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69ea9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd698153f00 0x7fd698147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69ea9b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69815ab30 0x7fd698151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69ea9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69815e0d0 0x7fd69815c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69ea9b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd698151050 con 0x7fd69815e0d0 2024-09-13T17:07:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69ea9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6981f3de0 con 0x7fd698153f00 2024-09-13T17:07:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69ea9b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6981503d0 con 0x7fd69815ab30 2024-09-13T17:07:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69e29a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69815e0d0 0x7fd69815c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69e29a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69815e0d0 0x7fd69815c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44392/0 (socket says 172.21.15.123:44392) 2024-09-13T17:07:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69e29a700 1 -- 172.21.15.123:0/3505116966 learned_addr learned my addr 172.21.15.123:0/3505116966 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69da99700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd698153f00 0x7fd698147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69d298700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69815ab30 0x7fd698151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69e29a700 1 -- 172.21.15.123:0/3505116966 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69815ab30 msgr2=0x7fd698151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69e29a700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69815ab30 0x7fd698151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69e29a700 1 -- 172.21.15.123:0/3505116966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd698153f00 msgr2=0x7fd698147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:49.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69e29a700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd698153f00 0x7fd698147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:49.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69e29a700 1 -- 172.21.15.123:0/3505116966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c009570 con 0x7fd69815e0d0 2024-09-13T17:07:49.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69da99700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd698153f00 0x7fd698147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:49.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69e29a700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69815e0d0 0x7fd69815c0f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd69000c7f0 tx=0x7fd69000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd6967fc700 1 -- 172.21.15.123:0/3505116966 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690004220 con 0x7fd69815e0d0 2024-09-13T17:07:49.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd6967fc700 1 -- 172.21.15.123:0/3505116966 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd690004380 con 0x7fd69815e0d0 2024-09-13T17:07:49.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd6967fc700 1 -- 172.21.15.123:0/3505116966 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6900036c0 con 0x7fd69815e0d0 2024-09-13T17:07:49.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3505116966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6981506b0 con 0x7fd69815e0d0 2024-09-13T17:07:49.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.977+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3505116966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd698150c70 con 0x7fd69815e0d0 2024-09-13T17:07:49.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.981+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3505116966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6980ce0e0 con 0x7fd69815e0d0 2024-09-13T17:07:49.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.981+0000 7fd6967fc700 1 -- 172.21.15.123:0/3505116966 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd690003820 con 0x7fd69815e0d0 2024-09-13T17:07:49.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.981+0000 7fd6967fc700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd684066730 0x7fd684068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:49.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.981+0000 7fd69da99700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd684066730 0x7fd684068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:49.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.981+0000 7fd6967fc700 1 -- 172.21.15.123:0/3505116966 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd690083dd0 con 0x7fd69815e0d0 2024-09-13T17:07:49.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.985+0000 7fd69da99700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd684066730 0x7fd684068bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd6880012e0 tx=0x7fd688009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:49.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:49.989+0000 7fd6967fc700 1 -- 172.21.15.123:0/3505116966 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd690051150 con 0x7fd69815e0d0 2024-09-13T17:07:50.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.153+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3505116966 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd69815a330 con 0x7fd684066730 2024-09-13T17:07:50.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.165+0000 7fd6967fc700 1 -- 172.21.15.123:0/3505116966 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286895 (secure 0 0 0) 0x7fd688001cb0 con 0x7fd684066730 2024-09-13T17:07:50.171 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:50.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.173+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3505116966 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd684066730 msgr2=0x7fd684068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.173+0000 7fd69ea9b700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd684066730 0x7fd684068bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd6880012e0 tx=0x7fd688009040 comp rx=0 tx=0).stop 2024-09-13T17:07:50.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.173+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3505116966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69815e0d0 msgr2=0x7fd69815c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.173+0000 7fd69ea9b700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69815e0d0 0x7fd69815c0f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd69000c7f0 tx=0x7fd69000cbb0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.173+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3505116966 shutdown_connections 2024-09-13T17:07:50.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.173+0000 7fd69ea9b700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd684066730 0x7fd684068bf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.173+0000 7fd69ea9b700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69815e0d0 0x7fd69815c0f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.173+0000 7fd69ea9b700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd69815ab30 0x7fd698151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.173+0000 7fd69ea9b700 1 --2- 172.21.15.123:0/3505116966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd698153f00 0x7fd698147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.173+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3505116966 >> 172.21.15.123:0/3505116966 conn(0x7fd698066780 msgr2=0x7fd6980cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:50.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.173+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3505116966 shutdown_connections 2024-09-13T17:07:50.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.173+0000 7fd69ea9b700 1 -- 172.21.15.123:0/3505116966 wait complete. 2024-09-13T17:07:50.177 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:07:50.188 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-13T17:07:48.754491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220068,"kb_used_data":3904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754652,"statfs":{"total":773094113280,"available":772868763648,"internally_reserved":0,"allocated":3997696,"data_stored":2253630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001092"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825404+0000","last_change":"2024-09-13T17:07:46.825404+0000","last_active":"2024-09-13T17:07:46.825404+0000","last_peered":"2024-09-13T17:07:46.825404+0000","last_clean":"2024-09-13T17:07:46.825404+0000","last_became_active":"2024-09-13T17:07:46.825157+0000","last_became_peered":"2024-09-13T17:07:46.825157+0000","last_unstale":"2024-09-13T17:07:46.825404+0000","last_undegraded":"2024-09-13T17:07:46.825404+0000","last_fullsized":"2024-09-13T17:07:46.825404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:08.819755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821865+0000","last_change":"2024-09-13T17:07:46.821865+0000","last_active":"2024-09-13T17:07:46.821865+0000","last_peered":"2024-09-13T17:07:46.821865+0000","last_clean":"2024-09-13T17:07:46.821865+0000","last_became_active":"2024-09-13T17:07:46.821335+0000","last_became_peered":"2024-09-13T17:07:46.821335+0000","last_unstale":"2024-09-13T17:07:46.821865+0000","last_undegraded":"2024-09-13T17:07:46.821865+0000","last_fullsized":"2024-09-13T17:07:46.821865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:19.871674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821251+0000","last_change":"2024-09-13T17:07:46.821251+0000","last_active":"2024-09-13T17:07:46.821251+0000","last_peered":"2024-09-13T17:07:46.821251+0000","last_clean":"2024-09-13T17:07:46.821251+0000","last_became_active":"2024-09-13T17:07:46.820956+0000","last_became_peered":"2024-09-13T17:07:46.820956+0000","last_unstale":"2024-09-13T17:07:46.821251+0000","last_undegraded":"2024-09-13T17:07:46.821251+0000","last_fullsized":"2024-09-13T17:07:46.821251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807336+0000","last_change":"2024-09-13T17:07:46.807336+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807336+0000","last_undegraded":"2024-09-13T17:07:46.807336+0000","last_fullsized":"2024-09-13T17:07:46.807336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.815482+0000","last_change":"2024-09-13T17:07:46.815482+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.815482+0000","last_undegraded":"2024-09-13T17:07:46.815482+0000","last_fullsized":"2024-09-13T17:07:46.815482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.812028+0000","last_change":"2024-09-13T17:07:46.812028+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.812028+0000","last_undegraded":"2024-09-13T17:07:46.812028+0000","last_fullsized":"2024-09-13T17:07:46.812028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807911+0000","last_change":"2024-09-13T17:07:46.807911+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807911+0000","last_undegraded":"2024-09-13T17:07:46.807911+0000","last_fullsized":"2024-09-13T17:07:46.807911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808191+0000","last_change":"2024-09-13T17:07:46.808191+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808191+0000","last_undegraded":"2024-09-13T17:07:46.808191+0000","last_fullsized":"2024-09-13T17:07:46.808191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:34.528334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.826617+0000","last_change":"2024-09-13T17:07:46.826617+0000","last_active":"2024-09-13T17:07:46.826617+0000","last_peered":"2024-09-13T17:07:46.826617+0000","last_clean":"2024-09-13T17:07:46.826617+0000","last_became_active":"2024-09-13T17:07:46.826339+0000","last_became_peered":"2024-09-13T17:07:46.826339+0000","last_unstale":"2024-09-13T17:07:46.826617+0000","last_undegraded":"2024-09-13T17:07:46.826617+0000","last_fullsized":"2024-09-13T17:07:46.826617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:27.800734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815960+0000","last_change":"2024-09-13T17:07:46.815960+0000","last_active":"2024-09-13T17:07:46.815960+0000","last_peered":"2024-09-13T17:07:46.815960+0000","last_clean":"2024-09-13T17:07:46.815960+0000","last_became_active":"2024-09-13T17:07:46.815778+0000","last_became_peered":"2024-09-13T17:07:46.815778+0000","last_unstale":"2024-09-13T17:07:46.815960+0000","last_undegraded":"2024-09-13T17:07:46.815960+0000","last_fullsized":"2024-09-13T17:07:46.815960+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.813819+0000","last_change":"2024-09-13T17:07:46.812036+0000","last_active":"2024-09-13T17:07:46.813819+0000","last_peered":"2024-09-13T17:07:46.813819+0000","last_clean":"2024-09-13T17:07:46.813819+0000","last_became_active":"2024-09-13T17:07:46.811777+0000","last_became_peered":"2024-09-13T17:07:46.811777+0000","last_unstale":"2024-09-13T17:07:46.813819+0000","last_undegraded":"2024-09-13T17:07:46.813819+0000","last_fullsized":"2024-09-13T17:07:46.813819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824951+0000","last_change":"2024-09-13T17:07:46.824951+0000","last_active":"2024-09-13T17:07:46.824951+0000","last_peered":"2024-09-13T17:07:46.824951+0000","last_clean":"2024-09-13T17:07:46.824951+0000","last_became_active":"2024-09-13T17:07:46.824657+0000","last_became_peered":"2024-09-13T17:07:46.824657+0000","last_unstale":"2024-09-13T17:07:46.824951+0000","last_undegraded":"2024-09-13T17:07:46.824951+0000","last_fullsized":"2024-09-13T17:07:46.824951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:19.871674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.819466+0000","last_change":"2024-09-13T17:07:46.819466+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.819466+0000","last_undegraded":"2024-09-13T17:07:46.819466+0000","last_fullsized":"2024-09-13T17:07:46.819466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:12.951389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824808+0000","last_change":"2024-09-13T17:07:46.824808+0000","last_active":"2024-09-13T17:07:46.824808+0000","last_peered":"2024-09-13T17:07:46.824808+0000","last_clean":"2024-09-13T17:07:46.824808+0000","last_became_active":"2024-09-13T17:07:46.824588+0000","last_became_peered":"2024-09-13T17:07:46.824588+0000","last_unstale":"2024-09-13T17:07:46.824808+0000","last_undegraded":"2024-09-13T17:07:46.824808+0000","last_fullsized":"2024-09-13T17:07:46.824808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824436+0000","last_change":"2024-09-13T17:07:46.824436+0000","last_active":"2024-09-13T17:07:46.824436+0000","last_peered":"2024-09-13T17:07:46.824436+0000","last_clean":"2024-09-13T17:07:46.824436+0000","last_became_active":"2024-09-13T17:07:46.822126+0000","last_became_peered":"2024-09-13T17:07:46.822126+0000","last_unstale":"2024-09-13T17:07:46.824436+0000","last_undegraded":"2024-09-13T17:07:46.824436+0000","last_fullsized":"2024-09-13T17:07:46.824436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:26.583203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.817868+0000","last_change":"2024-09-13T17:07:46.814681+0000","last_active":"2024-09-13T17:07:46.817868+0000","last_peered":"2024-09-13T17:07:46.817868+0000","last_clean":"2024-09-13T17:07:46.817868+0000","last_became_active":"2024-09-13T17:07:46.814398+0000","last_became_peered":"2024-09-13T17:07:46.814398+0000","last_unstale":"2024-09-13T17:07:46.817868+0000","last_undegraded":"2024-09-13T17:07:46.817868+0000","last_fullsized":"2024-09-13T17:07:46.817868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807614+0000","last_change":"2024-09-13T17:07:46.807614+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807614+0000","last_undegraded":"2024-09-13T17:07:46.807614+0000","last_fullsized":"2024-09-13T17:07:46.807614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824754+0000","last_change":"2024-09-13T17:07:46.824754+0000","last_active":"2024-09-13T17:07:46.824754+0000","last_peered":"2024-09-13T17:07:46.824754+0000","last_clean":"2024-09-13T17:07:46.824754+0000","last_became_active":"2024-09-13T17:07:46.824491+0000","last_became_peered":"2024-09-13T17:07:46.824491+0000","last_unstale":"2024-09-13T17:07:46.824754+0000","last_undegraded":"2024-09-13T17:07:46.824754+0000","last_fullsized":"2024-09-13T17:07:46.824754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822199+0000","last_change":"2024-09-13T17:07:46.822199+0000","last_active":"2024-09-13T17:07:46.822199+0000","last_peered":"2024-09-13T17:07:46.822199+0000","last_clean":"2024-09-13T17:07:46.822199+0000","last_became_active":"2024-09-13T17:07:46.821039+0000","last_became_peered":"2024-09-13T17:07:46.821039+0000","last_unstale":"2024-09-13T17:07:46.822199+0000","last_undegraded":"2024-09-13T17:07:46.822199+0000","last_fullsized":"2024-09-13T17:07:46.822199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.815297+0000","last_change":"2024-09-13T17:07:46.815297+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.815297+0000","last_undegraded":"2024-09-13T17:07:46.815297+0000","last_fullsized":"2024-09-13T17:07:46.815297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:56.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824875+0000","last_change":"2024-09-13T17:07:46.824875+0000","last_active":"2024-09-13T17:07:46.824875+0000","last_peered":"2024-09-13T17:07:46.824875+0000","last_clean":"2024-09-13T17:07:46.824875+0000","last_became_active":"2024-09-13T17:07:46.819999+0000","last_became_peered":"2024-09-13T17:07:46.819999+0000","last_unstale":"2024-09-13T17:07:46.824875+0000","last_undegraded":"2024-09-13T17:07:46.824875+0000","last_fullsized":"2024-09-13T17:07:46.824875+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:20.464724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824665+0000","last_change":"2024-09-13T17:07:46.824665+0000","last_active":"2024-09-13T17:07:46.824665+0000","last_peered":"2024-09-13T17:07:46.824665+0000","last_clean":"2024-09-13T17:07:46.824665+0000","last_became_active":"2024-09-13T17:07:46.820399+0000","last_became_peered":"2024-09-13T17:07:46.820399+0000","last_unstale":"2024-09-13T17:07:46.824665+0000","last_undegraded":"2024-09-13T17:07:46.824665+0000","last_fullsized":"2024-09-13T17:07:46.824665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:50.541570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815664+0000","last_change":"2024-09-13T17:07:46.811674+0000","last_active":"2024-09-13T17:07:46.815664+0000","last_peered":"2024-09-13T17:07:46.815664+0000","last_clean":"2024-09-13T17:07:46.815664+0000","last_became_active":"2024-09-13T17:07:46.811449+0000","last_became_peered":"2024-09-13T17:07:46.811449+0000","last_unstale":"2024-09-13T17:07:46.815664+0000","last_undegraded":"2024-09-13T17:07:46.815664+0000","last_fullsized":"2024-09-13T17:07:46.815664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:20.464724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.812767+0000","last_change":"2024-09-13T17:07:46.812767+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.812767+0000","last_undegraded":"2024-09-13T17:07:46.812767+0000","last_fullsized":"2024-09-13T17:07:46.812767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818395+0000","last_change":"2024-09-13T17:07:46.818395+0000","last_active":"2024-09-13T17:07:46.818395+0000","last_peered":"2024-09-13T17:07:46.818395+0000","last_clean":"2024-09-13T17:07:46.818395+0000","last_became_active":"2024-09-13T17:07:46.817022+0000","last_became_peered":"2024-09-13T17:07:46.817022+0000","last_unstale":"2024-09-13T17:07:46.818395+0000","last_undegraded":"2024-09-13T17:07:46.818395+0000","last_fullsized":"2024-09-13T17:07:46.818395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822031+0000","last_change":"2024-09-13T17:07:46.822031+0000","last_active":"2024-09-13T17:07:46.822031+0000","last_peered":"2024-09-13T17:07:46.822031+0000","last_clean":"2024-09-13T17:07:46.822031+0000","last_became_active":"2024-09-13T17:07:46.821647+0000","last_became_peered":"2024-09-13T17:07:46.821647+0000","last_unstale":"2024-09-13T17:07:46.822031+0000","last_undegraded":"2024-09-13T17:07:46.822031+0000","last_fullsized":"2024-09-13T17:07:46.822031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807893+0000","last_change":"2024-09-13T17:07:46.807893+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807893+0000","last_undegraded":"2024-09-13T17:07:46.807893+0000","last_fullsized":"2024-09-13T17:07:46.807893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820791+0000","last_change":"2024-09-13T17:07:46.820791+0000","last_active":"2024-09-13T17:07:46.820791+0000","last_peered":"2024-09-13T17:07:46.820791+0000","last_clean":"2024-09-13T17:07:46.820791+0000","last_became_active":"2024-09-13T17:07:46.820457+0000","last_became_peered":"2024-09-13T17:07:46.820457+0000","last_unstale":"2024-09-13T17:07:46.820791+0000","last_undegraded":"2024-09-13T17:07:46.820791+0000","last_fullsized":"2024-09-13T17:07:46.820791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825418+0000","last_change":"2024-09-13T17:07:46.825418+0000","last_active":"2024-09-13T17:07:46.825418+0000","last_peered":"2024-09-13T17:07:46.825418+0000","last_clean":"2024-09-13T17:07:46.825418+0000","last_became_active":"2024-09-13T17:07:46.825165+0000","last_became_peered":"2024-09-13T17:07:46.825165+0000","last_unstale":"2024-09-13T17:07:46.825418+0000","last_undegraded":"2024-09-13T17:07:46.825418+0000","last_fullsized":"2024-09-13T17:07:46.825418+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:58.908098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.819149+0000","last_change":"2024-09-13T17:07:46.819149+0000","last_active":"2024-09-13T17:07:46.819149+0000","last_peered":"2024-09-13T17:07:46.819149+0000","last_clean":"2024-09-13T17:07:46.819149+0000","last_became_active":"2024-09-13T17:07:46.818880+0000","last_became_peered":"2024-09-13T17:07:46.818880+0000","last_unstale":"2024-09-13T17:07:46.819149+0000","last_undegraded":"2024-09-13T17:07:46.819149+0000","last_fullsized":"2024-09-13T17:07:46.819149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824186+0000","last_change":"2024-09-13T17:07:46.824186+0000","last_active":"2024-09-13T17:07:46.824186+0000","last_peered":"2024-09-13T17:07:46.824186+0000","last_clean":"2024-09-13T17:07:46.824186+0000","last_became_active":"2024-09-13T17:07:46.823935+0000","last_became_peered":"2024-09-13T17:07:46.823935+0000","last_unstale":"2024-09-13T17:07:46.824186+0000","last_undegraded":"2024-09-13T17:07:46.824186+0000","last_fullsized":"2024-09-13T17:07:46.824186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:58.908098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807784+0000","last_change":"2024-09-13T17:07:46.807784+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807784+0000","last_undegraded":"2024-09-13T17:07:46.807784+0000","last_fullsized":"2024-09-13T17:07:46.807784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815878+0000","last_change":"2024-09-13T17:07:46.812039+0000","last_active":"2024-09-13T17:07:46.815878+0000","last_peered":"2024-09-13T17:07:46.815878+0000","last_clean":"2024-09-13T17:07:46.815878+0000","last_became_active":"2024-09-13T17:07:46.811670+0000","last_became_peered":"2024-09-13T17:07:46.811670+0000","last_unstale":"2024-09-13T17:07:46.815878+0000","last_undegraded":"2024-09-13T17:07:46.815878+0000","last_fullsized":"2024-09-13T17:07:46.815878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:47.788741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818961+0000","last_change":"2024-09-13T17:07:46.462013+0000","last_active":"2024-09-13T17:07:46.818961+0000","last_peered":"2024-09-13T17:07:46.818961+0000","last_clean":"2024-09-13T17:07:46.818961+0000","last_became_active":"2024-09-13T17:07:46.461748+0000","last_became_peered":"2024-09-13T17:07:46.461748+0000","last_unstale":"2024-09-13T17:07:46.818961+0000","last_undegraded":"2024-09-13T17:07:46.818961+0000","last_fullsized":"2024-09-13T17:07:46.818961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.816525+0000","last_change":"2024-09-13T17:07:46.816525+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.816525+0000","last_undegraded":"2024-09-13T17:07:46.816525+0000","last_fullsized":"2024-09-13T17:07:46.816525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:56.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.805711+0000","last_change":"2024-09-13T17:07:46.460122+0000","last_active":"2024-09-13T17:07:46.805711+0000","last_peered":"2024-09-13T17:07:46.805711+0000","last_clean":"2024-09-13T17:07:46.805711+0000","last_became_active":"2024-09-13T17:07:46.459873+0000","last_became_peered":"2024-09-13T17:07:46.459873+0000","last_unstale":"2024-09-13T17:07:46.805711+0000","last_undegraded":"2024-09-13T17:07:46.805711+0000","last_fullsized":"2024-09-13T17:07:46.805711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:32.873876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824847+0000","last_change":"2024-09-13T17:07:46.824847+0000","last_active":"2024-09-13T17:07:46.824847+0000","last_peered":"2024-09-13T17:07:46.824847+0000","last_clean":"2024-09-13T17:07:46.824847+0000","last_became_active":"2024-09-13T17:07:46.820127+0000","last_became_peered":"2024-09-13T17:07:46.820127+0000","last_unstale":"2024-09-13T17:07:46.824847+0000","last_undegraded":"2024-09-13T17:07:46.824847+0000","last_fullsized":"2024-09-13T17:07:46.824847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:08.819755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812174+0000","last_change":"2024-09-13T17:07:46.460323+0000","last_active":"2024-09-13T17:07:46.812174+0000","last_peered":"2024-09-13T17:07:46.812174+0000","last_clean":"2024-09-13T17:07:46.812174+0000","last_became_active":"2024-09-13T17:07:46.459957+0000","last_became_peered":"2024-09-13T17:07:46.459957+0000","last_unstale":"2024-09-13T17:07:46.812174+0000","last_undegraded":"2024-09-13T17:07:46.812174+0000","last_fullsized":"2024-09-13T17:07:46.812174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:28.877530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.806382+0000","last_change":"2024-09-13T17:07:46.806382+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.806382+0000","last_undegraded":"2024-09-13T17:07:46.806382+0000","last_fullsized":"2024-09-13T17:07:46.806382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818133+0000","last_change":"2024-09-13T17:07:46.466176+0000","last_active":"2024-09-13T17:07:46.818133+0000","last_peered":"2024-09-13T17:07:46.818133+0000","last_clean":"2024-09-13T17:07:46.818133+0000","last_became_active":"2024-09-13T17:07:46.465971+0000","last_became_peered":"2024-09-13T17:07:46.465971+0000","last_unstale":"2024-09-13T17:07:46.818133+0000","last_undegraded":"2024-09-13T17:07:46.818133+0000","last_fullsized":"2024-09-13T17:07:46.818133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:16.394194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808020+0000","last_change":"2024-09-13T17:07:46.808020+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808020+0000","last_undegraded":"2024-09-13T17:07:46.808020+0000","last_fullsized":"2024-09-13T17:07:46.808020+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812955+0000","last_change":"2024-09-13T17:07:46.463243+0000","last_active":"2024-09-13T17:07:46.812955+0000","last_peered":"2024-09-13T17:07:46.812955+0000","last_clean":"2024-09-13T17:07:46.812955+0000","last_became_active":"2024-09-13T17:07:46.458515+0000","last_became_peered":"2024-09-13T17:07:46.458515+0000","last_unstale":"2024-09-13T17:07:46.812955+0000","last_undegraded":"2024-09-13T17:07:46.812955+0000","last_fullsized":"2024-09-13T17:07:46.812955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:50.939498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820780+0000","last_change":"2024-09-13T17:07:46.820780+0000","last_active":"2024-09-13T17:07:46.820780+0000","last_peered":"2024-09-13T17:07:46.820780+0000","last_clean":"2024-09-13T17:07:46.820780+0000","last_became_active":"2024-09-13T17:07:46.820475+0000","last_became_peered":"2024-09-13T17:07:46.820475+0000","last_unstale":"2024-09-13T17:07:46.820780+0000","last_undegraded":"2024-09-13T17:07:46.820780+0000","last_fullsized":"2024-09-13T17:07:46.820780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.827386+0000","last_change":"2024-09-13T17:07:46.458577+0000","last_active":"2024-09-13T17:07:46.827386+0000","last_peered":"2024-09-13T17:07:46.827386+0000","last_clean":"2024-09-13T17:07:46.827386+0000","last_became_active":"2024-09-13T17:07:46.458092+0000","last_became_peered":"2024-09-13T17:07:46.458092+0000","last_unstale":"2024-09-13T17:07:46.827386+0000","last_undegraded":"2024-09-13T17:07:46.827386+0000","last_fullsized":"2024-09-13T17:07:46.827386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:40.898298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825572+0000","last_change":"2024-09-13T17:07:46.825572+0000","last_active":"2024-09-13T17:07:46.825572+0000","last_peered":"2024-09-13T17:07:46.825572+0000","last_clean":"2024-09-13T17:07:46.825572+0000","last_became_active":"2024-09-13T17:07:46.825347+0000","last_became_peered":"2024-09-13T17:07:46.825347+0000","last_unstale":"2024-09-13T17:07:46.825572+0000","last_undegraded":"2024-09-13T17:07:46.825572+0000","last_fullsized":"2024-09-13T17:07:46.825572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811858+0000","last_change":"2024-09-13T17:07:46.468729+0000","last_active":"2024-09-13T17:07:46.811858+0000","last_peered":"2024-09-13T17:07:46.811858+0000","last_clean":"2024-09-13T17:07:46.811858+0000","last_became_active":"2024-09-13T17:07:46.468433+0000","last_became_peered":"2024-09-13T17:07:46.468433+0000","last_unstale":"2024-09-13T17:07:46.811858+0000","last_undegraded":"2024-09-13T17:07:46.811858+0000","last_fullsized":"2024-09-13T17:07:46.811858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:31.087286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.806606+0000","last_change":"2024-09-13T17:07:46.806606+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.806606+0000","last_undegraded":"2024-09-13T17:07:46.806606+0000","last_fullsized":"2024-09-13T17:07:46.806606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.819903+0000","last_change":"2024-09-13T17:07:46.459288+0000","last_active":"2024-09-13T17:07:46.819903+0000","last_peered":"2024-09-13T17:07:46.819903+0000","last_clean":"2024-09-13T17:07:46.819903+0000","last_became_active":"2024-09-13T17:07:46.459007+0000","last_became_peered":"2024-09-13T17:07:46.459007+0000","last_unstale":"2024-09-13T17:07:46.819903+0000","last_undegraded":"2024-09-13T17:07:46.819903+0000","last_fullsized":"2024-09-13T17:07:46.819903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:29.395885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.826627+0000","last_change":"2024-09-13T17:07:46.826627+0000","last_active":"2024-09-13T17:07:46.826627+0000","last_peered":"2024-09-13T17:07:46.826627+0000","last_clean":"2024-09-13T17:07:46.826627+0000","last_became_active":"2024-09-13T17:07:46.826393+0000","last_became_peered":"2024-09-13T17:07:46.826393+0000","last_unstale":"2024-09-13T17:07:46.826627+0000","last_undegraded":"2024-09-13T17:07:46.826627+0000","last_fullsized":"2024-09-13T17:07:46.826627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815309+0000","last_change":"2024-09-13T17:07:46.461106+0000","last_active":"2024-09-13T17:07:46.815309+0000","last_peered":"2024-09-13T17:07:46.815309+0000","last_clean":"2024-09-13T17:07:46.815309+0000","last_became_active":"2024-09-13T17:07:46.460874+0000","last_became_peered":"2024-09-13T17:07:46.460874+0000","last_unstale":"2024-09-13T17:07:46.815309+0000","last_undegraded":"2024-09-13T17:07:46.815309+0000","last_fullsized":"2024-09-13T17:07:46.815309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:32.873876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821371+0000","last_change":"2024-09-13T17:07:46.821371+0000","last_active":"2024-09-13T17:07:46.821371+0000","last_peered":"2024-09-13T17:07:46.821371+0000","last_clean":"2024-09-13T17:07:46.821371+0000","last_became_active":"2024-09-13T17:07:46.821128+0000","last_became_peered":"2024-09-13T17:07:46.821128+0000","last_unstale":"2024-09-13T17:07:46.821371+0000","last_undegraded":"2024-09-13T17:07:46.821371+0000","last_fullsized":"2024-09-13T17:07:46.821371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.805842+0000","last_change":"2024-09-13T17:07:46.463906+0000","last_active":"2024-09-13T17:07:46.805842+0000","last_peered":"2024-09-13T17:07:46.805842+0000","last_clean":"2024-09-13T17:07:46.805842+0000","last_became_active":"2024-09-13T17:07:46.463601+0000","last_became_peered":"2024-09-13T17:07:46.463601+0000","last_unstale":"2024-09-13T17:07:46.805842+0000","last_undegraded":"2024-09-13T17:07:46.805842+0000","last_fullsized":"2024-09-13T17:07:46.805842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:31.087286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824192+0000","last_change":"2024-09-13T17:07:46.818746+0000","last_active":"2024-09-13T17:07:46.824192+0000","last_peered":"2024-09-13T17:07:46.824192+0000","last_clean":"2024-09-13T17:07:46.824192+0000","last_became_active":"2024-09-13T17:07:46.818495+0000","last_became_peered":"2024-09-13T17:07:46.818495+0000","last_unstale":"2024-09-13T17:07:46.824192+0000","last_undegraded":"2024-09-13T17:07:46.824192+0000","last_fullsized":"2024-09-13T17:07:46.824192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.816473+0000","last_change":"2024-09-13T17:07:46.461668+0000","last_active":"2024-09-13T17:07:46.816473+0000","last_peered":"2024-09-13T17:07:46.816473+0000","last_clean":"2024-09-13T17:07:46.816473+0000","last_became_active":"2024-09-13T17:07:46.461382+0000","last_became_peered":"2024-09-13T17:07:46.461382+0000","last_unstale":"2024-09-13T17:07:46.816473+0000","last_undegraded":"2024-09-13T17:07:46.816473+0000","last_fullsized":"2024-09-13T17:07:46.816473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:36.337890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825662+0000","last_change":"2024-09-13T17:07:46.825662+0000","last_active":"2024-09-13T17:07:46.825662+0000","last_peered":"2024-09-13T17:07:46.825662+0000","last_clean":"2024-09-13T17:07:46.825662+0000","last_became_active":"2024-09-13T17:07:46.825407+0000","last_became_peered":"2024-09-13T17:07:46.825407+0000","last_unstale":"2024-09-13T17:07:46.825662+0000","last_undegraded":"2024-09-13T17:07:46.825662+0000","last_fullsized":"2024-09-13T17:07:46.825662+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812710+0000","last_change":"2024-09-13T17:07:46.463093+0000","last_active":"2024-09-13T17:07:46.812710+0000","last_peered":"2024-09-13T17:07:46.812710+0000","last_clean":"2024-09-13T17:07:46.812710+0000","last_became_active":"2024-09-13T17:07:46.462889+0000","last_became_peered":"2024-09-13T17:07:46.462889+0000","last_unstale":"2024-09-13T17:07:46.812710+0000","last_undegraded":"2024-09-13T17:07:46.812710+0000","last_fullsized":"2024-09-13T17:07:46.812710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.806237+0000","last_change":"2024-09-13T17:07:46.806237+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.806237+0000","last_undegraded":"2024-09-13T17:07:46.806237+0000","last_fullsized":"2024-09-13T17:07:46.806237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.814816+0000","last_change":"2024-09-13T17:07:46.463442+0000","last_active":"2024-09-13T17:07:46.814816+0000","last_peered":"2024-09-13T17:07:46.814816+0000","last_clean":"2024-09-13T17:07:46.814816+0000","last_became_active":"2024-09-13T17:07:46.459612+0000","last_became_peered":"2024-09-13T17:07:46.459612+0000","last_unstale":"2024-09-13T17:07:46.814816+0000","last_undegraded":"2024-09-13T17:07:46.814816+0000","last_fullsized":"2024-09-13T17:07:46.814816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:24.900637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820438+0000","last_change":"2024-09-13T17:07:46.820438+0000","last_active":"2024-09-13T17:07:46.820438+0000","last_peered":"2024-09-13T17:07:46.820438+0000","last_clean":"2024-09-13T17:07:46.820438+0000","last_became_active":"2024-09-13T17:07:46.820201+0000","last_became_peered":"2024-09-13T17:07:46.820201+0000","last_unstale":"2024-09-13T17:07:46.820438+0000","last_undegraded":"2024-09-13T17:07:46.820438+0000","last_fullsized":"2024-09-13T17:07:46.820438+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.807423+0000","last_change":"2024-09-13T17:07:46.459435+0000","last_active":"2024-09-13T17:07:46.807423+0000","last_peered":"2024-09-13T17:07:46.807423+0000","last_clean":"2024-09-13T17:07:46.807423+0000","last_became_active":"2024-09-13T17:07:46.459153+0000","last_became_peered":"2024-09-13T17:07:46.459153+0000","last_unstale":"2024-09-13T17:07:46.807423+0000","last_undegraded":"2024-09-13T17:07:46.807423+0000","last_fullsized":"2024-09-13T17:07:46.807423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:07.809881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808836+0000","last_change":"2024-09-13T17:07:46.808836+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808836+0000","last_undegraded":"2024-09-13T17:07:46.808836+0000","last_fullsized":"2024-09-13T17:07:46.808836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.810926+0000","last_change":"2024-09-13T17:07:46.459612+0000","last_active":"2024-09-13T17:07:46.810926+0000","last_peered":"2024-09-13T17:07:46.810926+0000","last_clean":"2024-09-13T17:07:46.810926+0000","last_became_active":"2024-09-13T17:07:46.459303+0000","last_became_peered":"2024-09-13T17:07:46.459303+0000","last_unstale":"2024-09-13T17:07:46.810926+0000","last_undegraded":"2024-09-13T17:07:46.810926+0000","last_fullsized":"2024-09-13T17:07:46.810926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:25.626757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.816307+0000","last_change":"2024-09-13T17:07:46.816307+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.816307+0000","last_undegraded":"2024-09-13T17:07:46.816307+0000","last_fullsized":"2024-09-13T17:07:46.816307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:37.347764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811516+0000","last_change":"2024-09-13T17:07:46.462541+0000","last_active":"2024-09-13T17:07:46.811516+0000","last_peered":"2024-09-13T17:07:46.811516+0000","last_clean":"2024-09-13T17:07:46.811516+0000","last_became_active":"2024-09-13T17:07:46.460577+0000","last_became_peered":"2024-09-13T17:07:46.460577+0000","last_unstale":"2024-09-13T17:07:46.811516+0000","last_undegraded":"2024-09-13T17:07:46.811516+0000","last_fullsized":"2024-09-13T17:07:46.811516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:11.941516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.813451+0000","last_change":"2024-09-13T17:07:46.813451+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.813451+0000","last_undegraded":"2024-09-13T17:07:46.813451+0000","last_fullsized":"2024-09-13T17:07:46.813451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:47.788741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.806869+0000","last_change":"2024-09-13T17:07:46.466551+0000","last_active":"2024-09-13T17:07:46.806869+0000","last_peered":"2024-09-13T17:07:46.806869+0000","last_clean":"2024-09-13T17:07:46.806869+0000","last_became_active":"2024-09-13T17:07:46.466298+0000","last_became_peered":"2024-09-13T17:07:46.466298+0000","last_unstale":"2024-09-13T17:07:46.806869+0000","last_undegraded":"2024-09-13T17:07:46.806869+0000","last_fullsized":"2024-09-13T17:07:46.806869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:49.531696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-09-13T17:07:46.829660+0000","last_change":"2024-09-13T17:07:46.829622+0000","last_active":"2024-09-13T17:07:46.829660+0000","last_peered":"2024-09-13T17:07:46.829660+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"2024-09-13T17:07:46.829622+0000","last_became_peered":"2024-09-13T17:07:46.829622+0000","last_unstale":"2024-09-13T17:07:46.829660+0000","last_undegraded":"2024-09-13T17:07:46.829660+0000","last_fullsized":"2024-09-13T17:07:46.829660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.814018+0000","last_change":"2024-09-13T17:07:46.459751+0000","last_active":"2024-09-13T17:07:46.814018+0000","last_peered":"2024-09-13T17:07:46.814018+0000","last_clean":"2024-09-13T17:07:46.814018+0000","last_became_active":"2024-09-13T17:07:46.458678+0000","last_became_peered":"2024-09-13T17:07:46.458678+0000","last_unstale":"2024-09-13T17:07:46.814018+0000","last_undegraded":"2024-09-13T17:07:46.814018+0000","last_fullsized":"2024-09-13T17:07:46.814018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:13.965041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808768+0000","last_change":"2024-09-13T17:07:46.808768+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808768+0000","last_undegraded":"2024-09-13T17:07:46.808768+0000","last_fullsized":"2024-09-13T17:07:46.808768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820618+0000","last_change":"2024-09-13T17:07:46.464282+0000","last_active":"2024-09-13T17:07:46.820618+0000","last_peered":"2024-09-13T17:07:46.820618+0000","last_clean":"2024-09-13T17:07:46.820618+0000","last_became_active":"2024-09-13T17:07:46.463984+0000","last_became_peered":"2024-09-13T17:07:46.463984+0000","last_unstale":"2024-09-13T17:07:46.820618+0000","last_undegraded":"2024-09-13T17:07:46.820618+0000","last_fullsized":"2024-09-13T17:07:46.820618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:41.634119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":4,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.819042+0000","last_change":"2024-09-13T17:07:46.814192+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.819042+0000","last_undegraded":"2024-09-13T17:07:46.819042+0000","last_fullsized":"2024-09-13T17:07:46.819042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:32.097160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.814648+0000","last_change":"2024-09-13T17:07:46.458932+0000","last_active":"2024-09-13T17:07:46.814648+0000","last_peered":"2024-09-13T17:07:46.814648+0000","last_clean":"2024-09-13T17:07:46.814648+0000","last_became_active":"2024-09-13T17:07:46.458642+0000","last_became_peered":"2024-09-13T17:07:46.458642+0000","last_unstale":"2024-09-13T17:07:46.814648+0000","last_undegraded":"2024-09-13T17:07:46.814648+0000","last_fullsized":"2024-09-13T17:07:46.814648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:35.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.814124+0000","last_change":"2024-09-13T17:07:46.814124+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.814124+0000","last_undegraded":"2024-09-13T17:07:46.814124+0000","last_fullsized":"2024-09-13T17:07:46.814124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:26.636631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.806555+0000","last_change":"2024-09-13T17:07:46.460097+0000","last_active":"2024-09-13T17:07:46.806555+0000","last_peered":"2024-09-13T17:07:46.806555+0000","last_clean":"2024-09-13T17:07:46.806555+0000","last_became_active":"2024-09-13T17:07:46.459833+0000","last_became_peered":"2024-09-13T17:07:46.459833+0000","last_unstale":"2024-09-13T17:07:46.806555+0000","last_undegraded":"2024-09-13T17:07:46.806555+0000","last_fullsized":"2024-09-13T17:07:46.806555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:06.069380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":4,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.819701+0000","last_change":"2024-09-13T17:07:46.814919+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.819701+0000","last_undegraded":"2024-09-13T17:07:46.819701+0000","last_fullsized":"2024-09-13T17:07:46.819701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:07.079254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818652+0000","last_change":"2024-09-13T17:07:46.460821+0000","last_active":"2024-09-13T17:07:46.818652+0000","last_peered":"2024-09-13T17:07:46.818652+0000","last_clean":"2024-09-13T17:07:46.818652+0000","last_became_active":"2024-09-13T17:07:46.460540+0000","last_became_peered":"2024-09-13T17:07:46.460540+0000","last_unstale":"2024-09-13T17:07:46.818652+0000","last_undegraded":"2024-09-13T17:07:46.818652+0000","last_fullsized":"2024-09-13T17:07:46.818652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:35.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":4,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.817655+0000","last_change":"2024-09-13T17:07:46.813515+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.817655+0000","last_undegraded":"2024-09-13T17:07:46.817655+0000","last_fullsized":"2024-09-13T17:07:46.817655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:33.883750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812803+0000","last_change":"2024-09-13T17:07:46.463183+0000","last_active":"2024-09-13T17:07:46.812803+0000","last_peered":"2024-09-13T17:07:46.812803+0000","last_clean":"2024-09-13T17:07:46.812803+0000","last_became_active":"2024-09-13T17:07:46.462872+0000","last_became_peered":"2024-09-13T17:07:46.462872+0000","last_unstale":"2024-09-13T17:07:46.812803+0000","last_undegraded":"2024-09-13T17:07:46.812803+0000","last_fullsized":"2024-09-13T17:07:46.812803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807398+0000","last_change":"2024-09-13T17:07:46.807398+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807398+0000","last_undegraded":"2024-09-13T17:07:46.807398+0000","last_fullsized":"2024-09-13T17:07:46.807398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.816280+0000","last_change":"2024-09-13T17:07:46.461826+0000","last_active":"2024-09-13T17:07:46.816280+0000","last_peered":"2024-09-13T17:07:46.816280+0000","last_clean":"2024-09-13T17:07:46.816280+0000","last_became_active":"2024-09-13T17:07:46.461348+0000","last_became_peered":"2024-09-13T17:07:46.461348+0000","last_unstale":"2024-09-13T17:07:46.816280+0000","last_undegraded":"2024-09-13T17:07:46.816280+0000","last_fullsized":"2024-09-13T17:07:46.816280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:25.626757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.814196+0000","last_change":"2024-09-13T17:07:46.814196+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.814196+0000","last_undegraded":"2024-09-13T17:07:46.814196+0000","last_fullsized":"2024-09-13T17:07:46.814196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:37.347764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.807359+0000","last_change":"2024-09-13T17:07:46.466282+0000","last_active":"2024-09-13T17:07:46.807359+0000","last_peered":"2024-09-13T17:07:46.807359+0000","last_clean":"2024-09-13T17:07:46.807359+0000","last_became_active":"2024-09-13T17:07:46.466008+0000","last_became_peered":"2024-09-13T17:07:46.466008+0000","last_unstale":"2024-09-13T17:07:46.807359+0000","last_undegraded":"2024-09-13T17:07:46.807359+0000","last_fullsized":"2024-09-13T17:07:46.807359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:57.898224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821732+0000","last_change":"2024-09-13T17:07:46.821732+0000","last_active":"2024-09-13T17:07:46.821732+0000","last_peered":"2024-09-13T17:07:46.821732+0000","last_clean":"2024-09-13T17:07:46.821732+0000","last_became_active":"2024-09-13T17:07:46.821507+0000","last_became_peered":"2024-09-13T17:07:46.821507+0000","last_unstale":"2024-09-13T17:07:46.821732+0000","last_undegraded":"2024-09-13T17:07:46.821732+0000","last_fullsized":"2024-09-13T17:07:46.821732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.805993+0000","last_change":"2024-09-13T17:07:46.459158+0000","last_active":"2024-09-13T17:07:46.805993+0000","last_peered":"2024-09-13T17:07:46.805993+0000","last_clean":"2024-09-13T17:07:46.805993+0000","last_became_active":"2024-09-13T17:07:46.458901+0000","last_became_peered":"2024-09-13T17:07:46.458901+0000","last_unstale":"2024-09-13T17:07:46.805993+0000","last_undegraded":"2024-09-13T17:07:46.805993+0000","last_fullsized":"2024-09-13T17:07:46.805993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:53.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811930+0000","last_change":"2024-09-13T17:07:46.811040+0000","last_active":"2024-09-13T17:07:46.811930+0000","last_peered":"2024-09-13T17:07:46.811930+0000","last_clean":"2024-09-13T17:07:46.811930+0000","last_became_active":"2024-09-13T17:07:46.810738+0000","last_became_peered":"2024-09-13T17:07:46.810738+0000","last_unstale":"2024-09-13T17:07:46.811930+0000","last_undegraded":"2024-09-13T17:07:46.811930+0000","last_fullsized":"2024-09-13T17:07:46.811930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:40.468817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.809276+0000","last_change":"2024-09-13T17:07:46.469077+0000","last_active":"2024-09-13T17:07:46.809276+0000","last_peered":"2024-09-13T17:07:46.809276+0000","last_clean":"2024-09-13T17:07:46.809276+0000","last_became_active":"2024-09-13T17:07:46.468808+0000","last_became_peered":"2024-09-13T17:07:46.468808+0000","last_unstale":"2024-09-13T17:07:46.809276+0000","last_undegraded":"2024-09-13T17:07:46.809276+0000","last_fullsized":"2024-09-13T17:07:46.809276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:55.638425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821584+0000","last_change":"2024-09-13T17:07:46.820219+0000","last_active":"2024-09-13T17:07:46.821584+0000","last_peered":"2024-09-13T17:07:46.821584+0000","last_clean":"2024-09-13T17:07:46.821584+0000","last_became_active":"2024-09-13T17:07:46.819114+0000","last_became_peered":"2024-09-13T17:07:46.819114+0000","last_unstale":"2024-09-13T17:07:46.821584+0000","last_undegraded":"2024-09-13T17:07:46.821584+0000","last_fullsized":"2024-09-13T17:07:46.821584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.806777+0000","last_change":"2024-09-13T17:07:46.462465+0000","last_active":"2024-09-13T17:07:46.806777+0000","last_peered":"2024-09-13T17:07:46.806777+0000","last_clean":"2024-09-13T17:07:46.806777+0000","last_became_active":"2024-09-13T17:07:46.462216+0000","last_became_peered":"2024-09-13T17:07:46.462216+0000","last_unstale":"2024-09-13T17:07:46.806777+0000","last_undegraded":"2024-09-13T17:07:46.806777+0000","last_fullsized":"2024-09-13T17:07:46.806777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:11.941516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822778+0000","last_change":"2024-09-13T17:07:46.822778+0000","last_active":"2024-09-13T17:07:46.822778+0000","last_peered":"2024-09-13T17:07:46.822778+0000","last_clean":"2024-09-13T17:07:46.822778+0000","last_became_active":"2024-09-13T17:07:46.822504+0000","last_became_peered":"2024-09-13T17:07:46.822504+0000","last_unstale":"2024-09-13T17:07:46.822778+0000","last_undegraded":"2024-09-13T17:07:46.822778+0000","last_fullsized":"2024-09-13T17:07:46.822778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:50.541570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.807707+0000","last_change":"2024-09-13T17:07:46.466175+0000","last_active":"2024-09-13T17:07:46.807707+0000","last_peered":"2024-09-13T17:07:46.807707+0000","last_clean":"2024-09-13T17:07:46.807707+0000","last_became_active":"2024-09-13T17:07:46.465896+0000","last_became_peered":"2024-09-13T17:07:46.465896+0000","last_unstale":"2024-09-13T17:07:46.807707+0000","last_undegraded":"2024-09-13T17:07:46.807707+0000","last_fullsized":"2024-09-13T17:07:46.807707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:36.337890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820250+0000","last_change":"2024-09-13T17:07:46.820250+0000","last_active":"2024-09-13T17:07:46.820250+0000","last_peered":"2024-09-13T17:07:46.820250+0000","last_clean":"2024-09-13T17:07:46.820250+0000","last_became_active":"2024-09-13T17:07:46.820005+0000","last_became_peered":"2024-09-13T17:07:46.820005+0000","last_unstale":"2024-09-13T17:07:46.820250+0000","last_undegraded":"2024-09-13T17:07:46.820250+0000","last_fullsized":"2024-09-13T17:07:46.820250+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812911+0000","last_change":"2024-09-13T17:07:46.463288+0000","last_active":"2024-09-13T17:07:46.812911+0000","last_peered":"2024-09-13T17:07:46.812911+0000","last_clean":"2024-09-13T17:07:46.812911+0000","last_became_active":"2024-09-13T17:07:46.462965+0000","last_became_peered":"2024-09-13T17:07:46.462965+0000","last_unstale":"2024-09-13T17:07:46.812911+0000","last_undegraded":"2024-09-13T17:07:46.812911+0000","last_fullsized":"2024-09-13T17:07:46.812911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:59.219013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825815+0000","last_change":"2024-09-13T17:07:46.825815+0000","last_active":"2024-09-13T17:07:46.825815+0000","last_peered":"2024-09-13T17:07:46.825815+0000","last_clean":"2024-09-13T17:07:46.825815+0000","last_became_active":"2024-09-13T17:07:46.825560+0000","last_became_peered":"2024-09-13T17:07:46.825560+0000","last_unstale":"2024-09-13T17:07:46.825815+0000","last_undegraded":"2024-09-13T17:07:46.825815+0000","last_fullsized":"2024-09-13T17:07:46.825815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:40.468817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811434+0000","last_change":"2024-09-13T17:07:46.463686+0000","last_active":"2024-09-13T17:07:46.811434+0000","last_peered":"2024-09-13T17:07:46.811434+0000","last_clean":"2024-09-13T17:07:46.811434+0000","last_became_active":"2024-09-13T17:07:46.463437+0000","last_became_peered":"2024-09-13T17:07:46.463437+0000","last_unstale":"2024-09-13T17:07:46.811434+0000","last_undegraded":"2024-09-13T17:07:46.811434+0000","last_fullsized":"2024-09-13T17:07:46.811434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:53.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-09-13T17:07:46.821323+0000","last_change":"2024-09-13T17:07:46.821260+0000","last_active":"2024-09-13T17:07:46.821323+0000","last_peered":"2024-09-13T17:07:46.821323+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"2024-09-13T17:07:46.821260+0000","last_became_peered":"2024-09-13T17:07:46.821260+0000","last_unstale":"2024-09-13T17:07:46.821323+0000","last_undegraded":"2024-09-13T17:07:46.821323+0000","last_fullsized":"2024-09-13T17:07:46.821323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:36.033290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818687+0000","last_change":"2024-09-13T17:07:46.464490+0000","last_active":"2024-09-13T17:07:46.818687+0000","last_peered":"2024-09-13T17:07:46.818687+0000","last_clean":"2024-09-13T17:07:46.818687+0000","last_became_active":"2024-09-13T17:07:46.464175+0000","last_became_peered":"2024-09-13T17:07:46.464175+0000","last_unstale":"2024-09-13T17:07:46.818687+0000","last_undegraded":"2024-09-13T17:07:46.818687+0000","last_fullsized":"2024-09-13T17:07:46.818687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:50.939498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.453001+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:07:46.453001+0000","last_peered":"2024-09-13T17:07:46.453001+0000","last_clean":"2024-09-13T17:07:46.453001+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:07:46.453001+0000","last_undegraded":"2024-09-13T17:07:46.453001+0000","last_fullsized":"2024-09-13T17:07:46.453001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.032}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.83599999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.89500000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.054}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.006}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.86699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.72699999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.026}]},{"osd":4,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.754}]},{"osd":5,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.008}]},{"osd":7,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.073}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.89000000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.0249999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.91600000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.98199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.002},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.0940000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.0189999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.98399999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.0469999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":1.0700000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.127}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.1080000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.202},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.2270000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.626},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.77300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.83299999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.875},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.81100000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.91500000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.028}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.92700000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.84999999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.89800000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.0589999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.995}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.434}]},{"osd":3,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.999},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.79700000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.876},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.95799999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.83099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":729180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.25,"5min":3.25,"15min":3.25},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.80900000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.5590000000000002,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":6.4089999999999998,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.7060000000000004,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":6.2729999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.746}]},{"osd":4,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":5.3019999999999996,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.9039999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":0.86499999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":4.2599999999999998,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.018},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.105}]},{"osd":7,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":5.7510000000000003,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:07:50.193 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:07:50.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe109cd700 1 Processor -- start 2024-09-13T17:07:50.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe109cd700 1 -- start start 2024-09-13T17:07:50.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe109cd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efe0c071580 0x7efe0c0705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe109cd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0c15b9b0 0x7efe0c0cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe109cd700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0c0cee80 con 0x7efe0c15a8c0 2024-09-13T17:07:50.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe109cd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c15be60 con 0x7efe0c071580 2024-09-13T17:07:50.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe109cd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0ce270 con 0x7efe0c15b9b0 2024-09-13T17:07:50.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe0a59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efe0c071580 0x7efe0c0705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe0ad9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7efe0c15a8c0 0x7efe0c070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41824/0 (socket says 172.21.15.123:41824) 2024-09-13T17:07:50.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe0ad9d700 1 -- 172.21.15.123:0/3996351453 learned_addr learned my addr 172.21.15.123:0/3996351453 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:50.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe0a59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efe0c071580 0x7efe0c0705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44396/0 (socket says 172.21.15.123:44396) 2024-09-13T17:07:50.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe0b59e700 1 --2- 172.21.15.123:0/3996351453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0c15b9b0 0x7efe0c0cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe0a59c700 1 -- 172.21.15.123:0/3996351453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0c15b9b0 msgr2=0x7efe0c0cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:50.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe0a59c700 1 --2- 172.21.15.123:0/3996351453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0c15b9b0 0x7efe0c0cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe0a59c700 1 -- 172.21.15.123:0/3996351453 >> v1:172.21.15.123:6789/0 conn(0x7efe0c15a8c0 legacy=0x7efe0c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe0a59c700 1 -- 172.21.15.123:0/3996351453 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c0ce550 con 0x7efe0c071580 2024-09-13T17:07:50.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe09d9b700 1 -- 172.21.15.123:0/3996351453 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706770039 0 0) 0x7efe0c0cee80 con 0x7efe0c15a8c0 2024-09-13T17:07:50.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe0a59c700 1 --2- 172.21.15.123:0/3996351453 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe0c071580 0x7efe0c0705b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009d90 tx=0x7efdf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8363dd5e1551b98 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:50.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe09d9b700 1 -- 172.21.15.123:0/3996351453 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf400e070 con 0x7efe0c071580 2024-09-13T17:07:50.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe09d9b700 1 -- 172.21.15.123:0/3996351453 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf400bbd0 con 0x7efe0c071580 2024-09-13T17:07:50.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe09d9b700 1 -- 172.21.15.123:0/3996351453 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4012430 con 0x7efe0c071580 2024-09-13T17:07:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe109cd700 1 -- 172.21.15.123:0/3996351453 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe0c071580 msgr2=0x7efe0c0705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.305+0000 7efe109cd700 1 --2- 172.21.15.123:0/3996351453 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe0c071580 0x7efe0c0705b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009d90 tx=0x7efdf400b330 comp rx=0 tx=0).stop 2024-09-13T17:07:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe109cd700 1 -- 172.21.15.123:0/3996351453 shutdown_connections 2024-09-13T17:07:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe109cd700 1 --2- 172.21.15.123:0/3996351453 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0c15b9b0 0x7efe0c0cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe109cd700 1 --2- 172.21.15.123:0/3996351453 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe0c071580 0x7efe0c0705b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe109cd700 1 -- 172.21.15.123:0/3996351453 >> 172.21.15.123:0/3996351453 conn(0x7efe0c066150 msgr2=0x7efe0c066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe109cd700 1 -- 172.21.15.123:0/3996351453 shutdown_connections 2024-09-13T17:07:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe109cd700 1 -- 172.21.15.123:0/3996351453 wait complete. 2024-09-13T17:07:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe109cd700 1 Processor -- start 2024-09-13T17:07:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe109cd700 1 -- start start 2024-09-13T17:07:50.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe109cd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0c071580 0x7efe0c0a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe109cd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe0c15a8c0 0x7efe0c0ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe109cd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe0c15b9b0 0x7efe0c150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe109cd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0aa720 con 0x7efe0c15b9b0 2024-09-13T17:07:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe109cd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0acf20 con 0x7efe0c15a8c0 2024-09-13T17:07:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe109cd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0ad200 con 0x7efe0c071580 2024-09-13T17:07:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe0b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe0c15b9b0 0x7efe0c150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe0b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe0c15b9b0 0x7efe0c150690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44400/0 (socket says 172.21.15.123:44400) 2024-09-13T17:07:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.309+0000 7efe0b59e700 1 -- 172.21.15.123:0/3183599010 learned_addr learned my addr 172.21.15.123:0/3183599010 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe0ad9d700 1 --2- 172.21.15.123:0/3183599010 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0c071580 0x7efe0c0a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe0a59c700 1 --2- 172.21.15.123:0/3183599010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe0c15a8c0 0x7efe0c0ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe0b59e700 1 -- 172.21.15.123:0/3183599010 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0c071580 msgr2=0x7efe0c0a91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe0b59e700 1 --2- 172.21.15.123:0/3183599010 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0c071580 0x7efe0c0a91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe0b59e700 1 -- 172.21.15.123:0/3183599010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe0c15a8c0 msgr2=0x7efe0c0ac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe0b59e700 1 --2- 172.21.15.123:0/3183599010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe0c15a8c0 0x7efe0c0ac6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe0b59e700 1 -- 172.21.15.123:0/3183599010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf4009a70 con 0x7efe0c15b9b0 2024-09-13T17:07:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe0b59e700 1 --2- 172.21.15.123:0/3183599010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe0c15b9b0 0x7efe0c150690 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efe0400d800 tx=0x7efe0400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe037fe700 1 -- 172.21.15.123:0/3183599010 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040125f0 con 0x7efe0c15b9b0 2024-09-13T17:07:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe037fe700 1 -- 172.21.15.123:0/3183599010 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe04012790 con 0x7efe0c15b9b0 2024-09-13T17:07:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe109cd700 1 -- 172.21.15.123:0/3183599010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0c0aa0d0 con 0x7efe0c15b9b0 2024-09-13T17:07:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe037fe700 1 -- 172.21.15.123:0/3183599010 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04012b40 con 0x7efe0c15b9b0 2024-09-13T17:07:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe109cd700 1 -- 172.21.15.123:0/3183599010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0c0acc30 con 0x7efe0c15b9b0 2024-09-13T17:07:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe109cd700 1 -- 172.21.15.123:0/3183599010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0c0677f0 con 0x7efe0c15b9b0 2024-09-13T17:07:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.313+0000 7efe037fe700 1 -- 172.21.15.123:0/3183599010 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efe04012ca0 con 0x7efe0c15b9b0 2024-09-13T17:07:50.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.317+0000 7efe037fe700 1 --2- 172.21.15.123:0/3183599010 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efdec066760 0x7efdec068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.317+0000 7efe0ad9d700 1 --2- 172.21.15.123:0/3183599010 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efdec066760 0x7efdec068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.317+0000 7efe037fe700 1 -- 172.21.15.123:0/3183599010 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe04084070 con 0x7efe0c15b9b0 2024-09-13T17:07:50.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.317+0000 7efe0ad9d700 1 --2- 172.21.15.123:0/3183599010 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efdec066760 0x7efdec068c20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efdfc000f60 tx=0x7efdfc007e00 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:50.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.321+0000 7efe037fe700 1 -- 172.21.15.123:0/3183599010 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efe04051450 con 0x7efe0c15b9b0 2024-09-13T17:07:50.431 INFO:tasks.ceph.mds.c.smithi123.stderr:2024-09-13T17:07:50.429+0000 7f0c3c7ff700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:07:50.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.493+0000 7efe109cd700 1 -- 172.21.15.123:0/3183599010 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe0c0ceb10 con 0x7efdec066760 2024-09-13T17:07:50.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.509+0000 7efe037fe700 1 -- 172.21.15.123:0/3183599010 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286895 (secure 0 0 0) 0x7efdfc001370 con 0x7efdec066760 2024-09-13T17:07:50.516 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:50.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.513+0000 7efe109cd700 1 -- 172.21.15.123:0/3183599010 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efdec066760 msgr2=0x7efdec068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.513+0000 7efe109cd700 1 --2- 172.21.15.123:0/3183599010 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efdec066760 0x7efdec068c20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efdfc000f60 tx=0x7efdfc007e00 comp rx=0 tx=0).stop 2024-09-13T17:07:50.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.513+0000 7efe109cd700 1 -- 172.21.15.123:0/3183599010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe0c15b9b0 msgr2=0x7efe0c150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.513+0000 7efe109cd700 1 --2- 172.21.15.123:0/3183599010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe0c15b9b0 0x7efe0c150690 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efe0400d800 tx=0x7efe0400db10 comp rx=0 tx=0).stop 2024-09-13T17:07:50.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.513+0000 7efe109cd700 1 -- 172.21.15.123:0/3183599010 shutdown_connections 2024-09-13T17:07:50.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.513+0000 7efe109cd700 1 --2- 172.21.15.123:0/3183599010 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efdec066760 0x7efdec068c20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.513+0000 7efe109cd700 1 --2- 172.21.15.123:0/3183599010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe0c15b9b0 0x7efe0c150690 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.513+0000 7efe109cd700 1 --2- 172.21.15.123:0/3183599010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe0c15a8c0 0x7efe0c0ac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.513+0000 7efe109cd700 1 --2- 172.21.15.123:0/3183599010 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe0c071580 0x7efe0c0a91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.513+0000 7efe109cd700 1 -- 172.21.15.123:0/3183599010 >> 172.21.15.123:0/3183599010 conn(0x7efe0c066150 msgr2=0x7efe0c06c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:50.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.513+0000 7efe109cd700 1 -- 172.21.15.123:0/3183599010 shutdown_connections 2024-09-13T17:07:50.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.513+0000 7efe109cd700 1 -- 172.21.15.123:0/3183599010 wait complete. 2024-09-13T17:07:50.519 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:07:50.535 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-13T17:07:48.754491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220068,"kb_used_data":3904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754652,"statfs":{"total":773094113280,"available":772868763648,"internally_reserved":0,"allocated":3997696,"data_stored":2253630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001092"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825404+0000","last_change":"2024-09-13T17:07:46.825404+0000","last_active":"2024-09-13T17:07:46.825404+0000","last_peered":"2024-09-13T17:07:46.825404+0000","last_clean":"2024-09-13T17:07:46.825404+0000","last_became_active":"2024-09-13T17:07:46.825157+0000","last_became_peered":"2024-09-13T17:07:46.825157+0000","last_unstale":"2024-09-13T17:07:46.825404+0000","last_undegraded":"2024-09-13T17:07:46.825404+0000","last_fullsized":"2024-09-13T17:07:46.825404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:08.819755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821865+0000","last_change":"2024-09-13T17:07:46.821865+0000","last_active":"2024-09-13T17:07:46.821865+0000","last_peered":"2024-09-13T17:07:46.821865+0000","last_clean":"2024-09-13T17:07:46.821865+0000","last_became_active":"2024-09-13T17:07:46.821335+0000","last_became_peered":"2024-09-13T17:07:46.821335+0000","last_unstale":"2024-09-13T17:07:46.821865+0000","last_undegraded":"2024-09-13T17:07:46.821865+0000","last_fullsized":"2024-09-13T17:07:46.821865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:19.871674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821251+0000","last_change":"2024-09-13T17:07:46.821251+0000","last_active":"2024-09-13T17:07:46.821251+0000","last_peered":"2024-09-13T17:07:46.821251+0000","last_clean":"2024-09-13T17:07:46.821251+0000","last_became_active":"2024-09-13T17:07:46.820956+0000","last_became_peered":"2024-09-13T17:07:46.820956+0000","last_unstale":"2024-09-13T17:07:46.821251+0000","last_undegraded":"2024-09-13T17:07:46.821251+0000","last_fullsized":"2024-09-13T17:07:46.821251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807336+0000","last_change":"2024-09-13T17:07:46.807336+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807336+0000","last_undegraded":"2024-09-13T17:07:46.807336+0000","last_fullsized":"2024-09-13T17:07:46.807336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.815482+0000","last_change":"2024-09-13T17:07:46.815482+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.815482+0000","last_undegraded":"2024-09-13T17:07:46.815482+0000","last_fullsized":"2024-09-13T17:07:46.815482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.812028+0000","last_change":"2024-09-13T17:07:46.812028+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.812028+0000","last_undegraded":"2024-09-13T17:07:46.812028+0000","last_fullsized":"2024-09-13T17:07:46.812028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807911+0000","last_change":"2024-09-13T17:07:46.807911+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807911+0000","last_undegraded":"2024-09-13T17:07:46.807911+0000","last_fullsized":"2024-09-13T17:07:46.807911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808191+0000","last_change":"2024-09-13T17:07:46.808191+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808191+0000","last_undegraded":"2024-09-13T17:07:46.808191+0000","last_fullsized":"2024-09-13T17:07:46.808191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:34.528334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.826617+0000","last_change":"2024-09-13T17:07:46.826617+0000","last_active":"2024-09-13T17:07:46.826617+0000","last_peered":"2024-09-13T17:07:46.826617+0000","last_clean":"2024-09-13T17:07:46.826617+0000","last_became_active":"2024-09-13T17:07:46.826339+0000","last_became_peered":"2024-09-13T17:07:46.826339+0000","last_unstale":"2024-09-13T17:07:46.826617+0000","last_undegraded":"2024-09-13T17:07:46.826617+0000","last_fullsized":"2024-09-13T17:07:46.826617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:27.800734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815960+0000","last_change":"2024-09-13T17:07:46.815960+0000","last_active":"2024-09-13T17:07:46.815960+0000","last_peered":"2024-09-13T17:07:46.815960+0000","last_clean":"2024-09-13T17:07:46.815960+0000","last_became_active":"2024-09-13T17:07:46.815778+0000","last_became_peered":"2024-09-13T17:07:46.815778+0000","last_unstale":"2024-09-13T17:07:46.815960+0000","last_undegraded":"2024-09-13T17:07:46.815960+0000","last_fullsized":"2024-09-13T17:07:46.815960+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.813819+0000","last_change":"2024-09-13T17:07:46.812036+0000","last_active":"2024-09-13T17:07:46.813819+0000","last_peered":"2024-09-13T17:07:46.813819+0000","last_clean":"2024-09-13T17:07:46.813819+0000","last_became_active":"2024-09-13T17:07:46.811777+0000","last_became_peered":"2024-09-13T17:07:46.811777+0000","last_unstale":"2024-09-13T17:07:46.813819+0000","last_undegraded":"2024-09-13T17:07:46.813819+0000","last_fullsized":"2024-09-13T17:07:46.813819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824951+0000","last_change":"2024-09-13T17:07:46.824951+0000","last_active":"2024-09-13T17:07:46.824951+0000","last_peered":"2024-09-13T17:07:46.824951+0000","last_clean":"2024-09-13T17:07:46.824951+0000","last_became_active":"2024-09-13T17:07:46.824657+0000","last_became_peered":"2024-09-13T17:07:46.824657+0000","last_unstale":"2024-09-13T17:07:46.824951+0000","last_undegraded":"2024-09-13T17:07:46.824951+0000","last_fullsized":"2024-09-13T17:07:46.824951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:19.871674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.819466+0000","last_change":"2024-09-13T17:07:46.819466+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.819466+0000","last_undegraded":"2024-09-13T17:07:46.819466+0000","last_fullsized":"2024-09-13T17:07:46.819466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:12.951389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824808+0000","last_change":"2024-09-13T17:07:46.824808+0000","last_active":"2024-09-13T17:07:46.824808+0000","last_peered":"2024-09-13T17:07:46.824808+0000","last_clean":"2024-09-13T17:07:46.824808+0000","last_became_active":"2024-09-13T17:07:46.824588+0000","last_became_peered":"2024-09-13T17:07:46.824588+0000","last_unstale":"2024-09-13T17:07:46.824808+0000","last_undegraded":"2024-09-13T17:07:46.824808+0000","last_fullsized":"2024-09-13T17:07:46.824808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824436+0000","last_change":"2024-09-13T17:07:46.824436+0000","last_active":"2024-09-13T17:07:46.824436+0000","last_peered":"2024-09-13T17:07:46.824436+0000","last_clean":"2024-09-13T17:07:46.824436+0000","last_became_active":"2024-09-13T17:07:46.822126+0000","last_became_peered":"2024-09-13T17:07:46.822126+0000","last_unstale":"2024-09-13T17:07:46.824436+0000","last_undegraded":"2024-09-13T17:07:46.824436+0000","last_fullsized":"2024-09-13T17:07:46.824436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:26.583203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.817868+0000","last_change":"2024-09-13T17:07:46.814681+0000","last_active":"2024-09-13T17:07:46.817868+0000","last_peered":"2024-09-13T17:07:46.817868+0000","last_clean":"2024-09-13T17:07:46.817868+0000","last_became_active":"2024-09-13T17:07:46.814398+0000","last_became_peered":"2024-09-13T17:07:46.814398+0000","last_unstale":"2024-09-13T17:07:46.817868+0000","last_undegraded":"2024-09-13T17:07:46.817868+0000","last_fullsized":"2024-09-13T17:07:46.817868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807614+0000","last_change":"2024-09-13T17:07:46.807614+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807614+0000","last_undegraded":"2024-09-13T17:07:46.807614+0000","last_fullsized":"2024-09-13T17:07:46.807614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824754+0000","last_change":"2024-09-13T17:07:46.824754+0000","last_active":"2024-09-13T17:07:46.824754+0000","last_peered":"2024-09-13T17:07:46.824754+0000","last_clean":"2024-09-13T17:07:46.824754+0000","last_became_active":"2024-09-13T17:07:46.824491+0000","last_became_peered":"2024-09-13T17:07:46.824491+0000","last_unstale":"2024-09-13T17:07:46.824754+0000","last_undegraded":"2024-09-13T17:07:46.824754+0000","last_fullsized":"2024-09-13T17:07:46.824754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822199+0000","last_change":"2024-09-13T17:07:46.822199+0000","last_active":"2024-09-13T17:07:46.822199+0000","last_peered":"2024-09-13T17:07:46.822199+0000","last_clean":"2024-09-13T17:07:46.822199+0000","last_became_active":"2024-09-13T17:07:46.821039+0000","last_became_peered":"2024-09-13T17:07:46.821039+0000","last_unstale":"2024-09-13T17:07:46.822199+0000","last_undegraded":"2024-09-13T17:07:46.822199+0000","last_fullsized":"2024-09-13T17:07:46.822199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.815297+0000","last_change":"2024-09-13T17:07:46.815297+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.815297+0000","last_undegraded":"2024-09-13T17:07:46.815297+0000","last_fullsized":"2024-09-13T17:07:46.815297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:56.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824875+0000","last_change":"2024-09-13T17:07:46.824875+0000","last_active":"2024-09-13T17:07:46.824875+0000","last_peered":"2024-09-13T17:07:46.824875+0000","last_clean":"2024-09-13T17:07:46.824875+0000","last_became_active":"2024-09-13T17:07:46.819999+0000","last_became_peered":"2024-09-13T17:07:46.819999+0000","last_unstale":"2024-09-13T17:07:46.824875+0000","last_undegraded":"2024-09-13T17:07:46.824875+0000","last_fullsized":"2024-09-13T17:07:46.824875+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:20.464724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824665+0000","last_change":"2024-09-13T17:07:46.824665+0000","last_active":"2024-09-13T17:07:46.824665+0000","last_peered":"2024-09-13T17:07:46.824665+0000","last_clean":"2024-09-13T17:07:46.824665+0000","last_became_active":"2024-09-13T17:07:46.820399+0000","last_became_peered":"2024-09-13T17:07:46.820399+0000","last_unstale":"2024-09-13T17:07:46.824665+0000","last_undegraded":"2024-09-13T17:07:46.824665+0000","last_fullsized":"2024-09-13T17:07:46.824665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:50.541570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815664+0000","last_change":"2024-09-13T17:07:46.811674+0000","last_active":"2024-09-13T17:07:46.815664+0000","last_peered":"2024-09-13T17:07:46.815664+0000","last_clean":"2024-09-13T17:07:46.815664+0000","last_became_active":"2024-09-13T17:07:46.811449+0000","last_became_peered":"2024-09-13T17:07:46.811449+0000","last_unstale":"2024-09-13T17:07:46.815664+0000","last_undegraded":"2024-09-13T17:07:46.815664+0000","last_fullsized":"2024-09-13T17:07:46.815664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:20.464724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.812767+0000","last_change":"2024-09-13T17:07:46.812767+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.812767+0000","last_undegraded":"2024-09-13T17:07:46.812767+0000","last_fullsized":"2024-09-13T17:07:46.812767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818395+0000","last_change":"2024-09-13T17:07:46.818395+0000","last_active":"2024-09-13T17:07:46.818395+0000","last_peered":"2024-09-13T17:07:46.818395+0000","last_clean":"2024-09-13T17:07:46.818395+0000","last_became_active":"2024-09-13T17:07:46.817022+0000","last_became_peered":"2024-09-13T17:07:46.817022+0000","last_unstale":"2024-09-13T17:07:46.818395+0000","last_undegraded":"2024-09-13T17:07:46.818395+0000","last_fullsized":"2024-09-13T17:07:46.818395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822031+0000","last_change":"2024-09-13T17:07:46.822031+0000","last_active":"2024-09-13T17:07:46.822031+0000","last_peered":"2024-09-13T17:07:46.822031+0000","last_clean":"2024-09-13T17:07:46.822031+0000","last_became_active":"2024-09-13T17:07:46.821647+0000","last_became_peered":"2024-09-13T17:07:46.821647+0000","last_unstale":"2024-09-13T17:07:46.822031+0000","last_undegraded":"2024-09-13T17:07:46.822031+0000","last_fullsized":"2024-09-13T17:07:46.822031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807893+0000","last_change":"2024-09-13T17:07:46.807893+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807893+0000","last_undegraded":"2024-09-13T17:07:46.807893+0000","last_fullsized":"2024-09-13T17:07:46.807893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820791+0000","last_change":"2024-09-13T17:07:46.820791+0000","last_active":"2024-09-13T17:07:46.820791+0000","last_peered":"2024-09-13T17:07:46.820791+0000","last_clean":"2024-09-13T17:07:46.820791+0000","last_became_active":"2024-09-13T17:07:46.820457+0000","last_became_peered":"2024-09-13T17:07:46.820457+0000","last_unstale":"2024-09-13T17:07:46.820791+0000","last_undegraded":"2024-09-13T17:07:46.820791+0000","last_fullsized":"2024-09-13T17:07:46.820791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825418+0000","last_change":"2024-09-13T17:07:46.825418+0000","last_active":"2024-09-13T17:07:46.825418+0000","last_peered":"2024-09-13T17:07:46.825418+0000","last_clean":"2024-09-13T17:07:46.825418+0000","last_became_active":"2024-09-13T17:07:46.825165+0000","last_became_peered":"2024-09-13T17:07:46.825165+0000","last_unstale":"2024-09-13T17:07:46.825418+0000","last_undegraded":"2024-09-13T17:07:46.825418+0000","last_fullsized":"2024-09-13T17:07:46.825418+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:58.908098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.819149+0000","last_change":"2024-09-13T17:07:46.819149+0000","last_active":"2024-09-13T17:07:46.819149+0000","last_peered":"2024-09-13T17:07:46.819149+0000","last_clean":"2024-09-13T17:07:46.819149+0000","last_became_active":"2024-09-13T17:07:46.818880+0000","last_became_peered":"2024-09-13T17:07:46.818880+0000","last_unstale":"2024-09-13T17:07:46.819149+0000","last_undegraded":"2024-09-13T17:07:46.819149+0000","last_fullsized":"2024-09-13T17:07:46.819149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824186+0000","last_change":"2024-09-13T17:07:46.824186+0000","last_active":"2024-09-13T17:07:46.824186+0000","last_peered":"2024-09-13T17:07:46.824186+0000","last_clean":"2024-09-13T17:07:46.824186+0000","last_became_active":"2024-09-13T17:07:46.823935+0000","last_became_peered":"2024-09-13T17:07:46.823935+0000","last_unstale":"2024-09-13T17:07:46.824186+0000","last_undegraded":"2024-09-13T17:07:46.824186+0000","last_fullsized":"2024-09-13T17:07:46.824186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:58.908098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807784+0000","last_change":"2024-09-13T17:07:46.807784+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807784+0000","last_undegraded":"2024-09-13T17:07:46.807784+0000","last_fullsized":"2024-09-13T17:07:46.807784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815878+0000","last_change":"2024-09-13T17:07:46.812039+0000","last_active":"2024-09-13T17:07:46.815878+0000","last_peered":"2024-09-13T17:07:46.815878+0000","last_clean":"2024-09-13T17:07:46.815878+0000","last_became_active":"2024-09-13T17:07:46.811670+0000","last_became_peered":"2024-09-13T17:07:46.811670+0000","last_unstale":"2024-09-13T17:07:46.815878+0000","last_undegraded":"2024-09-13T17:07:46.815878+0000","last_fullsized":"2024-09-13T17:07:46.815878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:47.788741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818961+0000","last_change":"2024-09-13T17:07:46.462013+0000","last_active":"2024-09-13T17:07:46.818961+0000","last_peered":"2024-09-13T17:07:46.818961+0000","last_clean":"2024-09-13T17:07:46.818961+0000","last_became_active":"2024-09-13T17:07:46.461748+0000","last_became_peered":"2024-09-13T17:07:46.461748+0000","last_unstale":"2024-09-13T17:07:46.818961+0000","last_undegraded":"2024-09-13T17:07:46.818961+0000","last_fullsized":"2024-09-13T17:07:46.818961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.816525+0000","last_change":"2024-09-13T17:07:46.816525+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.816525+0000","last_undegraded":"2024-09-13T17:07:46.816525+0000","last_fullsized":"2024-09-13T17:07:46.816525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:56.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.805711+0000","last_change":"2024-09-13T17:07:46.460122+0000","last_active":"2024-09-13T17:07:46.805711+0000","last_peered":"2024-09-13T17:07:46.805711+0000","last_clean":"2024-09-13T17:07:46.805711+0000","last_became_active":"2024-09-13T17:07:46.459873+0000","last_became_peered":"2024-09-13T17:07:46.459873+0000","last_unstale":"2024-09-13T17:07:46.805711+0000","last_undegraded":"2024-09-13T17:07:46.805711+0000","last_fullsized":"2024-09-13T17:07:46.805711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:32.873876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824847+0000","last_change":"2024-09-13T17:07:46.824847+0000","last_active":"2024-09-13T17:07:46.824847+0000","last_peered":"2024-09-13T17:07:46.824847+0000","last_clean":"2024-09-13T17:07:46.824847+0000","last_became_active":"2024-09-13T17:07:46.820127+0000","last_became_peered":"2024-09-13T17:07:46.820127+0000","last_unstale":"2024-09-13T17:07:46.824847+0000","last_undegraded":"2024-09-13T17:07:46.824847+0000","last_fullsized":"2024-09-13T17:07:46.824847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:08.819755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812174+0000","last_change":"2024-09-13T17:07:46.460323+0000","last_active":"2024-09-13T17:07:46.812174+0000","last_peered":"2024-09-13T17:07:46.812174+0000","last_clean":"2024-09-13T17:07:46.812174+0000","last_became_active":"2024-09-13T17:07:46.459957+0000","last_became_peered":"2024-09-13T17:07:46.459957+0000","last_unstale":"2024-09-13T17:07:46.812174+0000","last_undegraded":"2024-09-13T17:07:46.812174+0000","last_fullsized":"2024-09-13T17:07:46.812174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:28.877530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.806382+0000","last_change":"2024-09-13T17:07:46.806382+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.806382+0000","last_undegraded":"2024-09-13T17:07:46.806382+0000","last_fullsized":"2024-09-13T17:07:46.806382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818133+0000","last_change":"2024-09-13T17:07:46.466176+0000","last_active":"2024-09-13T17:07:46.818133+0000","last_peered":"2024-09-13T17:07:46.818133+0000","last_clean":"2024-09-13T17:07:46.818133+0000","last_became_active":"2024-09-13T17:07:46.465971+0000","last_became_peered":"2024-09-13T17:07:46.465971+0000","last_unstale":"2024-09-13T17:07:46.818133+0000","last_undegraded":"2024-09-13T17:07:46.818133+0000","last_fullsized":"2024-09-13T17:07:46.818133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:16.394194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808020+0000","last_change":"2024-09-13T17:07:46.808020+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808020+0000","last_undegraded":"2024-09-13T17:07:46.808020+0000","last_fullsized":"2024-09-13T17:07:46.808020+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812955+0000","last_change":"2024-09-13T17:07:46.463243+0000","last_active":"2024-09-13T17:07:46.812955+0000","last_peered":"2024-09-13T17:07:46.812955+0000","last_clean":"2024-09-13T17:07:46.812955+0000","last_became_active":"2024-09-13T17:07:46.458515+0000","last_became_peered":"2024-09-13T17:07:46.458515+0000","last_unstale":"2024-09-13T17:07:46.812955+0000","last_undegraded":"2024-09-13T17:07:46.812955+0000","last_fullsized":"2024-09-13T17:07:46.812955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:50.939498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820780+0000","last_change":"2024-09-13T17:07:46.820780+0000","last_active":"2024-09-13T17:07:46.820780+0000","last_peered":"2024-09-13T17:07:46.820780+0000","last_clean":"2024-09-13T17:07:46.820780+0000","last_became_active":"2024-09-13T17:07:46.820475+0000","last_became_peered":"2024-09-13T17:07:46.820475+0000","last_unstale":"2024-09-13T17:07:46.820780+0000","last_undegraded":"2024-09-13T17:07:46.820780+0000","last_fullsized":"2024-09-13T17:07:46.820780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.827386+0000","last_change":"2024-09-13T17:07:46.458577+0000","last_active":"2024-09-13T17:07:46.827386+0000","last_peered":"2024-09-13T17:07:46.827386+0000","last_clean":"2024-09-13T17:07:46.827386+0000","last_became_active":"2024-09-13T17:07:46.458092+0000","last_became_peered":"2024-09-13T17:07:46.458092+0000","last_unstale":"2024-09-13T17:07:46.827386+0000","last_undegraded":"2024-09-13T17:07:46.827386+0000","last_fullsized":"2024-09-13T17:07:46.827386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:40.898298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825572+0000","last_change":"2024-09-13T17:07:46.825572+0000","last_active":"2024-09-13T17:07:46.825572+0000","last_peered":"2024-09-13T17:07:46.825572+0000","last_clean":"2024-09-13T17:07:46.825572+0000","last_became_active":"2024-09-13T17:07:46.825347+0000","last_became_peered":"2024-09-13T17:07:46.825347+0000","last_unstale":"2024-09-13T17:07:46.825572+0000","last_undegraded":"2024-09-13T17:07:46.825572+0000","last_fullsized":"2024-09-13T17:07:46.825572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811858+0000","last_change":"2024-09-13T17:07:46.468729+0000","last_active":"2024-09-13T17:07:46.811858+0000","last_peered":"2024-09-13T17:07:46.811858+0000","last_clean":"2024-09-13T17:07:46.811858+0000","last_became_active":"2024-09-13T17:07:46.468433+0000","last_became_peered":"2024-09-13T17:07:46.468433+0000","last_unstale":"2024-09-13T17:07:46.811858+0000","last_undegraded":"2024-09-13T17:07:46.811858+0000","last_fullsized":"2024-09-13T17:07:46.811858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:31.087286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.806606+0000","last_change":"2024-09-13T17:07:46.806606+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.806606+0000","last_undegraded":"2024-09-13T17:07:46.806606+0000","last_fullsized":"2024-09-13T17:07:46.806606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.819903+0000","last_change":"2024-09-13T17:07:46.459288+0000","last_active":"2024-09-13T17:07:46.819903+0000","last_peered":"2024-09-13T17:07:46.819903+0000","last_clean":"2024-09-13T17:07:46.819903+0000","last_became_active":"2024-09-13T17:07:46.459007+0000","last_became_peered":"2024-09-13T17:07:46.459007+0000","last_unstale":"2024-09-13T17:07:46.819903+0000","last_undegraded":"2024-09-13T17:07:46.819903+0000","last_fullsized":"2024-09-13T17:07:46.819903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:29.395885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.826627+0000","last_change":"2024-09-13T17:07:46.826627+0000","last_active":"2024-09-13T17:07:46.826627+0000","last_peered":"2024-09-13T17:07:46.826627+0000","last_clean":"2024-09-13T17:07:46.826627+0000","last_became_active":"2024-09-13T17:07:46.826393+0000","last_became_peered":"2024-09-13T17:07:46.826393+0000","last_unstale":"2024-09-13T17:07:46.826627+0000","last_undegraded":"2024-09-13T17:07:46.826627+0000","last_fullsized":"2024-09-13T17:07:46.826627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815309+0000","last_change":"2024-09-13T17:07:46.461106+0000","last_active":"2024-09-13T17:07:46.815309+0000","last_peered":"2024-09-13T17:07:46.815309+0000","last_clean":"2024-09-13T17:07:46.815309+0000","last_became_active":"2024-09-13T17:07:46.460874+0000","last_became_peered":"2024-09-13T17:07:46.460874+0000","last_unstale":"2024-09-13T17:07:46.815309+0000","last_undegraded":"2024-09-13T17:07:46.815309+0000","last_fullsized":"2024-09-13T17:07:46.815309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:32.873876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821371+0000","last_change":"2024-09-13T17:07:46.821371+0000","last_active":"2024-09-13T17:07:46.821371+0000","last_peered":"2024-09-13T17:07:46.821371+0000","last_clean":"2024-09-13T17:07:46.821371+0000","last_became_active":"2024-09-13T17:07:46.821128+0000","last_became_peered":"2024-09-13T17:07:46.821128+0000","last_unstale":"2024-09-13T17:07:46.821371+0000","last_undegraded":"2024-09-13T17:07:46.821371+0000","last_fullsized":"2024-09-13T17:07:46.821371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.805842+0000","last_change":"2024-09-13T17:07:46.463906+0000","last_active":"2024-09-13T17:07:46.805842+0000","last_peered":"2024-09-13T17:07:46.805842+0000","last_clean":"2024-09-13T17:07:46.805842+0000","last_became_active":"2024-09-13T17:07:46.463601+0000","last_became_peered":"2024-09-13T17:07:46.463601+0000","last_unstale":"2024-09-13T17:07:46.805842+0000","last_undegraded":"2024-09-13T17:07:46.805842+0000","last_fullsized":"2024-09-13T17:07:46.805842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:31.087286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824192+0000","last_change":"2024-09-13T17:07:46.818746+0000","last_active":"2024-09-13T17:07:46.824192+0000","last_peered":"2024-09-13T17:07:46.824192+0000","last_clean":"2024-09-13T17:07:46.824192+0000","last_became_active":"2024-09-13T17:07:46.818495+0000","last_became_peered":"2024-09-13T17:07:46.818495+0000","last_unstale":"2024-09-13T17:07:46.824192+0000","last_undegraded":"2024-09-13T17:07:46.824192+0000","last_fullsized":"2024-09-13T17:07:46.824192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.816473+0000","last_change":"2024-09-13T17:07:46.461668+0000","last_active":"2024-09-13T17:07:46.816473+0000","last_peered":"2024-09-13T17:07:46.816473+0000","last_clean":"2024-09-13T17:07:46.816473+0000","last_became_active":"2024-09-13T17:07:46.461382+0000","last_became_peered":"2024-09-13T17:07:46.461382+0000","last_unstale":"2024-09-13T17:07:46.816473+0000","last_undegraded":"2024-09-13T17:07:46.816473+0000","last_fullsized":"2024-09-13T17:07:46.816473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:36.337890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825662+0000","last_change":"2024-09-13T17:07:46.825662+0000","last_active":"2024-09-13T17:07:46.825662+0000","last_peered":"2024-09-13T17:07:46.825662+0000","last_clean":"2024-09-13T17:07:46.825662+0000","last_became_active":"2024-09-13T17:07:46.825407+0000","last_became_peered":"2024-09-13T17:07:46.825407+0000","last_unstale":"2024-09-13T17:07:46.825662+0000","last_undegraded":"2024-09-13T17:07:46.825662+0000","last_fullsized":"2024-09-13T17:07:46.825662+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812710+0000","last_change":"2024-09-13T17:07:46.463093+0000","last_active":"2024-09-13T17:07:46.812710+0000","last_peered":"2024-09-13T17:07:46.812710+0000","last_clean":"2024-09-13T17:07:46.812710+0000","last_became_active":"2024-09-13T17:07:46.462889+0000","last_became_peered":"2024-09-13T17:07:46.462889+0000","last_unstale":"2024-09-13T17:07:46.812710+0000","last_undegraded":"2024-09-13T17:07:46.812710+0000","last_fullsized":"2024-09-13T17:07:46.812710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.806237+0000","last_change":"2024-09-13T17:07:46.806237+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.806237+0000","last_undegraded":"2024-09-13T17:07:46.806237+0000","last_fullsized":"2024-09-13T17:07:46.806237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.814816+0000","last_change":"2024-09-13T17:07:46.463442+0000","last_active":"2024-09-13T17:07:46.814816+0000","last_peered":"2024-09-13T17:07:46.814816+0000","last_clean":"2024-09-13T17:07:46.814816+0000","last_became_active":"2024-09-13T17:07:46.459612+0000","last_became_peered":"2024-09-13T17:07:46.459612+0000","last_unstale":"2024-09-13T17:07:46.814816+0000","last_undegraded":"2024-09-13T17:07:46.814816+0000","last_fullsized":"2024-09-13T17:07:46.814816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:24.900637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820438+0000","last_change":"2024-09-13T17:07:46.820438+0000","last_active":"2024-09-13T17:07:46.820438+0000","last_peered":"2024-09-13T17:07:46.820438+0000","last_clean":"2024-09-13T17:07:46.820438+0000","last_became_active":"2024-09-13T17:07:46.820201+0000","last_became_peered":"2024-09-13T17:07:46.820201+0000","last_unstale":"2024-09-13T17:07:46.820438+0000","last_undegraded":"2024-09-13T17:07:46.820438+0000","last_fullsized":"2024-09-13T17:07:46.820438+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.807423+0000","last_change":"2024-09-13T17:07:46.459435+0000","last_active":"2024-09-13T17:07:46.807423+0000","last_peered":"2024-09-13T17:07:46.807423+0000","last_clean":"2024-09-13T17:07:46.807423+0000","last_became_active":"2024-09-13T17:07:46.459153+0000","last_became_peered":"2024-09-13T17:07:46.459153+0000","last_unstale":"2024-09-13T17:07:46.807423+0000","last_undegraded":"2024-09-13T17:07:46.807423+0000","last_fullsized":"2024-09-13T17:07:46.807423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:07.809881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808836+0000","last_change":"2024-09-13T17:07:46.808836+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808836+0000","last_undegraded":"2024-09-13T17:07:46.808836+0000","last_fullsized":"2024-09-13T17:07:46.808836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.810926+0000","last_change":"2024-09-13T17:07:46.459612+0000","last_active":"2024-09-13T17:07:46.810926+0000","last_peered":"2024-09-13T17:07:46.810926+0000","last_clean":"2024-09-13T17:07:46.810926+0000","last_became_active":"2024-09-13T17:07:46.459303+0000","last_became_peered":"2024-09-13T17:07:46.459303+0000","last_unstale":"2024-09-13T17:07:46.810926+0000","last_undegraded":"2024-09-13T17:07:46.810926+0000","last_fullsized":"2024-09-13T17:07:46.810926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:25.626757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.816307+0000","last_change":"2024-09-13T17:07:46.816307+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.816307+0000","last_undegraded":"2024-09-13T17:07:46.816307+0000","last_fullsized":"2024-09-13T17:07:46.816307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:37.347764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811516+0000","last_change":"2024-09-13T17:07:46.462541+0000","last_active":"2024-09-13T17:07:46.811516+0000","last_peered":"2024-09-13T17:07:46.811516+0000","last_clean":"2024-09-13T17:07:46.811516+0000","last_became_active":"2024-09-13T17:07:46.460577+0000","last_became_peered":"2024-09-13T17:07:46.460577+0000","last_unstale":"2024-09-13T17:07:46.811516+0000","last_undegraded":"2024-09-13T17:07:46.811516+0000","last_fullsized":"2024-09-13T17:07:46.811516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:11.941516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.813451+0000","last_change":"2024-09-13T17:07:46.813451+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.813451+0000","last_undegraded":"2024-09-13T17:07:46.813451+0000","last_fullsized":"2024-09-13T17:07:46.813451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:47.788741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.806869+0000","last_change":"2024-09-13T17:07:46.466551+0000","last_active":"2024-09-13T17:07:46.806869+0000","last_peered":"2024-09-13T17:07:46.806869+0000","last_clean":"2024-09-13T17:07:46.806869+0000","last_became_active":"2024-09-13T17:07:46.466298+0000","last_became_peered":"2024-09-13T17:07:46.466298+0000","last_unstale":"2024-09-13T17:07:46.806869+0000","last_undegraded":"2024-09-13T17:07:46.806869+0000","last_fullsized":"2024-09-13T17:07:46.806869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:49.531696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-09-13T17:07:46.829660+0000","last_change":"2024-09-13T17:07:46.829622+0000","last_active":"2024-09-13T17:07:46.829660+0000","last_peered":"2024-09-13T17:07:46.829660+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"2024-09-13T17:07:46.829622+0000","last_became_peered":"2024-09-13T17:07:46.829622+0000","last_unstale":"2024-09-13T17:07:46.829660+0000","last_undegraded":"2024-09-13T17:07:46.829660+0000","last_fullsized":"2024-09-13T17:07:46.829660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.814018+0000","last_change":"2024-09-13T17:07:46.459751+0000","last_active":"2024-09-13T17:07:46.814018+0000","last_peered":"2024-09-13T17:07:46.814018+0000","last_clean":"2024-09-13T17:07:46.814018+0000","last_became_active":"2024-09-13T17:07:46.458678+0000","last_became_peered":"2024-09-13T17:07:46.458678+0000","last_unstale":"2024-09-13T17:07:46.814018+0000","last_undegraded":"2024-09-13T17:07:46.814018+0000","last_fullsized":"2024-09-13T17:07:46.814018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:13.965041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808768+0000","last_change":"2024-09-13T17:07:46.808768+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808768+0000","last_undegraded":"2024-09-13T17:07:46.808768+0000","last_fullsized":"2024-09-13T17:07:46.808768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820618+0000","last_change":"2024-09-13T17:07:46.464282+0000","last_active":"2024-09-13T17:07:46.820618+0000","last_peered":"2024-09-13T17:07:46.820618+0000","last_clean":"2024-09-13T17:07:46.820618+0000","last_became_active":"2024-09-13T17:07:46.463984+0000","last_became_peered":"2024-09-13T17:07:46.463984+0000","last_unstale":"2024-09-13T17:07:46.820618+0000","last_undegraded":"2024-09-13T17:07:46.820618+0000","last_fullsized":"2024-09-13T17:07:46.820618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:41.634119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":4,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.819042+0000","last_change":"2024-09-13T17:07:46.814192+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.819042+0000","last_undegraded":"2024-09-13T17:07:46.819042+0000","last_fullsized":"2024-09-13T17:07:46.819042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:32.097160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.814648+0000","last_change":"2024-09-13T17:07:46.458932+0000","last_active":"2024-09-13T17:07:46.814648+0000","last_peered":"2024-09-13T17:07:46.814648+0000","last_clean":"2024-09-13T17:07:46.814648+0000","last_became_active":"2024-09-13T17:07:46.458642+0000","last_became_peered":"2024-09-13T17:07:46.458642+0000","last_unstale":"2024-09-13T17:07:46.814648+0000","last_undegraded":"2024-09-13T17:07:46.814648+0000","last_fullsized":"2024-09-13T17:07:46.814648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:35.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.814124+0000","last_change":"2024-09-13T17:07:46.814124+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.814124+0000","last_undegraded":"2024-09-13T17:07:46.814124+0000","last_fullsized":"2024-09-13T17:07:46.814124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:26.636631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.806555+0000","last_change":"2024-09-13T17:07:46.460097+0000","last_active":"2024-09-13T17:07:46.806555+0000","last_peered":"2024-09-13T17:07:46.806555+0000","last_clean":"2024-09-13T17:07:46.806555+0000","last_became_active":"2024-09-13T17:07:46.459833+0000","last_became_peered":"2024-09-13T17:07:46.459833+0000","last_unstale":"2024-09-13T17:07:46.806555+0000","last_undegraded":"2024-09-13T17:07:46.806555+0000","last_fullsized":"2024-09-13T17:07:46.806555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:06.069380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":4,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.819701+0000","last_change":"2024-09-13T17:07:46.814919+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.819701+0000","last_undegraded":"2024-09-13T17:07:46.819701+0000","last_fullsized":"2024-09-13T17:07:46.819701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:07.079254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818652+0000","last_change":"2024-09-13T17:07:46.460821+0000","last_active":"2024-09-13T17:07:46.818652+0000","last_peered":"2024-09-13T17:07:46.818652+0000","last_clean":"2024-09-13T17:07:46.818652+0000","last_became_active":"2024-09-13T17:07:46.460540+0000","last_became_peered":"2024-09-13T17:07:46.460540+0000","last_unstale":"2024-09-13T17:07:46.818652+0000","last_undegraded":"2024-09-13T17:07:46.818652+0000","last_fullsized":"2024-09-13T17:07:46.818652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:35.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":4,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.817655+0000","last_change":"2024-09-13T17:07:46.813515+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.817655+0000","last_undegraded":"2024-09-13T17:07:46.817655+0000","last_fullsized":"2024-09-13T17:07:46.817655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:33.883750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812803+0000","last_change":"2024-09-13T17:07:46.463183+0000","last_active":"2024-09-13T17:07:46.812803+0000","last_peered":"2024-09-13T17:07:46.812803+0000","last_clean":"2024-09-13T17:07:46.812803+0000","last_became_active":"2024-09-13T17:07:46.462872+0000","last_became_peered":"2024-09-13T17:07:46.462872+0000","last_unstale":"2024-09-13T17:07:46.812803+0000","last_undegraded":"2024-09-13T17:07:46.812803+0000","last_fullsized":"2024-09-13T17:07:46.812803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807398+0000","last_change":"2024-09-13T17:07:46.807398+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807398+0000","last_undegraded":"2024-09-13T17:07:46.807398+0000","last_fullsized":"2024-09-13T17:07:46.807398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.816280+0000","last_change":"2024-09-13T17:07:46.461826+0000","last_active":"2024-09-13T17:07:46.816280+0000","last_peered":"2024-09-13T17:07:46.816280+0000","last_clean":"2024-09-13T17:07:46.816280+0000","last_became_active":"2024-09-13T17:07:46.461348+0000","last_became_peered":"2024-09-13T17:07:46.461348+0000","last_unstale":"2024-09-13T17:07:46.816280+0000","last_undegraded":"2024-09-13T17:07:46.816280+0000","last_fullsized":"2024-09-13T17:07:46.816280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:25.626757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.814196+0000","last_change":"2024-09-13T17:07:46.814196+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.814196+0000","last_undegraded":"2024-09-13T17:07:46.814196+0000","last_fullsized":"2024-09-13T17:07:46.814196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:37.347764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.807359+0000","last_change":"2024-09-13T17:07:46.466282+0000","last_active":"2024-09-13T17:07:46.807359+0000","last_peered":"2024-09-13T17:07:46.807359+0000","last_clean":"2024-09-13T17:07:46.807359+0000","last_became_active":"2024-09-13T17:07:46.466008+0000","last_became_peered":"2024-09-13T17:07:46.466008+0000","last_unstale":"2024-09-13T17:07:46.807359+0000","last_undegraded":"2024-09-13T17:07:46.807359+0000","last_fullsized":"2024-09-13T17:07:46.807359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:57.898224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821732+0000","last_change":"2024-09-13T17:07:46.821732+0000","last_active":"2024-09-13T17:07:46.821732+0000","last_peered":"2024-09-13T17:07:46.821732+0000","last_clean":"2024-09-13T17:07:46.821732+0000","last_became_active":"2024-09-13T17:07:46.821507+0000","last_became_peered":"2024-09-13T17:07:46.821507+0000","last_unstale":"2024-09-13T17:07:46.821732+0000","last_undegraded":"2024-09-13T17:07:46.821732+0000","last_fullsized":"2024-09-13T17:07:46.821732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.805993+0000","last_change":"2024-09-13T17:07:46.459158+0000","last_active":"2024-09-13T17:07:46.805993+0000","last_peered":"2024-09-13T17:07:46.805993+0000","last_clean":"2024-09-13T17:07:46.805993+0000","last_became_active":"2024-09-13T17:07:46.458901+0000","last_became_peered":"2024-09-13T17:07:46.458901+0000","last_unstale":"2024-09-13T17:07:46.805993+0000","last_undegraded":"2024-09-13T17:07:46.805993+0000","last_fullsized":"2024-09-13T17:07:46.805993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:53.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811930+0000","last_change":"2024-09-13T17:07:46.811040+0000","last_active":"2024-09-13T17:07:46.811930+0000","last_peered":"2024-09-13T17:07:46.811930+0000","last_clean":"2024-09-13T17:07:46.811930+0000","last_became_active":"2024-09-13T17:07:46.810738+0000","last_became_peered":"2024-09-13T17:07:46.810738+0000","last_unstale":"2024-09-13T17:07:46.811930+0000","last_undegraded":"2024-09-13T17:07:46.811930+0000","last_fullsized":"2024-09-13T17:07:46.811930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:40.468817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.809276+0000","last_change":"2024-09-13T17:07:46.469077+0000","last_active":"2024-09-13T17:07:46.809276+0000","last_peered":"2024-09-13T17:07:46.809276+0000","last_clean":"2024-09-13T17:07:46.809276+0000","last_became_active":"2024-09-13T17:07:46.468808+0000","last_became_peered":"2024-09-13T17:07:46.468808+0000","last_unstale":"2024-09-13T17:07:46.809276+0000","last_undegraded":"2024-09-13T17:07:46.809276+0000","last_fullsized":"2024-09-13T17:07:46.809276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:55.638425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821584+0000","last_change":"2024-09-13T17:07:46.820219+0000","last_active":"2024-09-13T17:07:46.821584+0000","last_peered":"2024-09-13T17:07:46.821584+0000","last_clean":"2024-09-13T17:07:46.821584+0000","last_became_active":"2024-09-13T17:07:46.819114+0000","last_became_peered":"2024-09-13T17:07:46.819114+0000","last_unstale":"2024-09-13T17:07:46.821584+0000","last_undegraded":"2024-09-13T17:07:46.821584+0000","last_fullsized":"2024-09-13T17:07:46.821584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.806777+0000","last_change":"2024-09-13T17:07:46.462465+0000","last_active":"2024-09-13T17:07:46.806777+0000","last_peered":"2024-09-13T17:07:46.806777+0000","last_clean":"2024-09-13T17:07:46.806777+0000","last_became_active":"2024-09-13T17:07:46.462216+0000","last_became_peered":"2024-09-13T17:07:46.462216+0000","last_unstale":"2024-09-13T17:07:46.806777+0000","last_undegraded":"2024-09-13T17:07:46.806777+0000","last_fullsized":"2024-09-13T17:07:46.806777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:11.941516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822778+0000","last_change":"2024-09-13T17:07:46.822778+0000","last_active":"2024-09-13T17:07:46.822778+0000","last_peered":"2024-09-13T17:07:46.822778+0000","last_clean":"2024-09-13T17:07:46.822778+0000","last_became_active":"2024-09-13T17:07:46.822504+0000","last_became_peered":"2024-09-13T17:07:46.822504+0000","last_unstale":"2024-09-13T17:07:46.822778+0000","last_undegraded":"2024-09-13T17:07:46.822778+0000","last_fullsized":"2024-09-13T17:07:46.822778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:50.541570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.807707+0000","last_change":"2024-09-13T17:07:46.466175+0000","last_active":"2024-09-13T17:07:46.807707+0000","last_peered":"2024-09-13T17:07:46.807707+0000","last_clean":"2024-09-13T17:07:46.807707+0000","last_became_active":"2024-09-13T17:07:46.465896+0000","last_became_peered":"2024-09-13T17:07:46.465896+0000","last_unstale":"2024-09-13T17:07:46.807707+0000","last_undegraded":"2024-09-13T17:07:46.807707+0000","last_fullsized":"2024-09-13T17:07:46.807707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:36.337890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820250+0000","last_change":"2024-09-13T17:07:46.820250+0000","last_active":"2024-09-13T17:07:46.820250+0000","last_peered":"2024-09-13T17:07:46.820250+0000","last_clean":"2024-09-13T17:07:46.820250+0000","last_became_active":"2024-09-13T17:07:46.820005+0000","last_became_peered":"2024-09-13T17:07:46.820005+0000","last_unstale":"2024-09-13T17:07:46.820250+0000","last_undegraded":"2024-09-13T17:07:46.820250+0000","last_fullsized":"2024-09-13T17:07:46.820250+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812911+0000","last_change":"2024-09-13T17:07:46.463288+0000","last_active":"2024-09-13T17:07:46.812911+0000","last_peered":"2024-09-13T17:07:46.812911+0000","last_clean":"2024-09-13T17:07:46.812911+0000","last_became_active":"2024-09-13T17:07:46.462965+0000","last_became_peered":"2024-09-13T17:07:46.462965+0000","last_unstale":"2024-09-13T17:07:46.812911+0000","last_undegraded":"2024-09-13T17:07:46.812911+0000","last_fullsized":"2024-09-13T17:07:46.812911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:59.219013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825815+0000","last_change":"2024-09-13T17:07:46.825815+0000","last_active":"2024-09-13T17:07:46.825815+0000","last_peered":"2024-09-13T17:07:46.825815+0000","last_clean":"2024-09-13T17:07:46.825815+0000","last_became_active":"2024-09-13T17:07:46.825560+0000","last_became_peered":"2024-09-13T17:07:46.825560+0000","last_unstale":"2024-09-13T17:07:46.825815+0000","last_undegraded":"2024-09-13T17:07:46.825815+0000","last_fullsized":"2024-09-13T17:07:46.825815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:40.468817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811434+0000","last_change":"2024-09-13T17:07:46.463686+0000","last_active":"2024-09-13T17:07:46.811434+0000","last_peered":"2024-09-13T17:07:46.811434+0000","last_clean":"2024-09-13T17:07:46.811434+0000","last_became_active":"2024-09-13T17:07:46.463437+0000","last_became_peered":"2024-09-13T17:07:46.463437+0000","last_unstale":"2024-09-13T17:07:46.811434+0000","last_undegraded":"2024-09-13T17:07:46.811434+0000","last_fullsized":"2024-09-13T17:07:46.811434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:53.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-09-13T17:07:46.821323+0000","last_change":"2024-09-13T17:07:46.821260+0000","last_active":"2024-09-13T17:07:46.821323+0000","last_peered":"2024-09-13T17:07:46.821323+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"2024-09-13T17:07:46.821260+0000","last_became_peered":"2024-09-13T17:07:46.821260+0000","last_unstale":"2024-09-13T17:07:46.821323+0000","last_undegraded":"2024-09-13T17:07:46.821323+0000","last_fullsized":"2024-09-13T17:07:46.821323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:36.033290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818687+0000","last_change":"2024-09-13T17:07:46.464490+0000","last_active":"2024-09-13T17:07:46.818687+0000","last_peered":"2024-09-13T17:07:46.818687+0000","last_clean":"2024-09-13T17:07:46.818687+0000","last_became_active":"2024-09-13T17:07:46.464175+0000","last_became_peered":"2024-09-13T17:07:46.464175+0000","last_unstale":"2024-09-13T17:07:46.818687+0000","last_undegraded":"2024-09-13T17:07:46.818687+0000","last_fullsized":"2024-09-13T17:07:46.818687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:50.939498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.453001+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:07:46.453001+0000","last_peered":"2024-09-13T17:07:46.453001+0000","last_clean":"2024-09-13T17:07:46.453001+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:07:46.453001+0000","last_undegraded":"2024-09-13T17:07:46.453001+0000","last_fullsized":"2024-09-13T17:07:46.453001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.032}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.83599999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.89500000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.054}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.006}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.86699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.72699999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.026}]},{"osd":4,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.754}]},{"osd":5,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.008}]},{"osd":7,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.073}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.89000000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.0249999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.91600000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.98199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.002},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.0940000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.0189999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.98399999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.0469999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":1.0700000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.127}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.1080000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.202},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.2270000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.626},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.77300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.83299999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.875},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.81100000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.91500000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.028}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.92700000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.84999999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.89800000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.0589999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.995}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.434}]},{"osd":3,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.999},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.79700000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.876},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.95799999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.83099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":729180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.25,"5min":3.25,"15min":3.25},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.80900000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.5590000000000002,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":6.4089999999999998,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.7060000000000004,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":6.2729999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.746}]},{"osd":4,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":5.3019999999999996,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.9039999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":0.86499999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":4.2599999999999998,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.018},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.105}]},{"osd":7,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":5.7510000000000003,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:07:50.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-09-13T17:07:50.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.807336+0000', 'last_change': '2024-09-13T17:07:46.807336+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.807336+0000', 'last_undegraded': '2024-09-13T17:07:46.807336+0000', 'last_fullsized': '2024-09-13T17:07:46.807336+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:07:50.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-09-13T17:07:50.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.815482+0000', 'last_change': '2024-09-13T17:07:46.815482+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.815482+0000', 'last_undegraded': '2024-09-13T17:07:46.815482+0000', 'last_fullsized': '2024-09-13T17:07:46.815482+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:07:50.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-09-13T17:07:50.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.812028+0000', 'last_change': '2024-09-13T17:07:46.812028+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.812028+0000', 'last_undegraded': '2024-09-13T17:07:46.812028+0000', 'last_fullsized': '2024-09-13T17:07:46.812028+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': ['3', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:07:50.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-09-13T17:07:50.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.807911+0000', 'last_change': '2024-09-13T17:07:46.807911+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.807911+0000', 'last_undegraded': '2024-09-13T17:07:46.807911+0000', 'last_fullsized': '2024-09-13T17:07:46.807911+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': ['7', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:07:50.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-09-13T17:07:50.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.808191+0000', 'last_change': '2024-09-13T17:07:46.808191+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.808191+0000', 'last_undegraded': '2024-09-13T17:07:46.808191+0000', 'last_fullsized': '2024-09-13T17:07:46.808191+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:36:34.528334+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': ['7', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:07:50.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-09-13T17:07:50.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.819466+0000', 'last_change': '2024-09-13T17:07:46.819466+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.819466+0000', 'last_undegraded': '2024-09-13T17:07:46.819466+0000', 'last_fullsized': '2024-09-13T17:07:46.819466+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:53:12.951389+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': ['2', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:07:50.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-09-13T17:07:50.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.807614+0000', 'last_change': '2024-09-13T17:07:46.807614+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.807614+0000', 'last_undegraded': '2024-09-13T17:07:46.807614+0000', 'last_fullsized': '2024-09-13T17:07:46.807614+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': ['7', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:07:50.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-09-13T17:07:50.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.815297+0000', 'last_change': '2024-09-13T17:07:46.815297+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.815297+0000', 'last_undegraded': '2024-09-13T17:07:46.815297+0000', 'last_fullsized': '2024-09-13T17:07:46.815297+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:39:56.648299+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': ['2', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:07:50.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-09-13T17:07:50.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.812767+0000', 'last_change': '2024-09-13T17:07:46.812767+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.812767+0000', 'last_undegraded': '2024-09-13T17:07:46.812767+0000', 'last_fullsized': '2024-09-13T17:07:46.812767+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': ['5', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:07:50.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-09-13T17:07:50.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.807893+0000', 'last_change': '2024-09-13T17:07:46.807893+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.807893+0000', 'last_undegraded': '2024-09-13T17:07:46.807893+0000', 'last_fullsized': '2024-09-13T17:07:46.807893+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:07:50.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-09-13T17:07:50.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.807784+0000', 'last_change': '2024-09-13T17:07:46.807784+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.807784+0000', 'last_undegraded': '2024-09-13T17:07:46.807784+0000', 'last_fullsized': '2024-09-13T17:07:46.807784+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:07:50.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-09-13T17:07:50.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.816525+0000', 'last_change': '2024-09-13T17:07:46.816525+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.816525+0000', 'last_undegraded': '2024-09-13T17:07:46.816525+0000', 'last_fullsized': '2024-09-13T17:07:46.816525+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:39:56.648299+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': ['6', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:07:50.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-09-13T17:07:50.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.806382+0000', 'last_change': '2024-09-13T17:07:46.806382+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.806382+0000', 'last_undegraded': '2024-09-13T17:07:46.806382+0000', 'last_fullsized': '2024-09-13T17:07:46.806382+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:07:50.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-09-13T17:07:50.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.808020+0000', 'last_change': '2024-09-13T17:07:46.808020+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.808020+0000', 'last_undegraded': '2024-09-13T17:07:46.808020+0000', 'last_fullsized': '2024-09-13T17:07:46.808020+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:07:50.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-09-13T17:07:50.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.806606+0000', 'last_change': '2024-09-13T17:07:46.806606+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.806606+0000', 'last_undegraded': '2024-09-13T17:07:46.806606+0000', 'last_fullsized': '2024-09-13T17:07:46.806606+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': ['1', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:07:50.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-09-13T17:07:50.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.806237+0000', 'last_change': '2024-09-13T17:07:46.806237+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.806237+0000', 'last_undegraded': '2024-09-13T17:07:46.806237+0000', 'last_fullsized': '2024-09-13T17:07:46.806237+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': ['1', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:07:50.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-09-13T17:07:50.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.808836+0000', 'last_change': '2024-09-13T17:07:46.808836+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.808836+0000', 'last_undegraded': '2024-09-13T17:07:46.808836+0000', 'last_fullsized': '2024-09-13T17:07:46.808836+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:07:50.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-09-13T17:07:50.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.816307+0000', 'last_change': '2024-09-13T17:07:46.816307+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.816307+0000', 'last_undegraded': '2024-09-13T17:07:46.816307+0000', 'last_fullsized': '2024-09-13T17:07:46.816307+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:43:37.347764+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': ['6', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:07:50.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-09-13T17:07:50.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.813451+0000', 'last_change': '2024-09-13T17:07:46.813451+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.813451+0000', 'last_undegraded': '2024-09-13T17:07:46.813451+0000', 'last_fullsized': '2024-09-13T17:07:46.813451+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:32:47.788741+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': ['4', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:07:50.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-09-13T17:07:50.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 33, 'state': 'active', 'last_fresh': '2024-09-13T17:07:46.829660+0000', 'last_change': '2024-09-13T17:07:46.829622+0000', 'last_active': '2024-09-13T17:07:46.829660+0000', 'last_peered': '2024-09-13T17:07:46.829660+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '2024-09-13T17:07:46.829622+0000', 'last_became_peered': '2024-09-13T17:07:46.829622+0000', 'last_unstale': '2024-09-13T17:07:46.829660+0000', 'last_undegraded': '2024-09-13T17:07:46.829660+0000', 'last_fullsized': '2024-09-13T17:07:46.829660+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': ['5', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:07:50.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-09-13T17:07:50.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.808768+0000', 'last_change': '2024-09-13T17:07:46.808768+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.808768+0000', 'last_undegraded': '2024-09-13T17:07:46.808768+0000', 'last_fullsized': '2024-09-13T17:07:46.808768+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:07:50.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-09-13T17:07:50.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.819042+0000', 'last_change': '2024-09-13T17:07:46.814192+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.819042+0000', 'last_undegraded': '2024-09-13T17:07:46.819042+0000', 'last_fullsized': '2024-09-13T17:07:46.819042+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:01:32.097160+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': ['2', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:07:50.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-09-13T17:07:50.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.814124+0000', 'last_change': '2024-09-13T17:07:46.814124+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.814124+0000', 'last_undegraded': '2024-09-13T17:07:46.814124+0000', 'last_fullsized': '2024-09-13T17:07:46.814124+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:25:26.636631+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': ['2', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:07:50.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-09-13T17:07:50.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.819701+0000', 'last_change': '2024-09-13T17:07:46.814919+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.819701+0000', 'last_undegraded': '2024-09-13T17:07:46.819701+0000', 'last_fullsized': '2024-09-13T17:07:46.819701+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:37:07.079254+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': ['2', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:07:50.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-09-13T17:07:50.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.817655+0000', 'last_change': '2024-09-13T17:07:46.813515+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.817655+0000', 'last_undegraded': '2024-09-13T17:07:46.817655+0000', 'last_fullsized': '2024-09-13T17:07:46.817655+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:00:33.883750+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': ['2', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:07:50.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-09-13T17:07:50.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.807398+0000', 'last_change': '2024-09-13T17:07:46.807398+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.807398+0000', 'last_undegraded': '2024-09-13T17:07:46.807398+0000', 'last_fullsized': '2024-09-13T17:07:46.807398+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': ['7', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:07:50.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-09-13T17:07:50.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-09-13T17:07:46.814196+0000', 'last_change': '2024-09-13T17:07:46.814196+0000', 'last_active': '2024-09-13T17:07:46.436012+0000', 'last_peered': '2024-09-13T17:07:46.436012+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:07:46.814196+0000', 'last_undegraded': '2024-09-13T17:07:46.814196+0000', 'last_fullsized': '2024-09-13T17:07:46.814196+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:43:37.347764+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': ['2', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:07:50.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-09-13T17:07:50.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 33, 'state': 'active', 'last_fresh': '2024-09-13T17:07:46.821323+0000', 'last_change': '2024-09-13T17:07:46.821260+0000', 'last_active': '2024-09-13T17:07:46.821323+0000', 'last_peered': '2024-09-13T17:07:46.821323+0000', 'last_clean': '2024-09-13T17:07:46.436012+0000', 'last_became_active': '2024-09-13T17:07:46.821260+0000', 'last_became_peered': '2024-09-13T17:07:46.821260+0000', 'last_unstale': '2024-09-13T17:07:46.821323+0000', 'last_undegraded': '2024-09-13T17:07:46.821323+0000', 'last_fullsized': '2024-09-13T17:07:46.821323+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'last_clean_scrub_stamp': '2024-09-13T17:07:46.436012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:26:36.033290+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': ['7', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:07:50.546 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T17:07:50.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 Processor -- start 2024-09-13T17:07:50.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 -- start start 2024-09-13T17:07:50.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadb015e920 0x7fadb00caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fadb00cb020 0x7fadb0161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb0162550 con 0x7fadb015ed00 2024-09-13T17:07:50.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb00cd690 con 0x7fadb00cb020 2024-09-13T17:07:50.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb0161f90 con 0x7fadb015e920 2024-09-13T17:07:50.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadadd9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fadb00cb020 0x7fadb0161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadadd9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fadb00cb020 0x7fadb0161540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44404/0 (socket says 172.21.15.123:44404) 2024-09-13T17:07:50.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadadd9b700 1 -- 172.21.15.123:0/2020882994 learned_addr learned my addr 172.21.15.123:0/2020882994 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:50.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaed9d700 1 --1- 172.21.15.123:0/2020882994 >> v1:172.21.15.123:6789/0 conn(0x7fadb015ed00 0x7fadb00cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41830/0 (socket says 172.21.15.123:41830) 2024-09-13T17:07:50.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadae59c700 1 --2- 172.21.15.123:0/2020882994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadb015e920 0x7fadb00caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadadd9b700 1 -- 172.21.15.123:0/2020882994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadb015e920 msgr2=0x7fadb00caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:50.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadadd9b700 1 --2- 172.21.15.123:0/2020882994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadb015e920 0x7fadb00caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadadd9b700 1 -- 172.21.15.123:0/2020882994 >> v1:172.21.15.123:6789/0 conn(0x7fadb015ed00 legacy=0x7fadb00cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadadd9b700 1 -- 172.21.15.123:0/2020882994 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb0162270 con 0x7fadb00cb020 2024-09-13T17:07:50.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadadd9b700 1 --2- 172.21.15.123:0/2020882994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadb00cb020 0x7fadb0161540 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fada8009e50 tx=0x7fada800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82cfadef960c2774 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:50.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadad59a700 1 -- 172.21.15.123:0/2020882994 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada800e070 con 0x7fadb00cb020 2024-09-13T17:07:50.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadad59a700 1 -- 172.21.15.123:0/2020882994 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada800b9c0 con 0x7fadb00cb020 2024-09-13T17:07:50.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadad59a700 1 -- 172.21.15.123:0/2020882994 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada800bd70 con 0x7fadb00cb020 2024-09-13T17:07:50.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 -- 172.21.15.123:0/2020882994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadb00cb020 msgr2=0x7fadb0161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 --2- 172.21.15.123:0/2020882994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadb00cb020 0x7fadb0161540 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fada8009e50 tx=0x7fada800b330 comp rx=0 tx=0).stop 2024-09-13T17:07:50.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 -- 172.21.15.123:0/2020882994 shutdown_connections 2024-09-13T17:07:50.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 --2- 172.21.15.123:0/2020882994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadb00cb020 0x7fadb0161540 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 --2- 172.21.15.123:0/2020882994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadb015e920 0x7fadb00caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 -- 172.21.15.123:0/2020882994 >> 172.21.15.123:0/2020882994 conn(0x7fadb0066150 msgr2=0x7fadb0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:50.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 -- 172.21.15.123:0/2020882994 shutdown_connections 2024-09-13T17:07:50.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.657+0000 7fadaf59e700 1 -- 172.21.15.123:0/2020882994 wait complete. 2024-09-13T17:07:50.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadaf59e700 1 Processor -- start 2024-09-13T17:07:50.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadaf59e700 1 -- start start 2024-09-13T17:07:50.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadaf59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadb00cb020 0x7fadb00c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadaf59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadb015e920 0x7fadb0155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadaf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb015ed00 0x7fadb00c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadaf59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb00c5270 con 0x7fadb015e920 2024-09-13T17:07:50.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadaf59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb0156440 con 0x7fadb015ed00 2024-09-13T17:07:50.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadaf59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb01587f0 con 0x7fadb00cb020 2024-09-13T17:07:50.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadadd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadb015e920 0x7fadb0155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadadd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadb015e920 0x7fadb0155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44420/0 (socket says 172.21.15.123:44420) 2024-09-13T17:07:50.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadadd9b700 1 -- 172.21.15.123:0/2767296302 learned_addr learned my addr 172.21.15.123:0/2767296302 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:50.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadae59c700 1 --2- 172.21.15.123:0/2767296302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadb00cb020 0x7fadb00c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadaed9d700 1 --2- 172.21.15.123:0/2767296302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb015ed00 0x7fadb00c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadadd9b700 1 -- 172.21.15.123:0/2767296302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadb00cb020 msgr2=0x7fadb00c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadadd9b700 1 --2- 172.21.15.123:0/2767296302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadb00cb020 0x7fadb00c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadadd9b700 1 -- 172.21.15.123:0/2767296302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb015ed00 msgr2=0x7fadb00c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadadd9b700 1 --2- 172.21.15.123:0/2767296302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb015ed00 0x7fadb00c3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.661+0000 7fadadd9b700 1 -- 172.21.15.123:0/2767296302 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada8009b30 con 0x7fadb015e920 2024-09-13T17:07:50.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.665+0000 7fadadd9b700 1 --2- 172.21.15.123:0/2767296302 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadb015e920 0x7fadb0155f00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fada800b370 tx=0x7fada8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:50.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.665+0000 7fada6ffd700 1 -- 172.21.15.123:0/2767296302 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8004800 con 0x7fadb015e920 2024-09-13T17:07:50.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.665+0000 7fada6ffd700 1 -- 172.21.15.123:0/2767296302 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada80092e0 con 0x7fadb015e920 2024-09-13T17:07:50.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.665+0000 7fadaf59e700 1 -- 172.21.15.123:0/2767296302 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb0158ad0 con 0x7fadb015e920 2024-09-13T17:07:50.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.665+0000 7fada6ffd700 1 -- 172.21.15.123:0/2767296302 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada801c680 con 0x7fadb015e920 2024-09-13T17:07:50.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.665+0000 7fadaf59e700 1 -- 172.21.15.123:0/2767296302 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb0159090 con 0x7fadb015e920 2024-09-13T17:07:50.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.665+0000 7fada6ffd700 1 -- 172.21.15.123:0/2767296302 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fada801c7e0 con 0x7fadb015e920 2024-09-13T17:07:50.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.665+0000 7fadaf59e700 1 -- 172.21.15.123:0/2767296302 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb00677f0 con 0x7fadb015e920 2024-09-13T17:07:50.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.665+0000 7fada6ffd700 1 --2- 172.21.15.123:0/2767296302 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fad90066730 0x7fad90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.665+0000 7fadae59c700 1 --2- 172.21.15.123:0/2767296302 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fad90066730 0x7fad90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.665+0000 7fada6ffd700 1 -- 172.21.15.123:0/2767296302 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fada8085a20 con 0x7fadb015e920 2024-09-13T17:07:50.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.669+0000 7fadae59c700 1 --2- 172.21.15.123:0/2767296302 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fad90066730 0x7fad90068bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fadb01fa350 tx=0x7fad98008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:50.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.673+0000 7fada6ffd700 1 -- 172.21.15.123:0/2767296302 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fada8052d80 con 0x7fadb015e920 2024-09-13T17:07:50.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.908+0000 7fadaf59e700 1 -- 172.21.15.123:0/2767296302 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fadb00caae0 con 0x7fadb015e920 2024-09-13T17:07:50.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.908+0000 7fada6ffd700 1 -- 172.21.15.123:0/2767296302 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1616 (secure 0 0 0) 0x7fada80563a0 con 0x7fadb015e920 2024-09-13T17:07:50.912 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:50.912 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":86,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1726247195,"num_in_osds":8,"osd_in_since":1726247186,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":69},{"state_name":"creating+activating","count":26},{"state_name":"active","count":2}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225349632,"bytes_avail":772868763648,"bytes_total":773094113280,"inactive_pgs_ratio":0.2680412232875824},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5256}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-13T17:07:38.751951+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T17:07:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.912+0000 7fadaf59e700 1 -- 172.21.15.123:0/2767296302 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fad90066730 msgr2=0x7fad90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.912+0000 7fadaf59e700 1 --2- 172.21.15.123:0/2767296302 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fad90066730 0x7fad90068bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fadb01fa350 tx=0x7fad98008040 comp rx=0 tx=0).stop 2024-09-13T17:07:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.912+0000 7fadaf59e700 1 -- 172.21.15.123:0/2767296302 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadb015e920 msgr2=0x7fadb0155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.912+0000 7fadaf59e700 1 --2- 172.21.15.123:0/2767296302 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadb015e920 0x7fadb0155f00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fada800b370 tx=0x7fada8004af0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.912+0000 7fadaf59e700 1 -- 172.21.15.123:0/2767296302 shutdown_connections 2024-09-13T17:07:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.912+0000 7fadaf59e700 1 --2- 172.21.15.123:0/2767296302 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fad90066730 0x7fad90068bf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.912+0000 7fadaf59e700 1 --2- 172.21.15.123:0/2767296302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadb015ed00 0x7fadb00c3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.912+0000 7fadaf59e700 1 --2- 172.21.15.123:0/2767296302 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fadb015e920 0x7fadb0155f00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.912+0000 7fadaf59e700 1 --2- 172.21.15.123:0/2767296302 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fadb00cb020 0x7fadb00c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.912+0000 7fadaf59e700 1 -- 172.21.15.123:0/2767296302 >> 172.21.15.123:0/2767296302 conn(0x7fadb0066150 msgr2=0x7fadb0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.912+0000 7fadaf59e700 1 -- 172.21.15.123:0/2767296302 shutdown_connections 2024-09-13T17:07:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:50.912+0000 7fadaf59e700 1 -- 172.21.15.123:0/2767296302 wait complete. 2024-09-13T17:07:50.926 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T17:07:50.927 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:07:51.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9ea4c6b700 1 Processor -- start 2024-09-13T17:07:51.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9ea4c6b700 1 -- start start 2024-09-13T17:07:51.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9ea4c6b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ea015aa80 0x7f9ea015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:51.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9ea4c6b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ea00cec90 0x7f9ea00cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:51.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9ea4c6b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea00b1cf0 con 0x7f9ea0072510 2024-09-13T17:07:51.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9ea4c6b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea015ae60 con 0x7f9ea015aa80 2024-09-13T17:07:51.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9ea4c6b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00cf660 con 0x7f9ea00cec90 2024-09-13T17:07:51.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9e9ed9d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ea00cec90 0x7f9ea00cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:51.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9e9e59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ea015aa80 0x7f9ea015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:51.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9e9ed9d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ea00cec90 0x7f9ea00cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:46984/0 (socket says 172.21.15.123:46984) 2024-09-13T17:07:51.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9e9ed9d700 1 -- 172.21.15.123:0/815247686 learned_addr learned my addr 172.21.15.123:0/815247686 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:51.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9e9ed9d700 1 -- 172.21.15.123:0/815247686 >> v2:172.21.15.153:3300/0 conn(0x7f9ea015aa80 msgr2=0x7f9ea015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:51.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9e9ed9d700 1 --2- 172.21.15.123:0/815247686 >> v2:172.21.15.153:3300/0 conn(0x7f9ea015aa80 0x7f9ea015b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:51.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9e9ed9d700 1 -- 172.21.15.123:0/815247686 >> v1:172.21.15.153:6789/0 conn(0x7f9ea0072510 legacy=0x7f9ea00cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:51.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9e9ed9d700 1 -- 172.21.15.123:0/815247686 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea015bf00 con 0x7f9ea00cec90 2024-09-13T17:07:51.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9e9ed9d700 1 --2- 172.21.15.123:0/815247686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ea00cec90 0x7f9ea00cf120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009e50 tx=0x7f9e9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17f1a6db943ce829 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:51.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9e9dd9b700 1 -- 172.21.15.123:0/815247686 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800e070 con 0x7f9ea00cec90 2024-09-13T17:07:51.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9e9dd9b700 1 -- 172.21.15.123:0/815247686 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9800b910 con 0x7f9ea00cec90 2024-09-13T17:07:51.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9e9dd9b700 1 -- 172.21.15.123:0/815247686 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800bcc0 con 0x7f9ea00cec90 2024-09-13T17:07:51.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/815247686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ea00cec90 msgr2=0x7f9ea00cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:51.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9ea4c6b700 1 --2- 172.21.15.123:0/815247686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ea00cec90 0x7f9ea00cf120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009e50 tx=0x7f9e9800b330 comp rx=0 tx=0).stop 2024-09-13T17:07:51.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/815247686 shutdown_connections 2024-09-13T17:07:51.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9ea4c6b700 1 --2- 172.21.15.123:0/815247686 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ea00cec90 0x7f9ea00cf120 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:51.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9ea4c6b700 1 --2- 172.21.15.123:0/815247686 >> v2:172.21.15.153:3300/0 conn(0x7f9ea015aa80 0x7f9ea015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:51.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.040+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/815247686 >> 172.21.15.123:0/815247686 conn(0x7f9ea0066570 msgr2=0x7f9ea0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:51.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/815247686 shutdown_connections 2024-09-13T17:07:51.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/815247686 wait complete. 2024-09-13T17:07:51.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9ea4c6b700 1 Processor -- start 2024-09-13T17:07:51.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9ea4c6b700 1 -- start start 2024-09-13T17:07:51.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9ea4c6b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ea0072510 0x7f9ea0154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:51.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9ea4c6b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ea00cec90 0x7f9ea00cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:51.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9ea4c6b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea015aa80 0x7f9ea00b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:51.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9ea4c6b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea0151580 con 0x7f9ea0072510 2024-09-13T17:07:51.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9ea4c6b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea01f2510 con 0x7f9ea015aa80 2024-09-13T17:07:51.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9ea4c6b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea01f2720 con 0x7f9ea00cec90 2024-09-13T17:07:51.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9e9e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ea0072510 0x7f9ea0154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:51.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9e97fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ea00cec90 0x7f9ea00cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:51.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9e9e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ea0072510 0x7f9ea0154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44424/0 (socket says 172.21.15.123:44424) 2024-09-13T17:07:51.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9e9e59c700 1 -- 172.21.15.123:0/1965276856 learned_addr learned my addr 172.21.15.123:0/1965276856 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:51.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.044+0000 7f9e9ed9d700 1 --2- 172.21.15.123:0/1965276856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea015aa80 0x7f9ea00b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:51.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.048+0000 7f9e9e59c700 1 -- 172.21.15.123:0/1965276856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ea00cec90 msgr2=0x7f9ea00cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:51.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.048+0000 7f9e9e59c700 1 --2- 172.21.15.123:0/1965276856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ea00cec90 0x7f9ea00cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:51.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.048+0000 7f9e9e59c700 1 -- 172.21.15.123:0/1965276856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea015aa80 msgr2=0x7f9ea00b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:51.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.048+0000 7f9e9e59c700 1 --2- 172.21.15.123:0/1965276856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea015aa80 0x7f9ea00b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:51.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.048+0000 7f9e9e59c700 1 -- 172.21.15.123:0/1965276856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98009b30 con 0x7f9ea0072510 2024-09-13T17:07:51.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.048+0000 7f9e9e59c700 1 --2- 172.21.15.123:0/1965276856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ea0072510 0x7f9ea0154050 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000e840 tx=0x7f9e9000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:51.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.048+0000 7f9e96ffd700 1 -- 172.21.15.123:0/1965276856 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e900095a0 con 0x7f9ea0072510 2024-09-13T17:07:51.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.048+0000 7f9e96ffd700 1 -- 172.21.15.123:0/1965276856 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e90013680 con 0x7f9ea0072510 2024-09-13T17:07:51.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.048+0000 7f9e96ffd700 1 -- 172.21.15.123:0/1965276856 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e900139f0 con 0x7f9ea0072510 2024-09-13T17:07:51.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.048+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/1965276856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea01f2ca0 con 0x7f9ea0072510 2024-09-13T17:07:51.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.048+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/1965276856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea01f3260 con 0x7f9ea0072510 2024-09-13T17:07:51.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.048+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/1965276856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea00b3150 con 0x7f9ea0072510 2024-09-13T17:07:51.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.052+0000 7f9e96ffd700 1 -- 172.21.15.123:0/1965276856 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9e90013b50 con 0x7f9ea0072510 2024-09-13T17:07:51.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.052+0000 7f9e96ffd700 1 --2- 172.21.15.123:0/1965276856 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e80066730 0x7f9e80068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:51.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.052+0000 7f9e97fff700 1 --2- 172.21.15.123:0/1965276856 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e80066730 0x7f9e80068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:51.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.052+0000 7f9e96ffd700 1 -- 172.21.15.123:0/1965276856 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e90083fa0 con 0x7f9ea0072510 2024-09-13T17:07:51.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.052+0000 7f9e97fff700 1 --2- 172.21.15.123:0/1965276856 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e80066730 0x7f9e80068bf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00caa50 tx=0x7f9e88009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:51.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.060+0000 7f9e96ffd700 1 -- 172.21.15.123:0/1965276856 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9e900b5db0 con 0x7f9ea0072510 2024-09-13T17:07:51.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.228+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/1965276856 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ea00cbfc0 con 0x7f9e80066730 2024-09-13T17:07:51.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.236+0000 7f9e96ffd700 1 -- 172.21.15.123:0/1965276856 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286895 (secure 0 0 0) 0x7f9ea00cbfc0 con 0x7f9e80066730 2024-09-13T17:07:51.244 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:51.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.240+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/1965276856 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e80066730 msgr2=0x7f9e80068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:51.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.240+0000 7f9ea4c6b700 1 --2- 172.21.15.123:0/1965276856 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e80066730 0x7f9e80068bf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00caa50 tx=0x7f9e88009040 comp rx=0 tx=0).stop 2024-09-13T17:07:51.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.240+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/1965276856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ea0072510 msgr2=0x7f9ea0154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:51.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.240+0000 7f9ea4c6b700 1 --2- 172.21.15.123:0/1965276856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ea0072510 0x7f9ea0154050 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000e840 tx=0x7f9e9000eb50 comp rx=0 tx=0).stop 2024-09-13T17:07:51.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.240+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/1965276856 shutdown_connections 2024-09-13T17:07:51.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.240+0000 7f9ea4c6b700 1 --2- 172.21.15.123:0/1965276856 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e80066730 0x7f9e80068bf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:51.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.240+0000 7f9ea4c6b700 1 --2- 172.21.15.123:0/1965276856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea015aa80 0x7f9ea00b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:51.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.240+0000 7f9ea4c6b700 1 --2- 172.21.15.123:0/1965276856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ea00cec90 0x7f9ea00cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:51.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.240+0000 7f9ea4c6b700 1 --2- 172.21.15.123:0/1965276856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ea0072510 0x7f9ea0154050 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:51.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.240+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/1965276856 >> 172.21.15.123:0/1965276856 conn(0x7f9ea0066570 msgr2=0x7f9ea015d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:51.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.240+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/1965276856 shutdown_connections 2024-09-13T17:07:51.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:51.240+0000 7f9ea4c6b700 1 -- 172.21.15.123:0/1965276856 wait complete. 2024-09-13T17:07:51.247 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:07:51.257 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-09-13T17:07:50.755003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220068,"kb_used_data":3904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754652,"statfs":{"total":773094113280,"available":772868763648,"internally_reserved":0,"allocated":3997696,"data_stored":2253630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.301204"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825404+0000","last_change":"2024-09-13T17:07:46.825404+0000","last_active":"2024-09-13T17:07:46.825404+0000","last_peered":"2024-09-13T17:07:46.825404+0000","last_clean":"2024-09-13T17:07:46.825404+0000","last_became_active":"2024-09-13T17:07:46.825157+0000","last_became_peered":"2024-09-13T17:07:46.825157+0000","last_unstale":"2024-09-13T17:07:46.825404+0000","last_undegraded":"2024-09-13T17:07:46.825404+0000","last_fullsized":"2024-09-13T17:07:46.825404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:08.819755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821865+0000","last_change":"2024-09-13T17:07:46.821865+0000","last_active":"2024-09-13T17:07:46.821865+0000","last_peered":"2024-09-13T17:07:46.821865+0000","last_clean":"2024-09-13T17:07:46.821865+0000","last_became_active":"2024-09-13T17:07:46.821335+0000","last_became_peered":"2024-09-13T17:07:46.821335+0000","last_unstale":"2024-09-13T17:07:46.821865+0000","last_undegraded":"2024-09-13T17:07:46.821865+0000","last_fullsized":"2024-09-13T17:07:46.821865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:19.871674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821251+0000","last_change":"2024-09-13T17:07:46.821251+0000","last_active":"2024-09-13T17:07:46.821251+0000","last_peered":"2024-09-13T17:07:46.821251+0000","last_clean":"2024-09-13T17:07:46.821251+0000","last_became_active":"2024-09-13T17:07:46.820956+0000","last_became_peered":"2024-09-13T17:07:46.820956+0000","last_unstale":"2024-09-13T17:07:46.821251+0000","last_undegraded":"2024-09-13T17:07:46.821251+0000","last_fullsized":"2024-09-13T17:07:46.821251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807336+0000","last_change":"2024-09-13T17:07:46.807336+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807336+0000","last_undegraded":"2024-09-13T17:07:46.807336+0000","last_fullsized":"2024-09-13T17:07:46.807336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.815482+0000","last_change":"2024-09-13T17:07:46.815482+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.815482+0000","last_undegraded":"2024-09-13T17:07:46.815482+0000","last_fullsized":"2024-09-13T17:07:46.815482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.812028+0000","last_change":"2024-09-13T17:07:46.812028+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.812028+0000","last_undegraded":"2024-09-13T17:07:46.812028+0000","last_fullsized":"2024-09-13T17:07:46.812028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807911+0000","last_change":"2024-09-13T17:07:46.807911+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807911+0000","last_undegraded":"2024-09-13T17:07:46.807911+0000","last_fullsized":"2024-09-13T17:07:46.807911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808191+0000","last_change":"2024-09-13T17:07:46.808191+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808191+0000","last_undegraded":"2024-09-13T17:07:46.808191+0000","last_fullsized":"2024-09-13T17:07:46.808191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:34.528334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.826617+0000","last_change":"2024-09-13T17:07:46.826617+0000","last_active":"2024-09-13T17:07:46.826617+0000","last_peered":"2024-09-13T17:07:46.826617+0000","last_clean":"2024-09-13T17:07:46.826617+0000","last_became_active":"2024-09-13T17:07:46.826339+0000","last_became_peered":"2024-09-13T17:07:46.826339+0000","last_unstale":"2024-09-13T17:07:46.826617+0000","last_undegraded":"2024-09-13T17:07:46.826617+0000","last_fullsized":"2024-09-13T17:07:46.826617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:27.800734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815960+0000","last_change":"2024-09-13T17:07:46.815960+0000","last_active":"2024-09-13T17:07:46.815960+0000","last_peered":"2024-09-13T17:07:46.815960+0000","last_clean":"2024-09-13T17:07:46.815960+0000","last_became_active":"2024-09-13T17:07:46.815778+0000","last_became_peered":"2024-09-13T17:07:46.815778+0000","last_unstale":"2024-09-13T17:07:46.815960+0000","last_undegraded":"2024-09-13T17:07:46.815960+0000","last_fullsized":"2024-09-13T17:07:46.815960+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.813819+0000","last_change":"2024-09-13T17:07:46.812036+0000","last_active":"2024-09-13T17:07:46.813819+0000","last_peered":"2024-09-13T17:07:46.813819+0000","last_clean":"2024-09-13T17:07:46.813819+0000","last_became_active":"2024-09-13T17:07:46.811777+0000","last_became_peered":"2024-09-13T17:07:46.811777+0000","last_unstale":"2024-09-13T17:07:46.813819+0000","last_undegraded":"2024-09-13T17:07:46.813819+0000","last_fullsized":"2024-09-13T17:07:46.813819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824951+0000","last_change":"2024-09-13T17:07:46.824951+0000","last_active":"2024-09-13T17:07:46.824951+0000","last_peered":"2024-09-13T17:07:46.824951+0000","last_clean":"2024-09-13T17:07:46.824951+0000","last_became_active":"2024-09-13T17:07:46.824657+0000","last_became_peered":"2024-09-13T17:07:46.824657+0000","last_unstale":"2024-09-13T17:07:46.824951+0000","last_undegraded":"2024-09-13T17:07:46.824951+0000","last_fullsized":"2024-09-13T17:07:46.824951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:19.871674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.819466+0000","last_change":"2024-09-13T17:07:46.819466+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.819466+0000","last_undegraded":"2024-09-13T17:07:46.819466+0000","last_fullsized":"2024-09-13T17:07:46.819466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:12.951389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824808+0000","last_change":"2024-09-13T17:07:46.824808+0000","last_active":"2024-09-13T17:07:46.824808+0000","last_peered":"2024-09-13T17:07:46.824808+0000","last_clean":"2024-09-13T17:07:46.824808+0000","last_became_active":"2024-09-13T17:07:46.824588+0000","last_became_peered":"2024-09-13T17:07:46.824588+0000","last_unstale":"2024-09-13T17:07:46.824808+0000","last_undegraded":"2024-09-13T17:07:46.824808+0000","last_fullsized":"2024-09-13T17:07:46.824808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824436+0000","last_change":"2024-09-13T17:07:46.824436+0000","last_active":"2024-09-13T17:07:46.824436+0000","last_peered":"2024-09-13T17:07:46.824436+0000","last_clean":"2024-09-13T17:07:46.824436+0000","last_became_active":"2024-09-13T17:07:46.822126+0000","last_became_peered":"2024-09-13T17:07:46.822126+0000","last_unstale":"2024-09-13T17:07:46.824436+0000","last_undegraded":"2024-09-13T17:07:46.824436+0000","last_fullsized":"2024-09-13T17:07:46.824436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:26.583203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.817868+0000","last_change":"2024-09-13T17:07:46.814681+0000","last_active":"2024-09-13T17:07:46.817868+0000","last_peered":"2024-09-13T17:07:46.817868+0000","last_clean":"2024-09-13T17:07:46.817868+0000","last_became_active":"2024-09-13T17:07:46.814398+0000","last_became_peered":"2024-09-13T17:07:46.814398+0000","last_unstale":"2024-09-13T17:07:46.817868+0000","last_undegraded":"2024-09-13T17:07:46.817868+0000","last_fullsized":"2024-09-13T17:07:46.817868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807614+0000","last_change":"2024-09-13T17:07:46.807614+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807614+0000","last_undegraded":"2024-09-13T17:07:46.807614+0000","last_fullsized":"2024-09-13T17:07:46.807614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824754+0000","last_change":"2024-09-13T17:07:46.824754+0000","last_active":"2024-09-13T17:07:46.824754+0000","last_peered":"2024-09-13T17:07:46.824754+0000","last_clean":"2024-09-13T17:07:46.824754+0000","last_became_active":"2024-09-13T17:07:46.824491+0000","last_became_peered":"2024-09-13T17:07:46.824491+0000","last_unstale":"2024-09-13T17:07:46.824754+0000","last_undegraded":"2024-09-13T17:07:46.824754+0000","last_fullsized":"2024-09-13T17:07:46.824754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822199+0000","last_change":"2024-09-13T17:07:46.822199+0000","last_active":"2024-09-13T17:07:46.822199+0000","last_peered":"2024-09-13T17:07:46.822199+0000","last_clean":"2024-09-13T17:07:46.822199+0000","last_became_active":"2024-09-13T17:07:46.821039+0000","last_became_peered":"2024-09-13T17:07:46.821039+0000","last_unstale":"2024-09-13T17:07:46.822199+0000","last_undegraded":"2024-09-13T17:07:46.822199+0000","last_fullsized":"2024-09-13T17:07:46.822199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.815297+0000","last_change":"2024-09-13T17:07:46.815297+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.815297+0000","last_undegraded":"2024-09-13T17:07:46.815297+0000","last_fullsized":"2024-09-13T17:07:46.815297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:56.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824875+0000","last_change":"2024-09-13T17:07:46.824875+0000","last_active":"2024-09-13T17:07:46.824875+0000","last_peered":"2024-09-13T17:07:46.824875+0000","last_clean":"2024-09-13T17:07:46.824875+0000","last_became_active":"2024-09-13T17:07:46.819999+0000","last_became_peered":"2024-09-13T17:07:46.819999+0000","last_unstale":"2024-09-13T17:07:46.824875+0000","last_undegraded":"2024-09-13T17:07:46.824875+0000","last_fullsized":"2024-09-13T17:07:46.824875+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:20.464724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824665+0000","last_change":"2024-09-13T17:07:46.824665+0000","last_active":"2024-09-13T17:07:46.824665+0000","last_peered":"2024-09-13T17:07:46.824665+0000","last_clean":"2024-09-13T17:07:46.824665+0000","last_became_active":"2024-09-13T17:07:46.820399+0000","last_became_peered":"2024-09-13T17:07:46.820399+0000","last_unstale":"2024-09-13T17:07:46.824665+0000","last_undegraded":"2024-09-13T17:07:46.824665+0000","last_fullsized":"2024-09-13T17:07:46.824665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:50.541570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815664+0000","last_change":"2024-09-13T17:07:46.811674+0000","last_active":"2024-09-13T17:07:46.815664+0000","last_peered":"2024-09-13T17:07:46.815664+0000","last_clean":"2024-09-13T17:07:46.815664+0000","last_became_active":"2024-09-13T17:07:46.811449+0000","last_became_peered":"2024-09-13T17:07:46.811449+0000","last_unstale":"2024-09-13T17:07:46.815664+0000","last_undegraded":"2024-09-13T17:07:46.815664+0000","last_fullsized":"2024-09-13T17:07:46.815664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:20.464724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.812767+0000","last_change":"2024-09-13T17:07:46.812767+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.812767+0000","last_undegraded":"2024-09-13T17:07:46.812767+0000","last_fullsized":"2024-09-13T17:07:46.812767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818395+0000","last_change":"2024-09-13T17:07:46.818395+0000","last_active":"2024-09-13T17:07:46.818395+0000","last_peered":"2024-09-13T17:07:46.818395+0000","last_clean":"2024-09-13T17:07:46.818395+0000","last_became_active":"2024-09-13T17:07:46.817022+0000","last_became_peered":"2024-09-13T17:07:46.817022+0000","last_unstale":"2024-09-13T17:07:46.818395+0000","last_undegraded":"2024-09-13T17:07:46.818395+0000","last_fullsized":"2024-09-13T17:07:46.818395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822031+0000","last_change":"2024-09-13T17:07:46.822031+0000","last_active":"2024-09-13T17:07:46.822031+0000","last_peered":"2024-09-13T17:07:46.822031+0000","last_clean":"2024-09-13T17:07:46.822031+0000","last_became_active":"2024-09-13T17:07:46.821647+0000","last_became_peered":"2024-09-13T17:07:46.821647+0000","last_unstale":"2024-09-13T17:07:46.822031+0000","last_undegraded":"2024-09-13T17:07:46.822031+0000","last_fullsized":"2024-09-13T17:07:46.822031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807893+0000","last_change":"2024-09-13T17:07:46.807893+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807893+0000","last_undegraded":"2024-09-13T17:07:46.807893+0000","last_fullsized":"2024-09-13T17:07:46.807893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820791+0000","last_change":"2024-09-13T17:07:46.820791+0000","last_active":"2024-09-13T17:07:46.820791+0000","last_peered":"2024-09-13T17:07:46.820791+0000","last_clean":"2024-09-13T17:07:46.820791+0000","last_became_active":"2024-09-13T17:07:46.820457+0000","last_became_peered":"2024-09-13T17:07:46.820457+0000","last_unstale":"2024-09-13T17:07:46.820791+0000","last_undegraded":"2024-09-13T17:07:46.820791+0000","last_fullsized":"2024-09-13T17:07:46.820791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825418+0000","last_change":"2024-09-13T17:07:46.825418+0000","last_active":"2024-09-13T17:07:46.825418+0000","last_peered":"2024-09-13T17:07:46.825418+0000","last_clean":"2024-09-13T17:07:46.825418+0000","last_became_active":"2024-09-13T17:07:46.825165+0000","last_became_peered":"2024-09-13T17:07:46.825165+0000","last_unstale":"2024-09-13T17:07:46.825418+0000","last_undegraded":"2024-09-13T17:07:46.825418+0000","last_fullsized":"2024-09-13T17:07:46.825418+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:58.908098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.819149+0000","last_change":"2024-09-13T17:07:46.819149+0000","last_active":"2024-09-13T17:07:46.819149+0000","last_peered":"2024-09-13T17:07:46.819149+0000","last_clean":"2024-09-13T17:07:46.819149+0000","last_became_active":"2024-09-13T17:07:46.818880+0000","last_became_peered":"2024-09-13T17:07:46.818880+0000","last_unstale":"2024-09-13T17:07:46.819149+0000","last_undegraded":"2024-09-13T17:07:46.819149+0000","last_fullsized":"2024-09-13T17:07:46.819149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824186+0000","last_change":"2024-09-13T17:07:46.824186+0000","last_active":"2024-09-13T17:07:46.824186+0000","last_peered":"2024-09-13T17:07:46.824186+0000","last_clean":"2024-09-13T17:07:46.824186+0000","last_became_active":"2024-09-13T17:07:46.823935+0000","last_became_peered":"2024-09-13T17:07:46.823935+0000","last_unstale":"2024-09-13T17:07:46.824186+0000","last_undegraded":"2024-09-13T17:07:46.824186+0000","last_fullsized":"2024-09-13T17:07:46.824186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:58.908098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807784+0000","last_change":"2024-09-13T17:07:46.807784+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807784+0000","last_undegraded":"2024-09-13T17:07:46.807784+0000","last_fullsized":"2024-09-13T17:07:46.807784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815878+0000","last_change":"2024-09-13T17:07:46.812039+0000","last_active":"2024-09-13T17:07:46.815878+0000","last_peered":"2024-09-13T17:07:46.815878+0000","last_clean":"2024-09-13T17:07:46.815878+0000","last_became_active":"2024-09-13T17:07:46.811670+0000","last_became_peered":"2024-09-13T17:07:46.811670+0000","last_unstale":"2024-09-13T17:07:46.815878+0000","last_undegraded":"2024-09-13T17:07:46.815878+0000","last_fullsized":"2024-09-13T17:07:46.815878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:47.788741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818961+0000","last_change":"2024-09-13T17:07:46.462013+0000","last_active":"2024-09-13T17:07:46.818961+0000","last_peered":"2024-09-13T17:07:46.818961+0000","last_clean":"2024-09-13T17:07:46.818961+0000","last_became_active":"2024-09-13T17:07:46.461748+0000","last_became_peered":"2024-09-13T17:07:46.461748+0000","last_unstale":"2024-09-13T17:07:46.818961+0000","last_undegraded":"2024-09-13T17:07:46.818961+0000","last_fullsized":"2024-09-13T17:07:46.818961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.816525+0000","last_change":"2024-09-13T17:07:46.816525+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.816525+0000","last_undegraded":"2024-09-13T17:07:46.816525+0000","last_fullsized":"2024-09-13T17:07:46.816525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:56.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.805711+0000","last_change":"2024-09-13T17:07:46.460122+0000","last_active":"2024-09-13T17:07:46.805711+0000","last_peered":"2024-09-13T17:07:46.805711+0000","last_clean":"2024-09-13T17:07:46.805711+0000","last_became_active":"2024-09-13T17:07:46.459873+0000","last_became_peered":"2024-09-13T17:07:46.459873+0000","last_unstale":"2024-09-13T17:07:46.805711+0000","last_undegraded":"2024-09-13T17:07:46.805711+0000","last_fullsized":"2024-09-13T17:07:46.805711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:32.873876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824847+0000","last_change":"2024-09-13T17:07:46.824847+0000","last_active":"2024-09-13T17:07:46.824847+0000","last_peered":"2024-09-13T17:07:46.824847+0000","last_clean":"2024-09-13T17:07:46.824847+0000","last_became_active":"2024-09-13T17:07:46.820127+0000","last_became_peered":"2024-09-13T17:07:46.820127+0000","last_unstale":"2024-09-13T17:07:46.824847+0000","last_undegraded":"2024-09-13T17:07:46.824847+0000","last_fullsized":"2024-09-13T17:07:46.824847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:08.819755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812174+0000","last_change":"2024-09-13T17:07:46.460323+0000","last_active":"2024-09-13T17:07:46.812174+0000","last_peered":"2024-09-13T17:07:46.812174+0000","last_clean":"2024-09-13T17:07:46.812174+0000","last_became_active":"2024-09-13T17:07:46.459957+0000","last_became_peered":"2024-09-13T17:07:46.459957+0000","last_unstale":"2024-09-13T17:07:46.812174+0000","last_undegraded":"2024-09-13T17:07:46.812174+0000","last_fullsized":"2024-09-13T17:07:46.812174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:28.877530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.806382+0000","last_change":"2024-09-13T17:07:46.806382+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.806382+0000","last_undegraded":"2024-09-13T17:07:46.806382+0000","last_fullsized":"2024-09-13T17:07:46.806382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818133+0000","last_change":"2024-09-13T17:07:46.466176+0000","last_active":"2024-09-13T17:07:46.818133+0000","last_peered":"2024-09-13T17:07:46.818133+0000","last_clean":"2024-09-13T17:07:46.818133+0000","last_became_active":"2024-09-13T17:07:46.465971+0000","last_became_peered":"2024-09-13T17:07:46.465971+0000","last_unstale":"2024-09-13T17:07:46.818133+0000","last_undegraded":"2024-09-13T17:07:46.818133+0000","last_fullsized":"2024-09-13T17:07:46.818133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:16.394194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808020+0000","last_change":"2024-09-13T17:07:46.808020+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808020+0000","last_undegraded":"2024-09-13T17:07:46.808020+0000","last_fullsized":"2024-09-13T17:07:46.808020+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812955+0000","last_change":"2024-09-13T17:07:46.463243+0000","last_active":"2024-09-13T17:07:46.812955+0000","last_peered":"2024-09-13T17:07:46.812955+0000","last_clean":"2024-09-13T17:07:46.812955+0000","last_became_active":"2024-09-13T17:07:46.458515+0000","last_became_peered":"2024-09-13T17:07:46.458515+0000","last_unstale":"2024-09-13T17:07:46.812955+0000","last_undegraded":"2024-09-13T17:07:46.812955+0000","last_fullsized":"2024-09-13T17:07:46.812955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:50.939498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820780+0000","last_change":"2024-09-13T17:07:46.820780+0000","last_active":"2024-09-13T17:07:46.820780+0000","last_peered":"2024-09-13T17:07:46.820780+0000","last_clean":"2024-09-13T17:07:46.820780+0000","last_became_active":"2024-09-13T17:07:46.820475+0000","last_became_peered":"2024-09-13T17:07:46.820475+0000","last_unstale":"2024-09-13T17:07:46.820780+0000","last_undegraded":"2024-09-13T17:07:46.820780+0000","last_fullsized":"2024-09-13T17:07:46.820780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.827386+0000","last_change":"2024-09-13T17:07:46.458577+0000","last_active":"2024-09-13T17:07:46.827386+0000","last_peered":"2024-09-13T17:07:46.827386+0000","last_clean":"2024-09-13T17:07:46.827386+0000","last_became_active":"2024-09-13T17:07:46.458092+0000","last_became_peered":"2024-09-13T17:07:46.458092+0000","last_unstale":"2024-09-13T17:07:46.827386+0000","last_undegraded":"2024-09-13T17:07:46.827386+0000","last_fullsized":"2024-09-13T17:07:46.827386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:40.898298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825572+0000","last_change":"2024-09-13T17:07:46.825572+0000","last_active":"2024-09-13T17:07:46.825572+0000","last_peered":"2024-09-13T17:07:46.825572+0000","last_clean":"2024-09-13T17:07:46.825572+0000","last_became_active":"2024-09-13T17:07:46.825347+0000","last_became_peered":"2024-09-13T17:07:46.825347+0000","last_unstale":"2024-09-13T17:07:46.825572+0000","last_undegraded":"2024-09-13T17:07:46.825572+0000","last_fullsized":"2024-09-13T17:07:46.825572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811858+0000","last_change":"2024-09-13T17:07:46.468729+0000","last_active":"2024-09-13T17:07:46.811858+0000","last_peered":"2024-09-13T17:07:46.811858+0000","last_clean":"2024-09-13T17:07:46.811858+0000","last_became_active":"2024-09-13T17:07:46.468433+0000","last_became_peered":"2024-09-13T17:07:46.468433+0000","last_unstale":"2024-09-13T17:07:46.811858+0000","last_undegraded":"2024-09-13T17:07:46.811858+0000","last_fullsized":"2024-09-13T17:07:46.811858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:31.087286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.806606+0000","last_change":"2024-09-13T17:07:46.806606+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.806606+0000","last_undegraded":"2024-09-13T17:07:46.806606+0000","last_fullsized":"2024-09-13T17:07:46.806606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.819903+0000","last_change":"2024-09-13T17:07:46.459288+0000","last_active":"2024-09-13T17:07:46.819903+0000","last_peered":"2024-09-13T17:07:46.819903+0000","last_clean":"2024-09-13T17:07:46.819903+0000","last_became_active":"2024-09-13T17:07:46.459007+0000","last_became_peered":"2024-09-13T17:07:46.459007+0000","last_unstale":"2024-09-13T17:07:46.819903+0000","last_undegraded":"2024-09-13T17:07:46.819903+0000","last_fullsized":"2024-09-13T17:07:46.819903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:29.395885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.826627+0000","last_change":"2024-09-13T17:07:46.826627+0000","last_active":"2024-09-13T17:07:46.826627+0000","last_peered":"2024-09-13T17:07:46.826627+0000","last_clean":"2024-09-13T17:07:46.826627+0000","last_became_active":"2024-09-13T17:07:46.826393+0000","last_became_peered":"2024-09-13T17:07:46.826393+0000","last_unstale":"2024-09-13T17:07:46.826627+0000","last_undegraded":"2024-09-13T17:07:46.826627+0000","last_fullsized":"2024-09-13T17:07:46.826627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.815309+0000","last_change":"2024-09-13T17:07:46.461106+0000","last_active":"2024-09-13T17:07:46.815309+0000","last_peered":"2024-09-13T17:07:46.815309+0000","last_clean":"2024-09-13T17:07:46.815309+0000","last_became_active":"2024-09-13T17:07:46.460874+0000","last_became_peered":"2024-09-13T17:07:46.460874+0000","last_unstale":"2024-09-13T17:07:46.815309+0000","last_undegraded":"2024-09-13T17:07:46.815309+0000","last_fullsized":"2024-09-13T17:07:46.815309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:32.873876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821371+0000","last_change":"2024-09-13T17:07:46.821371+0000","last_active":"2024-09-13T17:07:46.821371+0000","last_peered":"2024-09-13T17:07:46.821371+0000","last_clean":"2024-09-13T17:07:46.821371+0000","last_became_active":"2024-09-13T17:07:46.821128+0000","last_became_peered":"2024-09-13T17:07:46.821128+0000","last_unstale":"2024-09-13T17:07:46.821371+0000","last_undegraded":"2024-09-13T17:07:46.821371+0000","last_fullsized":"2024-09-13T17:07:46.821371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.805842+0000","last_change":"2024-09-13T17:07:46.463906+0000","last_active":"2024-09-13T17:07:46.805842+0000","last_peered":"2024-09-13T17:07:46.805842+0000","last_clean":"2024-09-13T17:07:46.805842+0000","last_became_active":"2024-09-13T17:07:46.463601+0000","last_became_peered":"2024-09-13T17:07:46.463601+0000","last_unstale":"2024-09-13T17:07:46.805842+0000","last_undegraded":"2024-09-13T17:07:46.805842+0000","last_fullsized":"2024-09-13T17:07:46.805842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:31.087286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824192+0000","last_change":"2024-09-13T17:07:46.818746+0000","last_active":"2024-09-13T17:07:46.824192+0000","last_peered":"2024-09-13T17:07:46.824192+0000","last_clean":"2024-09-13T17:07:46.824192+0000","last_became_active":"2024-09-13T17:07:46.818495+0000","last_became_peered":"2024-09-13T17:07:46.818495+0000","last_unstale":"2024-09-13T17:07:46.824192+0000","last_undegraded":"2024-09-13T17:07:46.824192+0000","last_fullsized":"2024-09-13T17:07:46.824192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.816473+0000","last_change":"2024-09-13T17:07:46.461668+0000","last_active":"2024-09-13T17:07:46.816473+0000","last_peered":"2024-09-13T17:07:46.816473+0000","last_clean":"2024-09-13T17:07:46.816473+0000","last_became_active":"2024-09-13T17:07:46.461382+0000","last_became_peered":"2024-09-13T17:07:46.461382+0000","last_unstale":"2024-09-13T17:07:46.816473+0000","last_undegraded":"2024-09-13T17:07:46.816473+0000","last_fullsized":"2024-09-13T17:07:46.816473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:36.337890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825662+0000","last_change":"2024-09-13T17:07:46.825662+0000","last_active":"2024-09-13T17:07:46.825662+0000","last_peered":"2024-09-13T17:07:46.825662+0000","last_clean":"2024-09-13T17:07:46.825662+0000","last_became_active":"2024-09-13T17:07:46.825407+0000","last_became_peered":"2024-09-13T17:07:46.825407+0000","last_unstale":"2024-09-13T17:07:46.825662+0000","last_undegraded":"2024-09-13T17:07:46.825662+0000","last_fullsized":"2024-09-13T17:07:46.825662+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812710+0000","last_change":"2024-09-13T17:07:46.463093+0000","last_active":"2024-09-13T17:07:46.812710+0000","last_peered":"2024-09-13T17:07:46.812710+0000","last_clean":"2024-09-13T17:07:46.812710+0000","last_became_active":"2024-09-13T17:07:46.462889+0000","last_became_peered":"2024-09-13T17:07:46.462889+0000","last_unstale":"2024-09-13T17:07:46.812710+0000","last_undegraded":"2024-09-13T17:07:46.812710+0000","last_fullsized":"2024-09-13T17:07:46.812710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.806237+0000","last_change":"2024-09-13T17:07:46.806237+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.806237+0000","last_undegraded":"2024-09-13T17:07:46.806237+0000","last_fullsized":"2024-09-13T17:07:46.806237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.814816+0000","last_change":"2024-09-13T17:07:46.463442+0000","last_active":"2024-09-13T17:07:46.814816+0000","last_peered":"2024-09-13T17:07:46.814816+0000","last_clean":"2024-09-13T17:07:46.814816+0000","last_became_active":"2024-09-13T17:07:46.459612+0000","last_became_peered":"2024-09-13T17:07:46.459612+0000","last_unstale":"2024-09-13T17:07:46.814816+0000","last_undegraded":"2024-09-13T17:07:46.814816+0000","last_fullsized":"2024-09-13T17:07:46.814816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:24.900637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820438+0000","last_change":"2024-09-13T17:07:46.820438+0000","last_active":"2024-09-13T17:07:46.820438+0000","last_peered":"2024-09-13T17:07:46.820438+0000","last_clean":"2024-09-13T17:07:46.820438+0000","last_became_active":"2024-09-13T17:07:46.820201+0000","last_became_peered":"2024-09-13T17:07:46.820201+0000","last_unstale":"2024-09-13T17:07:46.820438+0000","last_undegraded":"2024-09-13T17:07:46.820438+0000","last_fullsized":"2024-09-13T17:07:46.820438+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.807423+0000","last_change":"2024-09-13T17:07:46.459435+0000","last_active":"2024-09-13T17:07:46.807423+0000","last_peered":"2024-09-13T17:07:46.807423+0000","last_clean":"2024-09-13T17:07:46.807423+0000","last_became_active":"2024-09-13T17:07:46.459153+0000","last_became_peered":"2024-09-13T17:07:46.459153+0000","last_unstale":"2024-09-13T17:07:46.807423+0000","last_undegraded":"2024-09-13T17:07:46.807423+0000","last_fullsized":"2024-09-13T17:07:46.807423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:07.809881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808836+0000","last_change":"2024-09-13T17:07:46.808836+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808836+0000","last_undegraded":"2024-09-13T17:07:46.808836+0000","last_fullsized":"2024-09-13T17:07:46.808836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.810926+0000","last_change":"2024-09-13T17:07:46.459612+0000","last_active":"2024-09-13T17:07:46.810926+0000","last_peered":"2024-09-13T17:07:46.810926+0000","last_clean":"2024-09-13T17:07:46.810926+0000","last_became_active":"2024-09-13T17:07:46.459303+0000","last_became_peered":"2024-09-13T17:07:46.459303+0000","last_unstale":"2024-09-13T17:07:46.810926+0000","last_undegraded":"2024-09-13T17:07:46.810926+0000","last_fullsized":"2024-09-13T17:07:46.810926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:25.626757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.816307+0000","last_change":"2024-09-13T17:07:46.816307+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.816307+0000","last_undegraded":"2024-09-13T17:07:46.816307+0000","last_fullsized":"2024-09-13T17:07:46.816307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:37.347764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811516+0000","last_change":"2024-09-13T17:07:46.462541+0000","last_active":"2024-09-13T17:07:46.811516+0000","last_peered":"2024-09-13T17:07:46.811516+0000","last_clean":"2024-09-13T17:07:46.811516+0000","last_became_active":"2024-09-13T17:07:46.460577+0000","last_became_peered":"2024-09-13T17:07:46.460577+0000","last_unstale":"2024-09-13T17:07:46.811516+0000","last_undegraded":"2024-09-13T17:07:46.811516+0000","last_fullsized":"2024-09-13T17:07:46.811516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:11.941516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.813451+0000","last_change":"2024-09-13T17:07:46.813451+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.813451+0000","last_undegraded":"2024-09-13T17:07:46.813451+0000","last_fullsized":"2024-09-13T17:07:46.813451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:47.788741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.806869+0000","last_change":"2024-09-13T17:07:46.466551+0000","last_active":"2024-09-13T17:07:46.806869+0000","last_peered":"2024-09-13T17:07:46.806869+0000","last_clean":"2024-09-13T17:07:46.806869+0000","last_became_active":"2024-09-13T17:07:46.466298+0000","last_became_peered":"2024-09-13T17:07:46.466298+0000","last_unstale":"2024-09-13T17:07:46.806869+0000","last_undegraded":"2024-09-13T17:07:46.806869+0000","last_fullsized":"2024-09-13T17:07:46.806869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:49.531696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-09-13T17:07:46.829660+0000","last_change":"2024-09-13T17:07:46.829622+0000","last_active":"2024-09-13T17:07:46.829660+0000","last_peered":"2024-09-13T17:07:46.829660+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"2024-09-13T17:07:46.829622+0000","last_became_peered":"2024-09-13T17:07:46.829622+0000","last_unstale":"2024-09-13T17:07:46.829660+0000","last_undegraded":"2024-09-13T17:07:46.829660+0000","last_fullsized":"2024-09-13T17:07:46.829660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.814018+0000","last_change":"2024-09-13T17:07:46.459751+0000","last_active":"2024-09-13T17:07:46.814018+0000","last_peered":"2024-09-13T17:07:46.814018+0000","last_clean":"2024-09-13T17:07:46.814018+0000","last_became_active":"2024-09-13T17:07:46.458678+0000","last_became_peered":"2024-09-13T17:07:46.458678+0000","last_unstale":"2024-09-13T17:07:46.814018+0000","last_undegraded":"2024-09-13T17:07:46.814018+0000","last_fullsized":"2024-09-13T17:07:46.814018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:13.965041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.808768+0000","last_change":"2024-09-13T17:07:46.808768+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.808768+0000","last_undegraded":"2024-09-13T17:07:46.808768+0000","last_fullsized":"2024-09-13T17:07:46.808768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820618+0000","last_change":"2024-09-13T17:07:46.464282+0000","last_active":"2024-09-13T17:07:46.820618+0000","last_peered":"2024-09-13T17:07:46.820618+0000","last_clean":"2024-09-13T17:07:46.820618+0000","last_became_active":"2024-09-13T17:07:46.463984+0000","last_became_peered":"2024-09-13T17:07:46.463984+0000","last_unstale":"2024-09-13T17:07:46.820618+0000","last_undegraded":"2024-09-13T17:07:46.820618+0000","last_fullsized":"2024-09-13T17:07:46.820618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:41.634119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":4,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.819042+0000","last_change":"2024-09-13T17:07:46.814192+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.819042+0000","last_undegraded":"2024-09-13T17:07:46.819042+0000","last_fullsized":"2024-09-13T17:07:46.819042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:32.097160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.814648+0000","last_change":"2024-09-13T17:07:46.458932+0000","last_active":"2024-09-13T17:07:46.814648+0000","last_peered":"2024-09-13T17:07:46.814648+0000","last_clean":"2024-09-13T17:07:46.814648+0000","last_became_active":"2024-09-13T17:07:46.458642+0000","last_became_peered":"2024-09-13T17:07:46.458642+0000","last_unstale":"2024-09-13T17:07:46.814648+0000","last_undegraded":"2024-09-13T17:07:46.814648+0000","last_fullsized":"2024-09-13T17:07:46.814648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:35.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.814124+0000","last_change":"2024-09-13T17:07:46.814124+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.814124+0000","last_undegraded":"2024-09-13T17:07:46.814124+0000","last_fullsized":"2024-09-13T17:07:46.814124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:26.636631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.806555+0000","last_change":"2024-09-13T17:07:46.460097+0000","last_active":"2024-09-13T17:07:46.806555+0000","last_peered":"2024-09-13T17:07:46.806555+0000","last_clean":"2024-09-13T17:07:46.806555+0000","last_became_active":"2024-09-13T17:07:46.459833+0000","last_became_peered":"2024-09-13T17:07:46.459833+0000","last_unstale":"2024-09-13T17:07:46.806555+0000","last_undegraded":"2024-09-13T17:07:46.806555+0000","last_fullsized":"2024-09-13T17:07:46.806555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:06.069380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":4,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.819701+0000","last_change":"2024-09-13T17:07:46.814919+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.819701+0000","last_undegraded":"2024-09-13T17:07:46.819701+0000","last_fullsized":"2024-09-13T17:07:46.819701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:07.079254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818652+0000","last_change":"2024-09-13T17:07:46.460821+0000","last_active":"2024-09-13T17:07:46.818652+0000","last_peered":"2024-09-13T17:07:46.818652+0000","last_clean":"2024-09-13T17:07:46.818652+0000","last_became_active":"2024-09-13T17:07:46.460540+0000","last_became_peered":"2024-09-13T17:07:46.460540+0000","last_unstale":"2024-09-13T17:07:46.818652+0000","last_undegraded":"2024-09-13T17:07:46.818652+0000","last_fullsized":"2024-09-13T17:07:46.818652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:35.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":4,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.817655+0000","last_change":"2024-09-13T17:07:46.813515+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.817655+0000","last_undegraded":"2024-09-13T17:07:46.817655+0000","last_fullsized":"2024-09-13T17:07:46.817655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:33.883750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812803+0000","last_change":"2024-09-13T17:07:46.463183+0000","last_active":"2024-09-13T17:07:46.812803+0000","last_peered":"2024-09-13T17:07:46.812803+0000","last_clean":"2024-09-13T17:07:46.812803+0000","last_became_active":"2024-09-13T17:07:46.462872+0000","last_became_peered":"2024-09-13T17:07:46.462872+0000","last_unstale":"2024-09-13T17:07:46.812803+0000","last_undegraded":"2024-09-13T17:07:46.812803+0000","last_fullsized":"2024-09-13T17:07:46.812803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.807398+0000","last_change":"2024-09-13T17:07:46.807398+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.807398+0000","last_undegraded":"2024-09-13T17:07:46.807398+0000","last_fullsized":"2024-09-13T17:07:46.807398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.816280+0000","last_change":"2024-09-13T17:07:46.461826+0000","last_active":"2024-09-13T17:07:46.816280+0000","last_peered":"2024-09-13T17:07:46.816280+0000","last_clean":"2024-09-13T17:07:46.816280+0000","last_became_active":"2024-09-13T17:07:46.461348+0000","last_became_peered":"2024-09-13T17:07:46.461348+0000","last_unstale":"2024-09-13T17:07:46.816280+0000","last_undegraded":"2024-09-13T17:07:46.816280+0000","last_fullsized":"2024-09-13T17:07:46.816280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:25.626757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-09-13T17:07:46.814196+0000","last_change":"2024-09-13T17:07:46.814196+0000","last_active":"2024-09-13T17:07:46.436012+0000","last_peered":"2024-09-13T17:07:46.436012+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:07:46.814196+0000","last_undegraded":"2024-09-13T17:07:46.814196+0000","last_fullsized":"2024-09-13T17:07:46.814196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:37.347764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.807359+0000","last_change":"2024-09-13T17:07:46.466282+0000","last_active":"2024-09-13T17:07:46.807359+0000","last_peered":"2024-09-13T17:07:46.807359+0000","last_clean":"2024-09-13T17:07:46.807359+0000","last_became_active":"2024-09-13T17:07:46.466008+0000","last_became_peered":"2024-09-13T17:07:46.466008+0000","last_unstale":"2024-09-13T17:07:46.807359+0000","last_undegraded":"2024-09-13T17:07:46.807359+0000","last_fullsized":"2024-09-13T17:07:46.807359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:57.898224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821732+0000","last_change":"2024-09-13T17:07:46.821732+0000","last_active":"2024-09-13T17:07:46.821732+0000","last_peered":"2024-09-13T17:07:46.821732+0000","last_clean":"2024-09-13T17:07:46.821732+0000","last_became_active":"2024-09-13T17:07:46.821507+0000","last_became_peered":"2024-09-13T17:07:46.821507+0000","last_unstale":"2024-09-13T17:07:46.821732+0000","last_undegraded":"2024-09-13T17:07:46.821732+0000","last_fullsized":"2024-09-13T17:07:46.821732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.805993+0000","last_change":"2024-09-13T17:07:46.459158+0000","last_active":"2024-09-13T17:07:46.805993+0000","last_peered":"2024-09-13T17:07:46.805993+0000","last_clean":"2024-09-13T17:07:46.805993+0000","last_became_active":"2024-09-13T17:07:46.458901+0000","last_became_peered":"2024-09-13T17:07:46.458901+0000","last_unstale":"2024-09-13T17:07:46.805993+0000","last_undegraded":"2024-09-13T17:07:46.805993+0000","last_fullsized":"2024-09-13T17:07:46.805993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:53.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811930+0000","last_change":"2024-09-13T17:07:46.811040+0000","last_active":"2024-09-13T17:07:46.811930+0000","last_peered":"2024-09-13T17:07:46.811930+0000","last_clean":"2024-09-13T17:07:46.811930+0000","last_became_active":"2024-09-13T17:07:46.810738+0000","last_became_peered":"2024-09-13T17:07:46.810738+0000","last_unstale":"2024-09-13T17:07:46.811930+0000","last_undegraded":"2024-09-13T17:07:46.811930+0000","last_fullsized":"2024-09-13T17:07:46.811930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:40.468817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.809276+0000","last_change":"2024-09-13T17:07:46.469077+0000","last_active":"2024-09-13T17:07:46.809276+0000","last_peered":"2024-09-13T17:07:46.809276+0000","last_clean":"2024-09-13T17:07:46.809276+0000","last_became_active":"2024-09-13T17:07:46.468808+0000","last_became_peered":"2024-09-13T17:07:46.468808+0000","last_unstale":"2024-09-13T17:07:46.809276+0000","last_undegraded":"2024-09-13T17:07:46.809276+0000","last_fullsized":"2024-09-13T17:07:46.809276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:55.638425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821584+0000","last_change":"2024-09-13T17:07:46.820219+0000","last_active":"2024-09-13T17:07:46.821584+0000","last_peered":"2024-09-13T17:07:46.821584+0000","last_clean":"2024-09-13T17:07:46.821584+0000","last_became_active":"2024-09-13T17:07:46.819114+0000","last_became_peered":"2024-09-13T17:07:46.819114+0000","last_unstale":"2024-09-13T17:07:46.821584+0000","last_undegraded":"2024-09-13T17:07:46.821584+0000","last_fullsized":"2024-09-13T17:07:46.821584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.806777+0000","last_change":"2024-09-13T17:07:46.462465+0000","last_active":"2024-09-13T17:07:46.806777+0000","last_peered":"2024-09-13T17:07:46.806777+0000","last_clean":"2024-09-13T17:07:46.806777+0000","last_became_active":"2024-09-13T17:07:46.462216+0000","last_became_peered":"2024-09-13T17:07:46.462216+0000","last_unstale":"2024-09-13T17:07:46.806777+0000","last_undegraded":"2024-09-13T17:07:46.806777+0000","last_fullsized":"2024-09-13T17:07:46.806777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:11.941516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822778+0000","last_change":"2024-09-13T17:07:46.822778+0000","last_active":"2024-09-13T17:07:46.822778+0000","last_peered":"2024-09-13T17:07:46.822778+0000","last_clean":"2024-09-13T17:07:46.822778+0000","last_became_active":"2024-09-13T17:07:46.822504+0000","last_became_peered":"2024-09-13T17:07:46.822504+0000","last_unstale":"2024-09-13T17:07:46.822778+0000","last_undegraded":"2024-09-13T17:07:46.822778+0000","last_fullsized":"2024-09-13T17:07:46.822778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:50.541570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.807707+0000","last_change":"2024-09-13T17:07:46.466175+0000","last_active":"2024-09-13T17:07:46.807707+0000","last_peered":"2024-09-13T17:07:46.807707+0000","last_clean":"2024-09-13T17:07:46.807707+0000","last_became_active":"2024-09-13T17:07:46.465896+0000","last_became_peered":"2024-09-13T17:07:46.465896+0000","last_unstale":"2024-09-13T17:07:46.807707+0000","last_undegraded":"2024-09-13T17:07:46.807707+0000","last_fullsized":"2024-09-13T17:07:46.807707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:36.337890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.820250+0000","last_change":"2024-09-13T17:07:46.820250+0000","last_active":"2024-09-13T17:07:46.820250+0000","last_peered":"2024-09-13T17:07:46.820250+0000","last_clean":"2024-09-13T17:07:46.820250+0000","last_became_active":"2024-09-13T17:07:46.820005+0000","last_became_peered":"2024-09-13T17:07:46.820005+0000","last_unstale":"2024-09-13T17:07:46.820250+0000","last_undegraded":"2024-09-13T17:07:46.820250+0000","last_fullsized":"2024-09-13T17:07:46.820250+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.812911+0000","last_change":"2024-09-13T17:07:46.463288+0000","last_active":"2024-09-13T17:07:46.812911+0000","last_peered":"2024-09-13T17:07:46.812911+0000","last_clean":"2024-09-13T17:07:46.812911+0000","last_became_active":"2024-09-13T17:07:46.462965+0000","last_became_peered":"2024-09-13T17:07:46.462965+0000","last_unstale":"2024-09-13T17:07:46.812911+0000","last_undegraded":"2024-09-13T17:07:46.812911+0000","last_fullsized":"2024-09-13T17:07:46.812911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:59.219013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825815+0000","last_change":"2024-09-13T17:07:46.825815+0000","last_active":"2024-09-13T17:07:46.825815+0000","last_peered":"2024-09-13T17:07:46.825815+0000","last_clean":"2024-09-13T17:07:46.825815+0000","last_became_active":"2024-09-13T17:07:46.825560+0000","last_became_peered":"2024-09-13T17:07:46.825560+0000","last_unstale":"2024-09-13T17:07:46.825815+0000","last_undegraded":"2024-09-13T17:07:46.825815+0000","last_fullsized":"2024-09-13T17:07:46.825815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:40.468817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.811434+0000","last_change":"2024-09-13T17:07:46.463686+0000","last_active":"2024-09-13T17:07:46.811434+0000","last_peered":"2024-09-13T17:07:46.811434+0000","last_clean":"2024-09-13T17:07:46.811434+0000","last_became_active":"2024-09-13T17:07:46.463437+0000","last_became_peered":"2024-09-13T17:07:46.463437+0000","last_unstale":"2024-09-13T17:07:46.811434+0000","last_undegraded":"2024-09-13T17:07:46.811434+0000","last_fullsized":"2024-09-13T17:07:46.811434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:53.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-09-13T17:07:46.821323+0000","last_change":"2024-09-13T17:07:46.821260+0000","last_active":"2024-09-13T17:07:46.821323+0000","last_peered":"2024-09-13T17:07:46.821323+0000","last_clean":"2024-09-13T17:07:46.436012+0000","last_became_active":"2024-09-13T17:07:46.821260+0000","last_became_peered":"2024-09-13T17:07:46.821260+0000","last_unstale":"2024-09-13T17:07:46.821323+0000","last_undegraded":"2024-09-13T17:07:46.821323+0000","last_fullsized":"2024-09-13T17:07:46.821323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:36.033290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818687+0000","last_change":"2024-09-13T17:07:46.464490+0000","last_active":"2024-09-13T17:07:46.818687+0000","last_peered":"2024-09-13T17:07:46.818687+0000","last_clean":"2024-09-13T17:07:46.818687+0000","last_became_active":"2024-09-13T17:07:46.464175+0000","last_became_peered":"2024-09-13T17:07:46.464175+0000","last_unstale":"2024-09-13T17:07:46.818687+0000","last_undegraded":"2024-09-13T17:07:46.818687+0000","last_fullsized":"2024-09-13T17:07:46.818687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:50.939498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.453001+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:07:46.453001+0000","last_peered":"2024-09-13T17:07:46.453001+0000","last_clean":"2024-09-13T17:07:46.453001+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:07:46.453001+0000","last_undegraded":"2024-09-13T17:07:46.453001+0000","last_fullsized":"2024-09-13T17:07:46.453001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.032}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.83599999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.89500000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.054}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.006}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.86699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.72699999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.026}]},{"osd":4,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.754}]},{"osd":5,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.008}]},{"osd":7,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.073}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.89000000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.0249999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.91600000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.98199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.002},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.0940000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.0189999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.98399999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.0469999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":1.0700000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.127}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.1080000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.202},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.2270000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.626},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.77300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.83299999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.875},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.81100000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.91500000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.028}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.92700000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.84999999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.89800000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.0589999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.995}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.434}]},{"osd":3,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.999},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.79700000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.876},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.95799999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.83099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":729180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.25,"5min":3.25,"15min":3.25},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.80900000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.5590000000000002,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":6.4089999999999998,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.7060000000000004,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":6.2729999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.746}]},{"osd":4,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":5.3019999999999996,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.9039999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":0.86499999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":4.2599999999999998,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.018},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.105}]},{"osd":7,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":5.7510000000000003,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:07:54.263 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:07:54.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.380+0000 7f5cb2cc4700 1 Processor -- start 2024-09-13T17:07:54.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.380+0000 7f5cb2cc4700 1 -- start start 2024-09-13T17:07:54.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.380+0000 7f5cb2cc4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5cac0cf3a0 0x7f5cac06c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:54.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cb2cc4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cac0acc00 con 0x7f5cac06c590 2024-09-13T17:07:54.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cb2cc4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cac06cc30 con 0x7f5cac15ff90 2024-09-13T17:07:54.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cb2cc4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cac06ca20 con 0x7f5cac0cf3a0 2024-09-13T17:07:54.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cb1261700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5cac06c590 0x7f5cac0b24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34070/0 (socket says 172.21.15.123:34070) 2024-09-13T17:07:54.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cb1261700 1 -- 172.21.15.123:0/1201443179 learned_addr learned my addr 172.21.15.123:0/1201443179 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:54.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cabfff700 1 --2- 172.21.15.123:0/1201443179 >> v2:172.21.15.153:3300/0 conn(0x7f5cac0cf3a0 0x7f5cac06c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:54.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cab7fe700 1 -- 172.21.15.123:0/1201443179 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392149187 0 0) 0x7f5cac0acc00 con 0x7f5cac06c590 2024-09-13T17:07:54.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cab7fe700 1 -- 172.21.15.123:0/1201443179 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c940035d0 con 0x7f5cac06c590 2024-09-13T17:07:54.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cabfff700 1 -- 172.21.15.123:0/1201443179 >> v1:172.21.15.153:6789/0 conn(0x7f5cac15ff90 legacy=0x7f5cac0cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:54.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cabfff700 1 -- 172.21.15.123:0/1201443179 >> v1:172.21.15.123:6789/0 conn(0x7f5cac06c590 legacy=0x7f5cac0b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:54.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cabfff700 1 -- 172.21.15.123:0/1201443179 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac06cf10 con 0x7f5cac0cf3a0 2024-09-13T17:07:54.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cabfff700 1 --2- 172.21.15.123:0/1201443179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cac0cf3a0 0x7f5cac06c050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009850 tx=0x7f5c9c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a22dc3fa4c8647cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:54.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cab7fe700 1 -- 172.21.15.123:0/1201443179 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c011830 con 0x7f5cac0cf3a0 2024-09-13T17:07:54.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cab7fe700 1 -- 172.21.15.123:0/1201443179 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c011990 con 0x7f5cac0cf3a0 2024-09-13T17:07:54.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cab7fe700 1 -- 172.21.15.123:0/1201443179 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c011d00 con 0x7f5cac0cf3a0 2024-09-13T17:07:54.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/1201443179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cac0cf3a0 msgr2=0x7f5cac06c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:54.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cb2cc4700 1 --2- 172.21.15.123:0/1201443179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cac0cf3a0 0x7f5cac06c050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009850 tx=0x7f5c9c009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:54.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/1201443179 shutdown_connections 2024-09-13T17:07:54.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cb2cc4700 1 --2- 172.21.15.123:0/1201443179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cac0cf3a0 0x7f5cac06c050 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/1201443179 >> 172.21.15.123:0/1201443179 conn(0x7f5cac066570 msgr2=0x7f5cac066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:54.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/1201443179 shutdown_connections 2024-09-13T17:07:54.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/1201443179 wait complete. 2024-09-13T17:07:54.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cb2cc4700 1 Processor -- start 2024-09-13T17:07:54.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.384+0000 7f5cb2cc4700 1 -- start start 2024-09-13T17:07:54.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb2cc4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cac06c590 0x7f5cac14f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:54.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb2cc4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5cac0cf3a0 0x7f5cac0b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:54.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb2cc4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cac15ff90 0x7f5cac0b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:54.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb2cc4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0c3750 con 0x7f5cac15ff90 2024-09-13T17:07:54.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb2cc4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0c3a30 con 0x7f5cac06c590 2024-09-13T17:07:54.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb2cc4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0c3d10 con 0x7f5cac0cf3a0 2024-09-13T17:07:54.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb1261700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cac15ff90 0x7f5cac0b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb1261700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cac15ff90 0x7f5cac0b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36670/0 (socket says 172.21.15.123:36670) 2024-09-13T17:07:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb1261700 1 -- 172.21.15.123:0/3889665755 learned_addr learned my addr 172.21.15.123:0/3889665755 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb0a60700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cac06c590 0x7f5cac14f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cabfff700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5cac0cf3a0 0x7f5cac0b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb1261700 1 -- 172.21.15.123:0/3889665755 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5cac0cf3a0 msgr2=0x7f5cac0b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb1261700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5cac0cf3a0 0x7f5cac0b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb1261700 1 -- 172.21.15.123:0/3889665755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cac06c590 msgr2=0x7f5cac14f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb1261700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cac06c590 0x7f5cac14f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb1261700 1 -- 172.21.15.123:0/3889665755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c0094b0 con 0x7f5cac15ff90 2024-09-13T17:07:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cabfff700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5cac0cf3a0 0x7f5cac0b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb1261700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cac15ff90 0x7f5cac0b0790 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5ca400cb40 tx=0x7f5ca400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5ca97fa700 1 -- 172.21.15.123:0/3889665755 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca400a9e0 con 0x7f5cac15ff90 2024-09-13T17:07:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5ca97fa700 1 -- 172.21.15.123:0/3889665755 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca400ab40 con 0x7f5cac15ff90 2024-09-13T17:07:54.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/3889665755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cac0c3ff0 con 0x7f5cac15ff90 2024-09-13T17:07:54.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5ca97fa700 1 -- 172.21.15.123:0/3889665755 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca400ce60 con 0x7f5cac15ff90 2024-09-13T17:07:54.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/3889665755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cac14fb00 con 0x7f5cac15ff90 2024-09-13T17:07:54.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.388+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/3889665755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cac0c4510 con 0x7f5cac15ff90 2024-09-13T17:07:54.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.392+0000 7f5ca97fa700 1 -- 172.21.15.123:0/3889665755 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ca401b3b0 con 0x7f5cac15ff90 2024-09-13T17:07:54.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.392+0000 7f5ca97fa700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5c98066730 0x7f5c98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:54.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.392+0000 7f5ca97fa700 1 -- 172.21.15.123:0/3889665755 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ca4083f50 con 0x7f5cac15ff90 2024-09-13T17:07:54.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.392+0000 7f5cb0a60700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5c98066730 0x7f5c98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:54.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.392+0000 7f5cb0a60700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5c98066730 0x7f5c98068bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0cd430 tx=0x7f5ca0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:54.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.396+0000 7f5ca97fa700 1 -- 172.21.15.123:0/3889665755 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5ca40512c0 con 0x7f5cac15ff90 2024-09-13T17:07:54.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.564+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/3889665755 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5cac0b1fc0 con 0x7f5c98066730 2024-09-13T17:07:54.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.580+0000 7f5ca97fa700 1 -- 172.21.15.123:0/3889665755 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287808 (secure 0 0 0) 0x7f5ca00050d0 con 0x7f5c98066730 2024-09-13T17:07:54.589 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.584+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/3889665755 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5c98066730 msgr2=0x7f5c98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.584+0000 7f5cb2cc4700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5c98066730 0x7f5c98068bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0cd430 tx=0x7f5ca0009040 comp rx=0 tx=0).stop 2024-09-13T17:07:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.584+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/3889665755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cac15ff90 msgr2=0x7f5cac0b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.584+0000 7f5cb2cc4700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cac15ff90 0x7f5cac0b0790 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5ca400cb40 tx=0x7f5ca400cc20 comp rx=0 tx=0).stop 2024-09-13T17:07:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.588+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/3889665755 shutdown_connections 2024-09-13T17:07:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.588+0000 7f5cb2cc4700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5c98066730 0x7f5c98068bf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.588+0000 7f5cb2cc4700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cac15ff90 0x7f5cac0b0790 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.588+0000 7f5cb2cc4700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5cac0cf3a0 0x7f5cac0b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.588+0000 7f5cb2cc4700 1 --2- 172.21.15.123:0/3889665755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cac06c590 0x7f5cac14f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.588+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/3889665755 >> 172.21.15.123:0/3889665755 conn(0x7f5cac066570 msgr2=0x7f5cac072150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.588+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/3889665755 shutdown_connections 2024-09-13T17:07:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.588+0000 7f5cb2cc4700 1 -- 172.21.15.123:0/3889665755 wait complete. 2024-09-13T17:07:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:07:54.604 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-13T17:07:52.755458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220436,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754284,"statfs":{"total":773094113280,"available":772868386816,"internally_reserved":0,"allocated":4333568,"data_stored":2400556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.313835"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.829975+0000","last_change":"2024-09-13T17:07:46.825404+0000","last_active":"2024-09-13T17:07:46.829975+0000","last_peered":"2024-09-13T17:07:46.829975+0000","last_clean":"2024-09-13T17:07:46.829975+0000","last_became_active":"2024-09-13T17:07:46.825157+0000","last_became_peered":"2024-09-13T17:07:46.825157+0000","last_unstale":"2024-09-13T17:07:46.829975+0000","last_undegraded":"2024-09-13T17:07:46.829975+0000","last_fullsized":"2024-09-13T17:07:46.829975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:08.819755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.832635+0000","last_change":"2024-09-13T17:07:46.821865+0000","last_active":"2024-09-13T17:07:46.832635+0000","last_peered":"2024-09-13T17:07:46.832635+0000","last_clean":"2024-09-13T17:07:46.832635+0000","last_became_active":"2024-09-13T17:07:46.821335+0000","last_became_peered":"2024-09-13T17:07:46.821335+0000","last_unstale":"2024-09-13T17:07:46.832635+0000","last_undegraded":"2024-09-13T17:07:46.832635+0000","last_fullsized":"2024-09-13T17:07:46.832635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:19.871674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.829603+0000","last_change":"2024-09-13T17:07:46.821251+0000","last_active":"2024-09-13T17:07:46.829603+0000","last_peered":"2024-09-13T17:07:46.829603+0000","last_clean":"2024-09-13T17:07:46.829603+0000","last_became_active":"2024-09-13T17:07:46.820956+0000","last_became_peered":"2024-09-13T17:07:46.820956+0000","last_unstale":"2024-09-13T17:07:46.829603+0000","last_undegraded":"2024-09-13T17:07:46.829603+0000","last_fullsized":"2024-09-13T17:07:46.829603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.836293+0000","last_change":"2024-09-13T17:07:46.828909+0000","last_active":"2024-09-13T17:07:46.836293+0000","last_peered":"2024-09-13T17:07:46.836293+0000","last_clean":"2024-09-13T17:07:46.836293+0000","last_became_active":"2024-09-13T17:07:46.828459+0000","last_became_peered":"2024-09-13T17:07:46.828459+0000","last_unstale":"2024-09-13T17:07:46.836293+0000","last_undegraded":"2024-09-13T17:07:46.836293+0000","last_fullsized":"2024-09-13T17:07:46.836293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824234+0000","last_change":"2024-09-13T17:07:46.823511+0000","last_active":"2024-09-13T17:07:46.824234+0000","last_peered":"2024-09-13T17:07:46.824234+0000","last_clean":"2024-09-13T17:07:46.824234+0000","last_became_active":"2024-09-13T17:07:46.823250+0000","last_became_peered":"2024-09-13T17:07:46.823250+0000","last_unstale":"2024-09-13T17:07:46.824234+0000","last_undegraded":"2024-09-13T17:07:46.824234+0000","last_fullsized":"2024-09-13T17:07:46.824234+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.838692+0000","last_change":"2024-09-13T17:07:46.826144+0000","last_active":"2024-09-13T17:07:46.838692+0000","last_peered":"2024-09-13T17:07:46.838692+0000","last_clean":"2024-09-13T17:07:46.838692+0000","last_became_active":"2024-09-13T17:07:46.825930+0000","last_became_peered":"2024-09-13T17:07:46.825930+0000","last_unstale":"2024-09-13T17:07:46.838692+0000","last_undegraded":"2024-09-13T17:07:46.838692+0000","last_fullsized":"2024-09-13T17:07:46.838692+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.823911+0000","last_change":"2024-09-13T17:07:46.822351+0000","last_active":"2024-09-13T17:07:46.823911+0000","last_peered":"2024-09-13T17:07:46.823911+0000","last_clean":"2024-09-13T17:07:46.823911+0000","last_became_active":"2024-09-13T17:07:46.822067+0000","last_became_peered":"2024-09-13T17:07:46.822067+0000","last_unstale":"2024-09-13T17:07:46.823911+0000","last_undegraded":"2024-09-13T17:07:46.823911+0000","last_fullsized":"2024-09-13T17:07:46.823911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.823950+0000","last_change":"2024-09-13T17:07:46.822282+0000","last_active":"2024-09-13T17:07:46.823950+0000","last_peered":"2024-09-13T17:07:46.823950+0000","last_clean":"2024-09-13T17:07:46.823950+0000","last_became_active":"2024-09-13T17:07:46.822013+0000","last_became_peered":"2024-09-13T17:07:46.822013+0000","last_unstale":"2024-09-13T17:07:46.823950+0000","last_undegraded":"2024-09-13T17:07:46.823950+0000","last_fullsized":"2024-09-13T17:07:46.823950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:34.528334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.834332+0000","last_change":"2024-09-13T17:07:46.826617+0000","last_active":"2024-09-13T17:07:46.834332+0000","last_peered":"2024-09-13T17:07:46.834332+0000","last_clean":"2024-09-13T17:07:46.834332+0000","last_became_active":"2024-09-13T17:07:46.826339+0000","last_became_peered":"2024-09-13T17:07:46.826339+0000","last_unstale":"2024-09-13T17:07:46.834332+0000","last_undegraded":"2024-09-13T17:07:46.834332+0000","last_fullsized":"2024-09-13T17:07:46.834332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:27.800734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822737+0000","last_change":"2024-09-13T17:07:46.815960+0000","last_active":"2024-09-13T17:07:46.822737+0000","last_peered":"2024-09-13T17:07:46.822737+0000","last_clean":"2024-09-13T17:07:46.822737+0000","last_became_active":"2024-09-13T17:07:46.815778+0000","last_became_peered":"2024-09-13T17:07:46.815778+0000","last_unstale":"2024-09-13T17:07:46.822737+0000","last_undegraded":"2024-09-13T17:07:46.822737+0000","last_fullsized":"2024-09-13T17:07:46.822737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821533+0000","last_change":"2024-09-13T17:07:46.812036+0000","last_active":"2024-09-13T17:07:46.821533+0000","last_peered":"2024-09-13T17:07:46.821533+0000","last_clean":"2024-09-13T17:07:46.821533+0000","last_became_active":"2024-09-13T17:07:46.811777+0000","last_became_peered":"2024-09-13T17:07:46.811777+0000","last_unstale":"2024-09-13T17:07:46.821533+0000","last_undegraded":"2024-09-13T17:07:46.821533+0000","last_fullsized":"2024-09-13T17:07:46.821533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.834365+0000","last_change":"2024-09-13T17:07:46.824951+0000","last_active":"2024-09-13T17:07:46.834365+0000","last_peered":"2024-09-13T17:07:46.834365+0000","last_clean":"2024-09-13T17:07:46.834365+0000","last_became_active":"2024-09-13T17:07:46.824657+0000","last_became_peered":"2024-09-13T17:07:46.824657+0000","last_unstale":"2024-09-13T17:07:46.834365+0000","last_undegraded":"2024-09-13T17:07:46.834365+0000","last_fullsized":"2024-09-13T17:07:46.834365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:19.871674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.836149+0000","last_change":"2024-09-13T17:07:46.830996+0000","last_active":"2024-09-13T17:07:46.836149+0000","last_peered":"2024-09-13T17:07:46.836149+0000","last_clean":"2024-09-13T17:07:46.836149+0000","last_became_active":"2024-09-13T17:07:46.830752+0000","last_became_peered":"2024-09-13T17:07:46.830752+0000","last_unstale":"2024-09-13T17:07:46.836149+0000","last_undegraded":"2024-09-13T17:07:46.836149+0000","last_fullsized":"2024-09-13T17:07:46.836149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:12.951389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.832555+0000","last_change":"2024-09-13T17:07:46.824808+0000","last_active":"2024-09-13T17:07:46.832555+0000","last_peered":"2024-09-13T17:07:46.832555+0000","last_clean":"2024-09-13T17:07:46.832555+0000","last_became_active":"2024-09-13T17:07:46.824588+0000","last_became_peered":"2024-09-13T17:07:46.824588+0000","last_unstale":"2024-09-13T17:07:46.832555+0000","last_undegraded":"2024-09-13T17:07:46.832555+0000","last_fullsized":"2024-09-13T17:07:46.832555+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.833984+0000","last_change":"2024-09-13T17:07:46.824436+0000","last_active":"2024-09-13T17:07:46.833984+0000","last_peered":"2024-09-13T17:07:46.833984+0000","last_clean":"2024-09-13T17:07:46.833984+0000","last_became_active":"2024-09-13T17:07:46.822126+0000","last_became_peered":"2024-09-13T17:07:46.822126+0000","last_unstale":"2024-09-13T17:07:46.833984+0000","last_undegraded":"2024-09-13T17:07:46.833984+0000","last_fullsized":"2024-09-13T17:07:46.833984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:26.583203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.821213+0000","last_change":"2024-09-13T17:07:46.814681+0000","last_active":"2024-09-13T17:07:46.821213+0000","last_peered":"2024-09-13T17:07:46.821213+0000","last_clean":"2024-09-13T17:07:46.821213+0000","last_became_active":"2024-09-13T17:07:46.814398+0000","last_became_peered":"2024-09-13T17:07:46.814398+0000","last_unstale":"2024-09-13T17:07:46.821213+0000","last_undegraded":"2024-09-13T17:07:46.821213+0000","last_fullsized":"2024-09-13T17:07:46.821213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.136980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824004+0000","last_change":"2024-09-13T17:07:46.822795+0000","last_active":"2024-09-13T17:07:46.824004+0000","last_peered":"2024-09-13T17:07:46.824004+0000","last_clean":"2024-09-13T17:07:46.824004+0000","last_became_active":"2024-09-13T17:07:46.822514+0000","last_became_peered":"2024-09-13T17:07:46.822514+0000","last_unstale":"2024-09-13T17:07:46.824004+0000","last_undegraded":"2024-09-13T17:07:46.824004+0000","last_fullsized":"2024-09-13T17:07:46.824004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.832670+0000","last_change":"2024-09-13T17:07:46.824754+0000","last_active":"2024-09-13T17:07:46.832670+0000","last_peered":"2024-09-13T17:07:46.832670+0000","last_clean":"2024-09-13T17:07:46.832670+0000","last_became_active":"2024-09-13T17:07:46.824491+0000","last_became_peered":"2024-09-13T17:07:46.824491+0000","last_unstale":"2024-09-13T17:07:46.832670+0000","last_undegraded":"2024-09-13T17:07:46.832670+0000","last_fullsized":"2024-09-13T17:07:46.832670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.831820+0000","last_change":"2024-09-13T17:07:46.822199+0000","last_active":"2024-09-13T17:07:46.831820+0000","last_peered":"2024-09-13T17:07:46.831820+0000","last_clean":"2024-09-13T17:07:46.831820+0000","last_became_active":"2024-09-13T17:07:46.821039+0000","last_became_peered":"2024-09-13T17:07:46.821039+0000","last_unstale":"2024-09-13T17:07:46.831820+0000","last_undegraded":"2024-09-13T17:07:46.831820+0000","last_fullsized":"2024-09-13T17:07:46.831820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.833596+0000","last_change":"2024-09-13T17:07:46.830406+0000","last_active":"2024-09-13T17:07:46.833596+0000","last_peered":"2024-09-13T17:07:46.833596+0000","last_clean":"2024-09-13T17:07:46.833596+0000","last_became_active":"2024-09-13T17:07:46.830187+0000","last_became_peered":"2024-09-13T17:07:46.830187+0000","last_unstale":"2024-09-13T17:07:46.833596+0000","last_undegraded":"2024-09-13T17:07:46.833596+0000","last_fullsized":"2024-09-13T17:07:46.833596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:56.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.834173+0000","last_change":"2024-09-13T17:07:46.824875+0000","last_active":"2024-09-13T17:07:46.834173+0000","last_peered":"2024-09-13T17:07:46.834173+0000","last_clean":"2024-09-13T17:07:46.834173+0000","last_became_active":"2024-09-13T17:07:46.819999+0000","last_became_peered":"2024-09-13T17:07:46.819999+0000","last_unstale":"2024-09-13T17:07:46.834173+0000","last_undegraded":"2024-09-13T17:07:46.834173+0000","last_fullsized":"2024-09-13T17:07:46.834173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:20.464724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.827602+0000","last_change":"2024-09-13T17:07:46.824665+0000","last_active":"2024-09-13T17:07:46.827602+0000","last_peered":"2024-09-13T17:07:46.827602+0000","last_clean":"2024-09-13T17:07:46.827602+0000","last_became_active":"2024-09-13T17:07:46.820399+0000","last_became_peered":"2024-09-13T17:07:46.820399+0000","last_unstale":"2024-09-13T17:07:46.827602+0000","last_undegraded":"2024-09-13T17:07:46.827602+0000","last_fullsized":"2024-09-13T17:07:46.827602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:50.541570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822553+0000","last_change":"2024-09-13T17:07:46.811674+0000","last_active":"2024-09-13T17:07:46.822553+0000","last_peered":"2024-09-13T17:07:46.822553+0000","last_clean":"2024-09-13T17:07:46.822553+0000","last_became_active":"2024-09-13T17:07:46.811449+0000","last_became_peered":"2024-09-13T17:07:46.811449+0000","last_unstale":"2024-09-13T17:07:46.822553+0000","last_undegraded":"2024-09-13T17:07:46.822553+0000","last_fullsized":"2024-09-13T17:07:46.822553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:20.464724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.834392+0000","last_change":"2024-09-13T17:07:46.830086+0000","last_active":"2024-09-13T17:07:46.834392+0000","last_peered":"2024-09-13T17:07:46.834392+0000","last_clean":"2024-09-13T17:07:46.834392+0000","last_became_active":"2024-09-13T17:07:46.829717+0000","last_became_peered":"2024-09-13T17:07:46.829717+0000","last_unstale":"2024-09-13T17:07:46.834392+0000","last_undegraded":"2024-09-13T17:07:46.834392+0000","last_fullsized":"2024-09-13T17:07:46.834392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822702+0000","last_change":"2024-09-13T17:07:46.818395+0000","last_active":"2024-09-13T17:07:46.822702+0000","last_peered":"2024-09-13T17:07:46.822702+0000","last_clean":"2024-09-13T17:07:46.822702+0000","last_became_active":"2024-09-13T17:07:46.817022+0000","last_became_peered":"2024-09-13T17:07:46.817022+0000","last_unstale":"2024-09-13T17:07:46.822702+0000","last_undegraded":"2024-09-13T17:07:46.822702+0000","last_fullsized":"2024-09-13T17:07:46.822702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.832653+0000","last_change":"2024-09-13T17:07:46.822031+0000","last_active":"2024-09-13T17:07:46.832653+0000","last_peered":"2024-09-13T17:07:46.832653+0000","last_clean":"2024-09-13T17:07:46.832653+0000","last_became_active":"2024-09-13T17:07:46.821647+0000","last_became_peered":"2024-09-13T17:07:46.821647+0000","last_unstale":"2024-09-13T17:07:46.832653+0000","last_undegraded":"2024-09-13T17:07:46.832653+0000","last_fullsized":"2024-09-13T17:07:46.832653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.836296+0000","last_change":"2024-09-13T17:07:46.829968+0000","last_active":"2024-09-13T17:07:46.836296+0000","last_peered":"2024-09-13T17:07:46.836296+0000","last_clean":"2024-09-13T17:07:46.836296+0000","last_became_active":"2024-09-13T17:07:46.829736+0000","last_became_peered":"2024-09-13T17:07:46.829736+0000","last_unstale":"2024-09-13T17:07:46.836296+0000","last_undegraded":"2024-09-13T17:07:46.836296+0000","last_fullsized":"2024-09-13T17:07:46.836296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:02.265702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.829811+0000","last_change":"2024-09-13T17:07:46.820791+0000","last_active":"2024-09-13T17:07:46.829811+0000","last_peered":"2024-09-13T17:07:46.829811+0000","last_clean":"2024-09-13T17:07:46.829811+0000","last_became_active":"2024-09-13T17:07:46.820457+0000","last_became_peered":"2024-09-13T17:07:46.820457+0000","last_unstale":"2024-09-13T17:07:46.829811+0000","last_undegraded":"2024-09-13T17:07:46.829811+0000","last_fullsized":"2024-09-13T17:07:46.829811+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.834193+0000","last_change":"2024-09-13T17:07:46.825418+0000","last_active":"2024-09-13T17:07:46.834193+0000","last_peered":"2024-09-13T17:07:46.834193+0000","last_clean":"2024-09-13T17:07:46.834193+0000","last_became_active":"2024-09-13T17:07:46.825165+0000","last_became_peered":"2024-09-13T17:07:46.825165+0000","last_unstale":"2024-09-13T17:07:46.834193+0000","last_undegraded":"2024-09-13T17:07:46.834193+0000","last_fullsized":"2024-09-13T17:07:46.834193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:58.908098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.823094+0000","last_change":"2024-09-13T17:07:46.819149+0000","last_active":"2024-09-13T17:07:46.823094+0000","last_peered":"2024-09-13T17:07:46.823094+0000","last_clean":"2024-09-13T17:07:46.823094+0000","last_became_active":"2024-09-13T17:07:46.818880+0000","last_became_peered":"2024-09-13T17:07:46.818880+0000","last_unstale":"2024-09-13T17:07:46.823094+0000","last_undegraded":"2024-09-13T17:07:46.823094+0000","last_fullsized":"2024-09-13T17:07:46.823094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.830210+0000","last_change":"2024-09-13T17:07:46.824186+0000","last_active":"2024-09-13T17:07:46.830210+0000","last_peered":"2024-09-13T17:07:46.830210+0000","last_clean":"2024-09-13T17:07:46.830210+0000","last_became_active":"2024-09-13T17:07:46.823935+0000","last_became_peered":"2024-09-13T17:07:46.823935+0000","last_unstale":"2024-09-13T17:07:46.830210+0000","last_undegraded":"2024-09-13T17:07:46.830210+0000","last_fullsized":"2024-09-13T17:07:46.830210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:58.908098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.831266+0000","last_change":"2024-09-13T17:07:46.829316+0000","last_active":"2024-09-13T17:07:46.831266+0000","last_peered":"2024-09-13T17:07:46.831266+0000","last_clean":"2024-09-13T17:07:46.831266+0000","last_became_active":"2024-09-13T17:07:46.828070+0000","last_became_peered":"2024-09-13T17:07:46.828070+0000","last_unstale":"2024-09-13T17:07:46.831266+0000","last_undegraded":"2024-09-13T17:07:46.831266+0000","last_fullsized":"2024-09-13T17:07:46.831266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822917+0000","last_change":"2024-09-13T17:07:46.812039+0000","last_active":"2024-09-13T17:07:46.822917+0000","last_peered":"2024-09-13T17:07:46.822917+0000","last_clean":"2024-09-13T17:07:46.822917+0000","last_became_active":"2024-09-13T17:07:46.811670+0000","last_became_peered":"2024-09-13T17:07:46.811670+0000","last_unstale":"2024-09-13T17:07:46.822917+0000","last_undegraded":"2024-09-13T17:07:46.822917+0000","last_fullsized":"2024-09-13T17:07:46.822917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:47.788741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.835125+0000","last_change":"2024-09-13T17:07:46.462013+0000","last_active":"2024-09-13T17:07:46.835125+0000","last_peered":"2024-09-13T17:07:46.835125+0000","last_clean":"2024-09-13T17:07:46.835125+0000","last_became_active":"2024-09-13T17:07:46.461748+0000","last_became_peered":"2024-09-13T17:07:46.461748+0000","last_unstale":"2024-09-13T17:07:46.835125+0000","last_undegraded":"2024-09-13T17:07:46.835125+0000","last_fullsized":"2024-09-13T17:07:46.835125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.833613+0000","last_change":"2024-09-13T17:07:46.828484+0000","last_active":"2024-09-13T17:07:46.833613+0000","last_peered":"2024-09-13T17:07:46.833613+0000","last_clean":"2024-09-13T17:07:46.833613+0000","last_became_active":"2024-09-13T17:07:46.828232+0000","last_became_peered":"2024-09-13T17:07:46.828232+0000","last_unstale":"2024-09-13T17:07:46.833613+0000","last_undegraded":"2024-09-13T17:07:46.833613+0000","last_fullsized":"2024-09-13T17:07:46.833613+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:56.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.831162+0000","last_change":"2024-09-13T17:07:46.460122+0000","last_active":"2024-09-13T17:07:46.831162+0000","last_peered":"2024-09-13T17:07:46.831162+0000","last_clean":"2024-09-13T17:07:46.831162+0000","last_became_active":"2024-09-13T17:07:46.459873+0000","last_became_peered":"2024-09-13T17:07:46.459873+0000","last_unstale":"2024-09-13T17:07:46.831162+0000","last_undegraded":"2024-09-13T17:07:46.831162+0000","last_fullsized":"2024-09-13T17:07:46.831162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:32.873876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.834275+0000","last_change":"2024-09-13T17:07:46.824847+0000","last_active":"2024-09-13T17:07:46.834275+0000","last_peered":"2024-09-13T17:07:46.834275+0000","last_clean":"2024-09-13T17:07:46.834275+0000","last_became_active":"2024-09-13T17:07:46.820127+0000","last_became_peered":"2024-09-13T17:07:46.820127+0000","last_unstale":"2024-09-13T17:07:46.834275+0000","last_undegraded":"2024-09-13T17:07:46.834275+0000","last_fullsized":"2024-09-13T17:07:46.834275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:08.819755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.839204+0000","last_change":"2024-09-13T17:07:46.460323+0000","last_active":"2024-09-13T17:07:46.839204+0000","last_peered":"2024-09-13T17:07:46.839204+0000","last_clean":"2024-09-13T17:07:46.839204+0000","last_became_active":"2024-09-13T17:07:46.459957+0000","last_became_peered":"2024-09-13T17:07:46.459957+0000","last_unstale":"2024-09-13T17:07:46.839204+0000","last_undegraded":"2024-09-13T17:07:46.839204+0000","last_fullsized":"2024-09-13T17:07:46.839204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:28.877530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.836249+0000","last_change":"2024-09-13T17:07:46.829757+0000","last_active":"2024-09-13T17:07:46.836249+0000","last_peered":"2024-09-13T17:07:46.836249+0000","last_clean":"2024-09-13T17:07:46.836249+0000","last_became_active":"2024-09-13T17:07:46.829269+0000","last_became_peered":"2024-09-13T17:07:46.829269+0000","last_unstale":"2024-09-13T17:07:46.836249+0000","last_undegraded":"2024-09-13T17:07:46.836249+0000","last_fullsized":"2024-09-13T17:07:46.836249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.834153+0000","last_change":"2024-09-13T17:07:46.466176+0000","last_active":"2024-09-13T17:07:46.834153+0000","last_peered":"2024-09-13T17:07:46.834153+0000","last_clean":"2024-09-13T17:07:46.834153+0000","last_became_active":"2024-09-13T17:07:46.465971+0000","last_became_peered":"2024-09-13T17:07:46.465971+0000","last_unstale":"2024-09-13T17:07:46.834153+0000","last_undegraded":"2024-09-13T17:07:46.834153+0000","last_fullsized":"2024-09-13T17:07:46.834153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:16.394194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.830239+0000","last_change":"2024-09-13T17:07:46.826738+0000","last_active":"2024-09-13T17:07:46.830239+0000","last_peered":"2024-09-13T17:07:46.830239+0000","last_clean":"2024-09-13T17:07:46.830239+0000","last_became_active":"2024-09-13T17:07:46.826481+0000","last_became_peered":"2024-09-13T17:07:46.826481+0000","last_unstale":"2024-09-13T17:07:46.830239+0000","last_undegraded":"2024-09-13T17:07:46.830239+0000","last_fullsized":"2024-09-13T17:07:46.830239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.838817+0000","last_change":"2024-09-13T17:07:46.463243+0000","last_active":"2024-09-13T17:07:46.838817+0000","last_peered":"2024-09-13T17:07:46.838817+0000","last_clean":"2024-09-13T17:07:46.838817+0000","last_became_active":"2024-09-13T17:07:46.458515+0000","last_became_peered":"2024-09-13T17:07:46.458515+0000","last_unstale":"2024-09-13T17:07:46.838817+0000","last_undegraded":"2024-09-13T17:07:46.838817+0000","last_fullsized":"2024-09-13T17:07:46.838817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:50.939498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.829629+0000","last_change":"2024-09-13T17:07:46.820780+0000","last_active":"2024-09-13T17:07:46.829629+0000","last_peered":"2024-09-13T17:07:46.829629+0000","last_clean":"2024-09-13T17:07:46.829629+0000","last_became_active":"2024-09-13T17:07:46.820475+0000","last_became_peered":"2024-09-13T17:07:46.820475+0000","last_unstale":"2024-09-13T17:07:46.829629+0000","last_undegraded":"2024-09-13T17:07:46.829629+0000","last_fullsized":"2024-09-13T17:07:46.829629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:15.222141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.839052+0000","last_change":"2024-09-13T17:07:46.458577+0000","last_active":"2024-09-13T17:07:46.839052+0000","last_peered":"2024-09-13T17:07:46.839052+0000","last_clean":"2024-09-13T17:07:46.839052+0000","last_became_active":"2024-09-13T17:07:46.458092+0000","last_became_peered":"2024-09-13T17:07:46.458092+0000","last_unstale":"2024-09-13T17:07:46.839052+0000","last_undegraded":"2024-09-13T17:07:46.839052+0000","last_fullsized":"2024-09-13T17:07:46.839052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:40.898298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.834170+0000","last_change":"2024-09-13T17:07:46.825572+0000","last_active":"2024-09-13T17:07:46.834170+0000","last_peered":"2024-09-13T17:07:46.834170+0000","last_clean":"2024-09-13T17:07:46.834170+0000","last_became_active":"2024-09-13T17:07:46.825347+0000","last_became_peered":"2024-09-13T17:07:46.825347+0000","last_unstale":"2024-09-13T17:07:46.834170+0000","last_undegraded":"2024-09-13T17:07:46.834170+0000","last_fullsized":"2024-09-13T17:07:46.834170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825286+0000","last_change":"2024-09-13T17:07:46.468729+0000","last_active":"2024-09-13T17:07:46.825286+0000","last_peered":"2024-09-13T17:07:46.825286+0000","last_clean":"2024-09-13T17:07:46.825286+0000","last_became_active":"2024-09-13T17:07:46.468433+0000","last_became_peered":"2024-09-13T17:07:46.468433+0000","last_unstale":"2024-09-13T17:07:46.825286+0000","last_undegraded":"2024-09-13T17:07:46.825286+0000","last_fullsized":"2024-09-13T17:07:46.825286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:31.087286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.830235+0000","last_change":"2024-09-13T17:07:46.822157+0000","last_active":"2024-09-13T17:07:46.830235+0000","last_peered":"2024-09-13T17:07:46.830235+0000","last_clean":"2024-09-13T17:07:46.830235+0000","last_became_active":"2024-09-13T17:07:46.821930+0000","last_became_peered":"2024-09-13T17:07:46.821930+0000","last_unstale":"2024-09-13T17:07:46.830235+0000","last_undegraded":"2024-09-13T17:07:46.830235+0000","last_fullsized":"2024-09-13T17:07:46.830235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.827507+0000","last_change":"2024-09-13T17:07:46.459288+0000","last_active":"2024-09-13T17:07:46.827507+0000","last_peered":"2024-09-13T17:07:46.827507+0000","last_clean":"2024-09-13T17:07:46.827507+0000","last_became_active":"2024-09-13T17:07:46.459007+0000","last_became_peered":"2024-09-13T17:07:46.459007+0000","last_unstale":"2024-09-13T17:07:46.827507+0000","last_undegraded":"2024-09-13T17:07:46.827507+0000","last_fullsized":"2024-09-13T17:07:46.827507+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:29.395885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.833651+0000","last_change":"2024-09-13T17:07:46.826627+0000","last_active":"2024-09-13T17:07:46.833651+0000","last_peered":"2024-09-13T17:07:46.833651+0000","last_clean":"2024-09-13T17:07:46.833651+0000","last_became_active":"2024-09-13T17:07:46.826393+0000","last_became_peered":"2024-09-13T17:07:46.826393+0000","last_unstale":"2024-09-13T17:07:46.833651+0000","last_undegraded":"2024-09-13T17:07:46.833651+0000","last_fullsized":"2024-09-13T17:07:46.833651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:46.683237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825481+0000","last_change":"2024-09-13T17:07:46.461106+0000","last_active":"2024-09-13T17:07:46.825481+0000","last_peered":"2024-09-13T17:07:46.825481+0000","last_clean":"2024-09-13T17:07:46.825481+0000","last_became_active":"2024-09-13T17:07:46.460874+0000","last_became_peered":"2024-09-13T17:07:46.460874+0000","last_unstale":"2024-09-13T17:07:46.825481+0000","last_undegraded":"2024-09-13T17:07:46.825481+0000","last_fullsized":"2024-09-13T17:07:46.825481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:32.873876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.827962+0000","last_change":"2024-09-13T17:07:46.821371+0000","last_active":"2024-09-13T17:07:46.827962+0000","last_peered":"2024-09-13T17:07:46.827962+0000","last_clean":"2024-09-13T17:07:46.827962+0000","last_became_active":"2024-09-13T17:07:46.821128+0000","last_became_peered":"2024-09-13T17:07:46.821128+0000","last_unstale":"2024-09-13T17:07:46.827962+0000","last_undegraded":"2024-09-13T17:07:46.827962+0000","last_fullsized":"2024-09-13T17:07:46.827962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822947+0000","last_change":"2024-09-13T17:07:46.463906+0000","last_active":"2024-09-13T17:07:46.822947+0000","last_peered":"2024-09-13T17:07:46.822947+0000","last_clean":"2024-09-13T17:07:46.822947+0000","last_became_active":"2024-09-13T17:07:46.463601+0000","last_became_peered":"2024-09-13T17:07:46.463601+0000","last_unstale":"2024-09-13T17:07:46.822947+0000","last_undegraded":"2024-09-13T17:07:46.822947+0000","last_fullsized":"2024-09-13T17:07:46.822947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:31.087286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825371+0000","last_change":"2024-09-13T17:07:46.818746+0000","last_active":"2024-09-13T17:07:46.825371+0000","last_peered":"2024-09-13T17:07:46.825371+0000","last_clean":"2024-09-13T17:07:46.825371+0000","last_became_active":"2024-09-13T17:07:46.818495+0000","last_became_peered":"2024-09-13T17:07:46.818495+0000","last_unstale":"2024-09-13T17:07:46.825371+0000","last_undegraded":"2024-09-13T17:07:46.825371+0000","last_fullsized":"2024-09-13T17:07:46.825371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.836745+0000","last_change":"2024-09-13T17:07:46.461668+0000","last_active":"2024-09-13T17:07:46.836745+0000","last_peered":"2024-09-13T17:07:46.836745+0000","last_clean":"2024-09-13T17:07:46.836745+0000","last_became_active":"2024-09-13T17:07:46.461382+0000","last_became_peered":"2024-09-13T17:07:46.461382+0000","last_unstale":"2024-09-13T17:07:46.836745+0000","last_undegraded":"2024-09-13T17:07:46.836745+0000","last_fullsized":"2024-09-13T17:07:46.836745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:36.337890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.833487+0000","last_change":"2024-09-13T17:07:46.825662+0000","last_active":"2024-09-13T17:07:46.833487+0000","last_peered":"2024-09-13T17:07:46.833487+0000","last_clean":"2024-09-13T17:07:46.833487+0000","last_became_active":"2024-09-13T17:07:46.825407+0000","last_became_peered":"2024-09-13T17:07:46.825407+0000","last_unstale":"2024-09-13T17:07:46.833487+0000","last_undegraded":"2024-09-13T17:07:46.833487+0000","last_fullsized":"2024-09-13T17:07:46.833487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.841450+0000","last_change":"2024-09-13T17:07:46.463093+0000","last_active":"2024-09-13T17:07:46.841450+0000","last_peered":"2024-09-13T17:07:46.841450+0000","last_clean":"2024-09-13T17:07:46.841450+0000","last_became_active":"2024-09-13T17:07:46.462889+0000","last_became_peered":"2024-09-13T17:07:46.462889+0000","last_unstale":"2024-09-13T17:07:46.841450+0000","last_undegraded":"2024-09-13T17:07:46.841450+0000","last_fullsized":"2024-09-13T17:07:46.841450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.833788+0000","last_change":"2024-09-13T17:07:46.825971+0000","last_active":"2024-09-13T17:07:46.833788+0000","last_peered":"2024-09-13T17:07:46.833788+0000","last_clean":"2024-09-13T17:07:46.833788+0000","last_became_active":"2024-09-13T17:07:46.825722+0000","last_became_peered":"2024-09-13T17:07:46.825722+0000","last_unstale":"2024-09-13T17:07:46.833788+0000","last_undegraded":"2024-09-13T17:07:46.833788+0000","last_fullsized":"2024-09-13T17:07:46.833788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:34.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.836411+0000","last_change":"2024-09-13T17:07:46.463442+0000","last_active":"2024-09-13T17:07:46.836411+0000","last_peered":"2024-09-13T17:07:46.836411+0000","last_clean":"2024-09-13T17:07:46.836411+0000","last_became_active":"2024-09-13T17:07:46.459612+0000","last_became_peered":"2024-09-13T17:07:46.459612+0000","last_unstale":"2024-09-13T17:07:46.836411+0000","last_undegraded":"2024-09-13T17:07:46.836411+0000","last_fullsized":"2024-09-13T17:07:46.836411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:24.900637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.826343+0000","last_change":"2024-09-13T17:07:46.820438+0000","last_active":"2024-09-13T17:07:46.826343+0000","last_peered":"2024-09-13T17:07:46.826343+0000","last_clean":"2024-09-13T17:07:46.826343+0000","last_became_active":"2024-09-13T17:07:46.820201+0000","last_became_peered":"2024-09-13T17:07:46.820201+0000","last_unstale":"2024-09-13T17:07:46.826343+0000","last_undegraded":"2024-09-13T17:07:46.826343+0000","last_fullsized":"2024-09-13T17:07:46.826343+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818673+0000","last_change":"2024-09-13T17:07:46.459435+0000","last_active":"2024-09-13T17:07:46.818673+0000","last_peered":"2024-09-13T17:07:46.818673+0000","last_clean":"2024-09-13T17:07:46.818673+0000","last_became_active":"2024-09-13T17:07:46.459153+0000","last_became_peered":"2024-09-13T17:07:46.459153+0000","last_unstale":"2024-09-13T17:07:46.818673+0000","last_undegraded":"2024-09-13T17:07:46.818673+0000","last_fullsized":"2024-09-13T17:07:46.818673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:07.809881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.830302+0000","last_change":"2024-09-13T17:07:46.826807+0000","last_active":"2024-09-13T17:07:46.830302+0000","last_peered":"2024-09-13T17:07:46.830302+0000","last_clean":"2024-09-13T17:07:46.830302+0000","last_became_active":"2024-09-13T17:07:46.826498+0000","last_became_peered":"2024-09-13T17:07:46.826498+0000","last_unstale":"2024-09-13T17:07:46.830302+0000","last_undegraded":"2024-09-13T17:07:46.830302+0000","last_fullsized":"2024-09-13T17:07:46.830302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825271+0000","last_change":"2024-09-13T17:07:46.459612+0000","last_active":"2024-09-13T17:07:46.825271+0000","last_peered":"2024-09-13T17:07:46.825271+0000","last_clean":"2024-09-13T17:07:46.825271+0000","last_became_active":"2024-09-13T17:07:46.459303+0000","last_became_peered":"2024-09-13T17:07:46.459303+0000","last_unstale":"2024-09-13T17:07:46.825271+0000","last_undegraded":"2024-09-13T17:07:46.825271+0000","last_fullsized":"2024-09-13T17:07:46.825271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:25.626757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.836212+0000","last_change":"2024-09-13T17:07:46.835091+0000","last_active":"2024-09-13T17:07:46.836212+0000","last_peered":"2024-09-13T17:07:46.836212+0000","last_clean":"2024-09-13T17:07:46.836212+0000","last_became_active":"2024-09-13T17:07:46.834805+0000","last_became_peered":"2024-09-13T17:07:46.834805+0000","last_unstale":"2024-09-13T17:07:46.836212+0000","last_undegraded":"2024-09-13T17:07:46.836212+0000","last_fullsized":"2024-09-13T17:07:46.836212+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:37.347764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.839294+0000","last_change":"2024-09-13T17:07:46.462541+0000","last_active":"2024-09-13T17:07:46.839294+0000","last_peered":"2024-09-13T17:07:46.839294+0000","last_clean":"2024-09-13T17:07:46.839294+0000","last_became_active":"2024-09-13T17:07:46.460577+0000","last_became_peered":"2024-09-13T17:07:46.460577+0000","last_unstale":"2024-09-13T17:07:46.839294+0000","last_undegraded":"2024-09-13T17:07:46.839294+0000","last_fullsized":"2024-09-13T17:07:46.839294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:11.941516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.836481+0000","last_change":"2024-09-13T17:07:46.831317+0000","last_active":"2024-09-13T17:07:46.836481+0000","last_peered":"2024-09-13T17:07:46.836481+0000","last_clean":"2024-09-13T17:07:46.836481+0000","last_became_active":"2024-09-13T17:07:46.831035+0000","last_became_peered":"2024-09-13T17:07:46.831035+0000","last_unstale":"2024-09-13T17:07:46.836481+0000","last_undegraded":"2024-09-13T17:07:46.836481+0000","last_fullsized":"2024-09-13T17:07:46.836481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:47.788741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.838932+0000","last_change":"2024-09-13T17:07:46.466551+0000","last_active":"2024-09-13T17:07:46.838932+0000","last_peered":"2024-09-13T17:07:46.838932+0000","last_clean":"2024-09-13T17:07:46.838932+0000","last_became_active":"2024-09-13T17:07:46.466298+0000","last_became_peered":"2024-09-13T17:07:46.466298+0000","last_unstale":"2024-09-13T17:07:46.838932+0000","last_undegraded":"2024-09-13T17:07:46.838932+0000","last_fullsized":"2024-09-13T17:07:46.838932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:49.531696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.834521+0000","last_change":"2024-09-13T17:07:46.832347+0000","last_active":"2024-09-13T17:07:46.834521+0000","last_peered":"2024-09-13T17:07:46.834521+0000","last_clean":"2024-09-13T17:07:46.834521+0000","last_became_active":"2024-09-13T17:07:46.829622+0000","last_became_peered":"2024-09-13T17:07:46.829622+0000","last_unstale":"2024-09-13T17:07:46.834521+0000","last_undegraded":"2024-09-13T17:07:46.834521+0000","last_fullsized":"2024-09-13T17:07:46.834521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:22.791184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.836415+0000","last_change":"2024-09-13T17:07:46.459751+0000","last_active":"2024-09-13T17:07:46.836415+0000","last_peered":"2024-09-13T17:07:46.836415+0000","last_clean":"2024-09-13T17:07:46.836415+0000","last_became_active":"2024-09-13T17:07:46.458678+0000","last_became_peered":"2024-09-13T17:07:46.458678+0000","last_unstale":"2024-09-13T17:07:46.836415+0000","last_undegraded":"2024-09-13T17:07:46.836415+0000","last_fullsized":"2024-09-13T17:07:46.836415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:13.965041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.836251+0000","last_change":"2024-09-13T17:07:46.828914+0000","last_active":"2024-09-13T17:07:46.836251+0000","last_peered":"2024-09-13T17:07:46.836251+0000","last_clean":"2024-09-13T17:07:46.836251+0000","last_became_active":"2024-09-13T17:07:46.828697+0000","last_became_peered":"2024-09-13T17:07:46.828697+0000","last_unstale":"2024-09-13T17:07:46.836251+0000","last_undegraded":"2024-09-13T17:07:46.836251+0000","last_fullsized":"2024-09-13T17:07:46.836251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.836354+0000","last_change":"2024-09-13T17:07:46.464282+0000","last_active":"2024-09-13T17:07:46.836354+0000","last_peered":"2024-09-13T17:07:46.836354+0000","last_clean":"2024-09-13T17:07:46.836354+0000","last_became_active":"2024-09-13T17:07:46.463984+0000","last_became_peered":"2024-09-13T17:07:46.463984+0000","last_unstale":"2024-09-13T17:07:46.836354+0000","last_undegraded":"2024-09-13T17:07:46.836354+0000","last_fullsized":"2024-09-13T17:07:46.836354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:41.634119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824190+0000","last_change":"2024-09-13T17:07:46.821164+0000","last_active":"2024-09-13T17:07:46.824190+0000","last_peered":"2024-09-13T17:07:46.824190+0000","last_clean":"2024-09-13T17:07:46.824190+0000","last_became_active":"2024-09-13T17:07:46.820939+0000","last_became_peered":"2024-09-13T17:07:46.820939+0000","last_unstale":"2024-09-13T17:07:46.824190+0000","last_undegraded":"2024-09-13T17:07:46.824190+0000","last_fullsized":"2024-09-13T17:07:46.824190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:32.097160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.827684+0000","last_change":"2024-09-13T17:07:46.458932+0000","last_active":"2024-09-13T17:07:46.827684+0000","last_peered":"2024-09-13T17:07:46.827684+0000","last_clean":"2024-09-13T17:07:46.827684+0000","last_became_active":"2024-09-13T17:07:46.458642+0000","last_became_peered":"2024-09-13T17:07:46.458642+0000","last_unstale":"2024-09-13T17:07:46.827684+0000","last_undegraded":"2024-09-13T17:07:46.827684+0000","last_fullsized":"2024-09-13T17:07:46.827684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:35.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.833469+0000","last_change":"2024-09-13T17:07:46.828756+0000","last_active":"2024-09-13T17:07:46.833469+0000","last_peered":"2024-09-13T17:07:46.833469+0000","last_clean":"2024-09-13T17:07:46.833469+0000","last_became_active":"2024-09-13T17:07:46.827997+0000","last_became_peered":"2024-09-13T17:07:46.827997+0000","last_unstale":"2024-09-13T17:07:46.833469+0000","last_undegraded":"2024-09-13T17:07:46.833469+0000","last_fullsized":"2024-09-13T17:07:46.833469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:26.636631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.836847+0000","last_change":"2024-09-13T17:07:46.460097+0000","last_active":"2024-09-13T17:07:46.836847+0000","last_peered":"2024-09-13T17:07:46.836847+0000","last_clean":"2024-09-13T17:07:46.836847+0000","last_became_active":"2024-09-13T17:07:46.459833+0000","last_became_peered":"2024-09-13T17:07:46.459833+0000","last_unstale":"2024-09-13T17:07:46.836847+0000","last_undegraded":"2024-09-13T17:07:46.836847+0000","last_fullsized":"2024-09-13T17:07:46.836847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:06.069380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824219+0000","last_change":"2024-09-13T17:07:46.820775+0000","last_active":"2024-09-13T17:07:46.824219+0000","last_peered":"2024-09-13T17:07:46.824219+0000","last_clean":"2024-09-13T17:07:46.824219+0000","last_became_active":"2024-09-13T17:07:46.820572+0000","last_became_peered":"2024-09-13T17:07:46.820572+0000","last_unstale":"2024-09-13T17:07:46.824219+0000","last_undegraded":"2024-09-13T17:07:46.824219+0000","last_fullsized":"2024-09-13T17:07:46.824219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:07.079254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825063+0000","last_change":"2024-09-13T17:07:46.460821+0000","last_active":"2024-09-13T17:07:46.825063+0000","last_peered":"2024-09-13T17:07:46.825063+0000","last_clean":"2024-09-13T17:07:46.825063+0000","last_became_active":"2024-09-13T17:07:46.460540+0000","last_became_peered":"2024-09-13T17:07:46.460540+0000","last_unstale":"2024-09-13T17:07:46.825063+0000","last_undegraded":"2024-09-13T17:07:46.825063+0000","last_fullsized":"2024-09-13T17:07:46.825063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:35.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.829115+0000","last_change":"2024-09-13T17:07:46.820742+0000","last_active":"2024-09-13T17:07:46.829115+0000","last_peered":"2024-09-13T17:07:46.829115+0000","last_clean":"2024-09-13T17:07:46.829115+0000","last_became_active":"2024-09-13T17:07:46.820507+0000","last_became_peered":"2024-09-13T17:07:46.820507+0000","last_unstale":"2024-09-13T17:07:46.829115+0000","last_undegraded":"2024-09-13T17:07:46.829115+0000","last_fullsized":"2024-09-13T17:07:46.829115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:33.883750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.827539+0000","last_change":"2024-09-13T17:07:46.463183+0000","last_active":"2024-09-13T17:07:46.827539+0000","last_peered":"2024-09-13T17:07:46.827539+0000","last_clean":"2024-09-13T17:07:46.827539+0000","last_became_active":"2024-09-13T17:07:46.462872+0000","last_became_peered":"2024-09-13T17:07:46.462872+0000","last_unstale":"2024-09-13T17:07:46.827539+0000","last_undegraded":"2024-09-13T17:07:46.827539+0000","last_fullsized":"2024-09-13T17:07:46.827539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:49.753663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825789+0000","last_change":"2024-09-13T17:07:46.823013+0000","last_active":"2024-09-13T17:07:46.825789+0000","last_peered":"2024-09-13T17:07:46.825789+0000","last_clean":"2024-09-13T17:07:46.825789+0000","last_became_active":"2024-09-13T17:07:46.822316+0000","last_became_peered":"2024-09-13T17:07:46.822316+0000","last_unstale":"2024-09-13T17:07:46.825789+0000","last_undegraded":"2024-09-13T17:07:46.825789+0000","last_fullsized":"2024-09-13T17:07:46.825789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:50.839729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.824330+0000","last_change":"2024-09-13T17:07:46.461826+0000","last_active":"2024-09-13T17:07:46.824330+0000","last_peered":"2024-09-13T17:07:46.824330+0000","last_clean":"2024-09-13T17:07:46.824330+0000","last_became_active":"2024-09-13T17:07:46.461348+0000","last_became_peered":"2024-09-13T17:07:46.461348+0000","last_unstale":"2024-09-13T17:07:46.824330+0000","last_undegraded":"2024-09-13T17:07:46.824330+0000","last_fullsized":"2024-09-13T17:07:46.824330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:25.626757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.833565+0000","last_change":"2024-09-13T17:07:46.830098+0000","last_active":"2024-09-13T17:07:46.833565+0000","last_peered":"2024-09-13T17:07:46.833565+0000","last_clean":"2024-09-13T17:07:46.833565+0000","last_became_active":"2024-09-13T17:07:46.829835+0000","last_became_peered":"2024-09-13T17:07:46.829835+0000","last_unstale":"2024-09-13T17:07:46.833565+0000","last_undegraded":"2024-09-13T17:07:46.833565+0000","last_fullsized":"2024-09-13T17:07:46.833565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:37.347764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.834950+0000","last_change":"2024-09-13T17:07:46.466282+0000","last_active":"2024-09-13T17:07:46.834950+0000","last_peered":"2024-09-13T17:07:46.834950+0000","last_clean":"2024-09-13T17:07:46.834950+0000","last_became_active":"2024-09-13T17:07:46.466008+0000","last_became_peered":"2024-09-13T17:07:46.466008+0000","last_unstale":"2024-09-13T17:07:46.834950+0000","last_undegraded":"2024-09-13T17:07:46.834950+0000","last_fullsized":"2024-09-13T17:07:46.834950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:57.898224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.832512+0000","last_change":"2024-09-13T17:07:46.821732+0000","last_active":"2024-09-13T17:07:46.832512+0000","last_peered":"2024-09-13T17:07:46.832512+0000","last_clean":"2024-09-13T17:07:46.832512+0000","last_became_active":"2024-09-13T17:07:46.821507+0000","last_became_peered":"2024-09-13T17:07:46.821507+0000","last_unstale":"2024-09-13T17:07:46.832512+0000","last_undegraded":"2024-09-13T17:07:46.832512+0000","last_fullsized":"2024-09-13T17:07:46.832512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:29.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T17:07:48.538369+0000","last_change":"2024-09-13T17:07:46.459158+0000","last_active":"2024-09-13T17:07:48.538369+0000","last_peered":"2024-09-13T17:07:48.538369+0000","last_clean":"2024-09-13T17:07:48.538369+0000","last_became_active":"2024-09-13T17:07:46.458901+0000","last_became_peered":"2024-09-13T17:07:46.458901+0000","last_unstale":"2024-09-13T17:07:48.538369+0000","last_undegraded":"2024-09-13T17:07:48.538369+0000","last_fullsized":"2024-09-13T17:07:48.538369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:53.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822902+0000","last_change":"2024-09-13T17:07:46.811040+0000","last_active":"2024-09-13T17:07:46.822902+0000","last_peered":"2024-09-13T17:07:46.822902+0000","last_clean":"2024-09-13T17:07:46.822902+0000","last_became_active":"2024-09-13T17:07:46.810738+0000","last_became_peered":"2024-09-13T17:07:46.810738+0000","last_unstale":"2024-09-13T17:07:46.822902+0000","last_undegraded":"2024-09-13T17:07:46.822902+0000","last_fullsized":"2024-09-13T17:07:46.822902+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:40.468817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818785+0000","last_change":"2024-09-13T17:07:46.469077+0000","last_active":"2024-09-13T17:07:46.818785+0000","last_peered":"2024-09-13T17:07:46.818785+0000","last_clean":"2024-09-13T17:07:46.818785+0000","last_became_active":"2024-09-13T17:07:46.468808+0000","last_became_peered":"2024-09-13T17:07:46.468808+0000","last_unstale":"2024-09-13T17:07:46.818785+0000","last_undegraded":"2024-09-13T17:07:46.818785+0000","last_fullsized":"2024-09-13T17:07:46.818785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:55.638425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825048+0000","last_change":"2024-09-13T17:07:46.820219+0000","last_active":"2024-09-13T17:07:46.825048+0000","last_peered":"2024-09-13T17:07:46.825048+0000","last_clean":"2024-09-13T17:07:46.825048+0000","last_became_active":"2024-09-13T17:07:46.819114+0000","last_became_peered":"2024-09-13T17:07:46.819114+0000","last_unstale":"2024-09-13T17:07:46.825048+0000","last_undegraded":"2024-09-13T17:07:46.825048+0000","last_fullsized":"2024-09-13T17:07:46.825048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:52.025688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.822888+0000","last_change":"2024-09-13T17:07:46.462465+0000","last_active":"2024-09-13T17:07:46.822888+0000","last_peered":"2024-09-13T17:07:46.822888+0000","last_clean":"2024-09-13T17:07:46.822888+0000","last_became_active":"2024-09-13T17:07:46.462216+0000","last_became_peered":"2024-09-13T17:07:46.462216+0000","last_unstale":"2024-09-13T17:07:46.822888+0000","last_undegraded":"2024-09-13T17:07:46.822888+0000","last_fullsized":"2024-09-13T17:07:46.822888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:11.941516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.828357+0000","last_change":"2024-09-13T17:07:46.822778+0000","last_active":"2024-09-13T17:07:46.828357+0000","last_peered":"2024-09-13T17:07:46.828357+0000","last_clean":"2024-09-13T17:07:46.828357+0000","last_became_active":"2024-09-13T17:07:46.822504+0000","last_became_peered":"2024-09-13T17:07:46.822504+0000","last_unstale":"2024-09-13T17:07:46.828357+0000","last_undegraded":"2024-09-13T17:07:46.828357+0000","last_fullsized":"2024-09-13T17:07:46.828357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:50.541570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.818688+0000","last_change":"2024-09-13T17:07:46.466175+0000","last_active":"2024-09-13T17:07:46.818688+0000","last_peered":"2024-09-13T17:07:46.818688+0000","last_clean":"2024-09-13T17:07:46.818688+0000","last_became_active":"2024-09-13T17:07:46.465896+0000","last_became_peered":"2024-09-13T17:07:46.465896+0000","last_unstale":"2024-09-13T17:07:46.818688+0000","last_undegraded":"2024-09-13T17:07:46.818688+0000","last_fullsized":"2024-09-13T17:07:46.818688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:36.337890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825616+0000","last_change":"2024-09-13T17:07:46.820250+0000","last_active":"2024-09-13T17:07:46.825616+0000","last_peered":"2024-09-13T17:07:46.825616+0000","last_clean":"2024-09-13T17:07:46.825616+0000","last_became_active":"2024-09-13T17:07:46.820005+0000","last_became_peered":"2024-09-13T17:07:46.820005+0000","last_unstale":"2024-09-13T17:07:46.825616+0000","last_undegraded":"2024-09-13T17:07:46.825616+0000","last_fullsized":"2024-09-13T17:07:46.825616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:52.581919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.827554+0000","last_change":"2024-09-13T17:07:46.463288+0000","last_active":"2024-09-13T17:07:46.827554+0000","last_peered":"2024-09-13T17:07:46.827554+0000","last_clean":"2024-09-13T17:07:46.827554+0000","last_became_active":"2024-09-13T17:07:46.462965+0000","last_became_peered":"2024-09-13T17:07:46.462965+0000","last_unstale":"2024-09-13T17:07:46.827554+0000","last_undegraded":"2024-09-13T17:07:46.827554+0000","last_fullsized":"2024-09-13T17:07:46.827554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:59.219013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.834287+0000","last_change":"2024-09-13T17:07:46.825815+0000","last_active":"2024-09-13T17:07:46.834287+0000","last_peered":"2024-09-13T17:07:46.834287+0000","last_clean":"2024-09-13T17:07:46.834287+0000","last_became_active":"2024-09-13T17:07:46.825560+0000","last_became_peered":"2024-09-13T17:07:46.825560+0000","last_unstale":"2024-09-13T17:07:46.834287+0000","last_undegraded":"2024-09-13T17:07:46.834287+0000","last_fullsized":"2024-09-13T17:07:46.834287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:40.468817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825242+0000","last_change":"2024-09-13T17:07:46.463686+0000","last_active":"2024-09-13T17:07:46.825242+0000","last_peered":"2024-09-13T17:07:46.825242+0000","last_clean":"2024-09-13T17:07:46.825242+0000","last_became_active":"2024-09-13T17:07:46.463437+0000","last_became_peered":"2024-09-13T17:07:46.463437+0000","last_unstale":"2024-09-13T17:07:46.825242+0000","last_undegraded":"2024-09-13T17:07:46.825242+0000","last_fullsized":"2024-09-13T17:07:46.825242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:53.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.823041+0000","last_change":"2024-09-13T17:07:46.821675+0000","last_active":"2024-09-13T17:07:46.823041+0000","last_peered":"2024-09-13T17:07:46.823041+0000","last_clean":"2024-09-13T17:07:46.823041+0000","last_became_active":"2024-09-13T17:07:46.821260+0000","last_became_peered":"2024-09-13T17:07:46.821260+0000","last_unstale":"2024-09-13T17:07:46.823041+0000","last_undegraded":"2024-09-13T17:07:46.823041+0000","last_fullsized":"2024-09-13T17:07:46.823041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:46.436012+0000","last_clean_scrub_stamp":"2024-09-13T17:07:46.436012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:36.033290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.825081+0000","last_change":"2024-09-13T17:07:46.464490+0000","last_active":"2024-09-13T17:07:46.825081+0000","last_peered":"2024-09-13T17:07:46.825081+0000","last_clean":"2024-09-13T17:07:46.825081+0000","last_became_active":"2024-09-13T17:07:46.464175+0000","last_became_peered":"2024-09-13T17:07:46.464175+0000","last_unstale":"2024-09-13T17:07:46.825081+0000","last_undegraded":"2024-09-13T17:07:46.825081+0000","last_fullsized":"2024-09-13T17:07:46.825081+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:45.426138+0000","last_clean_scrub_stamp":"2024-09-13T17:07:45.426138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:50.939498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T17:07:46.809945+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:07:46.809945+0000","last_peered":"2024-09-13T17:07:46.809945+0000","last_clean":"2024-09-13T17:07:46.809945+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:07:46.809945+0000","last_undegraded":"2024-09-13T17:07:46.809945+0000","last_fullsized":"2024-09-13T17:07:46.809945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":742345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.88900000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.86399999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.627},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.038}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.123},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.997},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.298}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.161},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.93400000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.226}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":152503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.873},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.753},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.92100000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.998}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":152559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.79600000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.133},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.101}]},{"osd":2,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.93700000000000006}]},{"osd":4,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.024},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.89500000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.052},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.173}]},{"osd":7,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.218}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":151991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.72199999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.04}]},{"osd":2,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.127},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.86199999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":1.1659999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.204},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.2709999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.77400000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.083}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":153473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.626},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.77300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.83299999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.875},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.81100000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.91500000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.028}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":151957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.58999999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.79200000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.94099999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.73599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.67400000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.83699999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.86099999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":1.284}]},{"osd":6,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.998},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.0680000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.96199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":742255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.25,"5min":3.25,"15min":3.25},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.5590000000000002,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":6.4089999999999998,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.55400000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.7060000000000004,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":6.2729999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.74099999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":5.3019999999999996,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.9039999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":1.03}]},{"osd":5,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.054},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.84499999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":4.2599999999999998,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.98399999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.87},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":5.7510000000000003,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":1.0089999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:07:54.608 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:07:54.609 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T17:07:54.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.728+0000 7fdd3bfff700 1 Processor -- start 2024-09-13T17:07:54.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.728+0000 7fdd3bfff700 1 -- start start 2024-09-13T17:07:54.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdd340e1910 0x7fdd34056f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:54.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdd340574b0 0x7fdd34052fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:54.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd34052560 0x7fdd340534e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:54.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd340520d0 con 0x7fdd340574b0 2024-09-13T17:07:54.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd340517a0 con 0x7fdd340e1910 2024-09-13T17:07:54.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd34051a80 con 0x7fdd34052560 2024-09-13T17:07:54.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3a7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdd340574b0 0x7fdd34052fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:54.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3a7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdd340574b0 0x7fdd34052fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36672/0 (socket says 172.21.15.123:36672) 2024-09-13T17:07:54.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3a7fc700 1 -- 172.21.15.123:0/2056599247 learned_addr learned my addr 172.21.15.123:0/2056599247 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:54.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3affd700 1 --2- 172.21.15.123:0/2056599247 >> v2:172.21.15.153:3300/0 conn(0x7fdd340e1910 0x7fdd34056f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:54.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3b7fe700 1 --2- 172.21.15.123:0/2056599247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd34052560 0x7fdd340534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:54.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3a7fc700 1 -- 172.21.15.123:0/2056599247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd34052560 msgr2=0x7fdd340534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:54.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3a7fc700 1 --2- 172.21.15.123:0/2056599247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd34052560 0x7fdd340534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3a7fc700 1 -- 172.21.15.123:0/2056599247 >> v2:172.21.15.153:3300/0 conn(0x7fdd340e1910 msgr2=0x7fdd34056f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:54.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3a7fc700 1 --2- 172.21.15.123:0/2056599247 >> v2:172.21.15.153:3300/0 conn(0x7fdd340e1910 0x7fdd34056f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3a7fc700 1 -- 172.21.15.123:0/2056599247 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd34051d60 con 0x7fdd340574b0 2024-09-13T17:07:54.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3affd700 1 --2- 172.21.15.123:0/2056599247 >> v2:172.21.15.153:3300/0 conn(0x7fdd340e1910 0x7fdd34056f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:54.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3b7fe700 1 --2- 172.21.15.123:0/2056599247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd34052560 0x7fdd340534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:54.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3a7fc700 1 --2- 172.21.15.123:0/2056599247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd340574b0 0x7fdd34052fa0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdd340393e0 tx=0x7fdd2c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3297a9783bbbb42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:54.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd39ffb700 1 -- 172.21.15.123:0/2056599247 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c00b8a0 con 0x7fdd340574b0 2024-09-13T17:07:54.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd39ffb700 1 -- 172.21.15.123:0/2056599247 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c00ba00 con 0x7fdd340574b0 2024-09-13T17:07:54.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd39ffb700 1 -- 172.21.15.123:0/2056599247 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c00bd90 con 0x7fdd340574b0 2024-09-13T17:07:54.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2056599247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd340574b0 msgr2=0x7fdd34052fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:54.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 --2- 172.21.15.123:0/2056599247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd340574b0 0x7fdd34052fa0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdd340393e0 tx=0x7fdd2c009bf0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2056599247 shutdown_connections 2024-09-13T17:07:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 --2- 172.21.15.123:0/2056599247 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd34052560 0x7fdd340534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 --2- 172.21.15.123:0/2056599247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd340574b0 0x7fdd34052fa0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 --2- 172.21.15.123:0/2056599247 >> v2:172.21.15.153:3300/0 conn(0x7fdd340e1910 0x7fdd34056f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2056599247 >> 172.21.15.123:0/2056599247 conn(0x7fdd3401fbf0 msgr2=0x7fdd34056860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2056599247 shutdown_connections 2024-09-13T17:07:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.732+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2056599247 wait complete. 2024-09-13T17:07:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3bfff700 1 Processor -- start 2024-09-13T17:07:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3bfff700 1 -- start start 2024-09-13T17:07:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd34052560 0x7fdd34175bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd340574b0 0x7fdd3404d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd340e1910 0x7fdd3404f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3bfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3404eeb0 con 0x7fdd340e1910 2024-09-13T17:07:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3bfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3404e230 con 0x7fdd34052560 2024-09-13T17:07:54.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3404e510 con 0x7fdd340574b0 2024-09-13T17:07:54.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd340e1910 0x7fdd3404f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:54.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd34052560 0x7fdd34175bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:54.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd340e1910 0x7fdd3404f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36682/0 (socket says 172.21.15.123:36682) 2024-09-13T17:07:54.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd34052560 0x7fdd34175bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:37664/0 (socket says 172.21.15.123:37664) 2024-09-13T17:07:54.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3b7fe700 1 -- 172.21.15.123:0/2934022013 learned_addr learned my addr 172.21.15.123:0/2934022013 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:54.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3a7fc700 1 --2- 172.21.15.123:0/2934022013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd340574b0 0x7fdd3404d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:54.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3b7fe700 1 -- 172.21.15.123:0/2934022013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd340574b0 msgr2=0x7fdd3404d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:54.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3b7fe700 1 --2- 172.21.15.123:0/2934022013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd340574b0 0x7fdd3404d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3b7fe700 1 -- 172.21.15.123:0/2934022013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd34052560 msgr2=0x7fdd34175bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:54.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3b7fe700 1 --2- 172.21.15.123:0/2934022013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd34052560 0x7fdd34175bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3b7fe700 1 -- 172.21.15.123:0/2934022013 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c009570 con 0x7fdd340e1910 2024-09-13T17:07:54.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3a7fc700 1 --2- 172.21.15.123:0/2934022013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd340574b0 0x7fdd3404d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:07:54.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3b7fe700 1 --2- 172.21.15.123:0/2934022013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd340e1910 0x7fdd3404f880 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c04fc20 tx=0x7fdd3c067ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:54.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd337fe700 1 -- 172.21.15.123:0/2934022013 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0720d0 con 0x7fdd340e1910 2024-09-13T17:07:54.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd337fe700 1 -- 172.21.15.123:0/2934022013 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c072270 con 0x7fdd340e1910 2024-09-13T17:07:54.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd337fe700 1 -- 172.21.15.123:0/2934022013 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c072620 con 0x7fdd340e1910 2024-09-13T17:07:54.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2934022013 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3404e7f0 con 0x7fdd340e1910 2024-09-13T17:07:54.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.736+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2934022013 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd341760f0 con 0x7fdd340e1910 2024-09-13T17:07:54.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.740+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2934022013 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3404eff0 con 0x7fdd340e1910 2024-09-13T17:07:54.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.740+0000 7fdd337fe700 1 -- 172.21.15.123:0/2934022013 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdd3c072780 con 0x7fdd340e1910 2024-09-13T17:07:54.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.740+0000 7fdd337fe700 1 --2- 172.21.15.123:0/2934022013 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdd1c066730 0x7fdd1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:54.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.740+0000 7fdd337fe700 1 -- 172.21.15.123:0/2934022013 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd3c0fe2c0 con 0x7fdd340e1910 2024-09-13T17:07:54.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.740+0000 7fdd3affd700 1 --2- 172.21.15.123:0/2934022013 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdd1c066730 0x7fdd1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:54.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.740+0000 7fdd3affd700 1 --2- 172.21.15.123:0/2934022013 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdd1c066730 0x7fdd1c068bf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400ab60 tx=0x7fdd24008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:54.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.748+0000 7fdd337fe700 1 -- 172.21.15.123:0/2934022013 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdd3404eff0 con 0x7fdd340e1910 2024-09-13T17:07:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.980+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2934022013 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fdd3404eff0 con 0x7fdd340e1910 2024-09-13T17:07:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.988+0000 7fdd337fe700 1 -- 172.21.15.123:0/2934022013 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7fdd3404eff0 con 0x7fdd340e1910 2024-09-13T17:07:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.992+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2934022013 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdd1c066730 msgr2=0x7fdd1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.992+0000 7fdd3bfff700 1 --2- 172.21.15.123:0/2934022013 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdd1c066730 0x7fdd1c068bf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400ab60 tx=0x7fdd24008040 comp rx=0 tx=0).stop 2024-09-13T17:07:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.992+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2934022013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd340e1910 msgr2=0x7fdd3404f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.992+0000 7fdd3bfff700 1 --2- 172.21.15.123:0/2934022013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd340e1910 0x7fdd3404f880 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c04fc20 tx=0x7fdd3c067ef0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.992+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2934022013 shutdown_connections 2024-09-13T17:07:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.992+0000 7fdd3bfff700 1 --2- 172.21.15.123:0/2934022013 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fdd1c066730 0x7fdd1c068bf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.992+0000 7fdd3bfff700 1 --2- 172.21.15.123:0/2934022013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd340e1910 0x7fdd3404f880 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.992+0000 7fdd3bfff700 1 --2- 172.21.15.123:0/2934022013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdd340574b0 0x7fdd3404d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.992+0000 7fdd3bfff700 1 --2- 172.21.15.123:0/2934022013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd34052560 0x7fdd34175bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.992+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2934022013 >> 172.21.15.123:0/2934022013 conn(0x7fdd3401fbf0 msgr2=0x7fdd340e3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.992+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2934022013 shutdown_connections 2024-09-13T17:07:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:54.992+0000 7fdd3bfff700 1 -- 172.21.15.123:0/2934022013 wait complete. 2024-09-13T17:07:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-13T17:07:55.008 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:07:55.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.116+0000 7f5421125700 1 Processor -- start 2024-09-13T17:07:55.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.116+0000 7f5421125700 1 -- start start 2024-09-13T17:07:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5421125700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f541c071580 0x7f541c0705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5421125700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f541c15b9b0 0x7f541c0cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5421125700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541c0cee80 con 0x7f541c15a8c0 2024-09-13T17:07:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5421125700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541c15be60 con 0x7f541c071580 2024-09-13T17:07:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5421125700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0ce270 con 0x7f541c15b9b0 2024-09-13T17:07:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f541bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f541c15a8c0 0x7f541c070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34078/0 (socket says 172.21.15.123:34078) 2024-09-13T17:07:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f541bfff700 1 -- 172.21.15.123:0/2714069643 learned_addr learned my addr 172.21.15.123:0/2714069643 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5420924700 1 --2- 172.21.15.123:0/2714069643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f541c15b9b0 0x7f541c0cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f54137fe700 1 --2- 172.21.15.123:0/2714069643 >> v2:172.21.15.153:3300/0 conn(0x7f541c071580 0x7f541c0705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f541b7fe700 1 -- 172.21.15.123:0/2714069643 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431506466 0 0) 0x7f541c0cee80 con 0x7f541c15a8c0 2024-09-13T17:07:55.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f541b7fe700 1 -- 172.21.15.123:0/2714069643 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54080035d0 con 0x7f541c15a8c0 2024-09-13T17:07:55.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5420924700 1 -- 172.21.15.123:0/2714069643 >> v2:172.21.15.153:3300/0 conn(0x7f541c071580 msgr2=0x7f541c0705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:55.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5420924700 1 --2- 172.21.15.123:0/2714069643 >> v2:172.21.15.153:3300/0 conn(0x7f541c071580 0x7f541c0705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5420924700 1 -- 172.21.15.123:0/2714069643 >> v1:172.21.15.123:6789/0 conn(0x7f541c15a8c0 legacy=0x7f541c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5420924700 1 -- 172.21.15.123:0/2714069643 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c0ce550 con 0x7f541c15b9b0 2024-09-13T17:07:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5420924700 1 --2- 172.21.15.123:0/2714069643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f541c15b9b0 0x7f541c0cc620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5414009d90 tx=0x7f541400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f0147579de20f7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f541b7fe700 1 -- 172.21.15.123:0/2714069643 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541400e070 con 0x7f541c15b9b0 2024-09-13T17:07:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f541b7fe700 1 -- 172.21.15.123:0/2714069643 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541400bb20 con 0x7f541c15b9b0 2024-09-13T17:07:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f541b7fe700 1 -- 172.21.15.123:0/2714069643 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5414012430 con 0x7f541c15b9b0 2024-09-13T17:07:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5421125700 1 -- 172.21.15.123:0/2714069643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f541c15b9b0 msgr2=0x7f541c0cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5421125700 1 --2- 172.21.15.123:0/2714069643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f541c15b9b0 0x7f541c0cc620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5414009d90 tx=0x7f541400b330 comp rx=0 tx=0).stop 2024-09-13T17:07:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5421125700 1 -- 172.21.15.123:0/2714069643 shutdown_connections 2024-09-13T17:07:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5421125700 1 --2- 172.21.15.123:0/2714069643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f541c15b9b0 0x7f541c0cc620 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5421125700 1 --2- 172.21.15.123:0/2714069643 >> v2:172.21.15.153:3300/0 conn(0x7f541c071580 0x7f541c0705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5421125700 1 -- 172.21.15.123:0/2714069643 >> 172.21.15.123:0/2714069643 conn(0x7f541c066150 msgr2=0x7f541c066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5421125700 1 -- 172.21.15.123:0/2714069643 shutdown_connections 2024-09-13T17:07:55.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.120+0000 7f5421125700 1 -- 172.21.15.123:0/2714069643 wait complete. 2024-09-13T17:07:55.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f5421125700 1 Processor -- start 2024-09-13T17:07:55.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f5421125700 1 -- start start 2024-09-13T17:07:55.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f5421125700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f541c071580 0x7f541c157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f5421125700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f541c15a8c0 0x7f541c14db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f5421125700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f541c15b9b0 0x7f541c150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f5421125700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c14f7f0 con 0x7f541c071580 2024-09-13T17:07:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f5421125700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c14ebe0 con 0x7f541c15b9b0 2024-09-13T17:07:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f5421125700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c14eec0 con 0x7f541c15a8c0 2024-09-13T17:07:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f541bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f541c071580 0x7f541c157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f54137fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f541c15a8c0 0x7f541c14db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f541bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f541c071580 0x7f541c157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36688/0 (socket says 172.21.15.123:36688) 2024-09-13T17:07:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f541bfff700 1 -- 172.21.15.123:0/3178918539 learned_addr learned my addr 172.21.15.123:0/3178918539 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f5420924700 1 --2- 172.21.15.123:0/3178918539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f541c15b9b0 0x7f541c150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f541bfff700 1 -- 172.21.15.123:0/3178918539 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f541c15a8c0 msgr2=0x7f541c14db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f541bfff700 1 --2- 172.21.15.123:0/3178918539 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f541c15a8c0 0x7f541c14db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f541bfff700 1 -- 172.21.15.123:0/3178918539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f541c15b9b0 msgr2=0x7f541c150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f541bfff700 1 --2- 172.21.15.123:0/3178918539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f541c15b9b0 0x7f541c150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f541bfff700 1 -- 172.21.15.123:0/3178918539 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5414009a70 con 0x7f541c071580 2024-09-13T17:07:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.124+0000 7f541bfff700 1 --2- 172.21.15.123:0/3178918539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f541c071580 0x7f541c157a70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f540c00c700 tx=0x7f540c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.128+0000 7f54197fa700 1 -- 172.21.15.123:0/3178918539 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c005d90 con 0x7f541c071580 2024-09-13T17:07:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.128+0000 7f54197fa700 1 -- 172.21.15.123:0/3178918539 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c0070d0 con 0x7f541c071580 2024-09-13T17:07:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.128+0000 7f5421125700 1 -- 172.21.15.123:0/3178918539 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541c14f1a0 con 0x7f541c071580 2024-09-13T17:07:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.128+0000 7f54197fa700 1 -- 172.21.15.123:0/3178918539 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c007480 con 0x7f541c071580 2024-09-13T17:07:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.128+0000 7f5421125700 1 -- 172.21.15.123:0/3178918539 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541c14e0a0 con 0x7f541c071580 2024-09-13T17:07:55.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.128+0000 7f54197fa700 1 -- 172.21.15.123:0/3178918539 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f540c0075e0 con 0x7f541c071580 2024-09-13T17:07:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.128+0000 7f5421125700 1 -- 172.21.15.123:0/3178918539 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541c0677f0 con 0x7f541c071580 2024-09-13T17:07:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.128+0000 7f54197fa700 1 --2- 172.21.15.123:0/3178918539 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f53fc066760 0x7f53fc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.132+0000 7f54197fa700 1 -- 172.21.15.123:0/3178918539 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f540c083610 con 0x7f541c071580 2024-09-13T17:07:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.132+0000 7f54137fe700 1 --2- 172.21.15.123:0/3178918539 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f53fc066760 0x7f53fc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.132+0000 7f54137fe700 1 --2- 172.21.15.123:0/3178918539 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f53fc066760 0x7f53fc068c20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f541c156e80 tx=0x7f5404009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:55.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.140+0000 7f54197fa700 1 -- 172.21.15.123:0/3178918539 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f540c050900 con 0x7f541c071580 2024-09-13T17:07:55.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.352+0000 7f5421125700 1 -- 172.21.15.123:0/3178918539 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f541c0705b0 con 0x7f541c071580 2024-09-13T17:07:55.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.352+0000 7f54197fa700 1 -- 172.21.15.123:0/3178918539 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4737 (secure 0 0 0) 0x7f540c053f20 con 0x7f541c071580 2024-09-13T17:07:55.358 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:07:55.358 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/675597916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":675597916},{"type":"v1","addr":"172.21.15.153:6835","nonce":675597916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/943744723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":943744723},{"type":"v1","addr":"172.21.15.153:6834","nonce":943744723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/625103317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":625103317},{"type":"v1","addr":"172.21.15.123:6835","nonce":625103317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:07:46.797973+0000","modified":"2024-09-13T17:07:48.808133+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2359124958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2359124958},{"type":"v1","addr":"172.21.15.123:6837","nonce":2359124958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:07:55.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.356+0000 7f5421125700 1 -- 172.21.15.123:0/3178918539 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f53fc066760 msgr2=0x7f53fc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.356+0000 7f5421125700 1 --2- 172.21.15.123:0/3178918539 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f53fc066760 0x7f53fc068c20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f541c156e80 tx=0x7f5404009240 comp rx=0 tx=0).stop 2024-09-13T17:07:55.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.356+0000 7f5421125700 1 -- 172.21.15.123:0/3178918539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f541c071580 msgr2=0x7f541c157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.356+0000 7f5421125700 1 --2- 172.21.15.123:0/3178918539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f541c071580 0x7f541c157a70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f540c00c700 tx=0x7f540c00ca10 comp rx=0 tx=0).stop 2024-09-13T17:07:55.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.356+0000 7f5421125700 1 -- 172.21.15.123:0/3178918539 shutdown_connections 2024-09-13T17:07:55.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.356+0000 7f5421125700 1 --2- 172.21.15.123:0/3178918539 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f53fc066760 0x7f53fc068c20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.356+0000 7f5421125700 1 --2- 172.21.15.123:0/3178918539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f541c15b9b0 0x7f541c150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.356+0000 7f5421125700 1 --2- 172.21.15.123:0/3178918539 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f541c15a8c0 0x7f541c14db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.356+0000 7f5421125700 1 --2- 172.21.15.123:0/3178918539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f541c071580 0x7f541c157a70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.356+0000 7f5421125700 1 -- 172.21.15.123:0/3178918539 >> 172.21.15.123:0/3178918539 conn(0x7f541c066150 msgr2=0x7f541c0cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:55.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.356+0000 7f5421125700 1 -- 172.21.15.123:0/3178918539 shutdown_connections 2024-09-13T17:07:55.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.356+0000 7f5421125700 1 -- 172.21.15.123:0/3178918539 wait complete. 2024-09-13T17:07:55.362 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 13 2024-09-13T17:07:55.775 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:07:46.797973+0000', 'modified': '2024-09-13T17:07:48.808133+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5256}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5256': {'gid': 5256, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6837/2359124958', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6836', 'nonce': 2359124958}, {'type': 'v1', 'addr': '172.21.15.123:6837', 'nonce': 2359124958}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:07:55.775 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:07:55.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T17:07:55.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8e54d9700 1 Processor -- start 2024-09-13T17:07:55.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8e54d9700 1 -- start start 2024-09-13T17:07:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8e54d9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e00ca950 0x7fc8e00c1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8e54d9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e00c93b0 con 0x7fc8e00c8cd0 2024-09-13T17:07:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8e54d9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e00cc580 con 0x7fc8e00cb090 2024-09-13T17:07:55.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8e54d9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e00cd100 con 0x7fc8e00ca950 2024-09-13T17:07:55.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8df7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc8e00c8cd0 0x7fc8e00c1280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34082/0 (socket says 172.21.15.123:34082) 2024-09-13T17:07:55.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8df7fe700 1 -- 172.21.15.123:0/969157207 learned_addr learned my addr 172.21.15.123:0/969157207 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:55.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/969157207 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e00ca950 0x7fc8e00c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8deffd700 1 -- 172.21.15.123:0/969157207 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115822597 0 0) 0x7fc8e00c93b0 con 0x7fc8e00c8cd0 2024-09-13T17:07:55.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8deffd700 1 -- 172.21.15.123:0/969157207 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c80035d0 con 0x7fc8e00c8cd0 2024-09-13T17:07:55.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8deffd700 1 -- 172.21.15.123:0/969157207 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520763793 0 0) 0x7fc8e00cc580 con 0x7fc8e00cb090 2024-09-13T17:07:55.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/969157207 >> v1:172.21.15.153:6789/0 conn(0x7fc8e00cb090 legacy=0x7fc8e00cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/969157207 >> v1:172.21.15.123:6789/0 conn(0x7fc8e00c8cd0 legacy=0x7fc8e00c1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/969157207 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e01617b0 con 0x7fc8e00ca950 2024-09-13T17:07:55.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.896+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/969157207 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e00ca950 0x7fc8e00c1990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009880 tx=0x7fc8d0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fd038abdf311a10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:55.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.900+0000 7fc8deffd700 1 -- 172.21.15.123:0/969157207 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0011830 con 0x7fc8e00ca950 2024-09-13T17:07:55.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.900+0000 7fc8deffd700 1 -- 172.21.15.123:0/969157207 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d0011990 con 0x7fc8e00ca950 2024-09-13T17:07:55.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.900+0000 7fc8deffd700 1 -- 172.21.15.123:0/969157207 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0011d20 con 0x7fc8e00ca950 2024-09-13T17:07:55.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.900+0000 7fc8e54d9700 1 -- 172.21.15.123:0/969157207 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e00ca950 msgr2=0x7fc8e00c1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.900+0000 7fc8e54d9700 1 --2- 172.21.15.123:0/969157207 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e00ca950 0x7fc8e00c1990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009880 tx=0x7fc8d0009b90 comp rx=0 tx=0).stop 2024-09-13T17:07:55.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.900+0000 7fc8e54d9700 1 -- 172.21.15.123:0/969157207 shutdown_connections 2024-09-13T17:07:55.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.900+0000 7fc8e54d9700 1 --2- 172.21.15.123:0/969157207 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e00ca950 0x7fc8e00c1990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.900+0000 7fc8e54d9700 1 -- 172.21.15.123:0/969157207 >> 172.21.15.123:0/969157207 conn(0x7fc8e00b01d0 msgr2=0x7fc8e00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.900+0000 7fc8e54d9700 1 -- 172.21.15.123:0/969157207 shutdown_connections 2024-09-13T17:07:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.900+0000 7fc8e54d9700 1 -- 172.21.15.123:0/969157207 wait complete. 2024-09-13T17:07:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.900+0000 7fc8e54d9700 1 Processor -- start 2024-09-13T17:07:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.900+0000 7fc8e54d9700 1 -- start start 2024-09-13T17:07:55.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e54d9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e00c8cd0 0x7fc8e00a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e54d9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e00ca950 0x7fc8e00c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e54d9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00cb090 0x7fc8e00c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e54d9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e00ab360 con 0x7fc8e00cb090 2024-09-13T17:07:55.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e54d9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e00c5c90 con 0x7fc8e00c8cd0 2024-09-13T17:07:55.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e54d9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e00c8b00 con 0x7fc8e00ca950 2024-09-13T17:07:55.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e4cd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00cb090 0x7fc8e00c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e4cd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00cb090 0x7fc8e00c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36692/0 (socket says 172.21.15.123:36692) 2024-09-13T17:07:55.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/684604222 learned_addr learned my addr 172.21.15.123:0/684604222 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:55.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8dffff700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e00c8cd0 0x7fc8e00a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8df7fe700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e00ca950 0x7fc8e00c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/684604222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e00ca950 msgr2=0x7fc8e00c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e00ca950 0x7fc8e00c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/684604222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e00c8cd0 msgr2=0x7fc8e00a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e00c8cd0 0x7fc8e00a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/684604222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d00094b0 con 0x7fc8e00cb090 2024-09-13T17:07:55.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8df7fe700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e00ca950 0x7fc8e00c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:07:55.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00cb090 0x7fc8e00c85c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00090b0 tx=0x7fc8d0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:55.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8dcff9700 1 -- 172.21.15.123:0/684604222 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0019a80 con 0x7fc8e00cb090 2024-09-13T17:07:55.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8dcff9700 1 -- 172.21.15.123:0/684604222 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d001e070 con 0x7fc8e00cb090 2024-09-13T17:07:55.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e54d9700 1 -- 172.21.15.123:0/684604222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e00a8ad0 con 0x7fc8e00cb090 2024-09-13T17:07:55.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8dcff9700 1 -- 172.21.15.123:0/684604222 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0019e40 con 0x7fc8e00cb090 2024-09-13T17:07:55.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.904+0000 7fc8e54d9700 1 -- 172.21.15.123:0/684604222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e00ab850 con 0x7fc8e00cb090 2024-09-13T17:07:55.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8dcff9700 1 -- 172.21.15.123:0/684604222 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc8d0024400 con 0x7fc8e00cb090 2024-09-13T17:07:55.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8dcff9700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc8cc066730 0x7fc8cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8dcff9700 1 -- 172.21.15.123:0/684604222 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8d0085100 con 0x7fc8e00cb090 2024-09-13T17:07:55.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e99ee740 1 Processor -- start 2024-09-13T17:07:55.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8dffff700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc8cc066730 0x7fc8cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e99ee740 1 -- start start 2024-09-13T17:07:55.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8dffff700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc8cc066730 0x7fc8cc068bf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80012e0 tx=0x7fc8d8009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:55.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e99ee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2230 0x1ba2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e99ee740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1b80e90 0x1b6a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e99ee740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b6add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e99ee740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ac9d80 con 0x1ba2b50 2024-09-13T17:07:55.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e99ee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ac7510 con 0x1ba2230 2024-09-13T17:07:55.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e99ee740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ac2e00 con 0x1b80e90 2024-09-13T17:07:55.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e4cd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b6add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e4cd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b6add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36708/0 (socket says 172.21.15.123:36708) 2024-09-13T17:07:55.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8dffff700 1 --2- 172.21.15.123:0/160371201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2230 0x1ba2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/160371201 learned_addr learned my addr 172.21.15.123:0/160371201 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:55.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8df7fe700 1 --2- 172.21.15.123:0/160371201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1b80e90 0x1b6a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/160371201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1b80e90 msgr2=0x1b6a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:55.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/160371201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1b80e90 0x1b6a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/160371201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2230 msgr2=0x1ba2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:55.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/160371201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2230 0x1ba2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/160371201 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1935960 con 0x1ba2b50 2024-09-13T17:07:55.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/160371201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b6add0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00836e0 tx=0x7fc8d0055dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137c85335a283107 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:55.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8c5ffb700 1 -- 172.21.15.123:0/160371201 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d00561c0 con 0x1ba2b50 2024-09-13T17:07:55.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8c5ffb700 1 -- 172.21.15.123:0/160371201 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d0059ff0 con 0x1ba2b50 2024-09-13T17:07:55.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.908+0000 7fc8c5ffb700 1 -- 172.21.15.123:0/160371201 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d005e5b0 con 0x1ba2b50 2024-09-13T17:07:55.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 -- 172.21.15.123:0/160371201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 msgr2=0x1b6add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/160371201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b6add0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00836e0 tx=0x7fc8d0055dd0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 -- 172.21.15.123:0/160371201 shutdown_connections 2024-09-13T17:07:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/160371201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b6add0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/160371201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1b80e90 0x1b6a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/160371201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2230 0x1ba2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 -- 172.21.15.123:0/160371201 >> 172.21.15.123:0/160371201 conn(0x18ea4d0 msgr2=0x1b83e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 -- 172.21.15.123:0/160371201 shutdown_connections 2024-09-13T17:07:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 -- 172.21.15.123:0/160371201 wait complete. 2024-09-13T17:07:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 -- start start 2024-09-13T17:07:55.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 Processor -- start 2024-09-13T17:07:55.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1b80e90 0x1ba1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ba2230 0x1b5c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b803c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a80730 con 0x1ba2b50 2024-09-13T17:07:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a865b0 con 0x1b80e90 2024-09-13T17:07:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x196eaa0 con 0x1ba2230 2024-09-13T17:07:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e99ee740 10 client.0 _ll_register_callbacks cb 0x1abc610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:07:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e4cd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b803c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e4cd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b803c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36710/0 (socket says 172.21.15.123:36710) 2024-09-13T17:07:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/114687496 learned_addr learned my addr 172.21.15.123:0/114687496 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8dffff700 1 --2- 172.21.15.123:0/114687496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1b80e90 0x1ba1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.912+0000 7fc8df7fe700 1 --2- 172.21.15.123:0/114687496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ba2230 0x1b5c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/114687496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ba2230 msgr2=0x1b5c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/114687496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ba2230 0x1b5c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/114687496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1b80e90 msgr2=0x1ba1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/114687496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1b80e90 0x1ba1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/114687496 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e00ab850 con 0x1ba2b50 2024-09-13T17:07:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/114687496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b803c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00526c0 tx=0x7fc8d0009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1632a0e752f951d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8beffd700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-13T17:07:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8beffd700 1 -- 172.21.15.123:0/114687496 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d00561c0 con 0x1ba2b50 2024-09-13T17:07:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8beffd700 1 -- 172.21.15.123:0/114687496 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8d005e5b0 con 0x1ba2b50 2024-09-13T17:07:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 -- 172.21.15.123:0/114687496 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x18f71e0 con 0x1ba2b50 2024-09-13T17:07:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8beffd700 1 -- 172.21.15.123:0/114687496 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8d00832b0 con 0x1ba2b50 2024-09-13T17:07:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 10 client.5463 fetch_fsmap learned FSMap version 13 2024-09-13T17:07:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 -- 172.21.15.123:0/114687496 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x1a89220 con 0x1ba2b50 2024-09-13T17:07:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8beffd700 1 -- 172.21.15.123:0/114687496 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x18f71e0 con 0x1ba2b50 2024-09-13T17:07:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8beffd700 1 -- 172.21.15.123:0/114687496 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 13) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc8d005c0c0 con 0x1ba2b50 2024-09-13T17:07:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 10 client.5463 fetch_fsmap finished waiting for FSMap version 13 2024-09-13T17:07:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 10 client.5463 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:07:55.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 20 client.5463 populate_metadata read hostname 'smithi123' 2024-09-13T17:07:55.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/114687496 >> [v2:172.21.15.123:6836/2359124958,v1:172.21.15.123:6837/2359124958] conn(0x1b5abf0 0x1b5afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 4 client.5463 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:07:55.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 -- 172.21.15.123:0/114687496 --> [v2:172.21.15.123:6836/2359124958,v1:172.21.15.123:6837/2359124958] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1941460 con 0x1b5abf0 2024-09-13T17:07:55.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8dffff700 1 --2- 172.21.15.123:0/114687496 >> [v2:172.21.15.123:6836/2359124958,v1:172.21.15.123:6837/2359124958] conn(0x1b5abf0 0x1b5afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8beffd700 10 client.5463 ms_handle_connect on v2:172.21.15.123:6836/2359124958 2024-09-13T17:07:55.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8dffff700 1 --2- 172.21.15.123:0/114687496 >> [v2:172.21.15.123:6836/2359124958,v1:172.21.15.123:6837/2359124958] conn(0x1b5abf0 0x1b5afd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a68b9e5e16689932 server_cookie=550aa53d87a39a1b in_seq=0 out_seq=0 2024-09-13T17:07:55.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8beffd700 1 -- 172.21.15.123:0/114687496 <== mds.0 v2:172.21.15.123:6836/2359124958 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1941460 con 0x1b5abf0 2024-09-13T17:07:55.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8beffd700 10 client.5463 handle_command_reply: tid=0 2024-09-13T17:07:55.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 client.5463 shutdown 2024-09-13T17:07:55.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 -- 172.21.15.123:0/114687496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 msgr2=0x1b803c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/114687496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b803c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00526c0 tx=0x7fc8d0009ee0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 -- 172.21.15.123:0/114687496 shutdown_connections 2024-09-13T17:07:55.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/114687496 >> [v2:172.21.15.123:6836/2359124958,v1:172.21.15.123:6837/2359124958] conn(0x1b5abf0 0x1b5afd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/114687496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b803c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/114687496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ba2230 0x1b5c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/114687496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1b80e90 0x1ba1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 -- 172.21.15.123:0/114687496 >> 172.21.15.123:0/114687496 conn(0x18ea4d0 msgr2=0x1b56700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:55.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8beffd700 0 client.5463 ms_handle_reset on v2:172.21.15.123:6836/2359124958 2024-09-13T17:07:55.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 -- 172.21.15.123:0/114687496 shutdown_connections 2024-09-13T17:07:55.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 1 -- 172.21.15.123:0/114687496 wait complete. 2024-09-13T17:07:55.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.916+0000 7fc8e99ee740 20 client.5463 trim_cache size 0 max 16384 2024-09-13T17:07:55.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 Processor -- start 2024-09-13T17:07:55.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 -- start start 2024-09-13T17:07:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1b80e90 0x1ba1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2230 0x1b58710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b58c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b5cc60 con 0x1ba2b50 2024-09-13T17:07:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1af1ec0 con 0x1ba2230 2024-09-13T17:07:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a865b0 con 0x1b80e90 2024-09-13T17:07:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e4cd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b58c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e4cd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b58c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36720/0 (socket says 172.21.15.123:36720) 2024-09-13T17:07:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/3467615019 learned_addr learned my addr 172.21.15.123:0/3467615019 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8df7fe700 1 --2- 172.21.15.123:0/3467615019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2230 0x1b58710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8dffff700 1 --2- 172.21.15.123:0/3467615019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1b80e90 0x1ba1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/3467615019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1b80e90 msgr2=0x1ba1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:55.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/3467615019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1b80e90 0x1ba1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/3467615019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2230 msgr2=0x1b58710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:55.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/3467615019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2230 0x1b58710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e4cd8700 1 -- 172.21.15.123:0/3467615019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a6f450 con 0x1ba2b50 2024-09-13T17:07:55.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/3467615019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b58c50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00097d0 tx=0x7fc8d0059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dedf88bc4f997117 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8c67fc700 1 -- 172.21.15.123:0/3467615019 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0055b20 con 0x1ba2b50 2024-09-13T17:07:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8c67fc700 1 -- 172.21.15.123:0/3467615019 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d005e5b0 con 0x1ba2b50 2024-09-13T17:07:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8c67fc700 1 -- 172.21.15.123:0/3467615019 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d00561c0 con 0x1ba2b50 2024-09-13T17:07:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 -- 172.21.15.123:0/3467615019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 msgr2=0x1b58c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/3467615019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b58c50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00097d0 tx=0x7fc8d0059000 comp rx=0 tx=0).stop 2024-09-13T17:07:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 -- 172.21.15.123:0/3467615019 shutdown_connections 2024-09-13T17:07:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/3467615019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1ba2b50 0x1b58c50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/3467615019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2230 0x1b58710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/3467615019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1b80e90 0x1ba1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 -- 172.21.15.123:0/3467615019 >> 172.21.15.123:0/3467615019 conn(0x18ea4d0 msgr2=0x1b5b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 -- 172.21.15.123:0/3467615019 shutdown_connections 2024-09-13T17:07:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.940+0000 7fc8e99ee740 1 -- 172.21.15.123:0/3467615019 wait complete. 2024-09-13T17:07:55.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8e99ee740 1 -- start start 2024-09-13T17:07:55.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8e99ee740 1 Processor -- start 2024-09-13T17:07:55.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8e99ee740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1b80e90 0x1ba7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8e99ee740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ba2230 0x1c022b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8e99ee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2b50 0x1b5bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8e99ee740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bbf350 con 0x1b80e90 2024-09-13T17:07:55.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8e99ee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ba72e0 con 0x1ba2b50 2024-09-13T17:07:55.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8e99ee740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b52320 con 0x1ba2230 2024-09-13T17:07:55.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8dffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1b80e90 0x1ba7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8e99ee740 10 client.0 _ll_register_callbacks cb 0x1a74ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:07:55.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8dffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1b80e90 0x1ba7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36726/0 (socket says 172.21.15.123:36726) 2024-09-13T17:07:55.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8dffff700 1 -- 172.21.15.123:0/2903840331 learned_addr learned my addr 172.21.15.123:0/2903840331 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:55.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8df7fe700 1 --2- 172.21.15.123:0/2903840331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ba2230 0x1c022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8e4cd8700 1 --2- 172.21.15.123:0/2903840331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2b50 0x1b5bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8dffff700 1 -- 172.21.15.123:0/2903840331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ba2230 msgr2=0x1c022b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:55.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.944+0000 7fc8dffff700 1 --2- 172.21.15.123:0/2903840331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ba2230 0x1c022b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8dffff700 1 -- 172.21.15.123:0/2903840331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2b50 msgr2=0x1b5bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:55.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8dffff700 1 --2- 172.21.15.123:0/2903840331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2b50 0x1b5bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8dffff700 1 -- 172.21.15.123:0/2903840331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1a89220 con 0x1b80e90 2024-09-13T17:07:55.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8dffff700 1 --2- 172.21.15.123:0/2903840331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1b80e90 0x1ba7b70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80017d0 tx=0x7fc8d8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b6a66873f4f133 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:55.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8beffd700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-13T17:07:55.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8beffd700 1 -- 172.21.15.123:0/2903840331 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8001ee0 con 0x1b80e90 2024-09-13T17:07:55.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8beffd700 1 -- 172.21.15.123:0/2903840331 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8d8003d70 con 0x1b80e90 2024-09-13T17:07:55.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 -- 172.21.15.123:0/2903840331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc8d0059ff0 con 0x1b80e90 2024-09-13T17:07:55.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8beffd700 1 -- 172.21.15.123:0/2903840331 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8d8005690 con 0x1b80e90 2024-09-13T17:07:55.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 10 client.5469 fetch_fsmap learned FSMap version 13 2024-09-13T17:07:55.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 -- 172.21.15.123:0/2903840331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x1a63720 con 0x1b80e90 2024-09-13T17:07:55.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8beffd700 1 -- 172.21.15.123:0/2903840331 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d0059ff0 con 0x1b80e90 2024-09-13T17:07:55.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8beffd700 1 -- 172.21.15.123:0/2903840331 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 13) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc8d802d060 con 0x1b80e90 2024-09-13T17:07:55.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 10 client.5469 fetch_fsmap finished waiting for FSMap version 13 2024-09-13T17:07:55.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 10 client.5469 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:07:55.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 20 client.5469 populate_metadata read hostname 'smithi123' 2024-09-13T17:07:55.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/2903840331 >> [v2:172.21.15.123:6836/2359124958,v1:172.21.15.123:6837/2359124958] conn(0x1c03600 0x1c039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:55.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 4 client.5469 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:07:55.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 -- 172.21.15.123:0/2903840331 --> [v2:172.21.15.123:6836/2359124958,v1:172.21.15.123:6837/2359124958] -- command(tid 0: {"prefix": "status"}) v1 -- 0x19661e0 con 0x1c03600 2024-09-13T17:07:55.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8df7fe700 1 --2- 172.21.15.123:0/2903840331 >> [v2:172.21.15.123:6836/2359124958,v1:172.21.15.123:6837/2359124958] conn(0x1c03600 0x1c039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:55.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8beffd700 10 client.5469 ms_handle_connect on v2:172.21.15.123:6836/2359124958 2024-09-13T17:07:55.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8df7fe700 1 --2- 172.21.15.123:0/2903840331 >> [v2:172.21.15.123:6836/2359124958,v1:172.21.15.123:6837/2359124958] conn(0x1c03600 0x1c039e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ebd6dafd1e3260f server_cookie=adb340cceffc619f in_seq=0 out_seq=0 2024-09-13T17:07:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8beffd700 1 -- 172.21.15.123:0/2903840331 <== mds.0 v2:172.21.15.123:6836/2359124958 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x19661e0 con 0x1c03600 2024-09-13T17:07:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8beffd700 10 client.5469 handle_command_reply: tid=0 2024-09-13T17:07:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 client.5469 shutdown 2024-09-13T17:07:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 -- 172.21.15.123:0/2903840331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1b80e90 msgr2=0x1ba7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/2903840331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1b80e90 0x1ba7b70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80017d0 tx=0x7fc8d8011000 comp rx=0 tx=0).stop 2024-09-13T17:07:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 -- 172.21.15.123:0/2903840331 shutdown_connections 2024-09-13T17:07:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/2903840331 >> [v2:172.21.15.123:6836/2359124958,v1:172.21.15.123:6837/2359124958] conn(0x1c03600 0x1c039e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/2903840331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ba2b50 0x1b5bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/2903840331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1ba2230 0x1c022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 --2- 172.21.15.123:0/2903840331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1b80e90 0x1ba7b70 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8beffd700 0 client.5469 ms_handle_reset on v2:172.21.15.123:6836/2359124958 2024-09-13T17:07:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 -- 172.21.15.123:0/2903840331 >> 172.21.15.123:0/2903840331 conn(0x18ea4d0 msgr2=0x1ba1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 -- 172.21.15.123:0/2903840331 shutdown_connections 2024-09-13T17:07:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.948+0000 7fc8e99ee740 1 -- 172.21.15.123:0/2903840331 wait complete. 2024-09-13T17:07:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.952+0000 7fc8e99ee740 20 client.5469 trim_cache size 0 max 16384 2024-09-13T17:07:55.956 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:07:55.956 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "c45759e3-62b7-46ff-ad19-917097e4c126", 2024-09-13T17:07:55.957 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-13T17:07:55.957 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 5256, 2024-09-13T17:07:55.957 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-13T17:07:55.957 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-13T17:07:55.957 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-13T17:07:55.957 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 9.1513768039999999, 2024-09-13T17:07:55.957 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 13, 2024-09-13T17:07:55.957 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 34, 2024-09-13T17:07:55.957 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 34, 2024-09-13T17:07:55.957 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 16.427159082999999 2024-09-13T17:07:55.957 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:07:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.952+0000 7fc8e54d9700 1 -- 172.21.15.123:0/684604222 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc8cc066730 msgr2=0x7fc8cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.952+0000 7fc8e54d9700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc8cc066730 0x7fc8cc068bf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80012e0 tx=0x7fc8d8009040 comp rx=0 tx=0).stop 2024-09-13T17:07:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.952+0000 7fc8e54d9700 1 -- 172.21.15.123:0/684604222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00cb090 msgr2=0x7fc8e00c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.952+0000 7fc8e54d9700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00cb090 0x7fc8e00c85c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00090b0 tx=0x7fc8d0004770 comp rx=0 tx=0).stop 2024-09-13T17:07:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.952+0000 7fc8e54d9700 1 -- 172.21.15.123:0/684604222 shutdown_connections 2024-09-13T17:07:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.952+0000 7fc8e54d9700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc8cc066730 0x7fc8cc068bf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.952+0000 7fc8e54d9700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00cb090 0x7fc8e00c85c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.952+0000 7fc8e54d9700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e00ca950 0x7fc8e00c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.952+0000 7fc8e54d9700 1 --2- 172.21.15.123:0/684604222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e00c8cd0 0x7fc8e00a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.952+0000 7fc8e54d9700 1 -- 172.21.15.123:0/684604222 >> 172.21.15.123:0/684604222 conn(0x7fc8e00b01d0 msgr2=0x7fc8e0071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.952+0000 7fc8e54d9700 1 -- 172.21.15.123:0/684604222 shutdown_connections 2024-09-13T17:07:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:55.952+0000 7fc8e54d9700 1 -- 172.21.15.123:0/684604222 wait complete. 2024-09-13T17:07:55.971 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:07:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.080+0000 7f82ddb5c700 1 Processor -- start 2024-09-13T17:07:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.080+0000 7f82ddb5c700 1 -- start start 2024-09-13T17:07:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82ddb5c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f82d815ed00 0x7f82d8161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82ddb5c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d8162550 con 0x7f82d8161a80 2024-09-13T17:07:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82ddb5c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d80cd690 con 0x7f82d815e920 2024-09-13T17:07:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82ddb5c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d8161f90 con 0x7f82d815ed00 2024-09-13T17:07:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82dd35b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f82d8161a80 0x7f82d80cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34088/0 (socket says 172.21.15.123:34088) 2024-09-13T17:07:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82dd35b700 1 -- 172.21.15.123:0/1536100904 learned_addr learned my addr 172.21.15.123:0/1536100904 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82d7fff700 1 --2- 172.21.15.123:0/1536100904 >> v2:172.21.15.153:3300/0 conn(0x7f82d815ed00 0x7f82d8161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:56.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82d77fe700 1 -- 172.21.15.123:0/1536100904 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757892485 0 0) 0x7f82d8162550 con 0x7f82d8161a80 2024-09-13T17:07:56.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82d77fe700 1 -- 172.21.15.123:0/1536100904 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82c00035d0 con 0x7f82d8161a80 2024-09-13T17:07:56.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82d7fff700 1 -- 172.21.15.123:0/1536100904 >> v1:172.21.15.153:6789/0 conn(0x7f82d815e920 legacy=0x7f82d80caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:56.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82d7fff700 1 -- 172.21.15.123:0/1536100904 >> v1:172.21.15.123:6789/0 conn(0x7f82d8161a80 legacy=0x7f82d80cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:56.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82d7fff700 1 -- 172.21.15.123:0/1536100904 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d8162270 con 0x7f82d815ed00 2024-09-13T17:07:56.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82d7fff700 1 --2- 172.21.15.123:0/1536100904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d815ed00 0x7f82d8161540 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009850 tx=0x7f82c8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89ec9cf3f2b8938d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:56.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82d77fe700 1 -- 172.21.15.123:0/1536100904 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8011830 con 0x7f82d815ed00 2024-09-13T17:07:56.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82d77fe700 1 -- 172.21.15.123:0/1536100904 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c8011990 con 0x7f82d815ed00 2024-09-13T17:07:56.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82d77fe700 1 -- 172.21.15.123:0/1536100904 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8011d40 con 0x7f82d815ed00 2024-09-13T17:07:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82ddb5c700 1 -- 172.21.15.123:0/1536100904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d815ed00 msgr2=0x7f82d8161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82ddb5c700 1 --2- 172.21.15.123:0/1536100904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d815ed00 0x7f82d8161540 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009850 tx=0x7f82c8009b60 comp rx=0 tx=0).stop 2024-09-13T17:07:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82ddb5c700 1 -- 172.21.15.123:0/1536100904 shutdown_connections 2024-09-13T17:07:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82ddb5c700 1 --2- 172.21.15.123:0/1536100904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d815ed00 0x7f82d8161540 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82ddb5c700 1 -- 172.21.15.123:0/1536100904 >> 172.21.15.123:0/1536100904 conn(0x7f82d8066150 msgr2=0x7f82d8066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82ddb5c700 1 -- 172.21.15.123:0/1536100904 shutdown_connections 2024-09-13T17:07:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.084+0000 7f82ddb5c700 1 -- 172.21.15.123:0/1536100904 wait complete. 2024-09-13T17:07:56.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82ddb5c700 1 Processor -- start 2024-09-13T17:07:56.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82ddb5c700 1 -- start start 2024-09-13T17:07:56.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82ddb5c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d815e920 0x7f82d814ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:56.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82ddb5c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d815ed00 0x7f82d815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:56.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82ddb5c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d8161a80 0x7f82d815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82ddb5c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d80c3540 con 0x7f82d815e920 2024-09-13T17:07:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82ddb5c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d8159e70 con 0x7f82d815ed00 2024-09-13T17:07:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82ddb5c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d815a150 con 0x7f82d8161a80 2024-09-13T17:07:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82dcb5a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d815e920 0x7f82d814ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82dcb5a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d815e920 0x7f82d814ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36734/0 (socket says 172.21.15.123:36734) 2024-09-13T17:07:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82dcb5a700 1 -- 172.21.15.123:0/4251569157 learned_addr learned my addr 172.21.15.123:0/4251569157 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82d7fff700 1 --2- 172.21.15.123:0/4251569157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d815ed00 0x7f82d815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82dd35b700 1 --2- 172.21.15.123:0/4251569157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d8161a80 0x7f82d815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82dcb5a700 1 -- 172.21.15.123:0/4251569157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d8161a80 msgr2=0x7f82d815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82dcb5a700 1 --2- 172.21.15.123:0/4251569157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d8161a80 0x7f82d815d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82dcb5a700 1 -- 172.21.15.123:0/4251569157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d815ed00 msgr2=0x7f82d815cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82dcb5a700 1 --2- 172.21.15.123:0/4251569157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d815ed00 0x7f82d815cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82dcb5a700 1 -- 172.21.15.123:0/4251569157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c80094b0 con 0x7f82d815e920 2024-09-13T17:07:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82dcb5a700 1 --2- 172.21.15.123:0/4251569157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d815e920 0x7f82d814ab30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00c500 tx=0x7f82cc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82d57fa700 1 -- 172.21.15.123:0/4251569157 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0052d0 con 0x7f82d815e920 2024-09-13T17:07:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82d57fa700 1 -- 172.21.15.123:0/4251569157 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc005430 con 0x7f82d815e920 2024-09-13T17:07:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82ddb5c700 1 -- 172.21.15.123:0/4251569157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d815a430 con 0x7f82d815e920 2024-09-13T17:07:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82d57fa700 1 -- 172.21.15.123:0/4251569157 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0055a0 con 0x7f82d815e920 2024-09-13T17:07:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.088+0000 7f82ddb5c700 1 -- 172.21.15.123:0/4251569157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d814b070 con 0x7f82d815e920 2024-09-13T17:07:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.092+0000 7f82ddb5c700 1 -- 172.21.15.123:0/4251569157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d80677f0 con 0x7f82d815e920 2024-09-13T17:07:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.092+0000 7f82d57fa700 1 -- 172.21.15.123:0/4251569157 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f82cc0038e0 con 0x7f82d815e920 2024-09-13T17:07:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.092+0000 7f82d57fa700 1 --2- 172.21.15.123:0/4251569157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82c4066730 0x7f82c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.092+0000 7f82d57fa700 1 -- 172.21.15.123:0/4251569157 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82cc083510 con 0x7f82d815e920 2024-09-13T17:07:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.092+0000 7f82d7fff700 1 --2- 172.21.15.123:0/4251569157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82c4066730 0x7f82c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:56.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.096+0000 7f82d7fff700 1 --2- 172.21.15.123:0/4251569157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82c4066730 0x7f82c4068bf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f82c80090b0 tx=0x7f82c8008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:56.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.104+0000 7f82d57fa700 1 -- 172.21.15.123:0/4251569157 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82cc050870 con 0x7f82d815e920 2024-09-13T17:07:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.312+0000 7f82ddb5c700 1 -- 172.21.15.123:0/4251569157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f82d8161540 con 0x7f82d815e920 2024-09-13T17:07:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.312+0000 7f82d57fa700 1 -- 172.21.15.123:0/4251569157 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f82cc053e90 con 0x7f82d815e920 2024-09-13T17:07:56.316 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:07:56.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.316+0000 7f82ddb5c700 1 -- 172.21.15.123:0/4251569157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82c4066730 msgr2=0x7f82c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:56.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.316+0000 7f82ddb5c700 1 --2- 172.21.15.123:0/4251569157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82c4066730 0x7f82c4068bf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f82c80090b0 tx=0x7f82c8008030 comp rx=0 tx=0).stop 2024-09-13T17:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.316+0000 7f82ddb5c700 1 -- 172.21.15.123:0/4251569157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d815e920 msgr2=0x7f82d814ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.316+0000 7f82ddb5c700 1 --2- 172.21.15.123:0/4251569157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d815e920 0x7f82d814ab30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00c500 tx=0x7f82cc00c810 comp rx=0 tx=0).stop 2024-09-13T17:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.316+0000 7f82ddb5c700 1 -- 172.21.15.123:0/4251569157 shutdown_connections 2024-09-13T17:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.316+0000 7f82ddb5c700 1 --2- 172.21.15.123:0/4251569157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82c4066730 0x7f82c4068bf0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.316+0000 7f82ddb5c700 1 --2- 172.21.15.123:0/4251569157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82d8161a80 0x7f82d815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.316+0000 7f82ddb5c700 1 --2- 172.21.15.123:0/4251569157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82d815ed00 0x7f82d815cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.316+0000 7f82ddb5c700 1 --2- 172.21.15.123:0/4251569157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d815e920 0x7f82d814ab30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.316+0000 7f82ddb5c700 1 -- 172.21.15.123:0/4251569157 >> 172.21.15.123:0/4251569157 conn(0x7f82d8066150 msgr2=0x7f82d8072150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.316+0000 7f82ddb5c700 1 -- 172.21.15.123:0/4251569157 shutdown_connections 2024-09-13T17:07:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:56.316+0000 7f82ddb5c700 1 -- 172.21.15.123:0/4251569157 wait complete. 2024-09-13T17:07:56.330 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:07:56.330 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:07:56.330 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-13T17:07:56.330 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:07:56.330 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:07:56.331 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:07:56.331 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:07:56.331 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:07:56.331 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:07:56.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:56.331 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-13T17:07:56.339 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:07:56.339 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:07:56.339 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:07:56.339 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:56.339 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-13T17:07:56.339 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:56.340 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:56.340 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:56.340 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:56.340 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:56.340 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:56.340 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:56.340 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:07:56.340 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:56.340 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:07:56.340 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42531sec preferred_lft 42531sec 2024-09-13T17:07:56.340 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-09-13T17:07:56.340 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:56.340 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:07:56.341 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:b1:d7:75:e9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:56.341 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:07:56.341 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:56.341 INFO:teuthology.orchestra.run.smithi123.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:07:56.341 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether d6:8a:3c:97:49:a9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:56.341 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:07:56.341 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:56.341 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::a038:65ff:fec0:5513/64 scope link 2024-09-13T17:07:56.341 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:56.341 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:07:56.341 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether da:a9:95:cd:41:8c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:07:56.341 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::d8a9:95ff:fecd:418c/64 scope link 2024-09-13T17:07:56.341 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:56.342 INFO:teuthology.orchestra.run.smithi123.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:07:56.342 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether d6:8a:3c:97:49:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:07:56.342 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::d48a:3cff:fe97:49a9/64 scope link 2024-09-13T17:07:56.342 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:56.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:56.342 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:07:56.396 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-13T17:07:56.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:56.398 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-13T17:07:56.407 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-13T17:07:56.407 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:07:56.407 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:07:56.407 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:07:56.407 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:07:56.407 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:07:56.407 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:07:56.408 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:07:56.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:56.408 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:07:56.408 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:07:56.408 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:07:56.408 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:07:56.408 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:07:56.408 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:07:56.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:56.444 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-13T17:07:56.451 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:07:56.451 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:07:56.451 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:07:56.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:56.451 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-13T17:07:56.466 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:07:56.466 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:07:56.466 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:07:56.517 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:07:56.517 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:07:56.517 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:07:56.524 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:07:56.539 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:56.539 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:56.553 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:56.553 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:56.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:56.554 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:07:56.604 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:07:56.604 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:07:56.607 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:07:56.625 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:56.625 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:56.681 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:56.682 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:56.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:56.683 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:07:56.700 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:2024-09-13T17:07:56.696+0000 7f2233aae640 -1 init, newargv = 0x556ced8986a0 newargc=15 2024-09-13T17:07:56.700 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[37558]: starting ceph client 2024-09-13T17:07:56.707 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[37558]: starting fuse 2024-09-13T17:07:57.790 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:07:57.807 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:57.807 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:57.864 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:57.865 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:57.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:57.865 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:07:57.872 INFO:teuthology.orchestra.run.smithi123.stdout:52 2024-09-13T17:07:57.872 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:07:57.873 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:07:57.873 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2024-09-13T17:07:57.873 DEBUG:teuthology.orchestra.run.smithi123:> import re 2024-09-13T17:07:57.873 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-13T17:07:57.873 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2024-09-13T17:07:57.873 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:07:57.873 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2024-09-13T17:07:57.873 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:07:57.873 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2024-09-13T17:07:57.873 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:07:57.873 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:07:57.873 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2024-09-13T17:07:57.874 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2024-09-13T17:07:57.874 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2024-09-13T17:07:57.874 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2024-09-13T17:07:57.874 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:07:57.874 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2024-09-13T17:07:57.874 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:07:57.874 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:07:57.874 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:07:57.874 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2024-09-13T17:07:57.874 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2024-09-13T17:07:57.874 DEBUG:teuthology.orchestra.run.smithi123:> return f 2024-09-13T17:07:57.875 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:07:57.875 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:07:57.875 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.0")) 2024-09-13T17:07:57.875 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-13T17:07:57.957 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.0.37558.asok 2024-09-13T17:07:58.141 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37558.asok 2024-09-13T17:07:58.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:58.142 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37558.asok status 2024-09-13T17:07:58.287 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:07:58.287 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2024-09-13T17:07:58.287 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:07:58.287 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:07:58.287 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "0", 2024-09-13T17:07:58.287 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2024-09-13T17:07:58.287 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:07:58.287 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "37558", 2024-09-13T17:07:58.287 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2024-09-13T17:07:58.288 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:58.288 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2024-09-13T17:07:58.288 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2024-09-13T17:07:58.288 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 5484, 2024-09-13T17:07:58.288 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2024-09-13T17:07:58.288 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2024-09-13T17:07:58.288 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2024-09-13T17:07:58.288 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5484 2024-09-13T17:07:58.288 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:58.288 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:07:58.288 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:07:58.288 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:07:58.289 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1063196657 2024-09-13T17:07:58.289 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:07:58.289 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:58.289 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:07:58.289 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:07:58.289 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:07:58.289 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1063196657 2024-09-13T17:07:58.289 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:07:58.289 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.5484 192.168.0.1:0/1063196657", 2024-09-13T17:07:58.289 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.1:0/1063196657", 2024-09-13T17:07:58.289 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2024-09-13T17:07:58.289 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 13, 2024-09-13T17:07:58.289 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 34, 2024-09-13T17:07:58.290 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:07:58.290 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2024-09-13T17:07:58.290 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2024-09-13T17:07:58.290 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:07:58.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:58.296 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2024-09-13T17:07:58.297 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:07:58.305 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2024-09-13T17:07:58.305 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:07:58.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:58.305 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:07:58.317 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:07:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.472+0000 7fc4c9182700 1 Processor -- start 2024-09-13T17:07:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.472+0000 7fc4c9182700 1 -- start start 2024-09-13T17:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c9182700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4c413e200 0x7fc4c406ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c9182700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc4c4159d80 0x7fc4c4156060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c9182700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c406d3e0 con 0x7fc4c406cfa0 2024-09-13T17:07:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c9182700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c413e5e0 con 0x7fc4c4159d80 2024-09-13T17:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c9182700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c415a3a0 con 0x7fc4c413e200 2024-09-13T17:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c37fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc4c406cfa0 0x7fc4c4159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34096/0 (socket says 172.21.15.123:34096) 2024-09-13T17:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c37fe700 1 -- 172.21.15.123:0/2569661513 learned_addr learned my addr 172.21.15.123:0/2569661513 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c8981700 1 --2- 172.21.15.123:0/2569661513 >> v2:172.21.15.123:3300/0 conn(0x7fc4c4159d80 0x7fc4c4156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c3fff700 1 --2- 172.21.15.123:0/2569661513 >> v2:172.21.15.153:3300/0 conn(0x7fc4c413e200 0x7fc4c406ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c2ffd700 1 -- 172.21.15.123:0/2569661513 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820827951 0 0) 0x7fc4c406d3e0 con 0x7fc4c406cfa0 2024-09-13T17:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c2ffd700 1 -- 172.21.15.123:0/2569661513 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4ac0035d0 con 0x7fc4c406cfa0 2024-09-13T17:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c8981700 1 -- 172.21.15.123:0/2569661513 >> v2:172.21.15.153:3300/0 conn(0x7fc4c413e200 msgr2=0x7fc4c406ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c8981700 1 --2- 172.21.15.123:0/2569661513 >> v2:172.21.15.153:3300/0 conn(0x7fc4c413e200 0x7fc4c406ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c8981700 1 -- 172.21.15.123:0/2569661513 >> v1:172.21.15.123:6789/0 conn(0x7fc4c406cfa0 legacy=0x7fc4c4159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c8981700 1 -- 172.21.15.123:0/2569661513 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c413e7d0 con 0x7fc4c4159d80 2024-09-13T17:07:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c8981700 1 --2- 172.21.15.123:0/2569661513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c4159d80 0x7fc4c4156060 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4072070 tx=0x7fc4bc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12cd996aa4f02d39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:58.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c2ffd700 1 -- 172.21.15.123:0/2569661513 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00f070 con 0x7fc4c4159d80 2024-09-13T17:07:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c2ffd700 1 -- 172.21.15.123:0/2569661513 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc00a2e0 con 0x7fc4c4159d80 2024-09-13T17:07:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c2ffd700 1 -- 172.21.15.123:0/2569661513 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00cb50 con 0x7fc4c4159d80 2024-09-13T17:07:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c9182700 1 -- 172.21.15.123:0/2569661513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c4159d80 msgr2=0x7fc4c4156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c9182700 1 --2- 172.21.15.123:0/2569661513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c4159d80 0x7fc4c4156060 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4072070 tx=0x7fc4bc00c330 comp rx=0 tx=0).stop 2024-09-13T17:07:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c9182700 1 -- 172.21.15.123:0/2569661513 shutdown_connections 2024-09-13T17:07:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c9182700 1 --2- 172.21.15.123:0/2569661513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c4159d80 0x7fc4c4156060 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c9182700 1 --2- 172.21.15.123:0/2569661513 >> v2:172.21.15.153:3300/0 conn(0x7fc4c413e200 0x7fc4c406ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.476+0000 7fc4c9182700 1 -- 172.21.15.123:0/2569661513 >> 172.21.15.123:0/2569661513 conn(0x7fc4c40b4630 msgr2=0x7fc4c40b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c9182700 1 -- 172.21.15.123:0/2569661513 shutdown_connections 2024-09-13T17:07:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c9182700 1 -- 172.21.15.123:0/2569661513 wait complete. 2024-09-13T17:07:58.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c9182700 1 Processor -- start 2024-09-13T17:07:58.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c9182700 1 -- start start 2024-09-13T17:07:58.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c9182700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c406cfa0 0x7fc4c41422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:58.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c9182700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4c413e200 0x7fc4c415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:58.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c9182700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c4159d80 0x7fc4c415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:58.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c9182700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40a9250 con 0x7fc4c406cfa0 2024-09-13T17:07:58.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c9182700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40a85d0 con 0x7fc4c4159d80 2024-09-13T17:07:58.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c9182700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40a88b0 con 0x7fc4c413e200 2024-09-13T17:07:58.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c406cfa0 0x7fc4c41422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:58.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c406cfa0 0x7fc4c41422a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36744/0 (socket says 172.21.15.123:36744) 2024-09-13T17:07:58.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c3fff700 1 -- 172.21.15.123:0/4094152553 learned_addr learned my addr 172.21.15.123:0/4094152553 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:07:58.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c37fe700 1 --2- 172.21.15.123:0/4094152553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4c413e200 0x7fc4c415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:58.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c8981700 1 --2- 172.21.15.123:0/4094152553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c4159d80 0x7fc4c415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:58.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c3fff700 1 -- 172.21.15.123:0/4094152553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4c413e200 msgr2=0x7fc4c415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:58.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c3fff700 1 --2- 172.21.15.123:0/4094152553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4c413e200 0x7fc4c415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:58.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c3fff700 1 -- 172.21.15.123:0/4094152553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c4159d80 msgr2=0x7fc4c415ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:58.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c3fff700 1 --2- 172.21.15.123:0/4094152553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c4159d80 0x7fc4c415ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:58.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.480+0000 7fc4c3fff700 1 -- 172.21.15.123:0/4094152553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc00ab80 con 0x7fc4c406cfa0 2024-09-13T17:07:58.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.484+0000 7fc4c3fff700 1 --2- 172.21.15.123:0/4094152553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c406cfa0 0x7fc4c41422a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400e9d0 tx=0x7fc4b400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:58.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.484+0000 7fc4c0ff9700 1 -- 172.21.15.123:0/4094152553 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4009720 con 0x7fc4c406cfa0 2024-09-13T17:07:58.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.484+0000 7fc4c9182700 1 -- 172.21.15.123:0/4094152553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c40a8b90 con 0x7fc4c406cfa0 2024-09-13T17:07:58.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.484+0000 7fc4c0ff9700 1 -- 172.21.15.123:0/4094152553 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b400ee70 con 0x7fc4c406cfa0 2024-09-13T17:07:58.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.484+0000 7fc4c0ff9700 1 -- 172.21.15.123:0/4094152553 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400ca50 con 0x7fc4c406cfa0 2024-09-13T17:07:58.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.484+0000 7fc4c9182700 1 -- 172.21.15.123:0/4094152553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c41427e0 con 0x7fc4c406cfa0 2024-09-13T17:07:58.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.484+0000 7fc4c9182700 1 -- 172.21.15.123:0/4094152553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c40a94c0 con 0x7fc4c406cfa0 2024-09-13T17:07:58.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.484+0000 7fc4c0ff9700 1 -- 172.21.15.123:0/4094152553 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc4b400cbb0 con 0x7fc4c406cfa0 2024-09-13T17:07:58.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.488+0000 7fc4c0ff9700 1 --2- 172.21.15.123:0/4094152553 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc4b0066730 0x7fc4b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:58.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.488+0000 7fc4c0ff9700 1 -- 172.21.15.123:0/4094152553 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4b4084920 con 0x7fc4c406cfa0 2024-09-13T17:07:58.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.488+0000 7fc4c37fe700 1 --2- 172.21.15.123:0/4094152553 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc4b0066730 0x7fc4b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.488+0000 7fc4c37fe700 1 --2- 172.21.15.123:0/4094152553 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc4b0066730 0x7fc4b0068bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40cf610 tx=0x7fc4b8007de0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:58.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.492+0000 7fc4c0ff9700 1 -- 172.21.15.123:0/4094152553 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc4b4051d20 con 0x7fc4c406cfa0 2024-09-13T17:07:58.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.696+0000 7fc4c9182700 1 -- 172.21.15.123:0/4094152553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc4c406ca60 con 0x7fc4c406cfa0 2024-09-13T17:07:58.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.696+0000 7fc4c0ff9700 1 -- 172.21.15.123:0/4094152553 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc4b4017070 con 0x7fc4c406cfa0 2024-09-13T17:07:58.700 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:07:58.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.700+0000 7fc4c9182700 1 -- 172.21.15.123:0/4094152553 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc4b0066730 msgr2=0x7fc4b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:58.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.700+0000 7fc4c9182700 1 --2- 172.21.15.123:0/4094152553 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc4b0066730 0x7fc4b0068bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40cf610 tx=0x7fc4b8007de0 comp rx=0 tx=0).stop 2024-09-13T17:07:58.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.700+0000 7fc4c9182700 1 -- 172.21.15.123:0/4094152553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c406cfa0 msgr2=0x7fc4c41422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:58.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.700+0000 7fc4c9182700 1 --2- 172.21.15.123:0/4094152553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c406cfa0 0x7fc4c41422a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400e9d0 tx=0x7fc4b400ece0 comp rx=0 tx=0).stop 2024-09-13T17:07:58.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.700+0000 7fc4c9182700 1 -- 172.21.15.123:0/4094152553 shutdown_connections 2024-09-13T17:07:58.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.700+0000 7fc4c9182700 1 --2- 172.21.15.123:0/4094152553 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc4b0066730 0x7fc4b0068bf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:58.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.700+0000 7fc4c9182700 1 --2- 172.21.15.123:0/4094152553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c4159d80 0x7fc4c415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:58.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.700+0000 7fc4c9182700 1 --2- 172.21.15.123:0/4094152553 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4c413e200 0x7fc4c415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:58.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.700+0000 7fc4c9182700 1 --2- 172.21.15.123:0/4094152553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c406cfa0 0x7fc4c41422a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:58.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.700+0000 7fc4c9182700 1 -- 172.21.15.123:0/4094152553 >> 172.21.15.123:0/4094152553 conn(0x7fc4c40b4630 msgr2=0x7fc4c415ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:58.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.700+0000 7fc4c9182700 1 -- 172.21.15.123:0/4094152553 shutdown_connections 2024-09-13T17:07:58.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:07:58.700+0000 7fc4c9182700 1 -- 172.21.15.123:0/4094152553 wait complete. 2024-09-13T17:07:58.716 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:07:58.716 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:07:58.717 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-13T17:07:58.717 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:07:58.717 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:07:58.717 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:07:58.717 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:07:58.717 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:07:58.717 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:07:58.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:58.717 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-13T17:07:58.725 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:07:58.725 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:07:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:07:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-13T17:07:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:58.726 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:58.726 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:58.727 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:07:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:58.727 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:07:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:07:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42532sec preferred_lft 42532sec 2024-09-13T17:07:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-09-13T17:07:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:58.727 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:07:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:73:6c:03:01 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:07:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:58.727 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:07:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:07:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:07:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::f82f:21ff:fe0c:65de/64 scope link 2024-09-13T17:07:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:58.728 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:07:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:07:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::346e:9ff:fe92:ffa0/64 scope link 2024-09-13T17:07:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:58.728 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:07:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether c6:e2:c1:7b:16:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:07:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::c4e2:c1ff:fe7b:1657/64 scope link 2024-09-13T17:07:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:07:58.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:58.729 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:07:58.742 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-13T17:07:58.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:58.743 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-13T17:07:58.752 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-13T17:07:58.752 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:07:58.752 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:07:58.752 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:07:58.752 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:07:58.752 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:07:58.752 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:07:58.752 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:07:58.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:58.753 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:07:58.753 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:07:58.753 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:07:58.753 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:07:58.753 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:07:58.753 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:07:58.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:58.836 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-13T17:07:58.843 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:07:58.843 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:07:58.843 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:07:58.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:58.844 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-09-13T17:07:58.859 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:07:58.860 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:07:58.860 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:07:58.864 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:07:58.865 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:07:58.865 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:07:58.913 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:07:58.931 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:58.931 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:58.944 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:58.945 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:58.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:58.946 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:07:58.994 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:07:58.994 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:07:58.996 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:07:59.012 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:07:59.012 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:07:59.021 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:07:59.021 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:07:59.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:07:59.022 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:07:59.088 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:2024-09-13T17:07:59.083+0000 7ff4d5057640 -1 init, newargv = 0x558a9eed07a0 newargc=15 2024-09-13T17:07:59.089 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[32881]: starting ceph client 2024-09-13T17:07:59.099 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[32881]: starting fuse 2024-09-13T17:08:00.171 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:08:00.189 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:08:00.189 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:08:00.203 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:08:00.204 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:08:00.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:00.205 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:08:00.254 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-09-13T17:08:00.254 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:08:00.254 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:08:00.254 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-09-13T17:08:00.254 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:08:00.255 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:08:00.256 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:08:00.256 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-09-13T17:08:00.256 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-09-13T17:08:00.256 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-09-13T17:08:00.256 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:08:00.256 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:08:00.256 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.1")) 2024-09-13T17:08:00.256 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-13T17:08:00.332 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.1.32881.asok 2024-09-13T17:08:00.518 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.32881.asok 2024-09-13T17:08:00.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:00.518 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.32881.asok status 2024-09-13T17:08:00.612 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-13T17:08:00.612 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-09-13T17:08:00.612 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:08:00.612 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:08:00.612 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "1", 2024-09-13T17:08:00.612 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-09-13T17:08:00.613 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:08:00.613 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "32881", 2024-09-13T17:08:00.613 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-09-13T17:08:00.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:08:00.613 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-09-13T17:08:00.613 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-09-13T17:08:00.613 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5377, 2024-09-13T17:08:00.613 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-09-13T17:08:00.613 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-09-13T17:08:00.613 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-09-13T17:08:00.614 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 5377 2024-09-13T17:08:00.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:08:00.614 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:08:00.614 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:08:00.614 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:08:00.614 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 2625367124 2024-09-13T17:08:00.614 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-13T17:08:00.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:08:00.614 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:08:00.614 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:08:00.614 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:08:00.614 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 2625367124 2024-09-13T17:08:00.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:08:00.615 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.5377 192.168.0.1:0/2625367124", 2024-09-13T17:08:00.615 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.1:0/2625367124", 2024-09-13T17:08:00.615 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-09-13T17:08:00.615 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 13, 2024-09-13T17:08:00.615 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 34, 2024-09-13T17:08:00.615 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:08:00.615 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-09-13T17:08:00.615 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-09-13T17:08:00.615 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-13T17:08:00.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:00.621 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-09-13T17:08:00.621 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:00.626 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-09-13T17:08:00.626 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:00.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:00.627 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:00.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:00.636 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-13T17:08:00.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:00.654 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 0 ./subdir) 2024-09-13T17:08:00.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:00.717 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T17:08:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:./subdir: ceph.quota.max_bytes: No such attribute 2024-09-13T17:08:00.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:00.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:00.737 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir) 2024-09-13T17:08:00.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:00.750 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T17:08:00.761 INFO:teuthology.orchestra.run.smithi123.stdout:1024 2024-09-13T17:08:00.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:00.762 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 0M ./subdir) 2024-09-13T17:08:00.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:00.774 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T17:08:00.826 INFO:teuthology.orchestra.run.smithi123.stderr:./subdir: ceph.quota.max_bytes: No such attribute 2024-09-13T17:08:00.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:00.827 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:08:00.827 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:08:00.847 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:08:00.869 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:08:00.869 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:08:00.869 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:00.877 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:01.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd63159c700 1 Processor -- start 2024-09-13T17:08:01.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd63159c700 1 -- start start 2024-09-13T17:08:01.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd63159c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd62c072510 0x7fd62c0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd63159c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd62c0cd200 0x7fd62c0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd63159c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62c0b1cf0 con 0x7fd62c15aa80 2024-09-13T17:08:01.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd63159c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c15ae60 con 0x7fd62c072510 2024-09-13T17:08:01.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd63159c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0b3150 con 0x7fd62c0cd200 2024-09-13T17:08:01.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd62affd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd62c15aa80 0x7fd62c15b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34108/0 (socket says 172.21.15.123:34108) 2024-09-13T17:08:01.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd62affd700 1 -- 172.21.15.123:0/11911735 learned_addr learned my addr 172.21.15.123:0/11911735 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:01.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd62b7fe700 1 --2- 172.21.15.123:0/11911735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd62c0cd200 0x7fd62c0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd62a7fc700 1 --2- 172.21.15.123:0/11911735 >> v2:172.21.15.153:3300/0 conn(0x7fd62c072510 0x7fd62c0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd629ffb700 1 -- 172.21.15.123:0/11911735 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957339321 0 0) 0x7fd62c0b1cf0 con 0x7fd62c15aa80 2024-09-13T17:08:01.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd629ffb700 1 -- 172.21.15.123:0/11911735 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd60c0035d0 con 0x7fd62c15aa80 2024-09-13T17:08:01.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd62b7fe700 1 -- 172.21.15.123:0/11911735 >> v2:172.21.15.153:3300/0 conn(0x7fd62c072510 msgr2=0x7fd62c0cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:01.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd62b7fe700 1 --2- 172.21.15.123:0/11911735 >> v2:172.21.15.153:3300/0 conn(0x7fd62c072510 0x7fd62c0cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd62b7fe700 1 -- 172.21.15.123:0/11911735 >> v1:172.21.15.123:6789/0 conn(0x7fd62c15aa80 legacy=0x7fd62c15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd62b7fe700 1 -- 172.21.15.123:0/11911735 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c0b37f0 con 0x7fd62c0cd200 2024-09-13T17:08:01.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd62b7fe700 1 --2- 172.21.15.123:0/11911735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd62c0cd200 0x7fd62c0cec90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd624009d90 tx=0x7fd62400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c76b192bf2da27c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:01.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd629ffb700 1 -- 172.21.15.123:0/11911735 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400e070 con 0x7fd62c0cd200 2024-09-13T17:08:01.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd629ffb700 1 -- 172.21.15.123:0/11911735 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62400bb20 con 0x7fd62c0cd200 2024-09-13T17:08:01.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.036+0000 7fd629ffb700 1 -- 172.21.15.123:0/11911735 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624012430 con 0x7fd62c0cd200 2024-09-13T17:08:01.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 -- 172.21.15.123:0/11911735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd62c0cd200 msgr2=0x7fd62c0cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 --2- 172.21.15.123:0/11911735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd62c0cd200 0x7fd62c0cec90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd624009d90 tx=0x7fd62400b330 comp rx=0 tx=0).stop 2024-09-13T17:08:01.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 -- 172.21.15.123:0/11911735 shutdown_connections 2024-09-13T17:08:01.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 --2- 172.21.15.123:0/11911735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd62c0cd200 0x7fd62c0cec90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 --2- 172.21.15.123:0/11911735 >> v2:172.21.15.153:3300/0 conn(0x7fd62c072510 0x7fd62c0cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 -- 172.21.15.123:0/11911735 >> 172.21.15.123:0/11911735 conn(0x7fd62c066570 msgr2=0x7fd62c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:01.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 -- 172.21.15.123:0/11911735 shutdown_connections 2024-09-13T17:08:01.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 -- 172.21.15.123:0/11911735 wait complete. 2024-09-13T17:08:01.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 Processor -- start 2024-09-13T17:08:01.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 -- start start 2024-09-13T17:08:01.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd62c072510 0x7fd62c1467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd62c0cd200 0x7fd62c15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd62c15aa80 0x7fd62c15d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c15bab0 con 0x7fd62c0cd200 2024-09-13T17:08:01.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c15bd90 con 0x7fd62c15aa80 2024-09-13T17:08:01.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd63159c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c15c070 con 0x7fd62c072510 2024-09-13T17:08:01.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd62a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd62c0cd200 0x7fd62c15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd62a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd62c0cd200 0x7fd62c15afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36754/0 (socket says 172.21.15.123:36754) 2024-09-13T17:08:01.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd62a7fc700 1 -- 172.21.15.123:0/736370071 learned_addr learned my addr 172.21.15.123:0/736370071 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:01.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd62affd700 1 --2- 172.21.15.123:0/736370071 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd62c072510 0x7fd62c1467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.040+0000 7fd62b7fe700 1 --2- 172.21.15.123:0/736370071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd62c15aa80 0x7fd62c15d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd62a7fc700 1 -- 172.21.15.123:0/736370071 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd62c072510 msgr2=0x7fd62c1467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd62a7fc700 1 --2- 172.21.15.123:0/736370071 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd62c072510 0x7fd62c1467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd62a7fc700 1 -- 172.21.15.123:0/736370071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd62c15aa80 msgr2=0x7fd62c15d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd62a7fc700 1 --2- 172.21.15.123:0/736370071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd62c15aa80 0x7fd62c15d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd62a7fc700 1 -- 172.21.15.123:0/736370071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd624009a70 con 0x7fd62c0cd200 2024-09-13T17:08:01.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd62a7fc700 1 --2- 172.21.15.123:0/736370071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd62c0cd200 0x7fd62c15afb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd61400e9d0 tx=0x7fd61400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:01.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd6237fe700 1 -- 172.21.15.123:0/736370071 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd614009720 con 0x7fd62c0cd200 2024-09-13T17:08:01.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd6237fe700 1 -- 172.21.15.123:0/736370071 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61400ee70 con 0x7fd62c0cd200 2024-09-13T17:08:01.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd63159c700 1 -- 172.21.15.123:0/736370071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62c15c350 con 0x7fd62c0cd200 2024-09-13T17:08:01.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd6237fe700 1 -- 172.21.15.123:0/736370071 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61400ca50 con 0x7fd62c0cd200 2024-09-13T17:08:01.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd63159c700 1 -- 172.21.15.123:0/736370071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c14e630 con 0x7fd62c0cd200 2024-09-13T17:08:01.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd63159c700 1 -- 172.21.15.123:0/736370071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62c0cccc0 con 0x7fd62c0cd200 2024-09-13T17:08:01.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd6237fe700 1 -- 172.21.15.123:0/736370071 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd61400cbb0 con 0x7fd62c0cd200 2024-09-13T17:08:01.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd6237fe700 1 --2- 172.21.15.123:0/736370071 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd610066730 0x7fd610068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd6237fe700 1 -- 172.21.15.123:0/736370071 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd614084180 con 0x7fd62c0cd200 2024-09-13T17:08:01.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.044+0000 7fd62affd700 1 --2- 172.21.15.123:0/736370071 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd610066730 0x7fd610068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.048+0000 7fd62affd700 1 --2- 172.21.15.123:0/736370071 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd610066730 0x7fd610068bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd61c007fd0 tx=0x7fd61c007de0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.056+0000 7fd6237fe700 1 -- 172.21.15.123:0/736370071 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd614051500 con 0x7fd62c0cd200 2024-09-13T17:08:01.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.216+0000 7fd63159c700 1 -- 172.21.15.123:0/736370071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd62c151b50 con 0x7fd62c0cd200 2024-09-13T17:08:01.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.220+0000 7fd6237fe700 1 -- 172.21.15.123:0/736370071 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fd61400ce60 con 0x7fd62c0cd200 2024-09-13T17:08:01.223 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:01.223 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":34,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:07:47.800958+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:07:44.636174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T17:07:45.802714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:01.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.220+0000 7fd63159c700 1 -- 172.21.15.123:0/736370071 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd610066730 msgr2=0x7fd610068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.220+0000 7fd63159c700 1 --2- 172.21.15.123:0/736370071 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd610066730 0x7fd610068bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd61c007fd0 tx=0x7fd61c007de0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.220+0000 7fd63159c700 1 -- 172.21.15.123:0/736370071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd62c0cd200 msgr2=0x7fd62c15afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.220+0000 7fd63159c700 1 --2- 172.21.15.123:0/736370071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd62c0cd200 0x7fd62c15afb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd61400e9d0 tx=0x7fd61400ece0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.220+0000 7fd63159c700 1 -- 172.21.15.123:0/736370071 shutdown_connections 2024-09-13T17:08:01.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.220+0000 7fd63159c700 1 --2- 172.21.15.123:0/736370071 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd610066730 0x7fd610068bf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.220+0000 7fd63159c700 1 --2- 172.21.15.123:0/736370071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd62c15aa80 0x7fd62c15d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.220+0000 7fd63159c700 1 --2- 172.21.15.123:0/736370071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd62c0cd200 0x7fd62c15afb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.220+0000 7fd63159c700 1 --2- 172.21.15.123:0/736370071 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd62c072510 0x7fd62c1467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.220+0000 7fd63159c700 1 -- 172.21.15.123:0/736370071 >> 172.21.15.123:0/736370071 conn(0x7fd62c066570 msgr2=0x7fd62c0aeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:01.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.220+0000 7fd63159c700 1 -- 172.21.15.123:0/736370071 shutdown_connections 2024-09-13T17:08:01.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.220+0000 7fd63159c700 1 -- 172.21.15.123:0/736370071 wait complete. 2024-09-13T17:08:01.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:07:44.636174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:07:45.802714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:08:01.237 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:08:01.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.352+0000 7fd711ba0700 1 Processor -- start 2024-09-13T17:08:01.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.352+0000 7fd711ba0700 1 -- start start 2024-09-13T17:08:01.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd711ba0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd70c0d0f40 0x7fd70c0d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd711ba0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c0d0cb0 con 0x7fd70c0b58b0 2024-09-13T17:08:01.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd711ba0700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c0b0060 con 0x7fd70c0cd5e0 2024-09-13T17:08:01.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd711ba0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0b0340 con 0x7fd70c0d0f40 2024-09-13T17:08:01.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd70c0b58b0 0x7fd70c0d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34114/0 (socket says 172.21.15.123:34114) 2024-09-13T17:08:01.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70bfff700 1 -- 172.21.15.123:0/2706766404 learned_addr learned my addr 172.21.15.123:0/2706766404 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:01.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd710b9e700 1 --2- 172.21.15.123:0/2706766404 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd70c0d0f40 0x7fd70c0d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165843367 0 0) 0x7fd70c0d0cb0 con 0x7fd70c0b58b0 2024-09-13T17:08:01.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6f80035d0 con 0x7fd70c0b58b0 2024-09-13T17:08:01.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79438094 0 0) 0x7fd70c0b0060 con 0x7fd70c0cd5e0 2024-09-13T17:08:01.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd70c0d0cb0 con 0x7fd70c0cd5e0 2024-09-13T17:08:01.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2273356013 0 0) 0x7fd6f80035d0 con 0x7fd70c0b58b0 2024-09-13T17:08:01.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd70c0d0f40 msgr2=0x7fd70c0d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:01.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 --2- 172.21.15.123:0/2706766404 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd70c0d0f40 0x7fd70c0d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 >> v1:172.21.15.153:6789/0 conn(0x7fd70c0cd5e0 legacy=0x7fd70c0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c0b0620 con 0x7fd70c0b58b0 2024-09-13T17:08:01.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7fd6fc001670 con 0x7fd70c0b58b0 2024-09-13T17:08:01.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd710b9e700 1 --2- 172.21.15.123:0/2706766404 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd70c0d0f40 0x7fd70c0d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:01.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 >> v1:172.21.15.123:6789/0 conn(0x7fd70c0b58b0 legacy=0x7fd70c0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 --2- 172.21.15.123:0/2706766404 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd70c0d0f40 0x7fd6f8003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 --2- 172.21.15.123:0/2706766404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6f8004120 0x7fd6f8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 --2- 172.21.15.123:0/2706766404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f8004db0 0x7fd6f8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0b0340 con 0x7fd6f8004db0 2024-09-13T17:08:01.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f800bb70 con 0x7fd6f8004120 2024-09-13T17:08:01.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f800bd30 con 0x7fd70c0d0f40 2024-09-13T17:08:01.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd71139f700 1 --2- 172.21.15.123:0/2706766404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f8004db0 0x7fd6f8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd710b9e700 1 --2- 172.21.15.123:0/2706766404 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd70c0d0f40 0x7fd6f8003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70bfff700 1 --2- 172.21.15.123:0/2706766404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6f8004120 0x7fd6f8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd71139f700 1 -- 172.21.15.123:0/2706766404 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd70c0d0f40 msgr2=0x7fd6f8003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:01.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd71139f700 1 --2- 172.21.15.123:0/2706766404 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd70c0d0f40 0x7fd6f8003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd71139f700 1 -- 172.21.15.123:0/2706766404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6f8004120 msgr2=0x7fd6f8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:01.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd71139f700 1 --2- 172.21.15.123:0/2706766404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6f8004120 0x7fd6f8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd71139f700 1 -- 172.21.15.123:0/2706766404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f40094b0 con 0x7fd6f8004db0 2024-09-13T17:08:01.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd71139f700 1 --2- 172.21.15.123:0/2706766404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f8004db0 0x7fd6f8005230 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd70400c2f0 tx=0x7fd6f80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34182e4beeaefeb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:01.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704001f30 con 0x7fd6f8004db0 2024-09-13T17:08:01.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70400ce90 con 0x7fd6f8004db0 2024-09-13T17:08:01.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd70b7fe700 1 -- 172.21.15.123:0/2706766404 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704003c60 con 0x7fd6f8004db0 2024-09-13T17:08:01.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd711ba0700 1 -- 172.21.15.123:0/2706766404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f8004db0 msgr2=0x7fd6f8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd711ba0700 1 --2- 172.21.15.123:0/2706766404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f8004db0 0x7fd6f8005230 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd70400c2f0 tx=0x7fd6f80058a0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd71139f700 1 -- 172.21.15.123:0/2706766404 reap_dead start 2024-09-13T17:08:01.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd711ba0700 1 -- 172.21.15.123:0/2706766404 shutdown_connections 2024-09-13T17:08:01.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd711ba0700 1 -- 172.21.15.123:0/2706766404 >> 172.21.15.123:0/2706766404 conn(0x7fd70c0d2a60 msgr2=0x7fd70c0d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:01.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd711ba0700 1 -- 172.21.15.123:0/2706766404 shutdown_connections 2024-09-13T17:08:01.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.356+0000 7fd711ba0700 1 -- 172.21.15.123:0/2706766404 wait complete. 2024-09-13T17:08:01.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.360+0000 7fd711ba0700 1 Processor -- start 2024-09-13T17:08:01.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.360+0000 7fd711ba0700 1 -- start start 2024-09-13T17:08:01.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.360+0000 7fd711ba0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd70c152f90 0x7fd70c0ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd711ba0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70c0b3da0 0x7fd70c0b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd711ba0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd70c15d820 0x7fd70c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd711ba0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0b4760 con 0x7fd70c0b3da0 2024-09-13T17:08:01.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd711ba0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c1601f0 con 0x7fd70c15d820 2024-09-13T17:08:01.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd711ba0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0cb990 con 0x7fd70c152f90 2024-09-13T17:08:01.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd70bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70c0b3da0 0x7fd70c0b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd70bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70c0b3da0 0x7fd70c0b4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36774/0 (socket says 172.21.15.123:36774) 2024-09-13T17:08:01.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd70bfff700 1 -- 172.21.15.123:0/1051092172 learned_addr learned my addr 172.21.15.123:0/1051092172 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:01.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd710b9e700 1 --2- 172.21.15.123:0/1051092172 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd70c152f90 0x7fd70c0ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd71139f700 1 --2- 172.21.15.123:0/1051092172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd70c15d820 0x7fd70c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd70bfff700 1 -- 172.21.15.123:0/1051092172 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd70c152f90 msgr2=0x7fd70c0ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd70bfff700 1 --2- 172.21.15.123:0/1051092172 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd70c152f90 0x7fd70c0ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd70bfff700 1 -- 172.21.15.123:0/1051092172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd70c15d820 msgr2=0x7fd70c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd70bfff700 1 --2- 172.21.15.123:0/1051092172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd70c15d820 0x7fd70c15dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd70bfff700 1 -- 172.21.15.123:0/1051092172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c0cbc70 con 0x7fd70c0b3da0 2024-09-13T17:08:01.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd70bfff700 1 --2- 172.21.15.123:0/1051092172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70c0b3da0 0x7fd70c0b4220 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc007310 tx=0x7fd6fc007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:01.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd7097fa700 1 -- 172.21.15.123:0/1051092172 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc011580 con 0x7fd70c0b3da0 2024-09-13T17:08:01.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd7097fa700 1 -- 172.21.15.123:0/1051092172 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc011700 con 0x7fd70c0b3da0 2024-09-13T17:08:01.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd711ba0700 1 -- 172.21.15.123:0/1051092172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c0cbf50 con 0x7fd70c0b3da0 2024-09-13T17:08:01.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd7097fa700 1 -- 172.21.15.123:0/1051092172 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc011ab0 con 0x7fd70c0b3da0 2024-09-13T17:08:01.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd711ba0700 1 -- 172.21.15.123:0/1051092172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c0cc510 con 0x7fd70c0b3da0 2024-09-13T17:08:01.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd711ba0700 1 -- 172.21.15.123:0/1051092172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c15d540 con 0x7fd70c0b3da0 2024-09-13T17:08:01.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.364+0000 7fd7097fa700 1 -- 172.21.15.123:0/1051092172 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd6fc011c10 con 0x7fd70c0b3da0 2024-09-13T17:08:01.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.368+0000 7fd7097fa700 1 --2- 172.21.15.123:0/1051092172 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd6ec066760 0x7fd6ec068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.368+0000 7fd7097fa700 1 -- 172.21.15.123:0/1051092172 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6fc083f70 con 0x7fd70c0b3da0 2024-09-13T17:08:01.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.368+0000 7fd710b9e700 1 --2- 172.21.15.123:0/1051092172 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd6ec066760 0x7fd6ec068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.368+0000 7fd710b9e700 1 --2- 172.21.15.123:0/1051092172 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd6ec066760 0x7fd6ec068c20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009df0 tx=0x7fd6f4009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:01.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.372+0000 7fd7097fa700 1 -- 172.21.15.123:0/1051092172 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd6fc0b5db0 con 0x7fd70c0b3da0 2024-09-13T17:08:01.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.536+0000 7fd711ba0700 1 -- 172.21.15.123:0/1051092172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd70c15ce70 con 0x7fd70c0b3da0 2024-09-13T17:08:01.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.540+0000 7fd7097fa700 1 -- 172.21.15.123:0/1051092172 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd70c15d540 con 0x7fd70c0b3da0 2024-09-13T17:08:01.542 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:08:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.540+0000 7fd711ba0700 1 -- 172.21.15.123:0/1051092172 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd6ec066760 msgr2=0x7fd6ec068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.540+0000 7fd711ba0700 1 --2- 172.21.15.123:0/1051092172 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd6ec066760 0x7fd6ec068c20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009df0 tx=0x7fd6f4009240 comp rx=0 tx=0).stop 2024-09-13T17:08:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.540+0000 7fd711ba0700 1 -- 172.21.15.123:0/1051092172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70c0b3da0 msgr2=0x7fd70c0b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.540+0000 7fd711ba0700 1 --2- 172.21.15.123:0/1051092172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70c0b3da0 0x7fd70c0b4220 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc007310 tx=0x7fd6fc007620 comp rx=0 tx=0).stop 2024-09-13T17:08:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.540+0000 7fd711ba0700 1 -- 172.21.15.123:0/1051092172 shutdown_connections 2024-09-13T17:08:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.540+0000 7fd711ba0700 1 --2- 172.21.15.123:0/1051092172 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd6ec066760 0x7fd6ec068c20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.540+0000 7fd711ba0700 1 --2- 172.21.15.123:0/1051092172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd70c15d820 0x7fd70c15dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.540+0000 7fd711ba0700 1 --2- 172.21.15.123:0/1051092172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd70c0b3da0 0x7fd70c0b4220 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.540+0000 7fd711ba0700 1 --2- 172.21.15.123:0/1051092172 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd70c152f90 0x7fd70c0ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.540+0000 7fd711ba0700 1 -- 172.21.15.123:0/1051092172 >> 172.21.15.123:0/1051092172 conn(0x7fd70c0d2a60 msgr2=0x7fd70c0d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.540+0000 7fd711ba0700 1 -- 172.21.15.123:0/1051092172 shutdown_connections 2024-09-13T17:08:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.540+0000 7fd711ba0700 1 -- 172.21.15.123:0/1051092172 wait complete. 2024-09-13T17:08:01.557 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:08:01.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf0b1b5700 1 Processor -- start 2024-09-13T17:08:01.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf0b1b5700 1 -- start start 2024-09-13T17:08:01.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf0b1b5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faf04159830 0x7faf04159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf0b1b5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0406d1d0 con 0x7faf0406a260 2024-09-13T17:08:01.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf0b1b5700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0406d420 con 0x7faf0406e460 2024-09-13T17:08:01.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf0b1b5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0406d6a0 con 0x7faf04159830 2024-09-13T17:08:01.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf08f51700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faf04159830 0x7faf04159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf09752700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7faf0406a260 0x7faf040ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34124/0 (socket says 172.21.15.123:34124) 2024-09-13T17:08:01.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf09752700 1 -- 172.21.15.123:0/4118108058 learned_addr learned my addr 172.21.15.123:0/4118108058 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:01.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf08f51700 1 -- 172.21.15.123:0/4118108058 >> v1:172.21.15.153:6789/0 conn(0x7faf0406e460 legacy=0x7faf040ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:01.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf08f51700 1 -- 172.21.15.123:0/4118108058 >> v1:172.21.15.123:6789/0 conn(0x7faf0406a260 legacy=0x7faf040ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf037fe700 1 -- 172.21.15.123:0/4118108058 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447495533 0 0) 0x7faf0406d1d0 con 0x7faf0406a260 2024-09-13T17:08:01.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf08f51700 1 -- 172.21.15.123:0/4118108058 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0406d980 con 0x7faf04159830 2024-09-13T17:08:01.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf08f51700 1 --2- 172.21.15.123:0/4118108058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf04159830 0x7faf04159c10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7faef4009d90 tx=0x7faef400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c5a2c7db707a64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:01.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf037fe700 1 -- 172.21.15.123:0/4118108058 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef400e070 con 0x7faf04159830 2024-09-13T17:08:01.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.676+0000 7faf037fe700 1 -- 172.21.15.123:0/4118108058 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef400bb90 con 0x7faf04159830 2024-09-13T17:08:01.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.680+0000 7faf037fe700 1 -- 172.21.15.123:0/4118108058 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4003a40 con 0x7faf04159830 2024-09-13T17:08:01.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.680+0000 7faf0b1b5700 1 -- 172.21.15.123:0/4118108058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf04159830 msgr2=0x7faf04159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.680+0000 7faf0b1b5700 1 --2- 172.21.15.123:0/4118108058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf04159830 0x7faf04159c10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7faef4009d90 tx=0x7faef400b330 comp rx=0 tx=0).stop 2024-09-13T17:08:01.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.680+0000 7faf0b1b5700 1 -- 172.21.15.123:0/4118108058 shutdown_connections 2024-09-13T17:08:01.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.680+0000 7faf0b1b5700 1 --2- 172.21.15.123:0/4118108058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf04159830 0x7faf04159c10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.680+0000 7faf0b1b5700 1 -- 172.21.15.123:0/4118108058 >> 172.21.15.123:0/4118108058 conn(0x7faf040b0eb0 msgr2=0x7faf040b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:01.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.680+0000 7faf0b1b5700 1 -- 172.21.15.123:0/4118108058 shutdown_connections 2024-09-13T17:08:01.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.680+0000 7faf0b1b5700 1 -- 172.21.15.123:0/4118108058 wait complete. 2024-09-13T17:08:01.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf0b1b5700 1 Processor -- start 2024-09-13T17:08:01.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf0b1b5700 1 -- start start 2024-09-13T17:08:01.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf0b1b5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0406a260 0x7faf040c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf0b1b5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf0406e460 0x7faf040ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf0b1b5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf04159830 0x7faf04157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf0b1b5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040c4610 con 0x7faf04159830 2024-09-13T17:08:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf0b1b5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040c48f0 con 0x7faf0406e460 2024-09-13T17:08:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf0b1b5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf040c4bd0 con 0x7faf0406a260 2024-09-13T17:08:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf09752700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf04159830 0x7faf04157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf09752700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf04159830 0x7faf04157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36794/0 (socket says 172.21.15.123:36794) 2024-09-13T17:08:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf09752700 1 -- 172.21.15.123:0/3079372529 learned_addr learned my addr 172.21.15.123:0/3079372529 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf08f51700 1 --2- 172.21.15.123:0/3079372529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0406a260 0x7faf040c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf03fff700 1 --2- 172.21.15.123:0/3079372529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf0406e460 0x7faf040ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf09752700 1 -- 172.21.15.123:0/3079372529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0406a260 msgr2=0x7faf040c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf09752700 1 --2- 172.21.15.123:0/3079372529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0406a260 0x7faf040c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf09752700 1 -- 172.21.15.123:0/3079372529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf0406e460 msgr2=0x7faf040ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf09752700 1 --2- 172.21.15.123:0/3079372529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf0406e460 0x7faf040ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf09752700 1 -- 172.21.15.123:0/3079372529 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4009a70 con 0x7faf04159830 2024-09-13T17:08:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf09752700 1 --2- 172.21.15.123:0/3079372529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf04159830 0x7faf04157630 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c550 tx=0x7faefc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf017fa700 1 -- 172.21.15.123:0/3079372529 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc004ca0 con 0x7faf04159830 2024-09-13T17:08:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf017fa700 1 -- 172.21.15.123:0/3079372529 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc004e40 con 0x7faf04159830 2024-09-13T17:08:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf017fa700 1 -- 172.21.15.123:0/3079372529 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc007310 con 0x7faf04159830 2024-09-13T17:08:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf0b1b5700 1 -- 172.21.15.123:0/3079372529 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf040cb140 con 0x7faf04159830 2024-09-13T17:08:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.684+0000 7faf0b1b5700 1 -- 172.21.15.123:0/3079372529 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf040a91a0 con 0x7faf04159830 2024-09-13T17:08:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.688+0000 7faf0b1b5700 1 -- 172.21.15.123:0/3079372529 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf04074800 con 0x7faf04159830 2024-09-13T17:08:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.688+0000 7faf017fa700 1 -- 172.21.15.123:0/3079372529 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faefc007470 con 0x7faf04159830 2024-09-13T17:08:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.688+0000 7faf017fa700 1 --2- 172.21.15.123:0/3079372529 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faee4066730 0x7faee4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.688+0000 7faf08f51700 1 --2- 172.21.15.123:0/3079372529 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faee4066730 0x7faee4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.688+0000 7faf017fa700 1 -- 172.21.15.123:0/3079372529 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faefc083d20 con 0x7faf04159830 2024-09-13T17:08:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.688+0000 7faf08f51700 1 --2- 172.21.15.123:0/3079372529 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faee4066730 0x7faee4068bf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faef4009790 tx=0x7faef4011000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:01.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.692+0000 7faf017fa700 1 -- 172.21.15.123:0/3079372529 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faefc051120 con 0x7faf04159830 2024-09-13T17:08:01.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.864+0000 7faf0b1b5700 1 -- 172.21.15.123:0/3079372529 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf040c4750 con 0x7faf04159830 2024-09-13T17:08:01.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.868+0000 7faf017fa700 1 -- 172.21.15.123:0/3079372529 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf040c4750 con 0x7faf04159830 2024-09-13T17:08:01.870 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:08:01.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.868+0000 7faf0b1b5700 1 -- 172.21.15.123:0/3079372529 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faee4066730 msgr2=0x7faee4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.868+0000 7faf0b1b5700 1 --2- 172.21.15.123:0/3079372529 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faee4066730 0x7faee4068bf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faef4009790 tx=0x7faef4011000 comp rx=0 tx=0).stop 2024-09-13T17:08:01.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.868+0000 7faf0b1b5700 1 -- 172.21.15.123:0/3079372529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf04159830 msgr2=0x7faf04157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:01.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.868+0000 7faf0b1b5700 1 --2- 172.21.15.123:0/3079372529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf04159830 0x7faf04157630 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c550 tx=0x7faefc00c860 comp rx=0 tx=0).stop 2024-09-13T17:08:01.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.868+0000 7faf0b1b5700 1 -- 172.21.15.123:0/3079372529 shutdown_connections 2024-09-13T17:08:01.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.868+0000 7faf0b1b5700 1 --2- 172.21.15.123:0/3079372529 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faee4066730 0x7faee4068bf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.868+0000 7faf0b1b5700 1 --2- 172.21.15.123:0/3079372529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf04159830 0x7faf04157630 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.868+0000 7faf0b1b5700 1 --2- 172.21.15.123:0/3079372529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf0406e460 0x7faf040ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.868+0000 7faf0b1b5700 1 --2- 172.21.15.123:0/3079372529 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0406a260 0x7faf040c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:01.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.868+0000 7faf0b1b5700 1 -- 172.21.15.123:0/3079372529 >> 172.21.15.123:0/3079372529 conn(0x7faf040b0eb0 msgr2=0x7faf040b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:01.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.868+0000 7faf0b1b5700 1 -- 172.21.15.123:0/3079372529 shutdown_connections 2024-09-13T17:08:01.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.868+0000 7faf0b1b5700 1 -- 172.21.15.123:0/3079372529 wait complete. 2024-09-13T17:08:01.884 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:08:01.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b8bbc700 1 Processor -- start 2024-09-13T17:08:01.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b8bbc700 1 -- start start 2024-09-13T17:08:02.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b8bbc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91b40cefe0 0x7f91b40b2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b8bbc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b40b2eb0 con 0x7f91b406f280 2024-09-13T17:08:02.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b8bbc700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b40b2c80 con 0x7f91b415a980 2024-09-13T17:08:02.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b8bbc700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b40b1860 con 0x7f91b40cefe0 2024-09-13T17:08:02.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b2ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91b40cefe0 0x7f91b40b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b3fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f91b406f280 0x7f91b406f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55406/0 (socket says 172.21.15.123:55406) 2024-09-13T17:08:02.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b3fff700 1 -- 172.21.15.123:0/216704277 learned_addr learned my addr 172.21.15.123:0/216704277 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:02.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b2ffd700 1 -- 172.21.15.123:0/216704277 >> v1:172.21.15.153:6789/0 conn(0x7f91b415a980 legacy=0x7f91b40cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b2ffd700 1 -- 172.21.15.123:0/216704277 >> v1:172.21.15.123:6789/0 conn(0x7f91b406f280 legacy=0x7f91b406f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b27fc700 1 -- 172.21.15.123:0/216704277 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242710830 0 0) 0x7f91b40b2eb0 con 0x7f91b406f280 2024-09-13T17:08:02.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b2ffd700 1 -- 172.21.15.123:0/216704277 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b40b2350 con 0x7f91b40cefe0 2024-09-13T17:08:02.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b2ffd700 1 --2- 172.21.15.123:0/216704277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91b40cefe0 0x7f91b40b2740 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009850 tx=0x7f91a8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca39f44e1cfbb58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:02.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b27fc700 1 -- 172.21.15.123:0/216704277 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8011830 con 0x7f91b40cefe0 2024-09-13T17:08:02.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b27fc700 1 -- 172.21.15.123:0/216704277 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a8011990 con 0x7f91b40cefe0 2024-09-13T17:08:02.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b27fc700 1 -- 172.21.15.123:0/216704277 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8011d20 con 0x7f91b40cefe0 2024-09-13T17:08:02.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b8bbc700 1 -- 172.21.15.123:0/216704277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91b40cefe0 msgr2=0x7f91b40b2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:01.996+0000 7f91b8bbc700 1 --2- 172.21.15.123:0/216704277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91b40cefe0 0x7f91b40b2740 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009850 tx=0x7f91a8009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:02.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 -- 172.21.15.123:0/216704277 shutdown_connections 2024-09-13T17:08:02.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 --2- 172.21.15.123:0/216704277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91b40cefe0 0x7f91b40b2740 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 -- 172.21.15.123:0/216704277 >> 172.21.15.123:0/216704277 conn(0x7f91b40735c0 msgr2=0x7f91b4066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:02.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 -- 172.21.15.123:0/216704277 shutdown_connections 2024-09-13T17:08:02.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 -- 172.21.15.123:0/216704277 wait complete. 2024-09-13T17:08:02.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 Processor -- start 2024-09-13T17:08:02.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 -- start start 2024-09-13T17:08:02.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91b406f280 0x7f91b414e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91b40cefe0 0x7f91b40c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b415a980 0x7f91b4153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b414fa00 con 0x7f91b406f280 2024-09-13T17:08:02.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40c9760 con 0x7f91b415a980 2024-09-13T17:08:02.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b414f080 con 0x7f91b40cefe0 2024-09-13T17:08:02.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91b406f280 0x7f91b414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91b406f280 0x7f91b414e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56222/0 (socket says 172.21.15.123:56222) 2024-09-13T17:08:02.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b37fe700 1 -- 172.21.15.123:0/1991054513 learned_addr learned my addr 172.21.15.123:0/1991054513 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:02.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b2ffd700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91b40cefe0 0x7f91b40c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b3fff700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b415a980 0x7f91b4153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b37fe700 1 -- 172.21.15.123:0/1991054513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91b40cefe0 msgr2=0x7f91b40c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b37fe700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91b40cefe0 0x7f91b40c9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b37fe700 1 -- 172.21.15.123:0/1991054513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b415a980 msgr2=0x7f91b4153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b37fe700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b415a980 0x7f91b4153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b37fe700 1 -- 172.21.15.123:0/1991054513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a80094b0 con 0x7f91b406f280 2024-09-13T17:08:02.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b2ffd700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91b40cefe0 0x7f91b40c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:02.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b37fe700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91b406f280 0x7f91b414e570 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f91a400c500 tx=0x7f91a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:02.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f919bfff700 1 -- 172.21.15.123:0/1991054513 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40052d0 con 0x7f91b406f280 2024-09-13T17:08:02.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f919bfff700 1 -- 172.21.15.123:0/1991054513 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a4005430 con 0x7f91b406f280 2024-09-13T17:08:02.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 -- 172.21.15.123:0/1991054513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b414f340 con 0x7f91b406f280 2024-09-13T17:08:02.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f919bfff700 1 -- 172.21.15.123:0/1991054513 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40055a0 con 0x7f91b406f280 2024-09-13T17:08:02.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.000+0000 7f91b8bbc700 1 -- 172.21.15.123:0/1991054513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b4154370 con 0x7f91b406f280 2024-09-13T17:08:02.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.004+0000 7f91b8bbc700 1 -- 172.21.15.123:0/1991054513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b40b2740 con 0x7f91b406f280 2024-09-13T17:08:02.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.004+0000 7f919bfff700 1 -- 172.21.15.123:0/1991054513 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f91a40038e0 con 0x7f91b406f280 2024-09-13T17:08:02.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.004+0000 7f919bfff700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91a0066730 0x7f91a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.004+0000 7f919bfff700 1 -- 172.21.15.123:0/1991054513 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91a40835e0 con 0x7f91b406f280 2024-09-13T17:08:02.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.004+0000 7f91b2ffd700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91a0066730 0x7f91a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.008+0000 7f91b2ffd700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91a0066730 0x7f91a0068bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91a80090b0 tx=0x7f91a8008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:02.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.012+0000 7f919bfff700 1 -- 172.21.15.123:0/1991054513 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f91a4050950 con 0x7f91b406f280 2024-09-13T17:08:02.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.184+0000 7f91b8bbc700 1 -- 172.21.15.123:0/1991054513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91b4153c10 con 0x7f91b406f280 2024-09-13T17:08:02.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.184+0000 7f919bfff700 1 -- 172.21.15.123:0/1991054513 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91a4053f70 con 0x7f91b406f280 2024-09-13T17:08:02.188 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:08:02.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.184+0000 7f91b8bbc700 1 -- 172.21.15.123:0/1991054513 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91a0066730 msgr2=0x7f91a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.184+0000 7f91b8bbc700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91a0066730 0x7f91a0068bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91a80090b0 tx=0x7f91a8008030 comp rx=0 tx=0).stop 2024-09-13T17:08:02.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.184+0000 7f91b8bbc700 1 -- 172.21.15.123:0/1991054513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91b406f280 msgr2=0x7f91b414e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.184+0000 7f91b8bbc700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91b406f280 0x7f91b414e570 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f91a400c500 tx=0x7f91a400c8c0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.188+0000 7f91b8bbc700 1 -- 172.21.15.123:0/1991054513 shutdown_connections 2024-09-13T17:08:02.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.188+0000 7f91b8bbc700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91a0066730 0x7f91a0068bf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.188+0000 7f91b8bbc700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b415a980 0x7f91b4153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.188+0000 7f91b8bbc700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91b40cefe0 0x7f91b40c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.188+0000 7f91b8bbc700 1 --2- 172.21.15.123:0/1991054513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91b406f280 0x7f91b414e570 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.188+0000 7f91b8bbc700 1 -- 172.21.15.123:0/1991054513 >> 172.21.15.123:0/1991054513 conn(0x7f91b40735c0 msgr2=0x7f91b4066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:02.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.188+0000 7f91b8bbc700 1 -- 172.21.15.123:0/1991054513 shutdown_connections 2024-09-13T17:08:02.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.188+0000 7f91b8bbc700 1 -- 172.21.15.123:0/1991054513 wait complete. 2024-09-13T17:08:02.203 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:08:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.312+0000 7f8b6df0b700 1 Processor -- start 2024-09-13T17:08:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.312+0000 7f8b6df0b700 1 -- start start 2024-09-13T17:08:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6df0b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8b680d0f40 0x7f8b680d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6df0b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b680b58b0 0x7f8b680d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6df0b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b680b0060 con 0x7f8b680b1100 2024-09-13T17:08:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6df0b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b680b0340 con 0x7f8b680d0f40 2024-09-13T17:08:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6df0b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b680b0620 con 0x7f8b680b58b0 2024-09-13T17:08:02.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6d70a700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8b680b1100 0x7f8b680b1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55414/0 (socket says 172.21.15.123:55414) 2024-09-13T17:08:02.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6d70a700 1 -- 172.21.15.123:0/3187465298 learned_addr learned my addr 172.21.15.123:0/3187465298 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:02.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b67fff700 1 --2- 172.21.15.123:0/3187465298 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b680b58b0 0x7f8b680d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6cf09700 1 --2- 172.21.15.123:0/3187465298 >> v2:172.21.15.153:3300/0 conn(0x7f8b680d0f40 0x7f8b680d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b677fe700 1 -- 172.21.15.123:0/3187465298 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704588288 0 0) 0x7f8b680b0060 con 0x7f8b680b1100 2024-09-13T17:08:02.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b677fe700 1 -- 172.21.15.123:0/3187465298 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b540035d0 con 0x7f8b680b1100 2024-09-13T17:08:02.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b67fff700 1 -- 172.21.15.123:0/3187465298 >> v2:172.21.15.153:3300/0 conn(0x7f8b680d0f40 msgr2=0x7f8b680d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:02.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b67fff700 1 --2- 172.21.15.123:0/3187465298 >> v2:172.21.15.153:3300/0 conn(0x7f8b680d0f40 0x7f8b680d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b67fff700 1 -- 172.21.15.123:0/3187465298 >> v1:172.21.15.123:6789/0 conn(0x7f8b680b1100 legacy=0x7f8b680b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b67fff700 1 -- 172.21.15.123:0/3187465298 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b680b0900 con 0x7f8b680b58b0 2024-09-13T17:08:02.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b67fff700 1 --2- 172.21.15.123:0/3187465298 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b680b58b0 0x7f8b680d05a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009850 tx=0x7f8b58009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2333e1ec399bb9a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:02.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b677fe700 1 -- 172.21.15.123:0/3187465298 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b58011830 con 0x7f8b680b58b0 2024-09-13T17:08:02.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b677fe700 1 -- 172.21.15.123:0/3187465298 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b58011990 con 0x7f8b680b58b0 2024-09-13T17:08:02.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b677fe700 1 -- 172.21.15.123:0/3187465298 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b58011d00 con 0x7f8b680b58b0 2024-09-13T17:08:02.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6df0b700 1 -- 172.21.15.123:0/3187465298 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b680b58b0 msgr2=0x7f8b680d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6df0b700 1 --2- 172.21.15.123:0/3187465298 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b680b58b0 0x7f8b680d05a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009850 tx=0x7f8b58009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:02.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6df0b700 1 -- 172.21.15.123:0/3187465298 shutdown_connections 2024-09-13T17:08:02.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6df0b700 1 --2- 172.21.15.123:0/3187465298 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b680b58b0 0x7f8b680d05a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6df0b700 1 --2- 172.21.15.123:0/3187465298 >> v2:172.21.15.153:3300/0 conn(0x7f8b680d0f40 0x7f8b680d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6df0b700 1 -- 172.21.15.123:0/3187465298 >> 172.21.15.123:0/3187465298 conn(0x7f8b680d2a60 msgr2=0x7f8b680d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:02.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6df0b700 1 -- 172.21.15.123:0/3187465298 shutdown_connections 2024-09-13T17:08:02.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.316+0000 7f8b6df0b700 1 -- 172.21.15.123:0/3187465298 wait complete. 2024-09-13T17:08:02.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.320+0000 7f8b6df0b700 1 Processor -- start 2024-09-13T17:08:02.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.320+0000 7f8b6df0b700 1 -- start start 2024-09-13T17:08:02.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.320+0000 7f8b6df0b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b680b1100 0x7f8b680b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.320+0000 7f8b6df0b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b680b58b0 0x7f8b680b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.320+0000 7f8b6df0b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b680d0f40 0x7f8b680b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.320+0000 7f8b6df0b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6815e650 con 0x7f8b680d0f40 2024-09-13T17:08:02.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.320+0000 7f8b6df0b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b681f2870 con 0x7f8b680b1100 2024-09-13T17:08:02.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.320+0000 7f8b6df0b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b680c7330 con 0x7f8b680b58b0 2024-09-13T17:08:02.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b6d70a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b680d0f40 0x7f8b680b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b6d70a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b680d0f40 0x7f8b680b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56224/0 (socket says 172.21.15.123:56224) 2024-09-13T17:08:02.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b6d70a700 1 -- 172.21.15.123:0/411329758 learned_addr learned my addr 172.21.15.123:0/411329758 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:02.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b6cf09700 1 --2- 172.21.15.123:0/411329758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b680b1100 0x7f8b680b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b67fff700 1 --2- 172.21.15.123:0/411329758 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b680b58b0 0x7f8b680b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b6d70a700 1 -- 172.21.15.123:0/411329758 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b680b58b0 msgr2=0x7f8b680b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b6d70a700 1 --2- 172.21.15.123:0/411329758 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b680b58b0 0x7f8b680b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b6d70a700 1 -- 172.21.15.123:0/411329758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b680b1100 msgr2=0x7f8b680b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b6d70a700 1 --2- 172.21.15.123:0/411329758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b680b1100 0x7f8b680b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b6d70a700 1 -- 172.21.15.123:0/411329758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b580094b0 con 0x7f8b680d0f40 2024-09-13T17:08:02.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b6d70a700 1 --2- 172.21.15.123:0/411329758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b680d0f40 0x7f8b680b2900 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000cad0 tx=0x7f8b6000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:02.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b657fa700 1 -- 172.21.15.123:0/411329758 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b60007480 con 0x7f8b680d0f40 2024-09-13T17:08:02.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b657fa700 1 -- 172.21.15.123:0/411329758 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b600075e0 con 0x7f8b680d0f40 2024-09-13T17:08:02.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b6df0b700 1 -- 172.21.15.123:0/411329758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6815c050 con 0x7f8b680d0f40 2024-09-13T17:08:02.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b657fa700 1 -- 172.21.15.123:0/411329758 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b60007970 con 0x7f8b680d0f40 2024-09-13T17:08:02.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b6df0b700 1 -- 172.21.15.123:0/411329758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b680c7050 con 0x7f8b680d0f40 2024-09-13T17:08:02.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b6df0b700 1 -- 172.21.15.123:0/411329758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6815e790 con 0x7f8b680d0f40 2024-09-13T17:08:02.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.324+0000 7f8b657fa700 1 -- 172.21.15.123:0/411329758 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8b6001b3b0 con 0x7f8b680d0f40 2024-09-13T17:08:02.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.328+0000 7f8b657fa700 1 --2- 172.21.15.123:0/411329758 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b48066730 0x7f8b48068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.328+0000 7f8b657fa700 1 -- 172.21.15.123:0/411329758 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b60083a40 con 0x7f8b680d0f40 2024-09-13T17:08:02.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.328+0000 7f8b6cf09700 1 --2- 172.21.15.123:0/411329758 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b48066730 0x7f8b48068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.328+0000 7f8b6cf09700 1 --2- 172.21.15.123:0/411329758 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b48066730 0x7f8b48068bf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009b50 tx=0x7f8b50009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:02.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.332+0000 7f8b657fa700 1 -- 172.21.15.123:0/411329758 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8b6815e790 con 0x7f8b680d0f40 2024-09-13T17:08:02.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.520+0000 7f8b6df0b700 1 -- 172.21.15.123:0/411329758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8b6815e790 con 0x7f8b680d0f40 2024-09-13T17:08:02.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.520+0000 7f8b657fa700 1 -- 172.21.15.123:0/411329758 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8b6815e790 con 0x7f8b680d0f40 2024-09-13T17:08:02.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.524+0000 7f8b6df0b700 1 -- 172.21.15.123:0/411329758 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b48066730 msgr2=0x7f8b48068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.524+0000 7f8b6df0b700 1 --2- 172.21.15.123:0/411329758 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b48066730 0x7f8b48068bf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009b50 tx=0x7f8b50009240 comp rx=0 tx=0).stop 2024-09-13T17:08:02.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.524+0000 7f8b6df0b700 1 -- 172.21.15.123:0/411329758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b680d0f40 msgr2=0x7f8b680b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.524+0000 7f8b6df0b700 1 --2- 172.21.15.123:0/411329758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b680d0f40 0x7f8b680b2900 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000cad0 tx=0x7f8b6000cb00 comp rx=0 tx=0).stop 2024-09-13T17:08:02.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.524+0000 7f8b6df0b700 1 -- 172.21.15.123:0/411329758 shutdown_connections 2024-09-13T17:08:02.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.524+0000 7f8b6df0b700 1 --2- 172.21.15.123:0/411329758 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b48066730 0x7f8b48068bf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.524+0000 7f8b6df0b700 1 --2- 172.21.15.123:0/411329758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b680d0f40 0x7f8b680b2900 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.524+0000 7f8b6df0b700 1 --2- 172.21.15.123:0/411329758 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b680b58b0 0x7f8b680b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.524+0000 7f8b6df0b700 1 --2- 172.21.15.123:0/411329758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b680b1100 0x7f8b680b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.524+0000 7f8b6df0b700 1 -- 172.21.15.123:0/411329758 >> 172.21.15.123:0/411329758 conn(0x7f8b680d2a60 msgr2=0x7f8b68070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:02.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.524+0000 7f8b6df0b700 1 -- 172.21.15.123:0/411329758 shutdown_connections 2024-09-13T17:08:02.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.524+0000 7f8b6df0b700 1 -- 172.21.15.123:0/411329758 wait complete. 2024-09-13T17:08:02.529 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:08:02.540 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2024-09-13T17:08:02.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:02.540 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:08:02.555 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[37558]: fuse finished with error 0 and tester_r 0 2024-09-13T17:08:02.557 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:08:02.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:02.557 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:08:02.691 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:08:02.691 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:02.700 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.812+0000 7f20ad9fb700 1 Processor -- start 2024-09-13T17:08:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.812+0000 7f20ad9fb700 1 -- start start 2024-09-13T17:08:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad9fb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20a80b1ac0 0x7f20a80b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad9fb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f20a80ce4a0 0x7f20a80ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad9fb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a80b2460 con 0x7f20a8160210 2024-09-13T17:08:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad9fb700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a806cfb0 con 0x7f20a80ce4a0 2024-09-13T17:08:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad9fb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a806d290 con 0x7f20a80b1ac0 2024-09-13T17:08:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad1fa700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f20a80ce4a0 0x7f20a80ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad1fa700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f20a80ce4a0 0x7f20a80ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56226/0 (socket says 172.21.15.123:56226) 2024-09-13T17:08:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad1fa700 1 -- 172.21.15.123:0/2764581886 learned_addr learned my addr 172.21.15.123:0/2764581886 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:02.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20a7fff700 1 --2- 172.21.15.123:0/2764581886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20a80b1ac0 0x7f20a80b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad1fa700 1 -- 172.21.15.123:0/2764581886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20a80b1ac0 msgr2=0x7f20a80b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:02.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad1fa700 1 --2- 172.21.15.123:0/2764581886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20a80b1ac0 0x7f20a80b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad1fa700 1 -- 172.21.15.123:0/2764581886 >> v1:172.21.15.153:6789/0 conn(0x7f20a8160210 legacy=0x7f20a80ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad1fa700 1 -- 172.21.15.123:0/2764581886 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a806d570 con 0x7f20a80ce4a0 2024-09-13T17:08:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad1fa700 1 --2- 172.21.15.123:0/2764581886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a80ce4a0 0x7f20a80ce950 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009e50 tx=0x7f20a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9eb9b9bcebedcb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20a77fe700 1 -- 172.21.15.123:0/2764581886 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000e070 con 0x7f20a80ce4a0 2024-09-13T17:08:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20a77fe700 1 -- 172.21.15.123:0/2764581886 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a000b910 con 0x7f20a80ce4a0 2024-09-13T17:08:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20a77fe700 1 -- 172.21.15.123:0/2764581886 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000bcc0 con 0x7f20a80ce4a0 2024-09-13T17:08:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad9fb700 1 -- 172.21.15.123:0/2764581886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a80ce4a0 msgr2=0x7f20a80ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad9fb700 1 --2- 172.21.15.123:0/2764581886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a80ce4a0 0x7f20a80ce950 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009e50 tx=0x7f20a000b330 comp rx=0 tx=0).stop 2024-09-13T17:08:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad9fb700 1 -- 172.21.15.123:0/2764581886 shutdown_connections 2024-09-13T17:08:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad9fb700 1 --2- 172.21.15.123:0/2764581886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a80ce4a0 0x7f20a80ce950 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad9fb700 1 --2- 172.21.15.123:0/2764581886 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20a80b1ac0 0x7f20a80b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad9fb700 1 -- 172.21.15.123:0/2764581886 >> 172.21.15.123:0/2764581886 conn(0x7f20a8066570 msgr2=0x7f20a8066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad9fb700 1 -- 172.21.15.123:0/2764581886 shutdown_connections 2024-09-13T17:08:02.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.816+0000 7f20ad9fb700 1 -- 172.21.15.123:0/2764581886 wait complete. 2024-09-13T17:08:02.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.820+0000 7f20ad9fb700 1 Processor -- start 2024-09-13T17:08:02.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.820+0000 7f20ad9fb700 1 -- start start 2024-09-13T17:08:02.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad9fb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20a80b1ac0 0x7f20a8150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad9fb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20a80ce4a0 0x7f20a815bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad9fb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a8160210 0x7f20a80b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad9fb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a81597d0 con 0x7f20a8160210 2024-09-13T17:08:02.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad9fb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a81511a0 con 0x7f20a80ce4a0 2024-09-13T17:08:02.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad9fb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a815c1c0 con 0x7f20a80b1ac0 2024-09-13T17:08:02.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad1fa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a8160210 0x7f20a80b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad1fa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a8160210 0x7f20a80b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56236/0 (socket says 172.21.15.123:56236) 2024-09-13T17:08:02.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad1fa700 1 -- 172.21.15.123:0/321111936 learned_addr learned my addr 172.21.15.123:0/321111936 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:02.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20a7fff700 1 --2- 172.21.15.123:0/321111936 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20a80ce4a0 0x7f20a815bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad1fa700 1 -- 172.21.15.123:0/321111936 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20a80b1ac0 msgr2=0x7f20a8150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad1fa700 1 --2- 172.21.15.123:0/321111936 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20a80b1ac0 0x7f20a8150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad1fa700 1 -- 172.21.15.123:0/321111936 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20a80ce4a0 msgr2=0x7f20a815bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:02.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad1fa700 1 --2- 172.21.15.123:0/321111936 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20a80ce4a0 0x7f20a815bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:02.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad1fa700 1 -- 172.21.15.123:0/321111936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0009b30 con 0x7f20a8160210 2024-09-13T17:08:02.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad1fa700 1 --2- 172.21.15.123:0/321111936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a8160210 0x7f20a80b3bd0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f20a000b680 tx=0x7f20a0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:02.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20a57fa700 1 -- 172.21.15.123:0/321111936 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a0004990 con 0x7f20a8160210 2024-09-13T17:08:02.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20a57fa700 1 -- 172.21.15.123:0/321111936 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a00099b0 con 0x7f20a8160210 2024-09-13T17:08:02.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad9fb700 1 -- 172.21.15.123:0/321111936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a8158bc0 con 0x7f20a8160210 2024-09-13T17:08:02.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20a57fa700 1 -- 172.21.15.123:0/321111936 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a001c680 con 0x7f20a8160210 2024-09-13T17:08:02.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.824+0000 7f20ad9fb700 1 -- 172.21.15.123:0/321111936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a8159180 con 0x7f20a8160210 2024-09-13T17:08:02.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.828+0000 7f20a57fa700 1 -- 172.21.15.123:0/321111936 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f20a001c7e0 con 0x7f20a8160210 2024-09-13T17:08:02.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.828+0000 7f20ad9fb700 1 -- 172.21.15.123:0/321111936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a80677f0 con 0x7f20a8160210 2024-09-13T17:08:02.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.828+0000 7f20a57fa700 1 --2- 172.21.15.123:0/321111936 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f208c066730 0x7f208c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:02.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.828+0000 7f20a57fa700 1 -- 172.21.15.123:0/321111936 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20a0085d40 con 0x7f20a8160210 2024-09-13T17:08:02.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.828+0000 7f20ac9f9700 1 --2- 172.21.15.123:0/321111936 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f208c066730 0x7f208c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:02.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.828+0000 7f20ac9f9700 1 --2- 172.21.15.123:0/321111936 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f208c066730 0x7f208c068bf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f209c000f60 tx=0x7f209c007a60 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:02.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:02.832+0000 7f20a57fa700 1 -- 172.21.15.123:0/321111936 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f20a0053140 con 0x7f20a8160210 2024-09-13T17:08:03.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.004+0000 7f20ad9fb700 1 -- 172.21.15.123:0/321111936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20a8072a10 con 0x7f20a8160210 2024-09-13T17:08:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.008+0000 7f20a57fa700 1 -- 172.21.15.123:0/321111936 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f20a0056760 con 0x7f20a8160210 2024-09-13T17:08:03.012 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:03.012 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":34,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:07:47.800958+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:07:44.636174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T17:07:45.802714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:03.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.012+0000 7f20ad9fb700 1 -- 172.21.15.123:0/321111936 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f208c066730 msgr2=0x7f208c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.012+0000 7f20ad9fb700 1 --2- 172.21.15.123:0/321111936 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f208c066730 0x7f208c068bf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f209c000f60 tx=0x7f209c007a60 comp rx=0 tx=0).stop 2024-09-13T17:08:03.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.012+0000 7f20ad9fb700 1 -- 172.21.15.123:0/321111936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a8160210 msgr2=0x7f20a80b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.012+0000 7f20ad9fb700 1 --2- 172.21.15.123:0/321111936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a8160210 0x7f20a80b3bd0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f20a000b680 tx=0x7f20a0004af0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.012+0000 7f20ad9fb700 1 -- 172.21.15.123:0/321111936 shutdown_connections 2024-09-13T17:08:03.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.012+0000 7f20ad9fb700 1 --2- 172.21.15.123:0/321111936 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f208c066730 0x7f208c068bf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.012+0000 7f20ad9fb700 1 --2- 172.21.15.123:0/321111936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a8160210 0x7f20a80b3bd0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.012+0000 7f20ad9fb700 1 --2- 172.21.15.123:0/321111936 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20a80ce4a0 0x7f20a815bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.012+0000 7f20ad9fb700 1 --2- 172.21.15.123:0/321111936 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20a80b1ac0 0x7f20a8150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.012+0000 7f20ad9fb700 1 -- 172.21.15.123:0/321111936 >> 172.21.15.123:0/321111936 conn(0x7f20a8066570 msgr2=0x7f20a80cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:03.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.012+0000 7f20ad9fb700 1 -- 172.21.15.123:0/321111936 shutdown_connections 2024-09-13T17:08:03.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.012+0000 7f20ad9fb700 1 -- 172.21.15.123:0/321111936 wait complete. 2024-09-13T17:08:03.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:07:44.636174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:07:45.802714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:08:03.028 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:08:03.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.136+0000 7f21d3fff700 1 Processor -- start 2024-09-13T17:08:03.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d3fff700 1 -- start start 2024-09-13T17:08:03.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21d41592e0 0x7f21d415d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d3fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d40cd2e0 con 0x7f21d406dc90 2024-09-13T17:08:03.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d3fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d40cd5c0 con 0x7f21d41596c0 2024-09-13T17:08:03.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d3fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d40cd8a0 con 0x7f21d41592e0 2024-09-13T17:08:03.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d2ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21d41592e0 0x7f21d415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d37fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f21d406dc90 0x7f21d4070e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55420/0 (socket says 172.21.15.123:55420) 2024-09-13T17:08:03.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d37fe700 1 -- 172.21.15.123:0/873590557 learned_addr learned my addr 172.21.15.123:0/873590557 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:03.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d2ffd700 1 -- 172.21.15.123:0/873590557 >> v1:172.21.15.153:6789/0 conn(0x7f21d41596c0 legacy=0x7f21d415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d2ffd700 1 -- 172.21.15.123:0/873590557 >> v1:172.21.15.123:6789/0 conn(0x7f21d406dc90 legacy=0x7f21d4070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d2ffd700 1 -- 172.21.15.123:0/873590557 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d40cdb80 con 0x7f21d41592e0 2024-09-13T17:08:03.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d1ffb700 1 -- 172.21.15.123:0/873590557 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050434372 0 0) 0x7f21d40cd2e0 con 0x7f21d406dc90 2024-09-13T17:08:03.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d2ffd700 1 --2- 172.21.15.123:0/873590557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d41592e0 0x7f21d415d030 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009850 tx=0x7f21c4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45f6201d2bbceba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:03.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d1ffb700 1 -- 172.21.15.123:0/873590557 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4011830 con 0x7f21d41592e0 2024-09-13T17:08:03.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d1ffb700 1 -- 172.21.15.123:0/873590557 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c4011990 con 0x7f21d41592e0 2024-09-13T17:08:03.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.140+0000 7f21d1ffb700 1 -- 172.21.15.123:0/873590557 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4011d20 con 0x7f21d41592e0 2024-09-13T17:08:03.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 -- 172.21.15.123:0/873590557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d41592e0 msgr2=0x7f21d415d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 --2- 172.21.15.123:0/873590557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d41592e0 0x7f21d415d030 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009850 tx=0x7f21c4009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:03.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 -- 172.21.15.123:0/873590557 shutdown_connections 2024-09-13T17:08:03.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 --2- 172.21.15.123:0/873590557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d41592e0 0x7f21d415d030 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 -- 172.21.15.123:0/873590557 >> 172.21.15.123:0/873590557 conn(0x7f21d40b01d0 msgr2=0x7f21d40b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:03.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 -- 172.21.15.123:0/873590557 shutdown_connections 2024-09-13T17:08:03.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 -- 172.21.15.123:0/873590557 wait complete. 2024-09-13T17:08:03.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 Processor -- start 2024-09-13T17:08:03.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 -- start start 2024-09-13T17:08:03.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d406dc90 0x7f21d4149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d41596c0 0x7f21d40c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d40c60f0 0x7f21d41f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40c65a0 con 0x7f21d406dc90 2024-09-13T17:08:03.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d414c160 con 0x7f21d40c60f0 2024-09-13T17:08:03.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.144+0000 7f21d3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d414c370 con 0x7f21d41596c0 2024-09-13T17:08:03.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d406dc90 0x7f21d4149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d27fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d41596c0 0x7f21d40c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d27fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d41596c0 0x7f21d40c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:49652/0 (socket says 172.21.15.123:49652) 2024-09-13T17:08:03.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d27fc700 1 -- 172.21.15.123:0/1048134460 learned_addr learned my addr 172.21.15.123:0/1048134460 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:03.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d37fe700 1 --2- 172.21.15.123:0/1048134460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d40c60f0 0x7f21d41f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d27fc700 1 -- 172.21.15.123:0/1048134460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d40c60f0 msgr2=0x7f21d41f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d27fc700 1 --2- 172.21.15.123:0/1048134460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d40c60f0 0x7f21d41f4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d27fc700 1 -- 172.21.15.123:0/1048134460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d406dc90 msgr2=0x7f21d4149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d27fc700 1 --2- 172.21.15.123:0/1048134460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d406dc90 0x7f21d4149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d27fc700 1 -- 172.21.15.123:0/1048134460 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c40094b0 con 0x7f21d41596c0 2024-09-13T17:08:03.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d2ffd700 1 --2- 172.21.15.123:0/1048134460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d406dc90 0x7f21d4149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:03.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d27fc700 1 --2- 172.21.15.123:0/1048134460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d41596c0 0x7f21d40c5bb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c500 tx=0x7f21c800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:03.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21bbfff700 1 -- 172.21.15.123:0/1048134460 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80052d0 con 0x7f21d41596c0 2024-09-13T17:08:03.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21bbfff700 1 -- 172.21.15.123:0/1048134460 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c8005430 con 0x7f21d41596c0 2024-09-13T17:08:03.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d3fff700 1 -- 172.21.15.123:0/1048134460 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d414c650 con 0x7f21d41596c0 2024-09-13T17:08:03.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21bbfff700 1 -- 172.21.15.123:0/1048134460 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80055a0 con 0x7f21d41596c0 2024-09-13T17:08:03.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d3fff700 1 -- 172.21.15.123:0/1048134460 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d414cc10 con 0x7f21d41596c0 2024-09-13T17:08:03.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.148+0000 7f21d3fff700 1 -- 172.21.15.123:0/1048134460 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d415d030 con 0x7f21d41596c0 2024-09-13T17:08:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.152+0000 7f21bbfff700 1 -- 172.21.15.123:0/1048134460 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f21c80038e0 con 0x7f21d41596c0 2024-09-13T17:08:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.152+0000 7f21bbfff700 1 --2- 172.21.15.123:0/1048134460 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f21c0066730 0x7f21c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.152+0000 7f21bbfff700 1 -- 172.21.15.123:0/1048134460 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21c8083530 con 0x7f21d41596c0 2024-09-13T17:08:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.152+0000 7f21d2ffd700 1 --2- 172.21.15.123:0/1048134460 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f21c0066730 0x7f21c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.152+0000 7f21d2ffd700 1 --2- 172.21.15.123:0/1048134460 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f21c0066730 0x7f21c0068bf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f21d40cf720 tx=0x7f21c4008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:03.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.164+0000 7f21bbfff700 1 -- 172.21.15.123:0/1048134460 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f21c80508a0 con 0x7f21d41596c0 2024-09-13T17:08:03.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.332+0000 7f21d3fff700 1 -- 172.21.15.123:0/1048134460 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21d40b4600 con 0x7f21d41596c0 2024-09-13T17:08:03.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.332+0000 7f21bbfff700 1 -- 172.21.15.123:0/1048134460 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21c8053ec0 con 0x7f21d41596c0 2024-09-13T17:08:03.336 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:08:03.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.336+0000 7f21d3fff700 1 -- 172.21.15.123:0/1048134460 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f21c0066730 msgr2=0x7f21c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.336+0000 7f21d3fff700 1 --2- 172.21.15.123:0/1048134460 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f21c0066730 0x7f21c0068bf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f21d40cf720 tx=0x7f21c4008030 comp rx=0 tx=0).stop 2024-09-13T17:08:03.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.336+0000 7f21d3fff700 1 -- 172.21.15.123:0/1048134460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d41596c0 msgr2=0x7f21d40c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.336+0000 7f21d3fff700 1 --2- 172.21.15.123:0/1048134460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d41596c0 0x7f21d40c5bb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c500 tx=0x7f21c800c810 comp rx=0 tx=0).stop 2024-09-13T17:08:03.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.336+0000 7f21d3fff700 1 -- 172.21.15.123:0/1048134460 shutdown_connections 2024-09-13T17:08:03.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.336+0000 7f21d3fff700 1 --2- 172.21.15.123:0/1048134460 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f21c0066730 0x7f21c0068bf0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.336+0000 7f21d3fff700 1 --2- 172.21.15.123:0/1048134460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d40c60f0 0x7f21d41f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.336+0000 7f21d3fff700 1 --2- 172.21.15.123:0/1048134460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d41596c0 0x7f21d40c5bb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.336+0000 7f21d3fff700 1 --2- 172.21.15.123:0/1048134460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d406dc90 0x7f21d4149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.336+0000 7f21d3fff700 1 -- 172.21.15.123:0/1048134460 >> 172.21.15.123:0/1048134460 conn(0x7f21d40b01d0 msgr2=0x7f21d40b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:03.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.336+0000 7f21d3fff700 1 -- 172.21.15.123:0/1048134460 shutdown_connections 2024-09-13T17:08:03.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.336+0000 7f21d3fff700 1 -- 172.21.15.123:0/1048134460 wait complete. 2024-09-13T17:08:03.351 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:08:03.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53f1ba700 1 Processor -- start 2024-09-13T17:08:03.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53f1ba700 1 -- start start 2024-09-13T17:08:03.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53f1ba700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff53004fc90 0x7ff5300e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53f1ba700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5300e3820 0x7ff53001ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53f1ba700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5300df440 con 0x7ff530033c50 2024-09-13T17:08:03.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53f1ba700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5300062f0 con 0x7ff53004fc90 2024-09-13T17:08:03.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53f1ba700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5300065d0 con 0x7ff5300e3820 2024-09-13T17:08:03.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53e9b9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5300e3820 0x7ff53001ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53e9b9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5300e3820 0x7ff53001ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:49664/0 (socket says 172.21.15.123:49664) 2024-09-13T17:08:03.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53e9b9700 1 -- 172.21.15.123:0/2536860406 learned_addr learned my addr 172.21.15.123:0/2536860406 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:03.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53d9b7700 1 --2- 172.21.15.123:0/2536860406 >> v2:172.21.15.153:3300/0 conn(0x7ff53004fc90 0x7ff5300e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53e9b9700 1 -- 172.21.15.123:0/2536860406 >> v2:172.21.15.153:3300/0 conn(0x7ff53004fc90 msgr2=0x7ff5300e32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:03.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53e9b9700 1 --2- 172.21.15.123:0/2536860406 >> v2:172.21.15.153:3300/0 conn(0x7ff53004fc90 0x7ff5300e32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53e9b9700 1 -- 172.21.15.123:0/2536860406 >> v1:172.21.15.153:6789/0 conn(0x7ff530033c50 legacy=0x7ff530005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53e9b9700 1 -- 172.21.15.123:0/2536860406 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5300068b0 con 0x7ff5300e3820 2024-09-13T17:08:03.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53e9b9700 1 --2- 172.21.15.123:0/2536860406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5300e3820 0x7ff53001ce60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff538064010 tx=0x7ff538069900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=283e1a48e967a0ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:03.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53d1b6700 1 -- 172.21.15.123:0/2536860406 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5380675b0 con 0x7ff5300e3820 2024-09-13T17:08:03.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53d1b6700 1 -- 172.21.15.123:0/2536860406 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff538073f10 con 0x7ff5300e3820 2024-09-13T17:08:03.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53d1b6700 1 -- 172.21.15.123:0/2536860406 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538067710 con 0x7ff5300e3820 2024-09-13T17:08:03.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53f1ba700 1 -- 172.21.15.123:0/2536860406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5300e3820 msgr2=0x7ff53001ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53f1ba700 1 --2- 172.21.15.123:0/2536860406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5300e3820 0x7ff53001ce60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff538064010 tx=0x7ff538069900 comp rx=0 tx=0).stop 2024-09-13T17:08:03.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53f1ba700 1 -- 172.21.15.123:0/2536860406 shutdown_connections 2024-09-13T17:08:03.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53f1ba700 1 --2- 172.21.15.123:0/2536860406 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5300e3820 0x7ff53001ce60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53f1ba700 1 --2- 172.21.15.123:0/2536860406 >> v2:172.21.15.153:3300/0 conn(0x7ff53004fc90 0x7ff5300e32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53f1ba700 1 -- 172.21.15.123:0/2536860406 >> 172.21.15.123:0/2536860406 conn(0x7ff530036140 msgr2=0x7ff530036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:03.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.468+0000 7ff53f1ba700 1 -- 172.21.15.123:0/2536860406 shutdown_connections 2024-09-13T17:08:03.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.472+0000 7ff53f1ba700 1 -- 172.21.15.123:0/2536860406 wait complete. 2024-09-13T17:08:03.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.472+0000 7ff53f1ba700 1 Processor -- start 2024-09-13T17:08:03.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.472+0000 7ff53f1ba700 1 -- start start 2024-09-13T17:08:03.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.472+0000 7ff53f1ba700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff530033c50 0x7ff530021df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.472+0000 7ff53f1ba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff53004fc90 0x7ff53004afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.472+0000 7ff53f1ba700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5300dbda0 0x7ff5300d4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.472+0000 7ff53f1ba700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5300d5130 con 0x7ff53004fc90 2024-09-13T17:08:03.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.472+0000 7ff53f1ba700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53001ecd0 con 0x7ff530033c50 2024-09-13T17:08:03.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.472+0000 7ff53f1ba700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53001ef20 con 0x7ff5300dbda0 2024-09-13T17:08:03.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.472+0000 7ff53d9b7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff53004fc90 0x7ff53004afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.472+0000 7ff53d9b7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff53004fc90 0x7ff53004afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56274/0 (socket says 172.21.15.123:56274) 2024-09-13T17:08:03.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.472+0000 7ff53e9b9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5300dbda0 0x7ff5300d4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.472+0000 7ff53d9b7700 1 -- 172.21.15.123:0/322585435 learned_addr learned my addr 172.21.15.123:0/322585435 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:03.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.472+0000 7ff53e1b8700 1 --2- 172.21.15.123:0/322585435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff530033c50 0x7ff530021df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.476+0000 7ff53e9b9700 1 -- 172.21.15.123:0/322585435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff530033c50 msgr2=0x7ff530021df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.476+0000 7ff53e9b9700 1 --2- 172.21.15.123:0/322585435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff530033c50 0x7ff530021df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.476+0000 7ff53e9b9700 1 -- 172.21.15.123:0/322585435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff53004fc90 msgr2=0x7ff53004afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.476+0000 7ff53e9b9700 1 --2- 172.21.15.123:0/322585435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff53004fc90 0x7ff53004afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.476+0000 7ff53e9b9700 1 -- 172.21.15.123:0/322585435 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53804f5c0 con 0x7ff5300dbda0 2024-09-13T17:08:03.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.476+0000 7ff53e9b9700 1 --2- 172.21.15.123:0/322585435 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5300dbda0 0x7ff5300d4bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff5380797e0 tx=0x7ff538069dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:03.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.476+0000 7ff52effd700 1 -- 172.21.15.123:0/322585435 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538098070 con 0x7ff5300dbda0 2024-09-13T17:08:03.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.476+0000 7ff52effd700 1 -- 172.21.15.123:0/322585435 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5380720e0 con 0x7ff5300dbda0 2024-09-13T17:08:03.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.476+0000 7ff52effd700 1 -- 172.21.15.123:0/322585435 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538072470 con 0x7ff5300dbda0 2024-09-13T17:08:03.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.476+0000 7ff53f1ba700 1 -- 172.21.15.123:0/322585435 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53001f200 con 0x7ff5300dbda0 2024-09-13T17:08:03.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.476+0000 7ff53f1ba700 1 -- 172.21.15.123:0/322585435 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5300218d0 con 0x7ff5300dbda0 2024-09-13T17:08:03.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.476+0000 7ff53f1ba700 1 -- 172.21.15.123:0/322585435 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5300e32e0 con 0x7ff5300dbda0 2024-09-13T17:08:03.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.480+0000 7ff52effd700 1 -- 172.21.15.123:0/322585435 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff53806d040 con 0x7ff5300dbda0 2024-09-13T17:08:03.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.480+0000 7ff52effd700 1 --2- 172.21.15.123:0/322585435 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff51c066730 0x7ff51c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.480+0000 7ff52effd700 1 -- 172.21.15.123:0/322585435 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5380ff400 con 0x7ff5300dbda0 2024-09-13T17:08:03.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.480+0000 7ff53e1b8700 1 --2- 172.21.15.123:0/322585435 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff51c066730 0x7ff51c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.480+0000 7ff53e1b8700 1 --2- 172.21.15.123:0/322585435 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff51c066730 0x7ff51c068bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff534000fb0 tx=0x7ff534009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:03.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.488+0000 7ff52effd700 1 -- 172.21.15.123:0/322585435 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5380cca00 con 0x7ff5300dbda0 2024-09-13T17:08:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.660+0000 7ff53f1ba700 1 -- 172.21.15.123:0/322585435 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5300dd050 con 0x7ff5300dbda0 2024-09-13T17:08:03.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.660+0000 7ff52effd700 1 -- 172.21.15.123:0/322585435 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5380d0020 con 0x7ff5300dbda0 2024-09-13T17:08:03.664 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:08:03.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.664+0000 7ff53f1ba700 1 -- 172.21.15.123:0/322585435 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff51c066730 msgr2=0x7ff51c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.664+0000 7ff53f1ba700 1 --2- 172.21.15.123:0/322585435 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff51c066730 0x7ff51c068bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff534000fb0 tx=0x7ff534009040 comp rx=0 tx=0).stop 2024-09-13T17:08:03.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.664+0000 7ff53f1ba700 1 -- 172.21.15.123:0/322585435 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5300dbda0 msgr2=0x7ff5300d4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.664+0000 7ff53f1ba700 1 --2- 172.21.15.123:0/322585435 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5300dbda0 0x7ff5300d4bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff5380797e0 tx=0x7ff538069dc0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.664+0000 7ff53f1ba700 1 -- 172.21.15.123:0/322585435 shutdown_connections 2024-09-13T17:08:03.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.664+0000 7ff53f1ba700 1 --2- 172.21.15.123:0/322585435 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff51c066730 0x7ff51c068bf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.664+0000 7ff53f1ba700 1 --2- 172.21.15.123:0/322585435 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5300dbda0 0x7ff5300d4bf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.664+0000 7ff53f1ba700 1 --2- 172.21.15.123:0/322585435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff53004fc90 0x7ff53004afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.664+0000 7ff53f1ba700 1 --2- 172.21.15.123:0/322585435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff530033c50 0x7ff530021df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.664+0000 7ff53f1ba700 1 -- 172.21.15.123:0/322585435 >> 172.21.15.123:0/322585435 conn(0x7ff530036140 msgr2=0x7ff5300dc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:03.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.664+0000 7ff53f1ba700 1 -- 172.21.15.123:0/322585435 shutdown_connections 2024-09-13T17:08:03.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.664+0000 7ff53f1ba700 1 -- 172.21.15.123:0/322585435 wait complete. 2024-09-13T17:08:03.679 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:08:03.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.788+0000 7fe44759e700 1 Processor -- start 2024-09-13T17:08:03.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.788+0000 7fe44759e700 1 -- start start 2024-09-13T17:08:03.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.788+0000 7fe44759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe4481506b0 0x7fe4480b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.788+0000 7fe44759e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe4480b37a0 0x7fe4480b4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.788+0000 7fe44759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44815e040 con 0x7fe44815d4c0 2024-09-13T17:08:03.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.788+0000 7fe44759e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4480b3310 con 0x7fe4480b37a0 2024-09-13T17:08:03.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.788+0000 7fe44759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44815e280 con 0x7fe4481506b0 2024-09-13T17:08:03.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe445d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe4480b37a0 0x7fe4480b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe445d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe4480b37a0 0x7fe4480b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56286/0 (socket says 172.21.15.123:56286) 2024-09-13T17:08:03.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe445d9b700 1 -- 172.21.15.123:0/3443975516 learned_addr learned my addr 172.21.15.123:0/3443975516 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:03.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe44659c700 1 --2- 172.21.15.123:0/3443975516 >> v2:172.21.15.153:3300/0 conn(0x7fe4481506b0 0x7fe4480b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe445d9b700 1 -- 172.21.15.123:0/3443975516 >> v2:172.21.15.153:3300/0 conn(0x7fe4481506b0 msgr2=0x7fe4480b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:03.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe445d9b700 1 --2- 172.21.15.123:0/3443975516 >> v2:172.21.15.153:3300/0 conn(0x7fe4481506b0 0x7fe4480b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe445d9b700 1 -- 172.21.15.123:0/3443975516 >> v1:172.21.15.153:6789/0 conn(0x7fe44815d4c0 legacy=0x7fe44815d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe445d9b700 1 -- 172.21.15.123:0/3443975516 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4480b29e0 con 0x7fe4480b37a0 2024-09-13T17:08:03.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe445d9b700 1 --2- 172.21.15.123:0/3443975516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4480b37a0 0x7fe4480b4990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe4480b4f80 tx=0x7fe43c00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f678b671044a449 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:03.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe44559a700 1 -- 172.21.15.123:0/3443975516 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c00dd90 con 0x7fe4480b37a0 2024-09-13T17:08:03.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe44559a700 1 -- 172.21.15.123:0/3443975516 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c010470 con 0x7fe4480b37a0 2024-09-13T17:08:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe44559a700 1 -- 172.21.15.123:0/3443975516 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c010800 con 0x7fe4480b37a0 2024-09-13T17:08:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe44759e700 1 -- 172.21.15.123:0/3443975516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4480b37a0 msgr2=0x7fe4480b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe44759e700 1 --2- 172.21.15.123:0/3443975516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4480b37a0 0x7fe4480b4990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe4480b4f80 tx=0x7fe43c00be90 comp rx=0 tx=0).stop 2024-09-13T17:08:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe44759e700 1 -- 172.21.15.123:0/3443975516 shutdown_connections 2024-09-13T17:08:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe44759e700 1 --2- 172.21.15.123:0/3443975516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4480b37a0 0x7fe4480b4990 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe44759e700 1 --2- 172.21.15.123:0/3443975516 >> v2:172.21.15.153:3300/0 conn(0x7fe4481506b0 0x7fe4480b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe44759e700 1 -- 172.21.15.123:0/3443975516 >> 172.21.15.123:0/3443975516 conn(0x7fe448066780 msgr2=0x7fe4480719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe44759e700 1 -- 172.21.15.123:0/3443975516 shutdown_connections 2024-09-13T17:08:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.792+0000 7fe44759e700 1 -- 172.21.15.123:0/3443975516 wait complete. 2024-09-13T17:08:03.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.796+0000 7fe44759e700 1 Processor -- start 2024-09-13T17:08:03.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.796+0000 7fe44759e700 1 -- start start 2024-09-13T17:08:03.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.796+0000 7fe44759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4480b37a0 0x7fe4481401f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.796+0000 7fe44759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4481506b0 0x7fe44814ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.796+0000 7fe44759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe44815d4c0 0x7fe44815b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.796+0000 7fe44759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4481522d0 con 0x7fe4481506b0 2024-09-13T17:08:03.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.796+0000 7fe44759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe448147530 con 0x7fe4480b37a0 2024-09-13T17:08:03.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.796+0000 7fe44759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe448151f10 con 0x7fe44815d4c0 2024-09-13T17:08:03.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.796+0000 7fe445d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4481506b0 0x7fe44814ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe445d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4481506b0 0x7fe44814ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56294/0 (socket says 172.21.15.123:56294) 2024-09-13T17:08:03.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe445d9b700 1 -- 172.21.15.123:0/4053966312 learned_addr learned my addr 172.21.15.123:0/4053966312 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:03.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe44659c700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4480b37a0 0x7fe4481401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe446d9d700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe44815d4c0 0x7fe44815b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe445d9b700 1 -- 172.21.15.123:0/4053966312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe44815d4c0 msgr2=0x7fe44815b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe445d9b700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe44815d4c0 0x7fe44815b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe445d9b700 1 -- 172.21.15.123:0/4053966312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4480b37a0 msgr2=0x7fe4481401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe445d9b700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4480b37a0 0x7fe4481401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe445d9b700 1 -- 172.21.15.123:0/4053966312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c00b810 con 0x7fe4481506b0 2024-09-13T17:08:03.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe446d9d700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe44815d4c0 0x7fe44815b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:03.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe445d9b700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4481506b0 0x7fe44814ce80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe43c000c00 tx=0x7fe43c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:03.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe436ffd700 1 -- 172.21.15.123:0/4053966312 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c003c10 con 0x7fe4481506b0 2024-09-13T17:08:03.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe436ffd700 1 -- 172.21.15.123:0/4053966312 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c003d70 con 0x7fe4481506b0 2024-09-13T17:08:03.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe436ffd700 1 -- 172.21.15.123:0/4053966312 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c010820 con 0x7fe4481506b0 2024-09-13T17:08:03.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe44759e700 1 -- 172.21.15.123:0/4053966312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44814f5f0 con 0x7fe4481506b0 2024-09-13T17:08:03.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe44759e700 1 -- 172.21.15.123:0/4053966312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44814fbb0 con 0x7fe4481506b0 2024-09-13T17:08:03.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe44759e700 1 -- 172.21.15.123:0/4053966312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe448152410 con 0x7fe4481506b0 2024-09-13T17:08:03.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.800+0000 7fe436ffd700 1 -- 172.21.15.123:0/4053966312 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe43c02c430 con 0x7fe4481506b0 2024-09-13T17:08:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.804+0000 7fe436ffd700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe428066730 0x7fe428068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.804+0000 7fe44659c700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe428066730 0x7fe428068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.804+0000 7fe436ffd700 1 -- 172.21.15.123:0/4053966312 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe43c085aa0 con 0x7fe4481506b0 2024-09-13T17:08:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.804+0000 7fe44659c700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe428066730 0x7fe428068bf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe438007a60 tx=0x7fe438008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:03.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.812+0000 7fe436ffd700 1 -- 172.21.15.123:0/4053966312 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe448152410 con 0x7fe4481506b0 2024-09-13T17:08:03.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.976+0000 7fe44759e700 1 -- 172.21.15.123:0/4053966312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe448152410 con 0x7fe4481506b0 2024-09-13T17:08:03.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.976+0000 7fe436ffd700 1 -- 172.21.15.123:0/4053966312 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe448152410 con 0x7fe4481506b0 2024-09-13T17:08:03.981 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:08:03.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.980+0000 7fe44759e700 1 -- 172.21.15.123:0/4053966312 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe428066730 msgr2=0x7fe428068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.980+0000 7fe44759e700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe428066730 0x7fe428068bf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe438007a60 tx=0x7fe438008040 comp rx=0 tx=0).stop 2024-09-13T17:08:03.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.980+0000 7fe44759e700 1 -- 172.21.15.123:0/4053966312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4481506b0 msgr2=0x7fe44814ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:03.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.980+0000 7fe44759e700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4481506b0 0x7fe44814ce80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe43c000c00 tx=0x7fe43c004770 comp rx=0 tx=0).stop 2024-09-13T17:08:03.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.980+0000 7fe44759e700 1 -- 172.21.15.123:0/4053966312 shutdown_connections 2024-09-13T17:08:03.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.980+0000 7fe44759e700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe428066730 0x7fe428068bf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.980+0000 7fe44759e700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe44815d4c0 0x7fe44815b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.980+0000 7fe44759e700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4481506b0 0x7fe44814ce80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.980+0000 7fe44759e700 1 --2- 172.21.15.123:0/4053966312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4480b37a0 0x7fe4481401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:03.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.980+0000 7fe44759e700 1 -- 172.21.15.123:0/4053966312 >> 172.21.15.123:0/4053966312 conn(0x7fe448066780 msgr2=0x7fe4480cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:03.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.980+0000 7fe44759e700 1 -- 172.21.15.123:0/4053966312 shutdown_connections 2024-09-13T17:08:03.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:03.980+0000 7fe44759e700 1 -- 172.21.15.123:0/4053966312 wait complete. 2024-09-13T17:08:04.001 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:08:04.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.108+0000 7f6fdb59e700 1 Processor -- start 2024-09-13T17:08:04.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.108+0000 7f6fdb59e700 1 -- start start 2024-09-13T17:08:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdb59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6fdc159550 0x7f6fdc0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdb59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fdc0c9610 0x7f6fdc0cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdb59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fdc06dc20 con 0x7f6fdc0710b0 2024-09-13T17:08:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdb59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc06c5a0 con 0x7f6fdc0c9610 2024-09-13T17:08:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdb59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc071620 con 0x7f6fdc159550 2024-09-13T17:08:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fdc0c9610 0x7f6fdc0cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fdc0c9610 0x7f6fdc0cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56298/0 (socket says 172.21.15.123:56298) 2024-09-13T17:08:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdad9d700 1 -- 172.21.15.123:0/313922895 learned_addr learned my addr 172.21.15.123:0/313922895 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fda59c700 1 --2- 172.21.15.123:0/313922895 >> v2:172.21.15.153:3300/0 conn(0x7f6fdc159550 0x7f6fdc0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdad9d700 1 -- 172.21.15.123:0/313922895 >> v2:172.21.15.153:3300/0 conn(0x7f6fdc159550 msgr2=0x7f6fdc0cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdad9d700 1 --2- 172.21.15.123:0/313922895 >> v2:172.21.15.153:3300/0 conn(0x7f6fdc159550 0x7f6fdc0cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdad9d700 1 -- 172.21.15.123:0/313922895 >> v1:172.21.15.123:6789/0 conn(0x7f6fdc0710b0 legacy=0x7f6fdc0c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdad9d700 1 -- 172.21.15.123:0/313922895 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc0cc0a0 con 0x7f6fdc0c9610 2024-09-13T17:08:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdad9d700 1 --2- 172.21.15.123:0/313922895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fdc0c9610 0x7f6fdc0cbb60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc06ff50 tx=0x7f6fd400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0adb9a4d839890e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fd959a700 1 -- 172.21.15.123:0/313922895 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4010070 con 0x7f6fdc0c9610 2024-09-13T17:08:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fd959a700 1 -- 172.21.15.123:0/313922895 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd400dd90 con 0x7f6fdc0c9610 2024-09-13T17:08:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fd959a700 1 -- 172.21.15.123:0/313922895 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd400b310 con 0x7f6fdc0c9610 2024-09-13T17:08:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdb59e700 1 -- 172.21.15.123:0/313922895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fdc0c9610 msgr2=0x7f6fdc0cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:04.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdb59e700 1 --2- 172.21.15.123:0/313922895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fdc0c9610 0x7f6fdc0cbb60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc06ff50 tx=0x7f6fd400d430 comp rx=0 tx=0).stop 2024-09-13T17:08:04.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdb59e700 1 -- 172.21.15.123:0/313922895 shutdown_connections 2024-09-13T17:08:04.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdb59e700 1 --2- 172.21.15.123:0/313922895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fdc0c9610 0x7f6fdc0cbb60 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdb59e700 1 --2- 172.21.15.123:0/313922895 >> v2:172.21.15.153:3300/0 conn(0x7f6fdc159550 0x7f6fdc0cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdb59e700 1 -- 172.21.15.123:0/313922895 >> 172.21.15.123:0/313922895 conn(0x7f6fdc0b01d0 msgr2=0x7f6fdc0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:04.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdb59e700 1 -- 172.21.15.123:0/313922895 shutdown_connections 2024-09-13T17:08:04.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.112+0000 7f6fdb59e700 1 -- 172.21.15.123:0/313922895 wait complete. 2024-09-13T17:08:04.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fdb59e700 1 Processor -- start 2024-09-13T17:08:04.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fdb59e700 1 -- start start 2024-09-13T17:08:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fdb59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fdc0710b0 0x7f6fdc1e1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fdb59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fdc0c9610 0x7f6fdc1ede50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fdb59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fdc159550 0x7f6fdc0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fdb59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc144e20 con 0x7f6fdc0710b0 2024-09-13T17:08:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fdb59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc0c8200 con 0x7f6fdc0c9610 2024-09-13T17:08:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fdb59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc1447a0 con 0x7f6fdc159550 2024-09-13T17:08:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fda59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fdc0710b0 0x7f6fdc1e1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fda59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fdc0710b0 0x7f6fdc1e1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56314/0 (socket says 172.21.15.123:56314) 2024-09-13T17:08:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fda59c700 1 -- 172.21.15.123:0/1427688725 learned_addr learned my addr 172.21.15.123:0/1427688725 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fd9d9b700 1 --2- 172.21.15.123:0/1427688725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fdc0c9610 0x7f6fdc1ede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fdad9d700 1 --2- 172.21.15.123:0/1427688725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fdc159550 0x7f6fdc0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:04.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fda59c700 1 -- 172.21.15.123:0/1427688725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fdc159550 msgr2=0x7f6fdc0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:04.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fda59c700 1 --2- 172.21.15.123:0/1427688725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fdc159550 0x7f6fdc0b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fda59c700 1 -- 172.21.15.123:0/1427688725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fdc0c9610 msgr2=0x7f6fdc1ede50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:04.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fda59c700 1 --2- 172.21.15.123:0/1427688725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fdc0c9610 0x7f6fdc1ede50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fda59c700 1 -- 172.21.15.123:0/1427688725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd400bd40 con 0x7f6fdc0710b0 2024-09-13T17:08:04.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fda59c700 1 --2- 172.21.15.123:0/1427688725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fdc0710b0 0x7f6fdc1e1e20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400d800 tx=0x7f6fc400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fd2ffd700 1 -- 172.21.15.123:0/1427688725 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40125f0 con 0x7f6fdc0710b0 2024-09-13T17:08:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fd2ffd700 1 -- 172.21.15.123:0/1427688725 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc4012750 con 0x7f6fdc0710b0 2024-09-13T17:08:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fdb59e700 1 -- 172.21.15.123:0/1427688725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fdc0c8430 con 0x7f6fdc0710b0 2024-09-13T17:08:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fd2ffd700 1 -- 172.21.15.123:0/1427688725 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4012ac0 con 0x7f6fdc0710b0 2024-09-13T17:08:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.116+0000 7f6fdb59e700 1 -- 172.21.15.123:0/1427688725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fdc0c8710 con 0x7f6fdc0710b0 2024-09-13T17:08:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.120+0000 7f6fdb59e700 1 -- 172.21.15.123:0/1427688725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fdc0c8d50 con 0x7f6fdc0710b0 2024-09-13T17:08:04.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.120+0000 7f6fd2ffd700 1 -- 172.21.15.123:0/1427688725 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6fc4012c20 con 0x7f6fdc0710b0 2024-09-13T17:08:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.120+0000 7f6fd2ffd700 1 --2- 172.21.15.123:0/1427688725 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6fbc066730 0x7f6fbc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.120+0000 7f6fd2ffd700 1 -- 172.21.15.123:0/1427688725 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fc4084120 con 0x7f6fdc0710b0 2024-09-13T17:08:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.120+0000 7f6fd9d9b700 1 --2- 172.21.15.123:0/1427688725 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6fbc066730 0x7f6fbc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:04.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.124+0000 7f6fd9d9b700 1 --2- 172.21.15.123:0/1427688725 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6fbc066730 0x7f6fbc068bf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc1577b0 tx=0x7f6fcc009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:04.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.128+0000 7f6fd2ffd700 1 -- 172.21.15.123:0/1427688725 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6fc4051490 con 0x7f6fdc0710b0 2024-09-13T17:08:04.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.308+0000 7f6fdb59e700 1 -- 172.21.15.123:0/1427688725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6fdc0cbb60 con 0x7f6fdc0710b0 2024-09-13T17:08:04.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.308+0000 7f6fd2ffd700 1 -- 172.21.15.123:0/1427688725 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6fc4054ab0 con 0x7f6fdc0710b0 2024-09-13T17:08:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.312+0000 7f6fdb59e700 1 -- 172.21.15.123:0/1427688725 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6fbc066730 msgr2=0x7f6fbc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.312+0000 7f6fdb59e700 1 --2- 172.21.15.123:0/1427688725 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6fbc066730 0x7f6fbc068bf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc1577b0 tx=0x7f6fcc009040 comp rx=0 tx=0).stop 2024-09-13T17:08:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.312+0000 7f6fdb59e700 1 -- 172.21.15.123:0/1427688725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fdc0710b0 msgr2=0x7f6fdc1e1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.312+0000 7f6fdb59e700 1 --2- 172.21.15.123:0/1427688725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fdc0710b0 0x7f6fdc1e1e20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400d800 tx=0x7f6fc400db10 comp rx=0 tx=0).stop 2024-09-13T17:08:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.312+0000 7f6fdb59e700 1 -- 172.21.15.123:0/1427688725 shutdown_connections 2024-09-13T17:08:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.312+0000 7f6fdb59e700 1 --2- 172.21.15.123:0/1427688725 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6fbc066730 0x7f6fbc068bf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.312+0000 7f6fdb59e700 1 --2- 172.21.15.123:0/1427688725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fdc159550 0x7f6fdc0b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.312+0000 7f6fdb59e700 1 --2- 172.21.15.123:0/1427688725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fdc0c9610 0x7f6fdc1ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.312+0000 7f6fdb59e700 1 --2- 172.21.15.123:0/1427688725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fdc0710b0 0x7f6fdc1e1e20 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.312+0000 7f6fdb59e700 1 -- 172.21.15.123:0/1427688725 >> 172.21.15.123:0/1427688725 conn(0x7f6fdc0b01d0 msgr2=0x7f6fdc0af710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.312+0000 7f6fdb59e700 1 -- 172.21.15.123:0/1427688725 shutdown_connections 2024-09-13T17:08:04.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.312+0000 7f6fdb59e700 1 -- 172.21.15.123:0/1427688725 wait complete. 2024-09-13T17:08:04.317 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:08:04.328 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-09-13T17:08:04.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:04.328 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:04.341 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[32881]: fuse finished with error 0 and tester_r 0 2024-09-13T17:08:04.344 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:08:04.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:04.344 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:08:04.481 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:08:04.482 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:04.490 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:08:04.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:08:04.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:04.491 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:08:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T17:08:04.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:04.498 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:08:04.498 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:04.506 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:08:04.506 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:08:04.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:04.507 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:08:04.553 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T17:08:04.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:04.555 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:08:04.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 Processor -- start 2024-09-13T17:08:04.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 -- start start 2024-09-13T17:08:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4434005b10 0x7f44340e18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f443401c740 0x7f443401cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44340e1e00 con 0x7f443400a5b0 2024-09-13T17:08:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4434006ce0 con 0x7f443401c740 2024-09-13T17:08:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44340060d0 con 0x7f4434005b10 2024-09-13T17:08:04.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f443bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f443401c740 0x7f443401cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:04.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f443bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f443401c740 0x7f443401cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:44932/0 (socket says 172.21.15.123:44932) 2024-09-13T17:08:04.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f443bfff700 1 -- 172.21.15.123:0/3953158210 learned_addr learned my addr 172.21.15.123:0/3953158210 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:04.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f443affd700 1 --2- 172.21.15.123:0/3953158210 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4434005b10 0x7f44340e18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:04.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f443bfff700 1 -- 172.21.15.123:0/3953158210 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4434005b10 msgr2=0x7f44340e18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:04.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f443bfff700 1 --2- 172.21.15.123:0/3953158210 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4434005b10 0x7f44340e18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f443bfff700 1 -- 172.21.15.123:0/3953158210 >> v1:172.21.15.153:6789/0 conn(0x7f443400a5b0 legacy=0x7f443400a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:04.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f443bfff700 1 -- 172.21.15.123:0/3953158210 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44340063b0 con 0x7f443401c740 2024-09-13T17:08:04.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f443bfff700 1 --2- 172.21.15.123:0/3953158210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f443401c740 0x7f443401cbf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f443c064010 tx=0x7f443c069900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=defebe31d0fa05ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:04.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f443a7fc700 1 -- 172.21.15.123:0/3953158210 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c0675b0 con 0x7f443401c740 2024-09-13T17:08:04.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f443a7fc700 1 -- 172.21.15.123:0/3953158210 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c073f10 con 0x7f443401c740 2024-09-13T17:08:04.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f443a7fc700 1 -- 172.21.15.123:0/3953158210 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c067710 con 0x7f443401c740 2024-09-13T17:08:04.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 -- 172.21.15.123:0/3953158210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f443401c740 msgr2=0x7f443401cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:04.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 --2- 172.21.15.123:0/3953158210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f443401c740 0x7f443401cbf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f443c064010 tx=0x7f443c069900 comp rx=0 tx=0).stop 2024-09-13T17:08:04.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 -- 172.21.15.123:0/3953158210 shutdown_connections 2024-09-13T17:08:04.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 --2- 172.21.15.123:0/3953158210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f443401c740 0x7f443401cbf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 --2- 172.21.15.123:0/3953158210 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4434005b10 0x7f44340e18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 -- 172.21.15.123:0/3953158210 >> 172.21.15.123:0/3953158210 conn(0x7f4434036140 msgr2=0x7f4434036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:04.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 -- 172.21.15.123:0/3953158210 shutdown_connections 2024-09-13T17:08:04.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.676+0000 7f4440d9f700 1 -- 172.21.15.123:0/3953158210 wait complete. 2024-09-13T17:08:04.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f4440d9f700 1 Processor -- start 2024-09-13T17:08:04.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f4440d9f700 1 -- start start 2024-09-13T17:08:04.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f4440d9f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4434005b10 0x7f4434038650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:04.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f4440d9f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f443400a5b0 0x7f4434038b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:04.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f4440d9f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f443401c740 0x7f44340390d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f4440d9f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4434038230 con 0x7f443400a5b0 2024-09-13T17:08:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f4440d9f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4434050830 con 0x7f4434005b10 2024-09-13T17:08:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f4440d9f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44340375b0 con 0x7f443401c740 2024-09-13T17:08:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f443affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f443400a5b0 0x7f4434038b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f443affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f443400a5b0 0x7f4434038b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56316/0 (socket says 172.21.15.123:56316) 2024-09-13T17:08:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f443affd700 1 -- 172.21.15.123:0/904861341 learned_addr learned my addr 172.21.15.123:0/904861341 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f443bfff700 1 --2- 172.21.15.123:0/904861341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f443401c740 0x7f44340390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f443b7fe700 1 --2- 172.21.15.123:0/904861341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4434005b10 0x7f4434038650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f443affd700 1 -- 172.21.15.123:0/904861341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f443401c740 msgr2=0x7f44340390d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f443affd700 1 --2- 172.21.15.123:0/904861341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f443401c740 0x7f44340390d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f443affd700 1 -- 172.21.15.123:0/904861341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4434005b10 msgr2=0x7f4434038650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f443affd700 1 --2- 172.21.15.123:0/904861341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4434005b10 0x7f4434038650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f443affd700 1 -- 172.21.15.123:0/904861341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c04f5c0 con 0x7f443400a5b0 2024-09-13T17:08:04.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.680+0000 7f443affd700 1 --2- 172.21.15.123:0/904861341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f443400a5b0 0x7f4434038b90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f442800e840 tx=0x7f442800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:04.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.684+0000 7f4427fff700 1 -- 172.21.15.123:0/904861341 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44280095a0 con 0x7f443400a5b0 2024-09-13T17:08:04.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.684+0000 7f4427fff700 1 -- 172.21.15.123:0/904861341 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4428013680 con 0x7f443400a5b0 2024-09-13T17:08:04.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.684+0000 7f4440d9f700 1 -- 172.21.15.123:0/904861341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4434037890 con 0x7f443400a5b0 2024-09-13T17:08:04.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.684+0000 7f4427fff700 1 -- 172.21.15.123:0/904861341 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4428013a10 con 0x7f443400a5b0 2024-09-13T17:08:04.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.684+0000 7f4440d9f700 1 -- 172.21.15.123:0/904861341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4434037e50 con 0x7f443400a5b0 2024-09-13T17:08:04.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.684+0000 7f4440d9f700 1 -- 172.21.15.123:0/904861341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44340384a0 con 0x7f443400a5b0 2024-09-13T17:08:04.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.684+0000 7f4427fff700 1 -- 172.21.15.123:0/904861341 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4428013b70 con 0x7f443400a5b0 2024-09-13T17:08:04.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.684+0000 7f4427fff700 1 --2- 172.21.15.123:0/904861341 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4420066730 0x7f4420068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:04.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.688+0000 7f443b7fe700 1 --2- 172.21.15.123:0/904861341 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4420066730 0x7f4420068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:04.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.688+0000 7f4427fff700 1 -- 172.21.15.123:0/904861341 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4428083fa0 con 0x7f443400a5b0 2024-09-13T17:08:04.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.688+0000 7f443b7fe700 1 --2- 172.21.15.123:0/904861341 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4420066730 0x7f4420068bf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4430000fb0 tx=0x7f4430009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:04.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.692+0000 7f4427fff700 1 -- 172.21.15.123:0/904861341 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4428051300 con 0x7f443400a5b0 2024-09-13T17:08:04.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.900+0000 7f4440d9f700 1 -- 172.21.15.123:0/904861341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f443404b3e0 con 0x7f443400a5b0 2024-09-13T17:08:04.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.900+0000 7f4427fff700 1 -- 172.21.15.123:0/904861341 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4737 (secure 0 0 0) 0x7f4428054920 con 0x7f443400a5b0 2024-09-13T17:08:04.905 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:04.905 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/675597916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":675597916},{"type":"v1","addr":"172.21.15.153:6835","nonce":675597916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/943744723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":943744723},{"type":"v1","addr":"172.21.15.153:6834","nonce":943744723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/625103317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":625103317},{"type":"v1","addr":"172.21.15.123:6835","nonce":625103317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:07:46.797973+0000","modified":"2024-09-13T17:07:48.808133+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2359124958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2359124958},{"type":"v1","addr":"172.21.15.123:6837","nonce":2359124958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:08:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.904+0000 7f4440d9f700 1 -- 172.21.15.123:0/904861341 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4420066730 msgr2=0x7f4420068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.904+0000 7f4440d9f700 1 --2- 172.21.15.123:0/904861341 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4420066730 0x7f4420068bf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4430000fb0 tx=0x7f4430009040 comp rx=0 tx=0).stop 2024-09-13T17:08:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.904+0000 7f4440d9f700 1 -- 172.21.15.123:0/904861341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f443400a5b0 msgr2=0x7f4434038b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.904+0000 7f4440d9f700 1 --2- 172.21.15.123:0/904861341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f443400a5b0 0x7f4434038b90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f442800e840 tx=0x7f442800eb50 comp rx=0 tx=0).stop 2024-09-13T17:08:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.904+0000 7f4440d9f700 1 -- 172.21.15.123:0/904861341 shutdown_connections 2024-09-13T17:08:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.904+0000 7f4440d9f700 1 --2- 172.21.15.123:0/904861341 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4420066730 0x7f4420068bf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.904+0000 7f4440d9f700 1 --2- 172.21.15.123:0/904861341 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f443401c740 0x7f44340390d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.904+0000 7f4440d9f700 1 --2- 172.21.15.123:0/904861341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f443400a5b0 0x7f4434038b90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.904+0000 7f4440d9f700 1 --2- 172.21.15.123:0/904861341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4434005b10 0x7f4434038650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.904+0000 7f4440d9f700 1 -- 172.21.15.123:0/904861341 >> 172.21.15.123:0/904861341 conn(0x7f4434036140 msgr2=0x7f44340e43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.904+0000 7f4440d9f700 1 -- 172.21.15.123:0/904861341 shutdown_connections 2024-09-13T17:08:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:04.904+0000 7f4440d9f700 1 -- 172.21.15.123:0/904861341 wait complete. 2024-09-13T17:08:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 13 2024-09-13T17:08:04.919 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:05.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f6894ce3700 1 Processor -- start 2024-09-13T17:08:05.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f6894ce3700 1 -- start start 2024-09-13T17:08:05.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f6894ce3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f68901598b0 0x7f6890071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f6894ce3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f68900cedc0 0x7f6890159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f6894ce3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689015d360 con 0x7f68900cdfd0 2024-09-13T17:08:05.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f6894ce3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68900ce400 con 0x7f68901598b0 2024-09-13T17:08:05.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f6894ce3700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68900724c0 con 0x7f68900cedc0 2024-09-13T17:08:05.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f688effd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f68900cdfd0 0x7f68900ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55440/0 (socket says 172.21.15.123:55440) 2024-09-13T17:08:05.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f688effd700 1 -- 172.21.15.123:0/1680859102 learned_addr learned my addr 172.21.15.123:0/1680859102 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:05.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f688f7fe700 1 --2- 172.21.15.123:0/1680859102 >> v2:172.21.15.123:3300/0 conn(0x7f68901598b0 0x7f6890071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f688ffff700 1 --2- 172.21.15.123:0/1680859102 >> v2:172.21.15.153:3300/0 conn(0x7f68900cedc0 0x7f6890159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f688e7fc700 1 -- 172.21.15.123:0/1680859102 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077136898 0 0) 0x7f689015d360 con 0x7f68900cdfd0 2024-09-13T17:08:05.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f688e7fc700 1 -- 172.21.15.123:0/1680859102 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f687c0057e0 con 0x7f68900cdfd0 2024-09-13T17:08:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f688e7fc700 1 -- 172.21.15.123:0/1680859102 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1868136963 0 0) 0x7f687c0057e0 con 0x7f68900cdfd0 2024-09-13T17:08:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f688f7fe700 1 -- 172.21.15.123:0/1680859102 >> v2:172.21.15.153:3300/0 conn(0x7f68900cedc0 msgr2=0x7f6890159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f688f7fe700 1 --2- 172.21.15.123:0/1680859102 >> v2:172.21.15.153:3300/0 conn(0x7f68900cedc0 0x7f6890159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.024+0000 7f688f7fe700 1 -- 172.21.15.123:0/1680859102 >> v1:172.21.15.123:6789/0 conn(0x7f68900cdfd0 legacy=0x7f68900ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f688f7fe700 1 -- 172.21.15.123:0/1680859102 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689015d5b0 con 0x7f68901598b0 2024-09-13T17:08:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f688ffff700 1 --2- 172.21.15.123:0/1680859102 >> v2:172.21.15.153:3300/0 conn(0x7f68900cedc0 0x7f6890159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f688f7fe700 1 --2- 172.21.15.123:0/1680859102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68901598b0 0x7f6890071e60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f68900cdcb0 tx=0x7f6878009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad529b775f7a4c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f688e7fc700 1 -- 172.21.15.123:0/1680859102 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800019f0 con 0x7f68901598b0 2024-09-13T17:08:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f688e7fc700 1 -- 172.21.15.123:0/1680859102 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878004030 con 0x7f68901598b0 2024-09-13T17:08:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f688e7fc700 1 -- 172.21.15.123:0/1680859102 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780043a0 con 0x7f68901598b0 2024-09-13T17:08:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f6894ce3700 1 -- 172.21.15.123:0/1680859102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68901598b0 msgr2=0x7f6890071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f6894ce3700 1 --2- 172.21.15.123:0/1680859102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68901598b0 0x7f6890071e60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f68900cdcb0 tx=0x7f6878009b30 comp rx=0 tx=0).stop 2024-09-13T17:08:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f6894ce3700 1 -- 172.21.15.123:0/1680859102 shutdown_connections 2024-09-13T17:08:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f6894ce3700 1 --2- 172.21.15.123:0/1680859102 >> v2:172.21.15.153:3300/0 conn(0x7f68900cedc0 0x7f6890159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f6894ce3700 1 --2- 172.21.15.123:0/1680859102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68901598b0 0x7f6890071e60 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f6894ce3700 1 -- 172.21.15.123:0/1680859102 >> 172.21.15.123:0/1680859102 conn(0x7f6890066150 msgr2=0x7f6890066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f6894ce3700 1 -- 172.21.15.123:0/1680859102 shutdown_connections 2024-09-13T17:08:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f6894ce3700 1 -- 172.21.15.123:0/1680859102 wait complete. 2024-09-13T17:08:05.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f6894ce3700 1 Processor -- start 2024-09-13T17:08:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.028+0000 7f6894ce3700 1 -- start start 2024-09-13T17:08:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f6894ce3700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68900cdfd0 0x7f6890157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f6894ce3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68900cedc0 0x7f6890151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f6894ce3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68901598b0 0x7f68901558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f6894ce3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689015b380 con 0x7f68901598b0 2024-09-13T17:08:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f6894ce3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689015b660 con 0x7f68900cedc0 2024-09-13T17:08:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f6894ce3700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689015b940 con 0x7f68900cdfd0 2024-09-13T17:08:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f688ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68901598b0 0x7f68901558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f688ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68901598b0 0x7f68901558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56342/0 (socket says 172.21.15.123:56342) 2024-09-13T17:08:05.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f688ffff700 1 -- 172.21.15.123:0/138186821 learned_addr learned my addr 172.21.15.123:0/138186821 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:05.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f688f7fe700 1 --2- 172.21.15.123:0/138186821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68900cdfd0 0x7f6890157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f688effd700 1 --2- 172.21.15.123:0/138186821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68900cedc0 0x7f6890151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f688ffff700 1 -- 172.21.15.123:0/138186821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68900cdfd0 msgr2=0x7f6890157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f688ffff700 1 --2- 172.21.15.123:0/138186821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68900cdfd0 0x7f6890157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f688ffff700 1 -- 172.21.15.123:0/138186821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68900cedc0 msgr2=0x7f6890151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f688ffff700 1 --2- 172.21.15.123:0/138186821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68900cedc0 0x7f6890151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f688ffff700 1 -- 172.21.15.123:0/138186821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68880094b0 con 0x7f68901598b0 2024-09-13T17:08:05.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f688ffff700 1 --2- 172.21.15.123:0/138186821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68901598b0 0x7f68901558e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f688800eb60 tx=0x7f688800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:05.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f6887fff700 1 -- 172.21.15.123:0/138186821 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68880097b0 con 0x7f68901598b0 2024-09-13T17:08:05.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f6894ce3700 1 -- 172.21.15.123:0/138186821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68780094b0 con 0x7f68901598b0 2024-09-13T17:08:05.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f6894ce3700 1 -- 172.21.15.123:0/138186821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6890155e20 con 0x7f68901598b0 2024-09-13T17:08:05.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f6887fff700 1 -- 172.21.15.123:0/138186821 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6888009e70 con 0x7f68901598b0 2024-09-13T17:08:05.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f6887fff700 1 -- 172.21.15.123:0/138186821 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888004220 con 0x7f68901598b0 2024-09-13T17:08:05.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.032+0000 7f6894ce3700 1 -- 172.21.15.123:0/138186821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6874005310 con 0x7f68901598b0 2024-09-13T17:08:05.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.036+0000 7f6887fff700 1 -- 172.21.15.123:0/138186821 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f68880043a0 con 0x7f68901598b0 2024-09-13T17:08:05.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.036+0000 7f6887fff700 1 --2- 172.21.15.123:0/138186821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6870066730 0x7f6870068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.036+0000 7f6887fff700 1 -- 172.21.15.123:0/138186821 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68880845a0 con 0x7f68901598b0 2024-09-13T17:08:05.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.036+0000 7f688f7fe700 1 --2- 172.21.15.123:0/138186821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6870066730 0x7f6870068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.036+0000 7f688f7fe700 1 --2- 172.21.15.123:0/138186821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6870066730 0x7f6870068bf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6878000c00 tx=0x7f6878008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:05.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.040+0000 7f6887fff700 1 -- 172.21.15.123:0/138186821 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f68880519a0 con 0x7f68901598b0 2024-09-13T17:08:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.212+0000 7f6894ce3700 1 -- 172.21.15.123:0/138186821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6874005890 con 0x7f68901598b0 2024-09-13T17:08:05.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.216+0000 7f6887fff700 1 -- 172.21.15.123:0/138186821 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f6888054fc0 con 0x7f68901598b0 2024-09-13T17:08:05.219 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:05.219 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":34,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:07:47.800958+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:07:44.636174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T17:07:45.802714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:05.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.216+0000 7f6894ce3700 1 -- 172.21.15.123:0/138186821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6870066730 msgr2=0x7f6870068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.216+0000 7f6894ce3700 1 --2- 172.21.15.123:0/138186821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6870066730 0x7f6870068bf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6878000c00 tx=0x7f6878008030 comp rx=0 tx=0).stop 2024-09-13T17:08:05.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.216+0000 7f6894ce3700 1 -- 172.21.15.123:0/138186821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68901598b0 msgr2=0x7f68901558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.216+0000 7f6894ce3700 1 --2- 172.21.15.123:0/138186821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68901598b0 0x7f68901558e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f688800eb60 tx=0x7f688800ee70 comp rx=0 tx=0).stop 2024-09-13T17:08:05.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.216+0000 7f6894ce3700 1 -- 172.21.15.123:0/138186821 shutdown_connections 2024-09-13T17:08:05.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.216+0000 7f6894ce3700 1 --2- 172.21.15.123:0/138186821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6870066730 0x7f6870068bf0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.216+0000 7f6894ce3700 1 --2- 172.21.15.123:0/138186821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68901598b0 0x7f68901558e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.216+0000 7f6894ce3700 1 --2- 172.21.15.123:0/138186821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68900cedc0 0x7f6890151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.216+0000 7f6894ce3700 1 --2- 172.21.15.123:0/138186821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68900cdfd0 0x7f6890157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.216+0000 7f6894ce3700 1 -- 172.21.15.123:0/138186821 >> 172.21.15.123:0/138186821 conn(0x7f6890066150 msgr2=0x7f6890159c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:05.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.216+0000 7f6894ce3700 1 -- 172.21.15.123:0/138186821 shutdown_connections 2024-09-13T17:08:05.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.216+0000 7f6894ce3700 1 -- 172.21.15.123:0/138186821 wait complete. 2024-09-13T17:08:05.233 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:07:44.636174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:07:45.802714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:08:05.233 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:08:05.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.352+0000 7fc35f7f4700 1 Processor -- start 2024-09-13T17:08:05.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.352+0000 7fc35f7f4700 1 -- start start 2024-09-13T17:08:05.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.352+0000 7fc35f7f4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc358143470 0x7fc35806b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.352+0000 7fc35f7f4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc35815a000 0x7fc3580b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.352+0000 7fc35f7f4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc35806b7a0 0x7fc3580b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.352+0000 7fc35f7f4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc358143850 con 0x7fc358143470 2024-09-13T17:08:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.352+0000 7fc35f7f4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3580b36f0 con 0x7fc35815a000 2024-09-13T17:08:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.352+0000 7fc35f7f4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3580b39d0 con 0x7fc35806b7a0 2024-09-13T17:08:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35d590700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc358143470 0x7fc35806b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35d590700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc358143470 0x7fc35806b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56346/0 (socket says 172.21.15.123:56346) 2024-09-13T17:08:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35d590700 1 -- 172.21.15.123:0/3861825094 learned_addr learned my addr 172.21.15.123:0/3861825094 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35dd91700 1 --2- 172.21.15.123:0/3861825094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc35806b7a0 0x7fc3580b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35cd8f700 1 --2- 172.21.15.123:0/3861825094 >> v2:172.21.15.153:3300/0 conn(0x7fc35815a000 0x7fc3580b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35d590700 1 -- 172.21.15.123:0/3861825094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc35806b7a0 msgr2=0x7fc3580b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35d590700 1 --2- 172.21.15.123:0/3861825094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc35806b7a0 0x7fc3580b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35d590700 1 -- 172.21.15.123:0/3861825094 >> v2:172.21.15.153:3300/0 conn(0x7fc35815a000 msgr2=0x7fc3580b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35d590700 1 --2- 172.21.15.123:0/3861825094 >> v2:172.21.15.153:3300/0 conn(0x7fc35815a000 0x7fc3580b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35d590700 1 -- 172.21.15.123:0/3861825094 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3580b3cb0 con 0x7fc358143470 2024-09-13T17:08:05.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35d590700 1 --2- 172.21.15.123:0/3861825094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc358143470 0x7fc35806b260 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc3580b2ba0 tx=0x7fc354009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131fd2924ff42b1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:05.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc34ffff700 1 -- 172.21.15.123:0/3861825094 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354011830 con 0x7fc358143470 2024-09-13T17:08:05.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc34ffff700 1 -- 172.21.15.123:0/3861825094 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354011990 con 0x7fc358143470 2024-09-13T17:08:05.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc34ffff700 1 -- 172.21.15.123:0/3861825094 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354011d20 con 0x7fc358143470 2024-09-13T17:08:05.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35f7f4700 1 -- 172.21.15.123:0/3861825094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc358143470 msgr2=0x7fc35806b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35f7f4700 1 --2- 172.21.15.123:0/3861825094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc358143470 0x7fc35806b260 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc3580b2ba0 tx=0x7fc354009bf0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35f7f4700 1 -- 172.21.15.123:0/3861825094 shutdown_connections 2024-09-13T17:08:05.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35f7f4700 1 --2- 172.21.15.123:0/3861825094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc35806b7a0 0x7fc3580b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35f7f4700 1 --2- 172.21.15.123:0/3861825094 >> v2:172.21.15.153:3300/0 conn(0x7fc35815a000 0x7fc3580b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35f7f4700 1 --2- 172.21.15.123:0/3861825094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc358143470 0x7fc35806b260 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35f7f4700 1 -- 172.21.15.123:0/3861825094 >> 172.21.15.123:0/3861825094 conn(0x7fc3580cfde0 msgr2=0x7fc3580d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:05.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35f7f4700 1 -- 172.21.15.123:0/3861825094 shutdown_connections 2024-09-13T17:08:05.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35f7f4700 1 -- 172.21.15.123:0/3861825094 wait complete. 2024-09-13T17:08:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35f7f4700 1 Processor -- start 2024-09-13T17:08:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.356+0000 7fc35f7f4700 1 -- start start 2024-09-13T17:08:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35f7f4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc35806b7a0 0x7fc3581f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35f7f4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc358143470 0x7fc358140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35f7f4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc35815a000 0x7fc35813c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35f7f4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35813bef0 con 0x7fc358143470 2024-09-13T17:08:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35f7f4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35813fab0 con 0x7fc35815a000 2024-09-13T17:08:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35f7f4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3581f6ae0 con 0x7fc35806b7a0 2024-09-13T17:08:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35cd8f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc358143470 0x7fc358140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35cd8f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc358143470 0x7fc358140ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56358/0 (socket says 172.21.15.123:56358) 2024-09-13T17:08:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35cd8f700 1 -- 172.21.15.123:0/265208282 learned_addr learned my addr 172.21.15.123:0/265208282 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35d590700 1 --2- 172.21.15.123:0/265208282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc35806b7a0 0x7fc3581f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35dd91700 1 --2- 172.21.15.123:0/265208282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc35815a000 0x7fc35813c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35cd8f700 1 -- 172.21.15.123:0/265208282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc35806b7a0 msgr2=0x7fc3581f65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35cd8f700 1 --2- 172.21.15.123:0/265208282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc35806b7a0 0x7fc3581f65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35cd8f700 1 -- 172.21.15.123:0/265208282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc35815a000 msgr2=0x7fc35813c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35cd8f700 1 --2- 172.21.15.123:0/265208282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc35815a000 0x7fc35813c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35cd8f700 1 -- 172.21.15.123:0/265208282 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354009570 con 0x7fc358143470 2024-09-13T17:08:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35cd8f700 1 --2- 172.21.15.123:0/265208282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc358143470 0x7fc358140ba0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc34800d7d0 tx=0x7fc34800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc34dffb700 1 -- 172.21.15.123:0/265208282 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348017070 con 0x7fc358143470 2024-09-13T17:08:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc34dffb700 1 -- 172.21.15.123:0/265208282 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc348004020 con 0x7fc358143470 2024-09-13T17:08:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35f7f4700 1 -- 172.21.15.123:0/265208282 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc358155d70 con 0x7fc358143470 2024-09-13T17:08:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc34dffb700 1 -- 172.21.15.123:0/265208282 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480041b0 con 0x7fc358143470 2024-09-13T17:08:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35f7f4700 1 -- 172.21.15.123:0/265208282 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc358156330 con 0x7fc358143470 2024-09-13T17:08:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.360+0000 7fc35f7f4700 1 -- 172.21.15.123:0/265208282 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35806b260 con 0x7fc358143470 2024-09-13T17:08:05.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.364+0000 7fc34dffb700 1 -- 172.21.15.123:0/265208282 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc348004310 con 0x7fc358143470 2024-09-13T17:08:05.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.364+0000 7fc34dffb700 1 --2- 172.21.15.123:0/265208282 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc33c066730 0x7fc33c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.364+0000 7fc34dffb700 1 -- 172.21.15.123:0/265208282 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc348083b00 con 0x7fc358143470 2024-09-13T17:08:05.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.364+0000 7fc35d590700 1 --2- 172.21.15.123:0/265208282 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc33c066730 0x7fc33c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.364+0000 7fc35d590700 1 --2- 172.21.15.123:0/265208282 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc33c066730 0x7fc33c068bf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc354000c00 tx=0x7fc354008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.372+0000 7fc34dffb700 1 -- 172.21.15.123:0/265208282 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc348085e60 con 0x7fc358143470 2024-09-13T17:08:05.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.540+0000 7fc35f7f4700 1 -- 172.21.15.123:0/265208282 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc35806fcc0 con 0x7fc358143470 2024-09-13T17:08:05.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.540+0000 7fc34dffb700 1 -- 172.21.15.123:0/265208282 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc348050e60 con 0x7fc358143470 2024-09-13T17:08:05.543 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:08:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.540+0000 7fc35f7f4700 1 -- 172.21.15.123:0/265208282 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc33c066730 msgr2=0x7fc33c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.540+0000 7fc35f7f4700 1 --2- 172.21.15.123:0/265208282 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc33c066730 0x7fc33c068bf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc354000c00 tx=0x7fc354008030 comp rx=0 tx=0).stop 2024-09-13T17:08:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.540+0000 7fc35f7f4700 1 -- 172.21.15.123:0/265208282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc358143470 msgr2=0x7fc358140ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.540+0000 7fc35f7f4700 1 --2- 172.21.15.123:0/265208282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc358143470 0x7fc358140ba0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc34800d7d0 tx=0x7fc34800dae0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.540+0000 7fc35f7f4700 1 -- 172.21.15.123:0/265208282 shutdown_connections 2024-09-13T17:08:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.540+0000 7fc35f7f4700 1 --2- 172.21.15.123:0/265208282 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc33c066730 0x7fc33c068bf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.540+0000 7fc35f7f4700 1 --2- 172.21.15.123:0/265208282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc35815a000 0x7fc35813c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.540+0000 7fc35f7f4700 1 --2- 172.21.15.123:0/265208282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc358143470 0x7fc358140ba0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.540+0000 7fc35f7f4700 1 --2- 172.21.15.123:0/265208282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc35806b7a0 0x7fc3581f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.540+0000 7fc35f7f4700 1 -- 172.21.15.123:0/265208282 >> 172.21.15.123:0/265208282 conn(0x7fc3580cfde0 msgr2=0x7fc3580cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:05.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.544+0000 7fc35f7f4700 1 -- 172.21.15.123:0/265208282 shutdown_connections 2024-09-13T17:08:05.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.544+0000 7fc35f7f4700 1 -- 172.21.15.123:0/265208282 wait complete. 2024-09-13T17:08:05.563 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:08:05.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570d8ed700 1 Processor -- start 2024-09-13T17:08:05.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570d8ed700 1 -- start start 2024-09-13T17:08:05.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570d8ed700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57081592e0 0x7f570815d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570d8ed700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f570806dc90 0x7f5708070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570d8ed700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57080cd2e0 con 0x7f57081596c0 2024-09-13T17:08:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570d8ed700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57080cd5c0 con 0x7f570806dc90 2024-09-13T17:08:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570d8ed700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57080cd8a0 con 0x7f57081592e0 2024-09-13T17:08:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570d0ec700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f570806dc90 0x7f5708070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570d0ec700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f570806dc90 0x7f5708070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56362/0 (socket says 172.21.15.123:56362) 2024-09-13T17:08:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570d0ec700 1 -- 172.21.15.123:0/259189770 learned_addr learned my addr 172.21.15.123:0/259189770 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570c8eb700 1 --2- 172.21.15.123:0/259189770 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57081592e0 0x7f570815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570d0ec700 1 -- 172.21.15.123:0/259189770 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57081592e0 msgr2=0x7f570815d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570d0ec700 1 --2- 172.21.15.123:0/259189770 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57081592e0 0x7f570815d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570d0ec700 1 -- 172.21.15.123:0/259189770 >> v1:172.21.15.123:6789/0 conn(0x7f57081596c0 legacy=0x7f570815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.680+0000 7f570d0ec700 1 -- 172.21.15.123:0/259189770 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57080cdb80 con 0x7f570806dc90 2024-09-13T17:08:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.684+0000 7f570d0ec700 1 --2- 172.21.15.123:0/259189770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570806dc90 0x7f5708070e50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5700009e50 tx=0x7f570000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36937afb3ebee19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:05.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.684+0000 7f57077fe700 1 -- 172.21.15.123:0/259189770 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570000e070 con 0x7f570806dc90 2024-09-13T17:08:05.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.684+0000 7f57077fe700 1 -- 172.21.15.123:0/259189770 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570000b910 con 0x7f570806dc90 2024-09-13T17:08:05.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.684+0000 7f57077fe700 1 -- 172.21.15.123:0/259189770 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570000bcc0 con 0x7f570806dc90 2024-09-13T17:08:05.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.684+0000 7f570d8ed700 1 -- 172.21.15.123:0/259189770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570806dc90 msgr2=0x7f5708070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.684+0000 7f570d8ed700 1 --2- 172.21.15.123:0/259189770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570806dc90 0x7f5708070e50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5700009e50 tx=0x7f570000b330 comp rx=0 tx=0).stop 2024-09-13T17:08:05.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.684+0000 7f570d8ed700 1 -- 172.21.15.123:0/259189770 shutdown_connections 2024-09-13T17:08:05.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.684+0000 7f570d8ed700 1 --2- 172.21.15.123:0/259189770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570806dc90 0x7f5708070e50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.684+0000 7f570d8ed700 1 --2- 172.21.15.123:0/259189770 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57081592e0 0x7f570815d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.684+0000 7f570d8ed700 1 -- 172.21.15.123:0/259189770 >> 172.21.15.123:0/259189770 conn(0x7f57080b01d0 msgr2=0x7f57080b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:05.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.684+0000 7f570d8ed700 1 -- 172.21.15.123:0/259189770 shutdown_connections 2024-09-13T17:08:05.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.684+0000 7f570d8ed700 1 -- 172.21.15.123:0/259189770 wait complete. 2024-09-13T17:08:05.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.684+0000 7f570d8ed700 1 Processor -- start 2024-09-13T17:08:05.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.684+0000 7f570d8ed700 1 -- start start 2024-09-13T17:08:05.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f570d8ed700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f570806dc90 0x7f57080c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f570d8ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57081592e0 0x7f570814f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f570d8ed700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57081596c0 0x7f57080c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f570d8ed700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5708153e10 con 0x7f57081592e0 2024-09-13T17:08:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f570d8ed700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57080c6440 con 0x7f570806dc90 2024-09-13T17:08:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f570d8ed700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57080c6720 con 0x7f57081596c0 2024-09-13T17:08:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f5707fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57081592e0 0x7f570814f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f5707fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57081592e0 0x7f570814f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56366/0 (socket says 172.21.15.123:56366) 2024-09-13T17:08:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f5707fff700 1 -- 172.21.15.123:0/420108574 learned_addr learned my addr 172.21.15.123:0/420108574 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f570d0ec700 1 --2- 172.21.15.123:0/420108574 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57081596c0 0x7f57080c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f570c8eb700 1 --2- 172.21.15.123:0/420108574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f570806dc90 0x7f57080c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f5707fff700 1 -- 172.21.15.123:0/420108574 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57081596c0 msgr2=0x7f57080c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f5707fff700 1 --2- 172.21.15.123:0/420108574 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57081596c0 0x7f57080c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f5707fff700 1 -- 172.21.15.123:0/420108574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f570806dc90 msgr2=0x7f57080c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f5707fff700 1 --2- 172.21.15.123:0/420108574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f570806dc90 0x7f57080c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f5707fff700 1 -- 172.21.15.123:0/420108574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5700009b30 con 0x7f57081592e0 2024-09-13T17:08:05.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f5707fff700 1 --2- 172.21.15.123:0/420108574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57081592e0 0x7f570814f890 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f56f800c4d0 tx=0x7f56f800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:05.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f57057fa700 1 -- 172.21.15.123:0/420108574 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80052d0 con 0x7f57081592e0 2024-09-13T17:08:05.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f57057fa700 1 -- 172.21.15.123:0/420108574 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f8005430 con 0x7f57081592e0 2024-09-13T17:08:05.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f57057fa700 1 -- 172.21.15.123:0/420108574 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80055a0 con 0x7f57081592e0 2024-09-13T17:08:05.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f570d8ed700 1 -- 172.21.15.123:0/420108574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57080c6a00 con 0x7f57081592e0 2024-09-13T17:08:05.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.688+0000 7f570d8ed700 1 -- 172.21.15.123:0/420108574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57080c6fc0 con 0x7f57081592e0 2024-09-13T17:08:05.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.692+0000 7f570d8ed700 1 -- 172.21.15.123:0/420108574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57080adc80 con 0x7f57081592e0 2024-09-13T17:08:05.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.692+0000 7f57057fa700 1 -- 172.21.15.123:0/420108574 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56f80038c0 con 0x7f57081592e0 2024-09-13T17:08:05.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.692+0000 7f57057fa700 1 --2- 172.21.15.123:0/420108574 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f56f4066730 0x7f56f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:05.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.692+0000 7f57057fa700 1 -- 172.21.15.123:0/420108574 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56f80833a0 con 0x7f57081592e0 2024-09-13T17:08:05.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.692+0000 7f570c8eb700 1 --2- 172.21.15.123:0/420108574 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f56f4066730 0x7f56f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:05.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.692+0000 7f570c8eb700 1 --2- 172.21.15.123:0/420108574 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f56f4066730 0x7f56f4068bf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009b50 tx=0x7f56fc009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:05.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.700+0000 7f57057fa700 1 -- 172.21.15.123:0/420108574 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56f80507a0 con 0x7f57081592e0 2024-09-13T17:08:05.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.872+0000 7f570d8ed700 1 -- 172.21.15.123:0/420108574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57080cb100 con 0x7f57081592e0 2024-09-13T17:08:05.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.872+0000 7f57057fa700 1 -- 172.21.15.123:0/420108574 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56f8053dc0 con 0x7f57081592e0 2024-09-13T17:08:05.875 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:08:05.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.872+0000 7f570d8ed700 1 -- 172.21.15.123:0/420108574 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f56f4066730 msgr2=0x7f56f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.872+0000 7f570d8ed700 1 --2- 172.21.15.123:0/420108574 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f56f4066730 0x7f56f4068bf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009b50 tx=0x7f56fc009240 comp rx=0 tx=0).stop 2024-09-13T17:08:05.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.872+0000 7f570d8ed700 1 -- 172.21.15.123:0/420108574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57081592e0 msgr2=0x7f570814f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:05.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.872+0000 7f570d8ed700 1 --2- 172.21.15.123:0/420108574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57081592e0 0x7f570814f890 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f56f800c4d0 tx=0x7f56f800c7e0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.872+0000 7f570d8ed700 1 -- 172.21.15.123:0/420108574 shutdown_connections 2024-09-13T17:08:05.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.872+0000 7f570d8ed700 1 --2- 172.21.15.123:0/420108574 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f56f4066730 0x7f56f4068bf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.872+0000 7f570d8ed700 1 --2- 172.21.15.123:0/420108574 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57081596c0 0x7f57080c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.872+0000 7f570d8ed700 1 --2- 172.21.15.123:0/420108574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57081592e0 0x7f570814f890 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.872+0000 7f570d8ed700 1 --2- 172.21.15.123:0/420108574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f570806dc90 0x7f57080c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:05.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.872+0000 7f570d8ed700 1 -- 172.21.15.123:0/420108574 >> 172.21.15.123:0/420108574 conn(0x7f57080b01d0 msgr2=0x7f570806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:05.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.872+0000 7f570d8ed700 1 -- 172.21.15.123:0/420108574 shutdown_connections 2024-09-13T17:08:05.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:05.872+0000 7f570d8ed700 1 -- 172.21.15.123:0/420108574 wait complete. 2024-09-13T17:08:05.889 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:08:06.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.000+0000 7f8ef9d3e700 1 Processor -- start 2024-09-13T17:08:06.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.000+0000 7f8ef9d3e700 1 -- start start 2024-09-13T17:08:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef9d3e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8ef40b3990 0x7f8ef40cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef9d3e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ef40ccac0 0x7f8ef40cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef9d3e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ef40cb5b0 0x7f8ef415e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef9d3e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40cba20 con 0x7f8ef40b3990 2024-09-13T17:08:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef9d3e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40ce180 con 0x7f8ef40ccac0 2024-09-13T17:08:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef9d3e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef40cd990 con 0x7f8ef40cb5b0 2024-09-13T17:08:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef8d3c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8ef40b3990 0x7f8ef40cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef8d3c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8ef40b3990 0x7f8ef40cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56374/0 (socket says 172.21.15.123:56374) 2024-09-13T17:08:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef8d3c700 1 -- 172.21.15.123:0/570027240 learned_addr learned my addr 172.21.15.123:0/570027240 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef953d700 1 --2- 172.21.15.123:0/570027240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ef40cb5b0 0x7f8ef415e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef3fff700 1 --2- 172.21.15.123:0/570027240 >> v2:172.21.15.153:3300/0 conn(0x7f8ef40ccac0 0x7f8ef40cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef8d3c700 1 -- 172.21.15.123:0/570027240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ef40cb5b0 msgr2=0x7f8ef415e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef8d3c700 1 --2- 172.21.15.123:0/570027240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ef40cb5b0 0x7f8ef415e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef8d3c700 1 -- 172.21.15.123:0/570027240 >> v2:172.21.15.153:3300/0 conn(0x7f8ef40ccac0 msgr2=0x7f8ef40cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:06.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef8d3c700 1 --2- 172.21.15.123:0/570027240 >> v2:172.21.15.153:3300/0 conn(0x7f8ef40ccac0 0x7f8ef40cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef8d3c700 1 -- 172.21.15.123:0/570027240 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef40cd0f0 con 0x7f8ef40b3990 2024-09-13T17:08:06.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef3fff700 1 --2- 172.21.15.123:0/570027240 >> v2:172.21.15.153:3300/0 conn(0x7f8ef40ccac0 0x7f8ef40cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:06.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef953d700 1 --2- 172.21.15.123:0/570027240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ef40cb5b0 0x7f8ef415e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:06.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef8d3c700 1 --2- 172.21.15.123:0/570027240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef40b3990 0x7f8ef40cc580 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8ef406a5c0 tx=0x7f8edc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fda58a6f0b7bb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:06.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef37fe700 1 -- 172.21.15.123:0/570027240 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc00b8a0 con 0x7f8ef40b3990 2024-09-13T17:08:06.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef37fe700 1 -- 172.21.15.123:0/570027240 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8edc00ba00 con 0x7f8ef40b3990 2024-09-13T17:08:06.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef37fe700 1 -- 172.21.15.123:0/570027240 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc00bd90 con 0x7f8ef40b3990 2024-09-13T17:08:06.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/570027240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef40b3990 msgr2=0x7f8ef40cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef9d3e700 1 --2- 172.21.15.123:0/570027240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef40b3990 0x7f8ef40cc580 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8ef406a5c0 tx=0x7f8edc009bf0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/570027240 shutdown_connections 2024-09-13T17:08:06.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef9d3e700 1 --2- 172.21.15.123:0/570027240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ef40cb5b0 0x7f8ef415e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef9d3e700 1 --2- 172.21.15.123:0/570027240 >> v2:172.21.15.153:3300/0 conn(0x7f8ef40ccac0 0x7f8ef40cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef9d3e700 1 --2- 172.21.15.123:0/570027240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef40b3990 0x7f8ef40cc580 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.004+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/570027240 >> 172.21.15.123:0/570027240 conn(0x7f8ef40b01d0 msgr2=0x7f8ef40b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:06.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.008+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/570027240 shutdown_connections 2024-09-13T17:08:06.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.008+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/570027240 wait complete. 2024-09-13T17:08:06.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.008+0000 7f8ef9d3e700 1 Processor -- start 2024-09-13T17:08:06.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.008+0000 7f8ef9d3e700 1 -- start start 2024-09-13T17:08:06.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.008+0000 7f8ef9d3e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef40b3990 0x7f8ef415ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.008+0000 7f8ef9d3e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40cb5b0 0x7f8ef40b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.008+0000 7f8ef9d3e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ef40ccac0 0x7f8ef40b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.008+0000 7f8ef9d3e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef414c7f0 con 0x7f8ef40b3990 2024-09-13T17:08:06.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.008+0000 7f8ef9d3e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef41f3c80 con 0x7f8ef40cb5b0 2024-09-13T17:08:06.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.008+0000 7f8ef9d3e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef41f3f60 con 0x7f8ef40ccac0 2024-09-13T17:08:06.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.008+0000 7f8ef8d3c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef40b3990 0x7f8ef415ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.008+0000 7f8ef8d3c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef40b3990 0x7f8ef415ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56386/0 (socket says 172.21.15.123:56386) 2024-09-13T17:08:06.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.008+0000 7f8ef8d3c700 1 -- 172.21.15.123:0/3879458418 learned_addr learned my addr 172.21.15.123:0/3879458418 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:06.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef3fff700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40cb5b0 0x7f8ef40b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef953d700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ef40ccac0 0x7f8ef40b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef8d3c700 1 -- 172.21.15.123:0/3879458418 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ef40ccac0 msgr2=0x7f8ef40b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef8d3c700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ef40ccac0 0x7f8ef40b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef8d3c700 1 -- 172.21.15.123:0/3879458418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40cb5b0 msgr2=0x7f8ef40b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef8d3c700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40cb5b0 0x7f8ef40b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef8d3c700 1 -- 172.21.15.123:0/3879458418 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc009570 con 0x7f8ef40b3990 2024-09-13T17:08:06.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef3fff700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40cb5b0 0x7f8ef40b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:06.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef8d3c700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef40b3990 0x7f8ef415ce10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8ef406b4a0 tx=0x7f8edc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:06.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef17fa700 1 -- 172.21.15.123:0/3879458418 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc0036c0 con 0x7f8ef40b3990 2024-09-13T17:08:06.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef17fa700 1 -- 172.21.15.123:0/3879458418 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8edc01f070 con 0x7f8ef40b3990 2024-09-13T17:08:06.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/3879458418 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef41f4240 con 0x7f8ef40b3990 2024-09-13T17:08:06.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef17fa700 1 -- 172.21.15.123:0/3879458418 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc003a80 con 0x7f8ef40b3990 2024-09-13T17:08:06.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/3879458418 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef41f4800 con 0x7f8ef40b3990 2024-09-13T17:08:06.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/3879458418 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef40cc580 con 0x7f8ef40b3990 2024-09-13T17:08:06.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef17fa700 1 -- 172.21.15.123:0/3879458418 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8edc021030 con 0x7f8ef40b3990 2024-09-13T17:08:06.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef17fa700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ed4066730 0x7f8ed4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.012+0000 7f8ef17fa700 1 -- 172.21.15.123:0/3879458418 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8edc0857d0 con 0x7f8ef40b3990 2024-09-13T17:08:06.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.016+0000 7f8ef3fff700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ed4066730 0x7f8ed4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.016+0000 7f8ef3fff700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ed4066730 0x7f8ed4068bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8ef414fb90 tx=0x7f8eec003ae0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:06.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.024+0000 7f8ef17fa700 1 -- 172.21.15.123:0/3879458418 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8edc052bd0 con 0x7f8ef40b3990 2024-09-13T17:08:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.192+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/3879458418 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ef406c190 con 0x7f8ef40b3990 2024-09-13T17:08:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.192+0000 7f8ef17fa700 1 -- 172.21.15.123:0/3879458418 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8edc0561f0 con 0x7f8ef40b3990 2024-09-13T17:08:06.196 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:08:06.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.196+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/3879458418 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ed4066730 msgr2=0x7f8ed4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.196+0000 7f8ef9d3e700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ed4066730 0x7f8ed4068bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8ef414fb90 tx=0x7f8eec003ae0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.196+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/3879458418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef40b3990 msgr2=0x7f8ef415ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.196+0000 7f8ef9d3e700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef40b3990 0x7f8ef415ce10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8ef406b4a0 tx=0x7f8edc004770 comp rx=0 tx=0).stop 2024-09-13T17:08:06.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.196+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/3879458418 shutdown_connections 2024-09-13T17:08:06.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.196+0000 7f8ef9d3e700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ed4066730 0x7f8ed4068bf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.196+0000 7f8ef9d3e700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ef40ccac0 0x7f8ef40b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.196+0000 7f8ef9d3e700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40cb5b0 0x7f8ef40b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.196+0000 7f8ef9d3e700 1 --2- 172.21.15.123:0/3879458418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef40b3990 0x7f8ef415ce10 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.196+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/3879458418 >> 172.21.15.123:0/3879458418 conn(0x7f8ef40b01d0 msgr2=0x7f8ef40b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:06.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.196+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/3879458418 shutdown_connections 2024-09-13T17:08:06.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.196+0000 7f8ef9d3e700 1 -- 172.21.15.123:0/3879458418 wait complete. 2024-09-13T17:08:06.211 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:08:06.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.316+0000 7f02ce003700 1 Processor -- start 2024-09-13T17:08:06.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.316+0000 7f02ce003700 1 -- start start 2024-09-13T17:08:06.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.316+0000 7f02ce003700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f02c815e920 0x7f02c80caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.316+0000 7f02ce003700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c8162550 con 0x7f02c815ed00 2024-09-13T17:08:06.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.316+0000 7f02ce003700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c80cd690 con 0x7f02c80cb020 2024-09-13T17:08:06.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.316+0000 7f02ce003700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c8161f90 con 0x7f02c815e920 2024-09-13T17:08:06.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.316+0000 7f02cd802700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f02c815ed00 0x7f02c80cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55464/0 (socket says 172.21.15.123:55464) 2024-09-13T17:08:06.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.316+0000 7f02cd802700 1 -- 172.21.15.123:0/3806650112 learned_addr learned my addr 172.21.15.123:0/3806650112 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:06.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.316+0000 7f02cd001700 1 --2- 172.21.15.123:0/3806650112 >> v2:172.21.15.153:3300/0 conn(0x7f02c815e920 0x7f02c80caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.316+0000 7f02bbfff700 1 -- 172.21.15.123:0/3806650112 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859705571 0 0) 0x7f02c8162550 con 0x7f02c815ed00 2024-09-13T17:08:06.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.316+0000 7f02bbfff700 1 -- 172.21.15.123:0/3806650112 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02b40035d0 con 0x7f02c815ed00 2024-09-13T17:08:06.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 -- 172.21.15.123:0/3806650112 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 557284996 0 0) 0x7f02b40035d0 con 0x7f02c815ed00 2024-09-13T17:08:06.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 -- 172.21.15.123:0/3806650112 >> v2:172.21.15.153:3300/0 conn(0x7f02c815e920 msgr2=0x7f02c80caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:06.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 --2- 172.21.15.123:0/3806650112 >> v2:172.21.15.153:3300/0 conn(0x7f02c815e920 0x7f02c80caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 -- 172.21.15.123:0/3806650112 >> v1:172.21.15.153:6789/0 conn(0x7f02c80cb020 legacy=0x7f02c8161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 -- 172.21.15.123:0/3806650112 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c8162270 con 0x7f02c815ed00 2024-09-13T17:08:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 -- 172.21.15.123:0/3806650112 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f02c00019f0 con 0x7f02c815ed00 2024-09-13T17:08:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02cd001700 1 --2- 172.21.15.123:0/3806650112 >> v2:172.21.15.153:3300/0 conn(0x7f02c815e920 0x7f02c80caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 -- 172.21.15.123:0/3806650112 >> v1:172.21.15.123:6789/0 conn(0x7f02c815ed00 legacy=0x7f02c80cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 --2- 172.21.15.123:0/3806650112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b4003a20 0x7f02b4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 --2- 172.21.15.123:0/3806650112 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02b4004870 0x7f02b4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 --2- 172.21.15.123:0/3806650112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02b4005230 0x7f02b400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 -- 172.21.15.123:0/3806650112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c8161f90 con 0x7f02b4003a20 2024-09-13T17:08:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 -- 172.21.15.123:0/3806650112 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b400c0d0 con 0x7f02b4005230 2024-09-13T17:08:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 -- 172.21.15.123:0/3806650112 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b400c290 con 0x7f02b4004870 2024-09-13T17:08:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02cd001700 1 --2- 172.21.15.123:0/3806650112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b4003a20 0x7f02b4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02cc800700 1 --2- 172.21.15.123:0/3806650112 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02b4004870 0x7f02b4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02cd802700 1 --2- 172.21.15.123:0/3806650112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02b4005230 0x7f02b400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02cd001700 1 -- 172.21.15.123:0/3806650112 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02b4004870 msgr2=0x7f02b4004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:06.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02cd001700 1 --2- 172.21.15.123:0/3806650112 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02b4004870 0x7f02b4004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02cd001700 1 -- 172.21.15.123:0/3806650112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02b4005230 msgr2=0x7f02b400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:06.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02cd001700 1 --2- 172.21.15.123:0/3806650112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02b4005230 0x7f02b400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02cd001700 1 -- 172.21.15.123:0/3806650112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b40035d0 con 0x7f02b4003a20 2024-09-13T17:08:06.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02cc800700 1 --2- 172.21.15.123:0/3806650112 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02b4004870 0x7f02b4004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:06.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02cd802700 1 --2- 172.21.15.123:0/3806650112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02b4005230 0x7f02b400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:06.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02cd802700 1 -- 172.21.15.123:0/3806650112 reap_dead start 2024-09-13T17:08:06.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02cd001700 1 --2- 172.21.15.123:0/3806650112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b4003a20 0x7f02b4003e40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009d40 tx=0x7f02b40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fed65483575d00c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:06.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 -- 172.21.15.123:0/3806650112 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4009e90 con 0x7f02b4003a20 2024-09-13T17:08:06.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 -- 172.21.15.123:0/3806650112 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c400e9a0 con 0x7f02b4003a20 2024-09-13T17:08:06.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02bbfff700 1 -- 172.21.15.123:0/3806650112 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c400ed10 con 0x7f02b4003a20 2024-09-13T17:08:06.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02ce003700 1 -- 172.21.15.123:0/3806650112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b4003a20 msgr2=0x7f02b4003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02ce003700 1 --2- 172.21.15.123:0/3806650112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b4003a20 0x7f02b4003e40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009d40 tx=0x7f02b40058a0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02ce003700 1 -- 172.21.15.123:0/3806650112 shutdown_connections 2024-09-13T17:08:06.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02ce003700 1 --2- 172.21.15.123:0/3806650112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b4003a20 0x7f02b4003e40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02ce003700 1 -- 172.21.15.123:0/3806650112 >> 172.21.15.123:0/3806650112 conn(0x7f02c8066150 msgr2=0x7f02c8066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:06.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02ce003700 1 -- 172.21.15.123:0/3806650112 shutdown_connections 2024-09-13T17:08:06.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.320+0000 7f02ce003700 1 -- 172.21.15.123:0/3806650112 wait complete. 2024-09-13T17:08:06.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02ce003700 1 Processor -- start 2024-09-13T17:08:06.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02ce003700 1 -- start start 2024-09-13T17:08:06.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02ce003700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b4003a20 0x7f02c8147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02ce003700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02c815ab20 0x7f02c81f99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02ce003700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02c81eb990 0x7f02c81f9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02ce003700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c81fa460 con 0x7f02b4003a20 2024-09-13T17:08:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02ce003700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c815b350 con 0x7f02c81eb990 2024-09-13T17:08:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02ce003700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c81eaed0 con 0x7f02c815ab20 2024-09-13T17:08:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02cd001700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b4003a20 0x7f02c8147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02cd001700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b4003a20 0x7f02c8147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56404/0 (socket says 172.21.15.123:56404) 2024-09-13T17:08:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02cd001700 1 -- 172.21.15.123:0/2350857565 learned_addr learned my addr 172.21.15.123:0/2350857565 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02cc800700 1 --2- 172.21.15.123:0/2350857565 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02c815ab20 0x7f02c81f99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02cd802700 1 --2- 172.21.15.123:0/2350857565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02c81eb990 0x7f02c81f9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02cd001700 1 -- 172.21.15.123:0/2350857565 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02c815ab20 msgr2=0x7f02c81f99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02cd001700 1 --2- 172.21.15.123:0/2350857565 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02c815ab20 0x7f02c81f99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02cd001700 1 -- 172.21.15.123:0/2350857565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02c81eb990 msgr2=0x7f02c81f9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02cd001700 1 --2- 172.21.15.123:0/2350857565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02c81eb990 0x7f02c81f9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02cd001700 1 -- 172.21.15.123:0/2350857565 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c815b070 con 0x7f02b4003a20 2024-09-13T17:08:06.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02cd001700 1 --2- 172.21.15.123:0/2350857565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b4003a20 0x7f02c8147560 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f02c40090b0 tx=0x7f02c40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:06.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02b9ffb700 1 -- 172.21.15.123:0/2350857565 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4003ad0 con 0x7f02b4003a20 2024-09-13T17:08:06.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02b9ffb700 1 -- 172.21.15.123:0/2350857565 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4003c30 con 0x7f02b4003a20 2024-09-13T17:08:06.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02ce003700 1 -- 172.21.15.123:0/2350857565 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c81eb190 con 0x7f02b4003a20 2024-09-13T17:08:06.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02b9ffb700 1 -- 172.21.15.123:0/2350857565 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4009e90 con 0x7f02b4003a20 2024-09-13T17:08:06.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.324+0000 7f02ce003700 1 -- 172.21.15.123:0/2350857565 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c8147aa0 con 0x7f02b4003a20 2024-09-13T17:08:06.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.328+0000 7f02ce003700 1 -- 172.21.15.123:0/2350857565 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c80677f0 con 0x7f02b4003a20 2024-09-13T17:08:06.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.328+0000 7f02b9ffb700 1 -- 172.21.15.123:0/2350857565 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f02c4013470 con 0x7f02b4003a20 2024-09-13T17:08:06.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.328+0000 7f02b9ffb700 1 --2- 172.21.15.123:0/2350857565 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f02ac066760 0x7f02ac068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.328+0000 7f02b9ffb700 1 -- 172.21.15.123:0/2350857565 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02c40856e0 con 0x7f02b4003a20 2024-09-13T17:08:06.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.328+0000 7f02cc800700 1 --2- 172.21.15.123:0/2350857565 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f02ac066760 0x7f02ac068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.328+0000 7f02cc800700 1 --2- 172.21.15.123:0/2350857565 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f02ac066760 0x7f02ac068c20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f02bc000c00 tx=0x7f02bc009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.336+0000 7f02b9ffb700 1 -- 172.21.15.123:0/2350857565 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f02c4052ae0 con 0x7f02b4003a20 2024-09-13T17:08:06.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.544+0000 7f02ce003700 1 -- 172.21.15.123:0/2350857565 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02c8147c60 con 0x7f02b4003a20 2024-09-13T17:08:06.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.544+0000 7f02b9ffb700 1 -- 172.21.15.123:0/2350857565 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4737 (secure 0 0 0) 0x7f02c4056100 con 0x7f02b4003a20 2024-09-13T17:08:06.547 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:06.548 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/675597916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":675597916},{"type":"v1","addr":"172.21.15.153:6835","nonce":675597916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/943744723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":943744723},{"type":"v1","addr":"172.21.15.153:6834","nonce":943744723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/625103317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":625103317},{"type":"v1","addr":"172.21.15.123:6835","nonce":625103317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:07:46.797973+0000","modified":"2024-09-13T17:07:48.808133+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2359124958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2359124958},{"type":"v1","addr":"172.21.15.123:6837","nonce":2359124958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:08:06.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.544+0000 7f02ce003700 1 -- 172.21.15.123:0/2350857565 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f02ac066760 msgr2=0x7f02ac068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.544+0000 7f02ce003700 1 --2- 172.21.15.123:0/2350857565 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f02ac066760 0x7f02ac068c20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f02bc000c00 tx=0x7f02bc009040 comp rx=0 tx=0).stop 2024-09-13T17:08:06.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.544+0000 7f02ce003700 1 -- 172.21.15.123:0/2350857565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b4003a20 msgr2=0x7f02c8147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.544+0000 7f02ce003700 1 --2- 172.21.15.123:0/2350857565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b4003a20 0x7f02c8147560 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f02c40090b0 tx=0x7f02c40047e0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.548+0000 7f02ce003700 1 -- 172.21.15.123:0/2350857565 shutdown_connections 2024-09-13T17:08:06.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.548+0000 7f02ce003700 1 --2- 172.21.15.123:0/2350857565 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f02ac066760 0x7f02ac068c20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.548+0000 7f02ce003700 1 --2- 172.21.15.123:0/2350857565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02c81eb990 0x7f02c81f9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.548+0000 7f02ce003700 1 --2- 172.21.15.123:0/2350857565 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02c815ab20 0x7f02c81f99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.548+0000 7f02ce003700 1 --2- 172.21.15.123:0/2350857565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b4003a20 0x7f02c8147560 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.548+0000 7f02ce003700 1 -- 172.21.15.123:0/2350857565 >> 172.21.15.123:0/2350857565 conn(0x7f02c8066150 msgr2=0x7f02c806c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:06.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.548+0000 7f02ce003700 1 -- 172.21.15.123:0/2350857565 shutdown_connections 2024-09-13T17:08:06.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.548+0000 7f02ce003700 1 -- 172.21.15.123:0/2350857565 wait complete. 2024-09-13T17:08:06.551 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 13 2024-09-13T17:08:06.562 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:06.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.672+0000 7feab759e700 1 Processor -- start 2024-09-13T17:08:06.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.672+0000 7feab759e700 1 -- start start 2024-09-13T17:08:06.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.672+0000 7feab759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feab8155180 0x7feab80ae710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.672+0000 7feab759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7feab80b21d0 0x7feab815b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.672+0000 7feab759e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab80af340 con 0x7feab80cc5c0 2024-09-13T17:08:06.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.672+0000 7feab759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab8155560 con 0x7feab80b21d0 2024-09-13T17:08:06.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.672+0000 7feab759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab80af060 con 0x7feab8155180 2024-09-13T17:08:06.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.672+0000 7feaaffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7feab80cc5c0 0x7feab80b1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55472/0 (socket says 172.21.15.123:55472) 2024-09-13T17:08:06.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.672+0000 7feaaffff700 1 -- 172.21.15.123:0/591906452 learned_addr learned my addr 172.21.15.123:0/591906452 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:06.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab6d9d700 1 --2- 172.21.15.123:0/591906452 >> v2:172.21.15.153:3300/0 conn(0x7feab80b21d0 0x7feab815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab659c700 1 --2- 172.21.15.123:0/591906452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feab8155180 0x7feab80ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab5d9b700 1 -- 172.21.15.123:0/591906452 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835445638 0 0) 0x7feab80af340 con 0x7feab80cc5c0 2024-09-13T17:08:06.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab5d9b700 1 -- 172.21.15.123:0/591906452 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaa40035d0 con 0x7feab80cc5c0 2024-09-13T17:08:06.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab6d9d700 1 -- 172.21.15.123:0/591906452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feab8155180 msgr2=0x7feab80ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:06.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab6d9d700 1 --2- 172.21.15.123:0/591906452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feab8155180 0x7feab80ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab6d9d700 1 -- 172.21.15.123:0/591906452 >> v1:172.21.15.123:6789/0 conn(0x7feab80cc5c0 legacy=0x7feab80b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab6d9d700 1 -- 172.21.15.123:0/591906452 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab806f320 con 0x7feab80b21d0 2024-09-13T17:08:06.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab6d9d700 1 --2- 172.21.15.123:0/591906452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feab80b21d0 0x7feab815b020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feab0009d90 tx=0x7feab000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6a0dda5bbf1f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:06.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab5d9b700 1 -- 172.21.15.123:0/591906452 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab000e070 con 0x7feab80b21d0 2024-09-13T17:08:06.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab5d9b700 1 -- 172.21.15.123:0/591906452 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab000bb20 con 0x7feab80b21d0 2024-09-13T17:08:06.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab5d9b700 1 -- 172.21.15.123:0/591906452 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab000be90 con 0x7feab80b21d0 2024-09-13T17:08:06.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab759e700 1 -- 172.21.15.123:0/591906452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feab80b21d0 msgr2=0x7feab815b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab759e700 1 --2- 172.21.15.123:0/591906452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feab80b21d0 0x7feab815b020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feab0009d90 tx=0x7feab000b330 comp rx=0 tx=0).stop 2024-09-13T17:08:06.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab759e700 1 -- 172.21.15.123:0/591906452 shutdown_connections 2024-09-13T17:08:06.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab759e700 1 --2- 172.21.15.123:0/591906452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feab80b21d0 0x7feab815b020 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab759e700 1 --2- 172.21.15.123:0/591906452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feab8155180 0x7feab80ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab759e700 1 -- 172.21.15.123:0/591906452 >> 172.21.15.123:0/591906452 conn(0x7feab8066570 msgr2=0x7feab8066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:06.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab759e700 1 -- 172.21.15.123:0/591906452 shutdown_connections 2024-09-13T17:08:06.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.676+0000 7feab759e700 1 -- 172.21.15.123:0/591906452 wait complete. 2024-09-13T17:08:06.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab759e700 1 Processor -- start 2024-09-13T17:08:06.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab759e700 1 -- start start 2024-09-13T17:08:06.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feab80b21d0 0x7feab814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feab80cc5c0 0x7feab81e3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feab8155180 0x7feab8157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab81581d0 con 0x7feab8155180 2024-09-13T17:08:06.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab81584b0 con 0x7feab80b21d0 2024-09-13T17:08:06.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab8158790 con 0x7feab80cc5c0 2024-09-13T17:08:06.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feab8155180 0x7feab8157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feab8155180 0x7feab8157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56406/0 (socket says 172.21.15.123:56406) 2024-09-13T17:08:06.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab6d9d700 1 -- 172.21.15.123:0/3901388845 learned_addr learned my addr 172.21.15.123:0/3901388845 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:06.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feaaffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feab80cc5c0 0x7feab81e3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab659c700 1 --2- 172.21.15.123:0/3901388845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feab80b21d0 0x7feab814ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab6d9d700 1 -- 172.21.15.123:0/3901388845 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feab80cc5c0 msgr2=0x7feab81e3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab6d9d700 1 --2- 172.21.15.123:0/3901388845 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feab80cc5c0 0x7feab81e3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab6d9d700 1 -- 172.21.15.123:0/3901388845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feab80b21d0 msgr2=0x7feab814ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab6d9d700 1 --2- 172.21.15.123:0/3901388845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feab80b21d0 0x7feab814ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab6d9d700 1 -- 172.21.15.123:0/3901388845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab0009a70 con 0x7feab8155180 2024-09-13T17:08:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab659c700 1 --2- 172.21.15.123:0/3901388845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feab80b21d0 0x7feab814ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab6d9d700 1 --2- 172.21.15.123:0/3901388845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feab8155180 0x7feab8157450 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7feab0014040 tx=0x7feab0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feaaeffd700 1 -- 172.21.15.123:0/3901388845 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab0007000 con 0x7feab8155180 2024-09-13T17:08:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feaaeffd700 1 -- 172.21.15.123:0/3901388845 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab0012650 con 0x7feab8155180 2024-09-13T17:08:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab759e700 1 -- 172.21.15.123:0/3901388845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab8158a70 con 0x7feab8155180 2024-09-13T17:08:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feaaeffd700 1 -- 172.21.15.123:0/3901388845 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab0012a00 con 0x7feab8155180 2024-09-13T17:08:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.680+0000 7feab759e700 1 -- 172.21.15.123:0/3901388845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab81e4080 con 0x7feab8155180 2024-09-13T17:08:06.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.684+0000 7feab759e700 1 -- 172.21.15.123:0/3901388845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab80677f0 con 0x7feab8155180 2024-09-13T17:08:06.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.684+0000 7feaaeffd700 1 -- 172.21.15.123:0/3901388845 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feab0012b60 con 0x7feab8155180 2024-09-13T17:08:06.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.684+0000 7feaaeffd700 1 --2- 172.21.15.123:0/3901388845 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fea98066730 0x7fea98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:06.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.684+0000 7feaaeffd700 1 -- 172.21.15.123:0/3901388845 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feab0086160 con 0x7feab8155180 2024-09-13T17:08:06.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.684+0000 7feab659c700 1 --2- 172.21.15.123:0/3901388845 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fea98066730 0x7fea98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:06.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.684+0000 7feab659c700 1 --2- 172.21.15.123:0/3901388845 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fea98066730 0x7fea98068bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009ba0 tx=0x7feaa8008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:06.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.692+0000 7feaaeffd700 1 -- 172.21.15.123:0/3901388845 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feab0053560 con 0x7feab8155180 2024-09-13T17:08:06.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.868+0000 7feab759e700 1 -- 172.21.15.123:0/3901388845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feab8072a10 con 0x7feab8155180 2024-09-13T17:08:06.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.872+0000 7feaaeffd700 1 -- 172.21.15.123:0/3901388845 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16617 (secure 0 0 0) 0x7feab0056b80 con 0x7feab8155180 2024-09-13T17:08:06.876 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:06.876 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":34,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:07:47.800958+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:07:44.636174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T17:07:45.802714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:06.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.876+0000 7feab759e700 1 -- 172.21.15.123:0/3901388845 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fea98066730 msgr2=0x7fea98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.876+0000 7feab759e700 1 --2- 172.21.15.123:0/3901388845 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fea98066730 0x7fea98068bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009ba0 tx=0x7feaa8008040 comp rx=0 tx=0).stop 2024-09-13T17:08:06.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.876+0000 7feab759e700 1 -- 172.21.15.123:0/3901388845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feab8155180 msgr2=0x7feab8157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:06.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.876+0000 7feab759e700 1 --2- 172.21.15.123:0/3901388845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feab8155180 0x7feab8157450 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7feab0014040 tx=0x7feab0004af0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.876+0000 7feab759e700 1 -- 172.21.15.123:0/3901388845 shutdown_connections 2024-09-13T17:08:06.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.876+0000 7feab759e700 1 --2- 172.21.15.123:0/3901388845 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fea98066730 0x7fea98068bf0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.876+0000 7feab759e700 1 --2- 172.21.15.123:0/3901388845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feab8155180 0x7feab8157450 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.876+0000 7feab759e700 1 --2- 172.21.15.123:0/3901388845 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feab80cc5c0 0x7feab81e3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.876+0000 7feab759e700 1 --2- 172.21.15.123:0/3901388845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feab80b21d0 0x7feab814ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:06.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.876+0000 7feab759e700 1 -- 172.21.15.123:0/3901388845 >> 172.21.15.123:0/3901388845 conn(0x7feab8066570 msgr2=0x7feab80b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:06.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.876+0000 7feab759e700 1 -- 172.21.15.123:0/3901388845 shutdown_connections 2024-09-13T17:08:06.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.876+0000 7feab759e700 1 -- 172.21.15.123:0/3901388845 wait complete. 2024-09-13T17:08:06.891 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:08:06.892 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:08:07.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.996+0000 7f7885103700 1 Processor -- start 2024-09-13T17:08:07.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:06.996+0000 7f7885103700 1 -- start start 2024-09-13T17:08:07.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7885103700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f78801598b0 0x7f7880071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7885103700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f78800cedc0 0x7f7880159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7885103700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788015d360 con 0x7f78800cdfd0 2024-09-13T17:08:07.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7885103700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78800ce400 con 0x7f78801598b0 2024-09-13T17:08:07.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7885103700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78800724c0 con 0x7f78800cedc0 2024-09-13T17:08:07.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f787ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f78801598b0 0x7f7880071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f787ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f78801598b0 0x7f7880071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56418/0 (socket says 172.21.15.123:56418) 2024-09-13T17:08:07.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f787ffff700 1 -- 172.21.15.123:0/1694885487 learned_addr learned my addr 172.21.15.123:0/1694885487 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:07.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7884902700 1 --2- 172.21.15.123:0/1694885487 >> v2:172.21.15.153:3300/0 conn(0x7f78800cedc0 0x7f7880159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f787ffff700 1 -- 172.21.15.123:0/1694885487 >> v2:172.21.15.153:3300/0 conn(0x7f78800cedc0 msgr2=0x7f7880159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:07.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f787ffff700 1 --2- 172.21.15.123:0/1694885487 >> v2:172.21.15.153:3300/0 conn(0x7f78800cedc0 0x7f7880159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f787ffff700 1 -- 172.21.15.123:0/1694885487 >> v1:172.21.15.153:6789/0 conn(0x7f78800cdfd0 legacy=0x7f78800ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:07.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f787ffff700 1 -- 172.21.15.123:0/1694885487 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788015d5b0 con 0x7f78801598b0 2024-09-13T17:08:07.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7884902700 1 --2- 172.21.15.123:0/1694885487 >> v2:172.21.15.153:3300/0 conn(0x7f78800cedc0 0x7f7880159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:07.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f787ffff700 1 --2- 172.21.15.123:0/1694885487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78801598b0 0x7f7880071e60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f78800cdcb0 tx=0x7f7874009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d44bc93a287e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:07.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f787effd700 1 -- 172.21.15.123:0/1694885487 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874004230 con 0x7f78801598b0 2024-09-13T17:08:07.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f787effd700 1 -- 172.21.15.123:0/1694885487 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7874004390 con 0x7f78801598b0 2024-09-13T17:08:07.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f787effd700 1 -- 172.21.15.123:0/1694885487 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78740036c0 con 0x7f78801598b0 2024-09-13T17:08:07.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7885103700 1 -- 172.21.15.123:0/1694885487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78801598b0 msgr2=0x7f7880071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7885103700 1 --2- 172.21.15.123:0/1694885487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78801598b0 0x7f7880071e60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f78800cdcb0 tx=0x7f7874009bf0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7885103700 1 -- 172.21.15.123:0/1694885487 shutdown_connections 2024-09-13T17:08:07.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7885103700 1 --2- 172.21.15.123:0/1694885487 >> v2:172.21.15.153:3300/0 conn(0x7f78800cedc0 0x7f7880159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7885103700 1 --2- 172.21.15.123:0/1694885487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78801598b0 0x7f7880071e60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7885103700 1 -- 172.21.15.123:0/1694885487 >> 172.21.15.123:0/1694885487 conn(0x7f7880066150 msgr2=0x7f7880066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:07.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7885103700 1 -- 172.21.15.123:0/1694885487 shutdown_connections 2024-09-13T17:08:07.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7885103700 1 -- 172.21.15.123:0/1694885487 wait complete. 2024-09-13T17:08:07.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.000+0000 7f7885103700 1 Processor -- start 2024-09-13T17:08:07.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f7885103700 1 -- start start 2024-09-13T17:08:07.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f7885103700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78800cdfd0 0x7f788015c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f7885103700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78800cedc0 0x7f78801e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f7885103700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78801598b0 0x7f7880155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f7885103700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78801f26f0 con 0x7f78800cdfd0 2024-09-13T17:08:07.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f7885103700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7880157f90 con 0x7f78801598b0 2024-09-13T17:08:07.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f7885103700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7880158270 con 0x7f78800cedc0 2024-09-13T17:08:07.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f787ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78800cdfd0 0x7f788015c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f787ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78800cdfd0 0x7f788015c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56426/0 (socket says 172.21.15.123:56426) 2024-09-13T17:08:07.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f787ffff700 1 -- 172.21.15.123:0/1390410817 learned_addr learned my addr 172.21.15.123:0/1390410817 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:07.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f7884902700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78801598b0 0x7f7880155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f787f7fe700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78800cedc0 0x7f78801e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f787ffff700 1 -- 172.21.15.123:0/1390410817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78800cedc0 msgr2=0x7f78801e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f787ffff700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78800cedc0 0x7f78801e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f787ffff700 1 -- 172.21.15.123:0/1390410817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78801598b0 msgr2=0x7f7880155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f787ffff700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78801598b0 0x7f7880155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f787ffff700 1 -- 172.21.15.123:0/1390410817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7874009570 con 0x7f78800cdfd0 2024-09-13T17:08:07.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f787f7fe700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78800cedc0 0x7f78801e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:07.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f787ffff700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78800cdfd0 0x7f788015c2c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7874004000 tx=0x7f7874004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:07.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f787cff9700 1 -- 172.21.15.123:0/1390410817 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874003ea0 con 0x7f78800cdfd0 2024-09-13T17:08:07.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f787cff9700 1 -- 172.21.15.123:0/1390410817 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787400b860 con 0x7f78800cdfd0 2024-09-13T17:08:07.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f787cff9700 1 -- 172.21.15.123:0/1390410817 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787400bc10 con 0x7f78800cdfd0 2024-09-13T17:08:07.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f7885103700 1 -- 172.21.15.123:0/1390410817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7880158550 con 0x7f78800cdfd0 2024-09-13T17:08:07.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f7885103700 1 -- 172.21.15.123:0/1390410817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788015c800 con 0x7f78800cdfd0 2024-09-13T17:08:07.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.004+0000 7f7885103700 1 -- 172.21.15.123:0/1390410817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78800677f0 con 0x7f78800cdfd0 2024-09-13T17:08:07.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.008+0000 7f787cff9700 1 -- 172.21.15.123:0/1390410817 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7874021070 con 0x7f78800cdfd0 2024-09-13T17:08:07.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.008+0000 7f787cff9700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f786c066730 0x7f786c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.008+0000 7f787cff9700 1 -- 172.21.15.123:0/1390410817 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7874085c10 con 0x7f78800cdfd0 2024-09-13T17:08:07.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.008+0000 7f787f7fe700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f786c066730 0x7f786c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.008+0000 7f787f7fe700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f786c066730 0x7f786c068bf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f78801f5c10 tx=0x7f7870009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:07.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.012+0000 7f787cff9700 1 -- 172.21.15.123:0/1390410817 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7874053010 con 0x7f78800cdfd0 2024-09-13T17:08:07.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.220+0000 7f7885103700 1 -- 172.21.15.123:0/1390410817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f788015c990 con 0x7f78800cdfd0 2024-09-13T17:08:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.224+0000 7f787cff9700 1 -- 172.21.15.123:0/1390410817 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4737 (secure 0 0 0) 0x7f7874029020 con 0x7f78800cdfd0 2024-09-13T17:08:07.227 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:07.227 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/675597916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":675597916},{"type":"v1","addr":"172.21.15.153:6835","nonce":675597916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/943744723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":943744723},{"type":"v1","addr":"172.21.15.153:6834","nonce":943744723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/625103317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":625103317},{"type":"v1","addr":"172.21.15.123:6835","nonce":625103317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:07:46.797973+0000","modified":"2024-09-13T17:07:48.808133+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2359124958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2359124958},{"type":"v1","addr":"172.21.15.123:6837","nonce":2359124958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:08:07.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.224+0000 7f7885103700 1 -- 172.21.15.123:0/1390410817 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f786c066730 msgr2=0x7f786c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.224+0000 7f7885103700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f786c066730 0x7f786c068bf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f78801f5c10 tx=0x7f7870009040 comp rx=0 tx=0).stop 2024-09-13T17:08:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.224+0000 7f7885103700 1 -- 172.21.15.123:0/1390410817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78800cdfd0 msgr2=0x7f788015c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.224+0000 7f7885103700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78800cdfd0 0x7f788015c2c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7874004000 tx=0x7f7874004770 comp rx=0 tx=0).stop 2024-09-13T17:08:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.224+0000 7f7885103700 1 -- 172.21.15.123:0/1390410817 shutdown_connections 2024-09-13T17:08:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.224+0000 7f7885103700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f786c066730 0x7f786c068bf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.224+0000 7f7885103700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78801598b0 0x7f7880155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.224+0000 7f7885103700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f78800cedc0 0x7f78801e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.224+0000 7f7885103700 1 --2- 172.21.15.123:0/1390410817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78800cdfd0 0x7f788015c2c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.224+0000 7f7885103700 1 -- 172.21.15.123:0/1390410817 >> 172.21.15.123:0/1390410817 conn(0x7f7880066150 msgr2=0x7f788006d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.224+0000 7f7885103700 1 -- 172.21.15.123:0/1390410817 shutdown_connections 2024-09-13T17:08:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.224+0000 7f7885103700 1 -- 172.21.15.123:0/1390410817 wait complete. 2024-09-13T17:08:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 13 2024-09-13T17:08:07.242 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:08:07.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff517fff700 1 Processor -- start 2024-09-13T17:08:07.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff517fff700 1 -- start start 2024-09-13T17:08:07.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff517fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff5181598b0 0x7ff518071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff517fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51815d360 con 0x7ff5180cdfd0 2024-09-13T17:08:07.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff517fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5180ce400 con 0x7ff5180cedc0 2024-09-13T17:08:07.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff517fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5180724c0 con 0x7ff5181598b0 2024-09-13T17:08:07.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff50ffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff5180cdfd0 0x7ff5180ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55480/0 (socket says 172.21.15.123:55480) 2024-09-13T17:08:07.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff50ffff700 1 -- 172.21.15.123:0/1350190090 learned_addr learned my addr 172.21.15.123:0/1350190090 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:07.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff516ffd700 1 --2- 172.21.15.123:0/1350190090 >> v2:172.21.15.153:3300/0 conn(0x7ff5181598b0 0x7ff518071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff5167fc700 1 -- 172.21.15.123:0/1350190090 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537410858 0 0) 0x7ff51815d360 con 0x7ff5180cdfd0 2024-09-13T17:08:07.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff5167fc700 1 -- 172.21.15.123:0/1350190090 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5040057e0 con 0x7ff5180cdfd0 2024-09-13T17:08:07.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff516ffd700 1 -- 172.21.15.123:0/1350190090 >> v1:172.21.15.153:6789/0 conn(0x7ff5180cedc0 legacy=0x7ff518159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff516ffd700 1 -- 172.21.15.123:0/1350190090 >> v1:172.21.15.123:6789/0 conn(0x7ff5180cdfd0 legacy=0x7ff5180ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff5167fc700 1 -- 172.21.15.123:0/1350190090 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 336840932 0 0) 0x7ff5040057e0 con 0x7ff5180cdfd0 2024-09-13T17:08:07.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.348+0000 7ff516ffd700 1 -- 172.21.15.123:0/1350190090 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51815d5b0 con 0x7ff5181598b0 2024-09-13T17:08:07.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.352+0000 7ff516ffd700 1 --2- 172.21.15.123:0/1350190090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5181598b0 0x7ff518071e60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff508009850 tx=0x7ff508009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=110d89ba5b64928e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:07.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.352+0000 7ff5167fc700 1 -- 172.21.15.123:0/1350190090 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508011830 con 0x7ff5181598b0 2024-09-13T17:08:07.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.352+0000 7ff5167fc700 1 -- 172.21.15.123:0/1350190090 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff508011990 con 0x7ff5181598b0 2024-09-13T17:08:07.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.352+0000 7ff5167fc700 1 -- 172.21.15.123:0/1350190090 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508011d00 con 0x7ff5181598b0 2024-09-13T17:08:07.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.352+0000 7ff517fff700 1 -- 172.21.15.123:0/1350190090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5181598b0 msgr2=0x7ff518071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.352+0000 7ff517fff700 1 --2- 172.21.15.123:0/1350190090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5181598b0 0x7ff518071e60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff508009850 tx=0x7ff508009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:07.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.352+0000 7ff517fff700 1 -- 172.21.15.123:0/1350190090 shutdown_connections 2024-09-13T17:08:07.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.352+0000 7ff517fff700 1 --2- 172.21.15.123:0/1350190090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5181598b0 0x7ff518071e60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.352+0000 7ff517fff700 1 -- 172.21.15.123:0/1350190090 >> 172.21.15.123:0/1350190090 conn(0x7ff518066150 msgr2=0x7ff518066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:07.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.352+0000 7ff517fff700 1 -- 172.21.15.123:0/1350190090 shutdown_connections 2024-09-13T17:08:07.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.352+0000 7ff517fff700 1 -- 172.21.15.123:0/1350190090 wait complete. 2024-09-13T17:08:07.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.352+0000 7ff517fff700 1 Processor -- start 2024-09-13T17:08:07.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.352+0000 7ff517fff700 1 -- start start 2024-09-13T17:08:07.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff517fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5180cdfd0 0x7ff518150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff517fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5180cedc0 0x7ff5181ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff517fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5181598b0 0x7ff5180af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff517fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff518153370 con 0x7ff5181598b0 2024-09-13T17:08:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff517fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff518156bb0 con 0x7ff5180cdfd0 2024-09-13T17:08:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff517fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff518156e90 con 0x7ff5180cedc0 2024-09-13T17:08:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff5177fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5181598b0 0x7ff5180af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff5177fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5181598b0 0x7ff5180af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56430/0 (socket says 172.21.15.123:56430) 2024-09-13T17:08:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff5177fe700 1 -- 172.21.15.123:0/3103884771 learned_addr learned my addr 172.21.15.123:0/3103884771 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff516ffd700 1 --2- 172.21.15.123:0/3103884771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5180cdfd0 0x7ff518150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff50ffff700 1 --2- 172.21.15.123:0/3103884771 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5180cedc0 0x7ff5181ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff5177fe700 1 -- 172.21.15.123:0/3103884771 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5180cedc0 msgr2=0x7ff5181ee2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff5177fe700 1 --2- 172.21.15.123:0/3103884771 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5180cedc0 0x7ff5181ee2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff5177fe700 1 -- 172.21.15.123:0/3103884771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5180cdfd0 msgr2=0x7ff518150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff5177fe700 1 --2- 172.21.15.123:0/3103884771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5180cdfd0 0x7ff518150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff5177fe700 1 -- 172.21.15.123:0/3103884771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5080094b0 con 0x7ff5181598b0 2024-09-13T17:08:07.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff5177fe700 1 --2- 172.21.15.123:0/3103884771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5181598b0 0x7ff5180af270 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff51000cc50 tx=0x7ff51000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:07.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff50f7fe700 1 -- 172.21.15.123:0/3103884771 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff510003c20 con 0x7ff5181598b0 2024-09-13T17:08:07.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff50f7fe700 1 -- 172.21.15.123:0/3103884771 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff510003d80 con 0x7ff5181598b0 2024-09-13T17:08:07.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff517fff700 1 -- 172.21.15.123:0/3103884771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff518157170 con 0x7ff5181598b0 2024-09-13T17:08:07.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff50f7fe700 1 -- 172.21.15.123:0/3103884771 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51000aab0 con 0x7ff5181598b0 2024-09-13T17:08:07.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff517fff700 1 -- 172.21.15.123:0/3103884771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5181567d0 con 0x7ff5181598b0 2024-09-13T17:08:07.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff517fff700 1 -- 172.21.15.123:0/3103884771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5180677f0 con 0x7ff5181598b0 2024-09-13T17:08:07.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.356+0000 7ff50f7fe700 1 -- 172.21.15.123:0/3103884771 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff51000ac10 con 0x7ff5181598b0 2024-09-13T17:08:07.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.360+0000 7ff50f7fe700 1 --2- 172.21.15.123:0/3103884771 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4f8066760 0x7ff4f8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.360+0000 7ff50f7fe700 1 -- 172.21.15.123:0/3103884771 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5100840a0 con 0x7ff5181598b0 2024-09-13T17:08:07.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.360+0000 7ff516ffd700 1 --2- 172.21.15.123:0/3103884771 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4f8066760 0x7ff4f8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.360+0000 7ff516ffd700 1 --2- 172.21.15.123:0/3103884771 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4f8066760 0x7ff4f8068c20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff5080090b0 tx=0x7ff508008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:07.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.364+0000 7ff50f7fe700 1 -- 172.21.15.123:0/3103884771 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5100514a0 con 0x7ff5181598b0 2024-09-13T17:08:07.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.568+0000 7ff517fff700 1 -- 172.21.15.123:0/3103884771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff518071e60 con 0x7ff5181598b0 2024-09-13T17:08:07.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.568+0000 7ff50f7fe700 1 -- 172.21.15.123:0/3103884771 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4737 (secure 0 0 0) 0x7ff510054ac0 con 0x7ff5181598b0 2024-09-13T17:08:07.571 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:07.572 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/675597916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":675597916},{"type":"v1","addr":"172.21.15.153:6835","nonce":675597916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/943744723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":943744723},{"type":"v1","addr":"172.21.15.153:6834","nonce":943744723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/625103317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":625103317},{"type":"v1","addr":"172.21.15.123:6835","nonce":625103317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:07:46.797973+0000","modified":"2024-09-13T17:07:48.808133+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2359124958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2359124958},{"type":"v1","addr":"172.21.15.123:6837","nonce":2359124958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:08:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.568+0000 7ff517fff700 1 -- 172.21.15.123:0/3103884771 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4f8066760 msgr2=0x7ff4f8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.568+0000 7ff517fff700 1 --2- 172.21.15.123:0/3103884771 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4f8066760 0x7ff4f8068c20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff5080090b0 tx=0x7ff508008030 comp rx=0 tx=0).stop 2024-09-13T17:08:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.568+0000 7ff517fff700 1 -- 172.21.15.123:0/3103884771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5181598b0 msgr2=0x7ff5180af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.568+0000 7ff517fff700 1 --2- 172.21.15.123:0/3103884771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5181598b0 0x7ff5180af270 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff51000cc50 tx=0x7ff51000cf60 comp rx=0 tx=0).stop 2024-09-13T17:08:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.568+0000 7ff517fff700 1 -- 172.21.15.123:0/3103884771 shutdown_connections 2024-09-13T17:08:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.568+0000 7ff517fff700 1 --2- 172.21.15.123:0/3103884771 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4f8066760 0x7ff4f8068c20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.568+0000 7ff517fff700 1 --2- 172.21.15.123:0/3103884771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5181598b0 0x7ff5180af270 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.568+0000 7ff517fff700 1 --2- 172.21.15.123:0/3103884771 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5180cedc0 0x7ff5181ee2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.568+0000 7ff517fff700 1 --2- 172.21.15.123:0/3103884771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5180cdfd0 0x7ff518150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.568+0000 7ff517fff700 1 -- 172.21.15.123:0/3103884771 >> 172.21.15.123:0/3103884771 conn(0x7ff518066150 msgr2=0x7ff5180cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:07.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.572+0000 7ff517fff700 1 -- 172.21.15.123:0/3103884771 shutdown_connections 2024-09-13T17:08:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.572+0000 7ff517fff700 1 -- 172.21.15.123:0/3103884771 wait complete. 2024-09-13T17:08:07.575 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 13 2024-09-13T17:08:07.586 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:07.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.692+0000 7f3bc3979700 1 Processor -- start 2024-09-13T17:08:07.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.692+0000 7f3bc3979700 1 -- start start 2024-09-13T17:08:07.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc3979700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3bbc072510 0x7f3bbc0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc3979700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3bbc0cd200 0x7f3bbc0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc3979700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bbc0b1cf0 con 0x7f3bbc15aa80 2024-09-13T17:08:07.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc3979700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bbc15ae60 con 0x7f3bbc072510 2024-09-13T17:08:07.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc3979700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0b3150 con 0x7f3bbc0cd200 2024-09-13T17:08:07.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc0f14700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3bbc072510 0x7f3bbc0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc0f14700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3bbc072510 0x7f3bbc0cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56436/0 (socket says 172.21.15.123:56436) 2024-09-13T17:08:07.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc0f14700 1 -- 172.21.15.123:0/3773338617 learned_addr learned my addr 172.21.15.123:0/3773338617 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:07.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc1f16700 1 --2- 172.21.15.123:0/3773338617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3bbc0cd200 0x7f3bbc0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc0f14700 1 -- 172.21.15.123:0/3773338617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3bbc0cd200 msgr2=0x7f3bbc0cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:07.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc0f14700 1 --2- 172.21.15.123:0/3773338617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3bbc0cd200 0x7f3bbc0cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc0f14700 1 -- 172.21.15.123:0/3773338617 >> v1:172.21.15.153:6789/0 conn(0x7f3bbc15aa80 legacy=0x7f3bbc15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc0f14700 1 -- 172.21.15.123:0/3773338617 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0b37f0 con 0x7f3bbc072510 2024-09-13T17:08:07.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc0f14700 1 --2- 172.21.15.123:0/3773338617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bbc072510 0x7f3bbc0cccc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009940 tx=0x7f3bac009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62019298a27a165b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:07.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bb3fff700 1 -- 172.21.15.123:0/3773338617 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00ba20 con 0x7f3bbc072510 2024-09-13T17:08:07.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bb3fff700 1 -- 172.21.15.123:0/3773338617 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac009e90 con 0x7f3bbc072510 2024-09-13T17:08:07.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bb3fff700 1 -- 172.21.15.123:0/3773338617 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00bda0 con 0x7f3bbc072510 2024-09-13T17:08:07.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc3979700 1 -- 172.21.15.123:0/3773338617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bbc072510 msgr2=0x7f3bbc0cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc3979700 1 --2- 172.21.15.123:0/3773338617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bbc072510 0x7f3bbc0cccc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009940 tx=0x7f3bac009c50 comp rx=0 tx=0).stop 2024-09-13T17:08:07.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc3979700 1 -- 172.21.15.123:0/3773338617 shutdown_connections 2024-09-13T17:08:07.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc3979700 1 --2- 172.21.15.123:0/3773338617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3bbc0cd200 0x7f3bbc0cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc3979700 1 --2- 172.21.15.123:0/3773338617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bbc072510 0x7f3bbc0cccc0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc3979700 1 -- 172.21.15.123:0/3773338617 >> 172.21.15.123:0/3773338617 conn(0x7f3bbc066570 msgr2=0x7f3bbc066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:07.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc3979700 1 -- 172.21.15.123:0/3773338617 shutdown_connections 2024-09-13T17:08:07.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.696+0000 7f3bc3979700 1 -- 172.21.15.123:0/3773338617 wait complete. 2024-09-13T17:08:07.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc3979700 1 Processor -- start 2024-09-13T17:08:07.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc3979700 1 -- start start 2024-09-13T17:08:07.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc3979700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bbc072510 0x7f3bbc1f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc3979700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bbc0cd200 0x7f3bbc140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc3979700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3bbc15aa80 0x7f3bbc1e5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc3979700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0ae580 con 0x7f3bbc072510 2024-09-13T17:08:07.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc3979700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc1f4b40 con 0x7f3bbc0cd200 2024-09-13T17:08:07.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc3979700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc1f42a0 con 0x7f3bbc15aa80 2024-09-13T17:08:07.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc1715700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bbc072510 0x7f3bbc1f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc1715700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bbc072510 0x7f3bbc1f3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56448/0 (socket says 172.21.15.123:56448) 2024-09-13T17:08:07.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc1715700 1 -- 172.21.15.123:0/4113750070 learned_addr learned my addr 172.21.15.123:0/4113750070 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:07.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc0f14700 1 --2- 172.21.15.123:0/4113750070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bbc0cd200 0x7f3bbc140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc1f16700 1 --2- 172.21.15.123:0/4113750070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3bbc15aa80 0x7f3bbc1e5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc1715700 1 -- 172.21.15.123:0/4113750070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3bbc15aa80 msgr2=0x7f3bbc1e5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc1715700 1 --2- 172.21.15.123:0/4113750070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3bbc15aa80 0x7f3bbc1e5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc1715700 1 -- 172.21.15.123:0/4113750070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bbc0cd200 msgr2=0x7f3bbc140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc1715700 1 --2- 172.21.15.123:0/4113750070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bbc0cd200 0x7f3bbc140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc1715700 1 -- 172.21.15.123:0/4113750070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac009570 con 0x7f3bbc072510 2024-09-13T17:08:07.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc1715700 1 --2- 172.21.15.123:0/4113750070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bbc072510 0x7f3bbc1f3c70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800c500 tx=0x7f3bb800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:07.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bb1ffb700 1 -- 172.21.15.123:0/4113750070 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb80052d0 con 0x7f3bbc072510 2024-09-13T17:08:07.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc3979700 1 -- 172.21.15.123:0/4113750070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bbc1f4580 con 0x7f3bbc072510 2024-09-13T17:08:07.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bb1ffb700 1 -- 172.21.15.123:0/4113750070 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb8005430 con 0x7f3bbc072510 2024-09-13T17:08:07.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bb1ffb700 1 -- 172.21.15.123:0/4113750070 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb80055a0 con 0x7f3bbc072510 2024-09-13T17:08:07.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.700+0000 7f3bc3979700 1 -- 172.21.15.123:0/4113750070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc15d300 con 0x7f3bbc072510 2024-09-13T17:08:07.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.704+0000 7f3bc3979700 1 -- 172.21.15.123:0/4113750070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc0ae3d0 con 0x7f3bbc072510 2024-09-13T17:08:07.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.704+0000 7f3bb1ffb700 1 -- 172.21.15.123:0/4113750070 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3bb80038e0 con 0x7f3bbc072510 2024-09-13T17:08:07.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.704+0000 7f3bb1ffb700 1 --2- 172.21.15.123:0/4113750070 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ba0066730 0x7f3ba0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:07.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.704+0000 7f3bb1ffb700 1 -- 172.21.15.123:0/4113750070 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bb8083590 con 0x7f3bbc072510 2024-09-13T17:08:07.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.704+0000 7f3bc0f14700 1 --2- 172.21.15.123:0/4113750070 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ba0066730 0x7f3ba0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:07.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.704+0000 7f3bc0f14700 1 --2- 172.21.15.123:0/4113750070 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ba0066730 0x7f3ba0068bf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3bac000c00 tx=0x7f3bac008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:07.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.708+0000 7f3bb1ffb700 1 -- 172.21.15.123:0/4113750070 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3bb8050880 con 0x7f3bbc072510 2024-09-13T17:08:07.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.884+0000 7f3bc3979700 1 -- 172.21.15.123:0/4113750070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bbc0cccc0 con 0x7f3bbc072510 2024-09-13T17:08:07.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.888+0000 7f3bb1ffb700 1 -- 172.21.15.123:0/4113750070 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f3bb8053ea0 con 0x7f3bbc072510 2024-09-13T17:08:07.891 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:07.891 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":34,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:07:47.800958+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:07:44.636174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T17:07:45.802714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:07.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.888+0000 7f3bc3979700 1 -- 172.21.15.123:0/4113750070 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ba0066730 msgr2=0x7f3ba0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.888+0000 7f3bc3979700 1 --2- 172.21.15.123:0/4113750070 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ba0066730 0x7f3ba0068bf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3bac000c00 tx=0x7f3bac008030 comp rx=0 tx=0).stop 2024-09-13T17:08:07.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.888+0000 7f3bc3979700 1 -- 172.21.15.123:0/4113750070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bbc072510 msgr2=0x7f3bbc1f3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:07.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.888+0000 7f3bc3979700 1 --2- 172.21.15.123:0/4113750070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bbc072510 0x7f3bbc1f3c70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800c500 tx=0x7f3bb800c810 comp rx=0 tx=0).stop 2024-09-13T17:08:07.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.888+0000 7f3bc3979700 1 -- 172.21.15.123:0/4113750070 shutdown_connections 2024-09-13T17:08:07.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.888+0000 7f3bc3979700 1 --2- 172.21.15.123:0/4113750070 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ba0066730 0x7f3ba0068bf0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.888+0000 7f3bc3979700 1 --2- 172.21.15.123:0/4113750070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3bbc15aa80 0x7f3bbc1e5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.888+0000 7f3bc3979700 1 --2- 172.21.15.123:0/4113750070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bbc0cd200 0x7f3bbc140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.888+0000 7f3bc3979700 1 --2- 172.21.15.123:0/4113750070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bbc072510 0x7f3bbc1f3c70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:07.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.888+0000 7f3bc3979700 1 -- 172.21.15.123:0/4113750070 >> 172.21.15.123:0/4113750070 conn(0x7f3bbc066570 msgr2=0x7f3bbc15b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:07.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.888+0000 7f3bc3979700 1 -- 172.21.15.123:0/4113750070 shutdown_connections 2024-09-13T17:08:07.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:07.888+0000 7f3bc3979700 1 -- 172.21.15.123:0/4113750070 wait complete. 2024-09-13T17:08:07.906 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:08:08.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 Processor -- start 2024-09-13T17:08:08.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 -- start start 2024-09-13T17:08:08.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49415b000 0x7fb494071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:08.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb4940ccfd0 0x7fb4940cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:08.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb4940cd410 0x7fb4940cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:08.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4940cdb90 con 0x7fb4940ccfd0 2024-09-13T17:08:08.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4940cc580 con 0x7fb4940cd410 2024-09-13T17:08:08.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940cdde0 con 0x7fb49415b000 2024-09-13T17:08:08.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb4994b1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb4940ccfd0 0x7fb4940cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:08.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb4994b1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb4940ccfd0 0x7fb4940cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56462/0 (socket says 172.21.15.123:56462) 2024-09-13T17:08:08.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb4994b1700 1 -- 172.21.15.123:0/1556904321 learned_addr learned my addr 172.21.15.123:0/1556904321 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:08.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49a4b3700 1 --2- 172.21.15.123:0/1556904321 >> v2:172.21.15.153:3300/0 conn(0x7fb4940cd410 0x7fb4940cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:08.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb499cb2700 1 --2- 172.21.15.123:0/1556904321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49415b000 0x7fb494071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:08.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb4994b1700 1 -- 172.21.15.123:0/1556904321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49415b000 msgr2=0x7fb494071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:08.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb4994b1700 1 --2- 172.21.15.123:0/1556904321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49415b000 0x7fb494071f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb4994b1700 1 -- 172.21.15.123:0/1556904321 >> v2:172.21.15.153:3300/0 conn(0x7fb4940cd410 msgr2=0x7fb4940cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:08.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb4994b1700 1 --2- 172.21.15.123:0/1556904321 >> v2:172.21.15.153:3300/0 conn(0x7fb4940cd410 0x7fb4940cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb4994b1700 1 -- 172.21.15.123:0/1556904321 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4940ce0c0 con 0x7fb4940ccfd0 2024-09-13T17:08:08.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49a4b3700 1 --2- 172.21.15.123:0/1556904321 >> v2:172.21.15.153:3300/0 conn(0x7fb4940cd410 0x7fb4940cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:08.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb4994b1700 1 --2- 172.21.15.123:0/1556904321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4940ccfd0 0x7fb4940cb070 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb4940cc050 tx=0x7fb48c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b529a1f0abeb73a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:08.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb498cb0700 1 -- 172.21.15.123:0/1556904321 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00e070 con 0x7fb4940ccfd0 2024-09-13T17:08:08.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb498cb0700 1 -- 172.21.15.123:0/1556904321 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c00b9c0 con 0x7fb4940ccfd0 2024-09-13T17:08:08.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb498cb0700 1 -- 172.21.15.123:0/1556904321 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00bd70 con 0x7fb4940ccfd0 2024-09-13T17:08:08.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 -- 172.21.15.123:0/1556904321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4940ccfd0 msgr2=0x7fb4940cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:08.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 --2- 172.21.15.123:0/1556904321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4940ccfd0 0x7fb4940cb070 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb4940cc050 tx=0x7fb48c00b330 comp rx=0 tx=0).stop 2024-09-13T17:08:08.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 -- 172.21.15.123:0/1556904321 shutdown_connections 2024-09-13T17:08:08.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 --2- 172.21.15.123:0/1556904321 >> v2:172.21.15.153:3300/0 conn(0x7fb4940cd410 0x7fb4940cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 --2- 172.21.15.123:0/1556904321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4940ccfd0 0x7fb4940cb070 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 --2- 172.21.15.123:0/1556904321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49415b000 0x7fb494071f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.016+0000 7fb49acb4700 1 -- 172.21.15.123:0/1556904321 >> 172.21.15.123:0/1556904321 conn(0x7fb4940b01d0 msgr2=0x7fb4940b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:08.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb49acb4700 1 -- 172.21.15.123:0/1556904321 shutdown_connections 2024-09-13T17:08:08.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb49acb4700 1 -- 172.21.15.123:0/1556904321 wait complete. 2024-09-13T17:08:08.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb49acb4700 1 Processor -- start 2024-09-13T17:08:08.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb49acb4700 1 -- start start 2024-09-13T17:08:08.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb49acb4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4940ccfd0 0x7fb4941eca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:08.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb49acb4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4940cd410 0x7fb4940b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:08.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb49acb4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49415b000 0x7fb49415d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:08.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb49acb4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940b2a60 con 0x7fb4940ccfd0 2024-09-13T17:08:08.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb49acb4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940b3880 con 0x7fb4940cd410 2024-09-13T17:08:08.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb49acb4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940b2c70 con 0x7fb49415b000 2024-09-13T17:08:08.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb499cb2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4940ccfd0 0x7fb4941eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:08.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb499cb2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4940ccfd0 0x7fb4941eca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56468/0 (socket says 172.21.15.123:56468) 2024-09-13T17:08:08.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb499cb2700 1 -- 172.21.15.123:0/3181436651 learned_addr learned my addr 172.21.15.123:0/3181436651 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb4994b1700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4940cd410 0x7fb4940b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb49a4b3700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49415b000 0x7fb49415d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb499cb2700 1 -- 172.21.15.123:0/3181436651 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49415b000 msgr2=0x7fb49415d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb499cb2700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49415b000 0x7fb49415d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb499cb2700 1 -- 172.21.15.123:0/3181436651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4940cd410 msgr2=0x7fb4940b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb499cb2700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4940cd410 0x7fb4940b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb499cb2700 1 -- 172.21.15.123:0/3181436651 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c009b30 con 0x7fb4940ccfd0 2024-09-13T17:08:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.020+0000 7fb4994b1700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4940cd410 0x7fb4940b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.024+0000 7fb499cb2700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4940ccfd0 0x7fb4941eca60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb48400e760 tx=0x7fb48400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:08.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.024+0000 7fb48a7fc700 1 -- 172.21.15.123:0/3181436651 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48400c070 con 0x7fb4940ccfd0 2024-09-13T17:08:08.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.024+0000 7fb48a7fc700 1 -- 172.21.15.123:0/3181436651 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb484013610 con 0x7fb4940ccfd0 2024-09-13T17:08:08.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.024+0000 7fb49acb4700 1 -- 172.21.15.123:0/3181436651 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4940b2f50 con 0x7fb4940ccfd0 2024-09-13T17:08:08.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.024+0000 7fb48a7fc700 1 -- 172.21.15.123:0/3181436651 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484013980 con 0x7fb4940ccfd0 2024-09-13T17:08:08.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.024+0000 7fb49acb4700 1 -- 172.21.15.123:0/3181436651 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4940b3510 con 0x7fb4940ccfd0 2024-09-13T17:08:08.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.024+0000 7fb49acb4700 1 -- 172.21.15.123:0/3181436651 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb494071f50 con 0x7fb4940ccfd0 2024-09-13T17:08:08.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.024+0000 7fb48a7fc700 1 -- 172.21.15.123:0/3181436651 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb484013ae0 con 0x7fb4940ccfd0 2024-09-13T17:08:08.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.028+0000 7fb48a7fc700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb478066760 0x7fb478068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:08.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.028+0000 7fb48a7fc700 1 -- 172.21.15.123:0/3181436651 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb484083e90 con 0x7fb4940ccfd0 2024-09-13T17:08:08.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.028+0000 7fb4994b1700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb478066760 0x7fb478068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:08.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.028+0000 7fb4994b1700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb478066760 0x7fb478068c20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb4940cc050 tx=0x7fb48c009000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:08.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.032+0000 7fb48a7fc700 1 -- 172.21.15.123:0/3181436651 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb484051290 con 0x7fb4940ccfd0 2024-09-13T17:08:08.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.240+0000 7fb49acb4700 1 -- 172.21.15.123:0/3181436651 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb49415bbd0 con 0x7fb4940ccfd0 2024-09-13T17:08:08.245 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-13T17:08:08.240+0000 7f1c63ac9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:08:08.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.256+0000 7fb48a7fc700 1 -- 172.21.15.123:0/3181436651 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb4840548b0 con 0x7fb4940ccfd0 2024-09-13T17:08:08.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.256+0000 7fb49acb4700 1 -- 172.21.15.123:0/3181436651 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb478066760 msgr2=0x7fb478068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:08.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.256+0000 7fb49acb4700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb478066760 0x7fb478068c20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb4940cc050 tx=0x7fb48c009000 comp rx=0 tx=0).stop 2024-09-13T17:08:08.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.256+0000 7fb49acb4700 1 -- 172.21.15.123:0/3181436651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4940ccfd0 msgr2=0x7fb4941eca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:08.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.256+0000 7fb49acb4700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4940ccfd0 0x7fb4941eca60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb48400e760 tx=0x7fb48400ea70 comp rx=0 tx=0).stop 2024-09-13T17:08:08.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.256+0000 7fb49acb4700 1 -- 172.21.15.123:0/3181436651 shutdown_connections 2024-09-13T17:08:08.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.256+0000 7fb49acb4700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb478066760 0x7fb478068c20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.256+0000 7fb49acb4700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49415b000 0x7fb49415d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.256+0000 7fb49acb4700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4940cd410 0x7fb4940b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.256+0000 7fb49acb4700 1 --2- 172.21.15.123:0/3181436651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4940ccfd0 0x7fb4941eca60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.256+0000 7fb49acb4700 1 -- 172.21.15.123:0/3181436651 >> 172.21.15.123:0/3181436651 conn(0x7fb4940b01d0 msgr2=0x7fb4940ad240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:08.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.256+0000 7fb49acb4700 1 -- 172.21.15.123:0/3181436651 shutdown_connections 2024-09-13T17:08:08.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.260+0000 7fb49acb4700 1 -- 172.21.15.123:0/3181436651 wait complete. 2024-09-13T17:08:08.263 INFO:tasks.ceph.mds.c.smithi123.stderr: -1916> 2024-09-13T17:07:50.429+0000 7f0c3c7ff700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:08:08.263 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:08:08.275 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:08:08.296 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-13T17:08:08.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c34c83700 1 Processor -- start 2024-09-13T17:08:08.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c34c83700 1 -- start start 2024-09-13T17:08:08.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c34c83700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1c300d0f40 0x7f1c300d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:08.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c34c83700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1c300cd5e0 0x7f1c300cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:08.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c34c83700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c300d0cb0 con 0x7f1c300b58b0 2024-09-13T17:08:08.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c34c83700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c300b0060 con 0x7f1c300d0f40 2024-09-13T17:08:08.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c34c83700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c300b0340 con 0x7f1c300cd5e0 2024-09-13T17:08:08.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c2f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1c300d0f40 0x7f1c300d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:08.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c2f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1c300d0f40 0x7f1c300d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56492/0 (socket says 172.21.15.123:56492) 2024-09-13T17:08:08.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c2f7fe700 1 -- 172.21.15.123:0/3704444245 learned_addr learned my addr 172.21.15.123:0/3704444245 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:08.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c2effd700 1 --1- 172.21.15.123:0/3704444245 >> v1:172.21.15.123:6789/0 conn(0x7f1c300b58b0 0x7f1c300d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55500/0 (socket says 172.21.15.123:55500) 2024-09-13T17:08:08.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c2ffff700 1 --2- 172.21.15.123:0/3704444245 >> v2:172.21.15.153:3300/0 conn(0x7f1c300cd5e0 0x7f1c300cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:08.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c2f7fe700 1 -- 172.21.15.123:0/3704444245 >> v2:172.21.15.153:3300/0 conn(0x7f1c300cd5e0 msgr2=0x7f1c300cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:08.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c2f7fe700 1 --2- 172.21.15.123:0/3704444245 >> v2:172.21.15.153:3300/0 conn(0x7f1c300cd5e0 0x7f1c300cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c2f7fe700 1 -- 172.21.15.123:0/3704444245 >> v1:172.21.15.123:6789/0 conn(0x7f1c300b58b0 legacy=0x7f1c300d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:08.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c2f7fe700 1 -- 172.21.15.123:0/3704444245 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c300b0620 con 0x7f1c300d0f40 2024-09-13T17:08:08.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.376+0000 7f1c2e7fc700 1 -- 172.21.15.123:0/3704444245 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716301312 0 0) 0x7f1c300d0cb0 con 0x7f1c300b58b0 2024-09-13T17:08:08.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c2ffff700 1 --2- 172.21.15.123:0/3704444245 >> v2:172.21.15.153:3300/0 conn(0x7f1c300cd5e0 0x7f1c300cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:08.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c2f7fe700 1 --2- 172.21.15.123:0/3704444245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c300d0f40 0x7f1c300d1320 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1c300b8ad0 tx=0x7f1c20009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f8e360184d97ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:08.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c2e7fc700 1 -- 172.21.15.123:0/3704444245 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2000b8a0 con 0x7f1c300d0f40 2024-09-13T17:08:08.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c2e7fc700 1 -- 172.21.15.123:0/3704444245 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2000ba00 con 0x7f1c300d0f40 2024-09-13T17:08:08.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c2e7fc700 1 -- 172.21.15.123:0/3704444245 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2000bd90 con 0x7f1c300d0f40 2024-09-13T17:08:08.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c34c83700 1 -- 172.21.15.123:0/3704444245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c300d0f40 msgr2=0x7f1c300d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:08.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c34c83700 1 --2- 172.21.15.123:0/3704444245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c300d0f40 0x7f1c300d1320 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1c300b8ad0 tx=0x7f1c20009bf0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c34c83700 1 -- 172.21.15.123:0/3704444245 shutdown_connections 2024-09-13T17:08:08.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c34c83700 1 --2- 172.21.15.123:0/3704444245 >> v2:172.21.15.153:3300/0 conn(0x7f1c300cd5e0 0x7f1c300cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c34c83700 1 --2- 172.21.15.123:0/3704444245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c300d0f40 0x7f1c300d1320 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c34c83700 1 -- 172.21.15.123:0/3704444245 >> 172.21.15.123:0/3704444245 conn(0x7f1c300d2a60 msgr2=0x7f1c300d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:08.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c34c83700 1 -- 172.21.15.123:0/3704444245 shutdown_connections 2024-09-13T17:08:08.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c34c83700 1 -- 172.21.15.123:0/3704444245 wait complete. 2024-09-13T17:08:08.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c34c83700 1 Processor -- start 2024-09-13T17:08:08.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.380+0000 7f1c34c83700 1 -- start start 2024-09-13T17:08:08.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c34c83700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c300b58b0 0x7f1c300cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:08.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c34c83700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c300cd5e0 0x7f1c30156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:08.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c34c83700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c300d0f40 0x7f1c301577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:08.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c34c83700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300cf8d0 con 0x7f1c300b58b0 2024-09-13T17:08:08.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c34c83700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300cace0 con 0x7f1c300d0f40 2024-09-13T17:08:08.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c34c83700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300cff90 con 0x7f1c300cd5e0 2024-09-13T17:08:08.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c2f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c300b58b0 0x7f1c300cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:08.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c2f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c300b58b0 0x7f1c300cfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56496/0 (socket says 172.21.15.123:56496) 2024-09-13T17:08:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c2f7fe700 1 -- 172.21.15.123:0/2211791424 learned_addr learned my addr 172.21.15.123:0/2211791424 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c2ffff700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c300d0f40 0x7f1c301577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c2effd700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c300cd5e0 0x7f1c30156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c2f7fe700 1 -- 172.21.15.123:0/2211791424 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c300cd5e0 msgr2=0x7f1c30156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c2f7fe700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c300cd5e0 0x7f1c30156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c2f7fe700 1 -- 172.21.15.123:0/2211791424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c300d0f40 msgr2=0x7f1c301577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c2f7fe700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c300d0f40 0x7f1c301577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c2f7fe700 1 -- 172.21.15.123:0/2211791424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c20009570 con 0x7f1c300b58b0 2024-09-13T17:08:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c2effd700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c300cd5e0 0x7f1c30156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c2ffff700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c300d0f40 0x7f1c301577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c2f7fe700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c300b58b0 0x7f1c300cfa50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1c20000c00 tx=0x7f1c20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c17fff700 1 -- 172.21.15.123:0/2211791424 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c200038c0 con 0x7f1c300b58b0 2024-09-13T17:08:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c17fff700 1 -- 172.21.15.123:0/2211791424 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c20003a20 con 0x7f1c300b58b0 2024-09-13T17:08:08.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c34c83700 1 -- 172.21.15.123:0/2211791424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c300ca060 con 0x7f1c300b58b0 2024-09-13T17:08:08.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c17fff700 1 -- 172.21.15.123:0/2211791424 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20003db0 con 0x7f1c300b58b0 2024-09-13T17:08:08.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c34c83700 1 -- 172.21.15.123:0/2211791424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c300ca620 con 0x7f1c300b58b0 2024-09-13T17:08:08.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.384+0000 7f1c34c83700 1 -- 172.21.15.123:0/2211791424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3015ce70 con 0x7f1c300b58b0 2024-09-13T17:08:08.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.388+0000 7f1c17fff700 1 -- 172.21.15.123:0/2211791424 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c20011420 con 0x7f1c300b58b0 2024-09-13T17:08:08.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.388+0000 7f1c17fff700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c1c066730 0x7f1c1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:08.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.388+0000 7f1c17fff700 1 -- 172.21.15.123:0/2211791424 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1c20020030 con 0x7f1c300b58b0 2024-09-13T17:08:08.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.388+0000 7f1c2effd700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c1c066730 0x7f1c1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:08.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.388+0000 7f1c2effd700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c1c066730 0x7f1c1c068bf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1c24000f60 tx=0x7f1c24007d20 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:08.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.396+0000 7f1c17fff700 1 -- 172.21.15.123:0/2211791424 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c20052aa0 con 0x7f1c300b58b0 2024-09-13T17:08:08.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:08.600+0000 7f1c34c83700 1 -- 172.21.15.123:0/2211791424 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1c300ca9c0 con 0x7f1c300b58b0 2024-09-13T17:08:09.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.260+0000 7f1c17fff700 1 -- 172.21.15.123:0/2211791424 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1c200560c0 con 0x7f1c300b58b0 2024-09-13T17:08:09.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.264+0000 7f1c34c83700 1 -- 172.21.15.123:0/2211791424 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c1c066730 msgr2=0x7f1c1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:09.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.264+0000 7f1c34c83700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c1c066730 0x7f1c1c068bf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1c24000f60 tx=0x7f1c24007d20 comp rx=0 tx=0).stop 2024-09-13T17:08:09.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.264+0000 7f1c34c83700 1 -- 172.21.15.123:0/2211791424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c300b58b0 msgr2=0x7f1c300cfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:09.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.264+0000 7f1c34c83700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c300b58b0 0x7f1c300cfa50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1c20000c00 tx=0x7f1c20004770 comp rx=0 tx=0).stop 2024-09-13T17:08:09.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.264+0000 7f1c34c83700 1 -- 172.21.15.123:0/2211791424 shutdown_connections 2024-09-13T17:08:09.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.264+0000 7f1c34c83700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c1c066730 0x7f1c1c068bf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:09.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.264+0000 7f1c34c83700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c300d0f40 0x7f1c301577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:09.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.264+0000 7f1c34c83700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c300cd5e0 0x7f1c30156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:09.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.264+0000 7f1c34c83700 1 --2- 172.21.15.123:0/2211791424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c300b58b0 0x7f1c300cfa50 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:09.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.264+0000 7f1c34c83700 1 -- 172.21.15.123:0/2211791424 >> 172.21.15.123:0/2211791424 conn(0x7f1c300d2a60 msgr2=0x7f1c30070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:09.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.264+0000 7f1c34c83700 1 -- 172.21.15.123:0/2211791424 shutdown_connections 2024-09-13T17:08:09.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.264+0000 7f1c34c83700 1 -- 172.21.15.123:0/2211791424 wait complete. 2024-09-13T17:08:09.284 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:08:09.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f1411db1700 1 Processor -- start 2024-09-13T17:08:09.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f1411db1700 1 -- start start 2024-09-13T17:08:09.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f1411db1700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f140c160310 0x7f140c0d36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:09.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f1411db1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f140c0d3220 0x7f140c0cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:09.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f1411db1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f140c0cfd90 0x7f140c0d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:09.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f1411db1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c1606f0 con 0x7f140c0d3220 2024-09-13T17:08:09.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f1411db1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c0ce7b0 con 0x7f140c0cfd90 2024-09-13T17:08:09.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f1411db1700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0cea90 con 0x7f140c160310 2024-09-13T17:08:09.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f140bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f140c0d3220 0x7f140c0cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:09.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f140bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f140c0d3220 0x7f140c0cf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56510/0 (socket says 172.21.15.123:56510) 2024-09-13T17:08:09.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f140bfff700 1 -- 172.21.15.123:0/3263804571 learned_addr learned my addr 172.21.15.123:0/3263804571 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:09.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f14115b0700 1 --2- 172.21.15.123:0/3263804571 >> v2:172.21.15.153:3300/0 conn(0x7f140c0cfd90 0x7f140c0d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f1410daf700 1 --2- 172.21.15.123:0/3263804571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f140c160310 0x7f140c0d36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f140bfff700 1 -- 172.21.15.123:0/3263804571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f140c160310 msgr2=0x7f140c0d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f140bfff700 1 --2- 172.21.15.123:0/3263804571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f140c160310 0x7f140c0d36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.444+0000 7f140bfff700 1 -- 172.21.15.123:0/3263804571 >> v2:172.21.15.153:3300/0 conn(0x7f140c0cfd90 msgr2=0x7f140c0d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f140bfff700 1 --2- 172.21.15.123:0/3263804571 >> v2:172.21.15.153:3300/0 conn(0x7f140c0cfd90 0x7f140c0d1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f140bfff700 1 -- 172.21.15.123:0/3263804571 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c0ced70 con 0x7f140c0d3220 2024-09-13T17:08:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f14115b0700 1 --2- 172.21.15.123:0/3263804571 >> v2:172.21.15.153:3300/0 conn(0x7f140c0cfd90 0x7f140c0d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f140bfff700 1 --2- 172.21.15.123:0/3263804571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f140c0d3220 0x7f140c0cf850 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f140c0b40b0 tx=0x7f1400009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592f7b7a13ea8158 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f140b7fe700 1 -- 172.21.15.123:0/3263804571 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140000b8a0 con 0x7f140c0d3220 2024-09-13T17:08:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f140b7fe700 1 -- 172.21.15.123:0/3263804571 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140000ba00 con 0x7f140c0d3220 2024-09-13T17:08:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f140b7fe700 1 -- 172.21.15.123:0/3263804571 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140000bd90 con 0x7f140c0d3220 2024-09-13T17:08:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 -- 172.21.15.123:0/3263804571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f140c0d3220 msgr2=0x7f140c0cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:09.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 --2- 172.21.15.123:0/3263804571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f140c0d3220 0x7f140c0cf850 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f140c0b40b0 tx=0x7f1400009bf0 comp rx=0 tx=0).stop 2024-09-13T17:08:09.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 -- 172.21.15.123:0/3263804571 shutdown_connections 2024-09-13T17:08:09.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 --2- 172.21.15.123:0/3263804571 >> v2:172.21.15.153:3300/0 conn(0x7f140c0cfd90 0x7f140c0d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:09.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 --2- 172.21.15.123:0/3263804571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f140c0d3220 0x7f140c0cf850 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:09.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 --2- 172.21.15.123:0/3263804571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f140c160310 0x7f140c0d36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:09.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 -- 172.21.15.123:0/3263804571 >> 172.21.15.123:0/3263804571 conn(0x7f140c09be50 msgr2=0x7f140c0d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:09.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 -- 172.21.15.123:0/3263804571 shutdown_connections 2024-09-13T17:08:09.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 -- 172.21.15.123:0/3263804571 wait complete. 2024-09-13T17:08:09.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 Processor -- start 2024-09-13T17:08:09.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 -- start start 2024-09-13T17:08:09.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f140c0cfd90 0x7f140c1f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:09.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f140c0d3220 0x7f140c0cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:09.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f140c160310 0x7f140c1efe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:09.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0ca0e0 con 0x7f140c0cfd90 2024-09-13T17:08:09.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0ca3c0 con 0x7f140c160310 2024-09-13T17:08:09.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1411db1700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0ca6a0 con 0x7f140c0d3220 2024-09-13T17:08:09.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1410daf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f140c0cfd90 0x7f140c1f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:09.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1410daf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f140c0cfd90 0x7f140c1f2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56512/0 (socket says 172.21.15.123:56512) 2024-09-13T17:08:09.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.448+0000 7f1410daf700 1 -- 172.21.15.123:0/826380355 learned_addr learned my addr 172.21.15.123:0/826380355 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:09.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f14115b0700 1 --2- 172.21.15.123:0/826380355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f140c160310 0x7f140c1efe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:09.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f140bfff700 1 --2- 172.21.15.123:0/826380355 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f140c0d3220 0x7f140c0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:09.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f1410daf700 1 -- 172.21.15.123:0/826380355 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f140c0d3220 msgr2=0x7f140c0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:09.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f1410daf700 1 --2- 172.21.15.123:0/826380355 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f140c0d3220 0x7f140c0cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:09.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f1410daf700 1 -- 172.21.15.123:0/826380355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f140c160310 msgr2=0x7f140c1efe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:09.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f1410daf700 1 --2- 172.21.15.123:0/826380355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f140c160310 0x7f140c1efe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:09.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f1410daf700 1 -- 172.21.15.123:0/826380355 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1400009570 con 0x7f140c0cfd90 2024-09-13T17:08:09.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f1410daf700 1 --2- 172.21.15.123:0/826380355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f140c0cfd90 0x7f140c1f2a50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00d800 tx=0x7f13fc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:09.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f14097fa700 1 -- 172.21.15.123:0/826380355 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0125f0 con 0x7f140c0cfd90 2024-09-13T17:08:09.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f14097fa700 1 -- 172.21.15.123:0/826380355 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc012750 con 0x7f140c0cfd90 2024-09-13T17:08:09.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f1411db1700 1 -- 172.21.15.123:0/826380355 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c0ca980 con 0x7f140c0cfd90 2024-09-13T17:08:09.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f14097fa700 1 -- 172.21.15.123:0/826380355 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc012ac0 con 0x7f140c0cfd90 2024-09-13T17:08:09.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f1411db1700 1 -- 172.21.15.123:0/826380355 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c1f0390 con 0x7f140c0cfd90 2024-09-13T17:08:09.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f1411db1700 1 -- 172.21.15.123:0/826380355 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c0677f0 con 0x7f140c0cfd90 2024-09-13T17:08:09.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.452+0000 7f14097fa700 1 -- 172.21.15.123:0/826380355 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f13fc012c20 con 0x7f140c0cfd90 2024-09-13T17:08:09.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.456+0000 7f14097fa700 1 --2- 172.21.15.123:0/826380355 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f13f8066760 0x7f13f8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:09.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.456+0000 7f140bfff700 1 --2- 172.21.15.123:0/826380355 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f13f8066760 0x7f13f8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:09.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.456+0000 7f14097fa700 1 -- 172.21.15.123:0/826380355 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f13fc084180 con 0x7f140c0cfd90 2024-09-13T17:08:09.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.456+0000 7f140bfff700 1 --2- 172.21.15.123:0/826380355 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f13f8066760 0x7f13f8068c20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f140c0b40b0 tx=0x7f1400008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:09.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.464+0000 7f14097fa700 1 -- 172.21.15.123:0/826380355 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f13fc051490 con 0x7f140c0cfd90 2024-09-13T17:08:09.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:09.628+0000 7f1411db1700 1 -- 172.21.15.123:0/826380355 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f140c0cf850 con 0x7f140c0cfd90 2024-09-13T17:08:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.272+0000 7f14097fa700 1 -- 172.21.15.123:0/826380355 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) v1 ==== 181+0+0 (secure 0 0 0) 0x7f13fc054ab0 con 0x7f140c0cfd90 2024-09-13T17:08:10.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.280+0000 7f1411db1700 1 -- 172.21.15.123:0/826380355 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f13f8066760 msgr2=0x7f13f8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:10.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.280+0000 7f1411db1700 1 --2- 172.21.15.123:0/826380355 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f13f8066760 0x7f13f8068c20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f140c0b40b0 tx=0x7f1400008030 comp rx=0 tx=0).stop 2024-09-13T17:08:10.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.280+0000 7f1411db1700 1 -- 172.21.15.123:0/826380355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f140c0cfd90 msgr2=0x7f140c1f2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:10.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.280+0000 7f1411db1700 1 --2- 172.21.15.123:0/826380355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f140c0cfd90 0x7f140c1f2a50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00d800 tx=0x7f13fc00db10 comp rx=0 tx=0).stop 2024-09-13T17:08:10.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.280+0000 7f1411db1700 1 -- 172.21.15.123:0/826380355 shutdown_connections 2024-09-13T17:08:10.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.280+0000 7f1411db1700 1 --2- 172.21.15.123:0/826380355 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f13f8066760 0x7f13f8068c20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:10.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.280+0000 7f1411db1700 1 --2- 172.21.15.123:0/826380355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f140c160310 0x7f140c1efe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:10.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.280+0000 7f1411db1700 1 --2- 172.21.15.123:0/826380355 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f140c0d3220 0x7f140c0cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:10.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.280+0000 7f1411db1700 1 --2- 172.21.15.123:0/826380355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f140c0cfd90 0x7f140c1f2a50 secure :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00d800 tx=0x7f13fc00db10 comp rx=0 tx=0).stop 2024-09-13T17:08:10.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.280+0000 7f1411db1700 1 -- 172.21.15.123:0/826380355 >> 172.21.15.123:0/826380355 conn(0x7f140c09be50 msgr2=0x7f140c0b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:10.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.280+0000 7f1411db1700 1 -- 172.21.15.123:0/826380355 shutdown_connections 2024-09-13T17:08:10.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.280+0000 7f1411db1700 1 -- 172.21.15.123:0/826380355 wait complete. 2024-09-13T17:08:10.286 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:08:10.302 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:08:10.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.408+0000 7f64f0bff700 1 Processor -- start 2024-09-13T17:08:10.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.408+0000 7f64f0bff700 1 -- start start 2024-09-13T17:08:10.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.408+0000 7f64f0bff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f64ec15cdd0 0x7f64ec0d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:10.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.408+0000 7f64f0bff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ec0ce020 con 0x7f64ec0d1580 2024-09-13T17:08:10.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.408+0000 7f64f0bff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ec0cd750 con 0x7f64ec0cf6b0 2024-09-13T17:08:10.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.408+0000 7f64f0bff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ec0d3cb0 con 0x7f64ec15cdd0 2024-09-13T17:08:10.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64eaffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f64ec0d1580 0x7f64ec0ce4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55512/0 (socket says 172.21.15.123:55512) 2024-09-13T17:08:10.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64eaffd700 1 -- 172.21.15.123:0/1416600055 learned_addr learned my addr 172.21.15.123:0/1416600055 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:10.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64eb7fe700 1 --2- 172.21.15.123:0/1416600055 >> v2:172.21.15.153:3300/0 conn(0x7f64ec15cdd0 0x7f64ec0d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:10.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 -- 172.21.15.123:0/1416600055 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916512716 0 0) 0x7f64ec0ce020 con 0x7f64ec0d1580 2024-09-13T17:08:10.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 -- 172.21.15.123:0/1416600055 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64d80035d0 con 0x7f64ec0d1580 2024-09-13T17:08:10.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 -- 172.21.15.123:0/1416600055 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4173844499 0 0) 0x7f64d80035d0 con 0x7f64ec0d1580 2024-09-13T17:08:10.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 -- 172.21.15.123:0/1416600055 >> v2:172.21.15.153:3300/0 conn(0x7f64ec15cdd0 msgr2=0x7f64ec0d33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:10.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 --2- 172.21.15.123:0/1416600055 >> v2:172.21.15.153:3300/0 conn(0x7f64ec15cdd0 0x7f64ec0d33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:10.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 -- 172.21.15.123:0/1416600055 >> v1:172.21.15.153:6789/0 conn(0x7f64ec0cf6b0 legacy=0x7f64ec0b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:10.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 -- 172.21.15.123:0/1416600055 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec15d1b0 con 0x7f64ec0d1580 2024-09-13T17:08:10.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 -- 172.21.15.123:0/1416600055 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f64d4001670 con 0x7f64ec0d1580 2024-09-13T17:08:10.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 -- 172.21.15.123:0/1416600055 >> v1:172.21.15.123:6789/0 conn(0x7f64ec0d1580 legacy=0x7f64ec0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:10.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 --2- 172.21.15.123:0/1416600055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d8003a20 0x7f64d8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:10.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 --2- 172.21.15.123:0/1416600055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64d8004870 0x7f64d8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:10.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 --2- 172.21.15.123:0/1416600055 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d8005230 0x7f64d800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:10.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 -- 172.21.15.123:0/1416600055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec0d3cb0 con 0x7f64d8003a20 2024-09-13T17:08:10.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 -- 172.21.15.123:0/1416600055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d800c1d0 con 0x7f64d8004870 2024-09-13T17:08:10.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 -- 172.21.15.123:0/1416600055 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d800c390 con 0x7f64d8005230 2024-09-13T17:08:10.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64eb7fe700 1 --2- 172.21.15.123:0/1416600055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d8003a20 0x7f64d8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:10.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64eaffd700 1 --2- 172.21.15.123:0/1416600055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64d8004870 0x7f64d8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:10.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ebfff700 1 --2- 172.21.15.123:0/1416600055 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d8005230 0x7f64d800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:10.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64eb7fe700 1 -- 172.21.15.123:0/1416600055 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d8005230 msgr2=0x7f64d800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:10.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64eb7fe700 1 --2- 172.21.15.123:0/1416600055 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d8005230 0x7f64d800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:10.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64eb7fe700 1 -- 172.21.15.123:0/1416600055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64d8004870 msgr2=0x7f64d8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:10.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64eb7fe700 1 --2- 172.21.15.123:0/1416600055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64d8004870 0x7f64d8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:10.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64eb7fe700 1 -- 172.21.15.123:0/1416600055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d80035d0 con 0x7f64d8003a20 2024-09-13T17:08:10.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ebfff700 1 --2- 172.21.15.123:0/1416600055 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d8005230 0x7f64d800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:10.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ebfff700 1 -- 172.21.15.123:0/1416600055 reap_dead start 2024-09-13T17:08:10.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64eb7fe700 1 --2- 172.21.15.123:0/1416600055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d8003a20 0x7f64d8003e40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009b70 tx=0x7f64d80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690f2885201f7974 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:10.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 -- 172.21.15.123:0/1416600055 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e400e6c0 con 0x7f64d8003a20 2024-09-13T17:08:10.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 -- 172.21.15.123:0/1416600055 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e400e820 con 0x7f64d8003a20 2024-09-13T17:08:10.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64ea7fc700 1 -- 172.21.15.123:0/1416600055 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e400eb90 con 0x7f64d8003a20 2024-09-13T17:08:10.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64f0bff700 1 -- 172.21.15.123:0/1416600055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d8003a20 msgr2=0x7f64d8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:10.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64f0bff700 1 --2- 172.21.15.123:0/1416600055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d8003a20 0x7f64d8003e40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009b70 tx=0x7f64d80058a0 comp rx=0 tx=0).stop 2024-09-13T17:08:10.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64f0bff700 1 -- 172.21.15.123:0/1416600055 shutdown_connections 2024-09-13T17:08:10.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64f0bff700 1 --2- 172.21.15.123:0/1416600055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d8003a20 0x7f64d8003e40 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:10.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64f0bff700 1 -- 172.21.15.123:0/1416600055 >> 172.21.15.123:0/1416600055 conn(0x7f64ec09c010 msgr2=0x7f64ec0d2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:10.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64f0bff700 1 -- 172.21.15.123:0/1416600055 shutdown_connections 2024-09-13T17:08:10.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.412+0000 7f64f0bff700 1 -- 172.21.15.123:0/1416600055 wait complete. 2024-09-13T17:08:10.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.416+0000 7f64f0bff700 1 Processor -- start 2024-09-13T17:08:10.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.416+0000 7f64f0bff700 1 -- start start 2024-09-13T17:08:10.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64f0bff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d8003a20 0x7f64ec1543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:10.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64f0bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64ec1f5070 0x7f64ec15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:10.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64f0bff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64ec148cd0 0x7f64ec149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:10.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64f0bff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec155510 con 0x7f64ec148cd0 2024-09-13T17:08:10.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64f0bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec1496c0 con 0x7f64ec1f5070 2024-09-13T17:08:10.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64f0bff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec154990 con 0x7f64d8003a20 2024-09-13T17:08:10.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64ebfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64ec148cd0 0x7f64ec149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:10.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64ebfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64ec148cd0 0x7f64ec149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56528/0 (socket says 172.21.15.123:56528) 2024-09-13T17:08:10.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64ebfff700 1 -- 172.21.15.123:0/2628888211 learned_addr learned my addr 172.21.15.123:0/2628888211 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:10.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64eb7fe700 1 --2- 172.21.15.123:0/2628888211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d8003a20 0x7f64ec1543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:10.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64eaffd700 1 --2- 172.21.15.123:0/2628888211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64ec1f5070 0x7f64ec15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:10.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64ebfff700 1 -- 172.21.15.123:0/2628888211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d8003a20 msgr2=0x7f64ec1543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:10.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64ebfff700 1 --2- 172.21.15.123:0/2628888211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d8003a20 0x7f64ec1543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:10.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64ebfff700 1 -- 172.21.15.123:0/2628888211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64ec1f5070 msgr2=0x7f64ec15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:10.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64ebfff700 1 --2- 172.21.15.123:0/2628888211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64ec1f5070 0x7f64ec15fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:10.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64ebfff700 1 -- 172.21.15.123:0/2628888211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec154c70 con 0x7f64ec148cd0 2024-09-13T17:08:10.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64ebfff700 1 --2- 172.21.15.123:0/2628888211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64ec148cd0 0x7f64ec149180 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0b22c0 tx=0x7f64dc00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:10.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64e3fff700 1 -- 172.21.15.123:0/2628888211 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc003c20 con 0x7f64ec148cd0 2024-09-13T17:08:10.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64f0bff700 1 -- 172.21.15.123:0/2628888211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ec154f50 con 0x7f64ec148cd0 2024-09-13T17:08:10.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64e3fff700 1 -- 172.21.15.123:0/2628888211 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64dc003da0 con 0x7f64ec148cd0 2024-09-13T17:08:10.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64e3fff700 1 -- 172.21.15.123:0/2628888211 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc0052b0 con 0x7f64ec148cd0 2024-09-13T17:08:10.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64f0bff700 1 -- 172.21.15.123:0/2628888211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ec160360 con 0x7f64ec148cd0 2024-09-13T17:08:10.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.420+0000 7f64f0bff700 1 -- 172.21.15.123:0/2628888211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ec0d33f0 con 0x7f64ec148cd0 2024-09-13T17:08:10.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.424+0000 7f64e3fff700 1 -- 172.21.15.123:0/2628888211 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f64dc005410 con 0x7f64ec148cd0 2024-09-13T17:08:10.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.424+0000 7f64e3fff700 1 --2- 172.21.15.123:0/2628888211 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64cc066730 0x7f64cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:10.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.424+0000 7f64e3fff700 1 -- 172.21.15.123:0/2628888211 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f64dc083900 con 0x7f64ec148cd0 2024-09-13T17:08:10.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.424+0000 7f64eb7fe700 1 --2- 172.21.15.123:0/2628888211 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64cc066730 0x7f64cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:10.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.424+0000 7f64eb7fe700 1 --2- 172.21.15.123:0/2628888211 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64cc066730 0x7f64cc068bf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f64e40090b0 tx=0x7f64e401f040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:10.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.432+0000 7f64e3fff700 1 -- 172.21.15.123:0/2628888211 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f64dc050e00 con 0x7f64ec148cd0 2024-09-13T17:08:10.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:10.596+0000 7f64f0bff700 1 -- 172.21.15.123:0/2628888211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f64ec15a400 con 0x7f64ec148cd0 2024-09-13T17:08:11.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.284+0000 7f64e3fff700 1 -- 172.21.15.123:0/2628888211 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) v1 ==== 169+0+0 (secure 0 0 0) 0x7f64dc018020 con 0x7f64ec148cd0 2024-09-13T17:08:11.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.292+0000 7f64f0bff700 1 -- 172.21.15.123:0/2628888211 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64cc066730 msgr2=0x7f64cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:11.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.292+0000 7f64f0bff700 1 --2- 172.21.15.123:0/2628888211 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64cc066730 0x7f64cc068bf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f64e40090b0 tx=0x7f64e401f040 comp rx=0 tx=0).stop 2024-09-13T17:08:11.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.292+0000 7f64f0bff700 1 -- 172.21.15.123:0/2628888211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64ec148cd0 msgr2=0x7f64ec149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:11.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.292+0000 7f64f0bff700 1 --2- 172.21.15.123:0/2628888211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64ec148cd0 0x7f64ec149180 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0b22c0 tx=0x7f64dc00ddc0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.292+0000 7f64f0bff700 1 -- 172.21.15.123:0/2628888211 shutdown_connections 2024-09-13T17:08:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.292+0000 7f64f0bff700 1 --2- 172.21.15.123:0/2628888211 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64cc066730 0x7f64cc068bf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.292+0000 7f64f0bff700 1 --2- 172.21.15.123:0/2628888211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64ec148cd0 0x7f64ec149180 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.292+0000 7f64f0bff700 1 --2- 172.21.15.123:0/2628888211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64ec1f5070 0x7f64ec15fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.292+0000 7f64f0bff700 1 --2- 172.21.15.123:0/2628888211 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d8003a20 0x7f64ec1543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.292+0000 7f64f0bff700 1 -- 172.21.15.123:0/2628888211 >> 172.21.15.123:0/2628888211 conn(0x7f64ec09c010 msgr2=0x7f64ec0b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.292+0000 7f64f0bff700 1 -- 172.21.15.123:0/2628888211 shutdown_connections 2024-09-13T17:08:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.292+0000 7f64f0bff700 1 -- 172.21.15.123:0/2628888211 wait complete. 2024-09-13T17:08:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-13T17:08:11.308 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T17:08:11.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.416+0000 7f9f1b504700 1 Processor -- start 2024-09-13T17:08:11.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.416+0000 7f9f1b504700 1 -- start start 2024-09-13T17:08:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.416+0000 7f9f1b504700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140cc6e0 0x7f9f140cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.416+0000 7f9f1b504700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f140cc250 con 0x7f9f140d08e0 2024-09-13T17:08:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.416+0000 7f9f1b504700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f140cb960 con 0x7f9f1415ceb0 2024-09-13T17:08:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.416+0000 7f9f1b504700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140d0560 con 0x7f9f140cc6e0 2024-09-13T17:08:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f19d01700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140cc6e0 0x7f9f140cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f19d01700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140cc6e0 0x7f9f140cfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:49950/0 (socket says 172.21.15.123:49950) 2024-09-13T17:08:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f19d01700 1 -- 172.21.15.123:0/2225668828 learned_addr learned my addr 172.21.15.123:0/2225668828 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f1a502700 1 --1- 172.21.15.123:0/2225668828 >> v1:172.21.15.153:6789/0 conn(0x7f9f1415ceb0 0x7f9f1406c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:36672/0 (socket says 172.21.15.123:36672) 2024-09-13T17:08:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f1ad03700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9f140d08e0 0x7f9f14070390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55528/0 (socket says 172.21.15.123:55528) 2024-09-13T17:08:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f19d01700 1 -- 172.21.15.123:0/2225668828 >> v1:172.21.15.153:6789/0 conn(0x7f9f1415ceb0 legacy=0x7f9f1406c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:11.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f19d01700 1 -- 172.21.15.123:0/2225668828 >> v1:172.21.15.123:6789/0 conn(0x7f9f140d08e0 legacy=0x7f9f14070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:11.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f19500700 1 -- 172.21.15.123:0/2225668828 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059418573 0 0) 0x7f9f140cb960 con 0x7f9f1415ceb0 2024-09-13T17:08:11.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f19d01700 1 -- 172.21.15.123:0/2225668828 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f140cbc00 con 0x7f9f140cc6e0 2024-09-13T17:08:11.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f19d01700 1 --2- 172.21.15.123:0/2225668828 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140cc6e0 0x7f9f140cfef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009940 tx=0x7f9f10009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b61b684aaa4d4eab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:11.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f19500700 1 -- 172.21.15.123:0/2225668828 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10004230 con 0x7f9f140cc6e0 2024-09-13T17:08:11.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f19500700 1 -- 172.21.15.123:0/2225668828 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f10009e90 con 0x7f9f140cc6e0 2024-09-13T17:08:11.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f19500700 1 -- 172.21.15.123:0/2225668828 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f100045b0 con 0x7f9f140cc6e0 2024-09-13T17:08:11.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f1b504700 1 -- 172.21.15.123:0/2225668828 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140cc6e0 msgr2=0x7f9f140cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:11.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f1b504700 1 --2- 172.21.15.123:0/2225668828 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140cc6e0 0x7f9f140cfef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009940 tx=0x7f9f10009c50 comp rx=0 tx=0).stop 2024-09-13T17:08:11.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f1b504700 1 -- 172.21.15.123:0/2225668828 shutdown_connections 2024-09-13T17:08:11.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f1b504700 1 --2- 172.21.15.123:0/2225668828 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140cc6e0 0x7f9f140cfef0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f1b504700 1 -- 172.21.15.123:0/2225668828 >> 172.21.15.123:0/2225668828 conn(0x7f9f1406e090 msgr2=0x7f9f1406e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f1b504700 1 -- 172.21.15.123:0/2225668828 shutdown_connections 2024-09-13T17:08:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f1b504700 1 -- 172.21.15.123:0/2225668828 wait complete. 2024-09-13T17:08:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.420+0000 7f9f1b504700 1 Processor -- start 2024-09-13T17:08:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f1b504700 1 -- start start 2024-09-13T17:08:11.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f1b504700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140cc6e0 0x7f9f141f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:11.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f1b504700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140d08e0 0x7f9f1415f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:11.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f1b504700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f1415ceb0 0x7f9f1415fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:11.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f1b504700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140c97e0 con 0x7f9f140d08e0 2024-09-13T17:08:11.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f1b504700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140c8f20 con 0x7f9f1415ceb0 2024-09-13T17:08:11.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f1b504700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140c87c0 con 0x7f9f140cc6e0 2024-09-13T17:08:11.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f19d01700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140d08e0 0x7f9f1415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:11.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f19d01700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140d08e0 0x7f9f1415f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56532/0 (socket says 172.21.15.123:56532) 2024-09-13T17:08:11.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f19d01700 1 -- 172.21.15.123:0/1221324309 learned_addr learned my addr 172.21.15.123:0/1221324309 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:11.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f1a502700 1 --2- 172.21.15.123:0/1221324309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140cc6e0 0x7f9f141f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:11.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f1ad03700 1 --2- 172.21.15.123:0/1221324309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f1415ceb0 0x7f9f1415fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:11.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f19d01700 1 -- 172.21.15.123:0/1221324309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140cc6e0 msgr2=0x7f9f141f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:11.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f19d01700 1 --2- 172.21.15.123:0/1221324309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140cc6e0 0x7f9f141f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f19d01700 1 -- 172.21.15.123:0/1221324309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f1415ceb0 msgr2=0x7f9f1415fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:11.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f19d01700 1 --2- 172.21.15.123:0/1221324309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f1415ceb0 0x7f9f1415fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f19d01700 1 -- 172.21.15.123:0/1221324309 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f10009570 con 0x7f9f140d08e0 2024-09-13T17:08:11.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f19d01700 1 --2- 172.21.15.123:0/1221324309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140d08e0 0x7f9f1415f770 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9f10006fd0 tx=0x7f9f10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:11.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f0affd700 1 -- 172.21.15.123:0/1221324309 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1000bd30 con 0x7f9f140d08e0 2024-09-13T17:08:11.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f1b504700 1 -- 172.21.15.123:0/1221324309 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1415d410 con 0x7f9f140d08e0 2024-09-13T17:08:11.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f0affd700 1 -- 172.21.15.123:0/1221324309 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1000be90 con 0x7f9f140d08e0 2024-09-13T17:08:11.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f0affd700 1 -- 172.21.15.123:0/1221324309 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10003900 con 0x7f9f140d08e0 2024-09-13T17:08:11.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f1b504700 1 -- 172.21.15.123:0/1221324309 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f140c9470 con 0x7f9f140d08e0 2024-09-13T17:08:11.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.424+0000 7f9f1b504700 1 -- 172.21.15.123:0/1221324309 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f140c9950 con 0x7f9f140d08e0 2024-09-13T17:08:11.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.428+0000 7f9f0affd700 1 -- 172.21.15.123:0/1221324309 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9f10022070 con 0x7f9f140d08e0 2024-09-13T17:08:11.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.428+0000 7f9f0affd700 1 --2- 172.21.15.123:0/1221324309 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ef8066760 0x7f9ef8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:11.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.428+0000 7f9f0affd700 1 -- 172.21.15.123:0/1221324309 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9f10085a00 con 0x7f9f140d08e0 2024-09-13T17:08:11.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.428+0000 7f9f1a502700 1 --2- 172.21.15.123:0/1221324309 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ef8066760 0x7f9ef8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:11.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.428+0000 7f9f1a502700 1 --2- 172.21.15.123:0/1221324309 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ef8066760 0x7f9ef8068c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9f04007c60 tx=0x7f9f04007bb0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:11.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.436+0000 7f9f0affd700 1 -- 172.21.15.123:0/1221324309 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9f10056ce0 con 0x7f9f140d08e0 2024-09-13T17:08:11.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.612+0000 7f9f1b504700 1 -- 172.21.15.123:0/1221324309 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9f140cf470 con 0x7f9f140d08e0 2024-09-13T17:08:11.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.620+0000 7f9f0affd700 1 -- 172.21.15.123:0/1221324309 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9f140cf470 con 0x7f9f140d08e0 2024-09-13T17:08:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.620+0000 7f9f1b504700 1 -- 172.21.15.123:0/1221324309 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ef8066760 msgr2=0x7f9ef8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.620+0000 7f9f1b504700 1 --2- 172.21.15.123:0/1221324309 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ef8066760 0x7f9ef8068c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9f04007c60 tx=0x7f9f04007bb0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.620+0000 7f9f1b504700 1 -- 172.21.15.123:0/1221324309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140d08e0 msgr2=0x7f9f1415f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.620+0000 7f9f1b504700 1 --2- 172.21.15.123:0/1221324309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140d08e0 0x7f9f1415f770 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9f10006fd0 tx=0x7f9f10004770 comp rx=0 tx=0).stop 2024-09-13T17:08:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.624+0000 7f9f1b504700 1 -- 172.21.15.123:0/1221324309 shutdown_connections 2024-09-13T17:08:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.624+0000 7f9f1b504700 1 --2- 172.21.15.123:0/1221324309 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ef8066760 0x7f9ef8068c20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.624+0000 7f9f1b504700 1 --2- 172.21.15.123:0/1221324309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f1415ceb0 0x7f9f1415fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.624+0000 7f9f1b504700 1 --2- 172.21.15.123:0/1221324309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f140d08e0 0x7f9f1415f770 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.624+0000 7f9f1b504700 1 --2- 172.21.15.123:0/1221324309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f140cc6e0 0x7f9f141f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.624+0000 7f9f1b504700 1 -- 172.21.15.123:0/1221324309 >> 172.21.15.123:0/1221324309 conn(0x7f9f1406e090 msgr2=0x7f9f140b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.624+0000 7f9f1b504700 1 -- 172.21.15.123:0/1221324309 shutdown_connections 2024-09-13T17:08:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.624+0000 7f9f1b504700 1 -- 172.21.15.123:0/1221324309 wait complete. 2024-09-13T17:08:11.639 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values' 2024-09-13T17:08:11.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9afba7c700 1 Processor -- start 2024-09-13T17:08:11.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9afba7c700 1 -- start start 2024-09-13T17:08:11.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9afba7c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9af40b2640 0x7f9af415f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:11.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9afba7c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af415fe10 0x7f9af41602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:11.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9afba7c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af40d0640 con 0x7f9af415f4f0 2024-09-13T17:08:11.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9afba7c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af40cd8f0 con 0x7f9af40b2640 2024-09-13T17:08:11.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9afba7c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40b23c0 con 0x7f9af415fe10 2024-09-13T17:08:11.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9af9818700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9af415f4f0 0x7f9af40b1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55536/0 (socket says 172.21.15.123:55536) 2024-09-13T17:08:11.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9af9818700 1 -- 172.21.15.123:0/3822620777 learned_addr learned my addr 172.21.15.123:0/3822620777 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9afa019700 1 --2- 172.21.15.123:0/3822620777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af415fe10 0x7f9af41602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9af9017700 1 --2- 172.21.15.123:0/3822620777 >> v2:172.21.15.153:3300/0 conn(0x7f9af40b2640 0x7f9af415f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9af8816700 1 -- 172.21.15.123:0/3822620777 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343039113 0 0) 0x7f9af40d0640 con 0x7f9af415f4f0 2024-09-13T17:08:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9af8816700 1 -- 172.21.15.123:0/3822620777 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae00035d0 con 0x7f9af415f4f0 2024-09-13T17:08:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9afa019700 1 -- 172.21.15.123:0/3822620777 >> v2:172.21.15.153:3300/0 conn(0x7f9af40b2640 msgr2=0x7f9af415f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9afa019700 1 --2- 172.21.15.123:0/3822620777 >> v2:172.21.15.153:3300/0 conn(0x7f9af40b2640 0x7f9af415f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9afa019700 1 -- 172.21.15.123:0/3822620777 >> v1:172.21.15.123:6789/0 conn(0x7f9af415f4f0 legacy=0x7f9af40b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9af8816700 1 -- 172.21.15.123:0/3822620777 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 218649296 0 0) 0x7f9ae00035d0 con 0x7f9af415f4f0 2024-09-13T17:08:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9afa019700 1 -- 172.21.15.123:0/3822620777 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40cfda0 con 0x7f9af415fe10 2024-09-13T17:08:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.752+0000 7f9afa019700 1 --2- 172.21.15.123:0/3822620777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af415fe10 0x7f9af41602c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009880 tx=0x7f9aec009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=548a87275335a53c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9af8816700 1 -- 172.21.15.123:0/3822620777 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8001670 con 0x7f9af415fe10 2024-09-13T17:08:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9af8816700 1 -- 172.21.15.123:0/3822620777 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec004030 con 0x7f9af415fe10 2024-09-13T17:08:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9af8816700 1 -- 172.21.15.123:0/3822620777 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0043c0 con 0x7f9af415fe10 2024-09-13T17:08:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 -- 172.21.15.123:0/3822620777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af415fe10 msgr2=0x7f9af41602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 --2- 172.21.15.123:0/3822620777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af415fe10 0x7f9af41602c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009880 tx=0x7f9aec009b90 comp rx=0 tx=0).stop 2024-09-13T17:08:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 -- 172.21.15.123:0/3822620777 shutdown_connections 2024-09-13T17:08:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 --2- 172.21.15.123:0/3822620777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af415fe10 0x7f9af41602c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 --2- 172.21.15.123:0/3822620777 >> v2:172.21.15.153:3300/0 conn(0x7f9af40b2640 0x7f9af415f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 -- 172.21.15.123:0/3822620777 >> 172.21.15.123:0/3822620777 conn(0x7f9af40d2ce0 msgr2=0x7f9af40d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 -- 172.21.15.123:0/3822620777 shutdown_connections 2024-09-13T17:08:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 -- 172.21.15.123:0/3822620777 wait complete. 2024-09-13T17:08:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 Processor -- start 2024-09-13T17:08:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 -- start start 2024-09-13T17:08:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40b2640 0x7f9af41f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af415f4f0 0x7f9af40b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af415fe10 0x7f9af40b7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40b78b0 con 0x7f9af415fe10 2024-09-13T17:08:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40b86f0 con 0x7f9af40b2640 2024-09-13T17:08:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.756+0000 7f9afba7c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af41f5da0 con 0x7f9af415f4f0 2024-09-13T17:08:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9afa019700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af415fe10 0x7f9af40b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9afa019700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af415fe10 0x7f9af40b7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56534/0 (socket says 172.21.15.123:56534) 2024-09-13T17:08:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9afa019700 1 -- 172.21.15.123:0/3366604305 learned_addr learned my addr 172.21.15.123:0/3366604305 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9af9017700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af415f4f0 0x7f9af40b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9af9818700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40b2640 0x7f9af41f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9afa019700 1 -- 172.21.15.123:0/3366604305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af415f4f0 msgr2=0x7f9af40b7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9afa019700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af415f4f0 0x7f9af40b7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9afa019700 1 -- 172.21.15.123:0/3366604305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40b2640 msgr2=0x7f9af41f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9afa019700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40b2640 0x7f9af41f2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9afa019700 1 -- 172.21.15.123:0/3366604305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec0094b0 con 0x7f9af415fe10 2024-09-13T17:08:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9af9818700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40b2640 0x7f9af41f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9afa019700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af415fe10 0x7f9af40b7370 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009850 tx=0x7f9aec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9ae67fc700 1 -- 172.21.15.123:0/3366604305 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec006ea0 con 0x7f9af415fe10 2024-09-13T17:08:11.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9ae67fc700 1 -- 172.21.15.123:0/3366604305 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec003da0 con 0x7f9af415fe10 2024-09-13T17:08:11.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9afba7c700 1 -- 172.21.15.123:0/3366604305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af40b8130 con 0x7f9af415fe10 2024-09-13T17:08:11.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9ae67fc700 1 -- 172.21.15.123:0/3366604305 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec011870 con 0x7f9af415fe10 2024-09-13T17:08:11.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9afba7c700 1 -- 172.21.15.123:0/3366604305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af41f5fb0 con 0x7f9af415fe10 2024-09-13T17:08:11.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9afba7c700 1 -- 172.21.15.123:0/3366604305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af41f64d0 con 0x7f9af415fe10 2024-09-13T17:08:11.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9ae67fc700 1 -- 172.21.15.123:0/3366604305 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9aec0119d0 con 0x7f9af415fe10 2024-09-13T17:08:11.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.760+0000 7f9ae67fc700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad8066730 0x7f9ad8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:11.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.764+0000 7f9ae67fc700 1 -- 172.21.15.123:0/3366604305 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9aec084ca0 con 0x7f9af415fe10 2024-09-13T17:08:11.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.764+0000 7f9af9818700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad8066730 0x7f9ad8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.764+0000 7f9af9818700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad8066730 0x7f9ad8068bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80017a0 tx=0x7f9ae8009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:11.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:11.768+0000 7f9ae67fc700 1 -- 172.21.15.123:0/3366604305 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9af41f64d0 con 0x7f9af415fe10 2024-09-13T17:08:12.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.000+0000 7f9afba7c700 1 -- 172.21.15.123:0/3366604305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]} v 0) v1 -- 0x7f9af41f64d0 con 0x7f9af415fe10 2024-09-13T17:08:12.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.284+0000 7f9ae67fc700 1 -- 172.21.15.123:0/3366604305 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]}]=0 v100) v1 ==== 160+0+0 (secure 0 0 0) 0x7f9af41f64d0 con 0x7f9af415fe10 2024-09-13T17:08:12.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.288+0000 7f9afba7c700 1 -- 172.21.15.123:0/3366604305 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad8066730 msgr2=0x7f9ad8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.288+0000 7f9afba7c700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad8066730 0x7f9ad8068bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80017a0 tx=0x7f9ae8009040 comp rx=0 tx=0).stop 2024-09-13T17:08:12.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.288+0000 7f9afba7c700 1 -- 172.21.15.123:0/3366604305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af415fe10 msgr2=0x7f9af40b7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.288+0000 7f9afba7c700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af415fe10 0x7f9af40b7370 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009850 tx=0x7f9aec004770 comp rx=0 tx=0).stop 2024-09-13T17:08:12.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.288+0000 7f9afba7c700 1 -- 172.21.15.123:0/3366604305 shutdown_connections 2024-09-13T17:08:12.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.288+0000 7f9afba7c700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ad8066730 0x7f9ad8068bf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.288+0000 7f9afba7c700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9af415fe10 0x7f9af40b7370 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.288+0000 7f9afba7c700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9af415f4f0 0x7f9af40b7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.288+0000 7f9afba7c700 1 --2- 172.21.15.123:0/3366604305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af40b2640 0x7f9af41f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.288+0000 7f9afba7c700 1 -- 172.21.15.123:0/3366604305 >> 172.21.15.123:0/3366604305 conn(0x7f9af40d2ce0 msgr2=0x7f9af40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:12.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.288+0000 7f9afba7c700 1 -- 172.21.15.123:0/3366604305 shutdown_connections 2024-09-13T17:08:12.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.288+0000 7f9afba7c700 1 -- 172.21.15.123:0/3366604305 wait complete. 2024-09-13T17:08:12.307 INFO:tasks.cephfs_test_runner:test: ... ok 2024-09-13T17:08:12.308 INFO:tasks.cephfs_test_runner:Starting test: test_human_readable_quota_invalid_values (tasks.cephfs.test_quota.TestQuota) test invalid values for ceph.quota.max_bytes 2024-09-13T17:08:12.308 INFO:tasks.cephfs_test_runner:test_human_readable_quota_invalid_values (tasks.cephfs.test_quota.TestQuota) 2024-09-13T17:08:12.308 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.420+0000 7f6e6ec82700 1 Processor -- start 2024-09-13T17:08:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.420+0000 7f6e6ec82700 1 -- start start 2024-09-13T17:08:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6ec82700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6e680cedc0 0x7f6e68071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6ec82700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e6815d360 con 0x7f6e681598b0 2024-09-13T17:08:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6ec82700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e680ce3f0 con 0x7f6e680cdfd0 2024-09-13T17:08:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6ec82700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e680724c0 con 0x7f6e680cedc0 2024-09-13T17:08:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6dc80700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6e681598b0 0x7f6e680ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47144/0 (socket says 172.21.15.123:47144) 2024-09-13T17:08:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6dc80700 1 -- 172.21.15.123:0/427818891 learned_addr learned my addr 172.21.15.123:0/427818891 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6d47f700 1 --2- 172.21.15.123:0/427818891 >> v2:172.21.15.153:3300/0 conn(0x7f6e680cedc0 0x7f6e68071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6cc7e700 1 -- 172.21.15.123:0/427818891 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843513199 0 0) 0x7f6e6815d360 con 0x7f6e681598b0 2024-09-13T17:08:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6cc7e700 1 -- 172.21.15.123:0/427818891 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e540035d0 con 0x7f6e681598b0 2024-09-13T17:08:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6d47f700 1 -- 172.21.15.123:0/427818891 >> v1:172.21.15.153:6789/0 conn(0x7f6e680cdfd0 legacy=0x7f6e68159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6d47f700 1 -- 172.21.15.123:0/427818891 >> v1:172.21.15.123:6789/0 conn(0x7f6e681598b0 legacy=0x7f6e680ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6d47f700 1 -- 172.21.15.123:0/427818891 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6815d5b0 con 0x7f6e680cedc0 2024-09-13T17:08:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6d47f700 1 --2- 172.21.15.123:0/427818891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e680cedc0 0x7f6e68071e60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009850 tx=0x7f6e64009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f7b75a086e32e8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6cc7e700 1 -- 172.21.15.123:0/427818891 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64011830 con 0x7f6e680cedc0 2024-09-13T17:08:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6cc7e700 1 -- 172.21.15.123:0/427818891 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e64011990 con 0x7f6e680cedc0 2024-09-13T17:08:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6cc7e700 1 -- 172.21.15.123:0/427818891 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64011d40 con 0x7f6e680cedc0 2024-09-13T17:08:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6ec82700 1 -- 172.21.15.123:0/427818891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e680cedc0 msgr2=0x7f6e68071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6ec82700 1 --2- 172.21.15.123:0/427818891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e680cedc0 0x7f6e68071e60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009850 tx=0x7f6e64009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6ec82700 1 -- 172.21.15.123:0/427818891 shutdown_connections 2024-09-13T17:08:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6ec82700 1 --2- 172.21.15.123:0/427818891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e680cedc0 0x7f6e68071e60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6ec82700 1 -- 172.21.15.123:0/427818891 >> 172.21.15.123:0/427818891 conn(0x7f6e68066150 msgr2=0x7f6e68066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6ec82700 1 -- 172.21.15.123:0/427818891 shutdown_connections 2024-09-13T17:08:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.424+0000 7f6e6ec82700 1 -- 172.21.15.123:0/427818891 wait complete. 2024-09-13T17:08:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6ec82700 1 Processor -- start 2024-09-13T17:08:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6ec82700 1 -- start start 2024-09-13T17:08:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6ec82700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e680cdfd0 0x7f6e681f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6ec82700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e680cedc0 0x7f6e681f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6ec82700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e681598b0 0x7f6e680a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6ec82700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68150db0 con 0x7f6e680cdfd0 2024-09-13T17:08:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6ec82700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680a9a10 con 0x7f6e681598b0 2024-09-13T17:08:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6ec82700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6815af40 con 0x7f6e680cedc0 2024-09-13T17:08:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6dc80700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e680cdfd0 0x7f6e681f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6dc80700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e680cdfd0 0x7f6e681f12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60262/0 (socket says 172.21.15.123:60262) 2024-09-13T17:08:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6dc80700 1 -- 172.21.15.123:0/1473043967 learned_addr learned my addr 172.21.15.123:0/1473043967 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6d47f700 1 --2- 172.21.15.123:0/1473043967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e680cedc0 0x7f6e681f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6e481700 1 --2- 172.21.15.123:0/1473043967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e681598b0 0x7f6e680a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6dc80700 1 -- 172.21.15.123:0/1473043967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e680cedc0 msgr2=0x7f6e681f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6dc80700 1 --2- 172.21.15.123:0/1473043967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e680cedc0 0x7f6e681f0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6dc80700 1 -- 172.21.15.123:0/1473043967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e681598b0 msgr2=0x7f6e680a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6dc80700 1 --2- 172.21.15.123:0/1473043967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e681598b0 0x7f6e680a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6dc80700 1 -- 172.21.15.123:0/1473043967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e640094b0 con 0x7f6e680cdfd0 2024-09-13T17:08:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.428+0000 7f6e6dc80700 1 --2- 172.21.15.123:0/1473043967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e680cdfd0 0x7f6e681f12f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800c4d0 tx=0x7f6e5800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.432+0000 7f6e5e7fc700 1 -- 172.21.15.123:0/1473043967 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58005d90 con 0x7f6e680cdfd0 2024-09-13T17:08:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.432+0000 7f6e5e7fc700 1 -- 172.21.15.123:0/1473043967 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e580070d0 con 0x7f6e680cdfd0 2024-09-13T17:08:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.432+0000 7f6e6ec82700 1 -- 172.21.15.123:0/1473043967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6815b220 con 0x7f6e680cdfd0 2024-09-13T17:08:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.432+0000 7f6e5e7fc700 1 -- 172.21.15.123:0/1473043967 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58007480 con 0x7f6e680cdfd0 2024-09-13T17:08:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.432+0000 7f6e6ec82700 1 -- 172.21.15.123:0/1473043967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6815b7e0 con 0x7f6e680cdfd0 2024-09-13T17:08:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.432+0000 7f6e6ec82700 1 -- 172.21.15.123:0/1473043967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e680677f0 con 0x7f6e680cdfd0 2024-09-13T17:08:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.432+0000 7f6e5e7fc700 1 -- 172.21.15.123:0/1473043967 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e580075e0 con 0x7f6e680cdfd0 2024-09-13T17:08:12.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.432+0000 7f6e5e7fc700 1 --2- 172.21.15.123:0/1473043967 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6e4c066730 0x7f6e4c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:12.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.436+0000 7f6e5e7fc700 1 -- 172.21.15.123:0/1473043967 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6e580832f0 con 0x7f6e680cdfd0 2024-09-13T17:08:12.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.436+0000 7f6e6d47f700 1 --2- 172.21.15.123:0/1473043967 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6e4c066730 0x7f6e4c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:12.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.436+0000 7f6e6d47f700 1 --2- 172.21.15.123:0/1473043967 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6e4c066730 0x7f6e4c068bf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6e640090b0 tx=0x7f6e64008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.440+0000 7f6e5e7fc700 1 -- 172.21.15.123:0/1473043967 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6e580508e0 con 0x7f6e680cdfd0 2024-09-13T17:08:12.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.612+0000 7f6e6ec82700 1 -- 172.21.15.123:0/1473043967 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e68071e60 con 0x7f6e680cdfd0 2024-09-13T17:08:12.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.616+0000 7f6e5e7fc700 1 -- 172.21.15.123:0/1473043967 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+13036 (secure 0 0 0) 0x7f6e58053f00 con 0x7f6e680cdfd0 2024-09-13T17:08:12.620 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:12.620 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":37,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:11.270581+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6837/2359124958":"2024-09-14T17:08:08.244067+0000","172.21.15.123:6836/2359124958":"2024-09-14T17:08:08.244067+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:12.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.616+0000 7f6e6ec82700 1 -- 172.21.15.123:0/1473043967 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6e4c066730 msgr2=0x7f6e4c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.616+0000 7f6e6ec82700 1 --2- 172.21.15.123:0/1473043967 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6e4c066730 0x7f6e4c068bf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6e640090b0 tx=0x7f6e64008030 comp rx=0 tx=0).stop 2024-09-13T17:08:12.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.616+0000 7f6e6ec82700 1 -- 172.21.15.123:0/1473043967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e680cdfd0 msgr2=0x7f6e681f12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.616+0000 7f6e6ec82700 1 --2- 172.21.15.123:0/1473043967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e680cdfd0 0x7f6e681f12f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800c4d0 tx=0x7f6e5800c7e0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.620+0000 7f6e6ec82700 1 -- 172.21.15.123:0/1473043967 shutdown_connections 2024-09-13T17:08:12.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.620+0000 7f6e6ec82700 1 --2- 172.21.15.123:0/1473043967 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6e4c066730 0x7f6e4c068bf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.620+0000 7f6e6ec82700 1 --2- 172.21.15.123:0/1473043967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e681598b0 0x7f6e680a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.620+0000 7f6e6ec82700 1 --2- 172.21.15.123:0/1473043967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e680cedc0 0x7f6e681f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.620+0000 7f6e6ec82700 1 --2- 172.21.15.123:0/1473043967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e680cdfd0 0x7f6e681f12f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.620+0000 7f6e6ec82700 1 -- 172.21.15.123:0/1473043967 >> 172.21.15.123:0/1473043967 conn(0x7f6e68066150 msgr2=0x7f6e680ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:12.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.620+0000 7f6e6ec82700 1 -- 172.21.15.123:0/1473043967 shutdown_connections 2024-09-13T17:08:12.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.620+0000 7f6e6ec82700 1 -- 172.21.15.123:0/1473043967 wait complete. 2024-09-13T17:08:12.635 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:08:12.635 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:08:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.756+0000 7f10baa7a700 1 Processor -- start 2024-09-13T17:08:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.756+0000 7f10baa7a700 1 -- start start 2024-09-13T17:08:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10baa7a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f10b4165760 0x7f10b4167b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10baa7a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b40d0cb0 con 0x7f10b40d0f40 2024-09-13T17:08:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10baa7a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b40b0060 con 0x7f10b40b58b0 2024-09-13T17:08:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10baa7a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b40b0340 con 0x7f10b4165760 2024-09-13T17:08:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10b9a78700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f10b40d0f40 0x7f10b40d1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47156/0 (socket says 172.21.15.123:47156) 2024-09-13T17:08:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10b9a78700 1 -- 172.21.15.123:0/1852907207 learned_addr learned my addr 172.21.15.123:0/1852907207 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10ba279700 1 --2- 172.21.15.123:0/1852907207 >> v2:172.21.15.153:3300/0 conn(0x7f10b4165760 0x7f10b4167b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10b8a76700 1 -- 172.21.15.123:0/1852907207 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985202597 0 0) 0x7f10b40d0cb0 con 0x7f10b40d0f40 2024-09-13T17:08:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10b8a76700 1 -- 172.21.15.123:0/1852907207 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a00035d0 con 0x7f10b40d0f40 2024-09-13T17:08:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10ba279700 1 -- 172.21.15.123:0/1852907207 >> v1:172.21.15.153:6789/0 conn(0x7f10b40b58b0 legacy=0x7f10b40d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10ba279700 1 -- 172.21.15.123:0/1852907207 >> v1:172.21.15.123:6789/0 conn(0x7f10b40d0f40 legacy=0x7f10b40d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10ba279700 1 -- 172.21.15.123:0/1852907207 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b40b0620 con 0x7f10b4165760 2024-09-13T17:08:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10ba279700 1 --2- 172.21.15.123:0/1852907207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b4165760 0x7f10b4167b50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009d90 tx=0x7f10ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7151c10b97a9f7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10b8a76700 1 -- 172.21.15.123:0/1852907207 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac00e070 con 0x7f10b4165760 2024-09-13T17:08:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10b8a76700 1 -- 172.21.15.123:0/1852907207 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac00bb20 con 0x7f10b4165760 2024-09-13T17:08:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.760+0000 7f10b8a76700 1 -- 172.21.15.123:0/1852907207 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac012430 con 0x7f10b4165760 2024-09-13T17:08:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.764+0000 7f10baa7a700 1 -- 172.21.15.123:0/1852907207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b4165760 msgr2=0x7f10b4167b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.764+0000 7f10baa7a700 1 --2- 172.21.15.123:0/1852907207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b4165760 0x7f10b4167b50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009d90 tx=0x7f10ac00b330 comp rx=0 tx=0).stop 2024-09-13T17:08:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.764+0000 7f10baa7a700 1 -- 172.21.15.123:0/1852907207 shutdown_connections 2024-09-13T17:08:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.764+0000 7f10baa7a700 1 --2- 172.21.15.123:0/1852907207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b4165760 0x7f10b4167b50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.764+0000 7f10baa7a700 1 -- 172.21.15.123:0/1852907207 >> 172.21.15.123:0/1852907207 conn(0x7f10b40d2a60 msgr2=0x7f10b40d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.764+0000 7f10baa7a700 1 -- 172.21.15.123:0/1852907207 shutdown_connections 2024-09-13T17:08:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.764+0000 7f10baa7a700 1 -- 172.21.15.123:0/1852907207 wait complete. 2024-09-13T17:08:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.764+0000 7f10baa7a700 1 Processor -- start 2024-09-13T17:08:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.764+0000 7f10baa7a700 1 -- start start 2024-09-13T17:08:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10baa7a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b40b58b0 0x7f10b415c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10baa7a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b40d0f40 0x7f10b40cf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10baa7a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10b4165760 0x7f10b40cf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10baa7a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b409ce50 con 0x7f10b40d0f40 2024-09-13T17:08:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10baa7a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b409ed30 con 0x7f10b40b58b0 2024-09-13T17:08:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10baa7a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b409cb70 con 0x7f10b4165760 2024-09-13T17:08:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10b9277700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b40d0f40 0x7f10b40cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10b9277700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b40d0f40 0x7f10b40cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60274/0 (socket says 172.21.15.123:60274) 2024-09-13T17:08:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10b9277700 1 -- 172.21.15.123:0/2997343989 learned_addr learned my addr 172.21.15.123:0/2997343989 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10b9a78700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b40b58b0 0x7f10b415c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10ba279700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10b4165760 0x7f10b40cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10b9277700 1 -- 172.21.15.123:0/2997343989 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10b4165760 msgr2=0x7f10b40cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10b9277700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10b4165760 0x7f10b40cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10b9277700 1 -- 172.21.15.123:0/2997343989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b40b58b0 msgr2=0x7f10b415c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10b9277700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b40b58b0 0x7f10b415c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10b9277700 1 -- 172.21.15.123:0/2997343989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac009a70 con 0x7f10b40d0f40 2024-09-13T17:08:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10b9a78700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b40b58b0 0x7f10b415c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10b9277700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b40d0f40 0x7f10b40cf000 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f10a400c500 tx=0x7f10a400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10aa7fc700 1 -- 172.21.15.123:0/2997343989 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a40052d0 con 0x7f10b40d0f40 2024-09-13T17:08:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10aa7fc700 1 -- 172.21.15.123:0/2997343989 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a4005430 con 0x7f10b40d0f40 2024-09-13T17:08:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10baa7a700 1 -- 172.21.15.123:0/2997343989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b409efb0 con 0x7f10b40d0f40 2024-09-13T17:08:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10aa7fc700 1 -- 172.21.15.123:0/2997343989 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a40055a0 con 0x7f10b40d0f40 2024-09-13T17:08:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.768+0000 7f10baa7a700 1 -- 172.21.15.123:0/2997343989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b409f570 con 0x7f10b40d0f40 2024-09-13T17:08:12.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.772+0000 7f10aa7fc700 1 -- 172.21.15.123:0/2997343989 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f10a40038e0 con 0x7f10b40d0f40 2024-09-13T17:08:12.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.772+0000 7f10baa7a700 1 -- 172.21.15.123:0/2997343989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b415ce70 con 0x7f10b40d0f40 2024-09-13T17:08:12.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.772+0000 7f10aa7fc700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1098066730 0x7f1098068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:12.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.772+0000 7f10b9a78700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1098066730 0x7f1098068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:12.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.772+0000 7f10aa7fc700 1 -- 172.21.15.123:0/2997343989 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f10a40832a0 con 0x7f10b40d0f40 2024-09-13T17:08:12.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.772+0000 7f10b9a78700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1098066730 0x7f1098068bf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f10b0007fd0 tx=0x7f10b0007de0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.780+0000 7f10aa7fc700 1 -- 172.21.15.123:0/2997343989 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10a4050870 con 0x7f10b40d0f40 2024-09-13T17:08:12.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.948+0000 7f10baa7a700 1 -- 172.21.15.123:0/2997343989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10b409f760 con 0x7f10b40d0f40 2024-09-13T17:08:12.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.952+0000 7f10aa7fc700 1 -- 172.21.15.123:0/2997343989 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10a4053e90 con 0x7f10b40d0f40 2024-09-13T17:08:12.954 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:08:12.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.952+0000 7f10baa7a700 1 -- 172.21.15.123:0/2997343989 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1098066730 msgr2=0x7f1098068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.952+0000 7f10baa7a700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1098066730 0x7f1098068bf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f10b0007fd0 tx=0x7f10b0007de0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.952+0000 7f10baa7a700 1 -- 172.21.15.123:0/2997343989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b40d0f40 msgr2=0x7f10b40cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:12.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.952+0000 7f10baa7a700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b40d0f40 0x7f10b40cf000 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f10a400c500 tx=0x7f10a400c810 comp rx=0 tx=0).stop 2024-09-13T17:08:12.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.952+0000 7f10baa7a700 1 -- 172.21.15.123:0/2997343989 shutdown_connections 2024-09-13T17:08:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.952+0000 7f10baa7a700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1098066730 0x7f1098068bf0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.952+0000 7f10baa7a700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10b4165760 0x7f10b40cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.952+0000 7f10baa7a700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b40d0f40 0x7f10b40cf000 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.952+0000 7f10baa7a700 1 --2- 172.21.15.123:0/2997343989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b40b58b0 0x7f10b415c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.952+0000 7f10baa7a700 1 -- 172.21.15.123:0/2997343989 >> 172.21.15.123:0/2997343989 conn(0x7f10b40d2a60 msgr2=0x7f10b40b8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.952+0000 7f10baa7a700 1 -- 172.21.15.123:0/2997343989 shutdown_connections 2024-09-13T17:08:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:12.952+0000 7f10baa7a700 1 -- 172.21.15.123:0/2997343989 wait complete. 2024-09-13T17:08:12.968 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values' 2024-09-13T17:08:13.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.076+0000 7fa899ff1700 1 Processor -- start 2024-09-13T17:08:13.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.076+0000 7fa899ff1700 1 -- start start 2024-09-13T17:08:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa899ff1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa8940705b0 0x7fa89415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa899ff1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8940cee80 con 0x7fa89415a8c0 2024-09-13T17:08:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa899ff1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89415bef0 con 0x7fa894071580 2024-09-13T17:08:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa899ff1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa894070a40 con 0x7fa8940705b0 2024-09-13T17:08:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa898fef700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa89415a8c0 0x7fa894070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47172/0 (socket says 172.21.15.123:47172) 2024-09-13T17:08:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa898fef700 1 -- 172.21.15.123:0/1837769191 learned_addr learned my addr 172.21.15.123:0/1837769191 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:13.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa8997f0700 1 --2- 172.21.15.123:0/1837769191 >> v2:172.21.15.153:3300/0 conn(0x7fa8940705b0 0x7fa89415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa8937fe700 1 -- 172.21.15.123:0/1837769191 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987410327 0 0) 0x7fa8940cee80 con 0x7fa89415a8c0 2024-09-13T17:08:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa8937fe700 1 -- 172.21.15.123:0/1837769191 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa87c0035d0 con 0x7fa89415a8c0 2024-09-13T17:08:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa8997f0700 1 -- 172.21.15.123:0/1837769191 >> v1:172.21.15.153:6789/0 conn(0x7fa894071580 legacy=0x7fa8940cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa8937fe700 1 -- 172.21.15.123:0/1837769191 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402547755 0 0) 0x7fa89415bef0 con 0x7fa894071580 2024-09-13T17:08:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa8997f0700 1 -- 172.21.15.123:0/1837769191 >> v1:172.21.15.123:6789/0 conn(0x7fa89415a8c0 legacy=0x7fa894070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa8997f0700 1 -- 172.21.15.123:0/1837769191 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8940ce270 con 0x7fa8940705b0 2024-09-13T17:08:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa8997f0700 1 --2- 172.21.15.123:0/1837769191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8940705b0 0x7fa89415b9b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009850 tx=0x7fa88c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40b6c9643de5abe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa8937fe700 1 -- 172.21.15.123:0/1837769191 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c011830 con 0x7fa8940705b0 2024-09-13T17:08:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa8937fe700 1 -- 172.21.15.123:0/1837769191 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c011990 con 0x7fa8940705b0 2024-09-13T17:08:13.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa8937fe700 1 -- 172.21.15.123:0/1837769191 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c011d40 con 0x7fa8940705b0 2024-09-13T17:08:13.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa899ff1700 1 -- 172.21.15.123:0/1837769191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8940705b0 msgr2=0x7fa89415b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:13.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa899ff1700 1 --2- 172.21.15.123:0/1837769191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8940705b0 0x7fa89415b9b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009850 tx=0x7fa88c009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:13.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa899ff1700 1 -- 172.21.15.123:0/1837769191 shutdown_connections 2024-09-13T17:08:13.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa899ff1700 1 --2- 172.21.15.123:0/1837769191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8940705b0 0x7fa89415b9b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:13.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa899ff1700 1 -- 172.21.15.123:0/1837769191 >> 172.21.15.123:0/1837769191 conn(0x7fa894066150 msgr2=0x7fa894066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:13.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa899ff1700 1 -- 172.21.15.123:0/1837769191 shutdown_connections 2024-09-13T17:08:13.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.080+0000 7fa899ff1700 1 -- 172.21.15.123:0/1837769191 wait complete. 2024-09-13T17:08:13.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa899ff1700 1 Processor -- start 2024-09-13T17:08:13.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa899ff1700 1 -- start start 2024-09-13T17:08:13.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa899ff1700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8940705b0 0x7fa8941efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:13.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa899ff1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa894071580 0x7fa89413fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:13.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa899ff1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89415a8c0 0x7fa89414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:13.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa899ff1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89415bbc0 con 0x7fa89415a8c0 2024-09-13T17:08:13.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa899ff1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa894140380 con 0x7fa894071580 2024-09-13T17:08:13.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa899ff1700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa894153060 con 0x7fa8940705b0 2024-09-13T17:08:13.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa8997f0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89415a8c0 0x7fa89414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:13.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa8997f0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89415a8c0 0x7fa89414fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60282/0 (socket says 172.21.15.123:60282) 2024-09-13T17:08:13.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa8997f0700 1 -- 172.21.15.123:0/2902497513 learned_addr learned my addr 172.21.15.123:0/2902497513 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:13.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa898fef700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8940705b0 0x7fa8941efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:13.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa893fff700 1 --2- 172.21.15.123:0/2902497513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa894071580 0x7fa89413fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:13.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa898fef700 1 -- 172.21.15.123:0/2902497513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa894071580 msgr2=0x7fa89413fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:13.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa898fef700 1 --2- 172.21.15.123:0/2902497513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa894071580 0x7fa89413fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:13.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa898fef700 1 -- 172.21.15.123:0/2902497513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89415a8c0 msgr2=0x7fa89414fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:13.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa898fef700 1 --2- 172.21.15.123:0/2902497513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89415a8c0 0x7fa89414fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:13.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa898fef700 1 -- 172.21.15.123:0/2902497513 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c0094b0 con 0x7fa8940705b0 2024-09-13T17:08:13.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa898fef700 1 --2- 172.21.15.123:0/2902497513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8940705b0 0x7fa8941efa50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa88800c500 tx=0x7fa88800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:13.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa8917fa700 1 -- 172.21.15.123:0/2902497513 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888005d90 con 0x7fa8940705b0 2024-09-13T17:08:13.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa899ff1700 1 -- 172.21.15.123:0/2902497513 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89415be10 con 0x7fa8940705b0 2024-09-13T17:08:13.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa8917fa700 1 -- 172.21.15.123:0/2902497513 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88800ce70 con 0x7fa8940705b0 2024-09-13T17:08:13.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa8917fa700 1 -- 172.21.15.123:0/2902497513 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8880072d0 con 0x7fa8940705b0 2024-09-13T17:08:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.084+0000 7fa899ff1700 1 -- 172.21.15.123:0/2902497513 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89415c3d0 con 0x7fa8940705b0 2024-09-13T17:08:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.088+0000 7fa8917fa700 1 -- 172.21.15.123:0/2902497513 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa888007430 con 0x7fa8940705b0 2024-09-13T17:08:13.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.088+0000 7fa899ff1700 1 -- 172.21.15.123:0/2902497513 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8940677f0 con 0x7fa8940705b0 2024-09-13T17:08:13.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.088+0000 7fa8917fa700 1 --2- 172.21.15.123:0/2902497513 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa880066730 0x7fa880068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:13.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.088+0000 7fa8917fa700 1 -- 172.21.15.123:0/2902497513 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa888083260 con 0x7fa8940705b0 2024-09-13T17:08:13.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.088+0000 7fa893fff700 1 --2- 172.21.15.123:0/2902497513 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa880066730 0x7fa880068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:13.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.088+0000 7fa893fff700 1 --2- 172.21.15.123:0/2902497513 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa880066730 0x7fa880068bf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa884002230 tx=0x7fa884009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:13.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.100+0000 7fa8917fa700 1 -- 172.21.15.123:0/2902497513 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8880507b0 con 0x7fa8940705b0 2024-09-13T17:08:13.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:13.332+0000 7fa899ff1700 1 -- 172.21.15.123:0/2902497513 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values"]} v 0) v1 -- 0x7fa89415c5f0 con 0x7fa8940705b0 2024-09-13T17:08:14.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.296+0000 7fa8917fa700 1 -- 172.21.15.123:0/2902497513 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values"]}]=0 v102) v1 ==== 156+0+0 (secure 0 0 0) 0x7fa888053dd0 con 0x7fa8940705b0 2024-09-13T17:08:14.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.300+0000 7fa899ff1700 1 -- 172.21.15.123:0/2902497513 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa880066730 msgr2=0x7fa880068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.300+0000 7fa899ff1700 1 --2- 172.21.15.123:0/2902497513 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa880066730 0x7fa880068bf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa884002230 tx=0x7fa884009040 comp rx=0 tx=0).stop 2024-09-13T17:08:14.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.300+0000 7fa899ff1700 1 -- 172.21.15.123:0/2902497513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8940705b0 msgr2=0x7fa8941efa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.300+0000 7fa899ff1700 1 --2- 172.21.15.123:0/2902497513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8940705b0 0x7fa8941efa50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa88800c500 tx=0x7fa88800c810 comp rx=0 tx=0).stop 2024-09-13T17:08:14.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.300+0000 7fa899ff1700 1 -- 172.21.15.123:0/2902497513 shutdown_connections 2024-09-13T17:08:14.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.300+0000 7fa899ff1700 1 --2- 172.21.15.123:0/2902497513 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa880066730 0x7fa880068bf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.300+0000 7fa899ff1700 1 --2- 172.21.15.123:0/2902497513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa89415a8c0 0x7fa89414fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.300+0000 7fa899ff1700 1 --2- 172.21.15.123:0/2902497513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa894071580 0x7fa89413fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.300+0000 7fa899ff1700 1 --2- 172.21.15.123:0/2902497513 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8940705b0 0x7fa8941efa50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.300+0000 7fa899ff1700 1 -- 172.21.15.123:0/2902497513 >> 172.21.15.123:0/2902497513 conn(0x7fa894066150 msgr2=0x7fa89406d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:14.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.300+0000 7fa899ff1700 1 -- 172.21.15.123:0/2902497513 shutdown_connections 2024-09-13T17:08:14.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.300+0000 7fa899ff1700 1 -- 172.21.15.123:0/2902497513 wait complete. 2024-09-13T17:08:14.321 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T17:08:14.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.444+0000 7f8b2b59e700 1 Processor -- start 2024-09-13T17:08:14.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.444+0000 7f8b2b59e700 1 -- start start 2024-09-13T17:08:14.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2b59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8b2c165760 0x7f8b2c167b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2b59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2c0d0cb0 con 0x7f8b2c0b58b0 2024-09-13T17:08:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2b59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2c0b0060 con 0x7f8b2c0d0f40 2024-09-13T17:08:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2b59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2c0b0340 con 0x7f8b2c165760 2024-09-13T17:08:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2ad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8b2c165760 0x7f8b2c167b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b29d9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8b2c0b58b0 0x7f8b2c0d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47182/0 (socket says 172.21.15.123:47182) 2024-09-13T17:08:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2ad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8b2c165760 0x7f8b2c167b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60290/0 (socket says 172.21.15.123:60290) 2024-09-13T17:08:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b29d9b700 1 -- 172.21.15.123:0/769653362 learned_addr learned my addr 172.21.15.123:0/769653362 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2ad9d700 1 -- 172.21.15.123:0/769653362 >> v1:172.21.15.153:6789/0 conn(0x7f8b2c0d0f40 legacy=0x7f8b2c0d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2ad9d700 1 -- 172.21.15.123:0/769653362 >> v1:172.21.15.123:6789/0 conn(0x7f8b2c0b58b0 legacy=0x7f8b2c0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2ad9d700 1 -- 172.21.15.123:0/769653362 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c0b0620 con 0x7f8b2c165760 2024-09-13T17:08:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2ad9d700 1 --2- 172.21.15.123:0/769653362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b2c165760 0x7f8b2c167b50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009d90 tx=0x7f8b2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12903e0dad732d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2959a700 1 -- 172.21.15.123:0/769653362 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2400e070 con 0x7f8b2c165760 2024-09-13T17:08:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2959a700 1 -- 172.21.15.123:0/769653362 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2400bbd0 con 0x7f8b2c165760 2024-09-13T17:08:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2959a700 1 -- 172.21.15.123:0/769653362 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24012430 con 0x7f8b2c165760 2024-09-13T17:08:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2b59e700 1 -- 172.21.15.123:0/769653362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b2c165760 msgr2=0x7f8b2c167b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2b59e700 1 --2- 172.21.15.123:0/769653362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b2c165760 0x7f8b2c167b50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009d90 tx=0x7f8b2400b330 comp rx=0 tx=0).stop 2024-09-13T17:08:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2b59e700 1 -- 172.21.15.123:0/769653362 shutdown_connections 2024-09-13T17:08:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2b59e700 1 --2- 172.21.15.123:0/769653362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b2c165760 0x7f8b2c167b50 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2b59e700 1 -- 172.21.15.123:0/769653362 >> 172.21.15.123:0/769653362 conn(0x7f8b2c0d2a60 msgr2=0x7f8b2c0d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2b59e700 1 -- 172.21.15.123:0/769653362 shutdown_connections 2024-09-13T17:08:14.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.448+0000 7f8b2b59e700 1 -- 172.21.15.123:0/769653362 wait complete. 2024-09-13T17:08:14.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2b59e700 1 Processor -- start 2024-09-13T17:08:14.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2b59e700 1 -- start start 2024-09-13T17:08:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2b59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b2c0b58b0 0x7f8b2c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b2c0d0f40 0x7f8b2c158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b2c165760 0x7f8b2c0b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2b59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c0ccbb0 con 0x7f8b2c165760 2024-09-13T17:08:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c0b3670 con 0x7f8b2c0d0f40 2024-09-13T17:08:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2b59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c0b3950 con 0x7f8b2c0b58b0 2024-09-13T17:08:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b2c165760 0x7f8b2c0b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b2c165760 0x7f8b2c0b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60302/0 (socket says 172.21.15.123:60302) 2024-09-13T17:08:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2ad9d700 1 -- 172.21.15.123:0/1754269141 learned_addr learned my addr 172.21.15.123:0/1754269141 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b29d9b700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b2c0d0f40 0x7f8b2c158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2a59c700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b2c0b58b0 0x7f8b2c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2ad9d700 1 -- 172.21.15.123:0/1754269141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b2c0b58b0 msgr2=0x7f8b2c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2ad9d700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b2c0b58b0 0x7f8b2c0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2ad9d700 1 -- 172.21.15.123:0/1754269141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b2c0d0f40 msgr2=0x7f8b2c158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2ad9d700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b2c0d0f40 0x7f8b2c158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2ad9d700 1 -- 172.21.15.123:0/1754269141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b24009a70 con 0x7f8b2c165760 2024-09-13T17:08:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b29d9b700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b2c0d0f40 0x7f8b2c158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2ad9d700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b2c165760 0x7f8b2c0b5d90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8b24014040 tx=0x7f8b24004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b22ffd700 1 -- 172.21.15.123:0/1754269141 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b240098f0 con 0x7f8b2c165760 2024-09-13T17:08:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b22ffd700 1 -- 172.21.15.123:0/1754269141 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b24020070 con 0x7f8b2c165760 2024-09-13T17:08:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b2b59e700 1 -- 172.21.15.123:0/1754269141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2c0b3c30 con 0x7f8b2c165760 2024-09-13T17:08:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.452+0000 7f8b22ffd700 1 -- 172.21.15.123:0/1754269141 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24004280 con 0x7f8b2c165760 2024-09-13T17:08:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.456+0000 7f8b2b59e700 1 -- 172.21.15.123:0/1754269141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2c158ea0 con 0x7f8b2c165760 2024-09-13T17:08:14.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.456+0000 7f8b2b59e700 1 -- 172.21.15.123:0/1754269141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2c0b4150 con 0x7f8b2c165760 2024-09-13T17:08:14.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.456+0000 7f8b22ffd700 1 -- 172.21.15.123:0/1754269141 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8b240043e0 con 0x7f8b2c165760 2024-09-13T17:08:14.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.456+0000 7f8b22ffd700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b0c066730 0x7f8b0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.456+0000 7f8b22ffd700 1 -- 172.21.15.123:0/1754269141 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8b24022070 con 0x7f8b2c165760 2024-09-13T17:08:14.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.456+0000 7f8b2a59c700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b0c066730 0x7f8b0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.456+0000 7f8b2a59c700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b0c066730 0x7f8b0c068bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8b140016e0 tx=0x7f8b14009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:14.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.464+0000 7f8b22ffd700 1 -- 172.21.15.123:0/1754269141 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8b2c0b4150 con 0x7f8b2c165760 2024-09-13T17:08:14.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.636+0000 7f8b2b59e700 1 -- 172.21.15.123:0/1754269141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8b2c0b4150 con 0x7f8b2c165760 2024-09-13T17:08:14.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.644+0000 7f8b22ffd700 1 -- 172.21.15.123:0/1754269141 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8b2c0b4150 con 0x7f8b2c165760 2024-09-13T17:08:14.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.648+0000 7f8b2b59e700 1 -- 172.21.15.123:0/1754269141 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b0c066730 msgr2=0x7f8b0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.648+0000 7f8b2b59e700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b0c066730 0x7f8b0c068bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8b140016e0 tx=0x7f8b14009040 comp rx=0 tx=0).stop 2024-09-13T17:08:14.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.648+0000 7f8b2b59e700 1 -- 172.21.15.123:0/1754269141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b2c165760 msgr2=0x7f8b2c0b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.648+0000 7f8b2b59e700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b2c165760 0x7f8b2c0b5d90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8b24014040 tx=0x7f8b24004af0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.648+0000 7f8b2b59e700 1 -- 172.21.15.123:0/1754269141 shutdown_connections 2024-09-13T17:08:14.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.648+0000 7f8b2b59e700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8b0c066730 0x7f8b0c068bf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.648+0000 7f8b2b59e700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b2c165760 0x7f8b2c0b5d90 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.648+0000 7f8b2b59e700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b2c0d0f40 0x7f8b2c158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.648+0000 7f8b2b59e700 1 --2- 172.21.15.123:0/1754269141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8b2c0b58b0 0x7f8b2c0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.648+0000 7f8b2b59e700 1 -- 172.21.15.123:0/1754269141 >> 172.21.15.123:0/1754269141 conn(0x7f8b2c0d2a60 msgr2=0x7f8b2c06fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:14.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.648+0000 7f8b2b59e700 1 -- 172.21.15.123:0/1754269141 shutdown_connections 2024-09-13T17:08:14.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.648+0000 7f8b2b59e700 1 -- 172.21.15.123:0/1754269141 wait complete. 2024-09-13T17:08:14.666 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:08:14.666 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:08:14.685 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:08:14.706 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:08:14.706 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:08:14.706 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:14.736 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:08:14.737 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:08:14.737 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:14.754 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:08:14.755 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:08:14.755 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:14.762 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:08:14.762 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:08:14.762 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:14.768 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:08:14.769 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T17:08:14.769 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:08:14.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1da3120700 1 Processor -- start 2024-09-13T17:08:14.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1da3120700 1 -- start start 2024-09-13T17:08:14.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1da3120700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d9c0cec90 0x7f1d9c0cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1da3120700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9c0b1cf0 con 0x7f1d9c15aa80 2024-09-13T17:08:14.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1da3120700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9c0b37f0 con 0x7f1d9c072510 2024-09-13T17:08:14.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1da3120700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c15ae60 con 0x7f1d9c0cec90 2024-09-13T17:08:14.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1da0ebc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1d9c15aa80 0x7f1d9c15b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47192/0 (socket says 172.21.15.123:47192) 2024-09-13T17:08:14.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1da0ebc700 1 -- 172.21.15.123:0/2772234726 learned_addr learned my addr 172.21.15.123:0/2772234726 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:14.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1da16bd700 1 --2- 172.21.15.123:0/2772234726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d9c0cec90 0x7f1d9c0cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 -- 172.21.15.123:0/2772234726 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521878098 0 0) 0x7f1d9c0b1cf0 con 0x7f1d9c15aa80 2024-09-13T17:08:14.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 -- 172.21.15.123:0/2772234726 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d880035d0 con 0x7f1d9c15aa80 2024-09-13T17:08:14.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 -- 172.21.15.123:0/2772234726 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3241880037 0 0) 0x7f1d880035d0 con 0x7f1d9c15aa80 2024-09-13T17:08:14.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 -- 172.21.15.123:0/2772234726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d9c0cec90 msgr2=0x7f1d9c0cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:14.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 --2- 172.21.15.123:0/2772234726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d9c0cec90 0x7f1d9c0cf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 -- 172.21.15.123:0/2772234726 >> v1:172.21.15.153:6789/0 conn(0x7f1d9c072510 legacy=0x7f1d9c0cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 -- 172.21.15.123:0/2772234726 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c0b3ad0 con 0x7f1d9c15aa80 2024-09-13T17:08:14.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 -- 172.21.15.123:0/2772234726 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f1d8c001670 con 0x7f1d9c15aa80 2024-09-13T17:08:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 -- 172.21.15.123:0/2772234726 >> v1:172.21.15.123:6789/0 conn(0x7f1d9c15aa80 legacy=0x7f1d9c15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 --2- 172.21.15.123:0/2772234726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d88003a50 0x7f1d88003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 --2- 172.21.15.123:0/2772234726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d88004870 0x7f1d88004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 --2- 172.21.15.123:0/2772234726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d9c0cec90 0x7f1d88005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 -- 172.21.15.123:0/2772234726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8800fef0 con 0x7f1d88004870 2024-09-13T17:08:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 -- 172.21.15.123:0/2772234726 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d88010030 con 0x7f1d88003a50 2024-09-13T17:08:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 -- 172.21.15.123:0/2772234726 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d880101f0 con 0x7f1d9c0cec90 2024-09-13T17:08:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9bfff700 1 --2- 172.21.15.123:0/2772234726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d88004870 0x7f1d88004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1da0ebc700 1 --2- 172.21.15.123:0/2772234726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d88003a50 0x7f1d88003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1da16bd700 1 --2- 172.21.15.123:0/2772234726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d9c0cec90 0x7f1d88005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9bfff700 1 -- 172.21.15.123:0/2772234726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d9c0cec90 msgr2=0x7f1d88005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9bfff700 1 --2- 172.21.15.123:0/2772234726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d9c0cec90 0x7f1d88005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9bfff700 1 -- 172.21.15.123:0/2772234726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d88003a50 msgr2=0x7f1d88003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9bfff700 1 --2- 172.21.15.123:0/2772234726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d88003a50 0x7f1d88003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9bfff700 1 -- 172.21.15.123:0/2772234726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d880035d0 con 0x7f1d88004870 2024-09-13T17:08:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1da16bd700 1 --2- 172.21.15.123:0/2772234726 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d9c0cec90 0x7f1d88005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1da0ebc700 1 --2- 172.21.15.123:0/2772234726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d88003a50 0x7f1d88003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9bfff700 1 --2- 172.21.15.123:0/2772234726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d88004870 0x7f1d88004cf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1d84007fd0 tx=0x7f1d880058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e460ce3b8d8d706 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.924+0000 7f1d9b7fe700 1 -- 172.21.15.123:0/2772234726 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d840052d0 con 0x7f1d88004870 2024-09-13T17:08:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.928+0000 7f1d9b7fe700 1 -- 172.21.15.123:0/2772234726 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d84005430 con 0x7f1d88004870 2024-09-13T17:08:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.928+0000 7f1d9b7fe700 1 -- 172.21.15.123:0/2772234726 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d840055a0 con 0x7f1d88004870 2024-09-13T17:08:14.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.928+0000 7f1da3120700 1 -- 172.21.15.123:0/2772234726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d88004870 msgr2=0x7f1d88004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.928+0000 7f1da3120700 1 --2- 172.21.15.123:0/2772234726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d88004870 0x7f1d88004cf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1d84007fd0 tx=0x7f1d880058a0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.928+0000 7f1da16bd700 1 -- 172.21.15.123:0/2772234726 reap_dead start 2024-09-13T17:08:14.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.928+0000 7f1da3120700 1 -- 172.21.15.123:0/2772234726 shutdown_connections 2024-09-13T17:08:14.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.928+0000 7f1da3120700 1 -- 172.21.15.123:0/2772234726 >> 172.21.15.123:0/2772234726 conn(0x7f1d9c066570 msgr2=0x7f1d9c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:14.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.928+0000 7f1da3120700 1 -- 172.21.15.123:0/2772234726 shutdown_connections 2024-09-13T17:08:14.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.928+0000 7f1da3120700 1 -- 172.21.15.123:0/2772234726 wait complete. 2024-09-13T17:08:14.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da3120700 1 Processor -- start 2024-09-13T17:08:14.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da3120700 1 -- start start 2024-09-13T17:08:14.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da3120700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d88004870 0x7f1d9c140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da3120700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d9c14b520 0x7f1d9c0ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da3120700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d9c0ae990 0x7f1d9c0aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da3120700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c140860 con 0x7f1d88004870 2024-09-13T17:08:14.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da3120700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c14f3f0 con 0x7f1d9c0ae990 2024-09-13T17:08:14.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da3120700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c14c8d0 con 0x7f1d9c14b520 2024-09-13T17:08:14.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da0ebc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d88004870 0x7f1d9c140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da0ebc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d88004870 0x7f1d9c140320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60330/0 (socket says 172.21.15.123:60330) 2024-09-13T17:08:14.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da0ebc700 1 -- 172.21.15.123:0/107916220 learned_addr learned my addr 172.21.15.123:0/107916220 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:14.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1d9bfff700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d9c14b520 0x7f1d9c0ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da16bd700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d9c0ae990 0x7f1d9c0aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da0ebc700 1 -- 172.21.15.123:0/107916220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d9c14b520 msgr2=0x7f1d9c0ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da0ebc700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d9c14b520 0x7f1d9c0ae450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da0ebc700 1 -- 172.21.15.123:0/107916220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d9c0ae990 msgr2=0x7f1d9c0aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da0ebc700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d9c0ae990 0x7f1d9c0aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da0ebc700 1 -- 172.21.15.123:0/107916220 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c14f110 con 0x7f1d88004870 2024-09-13T17:08:14.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da16bd700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d9c0ae990 0x7f1d9c0aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:14.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1da0ebc700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d88004870 0x7f1d9c140320 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0017a0 tx=0x7f1d8c0078e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:14.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.932+0000 7f1d997fa700 1 -- 172.21.15.123:0/107916220 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c00f8d0 con 0x7f1d88004870 2024-09-13T17:08:14.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.936+0000 7f1d997fa700 1 -- 172.21.15.123:0/107916220 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c00fa30 con 0x7f1d88004870 2024-09-13T17:08:14.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.936+0000 7f1da3120700 1 -- 172.21.15.123:0/107916220 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c15b3a0 con 0x7f1d88004870 2024-09-13T17:08:14.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.936+0000 7f1d997fa700 1 -- 172.21.15.123:0/107916220 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c00fda0 con 0x7f1d88004870 2024-09-13T17:08:14.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.936+0000 7f1da3120700 1 -- 172.21.15.123:0/107916220 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c15b960 con 0x7f1d88004870 2024-09-13T17:08:14.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.936+0000 7f1da3120700 1 -- 172.21.15.123:0/107916220 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9c0b3150 con 0x7f1d88004870 2024-09-13T17:08:14.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.936+0000 7f1d997fa700 1 -- 172.21.15.123:0/107916220 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d8c01d460 con 0x7f1d88004870 2024-09-13T17:08:14.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.936+0000 7f1d997fa700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1d7c066730 0x7f1d7c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.936+0000 7f1d997fa700 1 -- 172.21.15.123:0/107916220 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1d8c083ec0 con 0x7f1d88004870 2024-09-13T17:08:14.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.936+0000 7f1d9bfff700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1d7c066730 0x7f1d7c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.940+0000 7f1d9bfff700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1d7c066730 0x7f1d7c068bf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1d84000ff0 tx=0x7f1d84009030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:14.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:14.944+0000 7f1d997fa700 1 -- 172.21.15.123:0/107916220 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1d8c0515c0 con 0x7f1d88004870 2024-09-13T17:08:15.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.152+0000 7f1da3120700 1 -- 172.21.15.123:0/107916220 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d9c0cf520 con 0x7f1d88004870 2024-09-13T17:08:15.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.152+0000 7f1d997fa700 1 -- 172.21.15.123:0/107916220 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f1d8c054be0 con 0x7f1d88004870 2024-09-13T17:08:15.158 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:15.158 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/675597916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":675597916},{"type":"v1","addr":"172.21.15.153:6835","nonce":675597916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/943744723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":943744723},{"type":"v1","addr":"172.21.15.153:6834","nonce":943744723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/625103317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":625103317},{"type":"v1","addr":"172.21.15.123:6835","nonce":625103317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/4222234432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":4222234432},{"type":"v1","addr":"172.21.15.123:6837","nonce":4222234432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[]} 2024-09-13T17:08:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.156+0000 7f1da3120700 1 -- 172.21.15.123:0/107916220 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1d7c066730 msgr2=0x7f1d7c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.156+0000 7f1da3120700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1d7c066730 0x7f1d7c068bf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1d84000ff0 tx=0x7f1d84009030 comp rx=0 tx=0).stop 2024-09-13T17:08:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.156+0000 7f1da3120700 1 -- 172.21.15.123:0/107916220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d88004870 msgr2=0x7f1d9c140320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.156+0000 7f1da3120700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d88004870 0x7f1d9c140320 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0017a0 tx=0x7f1d8c0078e0 comp rx=0 tx=0).stop 2024-09-13T17:08:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.156+0000 7f1da3120700 1 -- 172.21.15.123:0/107916220 shutdown_connections 2024-09-13T17:08:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.156+0000 7f1da3120700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1d7c066730 0x7f1d7c068bf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.156+0000 7f1da3120700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d9c0ae990 0x7f1d9c0aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.156+0000 7f1da3120700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1d9c14b520 0x7f1d9c0ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.156+0000 7f1da3120700 1 --2- 172.21.15.123:0/107916220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d88004870 0x7f1d9c140320 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.156+0000 7f1da3120700 1 -- 172.21.15.123:0/107916220 >> 172.21.15.123:0/107916220 conn(0x7f1d9c066570 msgr2=0x7f1d9c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.156+0000 7f1da3120700 1 -- 172.21.15.123:0/107916220 shutdown_connections 2024-09-13T17:08:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.156+0000 7f1da3120700 1 -- 172.21.15.123:0/107916220 wait complete. 2024-09-13T17:08:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 15 2024-09-13T17:08:15.173 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:08:15.173 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:08:15.173 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:08:15.173 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:08:15.173 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:08:15.174 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:08:15.174 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:08:15.174 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:08:15.174 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:08:15.174 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:08:15.174 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:08:15.174 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:08:15.175 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:08:15.175 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:08:15.175 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:08:15.175 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:08:15.184 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:08:15.184 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:08:15.186 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:08:15.187 DEBUG:teuthology.parallel:result is None 2024-09-13T17:08:15.188 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:08:15.188 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:08:15.191 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:08:15.192 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:08:15.193 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:08:15.193 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:08:15.194 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:08:15.194 DEBUG:teuthology.parallel:result is None 2024-09-13T17:08:15.195 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:08:15.195 DEBUG:teuthology.parallel:result is None 2024-09-13T17:08:15.231 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:08:15.231 DEBUG:teuthology.parallel:result is None 2024-09-13T17:08:15.231 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T17:08:15.270 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-13T17:08:15.274 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-09-13T17:08:15.274 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-09-13T17:08:15.307 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-13T17:08:15.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 Processor -- start 2024-09-13T17:08:15.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 -- start start 2024-09-13T17:08:15.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f469c15ce00 0x7f469c0cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:15.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f469c0ad2a0 0x7f469c0cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:15.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c0ad7d0 con 0x7f469c15e200 2024-09-13T17:08:15.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c15d1e0 con 0x7f469c15ce00 2024-09-13T17:08:15.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c15d440 con 0x7f469c0ad2a0 2024-09-13T17:08:15.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a172b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f469c15ce00 0x7f469c0cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:15.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a172b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f469c15ce00 0x7f469c0cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60366/0 (socket says 172.21.15.123:60366) 2024-09-13T17:08:15.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a172b700 1 -- 172.21.15.123:0/1058640308 learned_addr learned my addr 172.21.15.123:0/1058640308 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:15.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a0f2a700 1 --1- 172.21.15.123:0/1058640308 >> v1:172.21.15.123:6789/0 conn(0x7f469c15e200 0x7f469c0ae8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47210/0 (socket says 172.21.15.123:47210) 2024-09-13T17:08:15.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a1f2c700 1 --2- 172.21.15.123:0/1058640308 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f469c0ad2a0 0x7f469c0cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:15.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a172b700 1 -- 172.21.15.123:0/1058640308 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f469c0ad2a0 msgr2=0x7f469c0cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:15.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a172b700 1 --2- 172.21.15.123:0/1058640308 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f469c0ad2a0 0x7f469c0cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:15.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a172b700 1 -- 172.21.15.123:0/1058640308 >> v1:172.21.15.123:6789/0 conn(0x7f469c15e200 legacy=0x7f469c0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:15.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a172b700 1 -- 172.21.15.123:0/1058640308 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c15d720 con 0x7f469c15ce00 2024-09-13T17:08:15.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a172b700 1 --2- 172.21.15.123:0/1058640308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c15ce00 0x7f469c0cc450 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4698009910 tx=0x7f4698009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135f9558030d88f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:15.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f468ffff700 1 -- 172.21.15.123:0/1058640308 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800ba60 con 0x7f469c15ce00 2024-09-13T17:08:15.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f468ffff700 1 -- 172.21.15.123:0/1058640308 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800bbc0 con 0x7f469c15ce00 2024-09-13T17:08:15.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f468ffff700 1 -- 172.21.15.123:0/1058640308 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698009e60 con 0x7f469c15ce00 2024-09-13T17:08:15.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 -- 172.21.15.123:0/1058640308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c15ce00 msgr2=0x7f469c0cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:15.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 --2- 172.21.15.123:0/1058640308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c15ce00 0x7f469c0cc450 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4698009910 tx=0x7f4698009c20 comp rx=0 tx=0).stop 2024-09-13T17:08:15.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 -- 172.21.15.123:0/1058640308 shutdown_connections 2024-09-13T17:08:15.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 --2- 172.21.15.123:0/1058640308 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f469c0ad2a0 0x7f469c0cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:15.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 --2- 172.21.15.123:0/1058640308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c15ce00 0x7f469c0cc450 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:15.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 -- 172.21.15.123:0/1058640308 >> 172.21.15.123:0/1058640308 conn(0x7f469c0b0450 msgr2=0x7f469c0b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:15.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 -- 172.21.15.123:0/1058640308 shutdown_connections 2024-09-13T17:08:15.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.340+0000 7f46a398f700 1 -- 172.21.15.123:0/1058640308 wait complete. 2024-09-13T17:08:15.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.344+0000 7f46a398f700 1 Processor -- start 2024-09-13T17:08:15.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.344+0000 7f46a398f700 1 -- start start 2024-09-13T17:08:15.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a398f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c0ad2a0 0x7f469c158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:15.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a398f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c15ce00 0x7f469c154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:15.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a398f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f469c15e200 0x7f469c0c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:15.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a398f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c1553f0 con 0x7f469c15ce00 2024-09-13T17:08:15.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a398f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0c61a0 con 0x7f469c0ad2a0 2024-09-13T17:08:15.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a398f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0c6480 con 0x7f469c15e200 2024-09-13T17:08:15.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a0f2a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c15ce00 0x7f469c154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:15.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a0f2a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c15ce00 0x7f469c154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60374/0 (socket says 172.21.15.123:60374) 2024-09-13T17:08:15.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a0f2a700 1 -- 172.21.15.123:0/412574611 learned_addr learned my addr 172.21.15.123:0/412574611 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:15.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a172b700 1 --2- 172.21.15.123:0/412574611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c0ad2a0 0x7f469c158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:15.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a1f2c700 1 --2- 172.21.15.123:0/412574611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f469c15e200 0x7f469c0c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:15.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a0f2a700 1 -- 172.21.15.123:0/412574611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f469c15e200 msgr2=0x7f469c0c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:15.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a0f2a700 1 --2- 172.21.15.123:0/412574611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f469c15e200 0x7f469c0c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:15.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a0f2a700 1 -- 172.21.15.123:0/412574611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c0ad2a0 msgr2=0x7f469c158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:15.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a0f2a700 1 --2- 172.21.15.123:0/412574611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c0ad2a0 0x7f469c158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:15.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a0f2a700 1 -- 172.21.15.123:0/412574611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4698009570 con 0x7f469c15ce00 2024-09-13T17:08:15.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a0f2a700 1 --2- 172.21.15.123:0/412574611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c15ce00 0x7f469c154eb0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f469000c430 tx=0x7f469000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:15.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f468dffb700 1 -- 172.21.15.123:0/412574611 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690005cd0 con 0x7f469c15ce00 2024-09-13T17:08:15.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f468dffb700 1 -- 172.21.15.123:0/412574611 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4690005e30 con 0x7f469c15ce00 2024-09-13T17:08:15.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a398f700 1 -- 172.21.15.123:0/412574611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c0c6760 con 0x7f469c15ce00 2024-09-13T17:08:15.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f468dffb700 1 -- 172.21.15.123:0/412574611 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46900072d0 con 0x7f469c15ce00 2024-09-13T17:08:15.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a398f700 1 -- 172.21.15.123:0/412574611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c0c6d20 con 0x7f469c15ce00 2024-09-13T17:08:15.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.348+0000 7f46a398f700 1 -- 172.21.15.123:0/412574611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c0c6ee0 con 0x7f469c15ce00 2024-09-13T17:08:15.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.352+0000 7f468dffb700 1 -- 172.21.15.123:0/412574611 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4690007430 con 0x7f469c15ce00 2024-09-13T17:08:15.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.352+0000 7f468dffb700 1 --2- 172.21.15.123:0/412574611 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4680066730 0x7f4680068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:15.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.352+0000 7f468dffb700 1 -- 172.21.15.123:0/412574611 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4690083120 con 0x7f469c15ce00 2024-09-13T17:08:15.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.352+0000 7f46a172b700 1 --2- 172.21.15.123:0/412574611 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4680066730 0x7f4680068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:15.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.352+0000 7f46a172b700 1 --2- 172.21.15.123:0/412574611 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4680066730 0x7f4680068bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4698000c00 tx=0x7f4698008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:15.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.356+0000 7f468dffb700 1 -- 172.21.15.123:0/412574611 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4690050720 con 0x7f469c15ce00 2024-09-13T17:08:15.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:15.540+0000 7f46a398f700 1 -- 172.21.15.123:0/412574611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f469c0ae0a0 con 0x7f469c15ce00 2024-09-13T17:08:16.253 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:08:16.256 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:08:16.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.328+0000 7f468dffb700 1 -- 172.21.15.123:0/412574611 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4690053d40 con 0x7f469c15ce00 2024-09-13T17:08:16.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.332+0000 7f46a398f700 1 -- 172.21.15.123:0/412574611 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4680066730 msgr2=0x7f4680068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:16.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.332+0000 7f46a398f700 1 --2- 172.21.15.123:0/412574611 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4680066730 0x7f4680068bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4698000c00 tx=0x7f4698008030 comp rx=0 tx=0).stop 2024-09-13T17:08:16.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.332+0000 7f46a398f700 1 -- 172.21.15.123:0/412574611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c15ce00 msgr2=0x7f469c154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:16.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.332+0000 7f46a398f700 1 --2- 172.21.15.123:0/412574611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c15ce00 0x7f469c154eb0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f469000c430 tx=0x7f469000c740 comp rx=0 tx=0).stop 2024-09-13T17:08:16.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.332+0000 7f46a398f700 1 -- 172.21.15.123:0/412574611 shutdown_connections 2024-09-13T17:08:16.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.332+0000 7f46a398f700 1 --2- 172.21.15.123:0/412574611 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4680066730 0x7f4680068bf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.332+0000 7f46a398f700 1 --2- 172.21.15.123:0/412574611 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f469c15e200 0x7f469c0c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.332+0000 7f46a398f700 1 --2- 172.21.15.123:0/412574611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c15ce00 0x7f469c154eb0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.332+0000 7f46a398f700 1 --2- 172.21.15.123:0/412574611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c0ad2a0 0x7f469c158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.332+0000 7f46a398f700 1 -- 172.21.15.123:0/412574611 >> 172.21.15.123:0/412574611 conn(0x7f469c0b0450 msgr2=0x7f469c0ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:16.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.332+0000 7f46a398f700 1 -- 172.21.15.123:0/412574611 shutdown_connections 2024-09-13T17:08:16.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.332+0000 7f46a398f700 1 -- 172.21.15.123:0/412574611 wait complete. 2024-09-13T17:08:16.337 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-13T17:08:16.352 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T17:08:16.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.468+0000 7f9cc59b4700 1 Processor -- start 2024-09-13T17:08:16.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.468+0000 7f9cc59b4700 1 -- start start 2024-09-13T17:08:16.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.468+0000 7f9cc59b4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9cc015a8c0 0x7f9cc00705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:16.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.468+0000 7f9cc59b4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cc015b9b0 0x7f9cc0070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:16.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.468+0000 7f9cc59b4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc00cee80 con 0x7f9cc00713b0 2024-09-13T17:08:16.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.468+0000 7f9cc59b4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc0071860 con 0x7f9cc015a8c0 2024-09-13T17:08:16.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.468+0000 7f9cc59b4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc00ce270 con 0x7f9cc015b9b0 2024-09-13T17:08:16.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.468+0000 7f9cc51b3700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9cc00713b0 0x7f9cc00cb130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47222/0 (socket says 172.21.15.123:47222) 2024-09-13T17:08:16.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.468+0000 7f9cc51b3700 1 -- 172.21.15.123:0/296929151 learned_addr learned my addr 172.21.15.123:0/296929151 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:16.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cbffff700 1 --2- 172.21.15.123:0/296929151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cc015b9b0 0x7f9cc0070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:16.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cc49b2700 1 --2- 172.21.15.123:0/296929151 >> v2:172.21.15.153:3300/0 conn(0x7f9cc015a8c0 0x7f9cc00705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:16.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cbf7fe700 1 -- 172.21.15.123:0/296929151 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481414472 0 0) 0x7f9cc00cee80 con 0x7f9cc00713b0 2024-09-13T17:08:16.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cbf7fe700 1 -- 172.21.15.123:0/296929151 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca80035d0 con 0x7f9cc00713b0 2024-09-13T17:08:16.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cbffff700 1 -- 172.21.15.123:0/296929151 >> v2:172.21.15.153:3300/0 conn(0x7f9cc015a8c0 msgr2=0x7f9cc00705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:16.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cbffff700 1 --2- 172.21.15.123:0/296929151 >> v2:172.21.15.153:3300/0 conn(0x7f9cc015a8c0 0x7f9cc00705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cbffff700 1 -- 172.21.15.123:0/296929151 >> v1:172.21.15.123:6789/0 conn(0x7f9cc00713b0 legacy=0x7f9cc00cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:16.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cbffff700 1 -- 172.21.15.123:0/296929151 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc00ce550 con 0x7f9cc015b9b0 2024-09-13T17:08:16.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cbffff700 1 --2- 172.21.15.123:0/296929151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cc015b9b0 0x7f9cc0070e70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009dc0 tx=0x7f9cb000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f91e649c91eb7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:16.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cbf7fe700 1 -- 172.21.15.123:0/296929151 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb000e070 con 0x7f9cc015b9b0 2024-09-13T17:08:16.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cbf7fe700 1 -- 172.21.15.123:0/296929151 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb000bae0 con 0x7f9cc015b9b0 2024-09-13T17:08:16.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cbf7fe700 1 -- 172.21.15.123:0/296929151 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb000be90 con 0x7f9cc015b9b0 2024-09-13T17:08:16.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cc59b4700 1 -- 172.21.15.123:0/296929151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cc015b9b0 msgr2=0x7f9cc0070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:16.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cc59b4700 1 --2- 172.21.15.123:0/296929151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cc015b9b0 0x7f9cc0070e70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009dc0 tx=0x7f9cb000b330 comp rx=0 tx=0).stop 2024-09-13T17:08:16.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cc59b4700 1 -- 172.21.15.123:0/296929151 shutdown_connections 2024-09-13T17:08:16.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cc59b4700 1 --2- 172.21.15.123:0/296929151 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cc015b9b0 0x7f9cc0070e70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cc59b4700 1 --2- 172.21.15.123:0/296929151 >> v2:172.21.15.153:3300/0 conn(0x7f9cc015a8c0 0x7f9cc00705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cc59b4700 1 -- 172.21.15.123:0/296929151 >> 172.21.15.123:0/296929151 conn(0x7f9cc0066150 msgr2=0x7f9cc0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:16.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cc59b4700 1 -- 172.21.15.123:0/296929151 shutdown_connections 2024-09-13T17:08:16.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cc59b4700 1 -- 172.21.15.123:0/296929151 wait complete. 2024-09-13T17:08:16.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.472+0000 7f9cc59b4700 1 Processor -- start 2024-09-13T17:08:16.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cc59b4700 1 -- start start 2024-09-13T17:08:16.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cc59b4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc00713b0 0x7f9cc00ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:16.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cc59b4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cc015a8c0 0x7f9cc01f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:16.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cc59b4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cc015b9b0 0x7f9cc01ed700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:16.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cc59b4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc00ad840 con 0x7f9cc015b9b0 2024-09-13T17:08:16.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cc59b4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc01f1260 con 0x7f9cc00713b0 2024-09-13T17:08:16.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cc59b4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc00a85d0 con 0x7f9cc015a8c0 2024-09-13T17:08:16.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cc51b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cc015b9b0 0x7f9cc01ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:16.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cbffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cc015a8c0 0x7f9cc01f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:16.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cbffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cc015a8c0 0x7f9cc01f0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:33558/0 (socket says 172.21.15.123:33558) 2024-09-13T17:08:16.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cbffff700 1 -- 172.21.15.123:0/117783798 learned_addr learned my addr 172.21.15.123:0/117783798 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:16.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cc51b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cc015b9b0 0x7f9cc01ed700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60386/0 (socket says 172.21.15.123:60386) 2024-09-13T17:08:16.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cc49b2700 1 --2- 172.21.15.123:0/117783798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc00713b0 0x7f9cc00ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:16.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cbffff700 1 -- 172.21.15.123:0/117783798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc00713b0 msgr2=0x7f9cc00ad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:16.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cbffff700 1 --2- 172.21.15.123:0/117783798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc00713b0 0x7f9cc00ad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cbffff700 1 -- 172.21.15.123:0/117783798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cc015b9b0 msgr2=0x7f9cc01ed700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:16.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cbffff700 1 --2- 172.21.15.123:0/117783798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cc015b9b0 0x7f9cc01ed700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cbffff700 1 -- 172.21.15.123:0/117783798 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb0009a70 con 0x7f9cc015a8c0 2024-09-13T17:08:16.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cc51b3700 1 --2- 172.21.15.123:0/117783798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cc015b9b0 0x7f9cc01ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:16.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cbffff700 1 --2- 172.21.15.123:0/117783798 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cc015a8c0 0x7f9cc01f0d20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0013000 tx=0x7f9cb0004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:16.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cbd7fa700 1 -- 172.21.15.123:0/117783798 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0004550 con 0x7f9cc015a8c0 2024-09-13T17:08:16.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cbd7fa700 1 -- 172.21.15.123:0/117783798 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb0020070 con 0x7f9cc015a8c0 2024-09-13T17:08:16.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cc59b4700 1 -- 172.21.15.123:0/117783798 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc00a88b0 con 0x7f9cc015a8c0 2024-09-13T17:08:16.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cbd7fa700 1 -- 172.21.15.123:0/117783798 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0004910 con 0x7f9cc015a8c0 2024-09-13T17:08:16.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.476+0000 7f9cc59b4700 1 -- 172.21.15.123:0/117783798 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc00a8e70 con 0x7f9cc015a8c0 2024-09-13T17:08:16.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.480+0000 7f9cc59b4700 1 -- 172.21.15.123:0/117783798 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc00677f0 con 0x7f9cc015a8c0 2024-09-13T17:08:16.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.480+0000 7f9cbd7fa700 1 -- 172.21.15.123:0/117783798 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9cb0012430 con 0x7f9cc015a8c0 2024-09-13T17:08:16.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.480+0000 7f9cbd7fa700 1 --2- 172.21.15.123:0/117783798 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9cac066730 0x7f9cac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:16.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.480+0000 7f9cbd7fa700 1 -- 172.21.15.123:0/117783798 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9cb0022070 con 0x7f9cc015a8c0 2024-09-13T17:08:16.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.480+0000 7f9cc49b2700 1 --2- 172.21.15.123:0/117783798 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9cac066730 0x7f9cac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:16.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.480+0000 7f9cc49b2700 1 --2- 172.21.15.123:0/117783798 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9cac066730 0x7f9cac068bf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00ada10 tx=0x7f9cb4009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:16.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.492+0000 7f9cbd7fa700 1 -- 172.21.15.123:0/117783798 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9cb0056f20 con 0x7f9cc015a8c0 2024-09-13T17:08:16.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.720+0000 7f9cc59b4700 1 -- 172.21.15.123:0/117783798 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9cc00705b0 con 0x7f9cc015a8c0 2024-09-13T17:08:16.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.724+0000 7f9cbd7fa700 1 -- 172.21.15.123:0/117783798 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9cb0056ab0 con 0x7f9cc015a8c0 2024-09-13T17:08:16.729 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:16.729 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:08:16.729 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-13T17:08:16.729 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.729 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-13T17:08:16.729 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmcINWChAAjEdCM4Sk1OsLUQerqFqnGg==", 2024-09-13T17:08:16.729 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.729 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:16.729 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:08:16.729 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:08:16.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.730 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.730 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.730 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.730 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-13T17:08:16.730 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmesC1ERAA2ZS4r6KU9vqfDLLX+0kwwg==", 2024-09-13T17:08:16.730 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.730 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:16.730 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:08:16.730 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:08:16.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.730 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.730 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.731 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.731 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-13T17:08:16.731 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORm+dvcDRAA5o6AtNdAEM2RTXMTKTuwvA==", 2024-09-13T17:08:16.731 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.731 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:16.731 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:08:16.731 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:08:16.731 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.731 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.731 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.731 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.731 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-13T17:08:16.731 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmnFIgGBAAZbqUsdKOG1nN0iHsKRqyHA==", 2024-09-13T17:08:16.732 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.732 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:16.732 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:08:16.732 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:08:16.732 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.732 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.732 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.732 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.732 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-13T17:08:16.732 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDucORmpvNQEhAAg2TDxfqiCxv8rfzNXd8ghw==", 2024-09-13T17:08:16.732 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.732 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:16.732 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:16.733 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.733 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.733 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.733 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.733 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-13T17:08:16.733 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDxcORmnAU+FxAAxjWreGRwyuQT2RRMicHAXg==", 2024-09-13T17:08:16.733 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.733 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:16.733 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:16.733 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.733 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.733 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.733 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.733 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-13T17:08:16.734 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD0cORmMXQpGhAADjhpu3evLXhYS+YKeKf8WQ==", 2024-09-13T17:08:16.734 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.734 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:16.734 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:16.734 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.734 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.734 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.734 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.734 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-13T17:08:16.734 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD3cORmAo7hHxAA80EcAMAxPmMPuKxUg6RYhQ==", 2024-09-13T17:08:16.734 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.734 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:16.734 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:16.734 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.735 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.735 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.735 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.735 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-13T17:08:16.735 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD9cORm2j1KCxAA57ClQVuoJdhuk76L4nPHVQ==", 2024-09-13T17:08:16.735 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.735 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:16.735 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:16.735 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.735 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.735 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.735 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.735 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-13T17:08:16.736 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAAceRmu5IeExAAyUOWIVy5i703n829U0KSuw==", 2024-09-13T17:08:16.736 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.736 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:16.736 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:16.736 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.736 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.736 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.736 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.736 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-13T17:08:16.736 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQADceRmhiXfFhAAt6aAa3EUOvKclLyGEl84SA==", 2024-09-13T17:08:16.737 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.737 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:16.737 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:16.737 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.737 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.737 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.737 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.737 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-13T17:08:16.737 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAGceRmjYdfHBAAHn19wbVS72wMYHvMh+Cpyg==", 2024-09-13T17:08:16.737 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.737 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:16.737 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:16.737 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.737 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.738 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.738 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.738 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-13T17:08:16.738 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmieDjGxAA9C8qfFqgRul4Kzk+0+UMTA==", 2024-09-13T17:08:16.738 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.738 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:16.738 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-13T17:08:16.738 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T17:08:16.738 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.738 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.738 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.738 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-13T17:08:16.738 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmJvUUJRAAQci63exaXrtjPfssFai1jw==", 2024-09-13T17:08:16.739 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.739 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:16.739 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:08:16.739 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:08:16.739 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:08:16.739 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.739 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.739 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.739 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-13T17:08:16.739 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmgbzRIRAA8VlhYQpFRQUNOo6nplFySA==", 2024-09-13T17:08:16.739 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.739 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:16.739 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:08:16.739 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:08:16.740 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:08:16.740 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.740 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.740 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.740 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-13T17:08:16.740 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmwT+9KhAASidrLfvv55brtJ3Mk+qdxA==", 2024-09-13T17:08:16.740 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.740 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:16.740 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:08:16.740 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:08:16.740 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:08:16.740 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.740 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.740 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.741 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-13T17:08:16.741 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDqcORmn/ceNxAAxs8e7/yGRB9oykHDFVQ0lA==", 2024-09-13T17:08:16.741 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.741 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:08:16.741 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:08:16.741 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:08:16.741 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.741 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.741 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.741 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.741 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-13T17:08:16.741 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmFSRNBhAAbI1RASXCwIZPggcjMdXynw==", 2024-09-13T17:08:16.741 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.742 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:08:16.742 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-13T17:08:16.742 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.742 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.742 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:16.742 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:16.742 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-13T17:08:16.742 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmLhAcAxAAHSNEbQ2dLEBPGDMMKc7dQQ==", 2024-09-13T17:08:16.742 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:16.742 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:08:16.742 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-13T17:08:16.742 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:16.742 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.742 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:16.743 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-13T17:08:16.743 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:08:16.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.724+0000 7f9cc59b4700 1 -- 172.21.15.123:0/117783798 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9cac066730 msgr2=0x7f9cac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:16.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.724+0000 7f9cc59b4700 1 --2- 172.21.15.123:0/117783798 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9cac066730 0x7f9cac068bf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00ada10 tx=0x7f9cb4009240 comp rx=0 tx=0).stop 2024-09-13T17:08:16.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.724+0000 7f9cc59b4700 1 -- 172.21.15.123:0/117783798 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cc015a8c0 msgr2=0x7f9cc01f0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:16.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.724+0000 7f9cc59b4700 1 --2- 172.21.15.123:0/117783798 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cc015a8c0 0x7f9cc01f0d20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0013000 tx=0x7f9cb0004af0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.724+0000 7f9cc59b4700 1 -- 172.21.15.123:0/117783798 shutdown_connections 2024-09-13T17:08:16.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.724+0000 7f9cc59b4700 1 --2- 172.21.15.123:0/117783798 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9cac066730 0x7f9cac068bf0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.724+0000 7f9cc59b4700 1 --2- 172.21.15.123:0/117783798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cc015b9b0 0x7f9cc01ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.724+0000 7f9cc59b4700 1 --2- 172.21.15.123:0/117783798 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9cc015a8c0 0x7f9cc01f0d20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.724+0000 7f9cc59b4700 1 --2- 172.21.15.123:0/117783798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cc00713b0 0x7f9cc00ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.724+0000 7f9cc59b4700 1 -- 172.21.15.123:0/117783798 >> 172.21.15.123:0/117783798 conn(0x7f9cc0066150 msgr2=0x7f9cc00aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:16.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.724+0000 7f9cc59b4700 1 -- 172.21.15.123:0/117783798 shutdown_connections 2024-09-13T17:08:16.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.724+0000 7f9cc59b4700 1 -- 172.21.15.123:0/117783798 wait complete. 2024-09-13T17:08:16.745 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:16.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.852+0000 7f80758f8700 1 Processor -- start 2024-09-13T17:08:16.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.852+0000 7f80758f8700 1 -- start start 2024-09-13T17:08:16.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80758f8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80700ce850 0x7f8070168050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:16.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80758f8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80700d1130 con 0x7f80700d3670 2024-09-13T17:08:16.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80758f8700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80700d1c20 con 0x7f80700cf600 2024-09-13T17:08:16.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80758f8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80700c9aa0 con 0x7f80700ce850 2024-09-13T17:08:16.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80750f7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80700ce850 0x7f8070168050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:16.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f806ffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f80700d3670 0x7f80701614a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47238/0 (socket says 172.21.15.123:47238) 2024-09-13T17:08:16.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f806ffff700 1 -- 172.21.15.123:0/3627876231 learned_addr learned my addr 172.21.15.123:0/3627876231 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:16.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80750f7700 1 -- 172.21.15.123:0/3627876231 >> v1:172.21.15.153:6789/0 conn(0x7f80700cf600 legacy=0x7f8070160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:16.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80750f7700 1 -- 172.21.15.123:0/3627876231 >> v1:172.21.15.123:6789/0 conn(0x7f80700d3670 legacy=0x7f80701614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:16.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80750f7700 1 -- 172.21.15.123:0/3627876231 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8070161bb0 con 0x7f80700ce850 2024-09-13T17:08:16.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80750f7700 1 --2- 172.21.15.123:0/3627876231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80700ce850 0x7f8070168050 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8068009dc0 tx=0x7f806800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712499c96f484d0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:16.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f806f7fe700 1 -- 172.21.15.123:0/3627876231 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806800e070 con 0x7f80700ce850 2024-09-13T17:08:16.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f806f7fe700 1 -- 172.21.15.123:0/3627876231 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806800bb90 con 0x7f80700ce850 2024-09-13T17:08:16.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f806f7fe700 1 -- 172.21.15.123:0/3627876231 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068012430 con 0x7f80700ce850 2024-09-13T17:08:16.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80758f8700 1 -- 172.21.15.123:0/3627876231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80700ce850 msgr2=0x7f8070168050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:16.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80758f8700 1 --2- 172.21.15.123:0/3627876231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80700ce850 0x7f8070168050 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8068009dc0 tx=0x7f806800b330 comp rx=0 tx=0).stop 2024-09-13T17:08:16.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80758f8700 1 -- 172.21.15.123:0/3627876231 shutdown_connections 2024-09-13T17:08:16.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80758f8700 1 --2- 172.21.15.123:0/3627876231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80700ce850 0x7f8070168050 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80758f8700 1 -- 172.21.15.123:0/3627876231 >> 172.21.15.123:0/3627876231 conn(0x7f80700d2b50 msgr2=0x7f80700d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:16.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80758f8700 1 -- 172.21.15.123:0/3627876231 shutdown_connections 2024-09-13T17:08:16.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.856+0000 7f80758f8700 1 -- 172.21.15.123:0/3627876231 wait complete. 2024-09-13T17:08:16.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80758f8700 1 Processor -- start 2024-09-13T17:08:16.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80758f8700 1 -- start start 2024-09-13T17:08:16.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80758f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80700ce850 0x7f807015ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:16.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80758f8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80700cf600 0x7f80700c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:16.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80758f8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80700ca160 0x7f80701f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:16.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80758f8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80701f6ec0 con 0x7f80700ca160 2024-09-13T17:08:16.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80758f8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80700ca610 con 0x7f80700ce850 2024-09-13T17:08:16.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80758f8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8070160b10 con 0x7f80700cf600 2024-09-13T17:08:16.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80750f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80700ca160 0x7f80701f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:16.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80750f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80700ca160 0x7f80701f6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60398/0 (socket says 172.21.15.123:60398) 2024-09-13T17:08:16.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80750f7700 1 -- 172.21.15.123:0/207874813 learned_addr learned my addr 172.21.15.123:0/207874813 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:16.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80748f6700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80700ce850 0x7f807015ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:16.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f806ffff700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80700cf600 0x7f80700c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:16.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80750f7700 1 -- 172.21.15.123:0/207874813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80700cf600 msgr2=0x7f80700c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:16.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80750f7700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80700cf600 0x7f80700c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80750f7700 1 -- 172.21.15.123:0/207874813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80700ce850 msgr2=0x7f807015ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:16.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80750f7700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80700ce850 0x7f807015ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:16.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80750f7700 1 -- 172.21.15.123:0/207874813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8068009a70 con 0x7f80700ca160 2024-09-13T17:08:16.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80748f6700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80700ce850 0x7f807015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:16.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f806ffff700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80700cf600 0x7f80700c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:16.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.860+0000 7f80750f7700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80700ca160 0x7f80701f6220 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f806800b370 tx=0x7f8068004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:16.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.864+0000 7f806d7fa700 1 -- 172.21.15.123:0/207874813 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80680098f0 con 0x7f80700ca160 2024-09-13T17:08:16.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.864+0000 7f806d7fa700 1 -- 172.21.15.123:0/207874813 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8068020070 con 0x7f80700ca160 2024-09-13T17:08:16.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.864+0000 7f80758f8700 1 -- 172.21.15.123:0/207874813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80701484c0 con 0x7f80700ca160 2024-09-13T17:08:16.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.864+0000 7f806d7fa700 1 -- 172.21.15.123:0/207874813 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80680276a0 con 0x7f80700ca160 2024-09-13T17:08:16.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.864+0000 7f80758f8700 1 -- 172.21.15.123:0/207874813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8070147b90 con 0x7f80700ca160 2024-09-13T17:08:16.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.864+0000 7f80758f8700 1 -- 172.21.15.123:0/207874813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8070148650 con 0x7f80700ca160 2024-09-13T17:08:16.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.864+0000 7f806d7fa700 1 -- 172.21.15.123:0/207874813 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8068012430 con 0x7f80700ca160 2024-09-13T17:08:16.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.864+0000 7f806d7fa700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f805c066730 0x7f805c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:16.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.864+0000 7f806d7fa700 1 -- 172.21.15.123:0/207874813 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8068022070 con 0x7f80700ca160 2024-09-13T17:08:16.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.864+0000 7f80748f6700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f805c066730 0x7f805c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:16.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.864+0000 7f80748f6700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f805c066730 0x7f805c068bf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f80700b7f10 tx=0x7f8064009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:16.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:16.872+0000 7f806d7fa700 1 -- 172.21.15.123:0/207874813 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f80680b7db0 con 0x7f80700ca160 2024-09-13T17:08:17.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.044+0000 7f80758f8700 1 -- 172.21.15.123:0/207874813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80700cf9e0 con 0x7f80700ca160 2024-09-13T17:08:17.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.048+0000 7f806d7fa700 1 -- 172.21.15.123:0/207874813 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12905 (secure 0 0 0) 0x7f8068057220 con 0x7f80700ca160 2024-09-13T17:08:17.052 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:17.052 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":42,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:16.323525+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:17.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.052+0000 7f80758f8700 1 -- 172.21.15.123:0/207874813 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f805c066730 msgr2=0x7f805c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.052+0000 7f80758f8700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f805c066730 0x7f805c068bf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f80700b7f10 tx=0x7f8064009040 comp rx=0 tx=0).stop 2024-09-13T17:08:17.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.052+0000 7f80758f8700 1 -- 172.21.15.123:0/207874813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80700ca160 msgr2=0x7f80701f6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.052+0000 7f80758f8700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80700ca160 0x7f80701f6220 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f806800b370 tx=0x7f8068004af0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.052+0000 7f80758f8700 1 -- 172.21.15.123:0/207874813 shutdown_connections 2024-09-13T17:08:17.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.052+0000 7f80758f8700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f805c066730 0x7f805c068bf0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.052+0000 7f80758f8700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80700ca160 0x7f80701f6220 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.052+0000 7f80758f8700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80700cf600 0x7f80700c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.052+0000 7f80758f8700 1 --2- 172.21.15.123:0/207874813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80700ce850 0x7f807015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.052+0000 7f80758f8700 1 -- 172.21.15.123:0/207874813 >> 172.21.15.123:0/207874813 conn(0x7f80700d2b50 msgr2=0x7f80700cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:17.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.052+0000 7f80758f8700 1 -- 172.21.15.123:0/207874813 shutdown_connections 2024-09-13T17:08:17.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.052+0000 7f80758f8700 1 -- 172.21.15.123:0/207874813 wait complete. 2024-09-13T17:08:17.067 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:08:17.067 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:08:17.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.176+0000 7f6a0b59e700 1 Processor -- start 2024-09-13T17:08:17.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.176+0000 7f6a0b59e700 1 -- start start 2024-09-13T17:08:17.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.176+0000 7f6a0b59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a0c0ce790 0x7f6a0c06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.176+0000 7f6a0b59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6a0c0cd2b0 0x7f6a0c15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.176+0000 7f6a0b59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6a0c0ceb70 0x7f6a0c15ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.176+0000 7f6a0b59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0c0b61f0 con 0x7f6a0c0ceb70 2024-09-13T17:08:17.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.176+0000 7f6a0b59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0c0cf740 con 0x7f6a0c0cd2b0 2024-09-13T17:08:17.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.176+0000 7f6a0b59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0cb2c0 con 0x7f6a0c0ce790 2024-09-13T17:08:17.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.176+0000 7f6a0ad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6a0c0ceb70 0x7f6a0c15ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.176+0000 7f6a09d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6a0c0cd2b0 0x7f6a0c15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.176+0000 7f6a0a59c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a0c0ce790 0x7f6a0c06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.176+0000 7f6a0ad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6a0c0ceb70 0x7f6a0c15ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60412/0 (socket says 172.21.15.123:60412) 2024-09-13T17:08:17.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.176+0000 7f6a0ad9d700 1 -- 172.21.15.123:0/1454227354 learned_addr learned my addr 172.21.15.123:0/1454227354 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:17.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0a59c700 1 -- 172.21.15.123:0/1454227354 >> v2:172.21.15.153:3300/0 conn(0x7f6a0c0cd2b0 msgr2=0x7f6a0c15a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:17.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0a59c700 1 --2- 172.21.15.123:0/1454227354 >> v2:172.21.15.153:3300/0 conn(0x7f6a0c0cd2b0 0x7f6a0c15a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0a59c700 1 -- 172.21.15.123:0/1454227354 >> v2:172.21.15.123:3300/0 conn(0x7f6a0c0ceb70 msgr2=0x7f6a0c15ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:17.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0a59c700 1 --2- 172.21.15.123:0/1454227354 >> v2:172.21.15.123:3300/0 conn(0x7f6a0c0ceb70 0x7f6a0c15ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0a59c700 1 -- 172.21.15.123:0/1454227354 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c15b250 con 0x7f6a0c0ce790 2024-09-13T17:08:17.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0a59c700 1 --2- 172.21.15.123:0/1454227354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a0c0ce790 0x7f6a0c06bc70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c06dcb0 tx=0x7f69fc009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2127729cc546886 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0959a700 1 -- 172.21.15.123:0/1454227354 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc011830 con 0x7f6a0c0ce790 2024-09-13T17:08:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0959a700 1 -- 172.21.15.123:0/1454227354 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc011990 con 0x7f6a0c0ce790 2024-09-13T17:08:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0959a700 1 -- 172.21.15.123:0/1454227354 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc011d20 con 0x7f6a0c0ce790 2024-09-13T17:08:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0b59e700 1 -- 172.21.15.123:0/1454227354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a0c0ce790 msgr2=0x7f6a0c06bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0b59e700 1 --2- 172.21.15.123:0/1454227354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a0c0ce790 0x7f6a0c06bc70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c06dcb0 tx=0x7f69fc009b30 comp rx=0 tx=0).stop 2024-09-13T17:08:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0b59e700 1 -- 172.21.15.123:0/1454227354 shutdown_connections 2024-09-13T17:08:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0b59e700 1 --2- 172.21.15.123:0/1454227354 >> v2:172.21.15.123:3300/0 conn(0x7f6a0c0ceb70 0x7f6a0c15ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0b59e700 1 --2- 172.21.15.123:0/1454227354 >> v2:172.21.15.153:3300/0 conn(0x7f6a0c0cd2b0 0x7f6a0c15a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0b59e700 1 --2- 172.21.15.123:0/1454227354 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a0c0ce790 0x7f6a0c06bc70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0b59e700 1 -- 172.21.15.123:0/1454227354 >> 172.21.15.123:0/1454227354 conn(0x7f6a0c06e090 msgr2=0x7f6a0c06e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0b59e700 1 -- 172.21.15.123:0/1454227354 shutdown_connections 2024-09-13T17:08:17.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.180+0000 7f6a0b59e700 1 -- 172.21.15.123:0/1454227354 wait complete. 2024-09-13T17:08:17.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.184+0000 7f6a0b59e700 1 Processor -- start 2024-09-13T17:08:17.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.184+0000 7f6a0b59e700 1 -- start start 2024-09-13T17:08:17.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.184+0000 7f6a0b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a0c0cd2b0 0x7f6a0c1f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.184+0000 7f6a0b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0c0ce790 0x7f6a0c0c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.184+0000 7f6a0b59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a0c0ceb70 0x7f6a0c0a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.184+0000 7f6a0b59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0a9420 con 0x7f6a0c0cd2b0 2024-09-13T17:08:17.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.184+0000 7f6a0b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0c5f40 con 0x7f6a0c0ce790 2024-09-13T17:08:17.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.184+0000 7f6a0b59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0a96a0 con 0x7f6a0c0ceb70 2024-09-13T17:08:17.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.184+0000 7f6a0a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a0c0cd2b0 0x7f6a0c1f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f6a0a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a0c0cd2b0 0x7f6a0c1f17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60420/0 (socket says 172.21.15.123:60420) 2024-09-13T17:08:17.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f6a0a59c700 1 -- 172.21.15.123:0/2356186163 learned_addr learned my addr 172.21.15.123:0/2356186163 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:17.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f6a0ad9d700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a0c0ceb70 0x7f6a0c0a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f6a09d9b700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0c0ce790 0x7f6a0c0c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f6a0ad9d700 1 -- 172.21.15.123:0/2356186163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0c0ce790 msgr2=0x7f6a0c0c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f6a0ad9d700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0c0ce790 0x7f6a0c0c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f6a0ad9d700 1 -- 172.21.15.123:0/2356186163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a0c0cd2b0 msgr2=0x7f6a0c1f17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f6a0ad9d700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a0c0cd2b0 0x7f6a0c1f17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f6a0ad9d700 1 -- 172.21.15.123:0/2356186163 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc0094b0 con 0x7f6a0c0ceb70 2024-09-13T17:08:17.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f6a0a59c700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a0c0cd2b0 0x7f6a0c1f17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f6a0ad9d700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a0c0ceb70 0x7f6a0c0a8ee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400eba0 tx=0x7f6a0400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f69faffd700 1 -- 172.21.15.123:0/2356186163 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04003c40 con 0x7f6a0c0ceb70 2024-09-13T17:08:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f6a0b59e700 1 -- 172.21.15.123:0/2356186163 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0c0c61e0 con 0x7f6a0c0ceb70 2024-09-13T17:08:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f69faffd700 1 -- 172.21.15.123:0/2356186163 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0400f040 con 0x7f6a0c0ceb70 2024-09-13T17:08:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f69faffd700 1 -- 172.21.15.123:0/2356186163 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400c5f0 con 0x7f6a0c0ceb70 2024-09-13T17:08:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f6a0b59e700 1 -- 172.21.15.123:0/2356186163 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0c0a9980 con 0x7f6a0c0ceb70 2024-09-13T17:08:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.188+0000 7f6a0b59e700 1 -- 172.21.15.123:0/2356186163 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0c0c6700 con 0x7f6a0c0ceb70 2024-09-13T17:08:17.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.192+0000 7f69faffd700 1 -- 172.21.15.123:0/2356186163 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6a0400c750 con 0x7f6a0c0ceb70 2024-09-13T17:08:17.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.192+0000 7f69faffd700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f69ec066730 0x7f69ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.192+0000 7f69faffd700 1 -- 172.21.15.123:0/2356186163 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6a04083eb0 con 0x7f6a0c0ceb70 2024-09-13T17:08:17.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.192+0000 7f6a0a59c700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f69ec066730 0x7f69ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.192+0000 7f6a0a59c700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f69ec066730 0x7f69ec068bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0090b0 tx=0x7f69fc008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:17.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.200+0000 7f69faffd700 1 -- 172.21.15.123:0/2356186163 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6a0c0c6700 con 0x7f6a0c0ceb70 2024-09-13T17:08:17.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.372+0000 7f6a0b59e700 1 -- 172.21.15.123:0/2356186163 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a0c0c6700 con 0x7f6a0c0ceb70 2024-09-13T17:08:17.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.376+0000 7f69faffd700 1 -- 172.21.15.123:0/2356186163 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a0c0c6700 con 0x7f6a0c0ceb70 2024-09-13T17:08:17.378 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:08:17.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.376+0000 7f6a0b59e700 1 -- 172.21.15.123:0/2356186163 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f69ec066730 msgr2=0x7f69ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.376+0000 7f6a0b59e700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f69ec066730 0x7f69ec068bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0090b0 tx=0x7f69fc008030 comp rx=0 tx=0).stop 2024-09-13T17:08:17.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.376+0000 7f6a0b59e700 1 -- 172.21.15.123:0/2356186163 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a0c0ceb70 msgr2=0x7f6a0c0a8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.376+0000 7f6a0b59e700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a0c0ceb70 0x7f6a0c0a8ee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400eba0 tx=0x7f6a0400eeb0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.380+0000 7f6a0b59e700 1 -- 172.21.15.123:0/2356186163 shutdown_connections 2024-09-13T17:08:17.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.380+0000 7f6a0b59e700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f69ec066730 0x7f69ec068bf0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.380+0000 7f6a0b59e700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a0c0ceb70 0x7f6a0c0a8ee0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.380+0000 7f6a0b59e700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0c0ce790 0x7f6a0c0c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.380+0000 7f6a0b59e700 1 --2- 172.21.15.123:0/2356186163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a0c0cd2b0 0x7f6a0c1f17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.380+0000 7f6a0b59e700 1 -- 172.21.15.123:0/2356186163 >> 172.21.15.123:0/2356186163 conn(0x7f6a0c06e090 msgr2=0x7f6a0c06e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:17.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.380+0000 7f6a0b59e700 1 -- 172.21.15.123:0/2356186163 shutdown_connections 2024-09-13T17:08:17.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.380+0000 7f6a0b59e700 1 -- 172.21.15.123:0/2356186163 wait complete. 2024-09-13T17:08:17.398 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:08:17.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.504+0000 7fdea4dc2700 1 Processor -- start 2024-09-13T17:08:17.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.504+0000 7fdea4dc2700 1 -- start start 2024-09-13T17:08:17.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.504+0000 7fdea4dc2700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea01598b0 0x7fdea0071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.504+0000 7fdea4dc2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdea00cdfd0 0x7fdea00ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.504+0000 7fdea4dc2700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea015d360 con 0x7fdea00cebf0 2024-09-13T17:08:17.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.504+0000 7fdea4dc2700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea00cf080 con 0x7fdea00cdfd0 2024-09-13T17:08:17.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.504+0000 7fdea4dc2700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea015aca0 con 0x7fdea01598b0 2024-09-13T17:08:17.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.504+0000 7fde9f7fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea01598b0 0x7fdea0071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.504+0000 7fde9effd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdea00cdfd0 0x7fdea00ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.504+0000 7fde9f7fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea01598b0 0x7fdea0071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:33610/0 (socket says 172.21.15.123:33610) 2024-09-13T17:08:17.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.504+0000 7fde9ffff700 1 --1- 172.21.15.123:0/716652564 >> v1:172.21.15.153:6789/0 conn(0x7fdea00cebf0 0x7fdea00b15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:43004/0 (socket says 172.21.15.123:43004) 2024-09-13T17:08:17.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.504+0000 7fde9f7fe700 1 -- 172.21.15.123:0/716652564 learned_addr learned my addr 172.21.15.123:0/716652564 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:17.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fde9f7fe700 1 -- 172.21.15.123:0/716652564 >> v2:172.21.15.153:3300/0 conn(0x7fdea00cdfd0 msgr2=0x7fdea00ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:17.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fde9f7fe700 1 --2- 172.21.15.123:0/716652564 >> v2:172.21.15.153:3300/0 conn(0x7fdea00cdfd0 0x7fdea00ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fde9f7fe700 1 -- 172.21.15.123:0/716652564 >> v1:172.21.15.153:6789/0 conn(0x7fdea00cebf0 legacy=0x7fdea00b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fde9f7fe700 1 -- 172.21.15.123:0/716652564 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea00ce3d0 con 0x7fdea01598b0 2024-09-13T17:08:17.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fde9effd700 1 --2- 172.21.15.123:0/716652564 >> v2:172.21.15.153:3300/0 conn(0x7fdea00cdfd0 0x7fdea00ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:17.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fde9f7fe700 1 --2- 172.21.15.123:0/716652564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea01598b0 0x7fdea0071e60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fde94009910 tx=0x7fde94009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e8905afb1857852 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:17.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fde9e7fc700 1 -- 172.21.15.123:0/716652564 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94011830 con 0x7fdea01598b0 2024-09-13T17:08:17.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fde9e7fc700 1 -- 172.21.15.123:0/716652564 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde94011990 con 0x7fdea01598b0 2024-09-13T17:08:17.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fde9e7fc700 1 -- 172.21.15.123:0/716652564 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94011d40 con 0x7fdea01598b0 2024-09-13T17:08:17.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fdea4dc2700 1 -- 172.21.15.123:0/716652564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea01598b0 msgr2=0x7fdea0071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fdea4dc2700 1 --2- 172.21.15.123:0/716652564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea01598b0 0x7fdea0071e60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fde94009910 tx=0x7fde94009c20 comp rx=0 tx=0).stop 2024-09-13T17:08:17.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fdea4dc2700 1 -- 172.21.15.123:0/716652564 shutdown_connections 2024-09-13T17:08:17.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fdea4dc2700 1 --2- 172.21.15.123:0/716652564 >> v2:172.21.15.153:3300/0 conn(0x7fdea00cdfd0 0x7fdea00ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fdea4dc2700 1 --2- 172.21.15.123:0/716652564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea01598b0 0x7fdea0071e60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fdea4dc2700 1 -- 172.21.15.123:0/716652564 >> 172.21.15.123:0/716652564 conn(0x7fdea0066150 msgr2=0x7fdea0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:17.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fdea4dc2700 1 -- 172.21.15.123:0/716652564 shutdown_connections 2024-09-13T17:08:17.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fdea4dc2700 1 -- 172.21.15.123:0/716652564 wait complete. 2024-09-13T17:08:17.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fdea4dc2700 1 Processor -- start 2024-09-13T17:08:17.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.508+0000 7fdea4dc2700 1 -- start start 2024-09-13T17:08:17.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fdea4dc2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdea00cdfd0 0x7fdea0157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fdea4dc2700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea00cebf0 0x7fdea00cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fdea4dc2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdea01598b0 0x7fdea00ac500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fdea4dc2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00a93c0 con 0x7fdea00cdfd0 2024-09-13T17:08:17.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fdea4dc2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00a87b0 con 0x7fdea01598b0 2024-09-13T17:08:17.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fdea4dc2700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00a8a90 con 0x7fdea00cebf0 2024-09-13T17:08:17.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fde9f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdea00cdfd0 0x7fdea0157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fde9f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdea00cdfd0 0x7fdea0157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60432/0 (socket says 172.21.15.123:60432) 2024-09-13T17:08:17.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fde9f7fe700 1 -- 172.21.15.123:0/1551919378 learned_addr learned my addr 172.21.15.123:0/1551919378 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:17.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fde9effd700 1 --2- 172.21.15.123:0/1551919378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea00cebf0 0x7fdea00cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fde9ffff700 1 --2- 172.21.15.123:0/1551919378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdea01598b0 0x7fdea00ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fde9f7fe700 1 -- 172.21.15.123:0/1551919378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea00cebf0 msgr2=0x7fdea00cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fde9f7fe700 1 --2- 172.21.15.123:0/1551919378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea00cebf0 0x7fdea00cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fde9f7fe700 1 -- 172.21.15.123:0/1551919378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdea01598b0 msgr2=0x7fdea00ac500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fde9f7fe700 1 --2- 172.21.15.123:0/1551919378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdea01598b0 0x7fdea00ac500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fde9f7fe700 1 -- 172.21.15.123:0/1551919378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde900094b0 con 0x7fdea00cdfd0 2024-09-13T17:08:17.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fde9f7fe700 1 --2- 172.21.15.123:0/1551919378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdea00cdfd0 0x7fdea0157890 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdea015ade0 tx=0x7fde94004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:17.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fde87fff700 1 -- 172.21.15.123:0/1551919378 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9401a8f0 con 0x7fdea00cdfd0 2024-09-13T17:08:17.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fde87fff700 1 -- 172.21.15.123:0/1551919378 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9401e070 con 0x7fdea00cdfd0 2024-09-13T17:08:17.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fde87fff700 1 -- 172.21.15.123:0/1551919378 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9401ac70 con 0x7fdea00cdfd0 2024-09-13T17:08:17.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fdea4dc2700 1 -- 172.21.15.123:0/1551919378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde94009570 con 0x7fdea00cdfd0 2024-09-13T17:08:17.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fdea4dc2700 1 -- 172.21.15.123:0/1551919378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea00a9050 con 0x7fdea00cdfd0 2024-09-13T17:08:17.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.512+0000 7fdea4dc2700 1 -- 172.21.15.123:0/1551919378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea00677f0 con 0x7fdea00cdfd0 2024-09-13T17:08:17.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.516+0000 7fde87fff700 1 -- 172.21.15.123:0/1551919378 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fde9402d450 con 0x7fdea00cdfd0 2024-09-13T17:08:17.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.516+0000 7fde87fff700 1 --2- 172.21.15.123:0/1551919378 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fde8c066730 0x7fde8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.516+0000 7fde9effd700 1 --2- 172.21.15.123:0/1551919378 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fde8c066730 0x7fde8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.516+0000 7fde87fff700 1 -- 172.21.15.123:0/1551919378 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fde94084de0 con 0x7fdea00cdfd0 2024-09-13T17:08:17.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.516+0000 7fde9effd700 1 --2- 172.21.15.123:0/1551919378 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fde8c066730 0x7fde8c068bf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdea00c9b50 tx=0x7fde90009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:17.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.524+0000 7fde87fff700 1 -- 172.21.15.123:0/1551919378 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fde94052410 con 0x7fdea00cdfd0 2024-09-13T17:08:17.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.696+0000 7fdea4dc2700 1 -- 172.21.15.123:0/1551919378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdea015e090 con 0x7fdea00cdfd0 2024-09-13T17:08:17.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.696+0000 7fde87fff700 1 -- 172.21.15.123:0/1551919378 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) v1 ==== 84+0+65 (secure 0 0 0) 0x7fde94055a30 con 0x7fdea00cdfd0 2024-09-13T17:08:17.700 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:17.700 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-13T17:08:17.700 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:17.700 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-13T17:08:17.701 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-13T17:08:17.701 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:17.701 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-13T17:08:17.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.700+0000 7fdea4dc2700 1 -- 172.21.15.123:0/1551919378 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fde8c066730 msgr2=0x7fde8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.700+0000 7fdea4dc2700 1 --2- 172.21.15.123:0/1551919378 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fde8c066730 0x7fde8c068bf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdea00c9b50 tx=0x7fde90009240 comp rx=0 tx=0).stop 2024-09-13T17:08:17.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.700+0000 7fdea4dc2700 1 -- 172.21.15.123:0/1551919378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdea00cdfd0 msgr2=0x7fdea0157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.700+0000 7fdea4dc2700 1 --2- 172.21.15.123:0/1551919378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdea00cdfd0 0x7fdea0157890 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdea015ade0 tx=0x7fde94004770 comp rx=0 tx=0).stop 2024-09-13T17:08:17.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.700+0000 7fdea4dc2700 1 -- 172.21.15.123:0/1551919378 shutdown_connections 2024-09-13T17:08:17.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.700+0000 7fdea4dc2700 1 --2- 172.21.15.123:0/1551919378 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fde8c066730 0x7fde8c068bf0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.700+0000 7fdea4dc2700 1 --2- 172.21.15.123:0/1551919378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdea01598b0 0x7fdea00ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.700+0000 7fdea4dc2700 1 --2- 172.21.15.123:0/1551919378 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdea00cebf0 0x7fdea00cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.700+0000 7fdea4dc2700 1 --2- 172.21.15.123:0/1551919378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdea00cdfd0 0x7fdea0157890 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.700+0000 7fdea4dc2700 1 -- 172.21.15.123:0/1551919378 >> 172.21.15.123:0/1551919378 conn(0x7fdea0066150 msgr2=0x7fdea01e3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:17.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.700+0000 7fdea4dc2700 1 -- 172.21.15.123:0/1551919378 shutdown_connections 2024-09-13T17:08:17.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.700+0000 7fdea4dc2700 1 -- 172.21.15.123:0/1551919378 wait complete. 2024-09-13T17:08:17.719 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:08:17.720 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:08:17.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.836+0000 7f3977fff700 1 Processor -- start 2024-09-13T17:08:17.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.836+0000 7f3977fff700 1 -- start start 2024-09-13T17:08:17.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3977fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39780d3220 0x7f39780d36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3977fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39780d1080 0x7f39780d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3977fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39781606f0 con 0x7f3978160310 2024-09-13T17:08:17.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3977fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39780d1a30 con 0x7f39780d1080 2024-09-13T17:08:17.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3977fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39780ce7b0 con 0x7f39780d3220 2024-09-13T17:08:17.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f39777fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39780d1080 0x7f39780d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f39777fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39780d1080 0x7f39780d14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60442/0 (socket says 172.21.15.123:60442) 2024-09-13T17:08:17.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f39777fe700 1 -- 172.21.15.123:0/1286425852 learned_addr learned my addr 172.21.15.123:0/1286425852 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:17.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f39767fc700 1 --2- 172.21.15.123:0/1286425852 >> v2:172.21.15.153:3300/0 conn(0x7f39780d3220 0x7f39780d36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f39777fe700 1 -- 172.21.15.123:0/1286425852 >> v2:172.21.15.153:3300/0 conn(0x7f39780d3220 msgr2=0x7f39780d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:17.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f39777fe700 1 --2- 172.21.15.123:0/1286425852 >> v2:172.21.15.153:3300/0 conn(0x7f39780d3220 0x7f39780d36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f39777fe700 1 -- 172.21.15.123:0/1286425852 >> v1:172.21.15.153:6789/0 conn(0x7f3978160310 legacy=0x7f39780cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:17.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f39777fe700 1 -- 172.21.15.123:0/1286425852 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39780cea90 con 0x7f39780d1080 2024-09-13T17:08:17.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f39777fe700 1 --2- 172.21.15.123:0/1286425852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39780d1080 0x7f39780d14f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3970009e50 tx=0x7f397000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208b5173b2f44a91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:17.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3975ffb700 1 -- 172.21.15.123:0/1286425852 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397000e070 con 0x7f39780d1080 2024-09-13T17:08:17.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3975ffb700 1 -- 172.21.15.123:0/1286425852 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3970003a40 con 0x7f39780d1080 2024-09-13T17:08:17.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3975ffb700 1 -- 172.21.15.123:0/1286425852 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970003df0 con 0x7f39780d1080 2024-09-13T17:08:17.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3977fff700 1 -- 172.21.15.123:0/1286425852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39780d1080 msgr2=0x7f39780d14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3977fff700 1 --2- 172.21.15.123:0/1286425852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39780d1080 0x7f39780d14f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3970009e50 tx=0x7f397000b330 comp rx=0 tx=0).stop 2024-09-13T17:08:17.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3977fff700 1 -- 172.21.15.123:0/1286425852 shutdown_connections 2024-09-13T17:08:17.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3977fff700 1 --2- 172.21.15.123:0/1286425852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39780d1080 0x7f39780d14f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3977fff700 1 --2- 172.21.15.123:0/1286425852 >> v2:172.21.15.153:3300/0 conn(0x7f39780d3220 0x7f39780d36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3977fff700 1 -- 172.21.15.123:0/1286425852 >> 172.21.15.123:0/1286425852 conn(0x7f397809be50 msgr2=0x7f39780d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:17.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3977fff700 1 -- 172.21.15.123:0/1286425852 shutdown_connections 2024-09-13T17:08:17.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.840+0000 7f3977fff700 1 -- 172.21.15.123:0/1286425852 wait complete. 2024-09-13T17:08:17.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.844+0000 7f3977fff700 1 Processor -- start 2024-09-13T17:08:17.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.844+0000 7f3977fff700 1 -- start start 2024-09-13T17:08:17.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.844+0000 7f3977fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39780d1080 0x7f3978158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.844+0000 7f3977fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39780d3220 0x7f39781f32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.844+0000 7f3977fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3978160310 0x7f39780b7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.844+0000 7f3977fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39781f2e20 con 0x7f3978160310 2024-09-13T17:08:17.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.844+0000 7f3977fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39780b8390 con 0x7f39780d1080 2024-09-13T17:08:17.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.844+0000 7f3977fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39780b8670 con 0x7f39780d3220 2024-09-13T17:08:17.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.844+0000 7f39777fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3978160310 0x7f39780b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.844+0000 7f39777fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3978160310 0x7f39780b7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60454/0 (socket says 172.21.15.123:60454) 2024-09-13T17:08:17.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.844+0000 7f39777fe700 1 -- 172.21.15.123:0/1770443308 learned_addr learned my addr 172.21.15.123:0/1770443308 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:17.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.844+0000 7f39767fc700 1 --2- 172.21.15.123:0/1770443308 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39780d3220 0x7f39781f32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.844+0000 7f3976ffd700 1 --2- 172.21.15.123:0/1770443308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39780d1080 0x7f3978158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.848+0000 7f39777fe700 1 -- 172.21.15.123:0/1770443308 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39780d3220 msgr2=0x7f39781f32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.848+0000 7f39777fe700 1 --2- 172.21.15.123:0/1770443308 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39780d3220 0x7f39781f32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.848+0000 7f39777fe700 1 -- 172.21.15.123:0/1770443308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39780d1080 msgr2=0x7f3978158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:17.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.848+0000 7f39777fe700 1 --2- 172.21.15.123:0/1770443308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39780d1080 0x7f3978158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:17.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.848+0000 7f39777fe700 1 -- 172.21.15.123:0/1770443308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3970009b30 con 0x7f3978160310 2024-09-13T17:08:17.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.848+0000 7f39777fe700 1 --2- 172.21.15.123:0/1770443308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3978160310 0x7f39780b7940 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f39780b56b0 tx=0x7f3970004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:17.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.848+0000 7f395f7fe700 1 -- 172.21.15.123:0/1770443308 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970004440 con 0x7f3978160310 2024-09-13T17:08:17.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.848+0000 7f395f7fe700 1 -- 172.21.15.123:0/1770443308 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39700045c0 con 0x7f3978160310 2024-09-13T17:08:17.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.848+0000 7f395f7fe700 1 -- 172.21.15.123:0/1770443308 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970004970 con 0x7f3978160310 2024-09-13T17:08:17.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.848+0000 7f3977fff700 1 -- 172.21.15.123:0/1770443308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39781f2ab0 con 0x7f3978160310 2024-09-13T17:08:17.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.848+0000 7f3977fff700 1 -- 172.21.15.123:0/1770443308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39780c96f0 con 0x7f3978160310 2024-09-13T17:08:17.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.848+0000 7f3977fff700 1 -- 172.21.15.123:0/1770443308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39780677f0 con 0x7f3978160310 2024-09-13T17:08:17.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.848+0000 7f395f7fe700 1 -- 172.21.15.123:0/1770443308 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3970025450 con 0x7f3978160310 2024-09-13T17:08:17.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.852+0000 7f395f7fe700 1 --2- 172.21.15.123:0/1770443308 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3964066730 0x7f3964068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:17.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.852+0000 7f395f7fe700 1 -- 172.21.15.123:0/1770443308 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3970085460 con 0x7f3978160310 2024-09-13T17:08:17.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.852+0000 7f3976ffd700 1 --2- 172.21.15.123:0/1770443308 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3964066730 0x7f3964068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:17.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.852+0000 7f3976ffd700 1 --2- 172.21.15.123:0/1770443308 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3964066730 0x7f3964068bf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f39781f3ad0 tx=0x7f396c0090e0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:17.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:17.860+0000 7f395f7fe700 1 -- 172.21.15.123:0/1770443308 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f39700566e0 con 0x7f3978160310 2024-09-13T17:08:18.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.028+0000 7f3977fff700 1 -- 172.21.15.123:0/1770443308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f39781f2900 con 0x7f3978160310 2024-09-13T17:08:18.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.340+0000 7f395f7fe700 1 -- 172.21.15.123:0/1770443308 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v43) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3970056270 con 0x7f3978160310 2024-09-13T17:08:18.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.348+0000 7f3977fff700 1 -- 172.21.15.123:0/1770443308 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3964066730 msgr2=0x7f3964068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:18.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.348+0000 7f3977fff700 1 --2- 172.21.15.123:0/1770443308 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3964066730 0x7f3964068bf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f39781f3ad0 tx=0x7f396c0090e0 comp rx=0 tx=0).stop 2024-09-13T17:08:18.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.348+0000 7f3977fff700 1 -- 172.21.15.123:0/1770443308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3978160310 msgr2=0x7f39780b7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:18.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.348+0000 7f3977fff700 1 --2- 172.21.15.123:0/1770443308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3978160310 0x7f39780b7940 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f39780b56b0 tx=0x7f3970004af0 comp rx=0 tx=0).stop 2024-09-13T17:08:18.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.348+0000 7f3977fff700 1 -- 172.21.15.123:0/1770443308 shutdown_connections 2024-09-13T17:08:18.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.348+0000 7f3977fff700 1 --2- 172.21.15.123:0/1770443308 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3964066730 0x7f3964068bf0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:18.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.348+0000 7f3977fff700 1 --2- 172.21.15.123:0/1770443308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3978160310 0x7f39780b7940 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:18.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.348+0000 7f3977fff700 1 --2- 172.21.15.123:0/1770443308 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39780d3220 0x7f39781f32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:18.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.348+0000 7f3977fff700 1 --2- 172.21.15.123:0/1770443308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39780d1080 0x7f3978158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:18.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.348+0000 7f3977fff700 1 -- 172.21.15.123:0/1770443308 >> 172.21.15.123:0/1770443308 conn(0x7f397809be50 msgr2=0x7f3978071650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:18.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.348+0000 7f3977fff700 1 -- 172.21.15.123:0/1770443308 shutdown_connections 2024-09-13T17:08:18.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.348+0000 7f3977fff700 1 -- 172.21.15.123:0/1770443308 wait complete. 2024-09-13T17:08:18.353 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-13T17:08:18.366 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:08:18.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.480+0000 7f38bffff700 1 Processor -- start 2024-09-13T17:08:18.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.480+0000 7f38bffff700 1 -- start start 2024-09-13T17:08:18.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f38c00b23f0 0x7f38c00afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:18.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38c015acf0 0x7f38c00b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:18.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bffff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c00b2d10 con 0x7f38c00cc3e0 2024-09-13T17:08:18.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bffff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c00ceb30 con 0x7f38c00b23f0 2024-09-13T17:08:18.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c00ce540 con 0x7f38c015acf0 2024-09-13T17:08:18.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38be7fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38c015acf0 0x7f38c00b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:18.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38be7fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38c015acf0 0x7f38c00b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:33628/0 (socket says 172.21.15.123:33628) 2024-09-13T17:08:18.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38be7fc700 1 -- 172.21.15.123:0/3000538854 learned_addr learned my addr 172.21.15.123:0/3000538854 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:18.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38beffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f38c00b23f0 0x7f38c00afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:18.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38be7fc700 1 -- 172.21.15.123:0/3000538854 >> v2:172.21.15.153:3300/0 conn(0x7f38c00b23f0 msgr2=0x7f38c00afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:18.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38be7fc700 1 --2- 172.21.15.123:0/3000538854 >> v2:172.21.15.153:3300/0 conn(0x7f38c00b23f0 0x7f38c00afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:18.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38be7fc700 1 -- 172.21.15.123:0/3000538854 >> v1:172.21.15.153:6789/0 conn(0x7f38c00cc3e0 legacy=0x7f38c00b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:18.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38be7fc700 1 -- 172.21.15.123:0/3000538854 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c00cccc0 con 0x7f38c015acf0 2024-09-13T17:08:18.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38be7fc700 1 --2- 172.21.15.123:0/3000538854 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38c015acf0 0x7f38c00b27d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009910 tx=0x7f38b0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=293c0ebf26e8adce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:18.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bdffb700 1 -- 172.21.15.123:0/3000538854 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0011830 con 0x7f38c015acf0 2024-09-13T17:08:18.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bdffb700 1 -- 172.21.15.123:0/3000538854 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b0011990 con 0x7f38c015acf0 2024-09-13T17:08:18.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bdffb700 1 -- 172.21.15.123:0/3000538854 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0011d40 con 0x7f38c015acf0 2024-09-13T17:08:18.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bffff700 1 -- 172.21.15.123:0/3000538854 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38c015acf0 msgr2=0x7f38c00b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:18.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bffff700 1 --2- 172.21.15.123:0/3000538854 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38c015acf0 0x7f38c00b27d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009910 tx=0x7f38b0009c20 comp rx=0 tx=0).stop 2024-09-13T17:08:18.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bffff700 1 -- 172.21.15.123:0/3000538854 shutdown_connections 2024-09-13T17:08:18.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bffff700 1 --2- 172.21.15.123:0/3000538854 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38c015acf0 0x7f38c00b27d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:18.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bffff700 1 --2- 172.21.15.123:0/3000538854 >> v2:172.21.15.153:3300/0 conn(0x7f38c00b23f0 0x7f38c00afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:18.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bffff700 1 -- 172.21.15.123:0/3000538854 >> 172.21.15.123:0/3000538854 conn(0x7f38c0066780 msgr2=0x7f38c00cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:18.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bffff700 1 -- 172.21.15.123:0/3000538854 shutdown_connections 2024-09-13T17:08:18.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.484+0000 7f38bffff700 1 -- 172.21.15.123:0/3000538854 wait complete. 2024-09-13T17:08:18.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.488+0000 7f38bffff700 1 Processor -- start 2024-09-13T17:08:18.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.488+0000 7f38bffff700 1 -- start start 2024-09-13T17:08:18.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38bffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38c00b23f0 0x7f38c00c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:18.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38bffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38c00cc3e0 0x7f38c0149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:18.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38bffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38c015acf0 0x7f38c0149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:18.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38bffff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c015be00 con 0x7f38c015acf0 2024-09-13T17:08:18.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38bffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c015c0e0 con 0x7f38c00cc3e0 2024-09-13T17:08:18.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38bffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c015c3c0 con 0x7f38c00b23f0 2024-09-13T17:08:18.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38bf7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38c015acf0 0x7f38c0149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:18.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38beffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38c00b23f0 0x7f38c00c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:18.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38beffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38c00b23f0 0x7f38c00c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:33640/0 (socket says 172.21.15.123:33640) 2024-09-13T17:08:18.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38beffd700 1 -- 172.21.15.123:0/4202434923 learned_addr learned my addr 172.21.15.123:0/4202434923 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:18.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38be7fc700 1 --2- 172.21.15.123:0/4202434923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38c00cc3e0 0x7f38c0149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38beffd700 1 -- 172.21.15.123:0/4202434923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38c00cc3e0 msgr2=0x7f38c0149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38beffd700 1 --2- 172.21.15.123:0/4202434923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38c00cc3e0 0x7f38c0149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38beffd700 1 -- 172.21.15.123:0/4202434923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38c015acf0 msgr2=0x7f38c0149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38beffd700 1 --2- 172.21.15.123:0/4202434923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38c015acf0 0x7f38c0149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38beffd700 1 -- 172.21.15.123:0/4202434923 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b0009570 con 0x7f38c00b23f0 2024-09-13T17:08:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38beffd700 1 --2- 172.21.15.123:0/4202434923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38c00b23f0 0x7f38c00c9c60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f38b400e840 tx=0x7f38b400eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38a77fe700 1 -- 172.21.15.123:0/4202434923 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b40095a0 con 0x7f38c00b23f0 2024-09-13T17:08:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38a77fe700 1 -- 172.21.15.123:0/4202434923 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b4013680 con 0x7f38c00b23f0 2024-09-13T17:08:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38a77fe700 1 -- 172.21.15.123:0/4202434923 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b40139f0 con 0x7f38c00b23f0 2024-09-13T17:08:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38bffff700 1 -- 172.21.15.123:0/4202434923 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c015c6a0 con 0x7f38c00b23f0 2024-09-13T17:08:18.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38bffff700 1 -- 172.21.15.123:0/4202434923 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c00ca1a0 con 0x7f38c00b23f0 2024-09-13T17:08:18.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.492+0000 7f38bffff700 1 -- 172.21.15.123:0/4202434923 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c00afe20 con 0x7f38c00b23f0 2024-09-13T17:08:18.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.496+0000 7f38a77fe700 1 -- 172.21.15.123:0/4202434923 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f38b4013b50 con 0x7f38c00b23f0 2024-09-13T17:08:18.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.496+0000 7f38a77fe700 1 --2- 172.21.15.123:0/4202434923 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f38ac066730 0x7f38ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:18.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.496+0000 7f38a77fe700 1 -- 172.21.15.123:0/4202434923 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f38b4083e60 con 0x7f38c00b23f0 2024-09-13T17:08:18.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.496+0000 7f38be7fc700 1 --2- 172.21.15.123:0/4202434923 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f38ac066730 0x7f38ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:18.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.496+0000 7f38be7fc700 1 --2- 172.21.15.123:0/4202434923 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f38ac066730 0x7f38ac068bf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f38c00ce4f0 tx=0x7f38b0008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.508+0000 7f38a77fe700 1 -- 172.21.15.123:0/4202434923 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f38b4051310 con 0x7f38c00b23f0 2024-09-13T17:08:18.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:18.676+0000 7f38bffff700 1 -- 172.21.15.123:0/4202434923 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f38c015c500 con 0x7f38c00b23f0 2024-09-13T17:08:19.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.352+0000 7f38a77fe700 1 -- 172.21.15.123:0/4202434923 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v44) v1 ==== 170+0+0 (secure 0 0 0) 0x7f38c015c500 con 0x7f38c00b23f0 2024-09-13T17:08:19.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.368+0000 7f38bffff700 1 -- 172.21.15.123:0/4202434923 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f38ac066730 msgr2=0x7f38ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:19.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.368+0000 7f38bffff700 1 --2- 172.21.15.123:0/4202434923 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f38ac066730 0x7f38ac068bf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f38c00ce4f0 tx=0x7f38b0008030 comp rx=0 tx=0).stop 2024-09-13T17:08:19.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.368+0000 7f38bffff700 1 -- 172.21.15.123:0/4202434923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38c00b23f0 msgr2=0x7f38c00c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:19.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.368+0000 7f38bffff700 1 --2- 172.21.15.123:0/4202434923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38c00b23f0 0x7f38c00c9c60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f38b400e840 tx=0x7f38b400eb50 comp rx=0 tx=0).stop 2024-09-13T17:08:19.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.368+0000 7f38bffff700 1 -- 172.21.15.123:0/4202434923 shutdown_connections 2024-09-13T17:08:19.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.368+0000 7f38bffff700 1 --2- 172.21.15.123:0/4202434923 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f38ac066730 0x7f38ac068bf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.368+0000 7f38bffff700 1 --2- 172.21.15.123:0/4202434923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38c015acf0 0x7f38c0149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.368+0000 7f38bffff700 1 --2- 172.21.15.123:0/4202434923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38c00cc3e0 0x7f38c0149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.368+0000 7f38bffff700 1 --2- 172.21.15.123:0/4202434923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f38c00b23f0 0x7f38c00c9c60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.368+0000 7f38bffff700 1 -- 172.21.15.123:0/4202434923 >> 172.21.15.123:0/4202434923 conn(0x7f38c0066780 msgr2=0x7f38c00d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:19.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.368+0000 7f38bffff700 1 -- 172.21.15.123:0/4202434923 shutdown_connections 2024-09-13T17:08:19.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.368+0000 7f38bffff700 1 -- 172.21.15.123:0/4202434923 wait complete. 2024-09-13T17:08:19.372 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-13T17:08:19.385 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:08:19.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d3fff700 1 Processor -- start 2024-09-13T17:08:19.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d3fff700 1 -- start start 2024-09-13T17:08:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd9d4071760 0x7fd9d40b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd9d406dc70 0x7fd9d40cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d3fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d40cc030 con 0x7fd9d41597c0 2024-09-13T17:08:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d3fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d40b2e60 con 0x7fd9d4071760 2024-09-13T17:08:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d3fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d40b17d0 con 0x7fd9d406dc70 2024-09-13T17:08:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d27fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd9d4071760 0x7fd9d40b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d27fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd9d4071760 0x7fd9d40b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60478/0 (socket says 172.21.15.123:60478) 2024-09-13T17:08:19.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d27fc700 1 -- 172.21.15.123:0/1081508827 learned_addr learned my addr 172.21.15.123:0/1081508827 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:19.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d37fe700 1 --2- 172.21.15.123:0/1081508827 >> v2:172.21.15.153:3300/0 conn(0x7fd9d406dc70 0x7fd9d40cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:19.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d1ffb700 1 -- 172.21.15.123:0/1081508827 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112790578 0 0) 0x7fd9d40cc030 con 0x7fd9d41597c0 2024-09-13T17:08:19.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d27fc700 1 -- 172.21.15.123:0/1081508827 >> v2:172.21.15.153:3300/0 conn(0x7fd9d406dc70 msgr2=0x7fd9d40cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:19.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d27fc700 1 --2- 172.21.15.123:0/1081508827 >> v2:172.21.15.153:3300/0 conn(0x7fd9d406dc70 0x7fd9d40cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d27fc700 1 -- 172.21.15.123:0/1081508827 >> v1:172.21.15.153:6789/0 conn(0x7fd9d41597c0 legacy=0x7fd9d4071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:19.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.496+0000 7fd9d27fc700 1 -- 172.21.15.123:0/1081508827 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d40b25c0 con 0x7fd9d4071760 2024-09-13T17:08:19.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.500+0000 7fd9d27fc700 1 --2- 172.21.15.123:0/1081508827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9d4071760 0x7fd9d40b1f30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800bbb0 tx=0x7fd9c800bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c886e7497f5cd5ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:19.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.500+0000 7fd9d1ffb700 1 -- 172.21.15.123:0/1081508827 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c800dcf0 con 0x7fd9d4071760 2024-09-13T17:08:19.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.500+0000 7fd9d1ffb700 1 -- 172.21.15.123:0/1081508827 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c800de50 con 0x7fd9d4071760 2024-09-13T17:08:19.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.500+0000 7fd9d1ffb700 1 -- 172.21.15.123:0/1081508827 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8010690 con 0x7fd9d4071760 2024-09-13T17:08:19.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.500+0000 7fd9d3fff700 1 -- 172.21.15.123:0/1081508827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9d4071760 msgr2=0x7fd9d40b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:19.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.500+0000 7fd9d3fff700 1 --2- 172.21.15.123:0/1081508827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9d4071760 0x7fd9d40b1f30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800bbb0 tx=0x7fd9c800bec0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.500+0000 7fd9d3fff700 1 -- 172.21.15.123:0/1081508827 shutdown_connections 2024-09-13T17:08:19.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.500+0000 7fd9d3fff700 1 --2- 172.21.15.123:0/1081508827 >> v2:172.21.15.153:3300/0 conn(0x7fd9d406dc70 0x7fd9d40cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.500+0000 7fd9d3fff700 1 --2- 172.21.15.123:0/1081508827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9d4071760 0x7fd9d40b1f30 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.500+0000 7fd9d3fff700 1 -- 172.21.15.123:0/1081508827 >> 172.21.15.123:0/1081508827 conn(0x7fd9d406f940 msgr2=0x7fd9d40b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:19.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.500+0000 7fd9d3fff700 1 -- 172.21.15.123:0/1081508827 shutdown_connections 2024-09-13T17:08:19.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.500+0000 7fd9d3fff700 1 -- 172.21.15.123:0/1081508827 wait complete. 2024-09-13T17:08:19.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.500+0000 7fd9d3fff700 1 Processor -- start 2024-09-13T17:08:19.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.500+0000 7fd9d3fff700 1 -- start start 2024-09-13T17:08:19.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9d406dc70 0x7fd9d40a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:19.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9d4071760 0x7fd9d40aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:19.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9d41597c0 0x7fd9d40ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:19.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d3fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40a9890 con 0x7fd9d4071760 2024-09-13T17:08:19.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40a89e0 con 0x7fd9d41597c0 2024-09-13T17:08:19.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40a8c80 con 0x7fd9d406dc70 2024-09-13T17:08:19.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d27fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9d4071760 0x7fd9d40aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:19.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d27fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9d4071760 0x7fd9d40aafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60480/0 (socket says 172.21.15.123:60480) 2024-09-13T17:08:19.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d27fc700 1 -- 172.21.15.123:0/222550050 learned_addr learned my addr 172.21.15.123:0/222550050 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:19.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d37fe700 1 --2- 172.21.15.123:0/222550050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9d41597c0 0x7fd9d40ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:19.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d2ffd700 1 --2- 172.21.15.123:0/222550050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9d406dc70 0x7fd9d40a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:19.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d27fc700 1 -- 172.21.15.123:0/222550050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9d406dc70 msgr2=0x7fd9d40a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:19.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d27fc700 1 --2- 172.21.15.123:0/222550050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9d406dc70 0x7fd9d40a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d27fc700 1 -- 172.21.15.123:0/222550050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9d41597c0 msgr2=0x7fd9d40ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:19.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d27fc700 1 --2- 172.21.15.123:0/222550050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9d41597c0 0x7fd9d40ab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d27fc700 1 -- 172.21.15.123:0/222550050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c800b810 con 0x7fd9d4071760 2024-09-13T17:08:19.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d27fc700 1 --2- 172.21.15.123:0/222550050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9d4071760 0x7fd9d40aafb0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800bfd0 tx=0x7fd9c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:19.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9bb7fe700 1 -- 172.21.15.123:0/222550050 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c801f070 con 0x7fd9d4071760 2024-09-13T17:08:19.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9bb7fe700 1 -- 172.21.15.123:0/222550050 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c8024470 con 0x7fd9d4071760 2024-09-13T17:08:19.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d3fff700 1 -- 172.21.15.123:0/222550050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d40a8f60 con 0x7fd9d4071760 2024-09-13T17:08:19.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9bb7fe700 1 -- 172.21.15.123:0/222550050 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8024800 con 0x7fd9d4071760 2024-09-13T17:08:19.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d3fff700 1 -- 172.21.15.123:0/222550050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d40a9520 con 0x7fd9d4071760 2024-09-13T17:08:19.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.504+0000 7fd9d3fff700 1 -- 172.21.15.123:0/222550050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d40a9a00 con 0x7fd9d4071760 2024-09-13T17:08:19.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.508+0000 7fd9bb7fe700 1 -- 172.21.15.123:0/222550050 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd9c8019400 con 0x7fd9d4071760 2024-09-13T17:08:19.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.508+0000 7fd9bb7fe700 1 --2- 172.21.15.123:0/222550050 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9c0066760 0x7fd9c0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:19.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.508+0000 7fd9bb7fe700 1 -- 172.21.15.123:0/222550050 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd9c8087670 con 0x7fd9d4071760 2024-09-13T17:08:19.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.508+0000 7fd9d2ffd700 1 --2- 172.21.15.123:0/222550050 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9c0066760 0x7fd9c0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:19.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.508+0000 7fd9d2ffd700 1 --2- 172.21.15.123:0/222550050 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9c0066760 0x7fd9c0068c20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd9d414d4f0 tx=0x7fd9c4009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:19.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.516+0000 7fd9bb7fe700 1 -- 172.21.15.123:0/222550050 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd9c8054ad0 con 0x7fd9d4071760 2024-09-13T17:08:19.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.720+0000 7fd9d3fff700 1 -- 172.21.15.123:0/222550050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd9d40b1f30 con 0x7fd9d4071760 2024-09-13T17:08:19.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.732+0000 7fd9bb7fe700 1 -- 172.21.15.123:0/222550050 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v17) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd9c80580f0 con 0x7fd9d4071760 2024-09-13T17:08:19.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.740+0000 7fd9d3fff700 1 -- 172.21.15.123:0/222550050 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9c0066760 msgr2=0x7fd9c0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:19.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.740+0000 7fd9d3fff700 1 --2- 172.21.15.123:0/222550050 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9c0066760 0x7fd9c0068c20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd9d414d4f0 tx=0x7fd9c4009040 comp rx=0 tx=0).stop 2024-09-13T17:08:19.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.740+0000 7fd9d3fff700 1 -- 172.21.15.123:0/222550050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9d4071760 msgr2=0x7fd9d40aafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:19.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.740+0000 7fd9d3fff700 1 --2- 172.21.15.123:0/222550050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9d4071760 0x7fd9d40aafb0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800bfd0 tx=0x7fd9c8004770 comp rx=0 tx=0).stop 2024-09-13T17:08:19.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.744+0000 7fd9d3fff700 1 -- 172.21.15.123:0/222550050 shutdown_connections 2024-09-13T17:08:19.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.744+0000 7fd9d3fff700 1 --2- 172.21.15.123:0/222550050 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9c0066760 0x7fd9c0068c20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.744+0000 7fd9d3fff700 1 --2- 172.21.15.123:0/222550050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9d41597c0 0x7fd9d40ab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.744+0000 7fd9d3fff700 1 --2- 172.21.15.123:0/222550050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9d4071760 0x7fd9d40aafb0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.744+0000 7fd9d3fff700 1 --2- 172.21.15.123:0/222550050 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9d406dc70 0x7fd9d40a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.744+0000 7fd9d3fff700 1 -- 172.21.15.123:0/222550050 >> 172.21.15.123:0/222550050 conn(0x7fd9d406f940 msgr2=0x7fd9d406d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:19.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.744+0000 7fd9d3fff700 1 -- 172.21.15.123:0/222550050 shutdown_connections 2024-09-13T17:08:19.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.744+0000 7fd9d3fff700 1 -- 172.21.15.123:0/222550050 wait complete. 2024-09-13T17:08:19.751 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 6 and data pool 7 2024-09-13T17:08:19.768 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:19.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb40862700 1 Processor -- start 2024-09-13T17:08:19.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb40862700 1 -- start start 2024-09-13T17:08:19.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb40862700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0b2400 0x7fcb3c0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:19.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb40862700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcb3c0cd4b0 0x7fcb3c0b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:19.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb40862700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3c0cde30 con 0x7fcb3c0b2d20 2024-09-13T17:08:19.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb40862700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3c0b3fc0 con 0x7fcb3c0cd4b0 2024-09-13T17:08:19.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb40862700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0cd8f0 con 0x7fcb3c0b2400 2024-09-13T17:08:19.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb3a59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcb3c0cd4b0 0x7fcb3c0b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:19.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb3ad9d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0b2400 0x7fcb3c0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:19.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb3b59e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcb3c0b2d20 0x7fcb3c0b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:43048/0 (socket says 172.21.15.123:43048) 2024-09-13T17:08:19.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb3b59e700 1 -- 172.21.15.123:0/1320224242 learned_addr learned my addr 172.21.15.123:0/1320224242 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:19.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb3a59c700 1 -- 172.21.15.123:0/1320224242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0b2400 msgr2=0x7fcb3c0ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:19.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb3a59c700 1 --2- 172.21.15.123:0/1320224242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0b2400 0x7fcb3c0ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb3a59c700 1 -- 172.21.15.123:0/1320224242 >> v1:172.21.15.153:6789/0 conn(0x7fcb3c0b2d20 legacy=0x7fcb3c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:19.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb3a59c700 1 -- 172.21.15.123:0/1320224242 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c0afa30 con 0x7fcb3c0cd4b0 2024-09-13T17:08:19.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb3a59c700 1 --2- 172.21.15.123:0/1320224242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c0cd4b0 0x7fcb3c0b27e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009d90 tx=0x7fcb3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baa32ede742a3473 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:19.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb39d9b700 1 -- 172.21.15.123:0/1320224242 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3400e070 con 0x7fcb3c0cd4b0 2024-09-13T17:08:19.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb39d9b700 1 -- 172.21.15.123:0/1320224242 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3400bb20 con 0x7fcb3c0cd4b0 2024-09-13T17:08:19.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb39d9b700 1 -- 172.21.15.123:0/1320224242 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34012430 con 0x7fcb3c0cd4b0 2024-09-13T17:08:19.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb40862700 1 -- 172.21.15.123:0/1320224242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c0cd4b0 msgr2=0x7fcb3c0b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:19.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.864+0000 7fcb40862700 1 --2- 172.21.15.123:0/1320224242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c0cd4b0 0x7fcb3c0b27e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009d90 tx=0x7fcb3400b330 comp rx=0 tx=0).stop 2024-09-13T17:08:19.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb40862700 1 -- 172.21.15.123:0/1320224242 shutdown_connections 2024-09-13T17:08:19.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb40862700 1 --2- 172.21.15.123:0/1320224242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c0cd4b0 0x7fcb3c0b27e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb40862700 1 --2- 172.21.15.123:0/1320224242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0b2400 0x7fcb3c0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb40862700 1 -- 172.21.15.123:0/1320224242 >> 172.21.15.123:0/1320224242 conn(0x7fcb3c06a650 msgr2=0x7fcb3c06aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:19.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb40862700 1 -- 172.21.15.123:0/1320224242 shutdown_connections 2024-09-13T17:08:19.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb40862700 1 -- 172.21.15.123:0/1320224242 wait complete. 2024-09-13T17:08:19.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb40862700 1 Processor -- start 2024-09-13T17:08:19.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb40862700 1 -- start start 2024-09-13T17:08:19.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb40862700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0b2400 0x7fcb3c0c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:19.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb40862700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb3c0b2d20 0x7fcb3c0c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:19.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb40862700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c0cd4b0 0x7fcb3c0ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:19.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb40862700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0c6a60 con 0x7fcb3c0b2d20 2024-09-13T17:08:19.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb40862700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0caa40 con 0x7fcb3c0cd4b0 2024-09-13T17:08:19.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb40862700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0c5480 con 0x7fcb3c0b2400 2024-09-13T17:08:19.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb3a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb3c0b2d20 0x7fcb3c0c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:19.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb3a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb3c0b2d20 0x7fcb3c0c6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60494/0 (socket says 172.21.15.123:60494) 2024-09-13T17:08:19.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb3a59c700 1 -- 172.21.15.123:0/3080447136 learned_addr learned my addr 172.21.15.123:0/3080447136 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:19.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb3b59e700 1 --2- 172.21.15.123:0/3080447136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c0cd4b0 0x7fcb3c0ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:19.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb3ad9d700 1 --2- 172.21.15.123:0/3080447136 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0b2400 0x7fcb3c0c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:19.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb3a59c700 1 -- 172.21.15.123:0/3080447136 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0b2400 msgr2=0x7fcb3c0c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:19.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb3a59c700 1 --2- 172.21.15.123:0/3080447136 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0b2400 0x7fcb3c0c4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb3a59c700 1 -- 172.21.15.123:0/3080447136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c0cd4b0 msgr2=0x7fcb3c0ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:19.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb3a59c700 1 --2- 172.21.15.123:0/3080447136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c0cd4b0 0x7fcb3c0ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:19.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.868+0000 7fcb3a59c700 1 -- 172.21.15.123:0/3080447136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb34009a70 con 0x7fcb3c0b2d20 2024-09-13T17:08:19.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.872+0000 7fcb3a59c700 1 --2- 172.21.15.123:0/3080447136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb3c0b2d20 0x7fcb3c0c6520 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcb34014040 tx=0x7fcb34004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:19.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.872+0000 7fcb337fe700 1 -- 172.21.15.123:0/3080447136 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34012430 con 0x7fcb3c0b2d20 2024-09-13T17:08:19.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.872+0000 7fcb337fe700 1 -- 172.21.15.123:0/3080447136 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb34020070 con 0x7fcb3c0b2d20 2024-09-13T17:08:19.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.872+0000 7fcb40862700 1 -- 172.21.15.123:0/3080447136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c0c5760 con 0x7fcb3c0b2d20 2024-09-13T17:08:19.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.872+0000 7fcb337fe700 1 -- 172.21.15.123:0/3080447136 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34004280 con 0x7fcb3c0b2d20 2024-09-13T17:08:19.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.872+0000 7fcb40862700 1 -- 172.21.15.123:0/3080447136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3c0c5d20 con 0x7fcb3c0b2d20 2024-09-13T17:08:19.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.872+0000 7fcb40862700 1 -- 172.21.15.123:0/3080447136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3c0677f0 con 0x7fcb3c0b2d20 2024-09-13T17:08:19.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.872+0000 7fcb337fe700 1 -- 172.21.15.123:0/3080447136 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcb340043e0 con 0x7fcb3c0b2d20 2024-09-13T17:08:19.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.876+0000 7fcb337fe700 1 --2- 172.21.15.123:0/3080447136 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcb1c066730 0x7fcb1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:19.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.876+0000 7fcb337fe700 1 -- 172.21.15.123:0/3080447136 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb34022070 con 0x7fcb3c0b2d20 2024-09-13T17:08:19.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.876+0000 7fcb3ad9d700 1 --2- 172.21.15.123:0/3080447136 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcb1c066730 0x7fcb1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:19.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.876+0000 7fcb3ad9d700 1 --2- 172.21.15.123:0/3080447136 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcb1c066730 0x7fcb1c068bf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009b50 tx=0x7fcb24009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:19.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:19.880+0000 7fcb337fe700 1 -- 172.21.15.123:0/3080447136 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcb340532a0 con 0x7fcb3c0b2d20 2024-09-13T17:08:20.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.056+0000 7fcb40862700 1 -- 172.21.15.123:0/3080447136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb3c0ccf70 con 0x7fcb3c0b2d20 2024-09-13T17:08:20.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.060+0000 7fcb337fe700 1 -- 172.21.15.123:0/3080447136 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16574 (secure 0 0 0) 0x7fcb340568c0 con 0x7fcb3c0b2d20 2024-09-13T17:08:20.064 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:20.064 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":45,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:19.725258+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:18.071457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:18.723653+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:20.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.060+0000 7fcb40862700 1 -- 172.21.15.123:0/3080447136 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcb1c066730 msgr2=0x7fcb1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.060+0000 7fcb40862700 1 --2- 172.21.15.123:0/3080447136 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcb1c066730 0x7fcb1c068bf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009b50 tx=0x7fcb24009240 comp rx=0 tx=0).stop 2024-09-13T17:08:20.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.060+0000 7fcb40862700 1 -- 172.21.15.123:0/3080447136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb3c0b2d20 msgr2=0x7fcb3c0c6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.060+0000 7fcb40862700 1 --2- 172.21.15.123:0/3080447136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb3c0b2d20 0x7fcb3c0c6520 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcb34014040 tx=0x7fcb34004af0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.064+0000 7fcb40862700 1 -- 172.21.15.123:0/3080447136 shutdown_connections 2024-09-13T17:08:20.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.064+0000 7fcb40862700 1 --2- 172.21.15.123:0/3080447136 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcb1c066730 0x7fcb1c068bf0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.064+0000 7fcb40862700 1 --2- 172.21.15.123:0/3080447136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb3c0cd4b0 0x7fcb3c0ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.064+0000 7fcb40862700 1 --2- 172.21.15.123:0/3080447136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb3c0b2d20 0x7fcb3c0c6520 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.064+0000 7fcb40862700 1 --2- 172.21.15.123:0/3080447136 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcb3c0b2400 0x7fcb3c0c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.064+0000 7fcb40862700 1 -- 172.21.15.123:0/3080447136 >> 172.21.15.123:0/3080447136 conn(0x7fcb3c06a650 msgr2=0x7fcb3c0b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:20.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.064+0000 7fcb40862700 1 -- 172.21.15.123:0/3080447136 shutdown_connections 2024-09-13T17:08:20.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.064+0000 7fcb40862700 1 -- 172.21.15.123:0/3080447136 wait complete. 2024-09-13T17:08:20.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:20.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.188+0000 7f04c6e03700 1 Processor -- start 2024-09-13T17:08:20.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.188+0000 7f04c6e03700 1 -- start start 2024-09-13T17:08:20.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.188+0000 7f04c6e03700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04c013f680 0x7f04c015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.188+0000 7f04c6e03700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04c00ce2a0 0x7f04c015d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.188+0000 7f04c6e03700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f04c00cc620 0x7f04c00ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.188+0000 7f04c6e03700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c00cd010 con 0x7f04c00ce2a0 2024-09-13T17:08:20.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.188+0000 7f04c6e03700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c00cf5c0 con 0x7f04c00cc620 2024-09-13T17:08:20.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.188+0000 7f04c6e03700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c00cd200 con 0x7f04c013f680 2024-09-13T17:08:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.188+0000 7f04c5600700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04c00ce2a0 0x7f04c015d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.188+0000 7f04c5600700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04c00ce2a0 0x7f04c015d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60500/0 (socket says 172.21.15.123:60500) 2024-09-13T17:08:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.188+0000 7f04c5600700 1 -- 172.21.15.123:0/3082708715 learned_addr learned my addr 172.21.15.123:0/3082708715 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c6602700 1 --2- 172.21.15.123:0/3082708715 >> v2:172.21.15.153:3300/0 conn(0x7f04c00cc620 0x7f04c00ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c5e01700 1 --2- 172.21.15.123:0/3082708715 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04c013f680 0x7f04c015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c5600700 1 -- 172.21.15.123:0/3082708715 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04c013f680 msgr2=0x7f04c015cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c5600700 1 --2- 172.21.15.123:0/3082708715 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04c013f680 0x7f04c015cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c5600700 1 -- 172.21.15.123:0/3082708715 >> v2:172.21.15.153:3300/0 conn(0x7f04c00cc620 msgr2=0x7f04c00ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c5600700 1 --2- 172.21.15.123:0/3082708715 >> v2:172.21.15.153:3300/0 conn(0x7f04c00cc620 0x7f04c00ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c5600700 1 -- 172.21.15.123:0/3082708715 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c00cd4e0 con 0x7f04c00ce2a0 2024-09-13T17:08:20.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c5600700 1 --2- 172.21.15.123:0/3082708715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c00ce2a0 0x7f04c015d0b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f04c0066f90 tx=0x7f04b0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503236056029c6f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:20.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c4dff700 1 -- 172.21.15.123:0/3082708715 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0011830 con 0x7f04c00ce2a0 2024-09-13T17:08:20.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c4dff700 1 -- 172.21.15.123:0/3082708715 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b0011990 con 0x7f04c00ce2a0 2024-09-13T17:08:20.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c4dff700 1 -- 172.21.15.123:0/3082708715 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0011d20 con 0x7f04c00ce2a0 2024-09-13T17:08:20.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c6e03700 1 -- 172.21.15.123:0/3082708715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c00ce2a0 msgr2=0x7f04c015d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c6e03700 1 --2- 172.21.15.123:0/3082708715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c00ce2a0 0x7f04c015d0b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f04c0066f90 tx=0x7f04b0009bf0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c6e03700 1 -- 172.21.15.123:0/3082708715 shutdown_connections 2024-09-13T17:08:20.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c6e03700 1 --2- 172.21.15.123:0/3082708715 >> v2:172.21.15.153:3300/0 conn(0x7f04c00cc620 0x7f04c00ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c6e03700 1 --2- 172.21.15.123:0/3082708715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c00ce2a0 0x7f04c015d0b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c6e03700 1 --2- 172.21.15.123:0/3082708715 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04c013f680 0x7f04c015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c6e03700 1 -- 172.21.15.123:0/3082708715 >> 172.21.15.123:0/3082708715 conn(0x7f04c0066150 msgr2=0x7f04c0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:20.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c6e03700 1 -- 172.21.15.123:0/3082708715 shutdown_connections 2024-09-13T17:08:20.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.192+0000 7f04c6e03700 1 -- 172.21.15.123:0/3082708715 wait complete. 2024-09-13T17:08:20.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.196+0000 7f04c6e03700 1 Processor -- start 2024-09-13T17:08:20.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.196+0000 7f04c6e03700 1 -- start start 2024-09-13T17:08:20.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.196+0000 7f04c6e03700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04c00cc620 0x7f04c01f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.196+0000 7f04c6e03700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04c00ce2a0 0x7f04c015b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.196+0000 7f04c6e03700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c013f680 0x7f04c0156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.196+0000 7f04c6e03700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c015bdf0 con 0x7f04c013f680 2024-09-13T17:08:20.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.196+0000 7f04c6e03700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c015c0d0 con 0x7f04c00ce2a0 2024-09-13T17:08:20.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.196+0000 7f04c6e03700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c015c3b0 con 0x7f04c00cc620 2024-09-13T17:08:20.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c6602700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c013f680 0x7f04c0156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c6602700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c013f680 0x7f04c0156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60514/0 (socket says 172.21.15.123:60514) 2024-09-13T17:08:20.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c6602700 1 -- 172.21.15.123:0/2689803487 learned_addr learned my addr 172.21.15.123:0/2689803487 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:20.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c5e01700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04c00cc620 0x7f04c01f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c5600700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04c00ce2a0 0x7f04c015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c6602700 1 -- 172.21.15.123:0/2689803487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04c00cc620 msgr2=0x7f04c01f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c6602700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04c00cc620 0x7f04c01f2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c6602700 1 -- 172.21.15.123:0/2689803487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04c00ce2a0 msgr2=0x7f04c015b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c6602700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04c00ce2a0 0x7f04c015b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c6602700 1 -- 172.21.15.123:0/2689803487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b0009570 con 0x7f04c013f680 2024-09-13T17:08:20.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c5600700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04c00ce2a0 0x7f04c015b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:20.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c6602700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c013f680 0x7f04c0156060 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f04b800eed0 tx=0x7f04b800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:20.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04b67fc700 1 -- 172.21.15.123:0/2689803487 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b8010040 con 0x7f04c013f680 2024-09-13T17:08:20.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04b67fc700 1 -- 172.21.15.123:0/2689803487 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b800bd30 con 0x7f04c013f680 2024-09-13T17:08:20.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c6e03700 1 -- 172.21.15.123:0/2689803487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c0140d50 con 0x7f04c013f680 2024-09-13T17:08:20.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04b67fc700 1 -- 172.21.15.123:0/2689803487 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b800bea0 con 0x7f04c013f680 2024-09-13T17:08:20.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c6e03700 1 -- 172.21.15.123:0/2689803487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c01565a0 con 0x7f04c013f680 2024-09-13T17:08:20.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.200+0000 7f04c6e03700 1 -- 172.21.15.123:0/2689803487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c01567f0 con 0x7f04c013f680 2024-09-13T17:08:20.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.204+0000 7f04b67fc700 1 -- 172.21.15.123:0/2689803487 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f04b8014620 con 0x7f04c013f680 2024-09-13T17:08:20.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.204+0000 7f04b67fc700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f04a4066730 0x7f04a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.204+0000 7f04b67fc700 1 -- 172.21.15.123:0/2689803487 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04b8084530 con 0x7f04c013f680 2024-09-13T17:08:20.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.204+0000 7f04c5e01700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f04a4066730 0x7f04a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.204+0000 7f04c5e01700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f04a4066730 0x7f04a4068bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f04bc007a60 tx=0x7f04bc008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:20.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.208+0000 7f04b67fc700 1 -- 172.21.15.123:0/2689803487 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f04b8051930 con 0x7f04c013f680 2024-09-13T17:08:20.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.384+0000 7f04c6e03700 1 -- 172.21.15.123:0/2689803487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04c00677f0 con 0x7f04c013f680 2024-09-13T17:08:20.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.388+0000 7f04b67fc700 1 -- 172.21.15.123:0/2689803487 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16574 (secure 0 0 0) 0x7f04b8054f50 con 0x7f04c013f680 2024-09-13T17:08:20.390 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:20.391 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":45,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:19.725258+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:18.071457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:18.723653+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:20.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.388+0000 7f04c6e03700 1 -- 172.21.15.123:0/2689803487 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f04a4066730 msgr2=0x7f04a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.388+0000 7f04c6e03700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f04a4066730 0x7f04a4068bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f04bc007a60 tx=0x7f04bc008040 comp rx=0 tx=0).stop 2024-09-13T17:08:20.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.388+0000 7f04c6e03700 1 -- 172.21.15.123:0/2689803487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c013f680 msgr2=0x7f04c0156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.388+0000 7f04c6e03700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c013f680 0x7f04c0156060 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f04b800eed0 tx=0x7f04b800b390 comp rx=0 tx=0).stop 2024-09-13T17:08:20.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.388+0000 7f04c6e03700 1 -- 172.21.15.123:0/2689803487 shutdown_connections 2024-09-13T17:08:20.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.388+0000 7f04c6e03700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f04a4066730 0x7f04a4068bf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.388+0000 7f04c6e03700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04c013f680 0x7f04c0156060 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.388+0000 7f04c6e03700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04c00ce2a0 0x7f04c015b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.388+0000 7f04c6e03700 1 --2- 172.21.15.123:0/2689803487 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f04c00cc620 0x7f04c01f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.388+0000 7f04c6e03700 1 -- 172.21.15.123:0/2689803487 >> 172.21.15.123:0/2689803487 conn(0x7f04c0066150 msgr2=0x7f04c0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:20.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.388+0000 7f04c6e03700 1 -- 172.21.15.123:0/2689803487 shutdown_connections 2024-09-13T17:08:20.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.388+0000 7f04c6e03700 1 -- 172.21.15.123:0/2689803487 wait complete. 2024-09-13T17:08:20.406 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:08:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7efff5bf0700 1 Processor -- start 2024-09-13T17:08:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7efff5bf0700 1 -- start start 2024-09-13T17:08:20.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7efff5bf0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efff015cc60 0x7efff00b3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7efff5bf0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efff00affd0 0x7efff006c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7efff5bf0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff006bbb0 con 0x7efff015d040 2024-09-13T17:08:20.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7efff5bf0700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff006cc90 con 0x7efff00affd0 2024-09-13T17:08:20.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7efff5bf0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff00b3e50 con 0x7efff015cc60 2024-09-13T17:08:20.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7effeffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7efff015d040 0x7efff006c580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47252/0 (socket says 172.21.15.123:47252) 2024-09-13T17:08:20.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7effeffff700 1 -- 172.21.15.123:0/526736426 learned_addr learned my addr 172.21.15.123:0/526736426 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:20.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7effeeffd700 1 --2- 172.21.15.123:0/526736426 >> v2:172.21.15.153:3300/0 conn(0x7efff00affd0 0x7efff006c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7effef7fe700 1 --2- 172.21.15.123:0/526736426 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efff015cc60 0x7efff00b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7effee7fc700 1 -- 172.21.15.123:0/526736426 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430694781 0 0) 0x7efff006bbb0 con 0x7efff015d040 2024-09-13T17:08:20.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7effee7fc700 1 -- 172.21.15.123:0/526736426 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effdc0035d0 con 0x7efff015d040 2024-09-13T17:08:20.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7effee7fc700 1 -- 172.21.15.123:0/526736426 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 639505355 0 0) 0x7effdc0035d0 con 0x7efff015d040 2024-09-13T17:08:20.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7effeeffd700 1 -- 172.21.15.123:0/526736426 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efff015cc60 msgr2=0x7efff00b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:20.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7effeeffd700 1 --2- 172.21.15.123:0/526736426 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efff015cc60 0x7efff00b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7effeeffd700 1 -- 172.21.15.123:0/526736426 >> v1:172.21.15.123:6789/0 conn(0x7efff015d040 legacy=0x7efff006c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7effeeffd700 1 -- 172.21.15.123:0/526736426 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff00cfde0 con 0x7efff00affd0 2024-09-13T17:08:20.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.520+0000 7effef7fe700 1 --2- 172.21.15.123:0/526736426 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efff015cc60 0x7efff00b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:20.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.524+0000 7effeeffd700 1 --2- 172.21.15.123:0/526736426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efff00affd0 0x7efff006c040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7effd8009850 tx=0x7effd8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fe19e4eab3b98c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:20.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.524+0000 7effee7fc700 1 -- 172.21.15.123:0/526736426 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe80019f0 con 0x7efff00affd0 2024-09-13T17:08:20.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.524+0000 7effee7fc700 1 -- 172.21.15.123:0/526736426 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd8004030 con 0x7efff00affd0 2024-09-13T17:08:20.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.524+0000 7effee7fc700 1 -- 172.21.15.123:0/526736426 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd80043e0 con 0x7efff00affd0 2024-09-13T17:08:20.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.524+0000 7efff5bf0700 1 -- 172.21.15.123:0/526736426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efff00affd0 msgr2=0x7efff006c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.524+0000 7efff5bf0700 1 --2- 172.21.15.123:0/526736426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efff00affd0 0x7efff006c040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7effd8009850 tx=0x7effd8009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:20.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.524+0000 7efff5bf0700 1 -- 172.21.15.123:0/526736426 shutdown_connections 2024-09-13T17:08:20.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.524+0000 7efff5bf0700 1 --2- 172.21.15.123:0/526736426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efff00affd0 0x7efff006c040 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.524+0000 7efff5bf0700 1 --2- 172.21.15.123:0/526736426 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efff015cc60 0x7efff00b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.524+0000 7efff5bf0700 1 -- 172.21.15.123:0/526736426 >> 172.21.15.123:0/526736426 conn(0x7efff006a660 msgr2=0x7efff006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:20.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.524+0000 7efff5bf0700 1 -- 172.21.15.123:0/526736426 shutdown_connections 2024-09-13T17:08:20.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.524+0000 7efff5bf0700 1 -- 172.21.15.123:0/526736426 wait complete. 2024-09-13T17:08:20.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.524+0000 7efff5bf0700 1 Processor -- start 2024-09-13T17:08:20.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.524+0000 7efff5bf0700 1 -- start start 2024-09-13T17:08:20.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7efff5bf0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efff00affd0 0x7efff00c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7efff5bf0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efff015cc60 0x7efff00b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7efff5bf0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efff015d040 0x7efff00b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7efff5bf0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff01480e0 con 0x7efff015cc60 2024-09-13T17:08:20.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7efff5bf0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff015d880 con 0x7efff00affd0 2024-09-13T17:08:20.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7efff5bf0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff014a900 con 0x7efff015d040 2024-09-13T17:08:20.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7effeeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efff015cc60 0x7efff00b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7effeeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efff015cc60 0x7efff00b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60518/0 (socket says 172.21.15.123:60518) 2024-09-13T17:08:20.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7effeeffd700 1 -- 172.21.15.123:0/4108717843 learned_addr learned my addr 172.21.15.123:0/4108717843 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:20.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7effef7fe700 1 --2- 172.21.15.123:0/4108717843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efff00affd0 0x7efff00c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7effeffff700 1 --2- 172.21.15.123:0/4108717843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efff015d040 0x7efff00b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7effeeffd700 1 -- 172.21.15.123:0/4108717843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efff015d040 msgr2=0x7efff00b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7effeeffd700 1 --2- 172.21.15.123:0/4108717843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efff015d040 0x7efff00b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7effeeffd700 1 -- 172.21.15.123:0/4108717843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efff00affd0 msgr2=0x7efff00c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7effeeffd700 1 --2- 172.21.15.123:0/4108717843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efff00affd0 0x7efff00c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7effeeffd700 1 -- 172.21.15.123:0/4108717843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe00094b0 con 0x7efff015cc60 2024-09-13T17:08:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7effeeffd700 1 --2- 172.21.15.123:0/4108717843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efff015cc60 0x7efff00b0cc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7effd80090b0 tx=0x7effd8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7effe7fff700 1 -- 172.21.15.123:0/4108717843 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd8003d10 con 0x7efff015cc60 2024-09-13T17:08:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7effe7fff700 1 -- 172.21.15.123:0/4108717843 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd801f070 con 0x7efff015cc60 2024-09-13T17:08:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7efff5bf0700 1 -- 172.21.15.123:0/4108717843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd80094b0 con 0x7efff015cc60 2024-09-13T17:08:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7effe7fff700 1 -- 172.21.15.123:0/4108717843 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd8011870 con 0x7efff015cc60 2024-09-13T17:08:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7efff5bf0700 1 -- 172.21.15.123:0/4108717843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff0147a20 con 0x7efff015cc60 2024-09-13T17:08:20.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.528+0000 7efff5bf0700 1 -- 172.21.15.123:0/4108717843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff0148220 con 0x7efff015cc60 2024-09-13T17:08:20.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.532+0000 7effe7fff700 1 -- 172.21.15.123:0/4108717843 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7effd80119d0 con 0x7efff015cc60 2024-09-13T17:08:20.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.532+0000 7effe7fff700 1 --2- 172.21.15.123:0/4108717843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7effd0066730 0x7effd0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:20.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.532+0000 7effe7fff700 1 -- 172.21.15.123:0/4108717843 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effd8021070 con 0x7efff015cc60 2024-09-13T17:08:20.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.532+0000 7effef7fe700 1 --2- 172.21.15.123:0/4108717843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7effd0066730 0x7effd0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:20.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.532+0000 7effef7fe700 1 --2- 172.21.15.123:0/4108717843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7effd0066730 0x7effd0068bf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7effe0009d80 tx=0x7effe0009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:20.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.536+0000 7effe7fff700 1 -- 172.21.15.123:0/4108717843 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7effd8052c70 con 0x7efff015cc60 2024-09-13T17:08:20.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:20.744+0000 7efff5bf0700 1 -- 172.21.15.123:0/4108717843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efff0148220 con 0x7efff015cc60 2024-09-13T17:08:21.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.748+0000 7effe7fff700 1 -- 172.21.15.123:0/4108717843 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 118+0+0 (secure 0 0 0) 0x7efff0148220 con 0x7efff015cc60 2024-09-13T17:08:21.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.752+0000 7efff5bf0700 1 -- 172.21.15.123:0/4108717843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7effd0066730 msgr2=0x7effd0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.752+0000 7efff5bf0700 1 --2- 172.21.15.123:0/4108717843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7effd0066730 0x7effd0068bf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7effe0009d80 tx=0x7effe0009240 comp rx=0 tx=0).stop 2024-09-13T17:08:21.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.752+0000 7efff5bf0700 1 -- 172.21.15.123:0/4108717843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efff015cc60 msgr2=0x7efff00b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.752+0000 7efff5bf0700 1 --2- 172.21.15.123:0/4108717843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efff015cc60 0x7efff00b0cc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7effd80090b0 tx=0x7effd8004770 comp rx=0 tx=0).stop 2024-09-13T17:08:21.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.752+0000 7efff5bf0700 1 -- 172.21.15.123:0/4108717843 shutdown_connections 2024-09-13T17:08:21.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.752+0000 7efff5bf0700 1 --2- 172.21.15.123:0/4108717843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7effd0066730 0x7effd0068bf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.752+0000 7efff5bf0700 1 --2- 172.21.15.123:0/4108717843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efff015d040 0x7efff00b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.752+0000 7efff5bf0700 1 --2- 172.21.15.123:0/4108717843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efff015cc60 0x7efff00b0cc0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.752+0000 7efff5bf0700 1 --2- 172.21.15.123:0/4108717843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efff00affd0 0x7efff00c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.752+0000 7efff5bf0700 1 -- 172.21.15.123:0/4108717843 >> 172.21.15.123:0/4108717843 conn(0x7efff006a660 msgr2=0x7efff015b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:21.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.752+0000 7efff5bf0700 1 -- 172.21.15.123:0/4108717843 shutdown_connections 2024-09-13T17:08:21.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.752+0000 7efff5bf0700 1 -- 172.21.15.123:0/4108717843 wait complete. 2024-09-13T17:08:21.772 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:08:21.772 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:08:21.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a5b5f700 1 Processor -- start 2024-09-13T17:08:21.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a5b5f700 1 -- start start 2024-09-13T17:08:21.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a5b5f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc9a0159c60 0x7fc9a015e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:21.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a5b5f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc9a0070f90 0x7fc9a00cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:21.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a5b5f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a00ada60 con 0x7fc9a00cdbd0 2024-09-13T17:08:21.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a5b5f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a015e680 con 0x7fc9a0159c60 2024-09-13T17:08:21.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a5b5f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a00ce020 con 0x7fc9a0070f90 2024-09-13T17:08:21.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a4b5d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc9a0159c60 0x7fc9a015e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:21.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a535e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc9a00cdbd0 0x7fc9a00cb090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47256/0 (socket says 172.21.15.123:47256) 2024-09-13T17:08:21.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a535e700 1 -- 172.21.15.123:0/670696734 learned_addr learned my addr 172.21.15.123:0/670696734 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc99ffff700 1 --2- 172.21.15.123:0/670696734 >> v2:172.21.15.153:3300/0 conn(0x7fc9a0070f90 0x7fc9a00cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc99f7fe700 1 -- 172.21.15.123:0/670696734 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245402074 0 0) 0x7fc9a00ada60 con 0x7fc9a00cdbd0 2024-09-13T17:08:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc99f7fe700 1 -- 172.21.15.123:0/670696734 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9880035d0 con 0x7fc9a00cdbd0 2024-09-13T17:08:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a4b5d700 1 -- 172.21.15.123:0/670696734 >> v2:172.21.15.153:3300/0 conn(0x7fc9a0070f90 msgr2=0x7fc9a00cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a4b5d700 1 --2- 172.21.15.123:0/670696734 >> v2:172.21.15.153:3300/0 conn(0x7fc9a0070f90 0x7fc9a00cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a4b5d700 1 -- 172.21.15.123:0/670696734 >> v1:172.21.15.123:6789/0 conn(0x7fc9a00cdbd0 legacy=0x7fc9a00cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a4b5d700 1 -- 172.21.15.123:0/670696734 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a00720a0 con 0x7fc9a0159c60 2024-09-13T17:08:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc99ffff700 1 --2- 172.21.15.123:0/670696734 >> v2:172.21.15.153:3300/0 conn(0x7fc9a0070f90 0x7fc9a00cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.892+0000 7fc9a4b5d700 1 --2- 172.21.15.123:0/670696734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a0159c60 0x7fc9a015e140 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00c2160 tx=0x7fc994009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcc6d30c4f811be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.896+0000 7fc99f7fe700 1 -- 172.21.15.123:0/670696734 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994011830 con 0x7fc9a0159c60 2024-09-13T17:08:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.896+0000 7fc99f7fe700 1 -- 172.21.15.123:0/670696734 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc994011990 con 0x7fc9a0159c60 2024-09-13T17:08:21.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.896+0000 7fc99f7fe700 1 -- 172.21.15.123:0/670696734 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994011d20 con 0x7fc9a0159c60 2024-09-13T17:08:21.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.896+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/670696734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a0159c60 msgr2=0x7fc9a015e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.896+0000 7fc9a5b5f700 1 --2- 172.21.15.123:0/670696734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a0159c60 0x7fc9a015e140 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00c2160 tx=0x7fc994009b30 comp rx=0 tx=0).stop 2024-09-13T17:08:21.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.896+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/670696734 shutdown_connections 2024-09-13T17:08:21.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.896+0000 7fc9a5b5f700 1 --2- 172.21.15.123:0/670696734 >> v2:172.21.15.153:3300/0 conn(0x7fc9a0070f90 0x7fc9a00cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.896+0000 7fc9a5b5f700 1 --2- 172.21.15.123:0/670696734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a0159c60 0x7fc9a015e140 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.896+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/670696734 >> 172.21.15.123:0/670696734 conn(0x7fc9a00b01d0 msgr2=0x7fc9a00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:21.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.896+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/670696734 shutdown_connections 2024-09-13T17:08:21.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.896+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/670696734 wait complete. 2024-09-13T17:08:21.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc9a5b5f700 1 Processor -- start 2024-09-13T17:08:21.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc9a5b5f700 1 -- start start 2024-09-13T17:08:21.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc9a5b5f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a0070f90 0x7fc9a0158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:21.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc9a5b5f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a00cdbd0 0x7fc9a00ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:21.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc9a5b5f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9a0159c60 0x7fc9a00ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc9a5b5f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0159290 con 0x7fc9a00cdbd0 2024-09-13T17:08:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc9a5b5f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00b30f0 con 0x7fc9a0070f90 2024-09-13T17:08:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc9a5b5f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00b2520 con 0x7fc9a0159c60 2024-09-13T17:08:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc99ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a00cdbd0 0x7fc9a00ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc99ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a00cdbd0 0x7fc9a00ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60544/0 (socket says 172.21.15.123:60544) 2024-09-13T17:08:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc99ffff700 1 -- 172.21.15.123:0/3221202380 learned_addr learned my addr 172.21.15.123:0/3221202380 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc9a4b5d700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a0070f90 0x7fc9a0158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc9a535e700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9a0159c60 0x7fc9a00ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc99ffff700 1 -- 172.21.15.123:0/3221202380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9a0159c60 msgr2=0x7fc9a00ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc99ffff700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9a0159c60 0x7fc9a00ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc99ffff700 1 -- 172.21.15.123:0/3221202380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a0070f90 msgr2=0x7fc9a0158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc99ffff700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a0070f90 0x7fc9a0158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:21.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc99ffff700 1 -- 172.21.15.123:0/3221202380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9940094b0 con 0x7fc9a00cdbd0 2024-09-13T17:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc9a4b5d700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a0070f90 0x7fc9a0158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc9a535e700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9a0159c60 0x7fc9a00ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc99ffff700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a00cdbd0 0x7fc9a00ac8c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc99000d9b0 tx=0x7fc99000dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc99d7fa700 1 -- 172.21.15.123:0/3221202380 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990004230 con 0x7fc9a00cdbd0 2024-09-13T17:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc99d7fa700 1 -- 172.21.15.123:0/3221202380 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc990004390 con 0x7fc9a00cdbd0 2024-09-13T17:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc99d7fa700 1 -- 172.21.15.123:0/3221202380 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99000a7d0 con 0x7fc9a00cdbd0 2024-09-13T17:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/3221202380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a00b27c0 con 0x7fc9a00cdbd0 2024-09-13T17:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.900+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/3221202380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a00b2d80 con 0x7fc9a00cdbd0 2024-09-13T17:08:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.904+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/3221202380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a0072510 con 0x7fc9a00cdbd0 2024-09-13T17:08:21.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.904+0000 7fc99d7fa700 1 -- 172.21.15.123:0/3221202380 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc99000a950 con 0x7fc9a00cdbd0 2024-09-13T17:08:21.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.904+0000 7fc99d7fa700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc98c066760 0x7fc98c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:21.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.904+0000 7fc9a4b5d700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc98c066760 0x7fc98c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:21.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.904+0000 7fc99d7fa700 1 -- 172.21.15.123:0/3221202380 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9900841e0 con 0x7fc9a00cdbd0 2024-09-13T17:08:21.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.908+0000 7fc9a4b5d700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc98c066760 0x7fc98c068c20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc994000c00 tx=0x7fc994008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:21.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:21.912+0000 7fc99d7fa700 1 -- 172.21.15.123:0/3221202380 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc9a0072510 con 0x7fc9a00cdbd0 2024-09-13T17:08:22.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.112+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/3221202380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc9a0072510 con 0x7fc9a00cdbd0 2024-09-13T17:08:22.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.748+0000 7fc99d7fa700 1 -- 172.21.15.123:0/3221202380 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v21) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc9a0072510 con 0x7fc9a00cdbd0 2024-09-13T17:08:22.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.752+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/3221202380 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc98c066760 msgr2=0x7fc98c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:22.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.752+0000 7fc9a5b5f700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc98c066760 0x7fc98c068c20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc994000c00 tx=0x7fc994008030 comp rx=0 tx=0).stop 2024-09-13T17:08:22.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.752+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/3221202380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a00cdbd0 msgr2=0x7fc9a00ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:22.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.752+0000 7fc9a5b5f700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a00cdbd0 0x7fc9a00ac8c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc99000d9b0 tx=0x7fc99000dd70 comp rx=0 tx=0).stop 2024-09-13T17:08:22.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.752+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/3221202380 shutdown_connections 2024-09-13T17:08:22.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.752+0000 7fc9a5b5f700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc98c066760 0x7fc98c068c20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:22.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.752+0000 7fc9a5b5f700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9a0159c60 0x7fc9a00ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:22.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.752+0000 7fc9a5b5f700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9a00cdbd0 0x7fc9a00ac8c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:22.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.752+0000 7fc9a5b5f700 1 --2- 172.21.15.123:0/3221202380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9a0070f90 0x7fc9a0158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:22.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.752+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/3221202380 >> 172.21.15.123:0/3221202380 conn(0x7fc9a00b01d0 msgr2=0x7fc9a00c9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:22.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.756+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/3221202380 shutdown_connections 2024-09-13T17:08:22.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.756+0000 7fc9a5b5f700 1 -- 172.21.15.123:0/3221202380 wait complete. 2024-09-13T17:08:22.772 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:08:22.773 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:08:22.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.888+0000 7ff3f7fff700 1 Processor -- start 2024-09-13T17:08:22.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.888+0000 7ff3f7fff700 1 -- start start 2024-09-13T17:08:22.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.888+0000 7ff3f7fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3f000acc0 0x7ff3f00e3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:22.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.888+0000 7ff3f7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3f00507a0 0x7ff3f00de2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:22.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.888+0000 7ff3f7fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f0005d80 con 0x7ff3f0033990 2024-09-13T17:08:22.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.888+0000 7ff3f7fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f004f9e0 con 0x7ff3f00507a0 2024-09-13T17:08:22.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.888+0000 7ff3f7fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f004fcc0 con 0x7ff3f000acc0 2024-09-13T17:08:22.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.888+0000 7ff3f6ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff3f0033990 0x7ff3f000a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39252/0 (socket says 172.21.15.123:39252) 2024-09-13T17:08:22.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.888+0000 7ff3f6ffd700 1 -- 172.21.15.123:0/3021991844 learned_addr learned my addr 172.21.15.123:0/3021991844 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:22.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f67fc700 1 --2- 172.21.15.123:0/3021991844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3f000acc0 0x7ff3f00e3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:22.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f77fe700 1 --2- 172.21.15.123:0/3021991844 >> v2:172.21.15.153:3300/0 conn(0x7ff3f00507a0 0x7ff3f00de2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:22.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f5ffb700 1 -- 172.21.15.123:0/3021991844 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116589823 0 0) 0x7ff3f0005d80 con 0x7ff3f0033990 2024-09-13T17:08:22.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f5ffb700 1 -- 172.21.15.123:0/3021991844 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3e00035d0 con 0x7ff3f0033990 2024-09-13T17:08:22.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f77fe700 1 -- 172.21.15.123:0/3021991844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3f000acc0 msgr2=0x7ff3f00e3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:22.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f77fe700 1 --2- 172.21.15.123:0/3021991844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3f000acc0 0x7ff3f00e3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:22.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f77fe700 1 -- 172.21.15.123:0/3021991844 >> v1:172.21.15.123:6789/0 conn(0x7ff3f0033990 legacy=0x7ff3f000a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:22.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f77fe700 1 -- 172.21.15.123:0/3021991844 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f004ffa0 con 0x7ff3f00507a0 2024-09-13T17:08:22.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f67fc700 1 --2- 172.21.15.123:0/3021991844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3f000acc0 0x7ff3f00e3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:22.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f77fe700 1 --2- 172.21.15.123:0/3021991844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f00507a0 0x7ff3f00de2a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8000b60 tx=0x7ff3f8069900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=616dc5abd5e39241 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:22.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f5ffb700 1 -- 172.21.15.123:0/3021991844 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f80675b0 con 0x7ff3f00507a0 2024-09-13T17:08:22.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f5ffb700 1 -- 172.21.15.123:0/3021991844 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f8073f10 con 0x7ff3f00507a0 2024-09-13T17:08:22.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f5ffb700 1 -- 172.21.15.123:0/3021991844 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8067710 con 0x7ff3f00507a0 2024-09-13T17:08:22.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f7fff700 1 -- 172.21.15.123:0/3021991844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f00507a0 msgr2=0x7ff3f00de2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:22.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f7fff700 1 --2- 172.21.15.123:0/3021991844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f00507a0 0x7ff3f00de2a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8000b60 tx=0x7ff3f8069900 comp rx=0 tx=0).stop 2024-09-13T17:08:22.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f7fff700 1 -- 172.21.15.123:0/3021991844 shutdown_connections 2024-09-13T17:08:22.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f7fff700 1 --2- 172.21.15.123:0/3021991844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f00507a0 0x7ff3f00de2a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:22.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f7fff700 1 --2- 172.21.15.123:0/3021991844 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3f000acc0 0x7ff3f00e3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:22.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f7fff700 1 -- 172.21.15.123:0/3021991844 >> 172.21.15.123:0/3021991844 conn(0x7ff3f0036140 msgr2=0x7ff3f0036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:22.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f7fff700 1 -- 172.21.15.123:0/3021991844 shutdown_connections 2024-09-13T17:08:22.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f7fff700 1 -- 172.21.15.123:0/3021991844 wait complete. 2024-09-13T17:08:22.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f7fff700 1 Processor -- start 2024-09-13T17:08:22.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.892+0000 7ff3f7fff700 1 -- start start 2024-09-13T17:08:22.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f000acc0 0x7ff3f00d6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:22.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3f0033990 0x7ff3f004b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:22.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f7fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3f00507a0 0x7ff3f004bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:22.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f7fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0037eb0 con 0x7ff3f0033990 2024-09-13T17:08:22.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f7fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0039c80 con 0x7ff3f000acc0 2024-09-13T17:08:22.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f7fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0038100 con 0x7ff3f00507a0 2024-09-13T17:08:22.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f67fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3f0033990 0x7ff3f004b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:22.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f67fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3f0033990 0x7ff3f004b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46412/0 (socket says 172.21.15.123:46412) 2024-09-13T17:08:22.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f67fc700 1 -- 172.21.15.123:0/2005666636 learned_addr learned my addr 172.21.15.123:0/2005666636 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:22.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f6ffd700 1 --2- 172.21.15.123:0/2005666636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f000acc0 0x7ff3f00d6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:22.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f77fe700 1 --2- 172.21.15.123:0/2005666636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3f00507a0 0x7ff3f004bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:22.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f6ffd700 1 -- 172.21.15.123:0/2005666636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3f00507a0 msgr2=0x7ff3f004bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:22.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f6ffd700 1 --2- 172.21.15.123:0/2005666636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3f00507a0 0x7ff3f004bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:22.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f6ffd700 1 -- 172.21.15.123:0/2005666636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3f0033990 msgr2=0x7ff3f004b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:22.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f6ffd700 1 --2- 172.21.15.123:0/2005666636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3f0033990 0x7ff3f004b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:22.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f6ffd700 1 -- 172.21.15.123:0/2005666636 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e80094b0 con 0x7ff3f000acc0 2024-09-13T17:08:22.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f6ffd700 1 --2- 172.21.15.123:0/2005666636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f000acc0 0x7ff3f00d6e30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec001000 tx=0x7ff3ec00c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:22.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3df7fe700 1 -- 172.21.15.123:0/2005666636 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec0074e0 con 0x7ff3f000acc0 2024-09-13T17:08:22.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3df7fe700 1 -- 172.21.15.123:0/2005666636 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec007640 con 0x7ff3f000acc0 2024-09-13T17:08:22.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3df7fe700 1 -- 172.21.15.123:0/2005666636 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec005a90 con 0x7ff3f000acc0 2024-09-13T17:08:22.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f7fff700 1 -- 172.21.15.123:0/2005666636 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f804f5c0 con 0x7ff3f000acc0 2024-09-13T17:08:22.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.896+0000 7ff3f7fff700 1 -- 172.21.15.123:0/2005666636 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f00386c0 con 0x7ff3f000acc0 2024-09-13T17:08:22.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.900+0000 7ff3f7fff700 1 -- 172.21.15.123:0/2005666636 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f000bc70 con 0x7ff3f000acc0 2024-09-13T17:08:22.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.900+0000 7ff3df7fe700 1 -- 172.21.15.123:0/2005666636 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3ec005bf0 con 0x7ff3f000acc0 2024-09-13T17:08:22.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.900+0000 7ff3df7fe700 1 --2- 172.21.15.123:0/2005666636 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3e4066730 0x7ff3e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:22.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.900+0000 7ff3df7fe700 1 -- 172.21.15.123:0/2005666636 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3ec083940 con 0x7ff3f000acc0 2024-09-13T17:08:22.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.900+0000 7ff3f67fc700 1 --2- 172.21.15.123:0/2005666636 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3e4066730 0x7ff3e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:22.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.900+0000 7ff3f67fc700 1 --2- 172.21.15.123:0/2005666636 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3e4066730 0x7ff3e4068bf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00de1a0 tx=0x7ff3e8009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:22.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:22.908+0000 7ff3df7fe700 1 -- 172.21.15.123:0/2005666636 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3ec050d90 con 0x7ff3f000acc0 2024-09-13T17:08:23.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.116+0000 7ff3f7fff700 1 -- 172.21.15.123:0/2005666636 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3f0000d70 con 0x7ff3f000acc0 2024-09-13T17:08:23.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.116+0000 7ff3df7fe700 1 -- 172.21.15.123:0/2005666636 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4743 (secure 0 0 0) 0x7ff3ec017070 con 0x7ff3f000acc0 2024-09-13T17:08:23.120 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:23.120 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5602,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3264962321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3264962321},{"type":"v1","addr":"172.21.15.153:6833","nonce":3264962321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5605,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1200497874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1200497874},{"type":"v1","addr":"172.21.15.153:6835","nonce":1200497874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/398437513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":398437513},{"type":"v1","addr":"172.21.15.123:6835","nonce":398437513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:08:19.726019+0000","modified":"2024-09-13T17:08:22.746133+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5730},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5730":{"gid":5730,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2449786141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2449786141},{"type":"v1","addr":"172.21.15.123:6837","nonce":2449786141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:08:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.120+0000 7ff3f7fff700 1 -- 172.21.15.123:0/2005666636 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3e4066730 msgr2=0x7ff3e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.120+0000 7ff3f7fff700 1 --2- 172.21.15.123:0/2005666636 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3e4066730 0x7ff3e4068bf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00de1a0 tx=0x7ff3e8009240 comp rx=0 tx=0).stop 2024-09-13T17:08:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.120+0000 7ff3f7fff700 1 -- 172.21.15.123:0/2005666636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f000acc0 msgr2=0x7ff3f00d6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.120+0000 7ff3f7fff700 1 --2- 172.21.15.123:0/2005666636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f000acc0 0x7ff3f00d6e30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec001000 tx=0x7ff3ec00c9e0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.120+0000 7ff3f7fff700 1 -- 172.21.15.123:0/2005666636 shutdown_connections 2024-09-13T17:08:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.120+0000 7ff3f7fff700 1 --2- 172.21.15.123:0/2005666636 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3e4066730 0x7ff3e4068bf0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.120+0000 7ff3f7fff700 1 --2- 172.21.15.123:0/2005666636 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3f00507a0 0x7ff3f004bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.120+0000 7ff3f7fff700 1 --2- 172.21.15.123:0/2005666636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3f0033990 0x7ff3f004b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.120+0000 7ff3f7fff700 1 --2- 172.21.15.123:0/2005666636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f000acc0 0x7ff3f00d6e30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.120+0000 7ff3f7fff700 1 -- 172.21.15.123:0/2005666636 >> 172.21.15.123:0/2005666636 conn(0x7ff3f0036140 msgr2=0x7ff3f00e0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.120+0000 7ff3f7fff700 1 -- 172.21.15.123:0/2005666636 shutdown_connections 2024-09-13T17:08:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.120+0000 7ff3f7fff700 1 -- 172.21.15.123:0/2005666636 wait complete. 2024-09-13T17:08:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 21 2024-09-13T17:08:23.141 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:23.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.248+0000 7fb0fa5d7700 1 Processor -- start 2024-09-13T17:08:23.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.248+0000 7fb0fa5d7700 1 -- start start 2024-09-13T17:08:23.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.248+0000 7fb0fa5d7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb0f41598b0 0x7fb0f4071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.248+0000 7fb0fa5d7700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0f40cedc0 0x7fb0f4159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.248+0000 7fb0fa5d7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f415d360 con 0x7fb0f40cdfd0 2024-09-13T17:08:23.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.248+0000 7fb0fa5d7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f40ce400 con 0x7fb0f41598b0 2024-09-13T17:08:23.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.248+0000 7fb0fa5d7700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f40724c0 con 0x7fb0f40cedc0 2024-09-13T17:08:23.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.248+0000 7fb0f8dd4700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb0f40cdfd0 0x7fb0f40ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39264/0 (socket says 172.21.15.123:39264) 2024-09-13T17:08:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.248+0000 7fb0f95d5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb0f41598b0 0x7fb0f4071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.248+0000 7fb0f8dd4700 1 -- 172.21.15.123:0/886200924 learned_addr learned my addr 172.21.15.123:0/886200924 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.248+0000 7fb0f9dd6700 1 --2- 172.21.15.123:0/886200924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0f40cedc0 0x7fb0f4159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0f95d5700 1 -- 172.21.15.123:0/886200924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0f40cedc0 msgr2=0x7fb0f4159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0f95d5700 1 --2- 172.21.15.123:0/886200924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0f40cedc0 0x7fb0f4159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0ebfff700 1 -- 172.21.15.123:0/886200924 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273970262 0 0) 0x7fb0f415d360 con 0x7fb0f40cdfd0 2024-09-13T17:08:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0f95d5700 1 -- 172.21.15.123:0/886200924 >> v1:172.21.15.123:6789/0 conn(0x7fb0f40cdfd0 legacy=0x7fb0f40ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0f95d5700 1 -- 172.21.15.123:0/886200924 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f415d5b0 con 0x7fb0f41598b0 2024-09-13T17:08:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0f95d5700 1 --2- 172.21.15.123:0/886200924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0f41598b0 0x7fb0f4071e60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009850 tx=0x7fb0f0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e560f6d8ec5c2326 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0ebfff700 1 -- 172.21.15.123:0/886200924 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0011830 con 0x7fb0f41598b0 2024-09-13T17:08:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0ebfff700 1 -- 172.21.15.123:0/886200924 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f0011990 con 0x7fb0f41598b0 2024-09-13T17:08:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0ebfff700 1 -- 172.21.15.123:0/886200924 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0011d40 con 0x7fb0f41598b0 2024-09-13T17:08:23.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/886200924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0f41598b0 msgr2=0x7fb0f4071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0fa5d7700 1 --2- 172.21.15.123:0/886200924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0f41598b0 0x7fb0f4071e60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009850 tx=0x7fb0f0009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/886200924 shutdown_connections 2024-09-13T17:08:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0fa5d7700 1 --2- 172.21.15.123:0/886200924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0f40cedc0 0x7fb0f4159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0fa5d7700 1 --2- 172.21.15.123:0/886200924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0f41598b0 0x7fb0f4071e60 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/886200924 >> 172.21.15.123:0/886200924 conn(0x7fb0f4066150 msgr2=0x7fb0f4066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/886200924 shutdown_connections 2024-09-13T17:08:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/886200924 wait complete. 2024-09-13T17:08:23.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.252+0000 7fb0fa5d7700 1 Processor -- start 2024-09-13T17:08:23.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0fa5d7700 1 -- start start 2024-09-13T17:08:23.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0fa5d7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0f40cdfd0 0x7fb0f4151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0fa5d7700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0f40cedc0 0x7fb0f4156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0fa5d7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0f41598b0 0x7fb0f40b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0fa5d7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f40afb70 con 0x7fb0f41598b0 2024-09-13T17:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0fa5d7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4151e80 con 0x7fb0f40cdfd0 2024-09-13T17:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0fa5d7700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4156ee0 con 0x7fb0f40cedc0 2024-09-13T17:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0f9dd6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0f41598b0 0x7fb0f40b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0f9dd6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0f41598b0 0x7fb0f40b08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46426/0 (socket says 172.21.15.123:46426) 2024-09-13T17:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0f9dd6700 1 -- 172.21.15.123:0/2999814777 learned_addr learned my addr 172.21.15.123:0/2999814777 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0f8dd4700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0f40cedc0 0x7fb0f4156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0f95d5700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0f40cdfd0 0x7fb0f4151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0f9dd6700 1 -- 172.21.15.123:0/2999814777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0f40cedc0 msgr2=0x7fb0f4156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0f9dd6700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0f40cedc0 0x7fb0f4156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0f9dd6700 1 -- 172.21.15.123:0/2999814777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0f40cdfd0 msgr2=0x7fb0f4151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0f9dd6700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0f40cdfd0 0x7fb0f4151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0f9dd6700 1 -- 172.21.15.123:0/2999814777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f00094b0 con 0x7fb0f41598b0 2024-09-13T17:08:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0f95d5700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0f40cdfd0 0x7fb0f4151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0f9dd6700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0f41598b0 0x7fb0f40b08a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec00e0c0 tx=0x7fb0ec00e480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0e9ffb700 1 -- 172.21.15.123:0/2999814777 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec00eb30 con 0x7fb0f41598b0 2024-09-13T17:08:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0e9ffb700 1 -- 172.21.15.123:0/2999814777 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec011040 con 0x7fb0f41598b0 2024-09-13T17:08:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/2999814777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f40afdc0 con 0x7fb0f41598b0 2024-09-13T17:08:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0e9ffb700 1 -- 172.21.15.123:0/2999814777 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec00eed0 con 0x7fb0f41598b0 2024-09-13T17:08:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.256+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/2999814777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f40b0380 con 0x7fb0f41598b0 2024-09-13T17:08:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.260+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/2999814777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f40677f0 con 0x7fb0f41598b0 2024-09-13T17:08:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.260+0000 7fb0e9ffb700 1 -- 172.21.15.123:0/2999814777 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0ec009540 con 0x7fb0f41598b0 2024-09-13T17:08:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.260+0000 7fb0e9ffb700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb0d8066730 0x7fb0d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.260+0000 7fb0e9ffb700 1 -- 172.21.15.123:0/2999814777 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0ec086ae0 con 0x7fb0f41598b0 2024-09-13T17:08:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.260+0000 7fb0f95d5700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb0d8066730 0x7fb0d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.260+0000 7fb0f95d5700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb0d8066730 0x7fb0d8068bf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00090b0 tx=0x7fb0f0008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:23.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.268+0000 7fb0e9ffb700 1 -- 172.21.15.123:0/2999814777 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb0ec053e60 con 0x7fb0f41598b0 2024-09-13T17:08:23.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.448+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/2999814777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0f4071e60 con 0x7fb0f41598b0 2024-09-13T17:08:23.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.448+0000 7fb0e9ffb700 1 -- 172.21.15.123:0/2999814777 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16561 (secure 0 0 0) 0x7fb0ec057480 con 0x7fb0f41598b0 2024-09-13T17:08:23.454 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:23.454 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":46,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:20.729309+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:18.071457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:18.723653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:23.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.452+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/2999814777 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb0d8066730 msgr2=0x7fb0d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.452+0000 7fb0fa5d7700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb0d8066730 0x7fb0d8068bf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00090b0 tx=0x7fb0f0008030 comp rx=0 tx=0).stop 2024-09-13T17:08:23.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.452+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/2999814777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0f41598b0 msgr2=0x7fb0f40b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.452+0000 7fb0fa5d7700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0f41598b0 0x7fb0f40b08a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec00e0c0 tx=0x7fb0ec00e480 comp rx=0 tx=0).stop 2024-09-13T17:08:23.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.452+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/2999814777 shutdown_connections 2024-09-13T17:08:23.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.452+0000 7fb0fa5d7700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb0d8066730 0x7fb0d8068bf0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.452+0000 7fb0fa5d7700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0f41598b0 0x7fb0f40b08a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.452+0000 7fb0fa5d7700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0f40cedc0 0x7fb0f4156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.452+0000 7fb0fa5d7700 1 --2- 172.21.15.123:0/2999814777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0f40cdfd0 0x7fb0f4151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.452+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/2999814777 >> 172.21.15.123:0/2999814777 conn(0x7fb0f4066150 msgr2=0x7fb0f415c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:23.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.452+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/2999814777 shutdown_connections 2024-09-13T17:08:23.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.452+0000 7fb0fa5d7700 1 -- 172.21.15.123:0/2999814777 wait complete. 2024-09-13T17:08:23.468 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:08:23.469 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:08:23.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad359e700 1 Processor -- start 2024-09-13T17:08:23.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad359e700 1 -- start start 2024-09-13T17:08:23.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad359e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1ad41598b0 0x7f1ad4071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1ad40cedc0 0x7f1ad4159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad359e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad415d360 con 0x7f1ad40cdfd0 2024-09-13T17:08:23.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad359e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad40ce400 con 0x7f1ad41598b0 2024-09-13T17:08:23.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad40724c0 con 0x7f1ad40cedc0 2024-09-13T17:08:23.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad1d9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1ad40cdfd0 0x7f1ad40ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39266/0 (socket says 172.21.15.123:39266) 2024-09-13T17:08:23.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad1d9b700 1 -- 172.21.15.123:0/3846965296 learned_addr learned my addr 172.21.15.123:0/3846965296 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad259c700 1 --2- 172.21.15.123:0/3846965296 >> v2:172.21.15.123:3300/0 conn(0x7f1ad41598b0 0x7f1ad4071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad2d9d700 1 --2- 172.21.15.123:0/3846965296 >> v2:172.21.15.153:3300/0 conn(0x7f1ad40cedc0 0x7f1ad4159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 -- 172.21.15.123:0/3846965296 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434384597 0 0) 0x7f1ad415d360 con 0x7f1ad40cdfd0 2024-09-13T17:08:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 -- 172.21.15.123:0/3846965296 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ac00035d0 con 0x7f1ad40cdfd0 2024-09-13T17:08:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 -- 172.21.15.123:0/3846965296 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3219177254 0 0) 0x7f1ac00035d0 con 0x7f1ad40cdfd0 2024-09-13T17:08:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 -- 172.21.15.123:0/3846965296 >> v2:172.21.15.153:3300/0 conn(0x7f1ad40cedc0 msgr2=0x7f1ad4159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 --2- 172.21.15.123:0/3846965296 >> v2:172.21.15.153:3300/0 conn(0x7f1ad40cedc0 0x7f1ad4159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 -- 172.21.15.123:0/3846965296 >> v2:172.21.15.123:3300/0 conn(0x7f1ad41598b0 msgr2=0x7f1ad4071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 --2- 172.21.15.123:0/3846965296 >> v2:172.21.15.123:3300/0 conn(0x7f1ad41598b0 0x7f1ad4071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 -- 172.21.15.123:0/3846965296 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad415d5b0 con 0x7f1ad40cdfd0 2024-09-13T17:08:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 -- 172.21.15.123:0/3846965296 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f1ac4001670 con 0x7f1ad40cdfd0 2024-09-13T17:08:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 -- 172.21.15.123:0/3846965296 >> v1:172.21.15.123:6789/0 conn(0x7f1ad40cdfd0 legacy=0x7f1ad40ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 --2- 172.21.15.123:0/3846965296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac0003a20 0x7f1ac0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 --2- 172.21.15.123:0/3846965296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ac0004870 0x7f1ac0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 --2- 172.21.15.123:0/3846965296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ac0005230 0x7f1ac000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 -- 172.21.15.123:0/3846965296 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40ce400 con 0x7f1ac0003a20 2024-09-13T17:08:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 -- 172.21.15.123:0/3846965296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40724c0 con 0x7f1ac0005230 2024-09-13T17:08:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 -- 172.21.15.123:0/3846965296 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac000bfc0 con 0x7f1ac0004870 2024-09-13T17:08:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad259c700 1 --2- 172.21.15.123:0/3846965296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac0003a20 0x7f1ac0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad1d9b700 1 --2- 172.21.15.123:0/3846965296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ac0004870 0x7f1ac0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad2d9d700 1 --2- 172.21.15.123:0/3846965296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ac0005230 0x7f1ac000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad259c700 1 -- 172.21.15.123:0/3846965296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ac0004870 msgr2=0x7f1ac0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad259c700 1 --2- 172.21.15.123:0/3846965296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ac0004870 0x7f1ac0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad259c700 1 -- 172.21.15.123:0/3846965296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ac0005230 msgr2=0x7f1ac000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad259c700 1 --2- 172.21.15.123:0/3846965296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ac0005230 0x7f1ac000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad2d9d700 1 -- 172.21.15.123:0/3846965296 reap_dead start 2024-09-13T17:08:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad259c700 1 -- 172.21.15.123:0/3846965296 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac00035d0 con 0x7f1ac0003a20 2024-09-13T17:08:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad259c700 1 --2- 172.21.15.123:0/3846965296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac0003a20 0x7f1ac0003e40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009b70 tx=0x7f1ac00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd77186755ef334 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 -- 172.21.15.123:0/3846965296 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00e6c0 con 0x7f1ac0003a20 2024-09-13T17:08:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 -- 172.21.15.123:0/3846965296 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc00e820 con 0x7f1ac0003a20 2024-09-13T17:08:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad159a700 1 -- 172.21.15.123:0/3846965296 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00eb90 con 0x7f1ac0003a20 2024-09-13T17:08:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad359e700 1 -- 172.21.15.123:0/3846965296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac0003a20 msgr2=0x7f1ac0003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.580+0000 7f1ad359e700 1 --2- 172.21.15.123:0/3846965296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac0003a20 0x7f1ac0003e40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009b70 tx=0x7f1ac00058a0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.584+0000 7f1ad359e700 1 -- 172.21.15.123:0/3846965296 shutdown_connections 2024-09-13T17:08:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.584+0000 7f1ad359e700 1 --2- 172.21.15.123:0/3846965296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac0003a20 0x7f1ac0003e40 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.584+0000 7f1ad359e700 1 -- 172.21.15.123:0/3846965296 >> 172.21.15.123:0/3846965296 conn(0x7f1ad4066150 msgr2=0x7f1ad4066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.584+0000 7f1ad359e700 1 -- 172.21.15.123:0/3846965296 shutdown_connections 2024-09-13T17:08:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.584+0000 7f1ad359e700 1 -- 172.21.15.123:0/3846965296 wait complete. 2024-09-13T17:08:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.584+0000 7f1ad359e700 1 Processor -- start 2024-09-13T17:08:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.584+0000 7f1ad359e700 1 -- start start 2024-09-13T17:08:23.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac0003a20 0x7f1ad40cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad359e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ad40ccda0 0x7f1ad40ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ad40ae760 0x7f1ad40aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad359e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40cd220 con 0x7f1ac0003a20 2024-09-13T17:08:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4152e40 con 0x7f1ad40ae760 2024-09-13T17:08:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad359e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4153120 con 0x7f1ad40ccda0 2024-09-13T17:08:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac0003a20 0x7f1ad40cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac0003a20 0x7f1ad40cc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46462/0 (socket says 172.21.15.123:46462) 2024-09-13T17:08:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad259c700 1 -- 172.21.15.123:0/3533754843 learned_addr learned my addr 172.21.15.123:0/3533754843 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad2d9d700 1 --2- 172.21.15.123:0/3533754843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ad40ae760 0x7f1ad40aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad1d9b700 1 --2- 172.21.15.123:0/3533754843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ad40ccda0 0x7f1ad40ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad259c700 1 -- 172.21.15.123:0/3533754843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ad40ccda0 msgr2=0x7f1ad40ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad259c700 1 --2- 172.21.15.123:0/3533754843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ad40ccda0 0x7f1ad40ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad259c700 1 -- 172.21.15.123:0/3533754843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ad40ae760 msgr2=0x7f1ad40aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad259c700 1 --2- 172.21.15.123:0/3533754843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ad40ae760 0x7f1ad40aebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad259c700 1 -- 172.21.15.123:0/3533754843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4153400 con 0x7f1ac0003a20 2024-09-13T17:08:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad259c700 1 --2- 172.21.15.123:0/3533754843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac0003a20 0x7f1ad40cc860 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00047c0 tx=0x7f1abc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1acaffd700 1 -- 172.21.15.123:0/3533754843 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00e6c0 con 0x7f1ac0003a20 2024-09-13T17:08:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1acaffd700 1 -- 172.21.15.123:0/3533754843 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc0038e0 con 0x7f1ac0003a20 2024-09-13T17:08:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad359e700 1 -- 172.21.15.123:0/3533754843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad41550c0 con 0x7f1ac0003a20 2024-09-13T17:08:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1acaffd700 1 -- 172.21.15.123:0/3533754843 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc003c90 con 0x7f1ac0003a20 2024-09-13T17:08:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad359e700 1 -- 172.21.15.123:0/3533754843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad41576b0 con 0x7f1ac0003a20 2024-09-13T17:08:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1ad359e700 1 -- 172.21.15.123:0/3533754843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad40677f0 con 0x7f1ac0003a20 2024-09-13T17:08:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.588+0000 7f1acaffd700 1 -- 172.21.15.123:0/3533754843 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1abc013470 con 0x7f1ac0003a20 2024-09-13T17:08:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.592+0000 7f1acaffd700 1 --2- 172.21.15.123:0/3533754843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1ab4066760 0x7f1ab4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.592+0000 7f1ad1d9b700 1 --2- 172.21.15.123:0/3533754843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1ab4066760 0x7f1ab4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.592+0000 7f1acaffd700 1 -- 172.21.15.123:0/3533754843 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1abc0855a0 con 0x7f1ac0003a20 2024-09-13T17:08:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.592+0000 7f1ad1d9b700 1 --2- 172.21.15.123:0/3533754843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1ab4066760 0x7f1ab4068c20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4000c00 tx=0x7f1ac40079a0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:23.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.596+0000 7f1acaffd700 1 -- 172.21.15.123:0/3533754843 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1abc052ac0 con 0x7f1ac0003a20 2024-09-13T17:08:23.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.764+0000 7f1ad359e700 1 -- 172.21.15.123:0/3533754843 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ad415db70 con 0x7f1ab4066760 2024-09-13T17:08:23.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.768+0000 7f1acaffd700 1 -- 172.21.15.123:0/3533754843 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287870 (secure 0 0 0) 0x7f1ac40070c0 con 0x7f1ab4066760 2024-09-13T17:08:23.778 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:23.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.776+0000 7f1ad359e700 1 -- 172.21.15.123:0/3533754843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1ab4066760 msgr2=0x7f1ab4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.776+0000 7f1ad359e700 1 --2- 172.21.15.123:0/3533754843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1ab4066760 0x7f1ab4068c20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4000c00 tx=0x7f1ac40079a0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.776+0000 7f1ad359e700 1 -- 172.21.15.123:0/3533754843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac0003a20 msgr2=0x7f1ad40cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.776+0000 7f1ad359e700 1 --2- 172.21.15.123:0/3533754843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac0003a20 0x7f1ad40cc860 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00047c0 tx=0x7f1abc0047e0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.776+0000 7f1ad359e700 1 -- 172.21.15.123:0/3533754843 shutdown_connections 2024-09-13T17:08:23.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.776+0000 7f1ad359e700 1 --2- 172.21.15.123:0/3533754843 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1ab4066760 0x7f1ab4068c20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.776+0000 7f1ad359e700 1 --2- 172.21.15.123:0/3533754843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ad40ae760 0x7f1ad40aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.776+0000 7f1ad359e700 1 --2- 172.21.15.123:0/3533754843 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ad40ccda0 0x7f1ad40ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.776+0000 7f1ad359e700 1 --2- 172.21.15.123:0/3533754843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ac0003a20 0x7f1ad40cc860 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.776+0000 7f1ad359e700 1 -- 172.21.15.123:0/3533754843 >> 172.21.15.123:0/3533754843 conn(0x7f1ad4066150 msgr2=0x7f1ad40b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:23.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.776+0000 7f1ad359e700 1 -- 172.21.15.123:0/3533754843 shutdown_connections 2024-09-13T17:08:23.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.776+0000 7f1ad359e700 1 -- 172.21.15.123:0/3533754843 wait complete. 2024-09-13T17:08:23.782 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:08:23.792 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-09-13T17:08:22.764803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221592,"kb_used_data":5412,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753128,"statfs":{"total":773094113280,"available":772867203072,"internally_reserved":0,"allocated":5541888,"data_stored":2929712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.426989"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746445+0000","last_change":"2024-09-13T17:08:19.750134+0000","last_active":"2024-09-13T17:08:20.746445+0000","last_peered":"2024-09-13T17:08:20.746445+0000","last_clean":"2024-09-13T17:08:20.746445+0000","last_became_active":"2024-09-13T17:08:19.749847+0000","last_became_peered":"2024-09-13T17:08:19.749847+0000","last_unstale":"2024-09-13T17:08:20.746445+0000","last_undegraded":"2024-09-13T17:08:20.746445+0000","last_fullsized":"2024-09-13T17:08:20.746445+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:07.632746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536069+0000","last_change":"2024-09-13T17:08:19.744872+0000","last_active":"2024-09-13T17:08:21.536069+0000","last_peered":"2024-09-13T17:08:21.536069+0000","last_clean":"2024-09-13T17:08:21.536069+0000","last_became_active":"2024-09-13T17:08:19.744443+0000","last_became_peered":"2024-09-13T17:08:19.744443+0000","last_unstale":"2024-09-13T17:08:21.536069+0000","last_undegraded":"2024-09-13T17:08:21.536069+0000","last_fullsized":"2024-09-13T17:08:21.536069+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:38.834515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745221+0000","last_change":"2024-09-13T17:08:19.751307+0000","last_active":"2024-09-13T17:08:20.745221+0000","last_peered":"2024-09-13T17:08:20.745221+0000","last_clean":"2024-09-13T17:08:20.745221+0000","last_became_active":"2024-09-13T17:08:19.751004+0000","last_became_peered":"2024-09-13T17:08:19.751004+0000","last_unstale":"2024-09-13T17:08:20.745221+0000","last_undegraded":"2024-09-13T17:08:20.745221+0000","last_fullsized":"2024-09-13T17:08:20.745221+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:45.171781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536946+0000","last_change":"2024-09-13T17:08:19.758425+0000","last_active":"2024-09-13T17:08:21.536946+0000","last_peered":"2024-09-13T17:08:21.536946+0000","last_clean":"2024-09-13T17:08:21.536946+0000","last_became_active":"2024-09-13T17:08:19.758156+0000","last_became_peered":"2024-09-13T17:08:19.758156+0000","last_unstale":"2024-09-13T17:08:21.536946+0000","last_undegraded":"2024-09-13T17:08:21.536946+0000","last_fullsized":"2024-09-13T17:08:21.536946+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:23.441619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535650+0000","last_change":"2024-09-13T17:08:19.748878+0000","last_active":"2024-09-13T17:08:21.535650+0000","last_peered":"2024-09-13T17:08:21.535650+0000","last_clean":"2024-09-13T17:08:21.535650+0000","last_became_active":"2024-09-13T17:08:19.748516+0000","last_became_peered":"2024-09-13T17:08:19.748516+0000","last_unstale":"2024-09-13T17:08:21.535650+0000","last_undegraded":"2024-09-13T17:08:21.535650+0000","last_fullsized":"2024-09-13T17:08:21.535650+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:51.490945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741775+0000","last_change":"2024-09-13T17:08:19.742878+0000","last_active":"2024-09-13T17:08:20.741775+0000","last_peered":"2024-09-13T17:08:20.741775+0000","last_clean":"2024-09-13T17:08:20.741775+0000","last_became_active":"2024-09-13T17:08:19.742606+0000","last_became_peered":"2024-09-13T17:08:19.742606+0000","last_unstale":"2024-09-13T17:08:20.741775+0000","last_undegraded":"2024-09-13T17:08:20.741775+0000","last_fullsized":"2024-09-13T17:08:20.741775+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:47.103390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746498+0000","last_change":"2024-09-13T17:08:19.753334+0000","last_active":"2024-09-13T17:08:20.746498+0000","last_peered":"2024-09-13T17:08:20.746498+0000","last_clean":"2024-09-13T17:08:20.746498+0000","last_became_active":"2024-09-13T17:08:19.753043+0000","last_became_peered":"2024-09-13T17:08:19.753043+0000","last_unstale":"2024-09-13T17:08:20.746498+0000","last_undegraded":"2024-09-13T17:08:20.746498+0000","last_fullsized":"2024-09-13T17:08:20.746498+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:02.147509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535966+0000","last_change":"2024-09-13T17:08:19.763443+0000","last_active":"2024-09-13T17:08:21.535966+0000","last_peered":"2024-09-13T17:08:21.535966+0000","last_clean":"2024-09-13T17:08:21.535966+0000","last_became_active":"2024-09-13T17:08:19.761173+0000","last_became_peered":"2024-09-13T17:08:19.761173+0000","last_unstale":"2024-09-13T17:08:21.535966+0000","last_undegraded":"2024-09-13T17:08:21.535966+0000","last_fullsized":"2024-09-13T17:08:21.535966+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:24.955493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536781+0000","last_change":"2024-09-13T17:08:19.752152+0000","last_active":"2024-09-13T17:08:21.536781+0000","last_peered":"2024-09-13T17:08:21.536781+0000","last_clean":"2024-09-13T17:08:21.536781+0000","last_became_active":"2024-09-13T17:08:19.751845+0000","last_became_peered":"2024-09-13T17:08:19.751845+0000","last_unstale":"2024-09-13T17:08:21.536781+0000","last_undegraded":"2024-09-13T17:08:21.536781+0000","last_fullsized":"2024-09-13T17:08:21.536781+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:12.551648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537100+0000","last_change":"2024-09-13T17:08:19.758489+0000","last_active":"2024-09-13T17:08:21.537100+0000","last_peered":"2024-09-13T17:08:21.537100+0000","last_clean":"2024-09-13T17:08:21.537100+0000","last_became_active":"2024-09-13T17:08:19.758236+0000","last_became_peered":"2024-09-13T17:08:19.758236+0000","last_unstale":"2024-09-13T17:08:21.537100+0000","last_undegraded":"2024-09-13T17:08:21.537100+0000","last_fullsized":"2024-09-13T17:08:21.537100+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:07.632746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536854+0000","last_change":"2024-09-13T17:08:19.757371+0000","last_active":"2024-09-13T17:08:21.536854+0000","last_peered":"2024-09-13T17:08:21.536854+0000","last_clean":"2024-09-13T17:08:21.536854+0000","last_became_active":"2024-09-13T17:08:19.756102+0000","last_became_peered":"2024-09-13T17:08:19.756102+0000","last_unstale":"2024-09-13T17:08:21.536854+0000","last_undegraded":"2024-09-13T17:08:21.536854+0000","last_fullsized":"2024-09-13T17:08:21.536854+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:28.681581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535645+0000","last_change":"2024-09-13T17:08:19.752232+0000","last_active":"2024-09-13T17:08:21.535645+0000","last_peered":"2024-09-13T17:08:21.535645+0000","last_clean":"2024-09-13T17:08:21.535645+0000","last_became_active":"2024-09-13T17:08:19.751987+0000","last_became_peered":"2024-09-13T17:08:19.751987+0000","last_unstale":"2024-09-13T17:08:21.535645+0000","last_undegraded":"2024-09-13T17:08:21.535645+0000","last_fullsized":"2024-09-13T17:08:21.535645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:34.642224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537853+0000","last_change":"2024-09-13T17:08:19.766875+0000","last_active":"2024-09-13T17:08:21.537853+0000","last_peered":"2024-09-13T17:08:21.537853+0000","last_clean":"2024-09-13T17:08:21.537853+0000","last_became_active":"2024-09-13T17:08:19.766600+0000","last_became_peered":"2024-09-13T17:08:19.766600+0000","last_unstale":"2024-09-13T17:08:21.537853+0000","last_undegraded":"2024-09-13T17:08:21.537853+0000","last_fullsized":"2024-09-13T17:08:21.537853+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:04.292550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536390+0000","last_change":"2024-09-13T17:08:19.756087+0000","last_active":"2024-09-13T17:08:21.536390+0000","last_peered":"2024-09-13T17:08:21.536390+0000","last_clean":"2024-09-13T17:08:21.536390+0000","last_became_active":"2024-09-13T17:08:19.755830+0000","last_became_peered":"2024-09-13T17:08:19.755830+0000","last_unstale":"2024-09-13T17:08:21.536390+0000","last_undegraded":"2024-09-13T17:08:21.536390+0000","last_fullsized":"2024-09-13T17:08:21.536390+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:45.675880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741667+0000","last_change":"2024-09-13T17:08:19.762743+0000","last_active":"2024-09-13T17:08:20.741667+0000","last_peered":"2024-09-13T17:08:20.741667+0000","last_clean":"2024-09-13T17:08:20.741667+0000","last_became_active":"2024-09-13T17:08:19.760662+0000","last_became_peered":"2024-09-13T17:08:19.760662+0000","last_unstale":"2024-09-13T17:08:20.741667+0000","last_undegraded":"2024-09-13T17:08:20.741667+0000","last_fullsized":"2024-09-13T17:08:20.741667+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:06.769269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946046+0000","last_change":"2024-09-13T17:08:19.757666+0000","last_active":"2024-09-13T17:08:20.946046+0000","last_peered":"2024-09-13T17:08:20.946046+0000","last_clean":"2024-09-13T17:08:20.946046+0000","last_became_active":"2024-09-13T17:08:19.757408+0000","last_became_peered":"2024-09-13T17:08:19.757408+0000","last_unstale":"2024-09-13T17:08:20.946046+0000","last_undegraded":"2024-09-13T17:08:20.946046+0000","last_fullsized":"2024-09-13T17:08:20.946046+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:09.521099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745294+0000","last_change":"2024-09-13T17:08:19.756094+0000","last_active":"2024-09-13T17:08:20.745294+0000","last_peered":"2024-09-13T17:08:20.745294+0000","last_clean":"2024-09-13T17:08:20.745294+0000","last_became_active":"2024-09-13T17:08:19.755822+0000","last_became_peered":"2024-09-13T17:08:19.755822+0000","last_unstale":"2024-09-13T17:08:20.745294+0000","last_undegraded":"2024-09-13T17:08:20.745294+0000","last_fullsized":"2024-09-13T17:08:20.745294+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:28.681581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745252+0000","last_change":"2024-09-13T17:08:19.751817+0000","last_active":"2024-09-13T17:08:20.745252+0000","last_peered":"2024-09-13T17:08:20.745252+0000","last_clean":"2024-09-13T17:08:20.745252+0000","last_became_active":"2024-09-13T17:08:19.751206+0000","last_became_peered":"2024-09-13T17:08:19.751206+0000","last_unstale":"2024-09-13T17:08:20.745252+0000","last_undegraded":"2024-09-13T17:08:20.745252+0000","last_fullsized":"2024-09-13T17:08:20.745252+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:12.551648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946899+0000","last_change":"2024-09-13T17:08:19.757121+0000","last_active":"2024-09-13T17:08:20.946899+0000","last_peered":"2024-09-13T17:08:20.946899+0000","last_clean":"2024-09-13T17:08:20.946899+0000","last_became_active":"2024-09-13T17:08:19.754904+0000","last_became_peered":"2024-09-13T17:08:19.754904+0000","last_unstale":"2024-09-13T17:08:20.946899+0000","last_undegraded":"2024-09-13T17:08:20.946899+0000","last_fullsized":"2024-09-13T17:08:20.946899+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:26.596259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.538229+0000","last_change":"2024-09-13T17:08:19.751231+0000","last_active":"2024-09-13T17:08:21.538229+0000","last_peered":"2024-09-13T17:08:21.538229+0000","last_clean":"2024-09-13T17:08:21.538229+0000","last_became_active":"2024-09-13T17:08:19.750958+0000","last_became_peered":"2024-09-13T17:08:19.750958+0000","last_unstale":"2024-09-13T17:08:21.538229+0000","last_undegraded":"2024-09-13T17:08:21.538229+0000","last_fullsized":"2024-09-13T17:08:21.538229+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:20.850522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741735+0000","last_change":"2024-09-13T17:08:19.762249+0000","last_active":"2024-09-13T17:08:20.741735+0000","last_peered":"2024-09-13T17:08:20.741735+0000","last_clean":"2024-09-13T17:08:20.741735+0000","last_became_active":"2024-09-13T17:08:19.760654+0000","last_became_peered":"2024-09-13T17:08:19.760654+0000","last_unstale":"2024-09-13T17:08:20.741735+0000","last_undegraded":"2024-09-13T17:08:20.741735+0000","last_fullsized":"2024-09-13T17:08:20.741735+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:07.632746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536445+0000","last_change":"2024-09-13T17:08:19.758681+0000","last_active":"2024-09-13T17:08:21.536445+0000","last_peered":"2024-09-13T17:08:21.536445+0000","last_clean":"2024-09-13T17:08:21.536445+0000","last_became_active":"2024-09-13T17:08:19.758401+0000","last_became_peered":"2024-09-13T17:08:19.758401+0000","last_unstale":"2024-09-13T17:08:21.536445+0000","last_undegraded":"2024-09-13T17:08:21.536445+0000","last_fullsized":"2024-09-13T17:08:21.536445+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:45.783700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946204+0000","last_change":"2024-09-13T17:08:19.757257+0000","last_active":"2024-09-13T17:08:20.946204+0000","last_peered":"2024-09-13T17:08:20.946204+0000","last_clean":"2024-09-13T17:08:20.946204+0000","last_became_active":"2024-09-13T17:08:19.756977+0000","last_became_peered":"2024-09-13T17:08:19.756977+0000","last_unstale":"2024-09-13T17:08:20.946204+0000","last_undegraded":"2024-09-13T17:08:20.946204+0000","last_fullsized":"2024-09-13T17:08:20.946204+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:00.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946052+0000","last_change":"2024-09-13T17:08:19.757689+0000","last_active":"2024-09-13T17:08:20.946052+0000","last_peered":"2024-09-13T17:08:20.946052+0000","last_clean":"2024-09-13T17:08:20.946052+0000","last_became_active":"2024-09-13T17:08:19.757351+0000","last_became_peered":"2024-09-13T17:08:19.757351+0000","last_unstale":"2024-09-13T17:08:20.946052+0000","last_undegraded":"2024-09-13T17:08:20.946052+0000","last_fullsized":"2024-09-13T17:08:20.946052+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:39.268277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.947033+0000","last_change":"2024-09-13T17:08:19.760768+0000","last_active":"2024-09-13T17:08:20.947033+0000","last_peered":"2024-09-13T17:08:20.947033+0000","last_clean":"2024-09-13T17:08:20.947033+0000","last_became_active":"2024-09-13T17:08:19.760014+0000","last_became_peered":"2024-09-13T17:08:19.760014+0000","last_unstale":"2024-09-13T17:08:20.947033+0000","last_undegraded":"2024-09-13T17:08:20.947033+0000","last_fullsized":"2024-09-13T17:08:20.947033+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:13.643325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.538752+0000","last_change":"2024-09-13T17:08:19.766907+0000","last_active":"2024-09-13T17:08:21.538752+0000","last_peered":"2024-09-13T17:08:21.538752+0000","last_clean":"2024-09-13T17:08:21.538752+0000","last_became_active":"2024-09-13T17:08:19.766592+0000","last_became_peered":"2024-09-13T17:08:19.766592+0000","last_unstale":"2024-09-13T17:08:21.538752+0000","last_undegraded":"2024-09-13T17:08:21.538752+0000","last_fullsized":"2024-09-13T17:08:21.538752+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:39.268277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745062+0000","last_change":"2024-09-13T17:08:19.756054+0000","last_active":"2024-09-13T17:08:20.745062+0000","last_peered":"2024-09-13T17:08:20.745062+0000","last_clean":"2024-09-13T17:08:20.745062+0000","last_became_active":"2024-09-13T17:08:19.755796+0000","last_became_peered":"2024-09-13T17:08:19.755796+0000","last_unstale":"2024-09-13T17:08:20.745062+0000","last_undegraded":"2024-09-13T17:08:20.745062+0000","last_fullsized":"2024-09-13T17:08:20.745062+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:51.490945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535811+0000","last_change":"2024-09-13T17:08:19.752123+0000","last_active":"2024-09-13T17:08:21.535811+0000","last_peered":"2024-09-13T17:08:21.535811+0000","last_clean":"2024-09-13T17:08:21.535811+0000","last_became_active":"2024-09-13T17:08:19.751639+0000","last_became_peered":"2024-09-13T17:08:19.751639+0000","last_unstale":"2024-09-13T17:08:21.535811+0000","last_undegraded":"2024-09-13T17:08:21.535811+0000","last_fullsized":"2024-09-13T17:08:21.535811+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:28.681581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946182+0000","last_change":"2024-09-13T17:08:19.755184+0000","last_active":"2024-09-13T17:08:20.946182+0000","last_peered":"2024-09-13T17:08:20.946182+0000","last_clean":"2024-09-13T17:08:20.946182+0000","last_became_active":"2024-09-13T17:08:19.754879+0000","last_became_peered":"2024-09-13T17:08:19.754879+0000","last_unstale":"2024-09-13T17:08:20.946182+0000","last_undegraded":"2024-09-13T17:08:20.946182+0000","last_fullsized":"2024-09-13T17:08:20.946182+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:00.459717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.744693+0000","last_change":"2024-09-13T17:08:19.755408+0000","last_active":"2024-09-13T17:08:20.744693+0000","last_peered":"2024-09-13T17:08:20.744693+0000","last_clean":"2024-09-13T17:08:20.744693+0000","last_became_active":"2024-09-13T17:08:19.752846+0000","last_became_peered":"2024-09-13T17:08:19.752846+0000","last_unstale":"2024-09-13T17:08:20.744693+0000","last_undegraded":"2024-09-13T17:08:20.744693+0000","last_fullsized":"2024-09-13T17:08:20.744693+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:07.449197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741628+0000","last_change":"2024-09-13T17:08:19.742587+0000","last_active":"2024-09-13T17:08:20.741628+0000","last_peered":"2024-09-13T17:08:20.741628+0000","last_clean":"2024-09-13T17:08:20.741628+0000","last_became_active":"2024-09-13T17:08:19.742343+0000","last_became_peered":"2024-09-13T17:08:19.742343+0000","last_unstale":"2024-09-13T17:08:20.741628+0000","last_undegraded":"2024-09-13T17:08:20.741628+0000","last_fullsized":"2024-09-13T17:08:20.741628+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:44.887122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537267+0000","last_change":"2024-09-13T17:08:19.753523+0000","last_active":"2024-09-13T17:08:21.537267+0000","last_peered":"2024-09-13T17:08:21.537267+0000","last_clean":"2024-09-13T17:08:21.537267+0000","last_became_active":"2024-09-13T17:08:19.753287+0000","last_became_peered":"2024-09-13T17:08:19.753287+0000","last_unstale":"2024-09-13T17:08:21.537267+0000","last_undegraded":"2024-09-13T17:08:21.537267+0000","last_fullsized":"2024-09-13T17:08:21.537267+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:13.851391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.326108+0000","last_change":"2024-09-13T17:08:19.766788+0000","last_active":"2024-09-13T17:08:21.326108+0000","last_peered":"2024-09-13T17:08:21.326108+0000","last_clean":"2024-09-13T17:08:21.326108+0000","last_became_active":"2024-09-13T17:08:19.766448+0000","last_became_peered":"2024-09-13T17:08:19.766448+0000","last_unstale":"2024-09-13T17:08:21.326108+0000","last_undegraded":"2024-09-13T17:08:21.326108+0000","last_fullsized":"2024-09-13T17:08:21.326108+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:38.834515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.742663+0000","last_change":"2024-09-13T17:08:19.364081+0000","last_active":"2024-09-13T17:08:20.742663+0000","last_peered":"2024-09-13T17:08:20.742663+0000","last_clean":"2024-09-13T17:08:20.742663+0000","last_became_active":"2024-09-13T17:08:19.360321+0000","last_became_peered":"2024-09-13T17:08:19.360321+0000","last_unstale":"2024-09-13T17:08:20.742663+0000","last_undegraded":"2024-09-13T17:08:20.742663+0000","last_fullsized":"2024-09-13T17:08:20.742663+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:00.945310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946810+0000","last_change":"2024-09-13T17:08:19.760961+0000","last_active":"2024-09-13T17:08:20.946810+0000","last_peered":"2024-09-13T17:08:20.946810+0000","last_clean":"2024-09-13T17:08:20.946810+0000","last_became_active":"2024-09-13T17:08:19.760159+0000","last_became_peered":"2024-09-13T17:08:19.760159+0000","last_unstale":"2024-09-13T17:08:20.946810+0000","last_undegraded":"2024-09-13T17:08:20.946810+0000","last_fullsized":"2024-09-13T17:08:20.946810+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:54.904018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745489+0000","last_change":"2024-09-13T17:08:19.357667+0000","last_active":"2024-09-13T17:08:20.745489+0000","last_peered":"2024-09-13T17:08:20.745489+0000","last_clean":"2024-09-13T17:08:20.745489+0000","last_became_active":"2024-09-13T17:08:19.357403+0000","last_became_peered":"2024-09-13T17:08:19.357403+0000","last_unstale":"2024-09-13T17:08:20.745489+0000","last_undegraded":"2024-09-13T17:08:20.745489+0000","last_fullsized":"2024-09-13T17:08:20.745489+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:39.426570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535806+0000","last_change":"2024-09-13T17:08:19.745209+0000","last_active":"2024-09-13T17:08:21.535806+0000","last_peered":"2024-09-13T17:08:21.535806+0000","last_clean":"2024-09-13T17:08:21.535806+0000","last_became_active":"2024-09-13T17:08:19.744870+0000","last_became_peered":"2024-09-13T17:08:19.744870+0000","last_unstale":"2024-09-13T17:08:21.535806+0000","last_undegraded":"2024-09-13T17:08:21.535806+0000","last_fullsized":"2024-09-13T17:08:21.535806+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:21.431579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.326214+0000","last_change":"2024-09-13T17:08:19.365328+0000","last_active":"2024-09-13T17:08:21.326214+0000","last_peered":"2024-09-13T17:08:21.326214+0000","last_clean":"2024-09-13T17:08:21.326214+0000","last_became_active":"2024-09-13T17:08:19.365080+0000","last_became_peered":"2024-09-13T17:08:19.365080+0000","last_unstale":"2024-09-13T17:08:21.326214+0000","last_undegraded":"2024-09-13T17:08:21.326214+0000","last_fullsized":"2024-09-13T17:08:21.326214+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:53.900550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.326097+0000","last_change":"2024-09-13T17:08:19.761311+0000","last_active":"2024-09-13T17:08:21.326097+0000","last_peered":"2024-09-13T17:08:21.326097+0000","last_clean":"2024-09-13T17:08:21.326097+0000","last_became_active":"2024-09-13T17:08:19.761044+0000","last_became_peered":"2024-09-13T17:08:19.761044+0000","last_unstale":"2024-09-13T17:08:21.326097+0000","last_undegraded":"2024-09-13T17:08:21.326097+0000","last_fullsized":"2024-09-13T17:08:21.326097+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:07.449197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746508+0000","last_change":"2024-09-13T17:08:19.365417+0000","last_active":"2024-09-13T17:08:20.746508+0000","last_peered":"2024-09-13T17:08:20.746508+0000","last_clean":"2024-09-13T17:08:20.746508+0000","last_became_active":"2024-09-13T17:08:19.365021+0000","last_became_peered":"2024-09-13T17:08:19.365021+0000","last_unstale":"2024-09-13T17:08:20.746508+0000","last_undegraded":"2024-09-13T17:08:20.746508+0000","last_fullsized":"2024-09-13T17:08:20.746508+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:25.592791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.744987+0000","last_change":"2024-09-13T17:08:19.761256+0000","last_active":"2024-09-13T17:08:20.744987+0000","last_peered":"2024-09-13T17:08:20.744987+0000","last_clean":"2024-09-13T17:08:20.744987+0000","last_became_active":"2024-09-13T17:08:19.760999+0000","last_became_peered":"2024-09-13T17:08:19.760999+0000","last_unstale":"2024-09-13T17:08:20.744987+0000","last_undegraded":"2024-09-13T17:08:20.744987+0000","last_fullsized":"2024-09-13T17:08:20.744987+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:38.834515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741928+0000","last_change":"2024-09-13T17:08:19.365531+0000","last_active":"2024-09-13T17:08:20.741928+0000","last_peered":"2024-09-13T17:08:20.741928+0000","last_clean":"2024-09-13T17:08:20.741928+0000","last_became_active":"2024-09-13T17:08:19.363998+0000","last_became_peered":"2024-09-13T17:08:19.363998+0000","last_unstale":"2024-09-13T17:08:20.741928+0000","last_undegraded":"2024-09-13T17:08:20.741928+0000","last_fullsized":"2024-09-13T17:08:20.741928+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:10.099555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537002+0000","last_change":"2024-09-13T17:08:19.752027+0000","last_active":"2024-09-13T17:08:21.537002+0000","last_peered":"2024-09-13T17:08:21.537002+0000","last_clean":"2024-09-13T17:08:21.537002+0000","last_became_active":"2024-09-13T17:08:19.751523+0000","last_became_peered":"2024-09-13T17:08:19.751523+0000","last_unstale":"2024-09-13T17:08:21.537002+0000","last_undegraded":"2024-09-13T17:08:21.537002+0000","last_fullsized":"2024-09-13T17:08:21.537002+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:21.431579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745132+0000","last_change":"2024-09-13T17:08:19.364421+0000","last_active":"2024-09-13T17:08:20.745132+0000","last_peered":"2024-09-13T17:08:20.745132+0000","last_clean":"2024-09-13T17:08:20.745132+0000","last_became_active":"2024-09-13T17:08:19.364112+0000","last_became_peered":"2024-09-13T17:08:19.364112+0000","last_unstale":"2024-09-13T17:08:20.745132+0000","last_undegraded":"2024-09-13T17:08:20.745132+0000","last_fullsized":"2024-09-13T17:08:20.745132+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:10.840044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536072+0000","last_change":"2024-09-13T17:08:19.763783+0000","last_active":"2024-09-13T17:08:21.536072+0000","last_peered":"2024-09-13T17:08:21.536072+0000","last_clean":"2024-09-13T17:08:21.536072+0000","last_became_active":"2024-09-13T17:08:19.763434+0000","last_became_peered":"2024-09-13T17:08:19.763434+0000","last_unstale":"2024-09-13T17:08:21.536072+0000","last_undegraded":"2024-09-13T17:08:21.536072+0000","last_fullsized":"2024-09-13T17:08:21.536072+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:02.147509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535364+0000","last_change":"2024-09-13T17:08:19.367636+0000","last_active":"2024-09-13T17:08:21.535364+0000","last_peered":"2024-09-13T17:08:21.535364+0000","last_clean":"2024-09-13T17:08:21.535364+0000","last_became_active":"2024-09-13T17:08:19.367292+0000","last_became_peered":"2024-09-13T17:08:19.367292+0000","last_unstale":"2024-09-13T17:08:21.535364+0000","last_undegraded":"2024-09-13T17:08:21.535364+0000","last_fullsized":"2024-09-13T17:08:21.535364+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:59.456249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946010+0000","last_change":"2024-09-13T17:08:19.756701+0000","last_active":"2024-09-13T17:08:20.946010+0000","last_peered":"2024-09-13T17:08:20.946010+0000","last_clean":"2024-09-13T17:08:20.946010+0000","last_became_active":"2024-09-13T17:08:19.755062+0000","last_became_peered":"2024-09-13T17:08:19.755062+0000","last_unstale":"2024-09-13T17:08:20.946010+0000","last_undegraded":"2024-09-13T17:08:20.946010+0000","last_fullsized":"2024-09-13T17:08:20.946010+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:55.729072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536701+0000","last_change":"2024-09-13T17:08:19.362103+0000","last_active":"2024-09-13T17:08:21.536701+0000","last_peered":"2024-09-13T17:08:21.536701+0000","last_clean":"2024-09-13T17:08:21.536701+0000","last_became_active":"2024-09-13T17:08:19.361850+0000","last_became_peered":"2024-09-13T17:08:19.361850+0000","last_unstale":"2024-09-13T17:08:21.536701+0000","last_undegraded":"2024-09-13T17:08:21.536701+0000","last_fullsized":"2024-09-13T17:08:21.536701+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.289082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745346+0000","last_change":"2024-09-13T17:08:19.751991+0000","last_active":"2024-09-13T17:08:20.745346+0000","last_peered":"2024-09-13T17:08:20.745346+0000","last_clean":"2024-09-13T17:08:20.745346+0000","last_became_active":"2024-09-13T17:08:19.751472+0000","last_became_peered":"2024-09-13T17:08:19.751472+0000","last_unstale":"2024-09-13T17:08:20.745346+0000","last_undegraded":"2024-09-13T17:08:20.745346+0000","last_fullsized":"2024-09-13T17:08:20.745346+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:40.150544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745507+0000","last_change":"2024-09-13T17:08:19.365047+0000","last_active":"2024-09-13T17:08:20.745507+0000","last_peered":"2024-09-13T17:08:20.745507+0000","last_clean":"2024-09-13T17:08:20.745507+0000","last_became_active":"2024-09-13T17:08:19.364729+0000","last_became_peered":"2024-09-13T17:08:19.364729+0000","last_unstale":"2024-09-13T17:08:20.745507+0000","last_undegraded":"2024-09-13T17:08:20.745507+0000","last_fullsized":"2024-09-13T17:08:20.745507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.289082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746632+0000","last_change":"2024-09-13T17:08:19.743693+0000","last_active":"2024-09-13T17:08:20.746632+0000","last_peered":"2024-09-13T17:08:20.746632+0000","last_clean":"2024-09-13T17:08:20.746632+0000","last_became_active":"2024-09-13T17:08:19.743419+0000","last_became_peered":"2024-09-13T17:08:19.743419+0000","last_unstale":"2024-09-13T17:08:20.746632+0000","last_undegraded":"2024-09-13T17:08:20.746632+0000","last_fullsized":"2024-09-13T17:08:20.746632+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:47.103390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537217+0000","last_change":"2024-09-13T17:08:19.360802+0000","last_active":"2024-09-13T17:08:21.537217+0000","last_peered":"2024-09-13T17:08:21.537217+0000","last_clean":"2024-09-13T17:08:21.537217+0000","last_became_active":"2024-09-13T17:08:19.360356+0000","last_became_peered":"2024-09-13T17:08:19.360356+0000","last_unstale":"2024-09-13T17:08:21.537217+0000","last_undegraded":"2024-09-13T17:08:21.537217+0000","last_fullsized":"2024-09-13T17:08:21.537217+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:52.341051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.742249+0000","last_change":"2024-09-13T17:08:19.762850+0000","last_active":"2024-09-13T17:08:20.742249+0000","last_peered":"2024-09-13T17:08:20.742249+0000","last_clean":"2024-09-13T17:08:20.742249+0000","last_became_active":"2024-09-13T17:08:19.762591+0000","last_became_peered":"2024-09-13T17:08:19.762591+0000","last_unstale":"2024-09-13T17:08:20.742249+0000","last_undegraded":"2024-09-13T17:08:20.742249+0000","last_fullsized":"2024-09-13T17:08:20.742249+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:02.147509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746580+0000","last_change":"2024-09-13T17:08:19.361219+0000","last_active":"2024-09-13T17:08:20.746580+0000","last_peered":"2024-09-13T17:08:20.746580+0000","last_clean":"2024-09-13T17:08:20.746580+0000","last_became_active":"2024-09-13T17:08:19.360790+0000","last_became_peered":"2024-09-13T17:08:19.360790+0000","last_unstale":"2024-09-13T17:08:20.746580+0000","last_undegraded":"2024-09-13T17:08:20.746580+0000","last_fullsized":"2024-09-13T17:08:20.746580+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:11.548180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746276+0000","last_change":"2024-09-13T17:08:19.754796+0000","last_active":"2024-09-13T17:08:20.746276+0000","last_peered":"2024-09-13T17:08:20.746276+0000","last_clean":"2024-09-13T17:08:20.746276+0000","last_became_active":"2024-09-13T17:08:19.754554+0000","last_became_peered":"2024-09-13T17:08:19.754554+0000","last_unstale":"2024-09-13T17:08:20.746276+0000","last_undegraded":"2024-09-13T17:08:20.746276+0000","last_fullsized":"2024-09-13T17:08:20.746276+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:24.955493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.538335+0000","last_change":"2024-09-13T17:08:19.362750+0000","last_active":"2024-09-13T17:08:21.538335+0000","last_peered":"2024-09-13T17:08:21.538335+0000","last_clean":"2024-09-13T17:08:21.538335+0000","last_became_active":"2024-09-13T17:08:19.362430+0000","last_became_peered":"2024-09-13T17:08:19.362430+0000","last_unstale":"2024-09-13T17:08:21.538335+0000","last_undegraded":"2024-09-13T17:08:21.538335+0000","last_fullsized":"2024-09-13T17:08:21.538335+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:06.864218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946452+0000","last_change":"2024-09-13T17:08:19.756888+0000","last_active":"2024-09-13T17:08:20.946452+0000","last_peered":"2024-09-13T17:08:20.946452+0000","last_clean":"2024-09-13T17:08:20.946452+0000","last_became_active":"2024-09-13T17:08:19.754775+0000","last_became_peered":"2024-09-13T17:08:19.754775+0000","last_unstale":"2024-09-13T17:08:20.946452+0000","last_undegraded":"2024-09-13T17:08:20.946452+0000","last_fullsized":"2024-09-13T17:08:20.946452+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:11.103022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.742042+0000","last_change":"2024-09-13T17:08:19.365401+0000","last_active":"2024-09-13T17:08:20.742042+0000","last_peered":"2024-09-13T17:08:20.742042+0000","last_clean":"2024-09-13T17:08:20.742042+0000","last_became_active":"2024-09-13T17:08:19.363655+0000","last_became_peered":"2024-09-13T17:08:19.363655+0000","last_unstale":"2024-09-13T17:08:20.742042+0000","last_undegraded":"2024-09-13T17:08:20.742042+0000","last_fullsized":"2024-09-13T17:08:20.742042+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:08.517632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536349+0000","last_change":"2024-09-13T17:08:19.743227+0000","last_active":"2024-09-13T17:08:21.536349+0000","last_peered":"2024-09-13T17:08:21.536349+0000","last_clean":"2024-09-13T17:08:21.536349+0000","last_became_active":"2024-09-13T17:08:19.742963+0000","last_became_peered":"2024-09-13T17:08:19.742963+0000","last_unstale":"2024-09-13T17:08:21.536349+0000","last_undegraded":"2024-09-13T17:08:21.536349+0000","last_fullsized":"2024-09-13T17:08:21.536349+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:49.433769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746379+0000","last_change":"2024-09-13T17:08:19.362039+0000","last_active":"2024-09-13T17:08:20.746379+0000","last_peered":"2024-09-13T17:08:20.746379+0000","last_clean":"2024-09-13T17:08:20.746379+0000","last_became_active":"2024-09-13T17:08:19.361784+0000","last_became_peered":"2024-09-13T17:08:19.361784+0000","last_unstale":"2024-09-13T17:08:20.746379+0000","last_undegraded":"2024-09-13T17:08:20.746379+0000","last_fullsized":"2024-09-13T17:08:20.746379+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:39.147077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.742512+0000","last_change":"2024-09-13T17:08:19.762334+0000","last_active":"2024-09-13T17:08:20.742512+0000","last_peered":"2024-09-13T17:08:20.742512+0000","last_clean":"2024-09-13T17:08:20.742512+0000","last_became_active":"2024-09-13T17:08:19.760173+0000","last_became_peered":"2024-09-13T17:08:19.760173+0000","last_unstale":"2024-09-13T17:08:20.742512+0000","last_undegraded":"2024-09-13T17:08:20.742512+0000","last_fullsized":"2024-09-13T17:08:20.742512+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:24.955493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741722+0000","last_change":"2024-09-13T17:08:19.364187+0000","last_active":"2024-09-13T17:08:20.741722+0000","last_peered":"2024-09-13T17:08:20.741722+0000","last_clean":"2024-09-13T17:08:20.741722+0000","last_became_active":"2024-09-13T17:08:19.363702+0000","last_became_peered":"2024-09-13T17:08:19.363702+0000","last_unstale":"2024-09-13T17:08:20.741722+0000","last_undegraded":"2024-09-13T17:08:20.741722+0000","last_fullsized":"2024-09-13T17:08:20.741722+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:25.592791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746119+0000","last_change":"2024-09-13T17:08:19.757962+0000","last_active":"2024-09-13T17:08:20.746119+0000","last_peered":"2024-09-13T17:08:20.746119+0000","last_clean":"2024-09-13T17:08:20.746119+0000","last_became_active":"2024-09-13T17:08:19.757339+0000","last_became_peered":"2024-09-13T17:08:19.757339+0000","last_unstale":"2024-09-13T17:08:20.746119+0000","last_undegraded":"2024-09-13T17:08:20.746119+0000","last_fullsized":"2024-09-13T17:08:20.746119+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:45.675880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536941+0000","last_change":"2024-09-13T17:08:19.364685+0000","last_active":"2024-09-13T17:08:21.536941+0000","last_peered":"2024-09-13T17:08:21.536941+0000","last_clean":"2024-09-13T17:08:21.536941+0000","last_became_active":"2024-09-13T17:08:19.364425+0000","last_became_peered":"2024-09-13T17:08:19.364425+0000","last_unstale":"2024-09-13T17:08:21.536941+0000","last_undegraded":"2024-09-13T17:08:21.536941+0000","last_fullsized":"2024-09-13T17:08:21.536941+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:39.426570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.538754+0000","last_change":"2024-09-13T17:08:19.755338+0000","last_active":"2024-09-13T17:08:21.538754+0000","last_peered":"2024-09-13T17:08:21.538754+0000","last_clean":"2024-09-13T17:08:21.538754+0000","last_became_active":"2024-09-13T17:08:19.755047+0000","last_became_peered":"2024-09-13T17:08:19.755047+0000","last_unstale":"2024-09-13T17:08:21.538754+0000","last_undegraded":"2024-09-13T17:08:21.538754+0000","last_fullsized":"2024-09-13T17:08:21.538754+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:53.344519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.538702+0000","last_change":"2024-09-13T17:08:19.368156+0000","last_active":"2024-09-13T17:08:21.538702+0000","last_peered":"2024-09-13T17:08:21.538702+0000","last_clean":"2024-09-13T17:08:21.538702+0000","last_became_active":"2024-09-13T17:08:19.367853+0000","last_became_peered":"2024-09-13T17:08:19.367853+0000","last_unstale":"2024-09-13T17:08:21.538702+0000","last_undegraded":"2024-09-13T17:08:21.538702+0000","last_fullsized":"2024-09-13T17:08:21.538702+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:12.013996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537013+0000","last_change":"2024-09-13T17:08:19.742266+0000","last_active":"2024-09-13T17:08:21.537013+0000","last_peered":"2024-09-13T17:08:21.537013+0000","last_clean":"2024-09-13T17:08:21.537013+0000","last_became_active":"2024-09-13T17:08:19.742032+0000","last_became_peered":"2024-09-13T17:08:19.742032+0000","last_unstale":"2024-09-13T17:08:21.537013+0000","last_undegraded":"2024-09-13T17:08:21.537013+0000","last_fullsized":"2024-09-13T17:08:21.537013+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:06.769269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745598+0000","last_change":"2024-09-13T17:08:19.358796+0000","last_active":"2024-09-13T17:08:20.745598+0000","last_peered":"2024-09-13T17:08:20.745598+0000","last_clean":"2024-09-13T17:08:20.745598+0000","last_became_active":"2024-09-13T17:08:19.358466+0000","last_became_peered":"2024-09-13T17:08:19.358466+0000","last_unstale":"2024-09-13T17:08:20.745598+0000","last_undegraded":"2024-09-13T17:08:20.745598+0000","last_fullsized":"2024-09-13T17:08:20.745598+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:19.847055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946538+0000","last_change":"2024-09-13T17:08:19.766496+0000","last_active":"2024-09-13T17:08:20.946538+0000","last_peered":"2024-09-13T17:08:20.946538+0000","last_clean":"2024-09-13T17:08:20.946538+0000","last_became_active":"2024-09-13T17:08:19.766261+0000","last_became_peered":"2024-09-13T17:08:19.766261+0000","last_unstale":"2024-09-13T17:08:20.946538+0000","last_undegraded":"2024-09-13T17:08:20.946538+0000","last_fullsized":"2024-09-13T17:08:20.946538+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:40.430037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536044+0000","last_change":"2024-09-13T17:08:19.367483+0000","last_active":"2024-09-13T17:08:21.536044+0000","last_peered":"2024-09-13T17:08:21.536044+0000","last_clean":"2024-09-13T17:08:21.536044+0000","last_became_active":"2024-09-13T17:08:19.367207+0000","last_became_peered":"2024-09-13T17:08:19.367207+0000","last_unstale":"2024-09-13T17:08:21.536044+0000","last_undegraded":"2024-09-13T17:08:21.536044+0000","last_fullsized":"2024-09-13T17:08:21.536044+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:53.900550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946636+0000","last_change":"2024-09-13T17:08:19.760520+0000","last_active":"2024-09-13T17:08:20.946636+0000","last_peered":"2024-09-13T17:08:20.946636+0000","last_clean":"2024-09-13T17:08:20.946636+0000","last_became_active":"2024-09-13T17:08:19.760191+0000","last_became_peered":"2024-09-13T17:08:19.760191+0000","last_unstale":"2024-09-13T17:08:20.946636+0000","last_undegraded":"2024-09-13T17:08:20.946636+0000","last_fullsized":"2024-09-13T17:08:20.946636+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:01.948778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.742299+0000","last_change":"2024-09-13T17:08:19.360211+0000","last_active":"2024-09-13T17:08:20.742299+0000","last_peered":"2024-09-13T17:08:20.742299+0000","last_clean":"2024-09-13T17:08:20.742299+0000","last_became_active":"2024-09-13T17:08:19.359960+0000","last_became_peered":"2024-09-13T17:08:19.359960+0000","last_unstale":"2024-09-13T17:08:20.742299+0000","last_undegraded":"2024-09-13T17:08:20.742299+0000","last_fullsized":"2024-09-13T17:08:20.742299+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:54.725605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741875+0000","last_change":"2024-09-13T17:08:19.760098+0000","last_active":"2024-09-13T17:08:20.741875+0000","last_peered":"2024-09-13T17:08:20.741875+0000","last_clean":"2024-09-13T17:08:20.741875+0000","last_became_active":"2024-09-13T17:08:19.759805+0000","last_became_peered":"2024-09-13T17:08:19.759805+0000","last_unstale":"2024-09-13T17:08:20.741875+0000","last_undegraded":"2024-09-13T17:08:20.741875+0000","last_fullsized":"2024-09-13T17:08:20.741875+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:45.675880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.742105+0000","last_change":"2024-09-13T17:08:19.365636+0000","last_active":"2024-09-13T17:08:20.742105+0000","last_peered":"2024-09-13T17:08:20.742105+0000","last_clean":"2024-09-13T17:08:20.742105+0000","last_became_active":"2024-09-13T17:08:19.364423+0000","last_became_peered":"2024-09-13T17:08:19.364423+0000","last_unstale":"2024-09-13T17:08:20.742105+0000","last_undegraded":"2024-09-13T17:08:20.742105+0000","last_fullsized":"2024-09-13T17:08:20.742105+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:19.066287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.325695+0000","last_change":"2024-09-13T17:08:19.757964+0000","last_active":"2024-09-13T17:08:21.325695+0000","last_peered":"2024-09-13T17:08:21.325695+0000","last_clean":"2024-09-13T17:08:21.325695+0000","last_became_active":"2024-09-13T17:08:19.756579+0000","last_became_peered":"2024-09-13T17:08:19.756579+0000","last_unstale":"2024-09-13T17:08:21.325695+0000","last_undegraded":"2024-09-13T17:08:21.325695+0000","last_fullsized":"2024-09-13T17:08:21.325695+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:51.490945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535403+0000","last_change":"2024-09-13T17:08:19.366477+0000","last_active":"2024-09-13T17:08:21.535403+0000","last_peered":"2024-09-13T17:08:21.535403+0000","last_clean":"2024-09-13T17:08:21.535403+0000","last_became_active":"2024-09-13T17:08:19.364728+0000","last_became_peered":"2024-09-13T17:08:19.364728+0000","last_unstale":"2024-09-13T17:08:21.535403+0000","last_undegraded":"2024-09-13T17:08:21.535403+0000","last_fullsized":"2024-09-13T17:08:21.535403+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:54.725605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537144+0000","last_change":"2024-09-13T17:08:19.750951+0000","last_active":"2024-09-13T17:08:21.537144+0000","last_peered":"2024-09-13T17:08:21.537144+0000","last_clean":"2024-09-13T17:08:21.537144+0000","last_became_active":"2024-09-13T17:08:19.750725+0000","last_became_peered":"2024-09-13T17:08:19.750725+0000","last_unstale":"2024-09-13T17:08:21.537144+0000","last_undegraded":"2024-09-13T17:08:21.537144+0000","last_fullsized":"2024-09-13T17:08:21.537144+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:40.430037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536353+0000","last_change":"2024-09-13T17:08:19.364056+0000","last_active":"2024-09-13T17:08:21.536353+0000","last_peered":"2024-09-13T17:08:21.536353+0000","last_clean":"2024-09-13T17:08:21.536353+0000","last_became_active":"2024-09-13T17:08:19.360624+0000","last_became_peered":"2024-09-13T17:08:19.360624+0000","last_unstale":"2024-09-13T17:08:21.536353+0000","last_undegraded":"2024-09-13T17:08:21.536353+0000","last_fullsized":"2024-09-13T17:08:21.536353+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:18.225382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536092+0000","last_change":"2024-09-13T17:08:19.754591+0000","last_active":"2024-09-13T17:08:21.536092+0000","last_peered":"2024-09-13T17:08:21.536092+0000","last_clean":"2024-09-13T17:08:21.536092+0000","last_became_active":"2024-09-13T17:08:19.753107+0000","last_became_peered":"2024-09-13T17:08:19.753107+0000","last_unstale":"2024-09-13T17:08:21.536092+0000","last_undegraded":"2024-09-13T17:08:21.536092+0000","last_fullsized":"2024-09-13T17:08:21.536092+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:45.171781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745731+0000","last_change":"2024-09-13T17:08:19.365792+0000","last_active":"2024-09-13T17:08:20.745731+0000","last_peered":"2024-09-13T17:08:20.745731+0000","last_clean":"2024-09-13T17:08:20.745731+0000","last_became_active":"2024-09-13T17:08:19.365417+0000","last_became_peered":"2024-09-13T17:08:19.365417+0000","last_unstale":"2024-09-13T17:08:20.745731+0000","last_undegraded":"2024-09-13T17:08:20.745731+0000","last_fullsized":"2024-09-13T17:08:20.745731+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:50.487478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946994+0000","last_change":"2024-09-13T17:08:19.760440+0000","last_active":"2024-09-13T17:08:20.946994+0000","last_peered":"2024-09-13T17:08:20.946994+0000","last_clean":"2024-09-13T17:08:20.946994+0000","last_became_active":"2024-09-13T17:08:19.758137+0000","last_became_peered":"2024-09-13T17:08:19.758137+0000","last_unstale":"2024-09-13T17:08:20.946994+0000","last_undegraded":"2024-09-13T17:08:20.946994+0000","last_fullsized":"2024-09-13T17:08:20.946994+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:07.449197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.742056+0000","last_change":"2024-09-13T17:08:19.359847+0000","last_active":"2024-09-13T17:08:20.742056+0000","last_peered":"2024-09-13T17:08:20.742056+0000","last_clean":"2024-09-13T17:08:20.742056+0000","last_became_active":"2024-09-13T17:08:19.359475+0000","last_became_peered":"2024-09-13T17:08:19.359475+0000","last_unstale":"2024-09-13T17:08:20.742056+0000","last_undegraded":"2024-09-13T17:08:20.742056+0000","last_fullsized":"2024-09-13T17:08:20.742056+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:06.445730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536841+0000","last_change":"2024-09-13T17:08:19.752213+0000","last_active":"2024-09-13T17:08:21.536841+0000","last_peered":"2024-09-13T17:08:21.536841+0000","last_clean":"2024-09-13T17:08:21.536841+0000","last_became_active":"2024-09-13T17:08:19.751951+0000","last_became_peered":"2024-09-13T17:08:19.751951+0000","last_unstale":"2024-09-13T17:08:21.536841+0000","last_undegraded":"2024-09-13T17:08:21.536841+0000","last_fullsized":"2024-09-13T17:08:21.536841+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:23.358525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746655+0000","last_change":"2024-09-13T17:08:19.361044+0000","last_active":"2024-09-13T17:08:20.746655+0000","last_peered":"2024-09-13T17:08:20.746655+0000","last_clean":"2024-09-13T17:08:20.746655+0000","last_became_active":"2024-09-13T17:08:19.360492+0000","last_became_peered":"2024-09-13T17:08:19.360492+0000","last_unstale":"2024-09-13T17:08:20.746655+0000","last_undegraded":"2024-09-13T17:08:20.746655+0000","last_fullsized":"2024-09-13T17:08:20.746655+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:37.831047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746388+0000","last_change":"2024-09-13T17:08:19.747529+0000","last_active":"2024-09-13T17:08:20.746388+0000","last_peered":"2024-09-13T17:08:20.746388+0000","last_clean":"2024-09-13T17:08:20.746388+0000","last_became_active":"2024-09-13T17:08:19.747033+0000","last_became_peered":"2024-09-13T17:08:19.747033+0000","last_unstale":"2024-09-13T17:08:20.746388+0000","last_undegraded":"2024-09-13T17:08:20.746388+0000","last_fullsized":"2024-09-13T17:08:20.746388+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:06.769269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.325653+0000","last_change":"2024-09-13T17:08:19.365608+0000","last_active":"2024-09-13T17:08:21.325653+0000","last_peered":"2024-09-13T17:08:21.325653+0000","last_clean":"2024-09-13T17:08:21.325653+0000","last_became_active":"2024-09-13T17:08:19.365337+0000","last_became_peered":"2024-09-13T17:08:19.365337+0000","last_unstale":"2024-09-13T17:08:21.325653+0000","last_undegraded":"2024-09-13T17:08:21.325653+0000","last_fullsized":"2024-09-13T17:08:21.325653+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:54.725605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741953+0000","last_change":"2024-09-13T17:08:19.762118+0000","last_active":"2024-09-13T17:08:20.741953+0000","last_peered":"2024-09-13T17:08:20.741953+0000","last_clean":"2024-09-13T17:08:20.741953+0000","last_became_active":"2024-09-13T17:08:19.760370+0000","last_became_peered":"2024-09-13T17:08:19.760370+0000","last_unstale":"2024-09-13T17:08:20.741953+0000","last_undegraded":"2024-09-13T17:08:20.741953+0000","last_fullsized":"2024-09-13T17:08:20.741953+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:45.783700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746290+0000","last_change":"2024-09-13T17:08:19.359060+0000","last_active":"2024-09-13T17:08:20.746290+0000","last_peered":"2024-09-13T17:08:20.746290+0000","last_clean":"2024-09-13T17:08:20.746290+0000","last_became_active":"2024-09-13T17:08:19.358740+0000","last_became_peered":"2024-09-13T17:08:19.358740+0000","last_unstale":"2024-09-13T17:08:20.746290+0000","last_undegraded":"2024-09-13T17:08:20.746290+0000","last_fullsized":"2024-09-13T17:08:20.746290+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:06.445730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741910+0000","last_change":"2024-09-13T17:08:19.762505+0000","last_active":"2024-09-13T17:08:20.741910+0000","last_peered":"2024-09-13T17:08:20.741910+0000","last_clean":"2024-09-13T17:08:20.741910+0000","last_became_active":"2024-09-13T17:08:19.762173+0000","last_became_peered":"2024-09-13T17:08:19.762173+0000","last_unstale":"2024-09-13T17:08:20.741910+0000","last_undegraded":"2024-09-13T17:08:20.741910+0000","last_fullsized":"2024-09-13T17:08:20.741910+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:23.441619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745280+0000","last_change":"2024-09-13T17:08:19.367697+0000","last_active":"2024-09-13T17:08:20.745280+0000","last_peered":"2024-09-13T17:08:20.745280+0000","last_clean":"2024-09-13T17:08:20.745280+0000","last_became_active":"2024-09-13T17:08:19.367415+0000","last_became_peered":"2024-09-13T17:08:19.367415+0000","last_unstale":"2024-09-13T17:08:20.745280+0000","last_undegraded":"2024-09-13T17:08:20.745280+0000","last_fullsized":"2024-09-13T17:08:20.745280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:38.264810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535326+0000","last_change":"2024-09-13T17:08:19.758407+0000","last_active":"2024-09-13T17:08:21.535326+0000","last_peered":"2024-09-13T17:08:21.535326+0000","last_clean":"2024-09-13T17:08:21.535326+0000","last_became_active":"2024-09-13T17:08:19.758077+0000","last_became_peered":"2024-09-13T17:08:19.758077+0000","last_unstale":"2024-09-13T17:08:21.535326+0000","last_undegraded":"2024-09-13T17:08:21.535326+0000","last_fullsized":"2024-09-13T17:08:21.535326+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:45.171781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.325714+0000","last_change":"2024-09-13T17:08:19.361977+0000","last_active":"2024-09-13T17:08:21.325714+0000","last_peered":"2024-09-13T17:08:21.325714+0000","last_clean":"2024-09-13T17:08:21.325714+0000","last_became_active":"2024-09-13T17:08:19.361397+0000","last_became_peered":"2024-09-13T17:08:19.361397+0000","last_unstale":"2024-09-13T17:08:21.325714+0000","last_undegraded":"2024-09-13T17:08:21.325714+0000","last_fullsized":"2024-09-13T17:08:21.325714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:59.456249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.744791+0000","last_change":"2024-09-13T17:08:19.765347+0000","last_active":"2024-09-13T17:08:20.744791+0000","last_peered":"2024-09-13T17:08:20.744791+0000","last_clean":"2024-09-13T17:08:20.744791+0000","last_became_active":"2024-09-13T17:08:19.765007+0000","last_became_peered":"2024-09-13T17:08:19.765007+0000","last_unstale":"2024-09-13T17:08:20.744791+0000","last_undegraded":"2024-09-13T17:08:20.744791+0000","last_fullsized":"2024-09-13T17:08:20.744791+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:11.103022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537158+0000","last_change":"2024-09-13T17:08:19.370718+0000","last_active":"2024-09-13T17:08:21.537158+0000","last_peered":"2024-09-13T17:08:21.537158+0000","last_clean":"2024-09-13T17:08:21.537158+0000","last_became_active":"2024-09-13T17:08:19.370285+0000","last_became_peered":"2024-09-13T17:08:19.370285+0000","last_unstale":"2024-09-13T17:08:21.537158+0000","last_undegraded":"2024-09-13T17:08:21.537158+0000","last_fullsized":"2024-09-13T17:08:21.537158+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:19.847055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537122+0000","last_change":"2024-09-13T17:08:19.742254+0000","last_active":"2024-09-13T17:08:21.537122+0000","last_peered":"2024-09-13T17:08:21.537122+0000","last_clean":"2024-09-13T17:08:21.537122+0000","last_became_active":"2024-09-13T17:08:19.742015+0000","last_became_peered":"2024-09-13T17:08:19.742015+0000","last_unstale":"2024-09-13T17:08:21.537122+0000","last_undegraded":"2024-09-13T17:08:21.537122+0000","last_fullsized":"2024-09-13T17:08:21.537122+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:34.642224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536130+0000","last_change":"2024-09-13T17:08:19.370236+0000","last_active":"2024-09-13T17:08:21.536130+0000","last_peered":"2024-09-13T17:08:21.536130+0000","last_clean":"2024-09-13T17:08:21.536130+0000","last_became_active":"2024-09-13T17:08:19.370035+0000","last_became_peered":"2024-09-13T17:08:19.370035+0000","last_unstale":"2024-09-13T17:08:21.536130+0000","last_undegraded":"2024-09-13T17:08:21.536130+0000","last_fullsized":"2024-09-13T17:08:21.536130+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:12.639857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T17:08:19.736971+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:08:19.736971+0000","last_peered":"2024-09-13T17:08:19.736971+0000","last_clean":"2024-09-13T17:08:19.736971+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:08:19.736971+0000","last_undegraded":"2024-09-13T17:08:19.736971+0000","last_fullsized":"2024-09-13T17:08:19.736971+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1138688,"data_stored":810852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.748},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.1020000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.0740000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.006}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.81200000000000006}]},{"osd":4,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.038}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.65700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":221066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.88300000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.143},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.1619999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.76100000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.262}]},{"osd":4,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.115}]},{"osd":5,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.081}]},{"osd":7,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.518}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":214164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.92600000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.099}]},{"osd":2,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.75}]},{"osd":3,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.995},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1579999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.131},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.036}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":221958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":1.119},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.96699999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.2310000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.4370000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":1.0740000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.478}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.304}]},{"osd":7,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.401},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.371}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":552960,"data_stored":221032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.74199999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.93300000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.008}]},{"osd":7,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.0189999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":544768,"data_stored":215680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.495},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.58799999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.0109999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.1060000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.0309999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":214164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.497},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.81599999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.76500000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.0269999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.1519999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.224},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.86899999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.329}]},{"osd":7,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.5720000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1138688,"data_stored":810796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.25,"5min":3.25,"15min":3.25},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.5590000000000002,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":6.4089999999999998,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.7060000000000004,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":6.2729999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.96499999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":5.3019999999999996,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.9039999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":4.2599999999999998,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.86699999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":5.7510000000000003,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":0.65600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:08:23.798 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:08:23.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.908+0000 7f26e55a5700 1 Processor -- start 2024-09-13T17:08:23.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.908+0000 7f26e55a5700 1 -- start start 2024-09-13T17:08:23.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.908+0000 7f26e55a5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26e0071580 0x7f26e00705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.908+0000 7f26e55a5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26e015b9b0 0x7f26e00cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.908+0000 7f26e55a5700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e00cee80 con 0x7f26e015a8c0 2024-09-13T17:08:23.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.908+0000 7f26e55a5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e015be60 con 0x7f26e0071580 2024-09-13T17:08:23.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.908+0000 7f26e55a5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00ce270 con 0x7f26e015b9b0 2024-09-13T17:08:23.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.908+0000 7f26d77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26e0071580 0x7f26e00705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.908+0000 7f26e4da4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26e015b9b0 0x7f26e00cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.908+0000 7f26dffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f26e015a8c0 0x7f26e0070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:56496/0 (socket says 172.21.15.123:56496) 2024-09-13T17:08:23.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.908+0000 7f26e4da4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26e015b9b0 0x7f26e00cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:35668/0 (socket says 172.21.15.123:35668) 2024-09-13T17:08:23.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.908+0000 7f26d77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26e0071580 0x7f26e00705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:48594/0 (socket says 172.21.15.123:48594) 2024-09-13T17:08:23.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.908+0000 7f26e4da4700 1 -- 172.21.15.123:0/2222111669 learned_addr learned my addr 172.21.15.123:0/2222111669 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:23.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26e4da4700 1 -- 172.21.15.123:0/2222111669 >> v2:172.21.15.153:3300/0 conn(0x7f26e0071580 msgr2=0x7f26e00705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:23.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26e4da4700 1 --2- 172.21.15.123:0/2222111669 >> v2:172.21.15.153:3300/0 conn(0x7f26e0071580 0x7f26e00705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26e4da4700 1 -- 172.21.15.123:0/2222111669 >> v1:172.21.15.153:6789/0 conn(0x7f26e015a8c0 legacy=0x7f26e0070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26e4da4700 1 -- 172.21.15.123:0/2222111669 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e00ce550 con 0x7f26e015b9b0 2024-09-13T17:08:23.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26e4da4700 1 --2- 172.21.15.123:0/2222111669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26e015b9b0 0x7f26e00cc620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009e50 tx=0x7f26d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=212c72a95586452d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:23.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26df7fe700 1 -- 172.21.15.123:0/2222111669 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800e070 con 0x7f26e015b9b0 2024-09-13T17:08:23.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26df7fe700 1 -- 172.21.15.123:0/2222111669 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d800b910 con 0x7f26e015b9b0 2024-09-13T17:08:23.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26df7fe700 1 -- 172.21.15.123:0/2222111669 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800bcc0 con 0x7f26e015b9b0 2024-09-13T17:08:23.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26e55a5700 1 -- 172.21.15.123:0/2222111669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26e015b9b0 msgr2=0x7f26e00cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26e55a5700 1 --2- 172.21.15.123:0/2222111669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26e015b9b0 0x7f26e00cc620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009e50 tx=0x7f26d800b330 comp rx=0 tx=0).stop 2024-09-13T17:08:23.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26e55a5700 1 -- 172.21.15.123:0/2222111669 shutdown_connections 2024-09-13T17:08:23.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26e55a5700 1 --2- 172.21.15.123:0/2222111669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26e015b9b0 0x7f26e00cc620 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26e55a5700 1 --2- 172.21.15.123:0/2222111669 >> v2:172.21.15.153:3300/0 conn(0x7f26e0071580 0x7f26e00705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26e55a5700 1 -- 172.21.15.123:0/2222111669 >> 172.21.15.123:0/2222111669 conn(0x7f26e0066150 msgr2=0x7f26e0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:23.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26e55a5700 1 -- 172.21.15.123:0/2222111669 shutdown_connections 2024-09-13T17:08:23.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.912+0000 7f26e55a5700 1 -- 172.21.15.123:0/2222111669 wait complete. 2024-09-13T17:08:23.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26e55a5700 1 Processor -- start 2024-09-13T17:08:23.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26e55a5700 1 -- start start 2024-09-13T17:08:23.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26e55a5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26e0071580 0x7f26e01454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26e55a5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26e015a8c0 0x7f26e014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26e55a5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e015b9b0 0x7f26e0158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26e55a5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e0151ad0 con 0x7f26e0071580 2024-09-13T17:08:23.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26e55a5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e0159f70 con 0x7f26e015b9b0 2024-09-13T17:08:23.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26e55a5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e0155770 con 0x7f26e015a8c0 2024-09-13T17:08:23.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26dffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26e0071580 0x7f26e01454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26dffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26e0071580 0x7f26e01454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46474/0 (socket says 172.21.15.123:46474) 2024-09-13T17:08:23.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26d77fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26e015a8c0 0x7f26e014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26dffff700 1 -- 172.21.15.123:0/159893252 learned_addr learned my addr 172.21.15.123:0/159893252 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:23.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26e4da4700 1 --2- 172.21.15.123:0/159893252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e015b9b0 0x7f26e0158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26dffff700 1 -- 172.21.15.123:0/159893252 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26e015a8c0 msgr2=0x7f26e014ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26dffff700 1 --2- 172.21.15.123:0/159893252 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26e015a8c0 0x7f26e014ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26dffff700 1 -- 172.21.15.123:0/159893252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e015b9b0 msgr2=0x7f26e0158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:23.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26dffff700 1 --2- 172.21.15.123:0/159893252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e015b9b0 0x7f26e0158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:23.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26dffff700 1 -- 172.21.15.123:0/159893252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d8009b30 con 0x7f26e0071580 2024-09-13T17:08:23.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26dffff700 1 --2- 172.21.15.123:0/159893252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26e0071580 0x7f26e01454c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c700 tx=0x7f26d000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:23.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26dd7fa700 1 -- 172.21.15.123:0/159893252 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0005cd0 con 0x7f26e0071580 2024-09-13T17:08:23.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26dd7fa700 1 -- 172.21.15.123:0/159893252 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d0005e30 con 0x7f26e0071580 2024-09-13T17:08:23.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26e55a5700 1 -- 172.21.15.123:0/159893252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e014f3d0 con 0x7f26e0071580 2024-09-13T17:08:23.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26dd7fa700 1 -- 172.21.15.123:0/159893252 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d00072d0 con 0x7f26e0071580 2024-09-13T17:08:23.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.916+0000 7f26e55a5700 1 -- 172.21.15.123:0/159893252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e0151480 con 0x7f26e0071580 2024-09-13T17:08:23.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.920+0000 7f26e55a5700 1 -- 172.21.15.123:0/159893252 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e00677f0 con 0x7f26e0071580 2024-09-13T17:08:23.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.920+0000 7f26dd7fa700 1 -- 172.21.15.123:0/159893252 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26d0007430 con 0x7f26e0071580 2024-09-13T17:08:23.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.920+0000 7f26dd7fa700 1 --2- 172.21.15.123:0/159893252 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f26c0066760 0x7f26c0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:23.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.920+0000 7f26dd7fa700 1 -- 172.21.15.123:0/159893252 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26d00833e0 con 0x7f26e0071580 2024-09-13T17:08:23.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.920+0000 7f26d77fe700 1 --2- 172.21.15.123:0/159893252 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f26c0066760 0x7f26c0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:23.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.924+0000 7f26d77fe700 1 --2- 172.21.15.123:0/159893252 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f26c0066760 0x7f26c0068c20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f26e0159c00 tx=0x7f26c8009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:23.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:23.928+0000 7f26dd7fa700 1 -- 172.21.15.123:0/159893252 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f26d0050800 con 0x7f26e0071580 2024-09-13T17:08:24.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.096+0000 7f26e55a5700 1 -- 172.21.15.123:0/159893252 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26e00ceb10 con 0x7f26c0066760 2024-09-13T17:08:24.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.104+0000 7f26dd7fa700 1 -- 172.21.15.123:0/159893252 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287870 (secure 0 0 0) 0x7f26c8011810 con 0x7f26c0066760 2024-09-13T17:08:24.113 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:24.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.112+0000 7f26e55a5700 1 -- 172.21.15.123:0/159893252 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f26c0066760 msgr2=0x7f26c0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.112+0000 7f26e55a5700 1 --2- 172.21.15.123:0/159893252 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f26c0066760 0x7f26c0068c20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f26e0159c00 tx=0x7f26c8009240 comp rx=0 tx=0).stop 2024-09-13T17:08:24.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.112+0000 7f26e55a5700 1 -- 172.21.15.123:0/159893252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26e0071580 msgr2=0x7f26e01454c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.112+0000 7f26e55a5700 1 --2- 172.21.15.123:0/159893252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26e0071580 0x7f26e01454c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c700 tx=0x7f26d000ca10 comp rx=0 tx=0).stop 2024-09-13T17:08:24.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.112+0000 7f26e55a5700 1 -- 172.21.15.123:0/159893252 shutdown_connections 2024-09-13T17:08:24.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.112+0000 7f26e55a5700 1 --2- 172.21.15.123:0/159893252 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f26c0066760 0x7f26c0068c20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.112+0000 7f26e55a5700 1 --2- 172.21.15.123:0/159893252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e015b9b0 0x7f26e0158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.112+0000 7f26e55a5700 1 --2- 172.21.15.123:0/159893252 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26e015a8c0 0x7f26e014ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.112+0000 7f26e55a5700 1 --2- 172.21.15.123:0/159893252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26e0071580 0x7f26e01454c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.112+0000 7f26e55a5700 1 -- 172.21.15.123:0/159893252 >> 172.21.15.123:0/159893252 conn(0x7f26e0066150 msgr2=0x7f26e00cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:24.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.112+0000 7f26e55a5700 1 -- 172.21.15.123:0/159893252 shutdown_connections 2024-09-13T17:08:24.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.112+0000 7f26e55a5700 1 -- 172.21.15.123:0/159893252 wait complete. 2024-09-13T17:08:24.117 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:08:24.128 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-09-13T17:08:22.764803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221592,"kb_used_data":5412,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753128,"statfs":{"total":773094113280,"available":772867203072,"internally_reserved":0,"allocated":5541888,"data_stored":2929712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.426989"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746445+0000","last_change":"2024-09-13T17:08:19.750134+0000","last_active":"2024-09-13T17:08:20.746445+0000","last_peered":"2024-09-13T17:08:20.746445+0000","last_clean":"2024-09-13T17:08:20.746445+0000","last_became_active":"2024-09-13T17:08:19.749847+0000","last_became_peered":"2024-09-13T17:08:19.749847+0000","last_unstale":"2024-09-13T17:08:20.746445+0000","last_undegraded":"2024-09-13T17:08:20.746445+0000","last_fullsized":"2024-09-13T17:08:20.746445+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:07.632746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536069+0000","last_change":"2024-09-13T17:08:19.744872+0000","last_active":"2024-09-13T17:08:21.536069+0000","last_peered":"2024-09-13T17:08:21.536069+0000","last_clean":"2024-09-13T17:08:21.536069+0000","last_became_active":"2024-09-13T17:08:19.744443+0000","last_became_peered":"2024-09-13T17:08:19.744443+0000","last_unstale":"2024-09-13T17:08:21.536069+0000","last_undegraded":"2024-09-13T17:08:21.536069+0000","last_fullsized":"2024-09-13T17:08:21.536069+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:38.834515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745221+0000","last_change":"2024-09-13T17:08:19.751307+0000","last_active":"2024-09-13T17:08:20.745221+0000","last_peered":"2024-09-13T17:08:20.745221+0000","last_clean":"2024-09-13T17:08:20.745221+0000","last_became_active":"2024-09-13T17:08:19.751004+0000","last_became_peered":"2024-09-13T17:08:19.751004+0000","last_unstale":"2024-09-13T17:08:20.745221+0000","last_undegraded":"2024-09-13T17:08:20.745221+0000","last_fullsized":"2024-09-13T17:08:20.745221+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:45.171781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536946+0000","last_change":"2024-09-13T17:08:19.758425+0000","last_active":"2024-09-13T17:08:21.536946+0000","last_peered":"2024-09-13T17:08:21.536946+0000","last_clean":"2024-09-13T17:08:21.536946+0000","last_became_active":"2024-09-13T17:08:19.758156+0000","last_became_peered":"2024-09-13T17:08:19.758156+0000","last_unstale":"2024-09-13T17:08:21.536946+0000","last_undegraded":"2024-09-13T17:08:21.536946+0000","last_fullsized":"2024-09-13T17:08:21.536946+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:23.441619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535650+0000","last_change":"2024-09-13T17:08:19.748878+0000","last_active":"2024-09-13T17:08:21.535650+0000","last_peered":"2024-09-13T17:08:21.535650+0000","last_clean":"2024-09-13T17:08:21.535650+0000","last_became_active":"2024-09-13T17:08:19.748516+0000","last_became_peered":"2024-09-13T17:08:19.748516+0000","last_unstale":"2024-09-13T17:08:21.535650+0000","last_undegraded":"2024-09-13T17:08:21.535650+0000","last_fullsized":"2024-09-13T17:08:21.535650+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:51.490945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741775+0000","last_change":"2024-09-13T17:08:19.742878+0000","last_active":"2024-09-13T17:08:20.741775+0000","last_peered":"2024-09-13T17:08:20.741775+0000","last_clean":"2024-09-13T17:08:20.741775+0000","last_became_active":"2024-09-13T17:08:19.742606+0000","last_became_peered":"2024-09-13T17:08:19.742606+0000","last_unstale":"2024-09-13T17:08:20.741775+0000","last_undegraded":"2024-09-13T17:08:20.741775+0000","last_fullsized":"2024-09-13T17:08:20.741775+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:47.103390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746498+0000","last_change":"2024-09-13T17:08:19.753334+0000","last_active":"2024-09-13T17:08:20.746498+0000","last_peered":"2024-09-13T17:08:20.746498+0000","last_clean":"2024-09-13T17:08:20.746498+0000","last_became_active":"2024-09-13T17:08:19.753043+0000","last_became_peered":"2024-09-13T17:08:19.753043+0000","last_unstale":"2024-09-13T17:08:20.746498+0000","last_undegraded":"2024-09-13T17:08:20.746498+0000","last_fullsized":"2024-09-13T17:08:20.746498+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:02.147509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535966+0000","last_change":"2024-09-13T17:08:19.763443+0000","last_active":"2024-09-13T17:08:21.535966+0000","last_peered":"2024-09-13T17:08:21.535966+0000","last_clean":"2024-09-13T17:08:21.535966+0000","last_became_active":"2024-09-13T17:08:19.761173+0000","last_became_peered":"2024-09-13T17:08:19.761173+0000","last_unstale":"2024-09-13T17:08:21.535966+0000","last_undegraded":"2024-09-13T17:08:21.535966+0000","last_fullsized":"2024-09-13T17:08:21.535966+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:24.955493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536781+0000","last_change":"2024-09-13T17:08:19.752152+0000","last_active":"2024-09-13T17:08:21.536781+0000","last_peered":"2024-09-13T17:08:21.536781+0000","last_clean":"2024-09-13T17:08:21.536781+0000","last_became_active":"2024-09-13T17:08:19.751845+0000","last_became_peered":"2024-09-13T17:08:19.751845+0000","last_unstale":"2024-09-13T17:08:21.536781+0000","last_undegraded":"2024-09-13T17:08:21.536781+0000","last_fullsized":"2024-09-13T17:08:21.536781+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:12.551648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537100+0000","last_change":"2024-09-13T17:08:19.758489+0000","last_active":"2024-09-13T17:08:21.537100+0000","last_peered":"2024-09-13T17:08:21.537100+0000","last_clean":"2024-09-13T17:08:21.537100+0000","last_became_active":"2024-09-13T17:08:19.758236+0000","last_became_peered":"2024-09-13T17:08:19.758236+0000","last_unstale":"2024-09-13T17:08:21.537100+0000","last_undegraded":"2024-09-13T17:08:21.537100+0000","last_fullsized":"2024-09-13T17:08:21.537100+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:07.632746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536854+0000","last_change":"2024-09-13T17:08:19.757371+0000","last_active":"2024-09-13T17:08:21.536854+0000","last_peered":"2024-09-13T17:08:21.536854+0000","last_clean":"2024-09-13T17:08:21.536854+0000","last_became_active":"2024-09-13T17:08:19.756102+0000","last_became_peered":"2024-09-13T17:08:19.756102+0000","last_unstale":"2024-09-13T17:08:21.536854+0000","last_undegraded":"2024-09-13T17:08:21.536854+0000","last_fullsized":"2024-09-13T17:08:21.536854+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:28.681581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535645+0000","last_change":"2024-09-13T17:08:19.752232+0000","last_active":"2024-09-13T17:08:21.535645+0000","last_peered":"2024-09-13T17:08:21.535645+0000","last_clean":"2024-09-13T17:08:21.535645+0000","last_became_active":"2024-09-13T17:08:19.751987+0000","last_became_peered":"2024-09-13T17:08:19.751987+0000","last_unstale":"2024-09-13T17:08:21.535645+0000","last_undegraded":"2024-09-13T17:08:21.535645+0000","last_fullsized":"2024-09-13T17:08:21.535645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:34.642224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537853+0000","last_change":"2024-09-13T17:08:19.766875+0000","last_active":"2024-09-13T17:08:21.537853+0000","last_peered":"2024-09-13T17:08:21.537853+0000","last_clean":"2024-09-13T17:08:21.537853+0000","last_became_active":"2024-09-13T17:08:19.766600+0000","last_became_peered":"2024-09-13T17:08:19.766600+0000","last_unstale":"2024-09-13T17:08:21.537853+0000","last_undegraded":"2024-09-13T17:08:21.537853+0000","last_fullsized":"2024-09-13T17:08:21.537853+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:04.292550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536390+0000","last_change":"2024-09-13T17:08:19.756087+0000","last_active":"2024-09-13T17:08:21.536390+0000","last_peered":"2024-09-13T17:08:21.536390+0000","last_clean":"2024-09-13T17:08:21.536390+0000","last_became_active":"2024-09-13T17:08:19.755830+0000","last_became_peered":"2024-09-13T17:08:19.755830+0000","last_unstale":"2024-09-13T17:08:21.536390+0000","last_undegraded":"2024-09-13T17:08:21.536390+0000","last_fullsized":"2024-09-13T17:08:21.536390+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:45.675880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741667+0000","last_change":"2024-09-13T17:08:19.762743+0000","last_active":"2024-09-13T17:08:20.741667+0000","last_peered":"2024-09-13T17:08:20.741667+0000","last_clean":"2024-09-13T17:08:20.741667+0000","last_became_active":"2024-09-13T17:08:19.760662+0000","last_became_peered":"2024-09-13T17:08:19.760662+0000","last_unstale":"2024-09-13T17:08:20.741667+0000","last_undegraded":"2024-09-13T17:08:20.741667+0000","last_fullsized":"2024-09-13T17:08:20.741667+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:06.769269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946046+0000","last_change":"2024-09-13T17:08:19.757666+0000","last_active":"2024-09-13T17:08:20.946046+0000","last_peered":"2024-09-13T17:08:20.946046+0000","last_clean":"2024-09-13T17:08:20.946046+0000","last_became_active":"2024-09-13T17:08:19.757408+0000","last_became_peered":"2024-09-13T17:08:19.757408+0000","last_unstale":"2024-09-13T17:08:20.946046+0000","last_undegraded":"2024-09-13T17:08:20.946046+0000","last_fullsized":"2024-09-13T17:08:20.946046+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:09.521099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745294+0000","last_change":"2024-09-13T17:08:19.756094+0000","last_active":"2024-09-13T17:08:20.745294+0000","last_peered":"2024-09-13T17:08:20.745294+0000","last_clean":"2024-09-13T17:08:20.745294+0000","last_became_active":"2024-09-13T17:08:19.755822+0000","last_became_peered":"2024-09-13T17:08:19.755822+0000","last_unstale":"2024-09-13T17:08:20.745294+0000","last_undegraded":"2024-09-13T17:08:20.745294+0000","last_fullsized":"2024-09-13T17:08:20.745294+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:28.681581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745252+0000","last_change":"2024-09-13T17:08:19.751817+0000","last_active":"2024-09-13T17:08:20.745252+0000","last_peered":"2024-09-13T17:08:20.745252+0000","last_clean":"2024-09-13T17:08:20.745252+0000","last_became_active":"2024-09-13T17:08:19.751206+0000","last_became_peered":"2024-09-13T17:08:19.751206+0000","last_unstale":"2024-09-13T17:08:20.745252+0000","last_undegraded":"2024-09-13T17:08:20.745252+0000","last_fullsized":"2024-09-13T17:08:20.745252+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:12.551648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946899+0000","last_change":"2024-09-13T17:08:19.757121+0000","last_active":"2024-09-13T17:08:20.946899+0000","last_peered":"2024-09-13T17:08:20.946899+0000","last_clean":"2024-09-13T17:08:20.946899+0000","last_became_active":"2024-09-13T17:08:19.754904+0000","last_became_peered":"2024-09-13T17:08:19.754904+0000","last_unstale":"2024-09-13T17:08:20.946899+0000","last_undegraded":"2024-09-13T17:08:20.946899+0000","last_fullsized":"2024-09-13T17:08:20.946899+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:26.596259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.538229+0000","last_change":"2024-09-13T17:08:19.751231+0000","last_active":"2024-09-13T17:08:21.538229+0000","last_peered":"2024-09-13T17:08:21.538229+0000","last_clean":"2024-09-13T17:08:21.538229+0000","last_became_active":"2024-09-13T17:08:19.750958+0000","last_became_peered":"2024-09-13T17:08:19.750958+0000","last_unstale":"2024-09-13T17:08:21.538229+0000","last_undegraded":"2024-09-13T17:08:21.538229+0000","last_fullsized":"2024-09-13T17:08:21.538229+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:20.850522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741735+0000","last_change":"2024-09-13T17:08:19.762249+0000","last_active":"2024-09-13T17:08:20.741735+0000","last_peered":"2024-09-13T17:08:20.741735+0000","last_clean":"2024-09-13T17:08:20.741735+0000","last_became_active":"2024-09-13T17:08:19.760654+0000","last_became_peered":"2024-09-13T17:08:19.760654+0000","last_unstale":"2024-09-13T17:08:20.741735+0000","last_undegraded":"2024-09-13T17:08:20.741735+0000","last_fullsized":"2024-09-13T17:08:20.741735+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:07.632746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536445+0000","last_change":"2024-09-13T17:08:19.758681+0000","last_active":"2024-09-13T17:08:21.536445+0000","last_peered":"2024-09-13T17:08:21.536445+0000","last_clean":"2024-09-13T17:08:21.536445+0000","last_became_active":"2024-09-13T17:08:19.758401+0000","last_became_peered":"2024-09-13T17:08:19.758401+0000","last_unstale":"2024-09-13T17:08:21.536445+0000","last_undegraded":"2024-09-13T17:08:21.536445+0000","last_fullsized":"2024-09-13T17:08:21.536445+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:45.783700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946204+0000","last_change":"2024-09-13T17:08:19.757257+0000","last_active":"2024-09-13T17:08:20.946204+0000","last_peered":"2024-09-13T17:08:20.946204+0000","last_clean":"2024-09-13T17:08:20.946204+0000","last_became_active":"2024-09-13T17:08:19.756977+0000","last_became_peered":"2024-09-13T17:08:19.756977+0000","last_unstale":"2024-09-13T17:08:20.946204+0000","last_undegraded":"2024-09-13T17:08:20.946204+0000","last_fullsized":"2024-09-13T17:08:20.946204+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:00.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946052+0000","last_change":"2024-09-13T17:08:19.757689+0000","last_active":"2024-09-13T17:08:20.946052+0000","last_peered":"2024-09-13T17:08:20.946052+0000","last_clean":"2024-09-13T17:08:20.946052+0000","last_became_active":"2024-09-13T17:08:19.757351+0000","last_became_peered":"2024-09-13T17:08:19.757351+0000","last_unstale":"2024-09-13T17:08:20.946052+0000","last_undegraded":"2024-09-13T17:08:20.946052+0000","last_fullsized":"2024-09-13T17:08:20.946052+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:39.268277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.947033+0000","last_change":"2024-09-13T17:08:19.760768+0000","last_active":"2024-09-13T17:08:20.947033+0000","last_peered":"2024-09-13T17:08:20.947033+0000","last_clean":"2024-09-13T17:08:20.947033+0000","last_became_active":"2024-09-13T17:08:19.760014+0000","last_became_peered":"2024-09-13T17:08:19.760014+0000","last_unstale":"2024-09-13T17:08:20.947033+0000","last_undegraded":"2024-09-13T17:08:20.947033+0000","last_fullsized":"2024-09-13T17:08:20.947033+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:13.643325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.538752+0000","last_change":"2024-09-13T17:08:19.766907+0000","last_active":"2024-09-13T17:08:21.538752+0000","last_peered":"2024-09-13T17:08:21.538752+0000","last_clean":"2024-09-13T17:08:21.538752+0000","last_became_active":"2024-09-13T17:08:19.766592+0000","last_became_peered":"2024-09-13T17:08:19.766592+0000","last_unstale":"2024-09-13T17:08:21.538752+0000","last_undegraded":"2024-09-13T17:08:21.538752+0000","last_fullsized":"2024-09-13T17:08:21.538752+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:39.268277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745062+0000","last_change":"2024-09-13T17:08:19.756054+0000","last_active":"2024-09-13T17:08:20.745062+0000","last_peered":"2024-09-13T17:08:20.745062+0000","last_clean":"2024-09-13T17:08:20.745062+0000","last_became_active":"2024-09-13T17:08:19.755796+0000","last_became_peered":"2024-09-13T17:08:19.755796+0000","last_unstale":"2024-09-13T17:08:20.745062+0000","last_undegraded":"2024-09-13T17:08:20.745062+0000","last_fullsized":"2024-09-13T17:08:20.745062+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:51.490945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535811+0000","last_change":"2024-09-13T17:08:19.752123+0000","last_active":"2024-09-13T17:08:21.535811+0000","last_peered":"2024-09-13T17:08:21.535811+0000","last_clean":"2024-09-13T17:08:21.535811+0000","last_became_active":"2024-09-13T17:08:19.751639+0000","last_became_peered":"2024-09-13T17:08:19.751639+0000","last_unstale":"2024-09-13T17:08:21.535811+0000","last_undegraded":"2024-09-13T17:08:21.535811+0000","last_fullsized":"2024-09-13T17:08:21.535811+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:28.681581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946182+0000","last_change":"2024-09-13T17:08:19.755184+0000","last_active":"2024-09-13T17:08:20.946182+0000","last_peered":"2024-09-13T17:08:20.946182+0000","last_clean":"2024-09-13T17:08:20.946182+0000","last_became_active":"2024-09-13T17:08:19.754879+0000","last_became_peered":"2024-09-13T17:08:19.754879+0000","last_unstale":"2024-09-13T17:08:20.946182+0000","last_undegraded":"2024-09-13T17:08:20.946182+0000","last_fullsized":"2024-09-13T17:08:20.946182+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:00.459717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.744693+0000","last_change":"2024-09-13T17:08:19.755408+0000","last_active":"2024-09-13T17:08:20.744693+0000","last_peered":"2024-09-13T17:08:20.744693+0000","last_clean":"2024-09-13T17:08:20.744693+0000","last_became_active":"2024-09-13T17:08:19.752846+0000","last_became_peered":"2024-09-13T17:08:19.752846+0000","last_unstale":"2024-09-13T17:08:20.744693+0000","last_undegraded":"2024-09-13T17:08:20.744693+0000","last_fullsized":"2024-09-13T17:08:20.744693+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:07.449197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741628+0000","last_change":"2024-09-13T17:08:19.742587+0000","last_active":"2024-09-13T17:08:20.741628+0000","last_peered":"2024-09-13T17:08:20.741628+0000","last_clean":"2024-09-13T17:08:20.741628+0000","last_became_active":"2024-09-13T17:08:19.742343+0000","last_became_peered":"2024-09-13T17:08:19.742343+0000","last_unstale":"2024-09-13T17:08:20.741628+0000","last_undegraded":"2024-09-13T17:08:20.741628+0000","last_fullsized":"2024-09-13T17:08:20.741628+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:44.887122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537267+0000","last_change":"2024-09-13T17:08:19.753523+0000","last_active":"2024-09-13T17:08:21.537267+0000","last_peered":"2024-09-13T17:08:21.537267+0000","last_clean":"2024-09-13T17:08:21.537267+0000","last_became_active":"2024-09-13T17:08:19.753287+0000","last_became_peered":"2024-09-13T17:08:19.753287+0000","last_unstale":"2024-09-13T17:08:21.537267+0000","last_undegraded":"2024-09-13T17:08:21.537267+0000","last_fullsized":"2024-09-13T17:08:21.537267+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:13.851391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.326108+0000","last_change":"2024-09-13T17:08:19.766788+0000","last_active":"2024-09-13T17:08:21.326108+0000","last_peered":"2024-09-13T17:08:21.326108+0000","last_clean":"2024-09-13T17:08:21.326108+0000","last_became_active":"2024-09-13T17:08:19.766448+0000","last_became_peered":"2024-09-13T17:08:19.766448+0000","last_unstale":"2024-09-13T17:08:21.326108+0000","last_undegraded":"2024-09-13T17:08:21.326108+0000","last_fullsized":"2024-09-13T17:08:21.326108+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:38.834515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.742663+0000","last_change":"2024-09-13T17:08:19.364081+0000","last_active":"2024-09-13T17:08:20.742663+0000","last_peered":"2024-09-13T17:08:20.742663+0000","last_clean":"2024-09-13T17:08:20.742663+0000","last_became_active":"2024-09-13T17:08:19.360321+0000","last_became_peered":"2024-09-13T17:08:19.360321+0000","last_unstale":"2024-09-13T17:08:20.742663+0000","last_undegraded":"2024-09-13T17:08:20.742663+0000","last_fullsized":"2024-09-13T17:08:20.742663+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:00.945310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946810+0000","last_change":"2024-09-13T17:08:19.760961+0000","last_active":"2024-09-13T17:08:20.946810+0000","last_peered":"2024-09-13T17:08:20.946810+0000","last_clean":"2024-09-13T17:08:20.946810+0000","last_became_active":"2024-09-13T17:08:19.760159+0000","last_became_peered":"2024-09-13T17:08:19.760159+0000","last_unstale":"2024-09-13T17:08:20.946810+0000","last_undegraded":"2024-09-13T17:08:20.946810+0000","last_fullsized":"2024-09-13T17:08:20.946810+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:54.904018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745489+0000","last_change":"2024-09-13T17:08:19.357667+0000","last_active":"2024-09-13T17:08:20.745489+0000","last_peered":"2024-09-13T17:08:20.745489+0000","last_clean":"2024-09-13T17:08:20.745489+0000","last_became_active":"2024-09-13T17:08:19.357403+0000","last_became_peered":"2024-09-13T17:08:19.357403+0000","last_unstale":"2024-09-13T17:08:20.745489+0000","last_undegraded":"2024-09-13T17:08:20.745489+0000","last_fullsized":"2024-09-13T17:08:20.745489+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:39.426570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535806+0000","last_change":"2024-09-13T17:08:19.745209+0000","last_active":"2024-09-13T17:08:21.535806+0000","last_peered":"2024-09-13T17:08:21.535806+0000","last_clean":"2024-09-13T17:08:21.535806+0000","last_became_active":"2024-09-13T17:08:19.744870+0000","last_became_peered":"2024-09-13T17:08:19.744870+0000","last_unstale":"2024-09-13T17:08:21.535806+0000","last_undegraded":"2024-09-13T17:08:21.535806+0000","last_fullsized":"2024-09-13T17:08:21.535806+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:21.431579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.326214+0000","last_change":"2024-09-13T17:08:19.365328+0000","last_active":"2024-09-13T17:08:21.326214+0000","last_peered":"2024-09-13T17:08:21.326214+0000","last_clean":"2024-09-13T17:08:21.326214+0000","last_became_active":"2024-09-13T17:08:19.365080+0000","last_became_peered":"2024-09-13T17:08:19.365080+0000","last_unstale":"2024-09-13T17:08:21.326214+0000","last_undegraded":"2024-09-13T17:08:21.326214+0000","last_fullsized":"2024-09-13T17:08:21.326214+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:53.900550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.326097+0000","last_change":"2024-09-13T17:08:19.761311+0000","last_active":"2024-09-13T17:08:21.326097+0000","last_peered":"2024-09-13T17:08:21.326097+0000","last_clean":"2024-09-13T17:08:21.326097+0000","last_became_active":"2024-09-13T17:08:19.761044+0000","last_became_peered":"2024-09-13T17:08:19.761044+0000","last_unstale":"2024-09-13T17:08:21.326097+0000","last_undegraded":"2024-09-13T17:08:21.326097+0000","last_fullsized":"2024-09-13T17:08:21.326097+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:07.449197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746508+0000","last_change":"2024-09-13T17:08:19.365417+0000","last_active":"2024-09-13T17:08:20.746508+0000","last_peered":"2024-09-13T17:08:20.746508+0000","last_clean":"2024-09-13T17:08:20.746508+0000","last_became_active":"2024-09-13T17:08:19.365021+0000","last_became_peered":"2024-09-13T17:08:19.365021+0000","last_unstale":"2024-09-13T17:08:20.746508+0000","last_undegraded":"2024-09-13T17:08:20.746508+0000","last_fullsized":"2024-09-13T17:08:20.746508+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:25.592791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.744987+0000","last_change":"2024-09-13T17:08:19.761256+0000","last_active":"2024-09-13T17:08:20.744987+0000","last_peered":"2024-09-13T17:08:20.744987+0000","last_clean":"2024-09-13T17:08:20.744987+0000","last_became_active":"2024-09-13T17:08:19.760999+0000","last_became_peered":"2024-09-13T17:08:19.760999+0000","last_unstale":"2024-09-13T17:08:20.744987+0000","last_undegraded":"2024-09-13T17:08:20.744987+0000","last_fullsized":"2024-09-13T17:08:20.744987+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:38.834515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741928+0000","last_change":"2024-09-13T17:08:19.365531+0000","last_active":"2024-09-13T17:08:20.741928+0000","last_peered":"2024-09-13T17:08:20.741928+0000","last_clean":"2024-09-13T17:08:20.741928+0000","last_became_active":"2024-09-13T17:08:19.363998+0000","last_became_peered":"2024-09-13T17:08:19.363998+0000","last_unstale":"2024-09-13T17:08:20.741928+0000","last_undegraded":"2024-09-13T17:08:20.741928+0000","last_fullsized":"2024-09-13T17:08:20.741928+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:10.099555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537002+0000","last_change":"2024-09-13T17:08:19.752027+0000","last_active":"2024-09-13T17:08:21.537002+0000","last_peered":"2024-09-13T17:08:21.537002+0000","last_clean":"2024-09-13T17:08:21.537002+0000","last_became_active":"2024-09-13T17:08:19.751523+0000","last_became_peered":"2024-09-13T17:08:19.751523+0000","last_unstale":"2024-09-13T17:08:21.537002+0000","last_undegraded":"2024-09-13T17:08:21.537002+0000","last_fullsized":"2024-09-13T17:08:21.537002+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:21.431579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745132+0000","last_change":"2024-09-13T17:08:19.364421+0000","last_active":"2024-09-13T17:08:20.745132+0000","last_peered":"2024-09-13T17:08:20.745132+0000","last_clean":"2024-09-13T17:08:20.745132+0000","last_became_active":"2024-09-13T17:08:19.364112+0000","last_became_peered":"2024-09-13T17:08:19.364112+0000","last_unstale":"2024-09-13T17:08:20.745132+0000","last_undegraded":"2024-09-13T17:08:20.745132+0000","last_fullsized":"2024-09-13T17:08:20.745132+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:10.840044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536072+0000","last_change":"2024-09-13T17:08:19.763783+0000","last_active":"2024-09-13T17:08:21.536072+0000","last_peered":"2024-09-13T17:08:21.536072+0000","last_clean":"2024-09-13T17:08:21.536072+0000","last_became_active":"2024-09-13T17:08:19.763434+0000","last_became_peered":"2024-09-13T17:08:19.763434+0000","last_unstale":"2024-09-13T17:08:21.536072+0000","last_undegraded":"2024-09-13T17:08:21.536072+0000","last_fullsized":"2024-09-13T17:08:21.536072+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:02.147509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535364+0000","last_change":"2024-09-13T17:08:19.367636+0000","last_active":"2024-09-13T17:08:21.535364+0000","last_peered":"2024-09-13T17:08:21.535364+0000","last_clean":"2024-09-13T17:08:21.535364+0000","last_became_active":"2024-09-13T17:08:19.367292+0000","last_became_peered":"2024-09-13T17:08:19.367292+0000","last_unstale":"2024-09-13T17:08:21.535364+0000","last_undegraded":"2024-09-13T17:08:21.535364+0000","last_fullsized":"2024-09-13T17:08:21.535364+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:59.456249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946010+0000","last_change":"2024-09-13T17:08:19.756701+0000","last_active":"2024-09-13T17:08:20.946010+0000","last_peered":"2024-09-13T17:08:20.946010+0000","last_clean":"2024-09-13T17:08:20.946010+0000","last_became_active":"2024-09-13T17:08:19.755062+0000","last_became_peered":"2024-09-13T17:08:19.755062+0000","last_unstale":"2024-09-13T17:08:20.946010+0000","last_undegraded":"2024-09-13T17:08:20.946010+0000","last_fullsized":"2024-09-13T17:08:20.946010+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:55.729072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536701+0000","last_change":"2024-09-13T17:08:19.362103+0000","last_active":"2024-09-13T17:08:21.536701+0000","last_peered":"2024-09-13T17:08:21.536701+0000","last_clean":"2024-09-13T17:08:21.536701+0000","last_became_active":"2024-09-13T17:08:19.361850+0000","last_became_peered":"2024-09-13T17:08:19.361850+0000","last_unstale":"2024-09-13T17:08:21.536701+0000","last_undegraded":"2024-09-13T17:08:21.536701+0000","last_fullsized":"2024-09-13T17:08:21.536701+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.289082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745346+0000","last_change":"2024-09-13T17:08:19.751991+0000","last_active":"2024-09-13T17:08:20.745346+0000","last_peered":"2024-09-13T17:08:20.745346+0000","last_clean":"2024-09-13T17:08:20.745346+0000","last_became_active":"2024-09-13T17:08:19.751472+0000","last_became_peered":"2024-09-13T17:08:19.751472+0000","last_unstale":"2024-09-13T17:08:20.745346+0000","last_undegraded":"2024-09-13T17:08:20.745346+0000","last_fullsized":"2024-09-13T17:08:20.745346+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:40.150544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745507+0000","last_change":"2024-09-13T17:08:19.365047+0000","last_active":"2024-09-13T17:08:20.745507+0000","last_peered":"2024-09-13T17:08:20.745507+0000","last_clean":"2024-09-13T17:08:20.745507+0000","last_became_active":"2024-09-13T17:08:19.364729+0000","last_became_peered":"2024-09-13T17:08:19.364729+0000","last_unstale":"2024-09-13T17:08:20.745507+0000","last_undegraded":"2024-09-13T17:08:20.745507+0000","last_fullsized":"2024-09-13T17:08:20.745507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.289082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746632+0000","last_change":"2024-09-13T17:08:19.743693+0000","last_active":"2024-09-13T17:08:20.746632+0000","last_peered":"2024-09-13T17:08:20.746632+0000","last_clean":"2024-09-13T17:08:20.746632+0000","last_became_active":"2024-09-13T17:08:19.743419+0000","last_became_peered":"2024-09-13T17:08:19.743419+0000","last_unstale":"2024-09-13T17:08:20.746632+0000","last_undegraded":"2024-09-13T17:08:20.746632+0000","last_fullsized":"2024-09-13T17:08:20.746632+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:47.103390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537217+0000","last_change":"2024-09-13T17:08:19.360802+0000","last_active":"2024-09-13T17:08:21.537217+0000","last_peered":"2024-09-13T17:08:21.537217+0000","last_clean":"2024-09-13T17:08:21.537217+0000","last_became_active":"2024-09-13T17:08:19.360356+0000","last_became_peered":"2024-09-13T17:08:19.360356+0000","last_unstale":"2024-09-13T17:08:21.537217+0000","last_undegraded":"2024-09-13T17:08:21.537217+0000","last_fullsized":"2024-09-13T17:08:21.537217+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:52.341051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.742249+0000","last_change":"2024-09-13T17:08:19.762850+0000","last_active":"2024-09-13T17:08:20.742249+0000","last_peered":"2024-09-13T17:08:20.742249+0000","last_clean":"2024-09-13T17:08:20.742249+0000","last_became_active":"2024-09-13T17:08:19.762591+0000","last_became_peered":"2024-09-13T17:08:19.762591+0000","last_unstale":"2024-09-13T17:08:20.742249+0000","last_undegraded":"2024-09-13T17:08:20.742249+0000","last_fullsized":"2024-09-13T17:08:20.742249+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:02.147509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746580+0000","last_change":"2024-09-13T17:08:19.361219+0000","last_active":"2024-09-13T17:08:20.746580+0000","last_peered":"2024-09-13T17:08:20.746580+0000","last_clean":"2024-09-13T17:08:20.746580+0000","last_became_active":"2024-09-13T17:08:19.360790+0000","last_became_peered":"2024-09-13T17:08:19.360790+0000","last_unstale":"2024-09-13T17:08:20.746580+0000","last_undegraded":"2024-09-13T17:08:20.746580+0000","last_fullsized":"2024-09-13T17:08:20.746580+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:11.548180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746276+0000","last_change":"2024-09-13T17:08:19.754796+0000","last_active":"2024-09-13T17:08:20.746276+0000","last_peered":"2024-09-13T17:08:20.746276+0000","last_clean":"2024-09-13T17:08:20.746276+0000","last_became_active":"2024-09-13T17:08:19.754554+0000","last_became_peered":"2024-09-13T17:08:19.754554+0000","last_unstale":"2024-09-13T17:08:20.746276+0000","last_undegraded":"2024-09-13T17:08:20.746276+0000","last_fullsized":"2024-09-13T17:08:20.746276+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:24.955493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.538335+0000","last_change":"2024-09-13T17:08:19.362750+0000","last_active":"2024-09-13T17:08:21.538335+0000","last_peered":"2024-09-13T17:08:21.538335+0000","last_clean":"2024-09-13T17:08:21.538335+0000","last_became_active":"2024-09-13T17:08:19.362430+0000","last_became_peered":"2024-09-13T17:08:19.362430+0000","last_unstale":"2024-09-13T17:08:21.538335+0000","last_undegraded":"2024-09-13T17:08:21.538335+0000","last_fullsized":"2024-09-13T17:08:21.538335+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:06.864218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946452+0000","last_change":"2024-09-13T17:08:19.756888+0000","last_active":"2024-09-13T17:08:20.946452+0000","last_peered":"2024-09-13T17:08:20.946452+0000","last_clean":"2024-09-13T17:08:20.946452+0000","last_became_active":"2024-09-13T17:08:19.754775+0000","last_became_peered":"2024-09-13T17:08:19.754775+0000","last_unstale":"2024-09-13T17:08:20.946452+0000","last_undegraded":"2024-09-13T17:08:20.946452+0000","last_fullsized":"2024-09-13T17:08:20.946452+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:11.103022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.742042+0000","last_change":"2024-09-13T17:08:19.365401+0000","last_active":"2024-09-13T17:08:20.742042+0000","last_peered":"2024-09-13T17:08:20.742042+0000","last_clean":"2024-09-13T17:08:20.742042+0000","last_became_active":"2024-09-13T17:08:19.363655+0000","last_became_peered":"2024-09-13T17:08:19.363655+0000","last_unstale":"2024-09-13T17:08:20.742042+0000","last_undegraded":"2024-09-13T17:08:20.742042+0000","last_fullsized":"2024-09-13T17:08:20.742042+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:08.517632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536349+0000","last_change":"2024-09-13T17:08:19.743227+0000","last_active":"2024-09-13T17:08:21.536349+0000","last_peered":"2024-09-13T17:08:21.536349+0000","last_clean":"2024-09-13T17:08:21.536349+0000","last_became_active":"2024-09-13T17:08:19.742963+0000","last_became_peered":"2024-09-13T17:08:19.742963+0000","last_unstale":"2024-09-13T17:08:21.536349+0000","last_undegraded":"2024-09-13T17:08:21.536349+0000","last_fullsized":"2024-09-13T17:08:21.536349+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:49.433769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746379+0000","last_change":"2024-09-13T17:08:19.362039+0000","last_active":"2024-09-13T17:08:20.746379+0000","last_peered":"2024-09-13T17:08:20.746379+0000","last_clean":"2024-09-13T17:08:20.746379+0000","last_became_active":"2024-09-13T17:08:19.361784+0000","last_became_peered":"2024-09-13T17:08:19.361784+0000","last_unstale":"2024-09-13T17:08:20.746379+0000","last_undegraded":"2024-09-13T17:08:20.746379+0000","last_fullsized":"2024-09-13T17:08:20.746379+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:39.147077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.742512+0000","last_change":"2024-09-13T17:08:19.762334+0000","last_active":"2024-09-13T17:08:20.742512+0000","last_peered":"2024-09-13T17:08:20.742512+0000","last_clean":"2024-09-13T17:08:20.742512+0000","last_became_active":"2024-09-13T17:08:19.760173+0000","last_became_peered":"2024-09-13T17:08:19.760173+0000","last_unstale":"2024-09-13T17:08:20.742512+0000","last_undegraded":"2024-09-13T17:08:20.742512+0000","last_fullsized":"2024-09-13T17:08:20.742512+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:24.955493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741722+0000","last_change":"2024-09-13T17:08:19.364187+0000","last_active":"2024-09-13T17:08:20.741722+0000","last_peered":"2024-09-13T17:08:20.741722+0000","last_clean":"2024-09-13T17:08:20.741722+0000","last_became_active":"2024-09-13T17:08:19.363702+0000","last_became_peered":"2024-09-13T17:08:19.363702+0000","last_unstale":"2024-09-13T17:08:20.741722+0000","last_undegraded":"2024-09-13T17:08:20.741722+0000","last_fullsized":"2024-09-13T17:08:20.741722+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:25.592791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746119+0000","last_change":"2024-09-13T17:08:19.757962+0000","last_active":"2024-09-13T17:08:20.746119+0000","last_peered":"2024-09-13T17:08:20.746119+0000","last_clean":"2024-09-13T17:08:20.746119+0000","last_became_active":"2024-09-13T17:08:19.757339+0000","last_became_peered":"2024-09-13T17:08:19.757339+0000","last_unstale":"2024-09-13T17:08:20.746119+0000","last_undegraded":"2024-09-13T17:08:20.746119+0000","last_fullsized":"2024-09-13T17:08:20.746119+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:45.675880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536941+0000","last_change":"2024-09-13T17:08:19.364685+0000","last_active":"2024-09-13T17:08:21.536941+0000","last_peered":"2024-09-13T17:08:21.536941+0000","last_clean":"2024-09-13T17:08:21.536941+0000","last_became_active":"2024-09-13T17:08:19.364425+0000","last_became_peered":"2024-09-13T17:08:19.364425+0000","last_unstale":"2024-09-13T17:08:21.536941+0000","last_undegraded":"2024-09-13T17:08:21.536941+0000","last_fullsized":"2024-09-13T17:08:21.536941+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:39.426570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.538754+0000","last_change":"2024-09-13T17:08:19.755338+0000","last_active":"2024-09-13T17:08:21.538754+0000","last_peered":"2024-09-13T17:08:21.538754+0000","last_clean":"2024-09-13T17:08:21.538754+0000","last_became_active":"2024-09-13T17:08:19.755047+0000","last_became_peered":"2024-09-13T17:08:19.755047+0000","last_unstale":"2024-09-13T17:08:21.538754+0000","last_undegraded":"2024-09-13T17:08:21.538754+0000","last_fullsized":"2024-09-13T17:08:21.538754+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:53.344519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.538702+0000","last_change":"2024-09-13T17:08:19.368156+0000","last_active":"2024-09-13T17:08:21.538702+0000","last_peered":"2024-09-13T17:08:21.538702+0000","last_clean":"2024-09-13T17:08:21.538702+0000","last_became_active":"2024-09-13T17:08:19.367853+0000","last_became_peered":"2024-09-13T17:08:19.367853+0000","last_unstale":"2024-09-13T17:08:21.538702+0000","last_undegraded":"2024-09-13T17:08:21.538702+0000","last_fullsized":"2024-09-13T17:08:21.538702+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:12.013996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537013+0000","last_change":"2024-09-13T17:08:19.742266+0000","last_active":"2024-09-13T17:08:21.537013+0000","last_peered":"2024-09-13T17:08:21.537013+0000","last_clean":"2024-09-13T17:08:21.537013+0000","last_became_active":"2024-09-13T17:08:19.742032+0000","last_became_peered":"2024-09-13T17:08:19.742032+0000","last_unstale":"2024-09-13T17:08:21.537013+0000","last_undegraded":"2024-09-13T17:08:21.537013+0000","last_fullsized":"2024-09-13T17:08:21.537013+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:06.769269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745598+0000","last_change":"2024-09-13T17:08:19.358796+0000","last_active":"2024-09-13T17:08:20.745598+0000","last_peered":"2024-09-13T17:08:20.745598+0000","last_clean":"2024-09-13T17:08:20.745598+0000","last_became_active":"2024-09-13T17:08:19.358466+0000","last_became_peered":"2024-09-13T17:08:19.358466+0000","last_unstale":"2024-09-13T17:08:20.745598+0000","last_undegraded":"2024-09-13T17:08:20.745598+0000","last_fullsized":"2024-09-13T17:08:20.745598+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:19.847055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946538+0000","last_change":"2024-09-13T17:08:19.766496+0000","last_active":"2024-09-13T17:08:20.946538+0000","last_peered":"2024-09-13T17:08:20.946538+0000","last_clean":"2024-09-13T17:08:20.946538+0000","last_became_active":"2024-09-13T17:08:19.766261+0000","last_became_peered":"2024-09-13T17:08:19.766261+0000","last_unstale":"2024-09-13T17:08:20.946538+0000","last_undegraded":"2024-09-13T17:08:20.946538+0000","last_fullsized":"2024-09-13T17:08:20.946538+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:40.430037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536044+0000","last_change":"2024-09-13T17:08:19.367483+0000","last_active":"2024-09-13T17:08:21.536044+0000","last_peered":"2024-09-13T17:08:21.536044+0000","last_clean":"2024-09-13T17:08:21.536044+0000","last_became_active":"2024-09-13T17:08:19.367207+0000","last_became_peered":"2024-09-13T17:08:19.367207+0000","last_unstale":"2024-09-13T17:08:21.536044+0000","last_undegraded":"2024-09-13T17:08:21.536044+0000","last_fullsized":"2024-09-13T17:08:21.536044+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:53.900550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946636+0000","last_change":"2024-09-13T17:08:19.760520+0000","last_active":"2024-09-13T17:08:20.946636+0000","last_peered":"2024-09-13T17:08:20.946636+0000","last_clean":"2024-09-13T17:08:20.946636+0000","last_became_active":"2024-09-13T17:08:19.760191+0000","last_became_peered":"2024-09-13T17:08:19.760191+0000","last_unstale":"2024-09-13T17:08:20.946636+0000","last_undegraded":"2024-09-13T17:08:20.946636+0000","last_fullsized":"2024-09-13T17:08:20.946636+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:01.948778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.742299+0000","last_change":"2024-09-13T17:08:19.360211+0000","last_active":"2024-09-13T17:08:20.742299+0000","last_peered":"2024-09-13T17:08:20.742299+0000","last_clean":"2024-09-13T17:08:20.742299+0000","last_became_active":"2024-09-13T17:08:19.359960+0000","last_became_peered":"2024-09-13T17:08:19.359960+0000","last_unstale":"2024-09-13T17:08:20.742299+0000","last_undegraded":"2024-09-13T17:08:20.742299+0000","last_fullsized":"2024-09-13T17:08:20.742299+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:54.725605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741875+0000","last_change":"2024-09-13T17:08:19.760098+0000","last_active":"2024-09-13T17:08:20.741875+0000","last_peered":"2024-09-13T17:08:20.741875+0000","last_clean":"2024-09-13T17:08:20.741875+0000","last_became_active":"2024-09-13T17:08:19.759805+0000","last_became_peered":"2024-09-13T17:08:19.759805+0000","last_unstale":"2024-09-13T17:08:20.741875+0000","last_undegraded":"2024-09-13T17:08:20.741875+0000","last_fullsized":"2024-09-13T17:08:20.741875+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:45.675880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.742105+0000","last_change":"2024-09-13T17:08:19.365636+0000","last_active":"2024-09-13T17:08:20.742105+0000","last_peered":"2024-09-13T17:08:20.742105+0000","last_clean":"2024-09-13T17:08:20.742105+0000","last_became_active":"2024-09-13T17:08:19.364423+0000","last_became_peered":"2024-09-13T17:08:19.364423+0000","last_unstale":"2024-09-13T17:08:20.742105+0000","last_undegraded":"2024-09-13T17:08:20.742105+0000","last_fullsized":"2024-09-13T17:08:20.742105+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:19.066287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.325695+0000","last_change":"2024-09-13T17:08:19.757964+0000","last_active":"2024-09-13T17:08:21.325695+0000","last_peered":"2024-09-13T17:08:21.325695+0000","last_clean":"2024-09-13T17:08:21.325695+0000","last_became_active":"2024-09-13T17:08:19.756579+0000","last_became_peered":"2024-09-13T17:08:19.756579+0000","last_unstale":"2024-09-13T17:08:21.325695+0000","last_undegraded":"2024-09-13T17:08:21.325695+0000","last_fullsized":"2024-09-13T17:08:21.325695+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:51.490945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535403+0000","last_change":"2024-09-13T17:08:19.366477+0000","last_active":"2024-09-13T17:08:21.535403+0000","last_peered":"2024-09-13T17:08:21.535403+0000","last_clean":"2024-09-13T17:08:21.535403+0000","last_became_active":"2024-09-13T17:08:19.364728+0000","last_became_peered":"2024-09-13T17:08:19.364728+0000","last_unstale":"2024-09-13T17:08:21.535403+0000","last_undegraded":"2024-09-13T17:08:21.535403+0000","last_fullsized":"2024-09-13T17:08:21.535403+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:54.725605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537144+0000","last_change":"2024-09-13T17:08:19.750951+0000","last_active":"2024-09-13T17:08:21.537144+0000","last_peered":"2024-09-13T17:08:21.537144+0000","last_clean":"2024-09-13T17:08:21.537144+0000","last_became_active":"2024-09-13T17:08:19.750725+0000","last_became_peered":"2024-09-13T17:08:19.750725+0000","last_unstale":"2024-09-13T17:08:21.537144+0000","last_undegraded":"2024-09-13T17:08:21.537144+0000","last_fullsized":"2024-09-13T17:08:21.537144+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:40.430037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536353+0000","last_change":"2024-09-13T17:08:19.364056+0000","last_active":"2024-09-13T17:08:21.536353+0000","last_peered":"2024-09-13T17:08:21.536353+0000","last_clean":"2024-09-13T17:08:21.536353+0000","last_became_active":"2024-09-13T17:08:19.360624+0000","last_became_peered":"2024-09-13T17:08:19.360624+0000","last_unstale":"2024-09-13T17:08:21.536353+0000","last_undegraded":"2024-09-13T17:08:21.536353+0000","last_fullsized":"2024-09-13T17:08:21.536353+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:18.225382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536092+0000","last_change":"2024-09-13T17:08:19.754591+0000","last_active":"2024-09-13T17:08:21.536092+0000","last_peered":"2024-09-13T17:08:21.536092+0000","last_clean":"2024-09-13T17:08:21.536092+0000","last_became_active":"2024-09-13T17:08:19.753107+0000","last_became_peered":"2024-09-13T17:08:19.753107+0000","last_unstale":"2024-09-13T17:08:21.536092+0000","last_undegraded":"2024-09-13T17:08:21.536092+0000","last_fullsized":"2024-09-13T17:08:21.536092+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:45.171781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745731+0000","last_change":"2024-09-13T17:08:19.365792+0000","last_active":"2024-09-13T17:08:20.745731+0000","last_peered":"2024-09-13T17:08:20.745731+0000","last_clean":"2024-09-13T17:08:20.745731+0000","last_became_active":"2024-09-13T17:08:19.365417+0000","last_became_peered":"2024-09-13T17:08:19.365417+0000","last_unstale":"2024-09-13T17:08:20.745731+0000","last_undegraded":"2024-09-13T17:08:20.745731+0000","last_fullsized":"2024-09-13T17:08:20.745731+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:50.487478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.946994+0000","last_change":"2024-09-13T17:08:19.760440+0000","last_active":"2024-09-13T17:08:20.946994+0000","last_peered":"2024-09-13T17:08:20.946994+0000","last_clean":"2024-09-13T17:08:20.946994+0000","last_became_active":"2024-09-13T17:08:19.758137+0000","last_became_peered":"2024-09-13T17:08:19.758137+0000","last_unstale":"2024-09-13T17:08:20.946994+0000","last_undegraded":"2024-09-13T17:08:20.946994+0000","last_fullsized":"2024-09-13T17:08:20.946994+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:07.449197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.742056+0000","last_change":"2024-09-13T17:08:19.359847+0000","last_active":"2024-09-13T17:08:20.742056+0000","last_peered":"2024-09-13T17:08:20.742056+0000","last_clean":"2024-09-13T17:08:20.742056+0000","last_became_active":"2024-09-13T17:08:19.359475+0000","last_became_peered":"2024-09-13T17:08:19.359475+0000","last_unstale":"2024-09-13T17:08:20.742056+0000","last_undegraded":"2024-09-13T17:08:20.742056+0000","last_fullsized":"2024-09-13T17:08:20.742056+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:06.445730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536841+0000","last_change":"2024-09-13T17:08:19.752213+0000","last_active":"2024-09-13T17:08:21.536841+0000","last_peered":"2024-09-13T17:08:21.536841+0000","last_clean":"2024-09-13T17:08:21.536841+0000","last_became_active":"2024-09-13T17:08:19.751951+0000","last_became_peered":"2024-09-13T17:08:19.751951+0000","last_unstale":"2024-09-13T17:08:21.536841+0000","last_undegraded":"2024-09-13T17:08:21.536841+0000","last_fullsized":"2024-09-13T17:08:21.536841+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:23.358525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746655+0000","last_change":"2024-09-13T17:08:19.361044+0000","last_active":"2024-09-13T17:08:20.746655+0000","last_peered":"2024-09-13T17:08:20.746655+0000","last_clean":"2024-09-13T17:08:20.746655+0000","last_became_active":"2024-09-13T17:08:19.360492+0000","last_became_peered":"2024-09-13T17:08:19.360492+0000","last_unstale":"2024-09-13T17:08:20.746655+0000","last_undegraded":"2024-09-13T17:08:20.746655+0000","last_fullsized":"2024-09-13T17:08:20.746655+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:37.831047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746388+0000","last_change":"2024-09-13T17:08:19.747529+0000","last_active":"2024-09-13T17:08:20.746388+0000","last_peered":"2024-09-13T17:08:20.746388+0000","last_clean":"2024-09-13T17:08:20.746388+0000","last_became_active":"2024-09-13T17:08:19.747033+0000","last_became_peered":"2024-09-13T17:08:19.747033+0000","last_unstale":"2024-09-13T17:08:20.746388+0000","last_undegraded":"2024-09-13T17:08:20.746388+0000","last_fullsized":"2024-09-13T17:08:20.746388+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:06.769269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.325653+0000","last_change":"2024-09-13T17:08:19.365608+0000","last_active":"2024-09-13T17:08:21.325653+0000","last_peered":"2024-09-13T17:08:21.325653+0000","last_clean":"2024-09-13T17:08:21.325653+0000","last_became_active":"2024-09-13T17:08:19.365337+0000","last_became_peered":"2024-09-13T17:08:19.365337+0000","last_unstale":"2024-09-13T17:08:21.325653+0000","last_undegraded":"2024-09-13T17:08:21.325653+0000","last_fullsized":"2024-09-13T17:08:21.325653+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:54.725605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741953+0000","last_change":"2024-09-13T17:08:19.762118+0000","last_active":"2024-09-13T17:08:20.741953+0000","last_peered":"2024-09-13T17:08:20.741953+0000","last_clean":"2024-09-13T17:08:20.741953+0000","last_became_active":"2024-09-13T17:08:19.760370+0000","last_became_peered":"2024-09-13T17:08:19.760370+0000","last_unstale":"2024-09-13T17:08:20.741953+0000","last_undegraded":"2024-09-13T17:08:20.741953+0000","last_fullsized":"2024-09-13T17:08:20.741953+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:45.783700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.746290+0000","last_change":"2024-09-13T17:08:19.359060+0000","last_active":"2024-09-13T17:08:20.746290+0000","last_peered":"2024-09-13T17:08:20.746290+0000","last_clean":"2024-09-13T17:08:20.746290+0000","last_became_active":"2024-09-13T17:08:19.358740+0000","last_became_peered":"2024-09-13T17:08:19.358740+0000","last_unstale":"2024-09-13T17:08:20.746290+0000","last_undegraded":"2024-09-13T17:08:20.746290+0000","last_fullsized":"2024-09-13T17:08:20.746290+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:06.445730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.741910+0000","last_change":"2024-09-13T17:08:19.762505+0000","last_active":"2024-09-13T17:08:20.741910+0000","last_peered":"2024-09-13T17:08:20.741910+0000","last_clean":"2024-09-13T17:08:20.741910+0000","last_became_active":"2024-09-13T17:08:19.762173+0000","last_became_peered":"2024-09-13T17:08:19.762173+0000","last_unstale":"2024-09-13T17:08:20.741910+0000","last_undegraded":"2024-09-13T17:08:20.741910+0000","last_fullsized":"2024-09-13T17:08:20.741910+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:23.441619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.745280+0000","last_change":"2024-09-13T17:08:19.367697+0000","last_active":"2024-09-13T17:08:20.745280+0000","last_peered":"2024-09-13T17:08:20.745280+0000","last_clean":"2024-09-13T17:08:20.745280+0000","last_became_active":"2024-09-13T17:08:19.367415+0000","last_became_peered":"2024-09-13T17:08:19.367415+0000","last_unstale":"2024-09-13T17:08:20.745280+0000","last_undegraded":"2024-09-13T17:08:20.745280+0000","last_fullsized":"2024-09-13T17:08:20.745280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:38.264810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.535326+0000","last_change":"2024-09-13T17:08:19.758407+0000","last_active":"2024-09-13T17:08:21.535326+0000","last_peered":"2024-09-13T17:08:21.535326+0000","last_clean":"2024-09-13T17:08:21.535326+0000","last_became_active":"2024-09-13T17:08:19.758077+0000","last_became_peered":"2024-09-13T17:08:19.758077+0000","last_unstale":"2024-09-13T17:08:21.535326+0000","last_undegraded":"2024-09-13T17:08:21.535326+0000","last_fullsized":"2024-09-13T17:08:21.535326+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:45.171781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.325714+0000","last_change":"2024-09-13T17:08:19.361977+0000","last_active":"2024-09-13T17:08:21.325714+0000","last_peered":"2024-09-13T17:08:21.325714+0000","last_clean":"2024-09-13T17:08:21.325714+0000","last_became_active":"2024-09-13T17:08:19.361397+0000","last_became_peered":"2024-09-13T17:08:19.361397+0000","last_unstale":"2024-09-13T17:08:21.325714+0000","last_undegraded":"2024-09-13T17:08:21.325714+0000","last_fullsized":"2024-09-13T17:08:21.325714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:59.456249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:20.744791+0000","last_change":"2024-09-13T17:08:19.765347+0000","last_active":"2024-09-13T17:08:20.744791+0000","last_peered":"2024-09-13T17:08:20.744791+0000","last_clean":"2024-09-13T17:08:20.744791+0000","last_became_active":"2024-09-13T17:08:19.765007+0000","last_became_peered":"2024-09-13T17:08:19.765007+0000","last_unstale":"2024-09-13T17:08:20.744791+0000","last_undegraded":"2024-09-13T17:08:20.744791+0000","last_fullsized":"2024-09-13T17:08:20.744791+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:11.103022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537158+0000","last_change":"2024-09-13T17:08:19.370718+0000","last_active":"2024-09-13T17:08:21.537158+0000","last_peered":"2024-09-13T17:08:21.537158+0000","last_clean":"2024-09-13T17:08:21.537158+0000","last_became_active":"2024-09-13T17:08:19.370285+0000","last_became_peered":"2024-09-13T17:08:19.370285+0000","last_unstale":"2024-09-13T17:08:21.537158+0000","last_undegraded":"2024-09-13T17:08:21.537158+0000","last_fullsized":"2024-09-13T17:08:21.537158+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:19.847055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.537122+0000","last_change":"2024-09-13T17:08:19.742254+0000","last_active":"2024-09-13T17:08:21.537122+0000","last_peered":"2024-09-13T17:08:21.537122+0000","last_clean":"2024-09-13T17:08:21.537122+0000","last_became_active":"2024-09-13T17:08:19.742015+0000","last_became_peered":"2024-09-13T17:08:19.742015+0000","last_unstale":"2024-09-13T17:08:21.537122+0000","last_undegraded":"2024-09-13T17:08:21.537122+0000","last_fullsized":"2024-09-13T17:08:21.537122+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:19.336648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:19.336648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:34.642224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:08:21.536130+0000","last_change":"2024-09-13T17:08:19.370236+0000","last_active":"2024-09-13T17:08:21.536130+0000","last_peered":"2024-09-13T17:08:21.536130+0000","last_clean":"2024-09-13T17:08:21.536130+0000","last_became_active":"2024-09-13T17:08:19.370035+0000","last_became_peered":"2024-09-13T17:08:19.370035+0000","last_unstale":"2024-09-13T17:08:21.536130+0000","last_undegraded":"2024-09-13T17:08:21.536130+0000","last_fullsized":"2024-09-13T17:08:21.536130+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:18.333181+0000","last_clean_scrub_stamp":"2024-09-13T17:08:18.333181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:12.639857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T17:08:19.736971+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:08:19.736971+0000","last_peered":"2024-09-13T17:08:19.736971+0000","last_clean":"2024-09-13T17:08:19.736971+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:08:19.736971+0000","last_undegraded":"2024-09-13T17:08:19.736971+0000","last_fullsized":"2024-09-13T17:08:19.736971+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1138688,"data_stored":810852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.748},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.1020000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.0740000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.006}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.81200000000000006}]},{"osd":4,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.038}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.65700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":221066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.88300000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.143},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.1619999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.76100000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.262}]},{"osd":4,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.115}]},{"osd":5,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.081}]},{"osd":7,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.518}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":214164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.92600000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.099}]},{"osd":2,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.75}]},{"osd":3,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.995},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1579999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:07:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.131},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.036}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":221958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":1.119},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.96699999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.2310000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.4370000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":1.0740000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.478}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.304}]},{"osd":7,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.401},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.371}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":552960,"data_stored":221032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.74199999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.93300000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.008}]},{"osd":7,"last update":"Fri Sep 13 17:07:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.0189999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":544768,"data_stored":215680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.495},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.58799999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.0109999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.1060000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.0309999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":214164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.497},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.81599999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.76500000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.0269999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.1519999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.224},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.86899999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.329}]},{"osd":7,"last update":"Fri Sep 13 17:07:39 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.5720000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1138688,"data_stored":810796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.25,"5min":3.25,"15min":3.25},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.5590000000000002,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":6.4089999999999998,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.7060000000000004,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":6.2729999999999997,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.96499999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":5.3019999999999996,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.9039999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":4.2599999999999998,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":4.0999999999999996,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.86699999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:07:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":5.7510000000000003,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":0.65600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:08:24.133 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:08:24.133 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T17:08:24.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc8a08700 1 Processor -- start 2024-09-13T17:08:24.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc8a08700 1 -- start start 2024-09-13T17:08:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc8a08700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7dc415c9e0 0x7f7dc40cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc8a08700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc40ad0a0 con 0x7f7dc40ad530 2024-09-13T17:08:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc8a08700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc40734f0 con 0x7f7dc40b2640 2024-09-13T17:08:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc8a08700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40cfb20 con 0x7f7dc415c9e0 2024-09-13T17:08:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc2ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7dc40ad530 0x7f7dc40b1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39274/0 (socket says 172.21.15.123:39274) 2024-09-13T17:08:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc2ffd700 1 -- 172.21.15.123:0/2202730219 learned_addr learned my addr 172.21.15.123:0/2202730219 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc37fe700 1 --2- 172.21.15.123:0/2202730219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7dc415c9e0 0x7f7dc40cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835084049 0 0) 0x7f7dc40ad0a0 con 0x7f7dc40ad530 2024-09-13T17:08:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7db00035d0 con 0x7f7dc40ad530 2024-09-13T17:08:24.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718052348 0 0) 0x7f7dc40734f0 con 0x7f7dc40b2640 2024-09-13T17:08:24.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc40ad0a0 con 0x7f7dc40b2640 2024-09-13T17:08:24.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 927817387 0 0) 0x7f7db00035d0 con 0x7f7dc40ad530 2024-09-13T17:08:24.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7dc415c9e0 msgr2=0x7f7dc40cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:24.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 --2- 172.21.15.123:0/2202730219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7dc415c9e0 0x7f7dc40cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 >> v1:172.21.15.153:6789/0 conn(0x7f7dc40b2640 legacy=0x7f7dc4160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc40cf840 con 0x7f7dc40ad530 2024-09-13T17:08:24.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f7dac001670 con 0x7f7dc40ad530 2024-09-13T17:08:24.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 >> v1:172.21.15.123:6789/0 conn(0x7f7dc40ad530 legacy=0x7f7dc40b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 --2- 172.21.15.123:0/2202730219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7dc415c9e0 0x7f7db0003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 --2- 172.21.15.123:0/2202730219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db0004190 0x7f7db0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 --2- 172.21.15.123:0/2202730219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db0004db0 0x7f7db0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40cfb20 con 0x7f7db0004190 2024-09-13T17:08:24.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db000bb70 con 0x7f7db0004db0 2024-09-13T17:08:24.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.252+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db000bd30 con 0x7f7dc415c9e0 2024-09-13T17:08:24.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc2ffd700 1 --2- 172.21.15.123:0/2202730219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db0004190 0x7f7db0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc37fe700 1 --2- 172.21.15.123:0/2202730219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7dc415c9e0 0x7f7db0003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc3fff700 1 --2- 172.21.15.123:0/2202730219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db0004db0 0x7f7db0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc2ffd700 1 -- 172.21.15.123:0/2202730219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7dc415c9e0 msgr2=0x7f7db0003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:24.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc2ffd700 1 --2- 172.21.15.123:0/2202730219 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7dc415c9e0 0x7f7db0003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc2ffd700 1 -- 172.21.15.123:0/2202730219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db0004db0 msgr2=0x7f7db0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:24.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc2ffd700 1 --2- 172.21.15.123:0/2202730219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db0004db0 0x7f7db0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc2ffd700 1 -- 172.21.15.123:0/2202730219 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db00035d0 con 0x7f7db0004190 2024-09-13T17:08:24.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc2ffd700 1 --2- 172.21.15.123:0/2202730219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db0004190 0x7f7db0004870 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7dac00c160 tx=0x7f7db00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6822c4cee4c483e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:24.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac00cbe0 con 0x7f7db0004190 2024-09-13T17:08:24.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac00cd40 con 0x7f7db0004190 2024-09-13T17:08:24.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc27fc700 1 -- 172.21.15.123:0/2202730219 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac005bc0 con 0x7f7db0004190 2024-09-13T17:08:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2202730219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db0004190 msgr2=0x7f7db0004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc8a08700 1 --2- 172.21.15.123:0/2202730219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7db0004190 0x7f7db0004870 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7dac00c160 tx=0x7f7db00058a0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc3fff700 1 -- 172.21.15.123:0/2202730219 reap_dead start 2024-09-13T17:08:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2202730219 shutdown_connections 2024-09-13T17:08:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2202730219 >> 172.21.15.123:0/2202730219 conn(0x7f7dc406f280 msgr2=0x7f7dc406f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2202730219 shutdown_connections 2024-09-13T17:08:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.256+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2202730219 wait complete. 2024-09-13T17:08:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc8a08700 1 Processor -- start 2024-09-13T17:08:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc8a08700 1 -- start start 2024-09-13T17:08:24.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc8a08700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db0004190 0x7f7dc4146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc8a08700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc415de30 0x7f7dc415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc8a08700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7dc415afc0 0x7f7dc415b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc8a08700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4146fa0 con 0x7f7dc415de30 2024-09-13T17:08:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc8a08700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc415b980 con 0x7f7db0004190 2024-09-13T17:08:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc8a08700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc415e8f0 con 0x7f7dc415afc0 2024-09-13T17:08:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc415de30 0x7f7dc415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc415de30 0x7f7dc415e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46490/0 (socket says 172.21.15.123:46490) 2024-09-13T17:08:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc2ffd700 1 -- 172.21.15.123:0/2323987869 learned_addr learned my addr 172.21.15.123:0/2323987869 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc37fe700 1 --2- 172.21.15.123:0/2323987869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db0004190 0x7f7dc4146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc3fff700 1 --2- 172.21.15.123:0/2323987869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7dc415afc0 0x7f7dc415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc2ffd700 1 -- 172.21.15.123:0/2323987869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7dc415afc0 msgr2=0x7f7dc415b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc2ffd700 1 --2- 172.21.15.123:0/2323987869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7dc415afc0 0x7f7dc415b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc2ffd700 1 -- 172.21.15.123:0/2323987869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db0004190 msgr2=0x7f7dc4146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc2ffd700 1 --2- 172.21.15.123:0/2323987869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db0004190 0x7f7dc4146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc2ffd700 1 -- 172.21.15.123:0/2323987869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc415ebd0 con 0x7f7dc415de30 2024-09-13T17:08:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc2ffd700 1 --2- 172.21.15.123:0/2323987869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc415de30 0x7f7dc415e2b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7dac001eb0 tx=0x7f7dac001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dbbfff700 1 -- 172.21.15.123:0/2323987869 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac0072d0 con 0x7f7dc415de30 2024-09-13T17:08:24.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dbbfff700 1 -- 172.21.15.123:0/2323987869 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac007430 con 0x7f7dc415de30 2024-09-13T17:08:24.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2323987869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc4146fa0 con 0x7f7dc415de30 2024-09-13T17:08:24.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dbbfff700 1 -- 172.21.15.123:0/2323987869 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac0077e0 con 0x7f7dc415de30 2024-09-13T17:08:24.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.260+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2323987869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc415f190 con 0x7f7dc415de30 2024-09-13T17:08:24.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.264+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2323987869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc4074240 con 0x7f7dc415de30 2024-09-13T17:08:24.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.264+0000 7f7dbbfff700 1 -- 172.21.15.123:0/2323987869 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7dac019030 con 0x7f7dc415de30 2024-09-13T17:08:24.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.264+0000 7f7dbbfff700 1 --2- 172.21.15.123:0/2323987869 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7da4066730 0x7f7da4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.264+0000 7f7dbbfff700 1 -- 172.21.15.123:0/2323987869 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dac085530 con 0x7f7dc415de30 2024-09-13T17:08:24.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.264+0000 7f7dc37fe700 1 --2- 172.21.15.123:0/2323987869 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7da4066730 0x7f7da4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.264+0000 7f7dc37fe700 1 --2- 172.21.15.123:0/2323987869 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7da4066730 0x7f7da4068bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009b90 tx=0x7f7dbc009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:24.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.272+0000 7f7dbbfff700 1 -- 172.21.15.123:0/2323987869 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7dac052930 con 0x7f7dc415de30 2024-09-13T17:08:24.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.504+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2323987869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7dc4161070 con 0x7f7dc415de30 2024-09-13T17:08:24.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.508+0000 7f7dbbfff700 1 -- 172.21.15.123:0/2323987869 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7dac01ae60 con 0x7f7dc415de30 2024-09-13T17:08:24.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.512+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2323987869 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7da4066730 msgr2=0x7f7da4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.512+0000 7f7dc8a08700 1 --2- 172.21.15.123:0/2323987869 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7da4066730 0x7f7da4068bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009b90 tx=0x7f7dbc009240 comp rx=0 tx=0).stop 2024-09-13T17:08:24.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.512+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2323987869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc415de30 msgr2=0x7f7dc415e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.512+0000 7f7dc8a08700 1 --2- 172.21.15.123:0/2323987869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc415de30 0x7f7dc415e2b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7dac001eb0 tx=0x7f7dac001930 comp rx=0 tx=0).stop 2024-09-13T17:08:24.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.512+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2323987869 shutdown_connections 2024-09-13T17:08:24.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.512+0000 7f7dc8a08700 1 --2- 172.21.15.123:0/2323987869 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7da4066730 0x7f7da4068bf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.512+0000 7f7dc8a08700 1 --2- 172.21.15.123:0/2323987869 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7dc415afc0 0x7f7dc415b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.512+0000 7f7dc8a08700 1 --2- 172.21.15.123:0/2323987869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc415de30 0x7f7dc415e2b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.512+0000 7f7dc8a08700 1 --2- 172.21.15.123:0/2323987869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db0004190 0x7f7dc4146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.512+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2323987869 >> 172.21.15.123:0/2323987869 conn(0x7f7dc406f280 msgr2=0x7f7dc40cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:24.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.512+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2323987869 shutdown_connections 2024-09-13T17:08:24.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.512+0000 7f7dc8a08700 1 -- 172.21.15.123:0/2323987869 wait complete. 2024-09-13T17:08:24.516 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-13T17:08:24.528 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:08:24.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff3a85700 1 Processor -- start 2024-09-13T17:08:24.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff3a85700 1 -- start start 2024-09-13T17:08:24.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff3a85700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4fec15aa80 0x7f4fec15b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff3a85700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4fec0cec90 0x7f4fec0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff3a85700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fec0b1cf0 con 0x7f4fec072510 2024-09-13T17:08:24.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff3a85700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fec0cf680 con 0x7f4fec0cec90 2024-09-13T17:08:24.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff3a85700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec15ae60 con 0x7f4fec15aa80 2024-09-13T17:08:24.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff1020700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4fec072510 0x7f4fec0cccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39276/0 (socket says 172.21.15.123:39276) 2024-09-13T17:08:24.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff1020700 1 -- 172.21.15.123:0/590669321 learned_addr learned my addr 172.21.15.123:0/590669321 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:24.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff2022700 1 --2- 172.21.15.123:0/590669321 >> v2:172.21.15.123:3300/0 conn(0x7f4fec0cec90 0x7f4fec0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 -- 172.21.15.123:0/590669321 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852143108 0 0) 0x7f4fec0b1cf0 con 0x7f4fec072510 2024-09-13T17:08:24.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff1821700 1 --2- 172.21.15.123:0/590669321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4fec15aa80 0x7f4fec15b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 -- 172.21.15.123:0/590669321 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fd80035d0 con 0x7f4fec072510 2024-09-13T17:08:24.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 -- 172.21.15.123:0/590669321 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3025435049 0 0) 0x7f4fd80035d0 con 0x7f4fec072510 2024-09-13T17:08:24.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 -- 172.21.15.123:0/590669321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4fec15aa80 msgr2=0x7f4fec15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:24.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 --2- 172.21.15.123:0/590669321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4fec15aa80 0x7f4fec15b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 -- 172.21.15.123:0/590669321 >> v2:172.21.15.123:3300/0 conn(0x7f4fec0cec90 msgr2=0x7f4fec0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:24.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 --2- 172.21.15.123:0/590669321 >> v2:172.21.15.123:3300/0 conn(0x7f4fec0cec90 0x7f4fec0cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 -- 172.21.15.123:0/590669321 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec15bf00 con 0x7f4fec072510 2024-09-13T17:08:24.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 -- 172.21.15.123:0/590669321 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f4fdc001670 con 0x7f4fec072510 2024-09-13T17:08:24.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 -- 172.21.15.123:0/590669321 >> v1:172.21.15.123:6789/0 conn(0x7f4fec072510 legacy=0x7f4fec0cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 --2- 172.21.15.123:0/590669321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd8003a20 0x7f4fd8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 --2- 172.21.15.123:0/590669321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4fec15aa80 0x7f4fd8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 --2- 172.21.15.123:0/590669321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fd8004db0 0x7f4fd8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 -- 172.21.15.123:0/590669321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec0cf680 con 0x7f4fd8004db0 2024-09-13T17:08:24.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 -- 172.21.15.123:0/590669321 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd800ba30 con 0x7f4fd8003a20 2024-09-13T17:08:24.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 -- 172.21.15.123:0/590669321 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd800bb70 con 0x7f4fec15aa80 2024-09-13T17:08:24.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff2022700 1 --2- 172.21.15.123:0/590669321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fd8004db0 0x7f4fd8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff1020700 1 --2- 172.21.15.123:0/590669321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4fec15aa80 0x7f4fd8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff1821700 1 --2- 172.21.15.123:0/590669321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd8003a20 0x7f4fd8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff2022700 1 -- 172.21.15.123:0/590669321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4fec15aa80 msgr2=0x7f4fd8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:24.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff2022700 1 --2- 172.21.15.123:0/590669321 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4fec15aa80 0x7f4fd8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff2022700 1 -- 172.21.15.123:0/590669321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd8003a20 msgr2=0x7f4fd8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:24.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff2022700 1 --2- 172.21.15.123:0/590669321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd8003a20 0x7f4fd8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff2022700 1 -- 172.21.15.123:0/590669321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80035d0 con 0x7f4fd8004db0 2024-09-13T17:08:24.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff2022700 1 --2- 172.21.15.123:0/590669321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fd8004db0 0x7f4fd8005230 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009b70 tx=0x7f4fd80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fd5279246f6687 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:24.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.636+0000 7f4ff081f700 1 -- 172.21.15.123:0/590669321 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe400e6c0 con 0x7f4fd8004db0 2024-09-13T17:08:24.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.640+0000 7f4ff081f700 1 -- 172.21.15.123:0/590669321 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe400e820 con 0x7f4fd8004db0 2024-09-13T17:08:24.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.640+0000 7f4ff081f700 1 -- 172.21.15.123:0/590669321 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe400eb90 con 0x7f4fd8004db0 2024-09-13T17:08:24.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.640+0000 7f4ff3a85700 1 -- 172.21.15.123:0/590669321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fd8004db0 msgr2=0x7f4fd8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.640+0000 7f4ff3a85700 1 --2- 172.21.15.123:0/590669321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fd8004db0 0x7f4fd8005230 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009b70 tx=0x7f4fd80058a0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.640+0000 7f4ff2022700 1 -- 172.21.15.123:0/590669321 reap_dead start 2024-09-13T17:08:24.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.640+0000 7f4ff3a85700 1 -- 172.21.15.123:0/590669321 shutdown_connections 2024-09-13T17:08:24.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.640+0000 7f4ff3a85700 1 -- 172.21.15.123:0/590669321 >> 172.21.15.123:0/590669321 conn(0x7f4fec066570 msgr2=0x7f4fec066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:24.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.640+0000 7f4ff3a85700 1 -- 172.21.15.123:0/590669321 shutdown_connections 2024-09-13T17:08:24.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.640+0000 7f4ff3a85700 1 -- 172.21.15.123:0/590669321 wait complete. 2024-09-13T17:08:24.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.640+0000 7f4ff3a85700 1 Processor -- start 2024-09-13T17:08:24.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.640+0000 7f4ff3a85700 1 -- start start 2024-09-13T17:08:24.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.640+0000 7f4ff3a85700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd8004db0 0x7f4fec14b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.640+0000 7f4ff3a85700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fec1541d0 0x7f4fec14d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.640+0000 7f4ff3a85700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4fec14da50 0x7f4fec0b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff3a85700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec0ae450 con 0x7f4fec1541d0 2024-09-13T17:08:24.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff3a85700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec0ae630 con 0x7f4fd8004db0 2024-09-13T17:08:24.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff3a85700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec0ae910 con 0x7f4fec14da50 2024-09-13T17:08:24.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff1020700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fec1541d0 0x7f4fec14d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff1020700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fec1541d0 0x7f4fec14d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46518/0 (socket says 172.21.15.123:46518) 2024-09-13T17:08:24.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff1020700 1 -- 172.21.15.123:0/2252438228 learned_addr learned my addr 172.21.15.123:0/2252438228 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:24.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff1821700 1 --2- 172.21.15.123:0/2252438228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd8004db0 0x7f4fec14b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff2022700 1 --2- 172.21.15.123:0/2252438228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4fec14da50 0x7f4fec0b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff1020700 1 -- 172.21.15.123:0/2252438228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4fec14da50 msgr2=0x7f4fec0b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff1020700 1 --2- 172.21.15.123:0/2252438228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4fec14da50 0x7f4fec0b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff1020700 1 -- 172.21.15.123:0/2252438228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd8004db0 msgr2=0x7f4fec14b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff1020700 1 --2- 172.21.15.123:0/2252438228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd8004db0 0x7f4fec14b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff1020700 1 -- 172.21.15.123:0/2252438228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec0aebf0 con 0x7f4fec1541d0 2024-09-13T17:08:24.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff1020700 1 --2- 172.21.15.123:0/2252438228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fec1541d0 0x7f4fec14d510 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc000fb0 tx=0x7f4fdc0075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:24.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4fe27fc700 1 -- 172.21.15.123:0/2252438228 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0077d0 con 0x7f4fec1541d0 2024-09-13T17:08:24.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4fe27fc700 1 -- 172.21.15.123:0/2252438228 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fdc00f8d0 con 0x7f4fec1541d0 2024-09-13T17:08:24.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff3a85700 1 -- 172.21.15.123:0/2252438228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fec0aeed0 con 0x7f4fec1541d0 2024-09-13T17:08:24.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4fe27fc700 1 -- 172.21.15.123:0/2252438228 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc00fc80 con 0x7f4fec1541d0 2024-09-13T17:08:24.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff3a85700 1 -- 172.21.15.123:0/2252438228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fec14bca0 con 0x7f4fec1541d0 2024-09-13T17:08:24.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4ff3a85700 1 -- 172.21.15.123:0/2252438228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fec0b3150 con 0x7f4fec1541d0 2024-09-13T17:08:24.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.644+0000 7f4fe27fc700 1 -- 172.21.15.123:0/2252438228 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4fdc01d460 con 0x7f4fec1541d0 2024-09-13T17:08:24.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.648+0000 7f4fe27fc700 1 --2- 172.21.15.123:0/2252438228 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4fd0066730 0x7f4fd0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:24.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.648+0000 7f4fe27fc700 1 -- 172.21.15.123:0/2252438228 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fdc084120 con 0x7f4fec1541d0 2024-09-13T17:08:24.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.648+0000 7f4ff1821700 1 --2- 172.21.15.123:0/2252438228 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4fd0066730 0x7f4fd0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:24.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.648+0000 7f4ff1821700 1 --2- 172.21.15.123:0/2252438228 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4fd0066730 0x7f4fd0068bf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8014450 tx=0x7f4fe800b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:24.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.652+0000 7f4fe27fc700 1 -- 172.21.15.123:0/2252438228 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4fdc051520 con 0x7f4fec1541d0 2024-09-13T17:08:24.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.860+0000 7f4ff3a85700 1 -- 172.21.15.123:0/2252438228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fec0cf140 con 0x7f4fec1541d0 2024-09-13T17:08:24.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.860+0000 7f4fe27fc700 1 -- 172.21.15.123:0/2252438228 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f4fdc054b40 con 0x7f4fec1541d0 2024-09-13T17:08:24.865 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:24.865 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5602,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3264962321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3264962321},{"type":"v1","addr":"172.21.15.153:6833","nonce":3264962321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5605,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1200497874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1200497874},{"type":"v1","addr":"172.21.15.153:6835","nonce":1200497874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/398437513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":398437513},{"type":"v1","addr":"172.21.15.123:6835","nonce":398437513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:08:19.726019+0000","modified":"2024-09-13T17:08:22.746133+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5730},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5730":{"gid":5730,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2449786141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2449786141},{"type":"v1","addr":"172.21.15.123:6837","nonce":2449786141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:08:24.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.864+0000 7f4ff3a85700 1 -- 172.21.15.123:0/2252438228 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4fd0066730 msgr2=0x7f4fd0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.864+0000 7f4ff3a85700 1 --2- 172.21.15.123:0/2252438228 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4fd0066730 0x7f4fd0068bf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8014450 tx=0x7f4fe800b040 comp rx=0 tx=0).stop 2024-09-13T17:08:24.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.864+0000 7f4ff3a85700 1 -- 172.21.15.123:0/2252438228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fec1541d0 msgr2=0x7f4fec14d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:24.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.864+0000 7f4ff3a85700 1 --2- 172.21.15.123:0/2252438228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fec1541d0 0x7f4fec14d510 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc000fb0 tx=0x7f4fdc0075f0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.864+0000 7f4ff3a85700 1 -- 172.21.15.123:0/2252438228 shutdown_connections 2024-09-13T17:08:24.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.864+0000 7f4ff3a85700 1 --2- 172.21.15.123:0/2252438228 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4fd0066730 0x7f4fd0068bf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.864+0000 7f4ff3a85700 1 --2- 172.21.15.123:0/2252438228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4fec14da50 0x7f4fec0b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.864+0000 7f4ff3a85700 1 --2- 172.21.15.123:0/2252438228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fec1541d0 0x7f4fec14d510 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.864+0000 7f4ff3a85700 1 --2- 172.21.15.123:0/2252438228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd8004db0 0x7f4fec14b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:24.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.864+0000 7f4ff3a85700 1 -- 172.21.15.123:0/2252438228 >> 172.21.15.123:0/2252438228 conn(0x7f4fec066570 msgr2=0x7f4fec15ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:24.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.864+0000 7f4ff3a85700 1 -- 172.21.15.123:0/2252438228 shutdown_connections 2024-09-13T17:08:24.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:24.864+0000 7f4ff3a85700 1 -- 172.21.15.123:0/2252438228 wait complete. 2024-09-13T17:08:24.869 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 21 2024-09-13T17:08:25.283 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:08:19.726019+0000', 'modified': '2024-09-13T17:08:22.746133+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5730}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5730': {'gid': 5730, 'name': 'c', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6837/2449786141', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6836', 'nonce': 2449786141}, {'type': 'v1', 'addr': '172.21.15.123:6837', 'nonce': 2449786141}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:08:25.283 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:08:25.284 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T17:08:25.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e75121700 1 Processor -- start 2024-09-13T17:08:25.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e75121700 1 -- start start 2024-09-13T17:08:25.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e75121700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0e700b58b0 0x7f0e700d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e75121700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e700cd5e0 0x7f0e700cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e75121700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e700b0060 con 0x7f0e700d0f40 2024-09-13T17:08:25.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e75121700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e700b0340 con 0x7f0e700b58b0 2024-09-13T17:08:25.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e75121700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700b0620 con 0x7f0e700cd5e0 2024-09-13T17:08:25.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e6ffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0e700d0f40 0x7f0e700d1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39288/0 (socket says 172.21.15.123:39288) 2024-09-13T17:08:25.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e6ffff700 1 -- 172.21.15.123:0/1570199349 learned_addr learned my addr 172.21.15.123:0/1570199349 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:25.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e74920700 1 --2- 172.21.15.123:0/1570199349 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e700cd5e0 0x7f0e700cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e6f7fe700 1 --2- 172.21.15.123:0/1570199349 >> v2:172.21.15.153:3300/0 conn(0x7f0e700b58b0 0x7f0e700d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e6effd700 1 -- 172.21.15.123:0/1570199349 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936227333 0 0) 0x7f0e700b0060 con 0x7f0e700d0f40 2024-09-13T17:08:25.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e6effd700 1 -- 172.21.15.123:0/1570199349 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e580035d0 con 0x7f0e700d0f40 2024-09-13T17:08:25.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e74920700 1 -- 172.21.15.123:0/1570199349 >> v2:172.21.15.153:3300/0 conn(0x7f0e700b58b0 msgr2=0x7f0e700d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:25.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e74920700 1 --2- 172.21.15.123:0/1570199349 >> v2:172.21.15.153:3300/0 conn(0x7f0e700b58b0 0x7f0e700d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e74920700 1 -- 172.21.15.123:0/1570199349 >> v1:172.21.15.123:6789/0 conn(0x7f0e700d0f40 legacy=0x7f0e700d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e74920700 1 -- 172.21.15.123:0/1570199349 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e700b0900 con 0x7f0e700cd5e0 2024-09-13T17:08:25.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e74920700 1 --2- 172.21.15.123:0/1570199349 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e700cd5e0 0x7f0e700cda30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009d90 tx=0x7f0e6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92c2794df04c5ca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:25.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e6effd700 1 -- 172.21.15.123:0/1570199349 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6800e070 con 0x7f0e700cd5e0 2024-09-13T17:08:25.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e6effd700 1 -- 172.21.15.123:0/1570199349 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6800bb20 con 0x7f0e700cd5e0 2024-09-13T17:08:25.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.404+0000 7f0e6effd700 1 -- 172.21.15.123:0/1570199349 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6800be90 con 0x7f0e700cd5e0 2024-09-13T17:08:25.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 -- 172.21.15.123:0/1570199349 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e700cd5e0 msgr2=0x7f0e700cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 --2- 172.21.15.123:0/1570199349 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e700cd5e0 0x7f0e700cda30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009d90 tx=0x7f0e6800b330 comp rx=0 tx=0).stop 2024-09-13T17:08:25.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 -- 172.21.15.123:0/1570199349 shutdown_connections 2024-09-13T17:08:25.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 --2- 172.21.15.123:0/1570199349 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e700cd5e0 0x7f0e700cda30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 --2- 172.21.15.123:0/1570199349 >> v2:172.21.15.153:3300/0 conn(0x7f0e700b58b0 0x7f0e700d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 -- 172.21.15.123:0/1570199349 >> 172.21.15.123:0/1570199349 conn(0x7f0e700d2a60 msgr2=0x7f0e700d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:25.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 -- 172.21.15.123:0/1570199349 shutdown_connections 2024-09-13T17:08:25.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 -- 172.21.15.123:0/1570199349 wait complete. 2024-09-13T17:08:25.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 Processor -- start 2024-09-13T17:08:25.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 -- start start 2024-09-13T17:08:25.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e700b58b0 0x7f0e7014cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e700cd5e0 0x7f0e7015f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e700d0f40 0x7f0e700c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7015fbd0 con 0x7f0e700d0f40 2024-09-13T17:08:25.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700b36f0 con 0x7f0e700cd5e0 2024-09-13T17:08:25.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e75121700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7014d450 con 0x7f0e700b58b0 2024-09-13T17:08:25.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e74920700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e700d0f40 0x7f0e700c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e6ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e700b58b0 0x7f0e7014cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e74920700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e700d0f40 0x7f0e700c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46534/0 (socket says 172.21.15.123:46534) 2024-09-13T17:08:25.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e74920700 1 -- 172.21.15.123:0/2765061467 learned_addr learned my addr 172.21.15.123:0/2765061467 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:25.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e6f7fe700 1 --2- 172.21.15.123:0/2765061467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e700cd5e0 0x7f0e7015f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e6ffff700 1 -- 172.21.15.123:0/2765061467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e700cd5e0 msgr2=0x7f0e7015f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e6ffff700 1 --2- 172.21.15.123:0/2765061467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e700cd5e0 0x7f0e7015f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e6ffff700 1 -- 172.21.15.123:0/2765061467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e700d0f40 msgr2=0x7f0e700c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e6ffff700 1 --2- 172.21.15.123:0/2765061467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e700d0f40 0x7f0e700c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e6ffff700 1 -- 172.21.15.123:0/2765061467 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e68009a70 con 0x7f0e700b58b0 2024-09-13T17:08:25.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e6ffff700 1 --2- 172.21.15.123:0/2765061467 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e700b58b0 0x7f0e7014cf10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000c4d0 tx=0x7f0e6000c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:25.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.408+0000 7f0e6cff9700 1 -- 172.21.15.123:0/2765061467 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60005d90 con 0x7f0e700b58b0 2024-09-13T17:08:25.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.412+0000 7f0e6cff9700 1 -- 172.21.15.123:0/2765061467 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6000ce80 con 0x7f0e700b58b0 2024-09-13T17:08:25.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.412+0000 7f0e75121700 1 -- 172.21.15.123:0/2765061467 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e700b2dc0 con 0x7f0e700b58b0 2024-09-13T17:08:25.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.412+0000 7f0e6cff9700 1 -- 172.21.15.123:0/2765061467 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600072f0 con 0x7f0e700b58b0 2024-09-13T17:08:25.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.412+0000 7f0e75121700 1 -- 172.21.15.123:0/2765061467 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e700b3380 con 0x7f0e700b58b0 2024-09-13T17:08:25.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.412+0000 7f0e6cff9700 1 -- 172.21.15.123:0/2765061467 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e60007450 con 0x7f0e700b58b0 2024-09-13T17:08:25.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.412+0000 7f0e6cff9700 1 --2- 172.21.15.123:0/2765061467 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0e5c066730 0x7f0e5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.412+0000 7f0e6cff9700 1 -- 172.21.15.123:0/2765061467 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e600834e0 con 0x7f0e700b58b0 2024-09-13T17:08:25.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.412+0000 7f0e6f7fe700 1 --2- 172.21.15.123:0/2765061467 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0e5c066730 0x7f0e5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.412+0000 7f0e6f7fe700 1 --2- 172.21.15.123:0/2765061467 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0e5c066730 0x7f0e5c068bf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0e701f5d60 tx=0x7f0e64009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:25.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e79634740 1 Processor -- start 2024-09-13T17:08:25.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e79634740 1 -- start start 2024-09-13T17:08:25.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e79634740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x14d8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e79634740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 0x14a0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e79634740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 0x14a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e79634740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x13ffd80 con 0x14d7da0 2024-09-13T17:08:25.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e79634740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x13fd510 con 0x14d86c0 2024-09-13T17:08:25.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e79634740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x13f8e00 con 0x14b6d00 2024-09-13T17:08:25.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e6ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x14d8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e6ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x14d8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46542/0 (socket says 172.21.15.123:46542) 2024-09-13T17:08:25.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e6ffff700 1 -- 172.21.15.123:0/3774140130 learned_addr learned my addr 172.21.15.123:0/3774140130 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:25.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e6f7fe700 1 --2- 172.21.15.123:0/3774140130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 0x14a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e74920700 1 --2- 172.21.15.123:0/3774140130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 0x14a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e6ffff700 1 -- 172.21.15.123:0/3774140130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 msgr2=0x14a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:25.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e6ffff700 1 --2- 172.21.15.123:0/3774140130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 0x14a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e6ffff700 1 -- 172.21.15.123:0/3774140130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 msgr2=0x14a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:25.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e6ffff700 1 --2- 172.21.15.123:0/3774140130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 0x14a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.416+0000 7f0e6ffff700 1 -- 172.21.15.123:0/3774140130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x126b960 con 0x14d7da0 2024-09-13T17:08:25.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e6ffff700 1 --2- 172.21.15.123:0/3774140130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x14d8180 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0e60001eb0 tx=0x7f0e60053e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22a419affcbfb56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:25.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e55ffb700 1 -- 172.21.15.123:0/3774140130 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60054470 con 0x14d7da0 2024-09-13T17:08:25.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e55ffb700 1 -- 172.21.15.123:0/3774140130 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e600582a0 con 0x14d7da0 2024-09-13T17:08:25.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e55ffb700 1 -- 172.21.15.123:0/3774140130 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6005c860 con 0x14d7da0 2024-09-13T17:08:25.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 -- 172.21.15.123:0/3774140130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 msgr2=0x14d8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 --2- 172.21.15.123:0/3774140130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x14d8180 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0e60001eb0 tx=0x7f0e60053e50 comp rx=0 tx=0).stop 2024-09-13T17:08:25.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 -- 172.21.15.123:0/3774140130 shutdown_connections 2024-09-13T17:08:25.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 --2- 172.21.15.123:0/3774140130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 0x14a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 --2- 172.21.15.123:0/3774140130 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 0x14a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 --2- 172.21.15.123:0/3774140130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x14d8180 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 -- 172.21.15.123:0/3774140130 >> 172.21.15.123:0/3774140130 conn(0x12204d0 msgr2=0x14b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:25.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 -- 172.21.15.123:0/3774140130 shutdown_connections 2024-09-13T17:08:25.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 -- 172.21.15.123:0/3774140130 wait complete. 2024-09-13T17:08:25.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 -- start start 2024-09-13T17:08:25.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 Processor -- start 2024-09-13T17:08:25.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 0x14b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x1491000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 0x1491540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x13b6730 con 0x14d7da0 2024-09-13T17:08:25.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x13bc5b0 con 0x14d86c0 2024-09-13T17:08:25.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x12a4aa0 con 0x14b6d00 2024-09-13T17:08:25.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e79634740 10 client.0 _ll_register_callbacks cb 0x13f2610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:08:25.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e6f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x1491000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e6f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x1491000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46544/0 (socket says 172.21.15.123:46544) 2024-09-13T17:08:25.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e6f7fe700 1 -- 172.21.15.123:0/3015855832 learned_addr learned my addr 172.21.15.123:0/3015855832 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:25.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e6ffff700 1 --2- 172.21.15.123:0/3015855832 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 0x14b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.420+0000 7f0e74920700 1 --2- 172.21.15.123:0/3015855832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 0x1491540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e6f7fe700 1 -- 172.21.15.123:0/3015855832 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 msgr2=0x14b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:25.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e6f7fe700 1 --2- 172.21.15.123:0/3015855832 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 0x14b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e6f7fe700 1 -- 172.21.15.123:0/3015855832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 msgr2=0x1491540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:25.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e6f7fe700 1 --2- 172.21.15.123:0/3015855832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 0x1491540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e6f7fe700 1 -- 172.21.15.123:0/3015855832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e700b3380 con 0x14d7da0 2024-09-13T17:08:25.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e6ffff700 1 --2- 172.21.15.123:0/3015855832 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 0x14b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:25.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e6f7fe700 1 --2- 172.21.15.123:0/3015855832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x1491000 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0e64011d30 tx=0x7f0e640047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe34aac8eea20ffd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:25.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e4effd700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-13T17:08:25.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e4effd700 1 -- 172.21.15.123:0/3015855832 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6401c040 con 0x14d7da0 2024-09-13T17:08:25.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 1 -- 172.21.15.123:0/3015855832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x122d1e0 con 0x14d7da0 2024-09-13T17:08:25.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e4effd700 1 -- 172.21.15.123:0/3015855832 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e64003e10 con 0x14d7da0 2024-09-13T17:08:25.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e4effd700 1 -- 172.21.15.123:0/3015855832 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e64023450 con 0x14d7da0 2024-09-13T17:08:25.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 10 client.5856 fetch_fsmap learned FSMap version 21 2024-09-13T17:08:25.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 1 -- 172.21.15.123:0/3015855832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x13bf220 con 0x14d7da0 2024-09-13T17:08:25.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e4effd700 1 -- 172.21.15.123:0/3015855832 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x122d1e0 con 0x14d7da0 2024-09-13T17:08:25.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e4effd700 1 -- 172.21.15.123:0/3015855832 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0e640235b0 con 0x14d7da0 2024-09-13T17:08:25.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 10 client.5856 fetch_fsmap finished waiting for FSMap version 21 2024-09-13T17:08:25.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 10 client.5856 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:08:25.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 20 client.5856 populate_metadata read hostname 'smithi123' 2024-09-13T17:08:25.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 1 --2- 172.21.15.123:0/3015855832 >> [v2:172.21.15.123:6836/2449786141,v1:172.21.15.123:6837/2449786141] conn(0x14d8180 0x148e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 4 client.5856 mds_command: new command op to 5730 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:08:25.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 1 -- 172.21.15.123:0/3015855832 --> [v2:172.21.15.123:6836/2449786141,v1:172.21.15.123:6837/2449786141] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1277460 con 0x14d8180 2024-09-13T17:08:25.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e6ffff700 1 --2- 172.21.15.123:0/3015855832 >> [v2:172.21.15.123:6836/2449786141,v1:172.21.15.123:6837/2449786141] conn(0x14d8180 0x148e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e6ffff700 1 --2- 172.21.15.123:0/3015855832 >> [v2:172.21.15.123:6836/2449786141,v1:172.21.15.123:6837/2449786141] conn(0x14d8180 0x148e880 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d19d85fa3341871 server_cookie=6d04788c4cfc762f in_seq=0 out_seq=0 2024-09-13T17:08:25.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e4effd700 10 client.5856 ms_handle_connect on v2:172.21.15.123:6836/2449786141 2024-09-13T17:08:25.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e4effd700 1 -- 172.21.15.123:0/3015855832 <== mds.0 v2:172.21.15.123:6836/2449786141 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1277460 con 0x14d8180 2024-09-13T17:08:25.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e4effd700 10 client.5856 handle_command_reply: tid=0 2024-09-13T17:08:25.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 1 client.5856 shutdown 2024-09-13T17:08:25.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 1 -- 172.21.15.123:0/3015855832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 msgr2=0x1491000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 1 --2- 172.21.15.123:0/3015855832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x1491000 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0e64011d30 tx=0x7f0e640047e0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 1 -- 172.21.15.123:0/3015855832 shutdown_connections 2024-09-13T17:08:25.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 1 --2- 172.21.15.123:0/3015855832 >> [v2:172.21.15.123:6836/2449786141,v1:172.21.15.123:6837/2449786141] conn(0x14d8180 0x148e880 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.424+0000 7f0e79634740 1 --2- 172.21.15.123:0/3015855832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 0x1491540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.428+0000 7f0e79634740 1 --2- 172.21.15.123:0/3015855832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x1491000 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.428+0000 7f0e79634740 1 --2- 172.21.15.123:0/3015855832 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 0x14b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.428+0000 7f0e4effd700 0 client.5856 ms_handle_reset on v2:172.21.15.123:6836/2449786141 2024-09-13T17:08:25.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.428+0000 7f0e79634740 1 -- 172.21.15.123:0/3015855832 >> 172.21.15.123:0/3015855832 conn(0x12204d0 msgr2=0x14b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:25.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.428+0000 7f0e79634740 1 -- 172.21.15.123:0/3015855832 shutdown_connections 2024-09-13T17:08:25.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.428+0000 7f0e79634740 1 -- 172.21.15.123:0/3015855832 wait complete. 2024-09-13T17:08:25.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.428+0000 7f0e79634740 20 client.5856 trim_cache size 0 max 16384 2024-09-13T17:08:25.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 Processor -- start 2024-09-13T17:08:25.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 -- start start 2024-09-13T17:08:25.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 0x14d6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x14d7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 0x148c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1427ec0 con 0x14d7da0 2024-09-13T17:08:25.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x13fc670 con 0x14d86c0 2024-09-13T17:08:25.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x13a1020 con 0x14b6d00 2024-09-13T17:08:25.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e6f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x14d7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e6f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x14d7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46550/0 (socket says 172.21.15.123:46550) 2024-09-13T17:08:25.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e6f7fe700 1 -- 172.21.15.123:0/736356574 learned_addr learned my addr 172.21.15.123:0/736356574 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e6ffff700 1 --2- 172.21.15.123:0/736356574 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 0x14d6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e74920700 1 --2- 172.21.15.123:0/736356574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 0x148c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e6f7fe700 1 -- 172.21.15.123:0/736356574 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 msgr2=0x14d6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e6f7fe700 1 --2- 172.21.15.123:0/736356574 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 0x14d6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e6f7fe700 1 -- 172.21.15.123:0/736356574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 msgr2=0x148c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e6f7fe700 1 --2- 172.21.15.123:0/736356574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 0x148c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e6f7fe700 1 -- 172.21.15.123:0/736356574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x13a5450 con 0x14d7da0 2024-09-13T17:08:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e6f7fe700 1 --2- 172.21.15.123:0/736356574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x14d7050 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0e64011a40 tx=0x7f0e64022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41196ca653f3a35b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e567fc700 1 -- 172.21.15.123:0/736356574 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64004610 con 0x14d7da0 2024-09-13T17:08:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e567fc700 1 -- 172.21.15.123:0/736356574 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6401c040 con 0x14d7da0 2024-09-13T17:08:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e567fc700 1 -- 172.21.15.123:0/736356574 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64023b10 con 0x14d7da0 2024-09-13T17:08:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 -- 172.21.15.123:0/736356574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 msgr2=0x14d7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 --2- 172.21.15.123:0/736356574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x14d7050 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0e64011a40 tx=0x7f0e64022000 comp rx=0 tx=0).stop 2024-09-13T17:08:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 -- 172.21.15.123:0/736356574 shutdown_connections 2024-09-13T17:08:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 --2- 172.21.15.123:0/736356574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d86c0 0x148c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 --2- 172.21.15.123:0/736356574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14d7da0 0x14d7050 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 --2- 172.21.15.123:0/736356574 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14b6d00 0x14d6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 -- 172.21.15.123:0/736356574 >> 172.21.15.123:0/736356574 conn(0x12204d0 msgr2=0x14d6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 -- 172.21.15.123:0/736356574 shutdown_connections 2024-09-13T17:08:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.448+0000 7f0e79634740 1 -- 172.21.15.123:0/736356574 wait complete. 2024-09-13T17:08:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.452+0000 7f0e79634740 1 -- start start 2024-09-13T17:08:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.452+0000 7f0e79634740 1 Processor -- start 2024-09-13T17:08:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.452+0000 7f0e79634740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14b6d00 0x14f5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.452+0000 7f0e79634740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d7da0 0x153baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.452+0000 7f0e79634740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14d86c0 0x14f7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.452+0000 7f0e79634740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x13ace80 con 0x14b6d00 2024-09-13T17:08:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.452+0000 7f0e79634740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1493890 con 0x14d7da0 2024-09-13T17:08:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.452+0000 7f0e79634740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x14ddc20 con 0x14d86c0 2024-09-13T17:08:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.452+0000 7f0e79634740 10 client.0 _ll_register_callbacks cb 0x144f710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:08:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.452+0000 7f0e6ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14b6d00 0x14f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.452+0000 7f0e74920700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14d86c0 0x14f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.452+0000 7f0e6ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14b6d00 0x14f5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46560/0 (socket says 172.21.15.123:46560) 2024-09-13T17:08:25.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.452+0000 7f0e6f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d7da0 0x153baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.452+0000 7f0e6ffff700 1 -- 172.21.15.123:0/1127067376 learned_addr learned my addr 172.21.15.123:0/1127067376 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e6ffff700 1 -- 172.21.15.123:0/1127067376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14d86c0 msgr2=0x14f7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e6ffff700 1 --2- 172.21.15.123:0/1127067376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14d86c0 0x14f7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e6ffff700 1 -- 172.21.15.123:0/1127067376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d7da0 msgr2=0x153baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e6ffff700 1 --2- 172.21.15.123:0/1127067376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d7da0 0x153baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e6ffff700 1 -- 172.21.15.123:0/1127067376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x13bf220 con 0x14b6d00 2024-09-13T17:08:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e6f7fe700 1 --2- 172.21.15.123:0/1127067376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d7da0 0x153baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e4effd700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-13T17:08:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e6ffff700 1 --2- 172.21.15.123:0/1127067376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14b6d00 0x14f5830 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0e60050970 tx=0x7f0e6001e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa83cf9cbd8ff0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e4effd700 1 -- 172.21.15.123:0/1127067376 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6005c860 con 0x14b6d00 2024-09-13T17:08:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e4effd700 1 -- 172.21.15.123:0/1127067376 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e60078020 con 0x14b6d00 2024-09-13T17:08:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 -- 172.21.15.123:0/1127067376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e600582a0 con 0x14b6d00 2024-09-13T17:08:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e4effd700 1 -- 172.21.15.123:0/1127067376 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e60054470 con 0x14b6d00 2024-09-13T17:08:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 10 client.5862 fetch_fsmap learned FSMap version 21 2024-09-13T17:08:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 -- 172.21.15.123:0/1127067376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x1399720 con 0x14b6d00 2024-09-13T17:08:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e4effd700 1 -- 172.21.15.123:0/1127067376 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e60060080 con 0x14b6d00 2024-09-13T17:08:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e4effd700 1 -- 172.21.15.123:0/1127067376 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0e60069070 con 0x14b6d00 2024-09-13T17:08:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 10 client.5862 fetch_fsmap finished waiting for FSMap version 21 2024-09-13T17:08:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 10 client.5862 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:08:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 20 client.5862 populate_metadata read hostname 'smithi123' 2024-09-13T17:08:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 --2- 172.21.15.123:0/1127067376 >> [v2:172.21.15.123:6836/2449786141,v1:172.21.15.123:6837/2449786141] conn(0x14f8380 0x14dbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 4 client.5862 mds_command: new command op to 5730 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:08:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 -- 172.21.15.123:0/1127067376 --> [v2:172.21.15.123:6836/2449786141,v1:172.21.15.123:6837/2449786141] -- command(tid 0: {"prefix": "status"}) v1 -- 0x129c1e0 con 0x14f8380 2024-09-13T17:08:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e6f7fe700 1 --2- 172.21.15.123:0/1127067376 >> [v2:172.21.15.123:6836/2449786141,v1:172.21.15.123:6837/2449786141] conn(0x14f8380 0x14dbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e4effd700 10 client.5862 ms_handle_connect on v2:172.21.15.123:6836/2449786141 2024-09-13T17:08:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e6f7fe700 1 --2- 172.21.15.123:0/1127067376 >> [v2:172.21.15.123:6836/2449786141,v1:172.21.15.123:6837/2449786141] conn(0x14f8380 0x14dbf60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c94ff7941cdc710 server_cookie=ca630f37b16f2ca1 in_seq=0 out_seq=0 2024-09-13T17:08:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e4effd700 1 -- 172.21.15.123:0/1127067376 <== mds.0 v2:172.21.15.123:6836/2449786141 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x129c1e0 con 0x14f8380 2024-09-13T17:08:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e4effd700 10 client.5862 handle_command_reply: tid=0 2024-09-13T17:08:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 client.5862 shutdown 2024-09-13T17:08:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 -- 172.21.15.123:0/1127067376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14b6d00 msgr2=0x14f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 --2- 172.21.15.123:0/1127067376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14b6d00 0x14f5830 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0e60050970 tx=0x7f0e6001e070 comp rx=0 tx=0).stop 2024-09-13T17:08:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 -- 172.21.15.123:0/1127067376 shutdown_connections 2024-09-13T17:08:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 --2- 172.21.15.123:0/1127067376 >> [v2:172.21.15.123:6836/2449786141,v1:172.21.15.123:6837/2449786141] conn(0x14f8380 0x14dbf60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 --2- 172.21.15.123:0/1127067376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x14d86c0 0x14f7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e4effd700 0 client.5862 ms_handle_reset on v2:172.21.15.123:6836/2449786141 2024-09-13T17:08:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 --2- 172.21.15.123:0/1127067376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14d7da0 0x153baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 --2- 172.21.15.123:0/1127067376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x14b6d00 0x14f5830 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 -- 172.21.15.123:0/1127067376 >> 172.21.15.123:0/1127067376 conn(0x12204d0 msgr2=0x14b5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 -- 172.21.15.123:0/1127067376 shutdown_connections 2024-09-13T17:08:25.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.456+0000 7f0e79634740 1 -- 172.21.15.123:0/1127067376 wait complete. 2024-09-13T17:08:25.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.460+0000 7f0e79634740 20 client.5862 trim_cache size 0 max 16384 2024-09-13T17:08:25.465 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:08:25.465 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "c45759e3-62b7-46ff-ad19-917097e4c126", 2024-09-13T17:08:25.465 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-13T17:08:25.465 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 5730, 2024-09-13T17:08:25.465 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-13T17:08:25.465 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-13T17:08:25.465 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-13T17:08:25.466 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 5.7309733960000004, 2024-09-13T17:08:25.466 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 21, 2024-09-13T17:08:25.466 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 46, 2024-09-13T17:08:25.466 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 46, 2024-09-13T17:08:25.466 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 10.151673696 2024-09-13T17:08:25.466 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:08:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.460+0000 7f0e75121700 1 -- 172.21.15.123:0/2765061467 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0e5c066730 msgr2=0x7f0e5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.460+0000 7f0e75121700 1 --2- 172.21.15.123:0/2765061467 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0e5c066730 0x7f0e5c068bf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0e701f5d60 tx=0x7f0e64009240 comp rx=0 tx=0).stop 2024-09-13T17:08:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.460+0000 7f0e75121700 1 -- 172.21.15.123:0/2765061467 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e700b58b0 msgr2=0x7f0e7014cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.460+0000 7f0e75121700 1 --2- 172.21.15.123:0/2765061467 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e700b58b0 0x7f0e7014cf10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000c4d0 tx=0x7f0e6000c7e0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.460+0000 7f0e75121700 1 -- 172.21.15.123:0/2765061467 shutdown_connections 2024-09-13T17:08:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.460+0000 7f0e75121700 1 --2- 172.21.15.123:0/2765061467 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0e5c066730 0x7f0e5c068bf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.460+0000 7f0e75121700 1 --2- 172.21.15.123:0/2765061467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e700d0f40 0x7f0e700c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.460+0000 7f0e75121700 1 --2- 172.21.15.123:0/2765061467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e700cd5e0 0x7f0e7015f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.460+0000 7f0e75121700 1 --2- 172.21.15.123:0/2765061467 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0e700b58b0 0x7f0e7014cf10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.460+0000 7f0e75121700 1 -- 172.21.15.123:0/2765061467 >> 172.21.15.123:0/2765061467 conn(0x7f0e700d2a60 msgr2=0x7f0e700cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.460+0000 7f0e75121700 1 -- 172.21.15.123:0/2765061467 shutdown_connections 2024-09-13T17:08:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.460+0000 7f0e75121700 1 -- 172.21.15.123:0/2765061467 wait complete. 2024-09-13T17:08:25.479 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:08:25.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.592+0000 7f3f0a54f700 1 Processor -- start 2024-09-13T17:08:25.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.592+0000 7f3f0a54f700 1 -- start start 2024-09-13T17:08:25.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0a54f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3f040b3cf0 0x7f3f040b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0a54f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f040715f0 0x7f3f0413d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0a54f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0413c630 con 0x7f3f0415d130 2024-09-13T17:08:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0a54f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0413c310 con 0x7f3f040b3cf0 2024-09-13T17:08:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0a54f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0413c910 con 0x7f3f040715f0 2024-09-13T17:08:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0954d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3f040b3cf0 0x7f3f040b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0954d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3f040b3cf0 0x7f3f040b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46574/0 (socket says 172.21.15.123:46574) 2024-09-13T17:08:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0954d700 1 -- 172.21.15.123:0/699444725 learned_addr learned my addr 172.21.15.123:0/699444725 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:25.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f09d4e700 1 --2- 172.21.15.123:0/699444725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f040715f0 0x7f3f0413d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0954d700 1 -- 172.21.15.123:0/699444725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f040715f0 msgr2=0x7f3f0413d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:25.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0954d700 1 --2- 172.21.15.123:0/699444725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f040715f0 0x7f3f0413d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0954d700 1 -- 172.21.15.123:0/699444725 >> v1:172.21.15.153:6789/0 conn(0x7f3f0415d130 legacy=0x7f3f04070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0954d700 1 -- 172.21.15.123:0/699444725 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0413cbf0 con 0x7f3f040b3cf0 2024-09-13T17:08:25.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0954d700 1 --2- 172.21.15.123:0/699444725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f040b3cf0 0x7f3f040b2030 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009910 tx=0x7f3f00009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7641d401debf3fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:25.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3efbfff700 1 -- 172.21.15.123:0/699444725 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000b830 con 0x7f3f040b3cf0 2024-09-13T17:08:25.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3efbfff700 1 -- 172.21.15.123:0/699444725 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0000b990 con 0x7f3f040b3cf0 2024-09-13T17:08:25.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3efbfff700 1 -- 172.21.15.123:0/699444725 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000bd40 con 0x7f3f040b3cf0 2024-09-13T17:08:25.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0a54f700 1 -- 172.21.15.123:0/699444725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f040b3cf0 msgr2=0x7f3f040b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0a54f700 1 --2- 172.21.15.123:0/699444725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f040b3cf0 0x7f3f040b2030 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009910 tx=0x7f3f00009c20 comp rx=0 tx=0).stop 2024-09-13T17:08:25.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0a54f700 1 -- 172.21.15.123:0/699444725 shutdown_connections 2024-09-13T17:08:25.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0a54f700 1 --2- 172.21.15.123:0/699444725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f040715f0 0x7f3f0413d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0a54f700 1 --2- 172.21.15.123:0/699444725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f040b3cf0 0x7f3f040b2030 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0a54f700 1 -- 172.21.15.123:0/699444725 >> 172.21.15.123:0/699444725 conn(0x7f3f040b0d30 msgr2=0x7f3f040b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:25.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0a54f700 1 -- 172.21.15.123:0/699444725 shutdown_connections 2024-09-13T17:08:25.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.596+0000 7f3f0a54f700 1 -- 172.21.15.123:0/699444725 wait complete. 2024-09-13T17:08:25.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f0a54f700 1 Processor -- start 2024-09-13T17:08:25.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f0a54f700 1 -- start start 2024-09-13T17:08:25.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f0a54f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f040715f0 0x7f3f04153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f0a54f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f040b3cf0 0x7f3f041f0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f0a54f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f0415d130 0x7f3f041567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f0a54f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f04156cf0 con 0x7f3f0415d130 2024-09-13T17:08:25.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f0a54f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f04154320 con 0x7f3f040715f0 2024-09-13T17:08:25.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f0a54f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f040b0950 con 0x7f3f040b3cf0 2024-09-13T17:08:25.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f09d4e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f0415d130 0x7f3f041567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f09d4e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f0415d130 0x7f3f041567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46586/0 (socket says 172.21.15.123:46586) 2024-09-13T17:08:25.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f09d4e700 1 -- 172.21.15.123:0/1078045727 learned_addr learned my addr 172.21.15.123:0/1078045727 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:25.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f0954d700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f040715f0 0x7f3f04153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f08d4c700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f040b3cf0 0x7f3f041f0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f09d4e700 1 -- 172.21.15.123:0/1078045727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f040b3cf0 msgr2=0x7f3f041f0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f09d4e700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f040b3cf0 0x7f3f041f0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f09d4e700 1 -- 172.21.15.123:0/1078045727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f040715f0 msgr2=0x7f3f04153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f09d4e700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f040715f0 0x7f3f04153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f09d4e700 1 -- 172.21.15.123:0/1078045727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f00009570 con 0x7f3f0415d130 2024-09-13T17:08:25.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f0954d700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f040715f0 0x7f3f04153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:25.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f09d4e700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f0415d130 0x7f3f041567b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009cb0 tx=0x7f3efc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:25.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3ef9ffb700 1 -- 172.21.15.123:0/1078045727 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc009b20 con 0x7f3f0415d130 2024-09-13T17:08:25.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3ef9ffb700 1 -- 172.21.15.123:0/1078045727 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc00f040 con 0x7f3f0415d130 2024-09-13T17:08:25.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f0a54f700 1 -- 172.21.15.123:0/1078045727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f041f0920 con 0x7f3f0415d130 2024-09-13T17:08:25.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3ef9ffb700 1 -- 172.21.15.123:0/1078045727 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc014480 con 0x7f3f0415d130 2024-09-13T17:08:25.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.600+0000 7f3f0a54f700 1 -- 172.21.15.123:0/1078045727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f041f0ee0 con 0x7f3f0415d130 2024-09-13T17:08:25.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.604+0000 7f3ef9ffb700 1 -- 172.21.15.123:0/1078045727 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3efc0145e0 con 0x7f3f0415d130 2024-09-13T17:08:25.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.604+0000 7f3f0a54f700 1 -- 172.21.15.123:0/1078045727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f041544f0 con 0x7f3f0415d130 2024-09-13T17:08:25.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.604+0000 7f3ef9ffb700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ee8066730 0x7f3ee8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:25.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.604+0000 7f3f0954d700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ee8066730 0x7f3ee8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:25.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.604+0000 7f3ef9ffb700 1 -- 172.21.15.123:0/1078045727 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3efc084d10 con 0x7f3f0415d130 2024-09-13T17:08:25.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.604+0000 7f3f0954d700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ee8066730 0x7f3ee8068bf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3f00000c00 tx=0x7f3f00008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:25.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.612+0000 7f3ef9ffb700 1 -- 172.21.15.123:0/1078045727 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3f041544f0 con 0x7f3f0415d130 2024-09-13T17:08:25.663 INFO:tasks.ceph.mds.c.smithi123.stderr:2024-09-13T17:08:25.660+0000 7f01e9e70700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:08:25.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.824+0000 7f3f0a54f700 1 -- 172.21.15.123:0/1078045727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3f041544f0 con 0x7f3f0415d130 2024-09-13T17:08:25.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.824+0000 7f3ef9ffb700 1 -- 172.21.15.123:0/1078045727 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3f041544f0 con 0x7f3f0415d130 2024-09-13T17:08:25.827 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:08:25.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.824+0000 7f3f0a54f700 1 -- 172.21.15.123:0/1078045727 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ee8066730 msgr2=0x7f3ee8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.824+0000 7f3f0a54f700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ee8066730 0x7f3ee8068bf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3f00000c00 tx=0x7f3f00008030 comp rx=0 tx=0).stop 2024-09-13T17:08:25.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.824+0000 7f3f0a54f700 1 -- 172.21.15.123:0/1078045727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f0415d130 msgr2=0x7f3f041567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:25.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.824+0000 7f3f0a54f700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f0415d130 0x7f3f041567b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009cb0 tx=0x7f3efc00c3a0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.824+0000 7f3f0a54f700 1 -- 172.21.15.123:0/1078045727 shutdown_connections 2024-09-13T17:08:25.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.824+0000 7f3f0a54f700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ee8066730 0x7f3ee8068bf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.824+0000 7f3f0a54f700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f0415d130 0x7f3f041567b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.824+0000 7f3f0a54f700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f040b3cf0 0x7f3f041f0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.824+0000 7f3f0a54f700 1 --2- 172.21.15.123:0/1078045727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f040715f0 0x7f3f04153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:25.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.824+0000 7f3f0a54f700 1 -- 172.21.15.123:0/1078045727 >> 172.21.15.123:0/1078045727 conn(0x7f3f040b0d30 msgr2=0x7f3f040b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:25.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.824+0000 7f3f0a54f700 1 -- 172.21.15.123:0/1078045727 shutdown_connections 2024-09-13T17:08:25.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:25.824+0000 7f3f0a54f700 1 -- 172.21.15.123:0/1078045727 wait complete. 2024-09-13T17:08:25.841 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:08:25.841 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:08:25.841 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-13T17:08:25.841 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:08:25.841 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:08:25.841 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:08:25.841 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:08:25.841 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:08:25.841 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:08:25.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:25.842 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-13T17:08:25.846 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:08:25.846 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:08:25.846 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:08:25.847 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:25.847 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-13T17:08:25.847 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:25.847 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:08:25.847 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:25.847 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:08:25.847 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:25.847 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:08:25.847 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:25.847 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:08:25.847 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:25.847 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:08:25.848 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42502sec preferred_lft 42502sec 2024-09-13T17:08:25.848 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-09-13T17:08:25.848 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:25.848 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:08:25.848 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:b1:d7:75:e9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:25.848 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:08:25.848 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:25.848 INFO:teuthology.orchestra.run.smithi123.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:08:25.848 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether d6:8a:3c:97:49:a9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:25.848 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:08:25.848 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:25.848 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::a038:65ff:fec0:5513/64 scope link 2024-09-13T17:08:25.849 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:25.849 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:08:25.849 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether da:a9:95:cd:41:8c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:08:25.849 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::d8a9:95ff:fecd:418c/64 scope link 2024-09-13T17:08:25.849 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:25.849 INFO:teuthology.orchestra.run.smithi123.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:08:25.849 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether d6:8a:3c:97:49:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:08:25.849 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::d48a:3cff:fe97:49a9/64 scope link 2024-09-13T17:08:25.849 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:25.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:25.849 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:08:25.903 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-13T17:08:25.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:25.905 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-13T17:08:25.914 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-13T17:08:25.914 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:08:25.914 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:08:25.914 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:08:25.914 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:08:25.914 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:08:25.914 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:08:25.914 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:08:25.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:25.915 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:08:25.915 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:08:25.915 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:08:25.915 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:08:25.915 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:08:25.915 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:08:25.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:25.951 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-13T17:08:26.001 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:08:26.001 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:08:26.001 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:08:26.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:26.001 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-13T17:08:26.019 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:08:26.019 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:08:26.019 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:08:26.026 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:08:26.026 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:08:26.026 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:08:26.076 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:08:26.093 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:08:26.093 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:08:26.109 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:08:26.110 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:08:26.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:26.111 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:08:26.116 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:08:26.116 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:08:26.159 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:08:26.177 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:08:26.177 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:08:26.189 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:08:26.190 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:08:26.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:26.191 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:08:26.254 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:2024-09-13T17:08:26.252+0000 7fc8a1bda640 -1 init, newargv = 0x55a42e550540 newargc=15 2024-09-13T17:08:26.255 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[39187]: starting ceph client 2024-09-13T17:08:26.263 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[39187]: starting fuse 2024-09-13T17:08:27.347 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:08:27.367 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:08:27.367 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:08:27.425 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:08:27.426 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:08:27.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:27.426 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:08:27.431 INFO:teuthology.orchestra.run.smithi123.stdout:52 2024-09-13T17:08:27.431 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:08:27.432 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:08:27.432 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2024-09-13T17:08:27.432 DEBUG:teuthology.orchestra.run.smithi123:> import re 2024-09-13T17:08:27.432 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-13T17:08:27.432 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2024-09-13T17:08:27.432 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:08:27.432 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2024-09-13T17:08:27.432 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:08:27.432 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2024-09-13T17:08:27.432 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:08:27.432 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:08:27.432 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2024-09-13T17:08:27.432 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2024-09-13T17:08:27.432 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2024-09-13T17:08:27.433 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2024-09-13T17:08:27.433 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:08:27.433 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2024-09-13T17:08:27.433 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:08:27.433 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:08:27.433 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:08:27.433 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2024-09-13T17:08:27.433 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2024-09-13T17:08:27.433 DEBUG:teuthology.orchestra.run.smithi123:> return f 2024-09-13T17:08:27.433 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:08:27.433 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:08:27.433 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.0")) 2024-09-13T17:08:27.433 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-13T17:08:27.520 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.0.39187.asok 2024-09-13T17:08:27.704 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39187.asok 2024-09-13T17:08:27.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:27.704 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39187.asok status 2024-09-13T17:08:27.814 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:08:27.814 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2024-09-13T17:08:27.814 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:08:27.814 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:08:27.814 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "0", 2024-09-13T17:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2024-09-13T17:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "39187", 2024-09-13T17:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2024-09-13T17:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2024-09-13T17:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2024-09-13T17:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 5874, 2024-09-13T17:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2024-09-13T17:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2024-09-13T17:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2024-09-13T17:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 5874 2024-09-13T17:08:27.815 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1970911117 2024-09-13T17:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1970911117 2024-09-13T17:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.5874 192.168.0.1:0/1970911117", 2024-09-13T17:08:27.816 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.1:0/1970911117", 2024-09-13T17:08:27.817 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2024-09-13T17:08:27.817 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 21, 2024-09-13T17:08:27.817 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 46, 2024-09-13T17:08:27.817 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:08:27.817 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2024-09-13T17:08:27.817 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2024-09-13T17:08:27.817 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:08:27.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:27.824 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2024-09-13T17:08:27.824 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:08:27.832 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2024-09-13T17:08:27.832 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:08:27.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:27.832 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:08:27.843 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:08:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.948+0000 7f093151a700 1 Processor -- start 2024-09-13T17:08:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.948+0000 7f093151a700 1 -- start start 2024-09-13T17:08:27.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.948+0000 7f093151a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f092c0b2400 0x7f092c0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:27.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f093151a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c0cde30 con 0x7f092c0b5460 2024-09-13T17:08:27.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f093151a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c0b3fc0 con 0x7f092c0cd4b0 2024-09-13T17:08:27.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f093151a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092c0cd8f0 con 0x7f092c0b2400 2024-09-13T17:08:27.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f0930d19700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f092c0b5460 0x7f092c164580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39290/0 (socket says 172.21.15.123:39290) 2024-09-13T17:08:27.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f092bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f092c0b2400 0x7f092c0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:27.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f0930d19700 1 -- 172.21.15.123:0/4035567930 learned_addr learned my addr 172.21.15.123:0/4035567930 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:27.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f092affd700 1 -- 172.21.15.123:0/4035567930 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824832173 0 0) 0x7f0924001110 con 0x7f092c0b5460 2024-09-13T17:08:27.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f092affd700 1 -- 172.21.15.123:0/4035567930 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09180035d0 con 0x7f092c0b5460 2024-09-13T17:08:27.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f092bfff700 1 -- 172.21.15.123:0/4035567930 >> v1:172.21.15.153:6789/0 conn(0x7f092c0cd4b0 legacy=0x7f092c0b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:27.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f092bfff700 1 -- 172.21.15.123:0/4035567930 >> v1:172.21.15.123:6789/0 conn(0x7f092c0b5460 legacy=0x7f092c164580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:27.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f092bfff700 1 -- 172.21.15.123:0/4035567930 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c0afa30 con 0x7f092c0b2400 2024-09-13T17:08:27.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f092bfff700 1 --2- 172.21.15.123:0/4035567930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c0b2400 0x7f092c0ccf70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f091c009d90 tx=0x7f091c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c673934e829c92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f092affd700 1 -- 172.21.15.123:0/4035567930 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00e070 con 0x7f092c0b2400 2024-09-13T17:08:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f092affd700 1 -- 172.21.15.123:0/4035567930 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c00bb20 con 0x7f092c0b2400 2024-09-13T17:08:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f092affd700 1 -- 172.21.15.123:0/4035567930 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c012430 con 0x7f092c0b2400 2024-09-13T17:08:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f093151a700 1 -- 172.21.15.123:0/4035567930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c0b2400 msgr2=0x7f092c0ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f093151a700 1 --2- 172.21.15.123:0/4035567930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c0b2400 0x7f092c0ccf70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f091c009d90 tx=0x7f091c00b330 comp rx=0 tx=0).stop 2024-09-13T17:08:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f093151a700 1 -- 172.21.15.123:0/4035567930 shutdown_connections 2024-09-13T17:08:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f093151a700 1 --2- 172.21.15.123:0/4035567930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c0b2400 0x7f092c0ccf70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f093151a700 1 -- 172.21.15.123:0/4035567930 >> 172.21.15.123:0/4035567930 conn(0x7f092c06a650 msgr2=0x7f092c06aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f093151a700 1 -- 172.21.15.123:0/4035567930 shutdown_connections 2024-09-13T17:08:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.952+0000 7f093151a700 1 -- 172.21.15.123:0/4035567930 wait complete. 2024-09-13T17:08:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f093151a700 1 Processor -- start 2024-09-13T17:08:27.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f093151a700 1 -- start start 2024-09-13T17:08:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f093151a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f092c0b2400 0x7f092c15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f093151a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f092c0b5460 0x7f092c1f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f093151a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c0cd4b0 0x7f092c152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f093151a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c153970 con 0x7f092c0cd4b0 2024-09-13T17:08:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f093151a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c153c10 con 0x7f092c0b5460 2024-09-13T17:08:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f093151a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092c1f31f0 con 0x7f092c0b2400 2024-09-13T17:08:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f0930d19700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c0cd4b0 0x7f092c152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f092bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f092c0b2400 0x7f092c15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f0930d19700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c0cd4b0 0x7f092c152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46598/0 (socket says 172.21.15.123:46598) 2024-09-13T17:08:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f0930d19700 1 -- 172.21.15.123:0/1277337635 learned_addr learned my addr 172.21.15.123:0/1277337635 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f092b7fe700 1 --2- 172.21.15.123:0/1277337635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f092c0b5460 0x7f092c1f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f0930d19700 1 -- 172.21.15.123:0/1277337635 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f092c0b2400 msgr2=0x7f092c15ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f0930d19700 1 --2- 172.21.15.123:0/1277337635 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f092c0b2400 0x7f092c15ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f0930d19700 1 -- 172.21.15.123:0/1277337635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f092c0b5460 msgr2=0x7f092c1f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f0930d19700 1 --2- 172.21.15.123:0/1277337635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f092c0b5460 0x7f092c1f29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f0930d19700 1 -- 172.21.15.123:0/1277337635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c009a70 con 0x7f092c0cd4b0 2024-09-13T17:08:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f092b7fe700 1 --2- 172.21.15.123:0/1277337635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f092c0b5460 0x7f092c1f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f0930d19700 1 --2- 172.21.15.123:0/1277337635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c0cd4b0 0x7f092c152e40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f092400c4f0 tx=0x7f092400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f0928ff9700 1 -- 172.21.15.123:0/1277337635 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0924005d90 con 0x7f092c0cd4b0 2024-09-13T17:08:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f0928ff9700 1 -- 172.21.15.123:0/1277337635 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09240070d0 con 0x7f092c0cd4b0 2024-09-13T17:08:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f093151a700 1 -- 172.21.15.123:0/1277337635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092c1f34d0 con 0x7f092c0cd4b0 2024-09-13T17:08:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f0928ff9700 1 -- 172.21.15.123:0/1277337635 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0924007460 con 0x7f092c0cd4b0 2024-09-13T17:08:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.956+0000 7f093151a700 1 -- 172.21.15.123:0/1277337635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092c1f2ee0 con 0x7f092c0cd4b0 2024-09-13T17:08:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.960+0000 7f093151a700 1 -- 172.21.15.123:0/1277337635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092c0677f0 con 0x7f092c0cd4b0 2024-09-13T17:08:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.960+0000 7f0928ff9700 1 -- 172.21.15.123:0/1277337635 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f09240075c0 con 0x7f092c0cd4b0 2024-09-13T17:08:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.960+0000 7f0928ff9700 1 --2- 172.21.15.123:0/1277337635 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f090c066730 0x7f090c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.960+0000 7f0928ff9700 1 -- 172.21.15.123:0/1277337635 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0924083490 con 0x7f092c0cd4b0 2024-09-13T17:08:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.960+0000 7f092bfff700 1 --2- 172.21.15.123:0/1277337635 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f090c066730 0x7f090c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:27.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.960+0000 7f092bfff700 1 --2- 172.21.15.123:0/1277337635 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f090c066730 0x7f090c068bf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f091c014040 tx=0x7f091c011000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:27.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:27.968+0000 7f0928ff9700 1 -- 172.21.15.123:0/1277337635 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0924050760 con 0x7f092c0cd4b0 2024-09-13T17:08:28.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:28.172+0000 7f093151a700 1 -- 172.21.15.123:0/1277337635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f092c0cde30 con 0x7f092c0cd4b0 2024-09-13T17:08:28.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:28.176+0000 7f0928ff9700 1 -- 172.21.15.123:0/1277337635 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+73 (secure 0 0 0) 0x7f092c0cde30 con 0x7f092c0cd4b0 2024-09-13T17:08:28.178 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:08:28.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:28.176+0000 7f093151a700 1 -- 172.21.15.123:0/1277337635 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f090c066730 msgr2=0x7f090c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:28.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:28.176+0000 7f093151a700 1 --2- 172.21.15.123:0/1277337635 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f090c066730 0x7f090c068bf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f091c014040 tx=0x7f091c011000 comp rx=0 tx=0).stop 2024-09-13T17:08:28.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:28.176+0000 7f093151a700 1 -- 172.21.15.123:0/1277337635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c0cd4b0 msgr2=0x7f092c152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:28.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:28.176+0000 7f093151a700 1 --2- 172.21.15.123:0/1277337635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c0cd4b0 0x7f092c152e40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f092400c4f0 tx=0x7f092400c800 comp rx=0 tx=0).stop 2024-09-13T17:08:28.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:28.176+0000 7f093151a700 1 -- 172.21.15.123:0/1277337635 shutdown_connections 2024-09-13T17:08:28.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:28.176+0000 7f093151a700 1 --2- 172.21.15.123:0/1277337635 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f090c066730 0x7f090c068bf0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:28.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:28.176+0000 7f093151a700 1 --2- 172.21.15.123:0/1277337635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c0cd4b0 0x7f092c152e40 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:28.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:28.176+0000 7f093151a700 1 --2- 172.21.15.123:0/1277337635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f092c0b5460 0x7f092c1f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:28.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:28.176+0000 7f093151a700 1 --2- 172.21.15.123:0/1277337635 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f092c0b2400 0x7f092c15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:28.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:28.176+0000 7f093151a700 1 -- 172.21.15.123:0/1277337635 >> 172.21.15.123:0/1277337635 conn(0x7f092c06a650 msgr2=0x7f092c0af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:28.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:28.176+0000 7f093151a700 1 -- 172.21.15.123:0/1277337635 shutdown_connections 2024-09-13T17:08:28.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:28.176+0000 7f093151a700 1 -- 172.21.15.123:0/1277337635 wait complete. 2024-09-13T17:08:28.193 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:08:28.193 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:08:28.193 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-13T17:08:28.193 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:08:28.193 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:28.193 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:08:28.193 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:08:28.193 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:08:28.193 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:08:28.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:28.194 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-13T17:08:28.202 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:08:28.202 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:08:28.202 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:08:28.202 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:28.203 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-13T17:08:28.203 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:28.203 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:08:28.203 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:28.203 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:08:28.203 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:28.203 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:08:28.203 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:28.203 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:08:28.203 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:28.203 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:08:28.203 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42503sec preferred_lft 42503sec 2024-09-13T17:08:28.204 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-09-13T17:08:28.204 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:28.204 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:08:28.204 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:73:6c:03:01 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:28.204 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:08:28.204 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:28.204 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:08:28.204 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:28.204 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:08:28.204 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:28.204 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::f82f:21ff:fe0c:65de/64 scope link 2024-09-13T17:08:28.205 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:28.205 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:08:28.205 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:08:28.205 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::346e:9ff:fe92:ffa0/64 scope link 2024-09-13T17:08:28.205 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:28.205 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:08:28.205 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether c6:e2:c1:7b:16:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:08:28.205 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::c4e2:c1ff:fe7b:1657/64 scope link 2024-09-13T17:08:28.206 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:28.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:28.206 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:08:28.218 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-13T17:08:28.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:28.220 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-13T17:08:28.228 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-13T17:08:28.228 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:08:28.228 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:08:28.228 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:08:28.228 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:08:28.228 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:08:28.228 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:08:28.228 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:08:28.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:28.229 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:08:28.229 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:08:28.229 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:08:28.229 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:08:28.229 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:08:28.229 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:08:28.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:28.314 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-13T17:08:28.320 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:08:28.320 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:08:28.320 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:08:28.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:28.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-09-13T17:08:28.335 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:08:28.336 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:08:28.336 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:28.386 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:08:28.387 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:08:28.387 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:28.393 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:08:28.408 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:08:28.408 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:08:28.423 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:08:28.423 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:08:28.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:28.424 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:08:28.428 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:08:28.429 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:08:28.474 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:08:28.491 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:08:28.491 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:08:28.505 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:08:28.505 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:08:28.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:28.506 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:08:28.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:2024-09-13T17:08:28.558+0000 7ff9d6214640 -1 init, newargv = 0x5574b84ac5c0 newargc=15 2024-09-13T17:08:28.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33034]: starting ceph client 2024-09-13T17:08:28.574 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33034]: starting fuse 2024-09-13T17:08:29.612 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:08:29.630 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:08:29.630 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:08:29.640 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:08:29.641 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:08:29.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:29.642 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:08:29.647 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-09-13T17:08:29.647 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:08:29.647 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:08:29.647 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-09-13T17:08:29.647 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-09-13T17:08:29.647 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-13T17:08:29.648 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-09-13T17:08:29.648 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:08:29.648 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-09-13T17:08:29.648 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:08:29.648 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-09-13T17:08:29.648 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:08:29.648 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:08:29.648 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-09-13T17:08:29.648 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-09-13T17:08:29.648 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-09-13T17:08:29.649 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-09-13T17:08:29.649 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:08:29.649 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-09-13T17:08:29.649 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:08:29.649 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:08:29.649 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:08:29.649 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-09-13T17:08:29.649 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-09-13T17:08:29.649 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-09-13T17:08:29.649 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:08:29.649 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:08:29.649 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.1")) 2024-09-13T17:08:29.649 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-13T17:08:29.728 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.1.33034.asok 2024-09-13T17:08:29.914 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33034.asok 2024-09-13T17:08:29.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:29.914 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33034.asok status 2024-09-13T17:08:30.061 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-13T17:08:30.062 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-09-13T17:08:30.062 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:08:30.062 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:08:30.062 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "1", 2024-09-13T17:08:30.062 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-09-13T17:08:30.063 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:08:30.063 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "33034", 2024-09-13T17:08:30.063 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-09-13T17:08:30.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:08:30.063 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-09-13T17:08:30.063 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-09-13T17:08:30.063 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5764, 2024-09-13T17:08:30.063 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-09-13T17:08:30.063 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-09-13T17:08:30.063 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-09-13T17:08:30.063 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 5764 2024-09-13T17:08:30.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:08:30.064 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:08:30.064 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:08:30.064 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:08:30.064 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 3648652505 2024-09-13T17:08:30.064 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-13T17:08:30.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:08:30.064 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:08:30.064 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:08:30.064 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:08:30.064 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 3648652505 2024-09-13T17:08:30.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:08:30.064 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.5764 192.168.0.1:0/3648652505", 2024-09-13T17:08:30.065 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.1:0/3648652505", 2024-09-13T17:08:30.065 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-09-13T17:08:30.065 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 21, 2024-09-13T17:08:30.065 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 46, 2024-09-13T17:08:30.065 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:08:30.065 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-09-13T17:08:30.065 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-09-13T17:08:30.065 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-13T17:08:30.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:30.071 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-09-13T17:08:30.071 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:30.078 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-09-13T17:08:30.078 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:30.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:30.079 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:30.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:30.093 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-13T17:08:30.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:30.111 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 10A ./subdir) 2024-09-13T17:08:30.120 INFO:teuthology.orchestra.run.smithi123.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T17:08:30.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:30.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:30.122 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1y00Ki ./subdir) 2024-09-13T17:08:30.174 INFO:teuthology.orchestra.run.smithi123.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T17:08:30.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:30.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:30.175 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v af00 ./subdir) 2024-09-13T17:08:30.183 INFO:teuthology.orchestra.run.smithi123.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T17:08:30.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:30.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:30.184 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v G ./subdir) 2024-09-13T17:08:30.192 INFO:teuthology.orchestra.run.smithi123.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T17:08:30.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:30.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:30.193 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v '' ./subdir) 2024-09-13T17:08:30.249 INFO:teuthology.orchestra.run.smithi123.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T17:08:30.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:30.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:30.251 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v ' ' ./subdir) 2024-09-13T17:08:30.259 INFO:teuthology.orchestra.run.smithi123.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T17:08:30.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:30.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:30.260 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v -1t ./subdir) 2024-09-13T17:08:30.268 INFO:teuthology.orchestra.run.smithi123.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T17:08:30.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:30.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:30.270 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v -1 ./subdir) 2024-09-13T17:08:30.321 INFO:teuthology.orchestra.run.smithi123.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T17:08:30.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:30.323 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:08:30.323 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:08:30.343 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:08:30.365 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:08:30.365 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:08:30.365 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:30.372 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:30.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.532+0000 7fc5abfff700 1 Processor -- start 2024-09-13T17:08:30.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.532+0000 7fc5abfff700 1 -- start start 2024-09-13T17:08:30.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5abfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5ac0b12c0 0x7fc5ac0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:30.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5abfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc5ac0b16a0 0x7fc5ac0b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:30.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5abfff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ac0b27d0 con 0x7fc5ac0cc5f0 2024-09-13T17:08:30.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5abfff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac0b25c0 con 0x7fc5ac0b16a0 2024-09-13T17:08:30.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5abfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac0b2ab0 con 0x7fc5ac0b12c0 2024-09-13T17:08:30.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5ab7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc5ac0cc5f0 0x7fc5ac06d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39296/0 (socket says 172.21.15.123:39296) 2024-09-13T17:08:30.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5ab7fe700 1 -- 172.21.15.123:0/2018642067 learned_addr learned my addr 172.21.15.123:0/2018642067 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:30.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5a27fc700 1 --2- 172.21.15.123:0/2018642067 >> v2:172.21.15.153:3300/0 conn(0x7fc5ac0b16a0 0x7fc5ac0b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:30.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5aaffd700 1 --2- 172.21.15.123:0/2018642067 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5ac0b12c0 0x7fc5ac0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:30.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5aa7fc700 1 -- 172.21.15.123:0/2018642067 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140990433 0 0) 0x7fc5ac0b27d0 con 0x7fc5ac0cc5f0 2024-09-13T17:08:30.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5aa7fc700 1 -- 172.21.15.123:0/2018642067 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5980035d0 con 0x7fc5ac0cc5f0 2024-09-13T17:08:30.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5aaffd700 1 -- 172.21.15.123:0/2018642067 >> v2:172.21.15.153:3300/0 conn(0x7fc5ac0b16a0 msgr2=0x7fc5ac0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:30.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5aaffd700 1 --2- 172.21.15.123:0/2018642067 >> v2:172.21.15.153:3300/0 conn(0x7fc5ac0b16a0 0x7fc5ac0b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:30.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5aaffd700 1 -- 172.21.15.123:0/2018642067 >> v1:172.21.15.123:6789/0 conn(0x7fc5ac0cc5f0 legacy=0x7fc5ac06d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:30.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5aaffd700 1 -- 172.21.15.123:0/2018642067 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac0b2d90 con 0x7fc5ac0b12c0 2024-09-13T17:08:30.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5a27fc700 1 --2- 172.21.15.123:0/2018642067 >> v2:172.21.15.153:3300/0 conn(0x7fc5ac0b16a0 0x7fc5ac0b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:30.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5aaffd700 1 --2- 172.21.15.123:0/2018642067 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5ac0b12c0 0x7fc5ac0cc0b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc59c009850 tx=0x7fc59c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea9273683f6756cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:30.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5aa7fc700 1 -- 172.21.15.123:0/2018642067 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c011830 con 0x7fc5ac0b12c0 2024-09-13T17:08:30.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5aa7fc700 1 -- 172.21.15.123:0/2018642067 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c011990 con 0x7fc5ac0b12c0 2024-09-13T17:08:30.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.536+0000 7fc5aa7fc700 1 -- 172.21.15.123:0/2018642067 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c011d00 con 0x7fc5ac0b12c0 2024-09-13T17:08:30.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.540+0000 7fc5abfff700 1 -- 172.21.15.123:0/2018642067 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5ac0b12c0 msgr2=0x7fc5ac0cc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:30.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.540+0000 7fc5abfff700 1 --2- 172.21.15.123:0/2018642067 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5ac0b12c0 0x7fc5ac0cc0b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc59c009850 tx=0x7fc59c009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:30.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.540+0000 7fc5abfff700 1 -- 172.21.15.123:0/2018642067 shutdown_connections 2024-09-13T17:08:30.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.540+0000 7fc5abfff700 1 --2- 172.21.15.123:0/2018642067 >> v2:172.21.15.153:3300/0 conn(0x7fc5ac0b16a0 0x7fc5ac0b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:30.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.540+0000 7fc5abfff700 1 --2- 172.21.15.123:0/2018642067 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5ac0b12c0 0x7fc5ac0cc0b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:30.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.540+0000 7fc5abfff700 1 -- 172.21.15.123:0/2018642067 >> 172.21.15.123:0/2018642067 conn(0x7fc5ac0b4630 msgr2=0x7fc5ac0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:30.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.540+0000 7fc5abfff700 1 -- 172.21.15.123:0/2018642067 shutdown_connections 2024-09-13T17:08:30.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.540+0000 7fc5abfff700 1 -- 172.21.15.123:0/2018642067 wait complete. 2024-09-13T17:08:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5abfff700 1 Processor -- start 2024-09-13T17:08:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5abfff700 1 -- start start 2024-09-13T17:08:30.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5abfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5ac0b12c0 0x7fc5ac14ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:30.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5abfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5ac0b16a0 0x7fc5ac14a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:30.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5abfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5ac0cc5f0 0x7fc5ac14f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:30.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5abfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac14f990 con 0x7fc5ac0b16a0 2024-09-13T17:08:30.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5abfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac0cf160 con 0x7fc5ac0cc5f0 2024-09-13T17:08:30.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5abfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac0cf440 con 0x7fc5ac0b12c0 2024-09-13T17:08:30.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5a27fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5ac0b16a0 0x7fc5ac14a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:30.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5aaffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5ac0b12c0 0x7fc5ac14ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:30.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5a27fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5ac0b16a0 0x7fc5ac14a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46606/0 (socket says 172.21.15.123:46606) 2024-09-13T17:08:30.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5a27fc700 1 -- 172.21.15.123:0/258394482 learned_addr learned my addr 172.21.15.123:0/258394482 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:30.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5ab7fe700 1 --2- 172.21.15.123:0/258394482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5ac0cc5f0 0x7fc5ac14f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:30.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5a27fc700 1 -- 172.21.15.123:0/258394482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5ac0b12c0 msgr2=0x7fc5ac14ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:30.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5a27fc700 1 --2- 172.21.15.123:0/258394482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5ac0b12c0 0x7fc5ac14ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:30.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5a27fc700 1 -- 172.21.15.123:0/258394482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5ac0cc5f0 msgr2=0x7fc5ac14f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:30.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5a27fc700 1 --2- 172.21.15.123:0/258394482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5ac0cc5f0 0x7fc5ac14f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:30.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5a27fc700 1 -- 172.21.15.123:0/258394482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5940094b0 con 0x7fc5ac0b16a0 2024-09-13T17:08:30.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5a27fc700 1 --2- 172.21.15.123:0/258394482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5ac0b16a0 0x7fc5ac14a7c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc59400ebe0 tx=0x7fc59400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:30.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5a8ff9700 1 -- 172.21.15.123:0/258394482 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59400c850 con 0x7fc5ac0b16a0 2024-09-13T17:08:30.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5a8ff9700 1 -- 172.21.15.123:0/258394482 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59400c9b0 con 0x7fc5ac0b16a0 2024-09-13T17:08:30.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5a8ff9700 1 -- 172.21.15.123:0/258394482 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59400cd40 con 0x7fc5ac0b16a0 2024-09-13T17:08:30.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5abfff700 1 -- 172.21.15.123:0/258394482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c0094b0 con 0x7fc5ac0b16a0 2024-09-13T17:08:30.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.544+0000 7fc5abfff700 1 -- 172.21.15.123:0/258394482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac0cfa00 con 0x7fc5ac0b16a0 2024-09-13T17:08:30.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.548+0000 7fc5abfff700 1 -- 172.21.15.123:0/258394482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac0cc0b0 con 0x7fc5ac0b16a0 2024-09-13T17:08:30.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.548+0000 7fc5a8ff9700 1 -- 172.21.15.123:0/258394482 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc594013470 con 0x7fc5ac0b16a0 2024-09-13T17:08:30.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.548+0000 7fc5a8ff9700 1 --2- 172.21.15.123:0/258394482 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc58c066760 0x7fc58c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:30.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.548+0000 7fc5a8ff9700 1 -- 172.21.15.123:0/258394482 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc594084560 con 0x7fc5ac0b16a0 2024-09-13T17:08:30.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.548+0000 7fc5aaffd700 1 --2- 172.21.15.123:0/258394482 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc58c066760 0x7fc58c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:30.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.548+0000 7fc5aaffd700 1 --2- 172.21.15.123:0/258394482 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc58c066760 0x7fc58c068c20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0090b0 tx=0x7fc59c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:30.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.556+0000 7fc5a8ff9700 1 -- 172.21.15.123:0/258394482 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc5940518c0 con 0x7fc5ac0b16a0 2024-09-13T17:08:30.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.732+0000 7fc5abfff700 1 -- 172.21.15.123:0/258394482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5ac14fba0 con 0x7fc5ac0b16a0 2024-09-13T17:08:30.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.732+0000 7fc5a8ff9700 1 -- 172.21.15.123:0/258394482 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16561 (secure 0 0 0) 0x7fc59400cea0 con 0x7fc5ac0b16a0 2024-09-13T17:08:30.736 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:30.736 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":46,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:20.729309+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:18.071457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:18.723653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:30.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.732+0000 7fc5abfff700 1 -- 172.21.15.123:0/258394482 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc58c066760 msgr2=0x7fc58c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:30.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.732+0000 7fc5abfff700 1 --2- 172.21.15.123:0/258394482 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc58c066760 0x7fc58c068c20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0090b0 tx=0x7fc59c008030 comp rx=0 tx=0).stop 2024-09-13T17:08:30.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.732+0000 7fc5abfff700 1 -- 172.21.15.123:0/258394482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5ac0b16a0 msgr2=0x7fc5ac14a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:30.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.732+0000 7fc5abfff700 1 --2- 172.21.15.123:0/258394482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5ac0b16a0 0x7fc5ac14a7c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc59400ebe0 tx=0x7fc59400eef0 comp rx=0 tx=0).stop 2024-09-13T17:08:30.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.736+0000 7fc5abfff700 1 -- 172.21.15.123:0/258394482 shutdown_connections 2024-09-13T17:08:30.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.736+0000 7fc5abfff700 1 --2- 172.21.15.123:0/258394482 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc58c066760 0x7fc58c068c20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:30.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.736+0000 7fc5abfff700 1 --2- 172.21.15.123:0/258394482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5ac0cc5f0 0x7fc5ac14f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:30.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.736+0000 7fc5abfff700 1 --2- 172.21.15.123:0/258394482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5ac0b16a0 0x7fc5ac14a7c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:30.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.736+0000 7fc5abfff700 1 --2- 172.21.15.123:0/258394482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5ac0b12c0 0x7fc5ac14ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:30.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.736+0000 7fc5abfff700 1 -- 172.21.15.123:0/258394482 >> 172.21.15.123:0/258394482 conn(0x7fc5ac0b4630 msgr2=0x7fc5ac0afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:30.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.736+0000 7fc5abfff700 1 -- 172.21.15.123:0/258394482 shutdown_connections 2024-09-13T17:08:30.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.736+0000 7fc5abfff700 1 -- 172.21.15.123:0/258394482 wait complete. 2024-09-13T17:08:30.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:08:18.071457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:08:18.723653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:08:30.757 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:08:30.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf1d27f700 1 Processor -- start 2024-09-13T17:08:30.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf1d27f700 1 -- start start 2024-09-13T17:08:30.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf1d27f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcf180c98c0 0x7fcf180cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:30.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf1d27f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf180ceec0 con 0x7fcf181604b0 2024-09-13T17:08:30.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf1d27f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf180ce620 con 0x7fcf18160890 2024-09-13T17:08:30.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf1d27f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf180ce430 con 0x7fcf180c98c0 2024-09-13T17:08:30.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf16ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcf181604b0 0x7fcf180cf2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39298/0 (socket says 172.21.15.123:39298) 2024-09-13T17:08:30.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf16ffd700 1 -- 172.21.15.123:0/1722386959 learned_addr learned my addr 172.21.15.123:0/1722386959 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:30.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf167fc700 1 --2- 172.21.15.123:0/1722386959 >> v2:172.21.15.153:3300/0 conn(0x7fcf180c98c0 0x7fcf180cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:30.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf15ffb700 1 -- 172.21.15.123:0/1722386959 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677375761 0 0) 0x7fcf180ceec0 con 0x7fcf181604b0 2024-09-13T17:08:30.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf15ffb700 1 -- 172.21.15.123:0/1722386959 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf040035d0 con 0x7fcf181604b0 2024-09-13T17:08:30.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf167fc700 1 -- 172.21.15.123:0/1722386959 >> v1:172.21.15.153:6789/0 conn(0x7fcf18160890 legacy=0x7fcf180b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:30.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf167fc700 1 -- 172.21.15.123:0/1722386959 >> v1:172.21.15.123:6789/0 conn(0x7fcf181604b0 legacy=0x7fcf180cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:30.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf167fc700 1 -- 172.21.15.123:0/1722386959 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf180ce900 con 0x7fcf180c98c0 2024-09-13T17:08:30.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.876+0000 7fcf167fc700 1 --2- 172.21.15.123:0/1722386959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf180c98c0 0x7fcf180cf9f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009850 tx=0x7fcf08009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56604f544071502 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:30.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.880+0000 7fcf15ffb700 1 -- 172.21.15.123:0/1722386959 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08011830 con 0x7fcf180c98c0 2024-09-13T17:08:30.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.880+0000 7fcf15ffb700 1 -- 172.21.15.123:0/1722386959 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf08011990 con 0x7fcf180c98c0 2024-09-13T17:08:30.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.880+0000 7fcf15ffb700 1 -- 172.21.15.123:0/1722386959 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08011d00 con 0x7fcf180c98c0 2024-09-13T17:08:30.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.880+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1722386959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf180c98c0 msgr2=0x7fcf180cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:30.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.880+0000 7fcf1d27f700 1 --2- 172.21.15.123:0/1722386959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf180c98c0 0x7fcf180cf9f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009850 tx=0x7fcf08009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:30.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.880+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1722386959 shutdown_connections 2024-09-13T17:08:30.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.880+0000 7fcf1d27f700 1 --2- 172.21.15.123:0/1722386959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf180c98c0 0x7fcf180cf9f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:30.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.880+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1722386959 >> 172.21.15.123:0/1722386959 conn(0x7fcf180d2cb0 msgr2=0x7fcf180d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:30.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.880+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1722386959 shutdown_connections 2024-09-13T17:08:30.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.880+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1722386959 wait complete. 2024-09-13T17:08:30.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.880+0000 7fcf1d27f700 1 Processor -- start 2024-09-13T17:08:30.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.880+0000 7fcf1d27f700 1 -- start start 2024-09-13T17:08:30.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf1d27f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf180c98c0 0x7fcf181f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:30.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf1d27f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf181604b0 0x7fcf180b85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:30.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf1d27f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf18160890 0x7fcf181511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:30.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf1d27f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180b8af0 con 0x7fcf18160890 2024-09-13T17:08:30.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf1d27f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf181f7180 con 0x7fcf181604b0 2024-09-13T17:08:30.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf1d27f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf181516e0 con 0x7fcf180c98c0 2024-09-13T17:08:30.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf177fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf18160890 0x7fcf181511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:30.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf177fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf18160890 0x7fcf181511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46620/0 (socket says 172.21.15.123:46620) 2024-09-13T17:08:30.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf16ffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf180c98c0 0x7fcf181f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:30.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf177fe700 1 -- 172.21.15.123:0/1644196486 learned_addr learned my addr 172.21.15.123:0/1644196486 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:30.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf167fc700 1 --2- 172.21.15.123:0/1644196486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf181604b0 0x7fcf180b85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:30.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf177fe700 1 -- 172.21.15.123:0/1644196486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf180c98c0 msgr2=0x7fcf181f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:30.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf177fe700 1 --2- 172.21.15.123:0/1644196486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf180c98c0 0x7fcf181f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:30.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf177fe700 1 -- 172.21.15.123:0/1644196486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf181604b0 msgr2=0x7fcf180b85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:30.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf177fe700 1 --2- 172.21.15.123:0/1644196486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf181604b0 0x7fcf180b85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:30.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf177fe700 1 -- 172.21.15.123:0/1644196486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf080094b0 con 0x7fcf18160890 2024-09-13T17:08:30.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf177fe700 1 --2- 172.21.15.123:0/1644196486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf18160890 0x7fcf181511a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000cbf0 tx=0x7fcf1000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:30.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf0f7fe700 1 -- 172.21.15.123:0/1644196486 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10003c20 con 0x7fcf18160890 2024-09-13T17:08:30.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf0f7fe700 1 -- 172.21.15.123:0/1644196486 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf10003d80 con 0x7fcf18160890 2024-09-13T17:08:30.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1644196486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf181f68e0 con 0x7fcf18160890 2024-09-13T17:08:30.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf0f7fe700 1 -- 172.21.15.123:0/1644196486 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000a9e0 con 0x7fcf18160890 2024-09-13T17:08:30.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.884+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1644196486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf181f6ea0 con 0x7fcf18160890 2024-09-13T17:08:30.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.888+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1644196486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf180cf2e0 con 0x7fcf18160890 2024-09-13T17:08:30.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.888+0000 7fcf0f7fe700 1 -- 172.21.15.123:0/1644196486 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf1000ab40 con 0x7fcf18160890 2024-09-13T17:08:30.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.888+0000 7fcf0f7fe700 1 --2- 172.21.15.123:0/1644196486 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcef8066760 0x7fcef8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:30.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.888+0000 7fcf0f7fe700 1 -- 172.21.15.123:0/1644196486 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf10084080 con 0x7fcf18160890 2024-09-13T17:08:30.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.888+0000 7fcf16ffd700 1 --2- 172.21.15.123:0/1644196486 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcef8066760 0x7fcef8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:30.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.888+0000 7fcf16ffd700 1 --2- 172.21.15.123:0/1644196486 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcef8066760 0x7fcef8068c20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcf00007fd0 tx=0x7fcf00007de0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:30.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:30.896+0000 7fcf0f7fe700 1 -- 172.21.15.123:0/1644196486 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf10051370 con 0x7fcf18160890 2024-09-13T17:08:31.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.064+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1644196486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf180ccf10 con 0x7fcf18160890 2024-09-13T17:08:31.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.064+0000 7fcf0f7fe700 1 -- 172.21.15.123:0/1644196486 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf10054990 con 0x7fcf18160890 2024-09-13T17:08:31.068 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:08:31.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.068+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1644196486 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcef8066760 msgr2=0x7fcef8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.068+0000 7fcf1d27f700 1 --2- 172.21.15.123:0/1644196486 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcef8066760 0x7fcef8068c20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcf00007fd0 tx=0x7fcf00007de0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.068+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1644196486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf18160890 msgr2=0x7fcf181511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.068+0000 7fcf1d27f700 1 --2- 172.21.15.123:0/1644196486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf18160890 0x7fcf181511a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000cbf0 tx=0x7fcf1000cf00 comp rx=0 tx=0).stop 2024-09-13T17:08:31.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.068+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1644196486 shutdown_connections 2024-09-13T17:08:31.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.068+0000 7fcf1d27f700 1 --2- 172.21.15.123:0/1644196486 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcef8066760 0x7fcef8068c20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.068+0000 7fcf1d27f700 1 --2- 172.21.15.123:0/1644196486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf18160890 0x7fcf181511a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.068+0000 7fcf1d27f700 1 --2- 172.21.15.123:0/1644196486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf181604b0 0x7fcf180b85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.068+0000 7fcf1d27f700 1 --2- 172.21.15.123:0/1644196486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcf180c98c0 0x7fcf181f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.068+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1644196486 >> 172.21.15.123:0/1644196486 conn(0x7fcf180d2cb0 msgr2=0x7fcf180b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:31.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.068+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1644196486 shutdown_connections 2024-09-13T17:08:31.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.068+0000 7fcf1d27f700 1 -- 172.21.15.123:0/1644196486 wait complete. 2024-09-13T17:08:31.082 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:08:31.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.196+0000 7f66b3fff700 1 Processor -- start 2024-09-13T17:08:31.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.196+0000 7f66b3fff700 1 -- start start 2024-09-13T17:08:31.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.196+0000 7f66b3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b40b2b00 0x7f66b4071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.196+0000 7f66b3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f66b40ccfd0 0x7f66b4071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.196+0000 7f66b3fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b40704c0 con 0x7f66b415cc30 2024-09-13T17:08:31.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.196+0000 7f66b3fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b415d010 con 0x7f66b40ccfd0 2024-09-13T17:08:31.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.196+0000 7f66b3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40707a0 con 0x7f66b40b2b00 2024-09-13T17:08:31.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.196+0000 7f66b37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f66b40ccfd0 0x7f66b4071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.196+0000 7f66b2ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f66b415cc30 0x7f66b40b23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39308/0 (socket says 172.21.15.123:39308) 2024-09-13T17:08:31.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.196+0000 7f66b37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f66b40ccfd0 0x7f66b4071fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46628/0 (socket says 172.21.15.123:46628) 2024-09-13T17:08:31.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.196+0000 7f66b2ffd700 1 -- 172.21.15.123:0/2291922580 learned_addr learned my addr 172.21.15.123:0/2291922580 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:31.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.196+0000 7f66b27fc700 1 --2- 172.21.15.123:0/2291922580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b40b2b00 0x7f66b4071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b37fe700 1 -- 172.21.15.123:0/2291922580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b40b2b00 msgr2=0x7f66b4071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:31.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b37fe700 1 --2- 172.21.15.123:0/2291922580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b40b2b00 0x7f66b4071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b37fe700 1 -- 172.21.15.123:0/2291922580 >> v1:172.21.15.123:6789/0 conn(0x7f66b415cc30 legacy=0x7f66b40b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b37fe700 1 -- 172.21.15.123:0/2291922580 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b4070a80 con 0x7f66b40ccfd0 2024-09-13T17:08:31.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b37fe700 1 --2- 172.21.15.123:0/2291922580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b40ccfd0 0x7f66b4071fb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009d90 tx=0x7f66ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22e8d51b3c94833 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:31.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b1ffb700 1 -- 172.21.15.123:0/2291922580 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac00e070 con 0x7f66b40ccfd0 2024-09-13T17:08:31.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b1ffb700 1 -- 172.21.15.123:0/2291922580 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ac00bbd0 con 0x7f66b40ccfd0 2024-09-13T17:08:31.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b1ffb700 1 -- 172.21.15.123:0/2291922580 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac012430 con 0x7f66b40ccfd0 2024-09-13T17:08:31.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b3fff700 1 -- 172.21.15.123:0/2291922580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b40ccfd0 msgr2=0x7f66b4071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b3fff700 1 --2- 172.21.15.123:0/2291922580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b40ccfd0 0x7f66b4071fb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009d90 tx=0x7f66ac00b330 comp rx=0 tx=0).stop 2024-09-13T17:08:31.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b3fff700 1 -- 172.21.15.123:0/2291922580 shutdown_connections 2024-09-13T17:08:31.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b3fff700 1 --2- 172.21.15.123:0/2291922580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b40ccfd0 0x7f66b4071fb0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b3fff700 1 --2- 172.21.15.123:0/2291922580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b40b2b00 0x7f66b4071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b3fff700 1 -- 172.21.15.123:0/2291922580 >> 172.21.15.123:0/2291922580 conn(0x7f66b4066780 msgr2=0x7f66b40cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:31.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b3fff700 1 -- 172.21.15.123:0/2291922580 shutdown_connections 2024-09-13T17:08:31.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b3fff700 1 -- 172.21.15.123:0/2291922580 wait complete. 2024-09-13T17:08:31.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b3fff700 1 Processor -- start 2024-09-13T17:08:31.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.200+0000 7f66b3fff700 1 -- start start 2024-09-13T17:08:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b40b2b00 0x7f66b40b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b40ccfd0 0x7f66b4154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66b415cc30 0x7f66b4152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b3fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40b4530 con 0x7f66b40b2b00 2024-09-13T17:08:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b4156e90 con 0x7f66b415cc30 2024-09-13T17:08:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b4155280 con 0x7f66b40ccfd0 2024-09-13T17:08:31.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b40b2b00 0x7f66b40b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b40b2b00 0x7f66b40b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46644/0 (socket says 172.21.15.123:46644) 2024-09-13T17:08:31.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b2ffd700 1 -- 172.21.15.123:0/515730772 learned_addr learned my addr 172.21.15.123:0/515730772 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:31.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b27fc700 1 --2- 172.21.15.123:0/515730772 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b40ccfd0 0x7f66b4154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b37fe700 1 --2- 172.21.15.123:0/515730772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66b415cc30 0x7f66b4152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b2ffd700 1 -- 172.21.15.123:0/515730772 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b40ccfd0 msgr2=0x7f66b4154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b2ffd700 1 --2- 172.21.15.123:0/515730772 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b40ccfd0 0x7f66b4154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b2ffd700 1 -- 172.21.15.123:0/515730772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66b415cc30 msgr2=0x7f66b4152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b2ffd700 1 --2- 172.21.15.123:0/515730772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66b415cc30 0x7f66b4152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b2ffd700 1 -- 172.21.15.123:0/515730772 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac009a70 con 0x7f66b40b2b00 2024-09-13T17:08:31.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b2ffd700 1 --2- 172.21.15.123:0/515730772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b40b2b00 0x7f66b40b3ff0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f66a8001eb0 tx=0x7f66a800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:31.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f669b7fe700 1 -- 172.21.15.123:0/515730772 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8005d90 con 0x7f66b40b2b00 2024-09-13T17:08:31.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f669b7fe700 1 -- 172.21.15.123:0/515730772 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a80070d0 con 0x7f66b40b2b00 2024-09-13T17:08:31.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b3fff700 1 -- 172.21.15.123:0/515730772 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b4155560 con 0x7f66b40b2b00 2024-09-13T17:08:31.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f669b7fe700 1 -- 172.21.15.123:0/515730772 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8007440 con 0x7f66b40b2b00 2024-09-13T17:08:31.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.204+0000 7f66b3fff700 1 -- 172.21.15.123:0/515730772 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b41573c0 con 0x7f66b40b2b00 2024-09-13T17:08:31.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.208+0000 7f66b3fff700 1 -- 172.21.15.123:0/515730772 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b40b23f0 con 0x7f66b40b2b00 2024-09-13T17:08:31.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.208+0000 7f669b7fe700 1 -- 172.21.15.123:0/515730772 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f66a80075a0 con 0x7f66b40b2b00 2024-09-13T17:08:31.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.208+0000 7f669b7fe700 1 --2- 172.21.15.123:0/515730772 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66a0066730 0x7f66a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.208+0000 7f669b7fe700 1 -- 172.21.15.123:0/515730772 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66a8083300 con 0x7f66b40b2b00 2024-09-13T17:08:31.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.208+0000 7f66b27fc700 1 --2- 172.21.15.123:0/515730772 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66a0066730 0x7f66a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.208+0000 7f66b27fc700 1 --2- 172.21.15.123:0/515730772 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66a0066730 0x7f66a0068bf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f66b40d0620 tx=0x7f66a4008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:31.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.216+0000 7f669b7fe700 1 -- 172.21.15.123:0/515730772 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f66a80507b0 con 0x7f66b40b2b00 2024-09-13T17:08:31.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.388+0000 7f66b3fff700 1 -- 172.21.15.123:0/515730772 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f66b40b0b80 con 0x7f66b40b2b00 2024-09-13T17:08:31.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.388+0000 7f669b7fe700 1 -- 172.21.15.123:0/515730772 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f66a8053dd0 con 0x7f66b40b2b00 2024-09-13T17:08:31.395 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:08:31.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.392+0000 7f66b3fff700 1 -- 172.21.15.123:0/515730772 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66a0066730 msgr2=0x7f66a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.392+0000 7f66b3fff700 1 --2- 172.21.15.123:0/515730772 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66a0066730 0x7f66a0068bf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f66b40d0620 tx=0x7f66a4008040 comp rx=0 tx=0).stop 2024-09-13T17:08:31.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.392+0000 7f66b3fff700 1 -- 172.21.15.123:0/515730772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b40b2b00 msgr2=0x7f66b40b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.392+0000 7f66b3fff700 1 --2- 172.21.15.123:0/515730772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b40b2b00 0x7f66b40b3ff0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f66a8001eb0 tx=0x7f66a800c7b0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.392+0000 7f66b3fff700 1 -- 172.21.15.123:0/515730772 shutdown_connections 2024-09-13T17:08:31.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.392+0000 7f66b3fff700 1 --2- 172.21.15.123:0/515730772 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66a0066730 0x7f66a0068bf0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.392+0000 7f66b3fff700 1 --2- 172.21.15.123:0/515730772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66b415cc30 0x7f66b4152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.392+0000 7f66b3fff700 1 --2- 172.21.15.123:0/515730772 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66b40ccfd0 0x7f66b4154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.392+0000 7f66b3fff700 1 --2- 172.21.15.123:0/515730772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b40b2b00 0x7f66b40b3ff0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.392+0000 7f66b3fff700 1 -- 172.21.15.123:0/515730772 >> 172.21.15.123:0/515730772 conn(0x7f66b4066780 msgr2=0x7f66b4159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:31.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.392+0000 7f66b3fff700 1 -- 172.21.15.123:0/515730772 shutdown_connections 2024-09-13T17:08:31.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.392+0000 7f66b3fff700 1 -- 172.21.15.123:0/515730772 wait complete. 2024-09-13T17:08:31.409 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:08:31.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f023e6d0700 1 Processor -- start 2024-09-13T17:08:31.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f023e6d0700 1 -- start start 2024-09-13T17:08:31.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f023e6d0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023815cc60 0x7f02380d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f023e6d0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f02380ce700 0x7f02380d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f023e6d0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02380d06b0 con 0x7f02380d3600 2024-09-13T17:08:31.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f023e6d0700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02380d0ec0 con 0x7f02380ce700 2024-09-13T17:08:31.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f023e6d0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02380cfec0 con 0x7f023815cc60 2024-09-13T17:08:31.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f023cecd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f02380d3600 0x7f02380b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39310/0 (socket says 172.21.15.123:39310) 2024-09-13T17:08:31.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f023cecd700 1 -- 172.21.15.123:0/2569793882 learned_addr learned my addr 172.21.15.123:0/2569793882 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:31.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f023decf700 1 --2- 172.21.15.123:0/2569793882 >> v2:172.21.15.153:3300/0 conn(0x7f02380ce700 0x7f02380d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f023d6ce700 1 --2- 172.21.15.123:0/2569793882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023815cc60 0x7f02380d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f022ffff700 1 -- 172.21.15.123:0/2569793882 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773787977 0 0) 0x7f02380d06b0 con 0x7f02380d3600 2024-09-13T17:08:31.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f022ffff700 1 -- 172.21.15.123:0/2569793882 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02240035d0 con 0x7f02380d3600 2024-09-13T17:08:31.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f022ffff700 1 -- 172.21.15.123:0/2569793882 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2065002619 0 0) 0x7f02240035d0 con 0x7f02380d3600 2024-09-13T17:08:31.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f022ffff700 1 -- 172.21.15.123:0/2569793882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023815cc60 msgr2=0x7f02380d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:31.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f022ffff700 1 --2- 172.21.15.123:0/2569793882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023815cc60 0x7f02380d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f022ffff700 1 -- 172.21.15.123:0/2569793882 >> v2:172.21.15.153:3300/0 conn(0x7f02380ce700 msgr2=0x7f02380d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:31.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f022ffff700 1 --2- 172.21.15.123:0/2569793882 >> v2:172.21.15.153:3300/0 conn(0x7f02380ce700 0x7f02380d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f022ffff700 1 -- 172.21.15.123:0/2569793882 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02380d0900 con 0x7f02380d3600 2024-09-13T17:08:31.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f022ffff700 1 -- 172.21.15.123:0/2569793882 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f0234001670 con 0x7f02380d3600 2024-09-13T17:08:31.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f022ffff700 1 -- 172.21.15.123:0/2569793882 >> v1:172.21.15.123:6789/0 conn(0x7f02380d3600 legacy=0x7f02380b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.524+0000 7f022ffff700 1 --2- 172.21.15.123:0/2569793882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0224003a20 0x7f0224003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f022ffff700 1 --2- 172.21.15.123:0/2569793882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0224004870 0x7f0224004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f022ffff700 1 --2- 172.21.15.123:0/2569793882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023815cc60 0x7f0224005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f022ffff700 1 -- 172.21.15.123:0/2569793882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380d0ec0 con 0x7f0224004870 2024-09-13T17:08:31.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f022ffff700 1 -- 172.21.15.123:0/2569793882 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380cfec0 con 0x7f0224003a20 2024-09-13T17:08:31.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f022ffff700 1 -- 172.21.15.123:0/2569793882 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022400ba30 con 0x7f023815cc60 2024-09-13T17:08:31.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023cecd700 1 --2- 172.21.15.123:0/2569793882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0224004870 0x7f0224004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023d6ce700 1 --2- 172.21.15.123:0/2569793882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0224003a20 0x7f0224003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023decf700 1 --2- 172.21.15.123:0/2569793882 >> v2:172.21.15.153:3300/0 conn(0x7f02380ce700 0x7f02380d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:31.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023cecd700 1 -- 172.21.15.123:0/2569793882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023815cc60 msgr2=0x7f0224005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:31.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023cecd700 1 --2- 172.21.15.123:0/2569793882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023815cc60 0x7f0224005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023cecd700 1 -- 172.21.15.123:0/2569793882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0224003a20 msgr2=0x7f0224003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:31.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023cecd700 1 --2- 172.21.15.123:0/2569793882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0224003a20 0x7f0224003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023cecd700 1 -- 172.21.15.123:0/2569793882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02240035d0 con 0x7f0224004870 2024-09-13T17:08:31.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023cecd700 1 --2- 172.21.15.123:0/2569793882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0224004870 0x7f0224004cf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f023400c2a0 tx=0x7f02240058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5005aeca0a4a86d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:31.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f022ffff700 1 -- 172.21.15.123:0/2569793882 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023400ce00 con 0x7f0224004870 2024-09-13T17:08:31.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f022ffff700 1 -- 172.21.15.123:0/2569793882 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0234005980 con 0x7f0224004870 2024-09-13T17:08:31.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f022ffff700 1 -- 172.21.15.123:0/2569793882 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234005d30 con 0x7f0224004870 2024-09-13T17:08:31.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023e6d0700 1 -- 172.21.15.123:0/2569793882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0224004870 msgr2=0x7f0224004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023e6d0700 1 --2- 172.21.15.123:0/2569793882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0224004870 0x7f0224004cf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f023400c2a0 tx=0x7f02240058a0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023decf700 1 -- 172.21.15.123:0/2569793882 reap_dead start 2024-09-13T17:08:31.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023e6d0700 1 -- 172.21.15.123:0/2569793882 shutdown_connections 2024-09-13T17:08:31.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023e6d0700 1 -- 172.21.15.123:0/2569793882 >> 172.21.15.123:0/2569793882 conn(0x7f02380d2ae0 msgr2=0x7f02380d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:31.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023e6d0700 1 -- 172.21.15.123:0/2569793882 shutdown_connections 2024-09-13T17:08:31.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023e6d0700 1 -- 172.21.15.123:0/2569793882 wait complete. 2024-09-13T17:08:31.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023e6d0700 1 Processor -- start 2024-09-13T17:08:31.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023e6d0700 1 -- start start 2024-09-13T17:08:31.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023e6d0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0224004870 0x7f02380b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023e6d0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02380c9fd0 0x7f02381553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023e6d0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023815b480 0x7f023815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023e6d0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023815be20 con 0x7f02380c9fd0 2024-09-13T17:08:31.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023e6d0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380ca450 con 0x7f0224004870 2024-09-13T17:08:31.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.528+0000 7f023e6d0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c6890 con 0x7f023815b480 2024-09-13T17:08:31.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f023cecd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02380c9fd0 0x7f02381553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f023cecd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02380c9fd0 0x7f02381553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46670/0 (socket says 172.21.15.123:46670) 2024-09-13T17:08:31.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f023cecd700 1 -- 172.21.15.123:0/3971460415 learned_addr learned my addr 172.21.15.123:0/3971460415 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:31.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f023d6ce700 1 --2- 172.21.15.123:0/3971460415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0224004870 0x7f02380b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f023decf700 1 --2- 172.21.15.123:0/3971460415 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023815b480 0x7f023815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f023cecd700 1 -- 172.21.15.123:0/3971460415 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023815b480 msgr2=0x7f023815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f023cecd700 1 --2- 172.21.15.123:0/3971460415 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023815b480 0x7f023815b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f023cecd700 1 -- 172.21.15.123:0/3971460415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0224004870 msgr2=0x7f02380b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f023cecd700 1 --2- 172.21.15.123:0/3971460415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0224004870 0x7f02380b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f023cecd700 1 -- 172.21.15.123:0/3971460415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02380c6b70 con 0x7f02380c9fd0 2024-09-13T17:08:31.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f023cecd700 1 --2- 172.21.15.123:0/3971460415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02380c9fd0 0x7f02381553c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0224004760 tx=0x7f0234001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:31.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f022dffb700 1 -- 172.21.15.123:0/3971460415 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02340070d0 con 0x7f02380c9fd0 2024-09-13T17:08:31.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f022dffb700 1 -- 172.21.15.123:0/3971460415 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0234007230 con 0x7f02380c9fd0 2024-09-13T17:08:31.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f022dffb700 1 -- 172.21.15.123:0/3971460415 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02340075e0 con 0x7f02380c9fd0 2024-09-13T17:08:31.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f023e6d0700 1 -- 172.21.15.123:0/3971460415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02380c6e50 con 0x7f02380c9fd0 2024-09-13T17:08:31.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f023e6d0700 1 -- 172.21.15.123:0/3971460415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0238155900 con 0x7f02380c9fd0 2024-09-13T17:08:31.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.532+0000 7f023e6d0700 1 -- 172.21.15.123:0/3971460415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02380d10a0 con 0x7f02380c9fd0 2024-09-13T17:08:31.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.536+0000 7f022dffb700 1 -- 172.21.15.123:0/3971460415 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0234019030 con 0x7f02380c9fd0 2024-09-13T17:08:31.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.536+0000 7f022dffb700 1 --2- 172.21.15.123:0/3971460415 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f021c066760 0x7f021c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.536+0000 7f022dffb700 1 -- 172.21.15.123:0/3971460415 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0234085290 con 0x7f02380c9fd0 2024-09-13T17:08:31.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.536+0000 7f023d6ce700 1 --2- 172.21.15.123:0/3971460415 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f021c066760 0x7f021c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.536+0000 7f023d6ce700 1 --2- 172.21.15.123:0/3971460415 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f021c066760 0x7f021c068c20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f02380c7cc0 tx=0x7f0228009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:31.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.544+0000 7f022dffb700 1 -- 172.21.15.123:0/3971460415 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0234052690 con 0x7f02380c9fd0 2024-09-13T17:08:31.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.712+0000 7f023e6d0700 1 -- 172.21.15.123:0/3971460415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0238160160 con 0x7f02380c9fd0 2024-09-13T17:08:31.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.712+0000 7f022dffb700 1 -- 172.21.15.123:0/3971460415 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0234055cb0 con 0x7f02380c9fd0 2024-09-13T17:08:31.715 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:08:31.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.712+0000 7f023e6d0700 1 -- 172.21.15.123:0/3971460415 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f021c066760 msgr2=0x7f021c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.712+0000 7f023e6d0700 1 --2- 172.21.15.123:0/3971460415 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f021c066760 0x7f021c068c20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f02380c7cc0 tx=0x7f0228009240 comp rx=0 tx=0).stop 2024-09-13T17:08:31.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.712+0000 7f023e6d0700 1 -- 172.21.15.123:0/3971460415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02380c9fd0 msgr2=0x7f02381553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.712+0000 7f023e6d0700 1 --2- 172.21.15.123:0/3971460415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02380c9fd0 0x7f02381553c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0224004760 tx=0x7f0234001a00 comp rx=0 tx=0).stop 2024-09-13T17:08:31.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.712+0000 7f023e6d0700 1 -- 172.21.15.123:0/3971460415 shutdown_connections 2024-09-13T17:08:31.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.712+0000 7f023e6d0700 1 --2- 172.21.15.123:0/3971460415 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f021c066760 0x7f021c068c20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.712+0000 7f023e6d0700 1 --2- 172.21.15.123:0/3971460415 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023815b480 0x7f023815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.712+0000 7f023e6d0700 1 --2- 172.21.15.123:0/3971460415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02380c9fd0 0x7f02381553c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.716+0000 7f023e6d0700 1 --2- 172.21.15.123:0/3971460415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0224004870 0x7f02380b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.716+0000 7f023e6d0700 1 -- 172.21.15.123:0/3971460415 >> 172.21.15.123:0/3971460415 conn(0x7f02380d2ae0 msgr2=0x7f02380b6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:31.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.716+0000 7f023e6d0700 1 -- 172.21.15.123:0/3971460415 shutdown_connections 2024-09-13T17:08:31.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.716+0000 7f023e6d0700 1 -- 172.21.15.123:0/3971460415 wait complete. 2024-09-13T17:08:31.730 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:08:31.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.840+0000 7f9449003700 1 Processor -- start 2024-09-13T17:08:31.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.840+0000 7f9449003700 1 -- start start 2024-09-13T17:08:31.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.840+0000 7f9449003700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f94440b23f0 0x7f94440b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.840+0000 7f9449003700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9444164730 0x7f9444166b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.840+0000 7f9449003700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94440ccfd0 con 0x7f944415cc30 2024-09-13T17:08:31.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.840+0000 7f9449003700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94440b2d70 con 0x7f94440b23f0 2024-09-13T17:08:31.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.840+0000 7f9449003700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944415d010 con 0x7f9444164730 2024-09-13T17:08:31.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.844+0000 7f943bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f94440b23f0 0x7f94440b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.844+0000 7f9443fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f944415cc30 0x7f9444071a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39320/0 (socket says 172.21.15.123:39320) 2024-09-13T17:08:31.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.844+0000 7f9443fff700 1 -- 172.21.15.123:0/322390928 learned_addr learned my addr 172.21.15.123:0/322390928 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:31.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.844+0000 7f9448802700 1 --2- 172.21.15.123:0/322390928 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9444164730 0x7f9444166b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.844+0000 7f943bfff700 1 -- 172.21.15.123:0/322390928 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9444164730 msgr2=0x7f9444166b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:31.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.844+0000 7f943bfff700 1 --2- 172.21.15.123:0/322390928 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9444164730 0x7f9444166b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.844+0000 7f943bfff700 1 -- 172.21.15.123:0/322390928 >> v1:172.21.15.123:6789/0 conn(0x7f944415cc30 legacy=0x7f9444071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.844+0000 7f943bfff700 1 -- 172.21.15.123:0/322390928 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9444070510 con 0x7f94440b23f0 2024-09-13T17:08:31.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.844+0000 7f943bfff700 1 --2- 172.21.15.123:0/322390928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94440b23f0 0x7f94440b2830 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f942c009850 tx=0x7f942c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9430f4e5637a9e64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:31.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.848+0000 7f94437fe700 1 -- 172.21.15.123:0/322390928 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c011830 con 0x7f94440b23f0 2024-09-13T17:08:31.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.848+0000 7f94437fe700 1 -- 172.21.15.123:0/322390928 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c011990 con 0x7f94440b23f0 2024-09-13T17:08:31.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.848+0000 7f94437fe700 1 -- 172.21.15.123:0/322390928 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c011d40 con 0x7f94440b23f0 2024-09-13T17:08:31.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.848+0000 7f9449003700 1 -- 172.21.15.123:0/322390928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94440b23f0 msgr2=0x7f94440b2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.848+0000 7f9449003700 1 --2- 172.21.15.123:0/322390928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94440b23f0 0x7f94440b2830 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f942c009850 tx=0x7f942c009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:31.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.848+0000 7f9449003700 1 -- 172.21.15.123:0/322390928 shutdown_connections 2024-09-13T17:08:31.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.848+0000 7f9449003700 1 --2- 172.21.15.123:0/322390928 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9444164730 0x7f9444166b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.848+0000 7f9449003700 1 --2- 172.21.15.123:0/322390928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94440b23f0 0x7f94440b2830 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.848+0000 7f9449003700 1 -- 172.21.15.123:0/322390928 >> 172.21.15.123:0/322390928 conn(0x7f9444066780 msgr2=0x7f94440cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:31.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.848+0000 7f9449003700 1 -- 172.21.15.123:0/322390928 shutdown_connections 2024-09-13T17:08:31.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.848+0000 7f9449003700 1 -- 172.21.15.123:0/322390928 wait complete. 2024-09-13T17:08:31.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.852+0000 7f9449003700 1 Processor -- start 2024-09-13T17:08:31.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.852+0000 7f9449003700 1 -- start start 2024-09-13T17:08:31.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.852+0000 7f9449003700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94440b23f0 0x7f944415b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.852+0000 7f9449003700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f944415cc30 0x7f94440b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.852+0000 7f9449003700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9444164730 0x7f9444159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.852+0000 7f9449003700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94440aeec0 con 0x7f9444164730 2024-09-13T17:08:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.852+0000 7f9449003700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94440af9b0 con 0x7f94440b23f0 2024-09-13T17:08:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.852+0000 7f9449003700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94440acbc0 con 0x7f944415cc30 2024-09-13T17:08:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.852+0000 7f9448802700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9444164730 0x7f9444159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.852+0000 7f9448802700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9444164730 0x7f9444159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46684/0 (socket says 172.21.15.123:46684) 2024-09-13T17:08:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.852+0000 7f9448802700 1 -- 172.21.15.123:0/606450287 learned_addr learned my addr 172.21.15.123:0/606450287 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.852+0000 7f9443fff700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94440b23f0 0x7f944415b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.852+0000 7f943bfff700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f944415cc30 0x7f94440b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.856+0000 7f9448802700 1 -- 172.21.15.123:0/606450287 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f944415cc30 msgr2=0x7f94440b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.856+0000 7f9448802700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f944415cc30 0x7f94440b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.856+0000 7f9448802700 1 -- 172.21.15.123:0/606450287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94440b23f0 msgr2=0x7f944415b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:31.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.856+0000 7f9448802700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94440b23f0 0x7f944415b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:31.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.856+0000 7f9448802700 1 -- 172.21.15.123:0/606450287 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c0094b0 con 0x7f9444164730 2024-09-13T17:08:31.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.856+0000 7f9443fff700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94440b23f0 0x7f944415b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:31.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.856+0000 7f9448802700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9444164730 0x7f9444159d60 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f943c00ef90 tx=0x7f943c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:31.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.856+0000 7f94417fa700 1 -- 172.21.15.123:0/606450287 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c009b20 con 0x7f9444164730 2024-09-13T17:08:31.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.856+0000 7f94417fa700 1 -- 172.21.15.123:0/606450287 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c00f040 con 0x7f9444164730 2024-09-13T17:08:31.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.856+0000 7f9449003700 1 -- 172.21.15.123:0/606450287 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94440af110 con 0x7f9444164730 2024-09-13T17:08:31.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.856+0000 7f94417fa700 1 -- 172.21.15.123:0/606450287 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c00cc70 con 0x7f9444164730 2024-09-13T17:08:31.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.856+0000 7f9449003700 1 -- 172.21.15.123:0/606450287 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94440af6d0 con 0x7f9444164730 2024-09-13T17:08:31.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.856+0000 7f94417fa700 1 -- 172.21.15.123:0/606450287 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f943c014480 con 0x7f9444164730 2024-09-13T17:08:31.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.856+0000 7f94417fa700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9424066730 0x7f9424068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:31.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.860+0000 7f94417fa700 1 -- 172.21.15.123:0/606450287 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f943c084a60 con 0x7f9444164730 2024-09-13T17:08:31.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.860+0000 7f9449003700 1 -- 172.21.15.123:0/606450287 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9428005310 con 0x7f9444164730 2024-09-13T17:08:31.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.860+0000 7f9443fff700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9424066730 0x7f9424068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:31.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.860+0000 7f9443fff700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9424066730 0x7f9424068bf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9434000f60 tx=0x7f9434009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:31.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:31.864+0000 7f94417fa700 1 -- 172.21.15.123:0/606450287 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f943c018070 con 0x7f9444164730 2024-09-13T17:08:32.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.044+0000 7f9449003700 1 -- 172.21.15.123:0/606450287 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f94280055c0 con 0x7f9444164730 2024-09-13T17:08:32.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.044+0000 7f94417fa700 1 -- 172.21.15.123:0/606450287 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f943c055620 con 0x7f9444164730 2024-09-13T17:08:32.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.048+0000 7f9449003700 1 -- 172.21.15.123:0/606450287 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9424066730 msgr2=0x7f9424068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.048+0000 7f9449003700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9424066730 0x7f9424068bf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9434000f60 tx=0x7f9434009040 comp rx=0 tx=0).stop 2024-09-13T17:08:32.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.048+0000 7f9449003700 1 -- 172.21.15.123:0/606450287 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9444164730 msgr2=0x7f9444159d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.048+0000 7f9449003700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9444164730 0x7f9444159d60 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f943c00ef90 tx=0x7f943c009f60 comp rx=0 tx=0).stop 2024-09-13T17:08:32.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.048+0000 7f9449003700 1 -- 172.21.15.123:0/606450287 shutdown_connections 2024-09-13T17:08:32.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.048+0000 7f9449003700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9424066730 0x7f9424068bf0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.048+0000 7f9449003700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9444164730 0x7f9444159d60 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.048+0000 7f9449003700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f944415cc30 0x7f94440b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.048+0000 7f9449003700 1 --2- 172.21.15.123:0/606450287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94440b23f0 0x7f944415b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.048+0000 7f9449003700 1 -- 172.21.15.123:0/606450287 >> 172.21.15.123:0/606450287 conn(0x7f9444066780 msgr2=0x7f9444157be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:32.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.048+0000 7f9449003700 1 -- 172.21.15.123:0/606450287 shutdown_connections 2024-09-13T17:08:32.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.048+0000 7f9449003700 1 -- 172.21.15.123:0/606450287 wait complete. 2024-09-13T17:08:32.052 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:08:32.063 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2024-09-13T17:08:32.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:32.063 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:08:32.076 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[39187]: fuse finished with error 0 and tester_r 0 2024-09-13T17:08:32.077 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:08:32.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:32.077 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:08:32.198 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:08:32.199 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:32.207 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:32.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.324+0000 7fc13f59e700 1 Processor -- start 2024-09-13T17:08:32.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.324+0000 7fc13f59e700 1 -- start start 2024-09-13T17:08:32.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.324+0000 7fc13f59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc140153390 0x7fc140159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.324+0000 7fc13f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc140153770 0x7fc1400ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.324+0000 7fc13f59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14015a4c0 con 0x7fc1400cdb70 2024-09-13T17:08:32.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.324+0000 7fc13f59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1401595a0 con 0x7fc140153390 2024-09-13T17:08:32.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.324+0000 7fc13f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1400cb540 con 0x7fc140153770 2024-09-13T17:08:32.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.324+0000 7fc13e59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc140153390 0x7fc140159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.324+0000 7fc13dd9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc1400cdb70 0x7fc1400cae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43398/0 (socket says 172.21.15.123:43398) 2024-09-13T17:08:32.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.324+0000 7fc13dd9b700 1 -- 172.21.15.123:0/649579786 learned_addr learned my addr 172.21.15.123:0/649579786 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:32.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.324+0000 7fc13ed9d700 1 --2- 172.21.15.123:0/649579786 >> v2:172.21.15.153:3300/0 conn(0x7fc140153770 0x7fc1400ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.324+0000 7fc13d59a700 1 -- 172.21.15.123:0/649579786 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127529549 0 0) 0x7fc14015a4c0 con 0x7fc1400cdb70 2024-09-13T17:08:32.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13d59a700 1 -- 172.21.15.123:0/649579786 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1280035d0 con 0x7fc1400cdb70 2024-09-13T17:08:32.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13e59c700 1 -- 172.21.15.123:0/649579786 >> v2:172.21.15.153:3300/0 conn(0x7fc140153770 msgr2=0x7fc1400ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:32.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13e59c700 1 --2- 172.21.15.123:0/649579786 >> v2:172.21.15.153:3300/0 conn(0x7fc140153770 0x7fc1400ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13e59c700 1 -- 172.21.15.123:0/649579786 >> v1:172.21.15.123:6789/0 conn(0x7fc1400cdb70 legacy=0x7fc1400cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13e59c700 1 -- 172.21.15.123:0/649579786 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1400cb730 con 0x7fc140153390 2024-09-13T17:08:32.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13e59c700 1 --2- 172.21.15.123:0/649579786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140153390 0x7fc140159f80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc1340098b0 tx=0x7fc134009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18462ccc6d35f32a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:32.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13d59a700 1 -- 172.21.15.123:0/649579786 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc134011830 con 0x7fc140153390 2024-09-13T17:08:32.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13d59a700 1 -- 172.21.15.123:0/649579786 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc134011990 con 0x7fc140153390 2024-09-13T17:08:32.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13d59a700 1 -- 172.21.15.123:0/649579786 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc134011d00 con 0x7fc140153390 2024-09-13T17:08:32.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13f59e700 1 -- 172.21.15.123:0/649579786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140153390 msgr2=0x7fc140159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13f59e700 1 --2- 172.21.15.123:0/649579786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140153390 0x7fc140159f80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc1340098b0 tx=0x7fc134009bc0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13f59e700 1 -- 172.21.15.123:0/649579786 shutdown_connections 2024-09-13T17:08:32.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13f59e700 1 --2- 172.21.15.123:0/649579786 >> v2:172.21.15.153:3300/0 conn(0x7fc140153770 0x7fc1400ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13f59e700 1 --2- 172.21.15.123:0/649579786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140153390 0x7fc140159f80 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13f59e700 1 -- 172.21.15.123:0/649579786 >> 172.21.15.123:0/649579786 conn(0x7fc140066150 msgr2=0x7fc140066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:32.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13f59e700 1 -- 172.21.15.123:0/649579786 shutdown_connections 2024-09-13T17:08:32.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13f59e700 1 -- 172.21.15.123:0/649579786 wait complete. 2024-09-13T17:08:32.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13f59e700 1 Processor -- start 2024-09-13T17:08:32.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.328+0000 7fc13f59e700 1 -- start start 2024-09-13T17:08:32.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13f59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1400cdb70 0x7fc1401409c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc140153390 0x7fc1400af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140153770 0x7fc1400afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13f59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc140148990 con 0x7fc140153770 2024-09-13T17:08:32.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc140140f00 con 0x7fc140153390 2024-09-13T17:08:32.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13f59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400aff90 con 0x7fc1400cdb70 2024-09-13T17:08:32.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140153770 0x7fc1400afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140153770 0x7fc1400afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37104/0 (socket says 172.21.15.123:37104) 2024-09-13T17:08:32.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13ed9d700 1 -- 172.21.15.123:0/4109073007 learned_addr learned my addr 172.21.15.123:0/4109073007 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:32.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13dd9b700 1 --2- 172.21.15.123:0/4109073007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc140153390 0x7fc1400af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13e59c700 1 --2- 172.21.15.123:0/4109073007 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1400cdb70 0x7fc1401409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13ed9d700 1 -- 172.21.15.123:0/4109073007 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1400cdb70 msgr2=0x7fc1401409c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13ed9d700 1 --2- 172.21.15.123:0/4109073007 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1400cdb70 0x7fc1401409c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13ed9d700 1 -- 172.21.15.123:0/4109073007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc140153390 msgr2=0x7fc1400af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13ed9d700 1 --2- 172.21.15.123:0/4109073007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc140153390 0x7fc1400af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13ed9d700 1 -- 172.21.15.123:0/4109073007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1340094b0 con 0x7fc140153770 2024-09-13T17:08:32.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13ed9d700 1 --2- 172.21.15.123:0/4109073007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140153770 0x7fc1400afa50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc13800e7b0 tx=0x7fc13800eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:32.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc12effd700 1 -- 172.21.15.123:0/4109073007 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138009560 con 0x7fc140153770 2024-09-13T17:08:32.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc12effd700 1 -- 172.21.15.123:0/4109073007 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc138013680 con 0x7fc140153770 2024-09-13T17:08:32.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13f59e700 1 -- 172.21.15.123:0/4109073007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc140147dc0 con 0x7fc140153770 2024-09-13T17:08:32.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc12effd700 1 -- 172.21.15.123:0/4109073007 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138013a10 con 0x7fc140153770 2024-09-13T17:08:32.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13f59e700 1 -- 172.21.15.123:0/4109073007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc140148340 con 0x7fc140153770 2024-09-13T17:08:32.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.332+0000 7fc13f59e700 1 -- 172.21.15.123:0/4109073007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1400677f0 con 0x7fc140153770 2024-09-13T17:08:32.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.336+0000 7fc12effd700 1 -- 172.21.15.123:0/4109073007 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc138013c10 con 0x7fc140153770 2024-09-13T17:08:32.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.336+0000 7fc12effd700 1 --2- 172.21.15.123:0/4109073007 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc120066730 0x7fc120068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.336+0000 7fc12effd700 1 -- 172.21.15.123:0/4109073007 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc138084480 con 0x7fc140153770 2024-09-13T17:08:32.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.336+0000 7fc13e59c700 1 --2- 172.21.15.123:0/4109073007 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc120066730 0x7fc120068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.336+0000 7fc13e59c700 1 --2- 172.21.15.123:0/4109073007 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc120066730 0x7fc120068bf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc1340090b0 tx=0x7fc134008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:32.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.344+0000 7fc12effd700 1 -- 172.21.15.123:0/4109073007 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc138051720 con 0x7fc140153770 2024-09-13T17:08:32.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.520+0000 7fc13f59e700 1 -- 172.21.15.123:0/4109073007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc140148b40 con 0x7fc140153770 2024-09-13T17:08:32.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.524+0000 7fc12effd700 1 -- 172.21.15.123:0/4109073007 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16652 (secure 0 0 0) 0x7fc140148b40 con 0x7fc140153770 2024-09-13T17:08:32.528 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:32.528 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":47,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:31.843339+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:18.071457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:18.723653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.1b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:32.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.528+0000 7fc13f59e700 1 -- 172.21.15.123:0/4109073007 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc120066730 msgr2=0x7fc120068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.528+0000 7fc13f59e700 1 --2- 172.21.15.123:0/4109073007 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc120066730 0x7fc120068bf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc1340090b0 tx=0x7fc134008030 comp rx=0 tx=0).stop 2024-09-13T17:08:32.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.528+0000 7fc13f59e700 1 -- 172.21.15.123:0/4109073007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140153770 msgr2=0x7fc1400afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.528+0000 7fc13f59e700 1 --2- 172.21.15.123:0/4109073007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140153770 0x7fc1400afa50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc13800e7b0 tx=0x7fc13800eac0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.528+0000 7fc13f59e700 1 -- 172.21.15.123:0/4109073007 shutdown_connections 2024-09-13T17:08:32.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.528+0000 7fc13f59e700 1 --2- 172.21.15.123:0/4109073007 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc120066730 0x7fc120068bf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.528+0000 7fc13f59e700 1 --2- 172.21.15.123:0/4109073007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140153770 0x7fc1400afa50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.528+0000 7fc13f59e700 1 --2- 172.21.15.123:0/4109073007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc140153390 0x7fc1400af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.528+0000 7fc13f59e700 1 --2- 172.21.15.123:0/4109073007 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc1400cdb70 0x7fc1401409c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.528+0000 7fc13f59e700 1 -- 172.21.15.123:0/4109073007 >> 172.21.15.123:0/4109073007 conn(0x7fc140066150 msgr2=0x7fc140074030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:32.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.528+0000 7fc13f59e700 1 -- 172.21.15.123:0/4109073007 shutdown_connections 2024-09-13T17:08:32.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.528+0000 7fc13f59e700 1 -- 172.21.15.123:0/4109073007 wait complete. 2024-09-13T17:08:32.543 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:08:18.071457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:08:18.723653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:08:32.543 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:08:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.660+0000 7f118354c700 1 Processor -- start 2024-09-13T17:08:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.660+0000 7f118354c700 1 -- start start 2024-09-13T17:08:32.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f118354c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f117c0d17b0 0x7f117c0cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f118354c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117c0d06b0 con 0x7f117c0b7270 2024-09-13T17:08:32.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f118354c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117c0d0ec0 con 0x7f117c15cc60 2024-09-13T17:08:32.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f118354c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117c0cfec0 con 0x7f117c0d17b0 2024-09-13T17:08:32.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f1181d49700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f117c0d17b0 0x7f117c0cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f1181d49700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f117c0d17b0 0x7f117c0cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37106/0 (socket says 172.21.15.123:37106) 2024-09-13T17:08:32.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f1182d4b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f117c0b7270 0x7f117c0cdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43400/0 (socket says 172.21.15.123:43400) 2024-09-13T17:08:32.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f1181d49700 1 -- 172.21.15.123:0/569640174 learned_addr learned my addr 172.21.15.123:0/569640174 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:32.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f1181548700 1 -- 172.21.15.123:0/569640174 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054991722 0 0) 0x7f117c0d0ec0 con 0x7f117c15cc60 2024-09-13T17:08:32.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f1181548700 1 -- 172.21.15.123:0/569640174 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11680035d0 con 0x7f117c15cc60 2024-09-13T17:08:32.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f1181d49700 1 -- 172.21.15.123:0/569640174 >> v1:172.21.15.153:6789/0 conn(0x7f117c15cc60 legacy=0x7f117c0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f1181d49700 1 -- 172.21.15.123:0/569640174 >> v1:172.21.15.123:6789/0 conn(0x7f117c0b7270 legacy=0x7f117c0cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f1181548700 1 -- 172.21.15.123:0/569640174 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955534432 0 0) 0x7f117c0d06b0 con 0x7f117c0b7270 2024-09-13T17:08:32.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f1181d49700 1 -- 172.21.15.123:0/569640174 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c0d0900 con 0x7f117c0d17b0 2024-09-13T17:08:32.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f1181d49700 1 --2- 172.21.15.123:0/569640174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f117c0d17b0 0x7f117c0cd6f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1170009910 tx=0x7f1170009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51cf91dcdda59b66 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:32.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f1181548700 1 -- 172.21.15.123:0/569640174 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170011830 con 0x7f117c0d17b0 2024-09-13T17:08:32.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f1181548700 1 -- 172.21.15.123:0/569640174 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1170011990 con 0x7f117c0d17b0 2024-09-13T17:08:32.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f1181548700 1 -- 172.21.15.123:0/569640174 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170011d00 con 0x7f117c0d17b0 2024-09-13T17:08:32.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f118354c700 1 -- 172.21.15.123:0/569640174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f117c0d17b0 msgr2=0x7f117c0cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f118354c700 1 --2- 172.21.15.123:0/569640174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f117c0d17b0 0x7f117c0cd6f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1170009910 tx=0x7f1170009c20 comp rx=0 tx=0).stop 2024-09-13T17:08:32.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f118354c700 1 -- 172.21.15.123:0/569640174 shutdown_connections 2024-09-13T17:08:32.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f118354c700 1 --2- 172.21.15.123:0/569640174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f117c0d17b0 0x7f117c0cd6f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f118354c700 1 -- 172.21.15.123:0/569640174 >> 172.21.15.123:0/569640174 conn(0x7f117c0d2ae0 msgr2=0x7f117c0d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:32.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f118354c700 1 -- 172.21.15.123:0/569640174 shutdown_connections 2024-09-13T17:08:32.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.664+0000 7f118354c700 1 -- 172.21.15.123:0/569640174 wait complete. 2024-09-13T17:08:32.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.668+0000 7f118354c700 1 Processor -- start 2024-09-13T17:08:32.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.668+0000 7f118354c700 1 -- start start 2024-09-13T17:08:32.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.668+0000 7f118354c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f117c0b7270 0x7f117c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.668+0000 7f118354c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f117c0d17b0 0x7f117c150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.668+0000 7f118354c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f117c15cc60 0x7f117c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.668+0000 7f118354c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c151530 con 0x7f117c0d17b0 2024-09-13T17:08:32.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.668+0000 7f118354c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0c79f0 con 0x7f117c15cc60 2024-09-13T17:08:32.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.668+0000 7f118354c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0c7710 con 0x7f117c0b7270 2024-09-13T17:08:32.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.668+0000 7f1181d49700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f117c0d17b0 0x7f117c150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.668+0000 7f1181d49700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f117c0d17b0 0x7f117c150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37122/0 (socket says 172.21.15.123:37122) 2024-09-13T17:08:32.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.668+0000 7f1181d49700 1 -- 172.21.15.123:0/1622279829 learned_addr learned my addr 172.21.15.123:0/1622279829 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:32.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.668+0000 7f1182d4b700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f117c15cc60 0x7f117c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.668+0000 7f118254a700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f117c0b7270 0x7f117c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f1181d49700 1 -- 172.21.15.123:0/1622279829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f117c0b7270 msgr2=0x7f117c159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f1181d49700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f117c0b7270 0x7f117c159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f1181d49700 1 -- 172.21.15.123:0/1622279829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f117c15cc60 msgr2=0x7f117c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f1181d49700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f117c15cc60 0x7f117c0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f1181d49700 1 -- 172.21.15.123:0/1622279829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1170009570 con 0x7f117c0d17b0 2024-09-13T17:08:32.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f118254a700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f117c0b7270 0x7f117c159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:32.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f1181d49700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f117c0d17b0 0x7f117c150ff0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1170009c60 tx=0x7f1170004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:32.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f116effd700 1 -- 172.21.15.123:0/1622279829 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170004550 con 0x7f117c0d17b0 2024-09-13T17:08:32.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f116effd700 1 -- 172.21.15.123:0/1622279829 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117001f070 con 0x7f117c0d17b0 2024-09-13T17:08:32.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f118354c700 1 -- 172.21.15.123:0/1622279829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117c0cb740 con 0x7f117c0d17b0 2024-09-13T17:08:32.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f116effd700 1 -- 172.21.15.123:0/1622279829 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11700038c0 con 0x7f117c0d17b0 2024-09-13T17:08:32.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f118354c700 1 -- 172.21.15.123:0/1622279829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117c0cc480 con 0x7f117c0d17b0 2024-09-13T17:08:32.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f118354c700 1 -- 172.21.15.123:0/1622279829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117c0cbc60 con 0x7f117c0d17b0 2024-09-13T17:08:32.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f116effd700 1 -- 172.21.15.123:0/1622279829 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1170003a20 con 0x7f117c0d17b0 2024-09-13T17:08:32.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.672+0000 7f116effd700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1160066730 0x7f1160068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.676+0000 7f116effd700 1 -- 172.21.15.123:0/1622279829 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1170021070 con 0x7f117c0d17b0 2024-09-13T17:08:32.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.676+0000 7f118254a700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1160066730 0x7f1160068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.676+0000 7f118254a700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1160066730 0x7f1160068bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1178007fd0 tx=0x7f1178009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:32.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.680+0000 7f116effd700 1 -- 172.21.15.123:0/1622279829 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1170053240 con 0x7f117c0d17b0 2024-09-13T17:08:32.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.852+0000 7f118354c700 1 -- 172.21.15.123:0/1622279829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f117c0cbc60 con 0x7f117c0d17b0 2024-09-13T17:08:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.852+0000 7f116effd700 1 -- 172.21.15.123:0/1622279829 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f117c0cbc60 con 0x7f117c0d17b0 2024-09-13T17:08:32.855 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:08:32.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.856+0000 7f118354c700 1 -- 172.21.15.123:0/1622279829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1160066730 msgr2=0x7f1160068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.856+0000 7f118354c700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1160066730 0x7f1160068bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1178007fd0 tx=0x7f1178009040 comp rx=0 tx=0).stop 2024-09-13T17:08:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.856+0000 7f118354c700 1 -- 172.21.15.123:0/1622279829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f117c0d17b0 msgr2=0x7f117c150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.856+0000 7f118354c700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f117c0d17b0 0x7f117c150ff0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1170009c60 tx=0x7f1170004770 comp rx=0 tx=0).stop 2024-09-13T17:08:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.856+0000 7f118354c700 1 -- 172.21.15.123:0/1622279829 shutdown_connections 2024-09-13T17:08:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.856+0000 7f118354c700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1160066730 0x7f1160068bf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.856+0000 7f118354c700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f117c15cc60 0x7f117c0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.856+0000 7f118354c700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f117c0d17b0 0x7f117c150ff0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.856+0000 7f118354c700 1 --2- 172.21.15.123:0/1622279829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f117c0b7270 0x7f117c159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.856+0000 7f118354c700 1 -- 172.21.15.123:0/1622279829 >> 172.21.15.123:0/1622279829 conn(0x7f117c0d2ae0 msgr2=0x7f117c0d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.856+0000 7f118354c700 1 -- 172.21.15.123:0/1622279829 shutdown_connections 2024-09-13T17:08:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.856+0000 7f118354c700 1 -- 172.21.15.123:0/1622279829 wait complete. 2024-09-13T17:08:32.876 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:08:32.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.984+0000 7fcce6223700 1 Processor -- start 2024-09-13T17:08:32.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.984+0000 7fcce6223700 1 -- start start 2024-09-13T17:08:32.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.984+0000 7fcce6223700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcce00aed70 0x7fcce00cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.984+0000 7fcce6223700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcce00af4f0 0x7fcce00cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.984+0000 7fcce6223700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce0161760 con 0x7fcce00cdf70 2024-09-13T17:08:32.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.984+0000 7fcce6223700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce00c93e0 con 0x7fcce00aed70 2024-09-13T17:08:32.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.984+0000 7fcce6223700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce00ce400 con 0x7fcce00af4f0 2024-09-13T17:08:32.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fccdf7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcce00aed70 0x7fcce00cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fccdf7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcce00aed70 0x7fcce00cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37128/0 (socket says 172.21.15.123:37128) 2024-09-13T17:08:32.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fccdf7fe700 1 -- 172.21.15.123:0/1460289783 learned_addr learned my addr 172.21.15.123:0/1460289783 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:32.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fccdeffd700 1 --2- 172.21.15.123:0/1460289783 >> v2:172.21.15.153:3300/0 conn(0x7fcce00af4f0 0x7fcce00cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fccdf7fe700 1 -- 172.21.15.123:0/1460289783 >> v2:172.21.15.153:3300/0 conn(0x7fcce00af4f0 msgr2=0x7fcce00cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:32.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fccdf7fe700 1 --2- 172.21.15.123:0/1460289783 >> v2:172.21.15.153:3300/0 conn(0x7fcce00af4f0 0x7fcce00cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fccdf7fe700 1 -- 172.21.15.123:0/1460289783 >> v1:172.21.15.153:6789/0 conn(0x7fcce00cdf70 legacy=0x7fcce00cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fccdf7fe700 1 -- 172.21.15.123:0/1460289783 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce00cb890 con 0x7fcce00aed70 2024-09-13T17:08:32.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fccdf7fe700 1 --2- 172.21.15.123:0/1460289783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce00aed70 0x7fcce00cb2b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fcce00c22d0 tx=0x7fccd4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2298dd2c399c287 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:32.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fccde7fc700 1 -- 172.21.15.123:0/1460289783 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4011830 con 0x7fcce00aed70 2024-09-13T17:08:32.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fccde7fc700 1 -- 172.21.15.123:0/1460289783 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd4011990 con 0x7fcce00aed70 2024-09-13T17:08:32.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fccde7fc700 1 -- 172.21.15.123:0/1460289783 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4011d20 con 0x7fcce00aed70 2024-09-13T17:08:32.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fcce6223700 1 -- 172.21.15.123:0/1460289783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce00aed70 msgr2=0x7fcce00cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fcce6223700 1 --2- 172.21.15.123:0/1460289783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce00aed70 0x7fcce00cb2b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fcce00c22d0 tx=0x7fccd4009bf0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fcce6223700 1 -- 172.21.15.123:0/1460289783 shutdown_connections 2024-09-13T17:08:32.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fcce6223700 1 --2- 172.21.15.123:0/1460289783 >> v2:172.21.15.153:3300/0 conn(0x7fcce00af4f0 0x7fcce00cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fcce6223700 1 --2- 172.21.15.123:0/1460289783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce00aed70 0x7fcce00cb2b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fcce6223700 1 -- 172.21.15.123:0/1460289783 >> 172.21.15.123:0/1460289783 conn(0x7fcce00b0450 msgr2=0x7fcce00b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:32.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fcce6223700 1 -- 172.21.15.123:0/1460289783 shutdown_connections 2024-09-13T17:08:32.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fcce6223700 1 -- 172.21.15.123:0/1460289783 wait complete. 2024-09-13T17:08:32.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fcce6223700 1 Processor -- start 2024-09-13T17:08:32.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.988+0000 7fcce6223700 1 -- start start 2024-09-13T17:08:32.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fcce6223700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcce00aed70 0x7fcce00b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fcce6223700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcce00af4f0 0x7fcce0155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fcce6223700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce00cdf70 0x7fcce00b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fcce6223700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0162b60 con 0x7fcce00cdf70 2024-09-13T17:08:32.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fcce6223700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce015f800 con 0x7fcce00aed70 2024-09-13T17:08:32.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fcce6223700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00c8450 con 0x7fcce00af4f0 2024-09-13T17:08:32.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccdffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce00cdf70 0x7fcce00b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccdffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce00cdf70 0x7fcce00b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37136/0 (socket says 172.21.15.123:37136) 2024-09-13T17:08:32.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccdffff700 1 -- 172.21.15.123:0/914349004 learned_addr learned my addr 172.21.15.123:0/914349004 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:32.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccdf7fe700 1 --2- 172.21.15.123:0/914349004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcce00aed70 0x7fcce00b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccdeffd700 1 --2- 172.21.15.123:0/914349004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcce00af4f0 0x7fcce0155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccdffff700 1 -- 172.21.15.123:0/914349004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcce00af4f0 msgr2=0x7fcce0155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccdffff700 1 --2- 172.21.15.123:0/914349004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcce00af4f0 0x7fcce0155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccdffff700 1 -- 172.21.15.123:0/914349004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcce00aed70 msgr2=0x7fcce00b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccdffff700 1 --2- 172.21.15.123:0/914349004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcce00aed70 0x7fcce00b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccdffff700 1 -- 172.21.15.123:0/914349004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4009570 con 0x7fcce00cdf70 2024-09-13T17:08:32.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccdffff700 1 --2- 172.21.15.123:0/914349004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce00cdf70 0x7fcce00b39e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fccd800cb50 tx=0x7fccd800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:32.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccc7fff700 1 -- 172.21.15.123:0/914349004 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8003c20 con 0x7fcce00cdf70 2024-09-13T17:08:32.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccc7fff700 1 -- 172.21.15.123:0/914349004 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd8003d80 con 0x7fcce00cdf70 2024-09-13T17:08:32.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fcce6223700 1 -- 172.21.15.123:0/914349004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce01624a0 con 0x7fcce00cdf70 2024-09-13T17:08:32.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccc7fff700 1 -- 172.21.15.123:0/914349004 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd800aa20 con 0x7fcce00cdf70 2024-09-13T17:08:32.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fcce6223700 1 -- 172.21.15.123:0/914349004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce0156180 con 0x7fcce00cdf70 2024-09-13T17:08:32.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fcce6223700 1 -- 172.21.15.123:0/914349004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce0162300 con 0x7fcce00cdf70 2024-09-13T17:08:32.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.992+0000 7fccc7fff700 1 -- 172.21.15.123:0/914349004 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fccd800ab80 con 0x7fcce00cdf70 2024-09-13T17:08:32.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.996+0000 7fccc7fff700 1 --2- 172.21.15.123:0/914349004 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcccc066730 0x7fcccc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:32.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.996+0000 7fccc7fff700 1 -- 172.21.15.123:0/914349004 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fccd80840e0 con 0x7fcce00cdf70 2024-09-13T17:08:32.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.996+0000 7fccdf7fe700 1 --2- 172.21.15.123:0/914349004 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcccc066730 0x7fcccc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:32.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:32.996+0000 7fccdf7fe700 1 --2- 172.21.15.123:0/914349004 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcccc066730 0x7fcccc068bf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fccd4000c00 tx=0x7fccd4008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:33.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.000+0000 7fccc7fff700 1 -- 172.21.15.123:0/914349004 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcce0162300 con 0x7fcce00cdf70 2024-09-13T17:08:33.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.168+0000 7fcce6223700 1 -- 172.21.15.123:0/914349004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcce0162ca0 con 0x7fcce00cdf70 2024-09-13T17:08:33.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.168+0000 7fccc7fff700 1 -- 172.21.15.123:0/914349004 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcce0162ca0 con 0x7fcce00cdf70 2024-09-13T17:08:33.172 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:08:33.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.172+0000 7fcce6223700 1 -- 172.21.15.123:0/914349004 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcccc066730 msgr2=0x7fcccc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.172+0000 7fcce6223700 1 --2- 172.21.15.123:0/914349004 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcccc066730 0x7fcccc068bf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fccd4000c00 tx=0x7fccd4008030 comp rx=0 tx=0).stop 2024-09-13T17:08:33.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.172+0000 7fcce6223700 1 -- 172.21.15.123:0/914349004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce00cdf70 msgr2=0x7fcce00b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.172+0000 7fcce6223700 1 --2- 172.21.15.123:0/914349004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce00cdf70 0x7fcce00b39e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fccd800cb50 tx=0x7fccd800ce60 comp rx=0 tx=0).stop 2024-09-13T17:08:33.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.172+0000 7fcce6223700 1 -- 172.21.15.123:0/914349004 shutdown_connections 2024-09-13T17:08:33.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.172+0000 7fcce6223700 1 --2- 172.21.15.123:0/914349004 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcccc066730 0x7fcccc068bf0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.172+0000 7fcce6223700 1 --2- 172.21.15.123:0/914349004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce00cdf70 0x7fcce00b39e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.172+0000 7fcce6223700 1 --2- 172.21.15.123:0/914349004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcce00af4f0 0x7fcce0155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.172+0000 7fcce6223700 1 --2- 172.21.15.123:0/914349004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcce00aed70 0x7fcce00b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.172+0000 7fcce6223700 1 -- 172.21.15.123:0/914349004 >> 172.21.15.123:0/914349004 conn(0x7fcce00b0450 msgr2=0x7fcce00ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:33.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.172+0000 7fcce6223700 1 -- 172.21.15.123:0/914349004 shutdown_connections 2024-09-13T17:08:33.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.172+0000 7fcce6223700 1 -- 172.21.15.123:0/914349004 wait complete. 2024-09-13T17:08:33.186 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:08:33.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.296+0000 7f97b3fff700 1 Processor -- start 2024-09-13T17:08:33.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.296+0000 7f97b3fff700 1 -- start start 2024-09-13T17:08:33.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.296+0000 7f97b3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f97b40b58b0 0x7f97b40d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:33.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.296+0000 7f97b3fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b40b0060 con 0x7f97b40cd5e0 2024-09-13T17:08:33.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.296+0000 7f97b3fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b40b0340 con 0x7f97b40d0f40 2024-09-13T17:08:33.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.296+0000 7f97b3fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b40b0620 con 0x7f97b40b58b0 2024-09-13T17:08:33.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b37fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f97b40cd5e0 0x7f97b40cd9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43414/0 (socket says 172.21.15.123:43414) 2024-09-13T17:08:33.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b37fe700 1 -- 172.21.15.123:0/2179141497 learned_addr learned my addr 172.21.15.123:0/2179141497 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:33.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b27fc700 1 --2- 172.21.15.123:0/2179141497 >> v2:172.21.15.153:3300/0 conn(0x7f97b40b58b0 0x7f97b40d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:33.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608224066 0 0) 0x7f97b40b0060 con 0x7f97b40cd5e0 2024-09-13T17:08:33.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f979c0035d0 con 0x7f97b40cd5e0 2024-09-13T17:08:33.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511265868 0 0) 0x7f97b40b0340 con 0x7f97b40d0f40 2024-09-13T17:08:33.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b40b0060 con 0x7f97b40d0f40 2024-09-13T17:08:33.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 676236658 0 0) 0x7f979c0035d0 con 0x7f97b40cd5e0 2024-09-13T17:08:33.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 >> v2:172.21.15.153:3300/0 conn(0x7f97b40b58b0 msgr2=0x7f97b40d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:33.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 --2- 172.21.15.123:0/2179141497 >> v2:172.21.15.153:3300/0 conn(0x7f97b40b58b0 0x7f97b40d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 >> v1:172.21.15.153:6789/0 conn(0x7f97b40d0f40 legacy=0x7f97b40d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b40b0900 con 0x7f97b40cd5e0 2024-09-13T17:08:33.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f97ac001690 con 0x7f97b40cd5e0 2024-09-13T17:08:33.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 >> v1:172.21.15.123:6789/0 conn(0x7f97b40cd5e0 legacy=0x7f97b40cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 --2- 172.21.15.123:0/2179141497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f979c003bb0 0x7f979c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:33.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 --2- 172.21.15.123:0/2179141497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f979c004870 0x7f979c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:33.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 --2- 172.21.15.123:0/2179141497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f979c005230 0x7f979c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:33.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40b0620 con 0x7f979c005230 2024-09-13T17:08:33.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c00c160 con 0x7f979c004870 2024-09-13T17:08:33.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979c00c320 con 0x7f979c003bb0 2024-09-13T17:08:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b37fe700 1 --2- 172.21.15.123:0/2179141497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f979c005230 0x7f979c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b2ffd700 1 --2- 172.21.15.123:0/2179141497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f979c003bb0 0x7f979c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b27fc700 1 --2- 172.21.15.123:0/2179141497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f979c004870 0x7f979c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b37fe700 1 -- 172.21.15.123:0/2179141497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f979c003bb0 msgr2=0x7f979c003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b37fe700 1 --2- 172.21.15.123:0/2179141497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f979c003bb0 0x7f979c003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b37fe700 1 -- 172.21.15.123:0/2179141497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f979c004870 msgr2=0x7f979c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b37fe700 1 --2- 172.21.15.123:0/2179141497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f979c004870 0x7f979c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b37fe700 1 -- 172.21.15.123:0/2179141497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c0035d0 con 0x7f979c005230 2024-09-13T17:08:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b2ffd700 1 --2- 172.21.15.123:0/2179141497 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f979c003bb0 0x7f979c003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b37fe700 1 -- 172.21.15.123:0/2179141497 reap_dead start 2024-09-13T17:08:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b37fe700 1 --2- 172.21.15.123:0/2179141497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f979c005230 0x7f979c00ba30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f97b40b2170 tx=0x7f979c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52966a98d84371b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac00ce00 con 0x7f979c005230 2024-09-13T17:08:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac005980 con 0x7f979c005230 2024-09-13T17:08:33.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b1ffb700 1 -- 172.21.15.123:0/2179141497 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac005d30 con 0x7f979c005230 2024-09-13T17:08:33.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b3fff700 1 -- 172.21.15.123:0/2179141497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f979c005230 msgr2=0x7f979c00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b3fff700 1 --2- 172.21.15.123:0/2179141497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f979c005230 0x7f979c00ba30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f97b40b2170 tx=0x7f979c0058a0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b3fff700 1 -- 172.21.15.123:0/2179141497 shutdown_connections 2024-09-13T17:08:33.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b3fff700 1 --2- 172.21.15.123:0/2179141497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f979c005230 0x7f979c00ba30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b3fff700 1 -- 172.21.15.123:0/2179141497 >> 172.21.15.123:0/2179141497 conn(0x7f97b40d2a60 msgr2=0x7f97b40d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:33.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b3fff700 1 -- 172.21.15.123:0/2179141497 shutdown_connections 2024-09-13T17:08:33.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.300+0000 7f97b3fff700 1 -- 172.21.15.123:0/2179141497 wait complete. 2024-09-13T17:08:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.304+0000 7f97b3fff700 1 Processor -- start 2024-09-13T17:08:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.304+0000 7f97b3fff700 1 -- start start 2024-09-13T17:08:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.304+0000 7f97b3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f979c005230 0x7f97b4156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:33.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.304+0000 7f97b3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97b4157b10 0x7f97b40c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:33.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.304+0000 7f97b3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97b40c6a00 0x7f97b40b6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:33.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.304+0000 7f97b3fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40c7820 con 0x7f979c005230 2024-09-13T17:08:33.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.304+0000 7f97b3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b4157f90 con 0x7f97b4157b10 2024-09-13T17:08:33.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.304+0000 7f97b3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40c6f80 con 0x7f97b40c6a00 2024-09-13T17:08:33.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.304+0000 7f97b2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f979c005230 0x7f97b4156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:33.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.304+0000 7f97b2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f979c005230 0x7f97b4156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37150/0 (socket says 172.21.15.123:37150) 2024-09-13T17:08:33.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.304+0000 7f97b2ffd700 1 -- 172.21.15.123:0/1321072254 learned_addr learned my addr 172.21.15.123:0/1321072254 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:33.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.304+0000 7f97b27fc700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97b4157b10 0x7f97b40c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:33.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.304+0000 7f97b37fe700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97b40c6a00 0x7f97b40b6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:33.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f97b2ffd700 1 -- 172.21.15.123:0/1321072254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97b40c6a00 msgr2=0x7f97b40b6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f97b2ffd700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97b40c6a00 0x7f97b40b6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f97b2ffd700 1 -- 172.21.15.123:0/1321072254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97b4157b10 msgr2=0x7f97b40c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f97b2ffd700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97b4157b10 0x7f97b40c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f97b2ffd700 1 -- 172.21.15.123:0/1321072254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b40c7260 con 0x7f979c005230 2024-09-13T17:08:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f97b37fe700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97b40c6a00 0x7f97b40b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f97b2ffd700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f979c005230 0x7f97b4156fd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f97a4001f60 tx=0x7f97a400c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f979b7fe700 1 -- 172.21.15.123:0/1321072254 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4003c30 con 0x7f979c005230 2024-09-13T17:08:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f979b7fe700 1 -- 172.21.15.123:0/1321072254 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a4003d90 con 0x7f979c005230 2024-09-13T17:08:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f97b3fff700 1 -- 172.21.15.123:0/1321072254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b40c7540 con 0x7f979c005230 2024-09-13T17:08:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f979b7fe700 1 -- 172.21.15.123:0/1321072254 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a400cc10 con 0x7f979c005230 2024-09-13T17:08:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f97b3fff700 1 -- 172.21.15.123:0/1321072254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b40c7ca0 con 0x7f979c005230 2024-09-13T17:08:33.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f97b3fff700 1 -- 172.21.15.123:0/1321072254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b404e820 con 0x7f979c005230 2024-09-13T17:08:33.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f979b7fe700 1 -- 172.21.15.123:0/1321072254 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f97a40050d0 con 0x7f979c005230 2024-09-13T17:08:33.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f979b7fe700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97a0066760 0x7f97a0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:33.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f97b27fc700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97a0066760 0x7f97a0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:33.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.308+0000 7f979b7fe700 1 -- 172.21.15.123:0/1321072254 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f97a40845e0 con 0x7f979c005230 2024-09-13T17:08:33.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.312+0000 7f97b27fc700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97a0066760 0x7f97a0068c20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f97b4157900 tx=0x7f97a8008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:33.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.316+0000 7f979b7fe700 1 -- 172.21.15.123:0/1321072254 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f97a4051910 con 0x7f979c005230 2024-09-13T17:08:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.484+0000 7f97b3fff700 1 -- 172.21.15.123:0/1321072254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97b40b0340 con 0x7f979c005230 2024-09-13T17:08:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.488+0000 7f979b7fe700 1 -- 172.21.15.123:0/1321072254 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97a4001d40 con 0x7f979c005230 2024-09-13T17:08:33.491 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:08:33.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.488+0000 7f97b3fff700 1 -- 172.21.15.123:0/1321072254 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97a0066760 msgr2=0x7f97a0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.488+0000 7f97b3fff700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97a0066760 0x7f97a0068c20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f97b4157900 tx=0x7f97a8008040 comp rx=0 tx=0).stop 2024-09-13T17:08:33.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.488+0000 7f97b3fff700 1 -- 172.21.15.123:0/1321072254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f979c005230 msgr2=0x7f97b4156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.488+0000 7f97b3fff700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f979c005230 0x7f97b4156fd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f97a4001f60 tx=0x7f97a400c3c0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.488+0000 7f97b3fff700 1 -- 172.21.15.123:0/1321072254 shutdown_connections 2024-09-13T17:08:33.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.488+0000 7f97b3fff700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97a0066760 0x7f97a0068c20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.488+0000 7f97b3fff700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f97b40c6a00 0x7f97b40b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.488+0000 7f97b3fff700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97b4157b10 0x7f97b40c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.488+0000 7f97b3fff700 1 --2- 172.21.15.123:0/1321072254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f979c005230 0x7f97b4156fd0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.488+0000 7f97b3fff700 1 -- 172.21.15.123:0/1321072254 >> 172.21.15.123:0/1321072254 conn(0x7f97b40d2a60 msgr2=0x7f97b40cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:33.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.488+0000 7f97b3fff700 1 -- 172.21.15.123:0/1321072254 shutdown_connections 2024-09-13T17:08:33.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.488+0000 7f97b3fff700 1 -- 172.21.15.123:0/1321072254 wait complete. 2024-09-13T17:08:33.505 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:08:33.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.616+0000 7fa74e034700 1 Processor -- start 2024-09-13T17:08:33.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.616+0000 7fa74e034700 1 -- start start 2024-09-13T17:08:33.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74e034700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa7480c9f80 0x7fa7480c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:33.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74e034700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa7480cdda0 0x7fa74806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:33.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74e034700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74815b180 con 0x7fa74806c610 2024-09-13T17:08:33.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74e034700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7480c95f0 con 0x7fa7480cdda0 2024-09-13T17:08:33.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74e034700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7480cae70 con 0x7fa7480c9f80 2024-09-13T17:08:33.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74d833700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa7480cdda0 0x7fa74806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:33.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74d833700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa7480cdda0 0x7fa74806ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37152/0 (socket says 172.21.15.123:37152) 2024-09-13T17:08:33.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74c831700 1 --1- 172.21.15.123:0/2842926921 >> v1:172.21.15.123:6789/0 conn(0x7fa74806c610 0x7fa7480cd690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43426/0 (socket says 172.21.15.123:43426) 2024-09-13T17:08:33.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74d833700 1 -- 172.21.15.123:0/2842926921 learned_addr learned my addr 172.21.15.123:0/2842926921 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:33.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74d032700 1 --2- 172.21.15.123:0/2842926921 >> v2:172.21.15.153:3300/0 conn(0x7fa7480c9f80 0x7fa7480c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:33.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74d833700 1 -- 172.21.15.123:0/2842926921 >> v2:172.21.15.153:3300/0 conn(0x7fa7480c9f80 msgr2=0x7fa7480c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:33.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74d833700 1 --2- 172.21.15.123:0/2842926921 >> v2:172.21.15.153:3300/0 conn(0x7fa7480c9f80 0x7fa7480c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74d833700 1 -- 172.21.15.123:0/2842926921 >> v1:172.21.15.123:6789/0 conn(0x7fa74806c610 legacy=0x7fa7480cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74d833700 1 -- 172.21.15.123:0/2842926921 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7480cb140 con 0x7fa7480cdda0 2024-09-13T17:08:33.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74d833700 1 --2- 172.21.15.123:0/2842926921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7480cdda0 0x7fa74806ca70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa74806e260 tx=0x7fa74000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faaa6022a4758660 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:33.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa73bfff700 1 -- 172.21.15.123:0/2842926921 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74000e070 con 0x7fa7480cdda0 2024-09-13T17:08:33.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa73bfff700 1 -- 172.21.15.123:0/2842926921 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74000b9c0 con 0x7fa7480cdda0 2024-09-13T17:08:33.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa73bfff700 1 -- 172.21.15.123:0/2842926921 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74000bd70 con 0x7fa7480cdda0 2024-09-13T17:08:33.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74e034700 1 -- 172.21.15.123:0/2842926921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7480cdda0 msgr2=0x7fa74806ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74e034700 1 --2- 172.21.15.123:0/2842926921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7480cdda0 0x7fa74806ca70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa74806e260 tx=0x7fa74000b330 comp rx=0 tx=0).stop 2024-09-13T17:08:33.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74e034700 1 -- 172.21.15.123:0/2842926921 shutdown_connections 2024-09-13T17:08:33.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74e034700 1 --2- 172.21.15.123:0/2842926921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7480cdda0 0x7fa74806ca70 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74e034700 1 --2- 172.21.15.123:0/2842926921 >> v2:172.21.15.153:3300/0 conn(0x7fa7480c9f80 0x7fa7480c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74e034700 1 -- 172.21.15.123:0/2842926921 >> 172.21.15.123:0/2842926921 conn(0x7fa7480b01d0 msgr2=0x7fa7480b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:33.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74e034700 1 -- 172.21.15.123:0/2842926921 shutdown_connections 2024-09-13T17:08:33.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.620+0000 7fa74e034700 1 -- 172.21.15.123:0/2842926921 wait complete. 2024-09-13T17:08:33.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.624+0000 7fa74e034700 1 Processor -- start 2024-09-13T17:08:33.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.624+0000 7fa74e034700 1 -- start start 2024-09-13T17:08:33.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.624+0000 7fa74e034700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa74806c610 0x7fa7481f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:33.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.624+0000 7fa74e034700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7480c9f80 0x7fa748149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:33.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.624+0000 7fa74e034700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7480cdda0 0x7fa74814afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:33.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.624+0000 7fa74e034700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7481f2be0 con 0x7fa74806c610 2024-09-13T17:08:33.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.624+0000 7fa74e034700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa748149c90 con 0x7fa7480c9f80 2024-09-13T17:08:33.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.624+0000 7fa74e034700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa748149f30 con 0x7fa7480cdda0 2024-09-13T17:08:33.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa74d032700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa74806c610 0x7fa7481f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:33.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa74d032700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa74806c610 0x7fa7481f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37166/0 (socket says 172.21.15.123:37166) 2024-09-13T17:08:33.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa74d032700 1 -- 172.21.15.123:0/3833384895 learned_addr learned my addr 172.21.15.123:0/3833384895 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:33.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa74c831700 1 --2- 172.21.15.123:0/3833384895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7480c9f80 0x7fa748149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:33.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa74d833700 1 --2- 172.21.15.123:0/3833384895 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7480cdda0 0x7fa74814afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:33.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa74d032700 1 -- 172.21.15.123:0/3833384895 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7480cdda0 msgr2=0x7fa74814afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa74d032700 1 --2- 172.21.15.123:0/3833384895 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7480cdda0 0x7fa74814afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa74d032700 1 -- 172.21.15.123:0/3833384895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7480c9f80 msgr2=0x7fa748149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa74d032700 1 --2- 172.21.15.123:0/3833384895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7480c9f80 0x7fa748149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa74d032700 1 -- 172.21.15.123:0/3833384895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa740009b30 con 0x7fa74806c610 2024-09-13T17:08:33.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa74d032700 1 --2- 172.21.15.123:0/3833384895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa74806c610 0x7fa7481f26a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa74400e760 tx=0x7fa74400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:33.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa739ffb700 1 -- 172.21.15.123:0/3833384895 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74400c070 con 0x7fa74806c610 2024-09-13T17:08:33.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa74e034700 1 -- 172.21.15.123:0/3833384895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74814a210 con 0x7fa74806c610 2024-09-13T17:08:33.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa739ffb700 1 -- 172.21.15.123:0/3833384895 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa744013610 con 0x7fa74806c610 2024-09-13T17:08:33.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa739ffb700 1 -- 172.21.15.123:0/3833384895 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744013980 con 0x7fa74806c610 2024-09-13T17:08:33.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa74e034700 1 -- 172.21.15.123:0/3833384895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74814a7d0 con 0x7fa74806c610 2024-09-13T17:08:33.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa74e034700 1 -- 172.21.15.123:0/3833384895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7480c90b0 con 0x7fa74806c610 2024-09-13T17:08:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.628+0000 7fa739ffb700 1 -- 172.21.15.123:0/3833384895 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa744013ae0 con 0x7fa74806c610 2024-09-13T17:08:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.632+0000 7fa739ffb700 1 --2- 172.21.15.123:0/3833384895 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa72c066730 0x7fa72c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.632+0000 7fa739ffb700 1 -- 172.21.15.123:0/3833384895 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa744083f90 con 0x7fa74806c610 2024-09-13T17:08:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.632+0000 7fa74c831700 1 --2- 172.21.15.123:0/3833384895 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa72c066730 0x7fa72c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.632+0000 7fa74c831700 1 --2- 172.21.15.123:0/3833384895 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa72c066730 0x7fa72c068bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa74815e5e0 tx=0x7fa73c007ef0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:33.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.640+0000 7fa739ffb700 1 -- 172.21.15.123:0/3833384895 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa7440b5db0 con 0x7fa74806c610 2024-09-13T17:08:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.816+0000 7fa74e034700 1 -- 172.21.15.123:0/3833384895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa74815e670 con 0x7fa74806c610 2024-09-13T17:08:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.816+0000 7fa739ffb700 1 -- 172.21.15.123:0/3833384895 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa744051240 con 0x7fa74806c610 2024-09-13T17:08:33.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.820+0000 7fa74e034700 1 -- 172.21.15.123:0/3833384895 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa72c066730 msgr2=0x7fa72c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.820+0000 7fa74e034700 1 --2- 172.21.15.123:0/3833384895 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa72c066730 0x7fa72c068bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa74815e5e0 tx=0x7fa73c007ef0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.820+0000 7fa74e034700 1 -- 172.21.15.123:0/3833384895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa74806c610 msgr2=0x7fa7481f26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:33.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.820+0000 7fa74e034700 1 --2- 172.21.15.123:0/3833384895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa74806c610 0x7fa7481f26a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa74400e760 tx=0x7fa74400ea70 comp rx=0 tx=0).stop 2024-09-13T17:08:33.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.820+0000 7fa74e034700 1 -- 172.21.15.123:0/3833384895 shutdown_connections 2024-09-13T17:08:33.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.820+0000 7fa74e034700 1 --2- 172.21.15.123:0/3833384895 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa72c066730 0x7fa72c068bf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.824+0000 7fa74e034700 1 --2- 172.21.15.123:0/3833384895 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7480cdda0 0x7fa74814afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.824+0000 7fa74e034700 1 --2- 172.21.15.123:0/3833384895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7480c9f80 0x7fa748149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.824+0000 7fa74e034700 1 --2- 172.21.15.123:0/3833384895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa74806c610 0x7fa7481f26a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:33.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.824+0000 7fa74e034700 1 -- 172.21.15.123:0/3833384895 >> 172.21.15.123:0/3833384895 conn(0x7fa7480b01d0 msgr2=0x7fa7480b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:33.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.824+0000 7fa74e034700 1 -- 172.21.15.123:0/3833384895 shutdown_connections 2024-09-13T17:08:33.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:33.824+0000 7fa74e034700 1 -- 172.21.15.123:0/3833384895 wait complete. 2024-09-13T17:08:33.827 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:08:33.843 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-09-13T17:08:33.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:33.843 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:33.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33034]: fuse finished with error 0 and tester_r 0 2024-09-13T17:08:33.858 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:08:33.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:33.859 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:08:33.954 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:08:33.954 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:33.962 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:08:33.962 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:08:33.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:33.962 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:08:33.969 INFO:teuthology.orchestra.run.smithi123.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T17:08:33.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:33.970 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:08:33.970 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:33.978 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:08:33.978 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:08:33.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:33.978 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:08:34.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:34.031 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T17:08:34.033 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:08:34.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.148+0000 7fb9c741e700 1 Processor -- start 2024-09-13T17:08:34.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.148+0000 7fb9c741e700 1 -- start start 2024-09-13T17:08:34.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.148+0000 7fb9c741e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb9c015ca90 0x7fb9c006e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.148+0000 7fb9c741e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb9c00b3170 0x7fb9c0071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.148+0000 7fb9c741e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9c015ce70 0x7fb9c0071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.148+0000 7fb9c741e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c015dae0 con 0x7fb9c00b3170 2024-09-13T17:08:34.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.148+0000 7fb9c741e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c00ce830 con 0x7fb9c015ca90 2024-09-13T17:08:34.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.148+0000 7fb9c741e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c006ec70 con 0x7fb9c015ce70 2024-09-13T17:08:34.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c5c1b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb9c00b3170 0x7fb9c0071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c641c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb9c015ca90 0x7fb9c006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c5c1b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb9c00b3170 0x7fb9c0071a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37172/0 (socket says 172.21.15.123:37172) 2024-09-13T17:08:34.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c6c1d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9c015ce70 0x7fb9c0071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c5c1b700 1 -- 172.21.15.123:0/3120808885 learned_addr learned my addr 172.21.15.123:0/3120808885 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:34.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c5c1b700 1 -- 172.21.15.123:0/3120808885 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9c015ce70 msgr2=0x7fb9c0071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:34.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c5c1b700 1 --2- 172.21.15.123:0/3120808885 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9c015ce70 0x7fb9c0071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c5c1b700 1 -- 172.21.15.123:0/3120808885 >> v2:172.21.15.153:3300/0 conn(0x7fb9c015ca90 msgr2=0x7fb9c006e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:34.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c5c1b700 1 --2- 172.21.15.123:0/3120808885 >> v2:172.21.15.153:3300/0 conn(0x7fb9c015ca90 0x7fb9c006e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c5c1b700 1 -- 172.21.15.123:0/3120808885 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c015d420 con 0x7fb9c00b3170 2024-09-13T17:08:34.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c641c700 1 --2- 172.21.15.123:0/3120808885 >> v2:172.21.15.153:3300/0 conn(0x7fb9c015ca90 0x7fb9c006e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:34.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c5c1b700 1 --2- 172.21.15.123:0/3120808885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9c00b3170 0x7fb9c0071a70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00d1990 tx=0x7fb9b0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1392dbcfcf1b29c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:34.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c541a700 1 -- 172.21.15.123:0/3120808885 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0011830 con 0x7fb9c00b3170 2024-09-13T17:08:34.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c541a700 1 -- 172.21.15.123:0/3120808885 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b0011990 con 0x7fb9c00b3170 2024-09-13T17:08:34.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c541a700 1 -- 172.21.15.123:0/3120808885 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0011d20 con 0x7fb9c00b3170 2024-09-13T17:08:34.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c741e700 1 -- 172.21.15.123:0/3120808885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9c00b3170 msgr2=0x7fb9c0071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c741e700 1 --2- 172.21.15.123:0/3120808885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9c00b3170 0x7fb9c0071a70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00d1990 tx=0x7fb9b0009bf0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c741e700 1 -- 172.21.15.123:0/3120808885 shutdown_connections 2024-09-13T17:08:34.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c741e700 1 --2- 172.21.15.123:0/3120808885 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9c015ce70 0x7fb9c0071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c741e700 1 --2- 172.21.15.123:0/3120808885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9c00b3170 0x7fb9c0071a70 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c741e700 1 --2- 172.21.15.123:0/3120808885 >> v2:172.21.15.153:3300/0 conn(0x7fb9c015ca90 0x7fb9c006e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c741e700 1 -- 172.21.15.123:0/3120808885 >> 172.21.15.123:0/3120808885 conn(0x7fb9c006a650 msgr2=0x7fb9c006aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:34.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c741e700 1 -- 172.21.15.123:0/3120808885 shutdown_connections 2024-09-13T17:08:34.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.152+0000 7fb9c741e700 1 -- 172.21.15.123:0/3120808885 wait complete. 2024-09-13T17:08:34.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c741e700 1 Processor -- start 2024-09-13T17:08:34.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c741e700 1 -- start start 2024-09-13T17:08:34.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c741e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9c00b3170 0x7fb9c0153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c741e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c015ca90 0x7fb9c00b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c741e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9c015ce70 0x7fb9c00b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c741e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0154520 con 0x7fb9c00b3170 2024-09-13T17:08:34.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c741e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c01562f0 con 0x7fb9c015ca90 2024-09-13T17:08:34.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c741e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c01565d0 con 0x7fb9c015ce70 2024-09-13T17:08:34.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c641c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9c00b3170 0x7fb9c0153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c641c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9c00b3170 0x7fb9c0153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37186/0 (socket says 172.21.15.123:37186) 2024-09-13T17:08:34.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c641c700 1 -- 172.21.15.123:0/3228729173 learned_addr learned my addr 172.21.15.123:0/3228729173 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:34.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c5c1b700 1 --2- 172.21.15.123:0/3228729173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c015ca90 0x7fb9c00b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c6c1d700 1 --2- 172.21.15.123:0/3228729173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9c015ce70 0x7fb9c00b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c641c700 1 -- 172.21.15.123:0/3228729173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9c015ce70 msgr2=0x7fb9c00b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c641c700 1 --2- 172.21.15.123:0/3228729173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9c015ce70 0x7fb9c00b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c641c700 1 -- 172.21.15.123:0/3228729173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c015ca90 msgr2=0x7fb9c00b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c641c700 1 --2- 172.21.15.123:0/3228729173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c015ca90 0x7fb9c00b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c641c700 1 -- 172.21.15.123:0/3228729173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc0094b0 con 0x7fb9c00b3170 2024-09-13T17:08:34.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c641c700 1 --2- 172.21.15.123:0/3228729173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9c00b3170 0x7fb9c0153fe0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00ebe0 tx=0x7fb9bc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:34.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9b6ffd700 1 -- 172.21.15.123:0/3228729173 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc009790 con 0x7fb9c00b3170 2024-09-13T17:08:34.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9b6ffd700 1 -- 172.21.15.123:0/3228729173 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc00c850 con 0x7fb9c00b3170 2024-09-13T17:08:34.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c741e700 1 -- 172.21.15.123:0/3228729173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b0009570 con 0x7fb9c00b3170 2024-09-13T17:08:34.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9b6ffd700 1 -- 172.21.15.123:0/3228729173 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc00cbe0 con 0x7fb9c00b3170 2024-09-13T17:08:34.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.156+0000 7fb9c741e700 1 -- 172.21.15.123:0/3228729173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c0156b90 con 0x7fb9c00b3170 2024-09-13T17:08:34.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.160+0000 7fb9c741e700 1 -- 172.21.15.123:0/3228729173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c00677f0 con 0x7fb9c00b3170 2024-09-13T17:08:34.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.160+0000 7fb9b6ffd700 1 -- 172.21.15.123:0/3228729173 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb9bc00cd40 con 0x7fb9c00b3170 2024-09-13T17:08:34.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.160+0000 7fb9b6ffd700 1 --2- 172.21.15.123:0/3228729173 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb9a4066730 0x7fb9a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.160+0000 7fb9b6ffd700 1 -- 172.21.15.123:0/3228729173 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb9bc084270 con 0x7fb9c00b3170 2024-09-13T17:08:34.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.160+0000 7fb9c5c1b700 1 --2- 172.21.15.123:0/3228729173 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb9a4066730 0x7fb9a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.160+0000 7fb9c5c1b700 1 --2- 172.21.15.123:0/3228729173 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb9a4066730 0x7fb9a4068bf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00b3570 tx=0x7fb9b0008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:34.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.168+0000 7fb9b6ffd700 1 -- 172.21.15.123:0/3228729173 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb9bc051500 con 0x7fb9c00b3170 2024-09-13T17:08:34.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.376+0000 7fb9c741e700 1 -- 172.21.15.123:0/3228729173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9c006e440 con 0x7fb9c00b3170 2024-09-13T17:08:34.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.376+0000 7fb9b6ffd700 1 -- 172.21.15.123:0/3228729173 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fb9bc054b20 con 0x7fb9c00b3170 2024-09-13T17:08:34.379 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:34.379 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5602,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3264962321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3264962321},{"type":"v1","addr":"172.21.15.153:6833","nonce":3264962321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5605,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1200497874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1200497874},{"type":"v1","addr":"172.21.15.153:6835","nonce":1200497874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/398437513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":398437513},{"type":"v1","addr":"172.21.15.123:6835","nonce":398437513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:08:19.726019+0000","modified":"2024-09-13T17:08:22.746133+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5730},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5730":{"gid":5730,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2449786141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2449786141},{"type":"v1","addr":"172.21.15.123:6837","nonce":2449786141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:08:34.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.376+0000 7fb9c741e700 1 -- 172.21.15.123:0/3228729173 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb9a4066730 msgr2=0x7fb9a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.376+0000 7fb9c741e700 1 --2- 172.21.15.123:0/3228729173 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb9a4066730 0x7fb9a4068bf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00b3570 tx=0x7fb9b0008030 comp rx=0 tx=0).stop 2024-09-13T17:08:34.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.376+0000 7fb9c741e700 1 -- 172.21.15.123:0/3228729173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9c00b3170 msgr2=0x7fb9c0153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.376+0000 7fb9c741e700 1 --2- 172.21.15.123:0/3228729173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9c00b3170 0x7fb9c0153fe0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00ebe0 tx=0x7fb9bc00eef0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.376+0000 7fb9c741e700 1 -- 172.21.15.123:0/3228729173 shutdown_connections 2024-09-13T17:08:34.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.376+0000 7fb9c741e700 1 --2- 172.21.15.123:0/3228729173 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb9a4066730 0x7fb9a4068bf0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.376+0000 7fb9c741e700 1 --2- 172.21.15.123:0/3228729173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9c015ce70 0x7fb9c00b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.376+0000 7fb9c741e700 1 --2- 172.21.15.123:0/3228729173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c015ca90 0x7fb9c00b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.376+0000 7fb9c741e700 1 --2- 172.21.15.123:0/3228729173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9c00b3170 0x7fb9c0153fe0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.376+0000 7fb9c741e700 1 -- 172.21.15.123:0/3228729173 >> 172.21.15.123:0/3228729173 conn(0x7fb9c006a650 msgr2=0x7fb9c00b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:34.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.376+0000 7fb9c741e700 1 -- 172.21.15.123:0/3228729173 shutdown_connections 2024-09-13T17:08:34.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.376+0000 7fb9c741e700 1 -- 172.21.15.123:0/3228729173 wait complete. 2024-09-13T17:08:34.383 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 21 2024-09-13T17:08:34.394 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:34.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.500+0000 7ff3c759e700 1 Processor -- start 2024-09-13T17:08:34.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.500+0000 7ff3c759e700 1 -- start start 2024-09-13T17:08:34.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.500+0000 7ff3c759e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff3c80705b0 0x7ff3c815b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.500+0000 7ff3c759e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c80cee80 con 0x7ff3c8071580 2024-09-13T17:08:34.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.500+0000 7ff3c759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c815bef0 con 0x7ff3c815a8c0 2024-09-13T17:08:34.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.500+0000 7ff3c759e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c8070a40 con 0x7ff3c80705b0 2024-09-13T17:08:34.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.500+0000 7ff3c6d9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff3c80705b0 0x7ff3c815b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.500+0000 7ff3c5d9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff3c8071580 0x7ff3c80cc620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43432/0 (socket says 172.21.15.123:43432) 2024-09-13T17:08:34.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.500+0000 7ff3c5d9b700 1 -- 172.21.15.123:0/3381809662 learned_addr learned my addr 172.21.15.123:0/3381809662 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.500+0000 7ff3c6d9d700 1 -- 172.21.15.123:0/3381809662 >> v1:172.21.15.153:6789/0 conn(0x7ff3c815a8c0 legacy=0x7ff3c8070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.500+0000 7ff3c6d9d700 1 -- 172.21.15.123:0/3381809662 >> v1:172.21.15.123:6789/0 conn(0x7ff3c8071580 legacy=0x7ff3c80cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.500+0000 7ff3c6d9d700 1 -- 172.21.15.123:0/3381809662 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c80ce270 con 0x7ff3c80705b0 2024-09-13T17:08:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.500+0000 7ff3c559a700 1 -- 172.21.15.123:0/3381809662 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563116884 0 0) 0x7ff3c80cee80 con 0x7ff3c8071580 2024-09-13T17:08:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.500+0000 7ff3c6d9d700 1 --2- 172.21.15.123:0/3381809662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c80705b0 0x7ff3c815b9b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009850 tx=0x7ff3c0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74dba2722b9f0b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.504+0000 7ff3c559a700 1 -- 172.21.15.123:0/3381809662 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0011830 con 0x7ff3c80705b0 2024-09-13T17:08:34.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.504+0000 7ff3c559a700 1 -- 172.21.15.123:0/3381809662 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c0011990 con 0x7ff3c80705b0 2024-09-13T17:08:34.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.504+0000 7ff3c559a700 1 -- 172.21.15.123:0/3381809662 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0011d20 con 0x7ff3c80705b0 2024-09-13T17:08:34.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.504+0000 7ff3c759e700 1 -- 172.21.15.123:0/3381809662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c80705b0 msgr2=0x7ff3c815b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.504+0000 7ff3c759e700 1 --2- 172.21.15.123:0/3381809662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c80705b0 0x7ff3c815b9b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009850 tx=0x7ff3c0009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.504+0000 7ff3c759e700 1 -- 172.21.15.123:0/3381809662 shutdown_connections 2024-09-13T17:08:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.504+0000 7ff3c759e700 1 --2- 172.21.15.123:0/3381809662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c80705b0 0x7ff3c815b9b0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.504+0000 7ff3c759e700 1 -- 172.21.15.123:0/3381809662 >> 172.21.15.123:0/3381809662 conn(0x7ff3c8066150 msgr2=0x7ff3c8066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.504+0000 7ff3c759e700 1 -- 172.21.15.123:0/3381809662 shutdown_connections 2024-09-13T17:08:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.504+0000 7ff3c759e700 1 -- 172.21.15.123:0/3381809662 wait complete. 2024-09-13T17:08:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.504+0000 7ff3c759e700 1 Processor -- start 2024-09-13T17:08:34.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.504+0000 7ff3c759e700 1 -- start start 2024-09-13T17:08:34.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c80705b0 0x7ff3c81540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c8071580 0x7ff3c81538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c815a8c0 0x7ff3c8159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c8155c30 con 0x7ff3c815a8c0 2024-09-13T17:08:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c81f2a10 con 0x7ff3c8071580 2024-09-13T17:08:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c81f2cf0 con 0x7ff3c80705b0 2024-09-13T17:08:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c815a8c0 0x7ff3c8159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c815a8c0 0x7ff3c8159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37202/0 (socket says 172.21.15.123:37202) 2024-09-13T17:08:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c659c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c80705b0 0x7ff3c81540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c6d9d700 1 -- 172.21.15.123:0/457293417 learned_addr learned my addr 172.21.15.123:0/457293417 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c5d9b700 1 --2- 172.21.15.123:0/457293417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c8071580 0x7ff3c81538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c6d9d700 1 -- 172.21.15.123:0/457293417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c80705b0 msgr2=0x7ff3c81540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c6d9d700 1 --2- 172.21.15.123:0/457293417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c80705b0 0x7ff3c81540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c6d9d700 1 -- 172.21.15.123:0/457293417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c8071580 msgr2=0x7ff3c81538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c6d9d700 1 --2- 172.21.15.123:0/457293417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c8071580 0x7ff3c81538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c6d9d700 1 -- 172.21.15.123:0/457293417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c00094b0 con 0x7ff3c815a8c0 2024-09-13T17:08:34.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c6d9d700 1 --2- 172.21.15.123:0/457293417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c815a8c0 0x7ff3c8159c00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0014040 tx=0x7ff3c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:34.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3beffd700 1 -- 172.21.15.123:0/457293417 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c000ba70 con 0x7ff3c815a8c0 2024-09-13T17:08:34.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3beffd700 1 -- 172.21.15.123:0/457293417 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c001e070 con 0x7ff3c815a8c0 2024-09-13T17:08:34.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3beffd700 1 -- 172.21.15.123:0/457293417 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c000be30 con 0x7ff3c815a8c0 2024-09-13T17:08:34.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c759e700 1 -- 172.21.15.123:0/457293417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c81f2fd0 con 0x7ff3c815a8c0 2024-09-13T17:08:34.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c759e700 1 -- 172.21.15.123:0/457293417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c81f32b0 con 0x7ff3c815a8c0 2024-09-13T17:08:34.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.508+0000 7ff3c759e700 1 -- 172.21.15.123:0/457293417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c80677f0 con 0x7ff3c815a8c0 2024-09-13T17:08:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.512+0000 7ff3beffd700 1 -- 172.21.15.123:0/457293417 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3c002d440 con 0x7ff3c815a8c0 2024-09-13T17:08:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.512+0000 7ff3beffd700 1 --2- 172.21.15.123:0/457293417 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3a8066730 0x7ff3a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.512+0000 7ff3beffd700 1 -- 172.21.15.123:0/457293417 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff3c0085500 con 0x7ff3c815a8c0 2024-09-13T17:08:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.512+0000 7ff3c659c700 1 --2- 172.21.15.123:0/457293417 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3a8066730 0x7ff3a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.512+0000 7ff3c659c700 1 --2- 172.21.15.123:0/457293417 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3a8066730 0x7ff3a8068bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0000f60 tx=0x7ff3b0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:34.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.520+0000 7ff3beffd700 1 -- 172.21.15.123:0/457293417 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3c00527a0 con 0x7ff3c815a8c0 2024-09-13T17:08:34.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.692+0000 7ff3c759e700 1 -- 172.21.15.123:0/457293417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3c815b9b0 con 0x7ff3c815a8c0 2024-09-13T17:08:34.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.696+0000 7ff3beffd700 1 -- 172.21.15.123:0/457293417 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16652 (secure 0 0 0) 0x7ff3c0055dc0 con 0x7ff3c815a8c0 2024-09-13T17:08:34.698 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:34.698 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":48,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:32.853957+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:18.071457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:18.723653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.1b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:34.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.696+0000 7ff3c759e700 1 -- 172.21.15.123:0/457293417 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3a8066730 msgr2=0x7ff3a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.696+0000 7ff3c759e700 1 --2- 172.21.15.123:0/457293417 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3a8066730 0x7ff3a8068bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0000f60 tx=0x7ff3b0009040 comp rx=0 tx=0).stop 2024-09-13T17:08:34.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.696+0000 7ff3c759e700 1 -- 172.21.15.123:0/457293417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c815a8c0 msgr2=0x7ff3c8159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.696+0000 7ff3c759e700 1 --2- 172.21.15.123:0/457293417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c815a8c0 0x7ff3c8159c00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0014040 tx=0x7ff3c0004770 comp rx=0 tx=0).stop 2024-09-13T17:08:34.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.696+0000 7ff3c759e700 1 -- 172.21.15.123:0/457293417 shutdown_connections 2024-09-13T17:08:34.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.696+0000 7ff3c759e700 1 --2- 172.21.15.123:0/457293417 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3a8066730 0x7ff3a8068bf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.696+0000 7ff3c759e700 1 --2- 172.21.15.123:0/457293417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c815a8c0 0x7ff3c8159c00 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.696+0000 7ff3c759e700 1 --2- 172.21.15.123:0/457293417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c8071580 0x7ff3c81538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.696+0000 7ff3c759e700 1 --2- 172.21.15.123:0/457293417 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c80705b0 0x7ff3c81540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.696+0000 7ff3c759e700 1 -- 172.21.15.123:0/457293417 >> 172.21.15.123:0/457293417 conn(0x7ff3c8066150 msgr2=0x7ff3c806d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:34.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.696+0000 7ff3c759e700 1 -- 172.21.15.123:0/457293417 shutdown_connections 2024-09-13T17:08:34.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.696+0000 7ff3c759e700 1 -- 172.21.15.123:0/457293417 wait complete. 2024-09-13T17:08:34.713 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:08:18.071457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:08:18.723653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:08:34.714 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:08:34.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed698da700 1 Processor -- start 2024-09-13T17:08:34.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed698da700 1 -- start start 2024-09-13T17:08:34.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed698da700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640d0f40 0x7fed640d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed698da700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed640b58b0 0x7fed640d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed698da700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed640b0060 con 0x7fed640b1100 2024-09-13T17:08:34.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed698da700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed640b0340 con 0x7fed640b58b0 2024-09-13T17:08:34.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed698da700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed640b0620 con 0x7fed640d0f40 2024-09-13T17:08:34.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed63fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed640b58b0 0x7fed640d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed63fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed640b58b0 0x7fed640d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37218/0 (socket says 172.21.15.123:37218) 2024-09-13T17:08:34.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed63fff700 1 -- 172.21.15.123:0/2566941170 learned_addr learned my addr 172.21.15.123:0/2566941170 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:34.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed688d8700 1 --2- 172.21.15.123:0/2566941170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640d0f40 0x7fed640d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed63fff700 1 -- 172.21.15.123:0/2566941170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640d0f40 msgr2=0x7fed640d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:34.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed63fff700 1 --2- 172.21.15.123:0/2566941170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640d0f40 0x7fed640d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed63fff700 1 -- 172.21.15.123:0/2566941170 >> v1:172.21.15.153:6789/0 conn(0x7fed640b1100 legacy=0x7fed640b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed63fff700 1 -- 172.21.15.123:0/2566941170 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed640b0900 con 0x7fed640b58b0 2024-09-13T17:08:34.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed63fff700 1 --2- 172.21.15.123:0/2566941170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed640b58b0 0x7fed640d05a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fed58009910 tx=0x7fed58009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4264044e6299d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:34.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed637fe700 1 -- 172.21.15.123:0/2566941170 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58011830 con 0x7fed640b58b0 2024-09-13T17:08:34.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed637fe700 1 -- 172.21.15.123:0/2566941170 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed58011990 con 0x7fed640b58b0 2024-09-13T17:08:34.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.832+0000 7fed637fe700 1 -- 172.21.15.123:0/2566941170 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58011d40 con 0x7fed640b58b0 2024-09-13T17:08:34.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.836+0000 7fed698da700 1 -- 172.21.15.123:0/2566941170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed640b58b0 msgr2=0x7fed640d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.836+0000 7fed698da700 1 --2- 172.21.15.123:0/2566941170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed640b58b0 0x7fed640d05a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fed58009910 tx=0x7fed58009c20 comp rx=0 tx=0).stop 2024-09-13T17:08:34.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.836+0000 7fed698da700 1 -- 172.21.15.123:0/2566941170 shutdown_connections 2024-09-13T17:08:34.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.836+0000 7fed698da700 1 --2- 172.21.15.123:0/2566941170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed640b58b0 0x7fed640d05a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.836+0000 7fed698da700 1 --2- 172.21.15.123:0/2566941170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640d0f40 0x7fed640d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.836+0000 7fed698da700 1 -- 172.21.15.123:0/2566941170 >> 172.21.15.123:0/2566941170 conn(0x7fed640d2a60 msgr2=0x7fed640d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.836+0000 7fed698da700 1 -- 172.21.15.123:0/2566941170 shutdown_connections 2024-09-13T17:08:34.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.836+0000 7fed698da700 1 -- 172.21.15.123:0/2566941170 wait complete. 2024-09-13T17:08:34.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.836+0000 7fed698da700 1 Processor -- start 2024-09-13T17:08:34.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.836+0000 7fed698da700 1 -- start start 2024-09-13T17:08:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed698da700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed640b1100 0x7fed6415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed698da700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed640b58b0 0x7fed6414eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed698da700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640d0f40 0x7fed641f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed698da700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6415e170 con 0x7fed640b1100 2024-09-13T17:08:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed698da700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed641f3ff0 con 0x7fed640b58b0 2024-09-13T17:08:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed698da700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6414f400 con 0x7fed640d0f40 2024-09-13T17:08:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed688d8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed640b1100 0x7fed6415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed688d8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed640b1100 0x7fed6415c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37222/0 (socket says 172.21.15.123:37222) 2024-09-13T17:08:34.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed688d8700 1 -- 172.21.15.123:0/601109948 learned_addr learned my addr 172.21.15.123:0/601109948 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed63fff700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed640b58b0 0x7fed6414eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed690d9700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640d0f40 0x7fed641f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed688d8700 1 -- 172.21.15.123:0/601109948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640d0f40 msgr2=0x7fed641f2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed688d8700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640d0f40 0x7fed641f2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed688d8700 1 -- 172.21.15.123:0/601109948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed640b58b0 msgr2=0x7fed6414eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed688d8700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed640b58b0 0x7fed6414eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed688d8700 1 -- 172.21.15.123:0/601109948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed58009570 con 0x7fed640b1100 2024-09-13T17:08:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed690d9700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640d0f40 0x7fed641f2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed688d8700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed640b1100 0x7fed6415c1c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fed5400e840 tx=0x7fed5400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed617fa700 1 -- 172.21.15.123:0/601109948 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540095a0 con 0x7fed640b1100 2024-09-13T17:08:34.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed617fa700 1 -- 172.21.15.123:0/601109948 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed54013680 con 0x7fed640b1100 2024-09-13T17:08:34.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed617fa700 1 -- 172.21.15.123:0/601109948 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540139f0 con 0x7fed640b1100 2024-09-13T17:08:34.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed698da700 1 -- 172.21.15.123:0/601109948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed640c8c40 con 0x7fed640b1100 2024-09-13T17:08:34.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.840+0000 7fed698da700 1 -- 172.21.15.123:0/601109948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed640c9200 con 0x7fed640b1100 2024-09-13T17:08:34.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.844+0000 7fed698da700 1 -- 172.21.15.123:0/601109948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6415ce70 con 0x7fed640b1100 2024-09-13T17:08:34.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.844+0000 7fed617fa700 1 -- 172.21.15.123:0/601109948 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fed54013b50 con 0x7fed640b1100 2024-09-13T17:08:34.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.844+0000 7fed617fa700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed50066730 0x7fed50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:34.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.844+0000 7fed617fa700 1 -- 172.21.15.123:0/601109948 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fed540840e0 con 0x7fed640b1100 2024-09-13T17:08:34.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.844+0000 7fed63fff700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed50066730 0x7fed50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:34.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.844+0000 7fed63fff700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed50066730 0x7fed50068bf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fed640b5c90 tx=0x7fed58008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:34.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:34.852+0000 7fed617fa700 1 -- 172.21.15.123:0/601109948 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fed54051420 con 0x7fed640b1100 2024-09-13T17:08:35.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.024+0000 7fed698da700 1 -- 172.21.15.123:0/601109948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed6415e2b0 con 0x7fed640b1100 2024-09-13T17:08:35.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.028+0000 7fed617fa700 1 -- 172.21.15.123:0/601109948 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed6415e2b0 con 0x7fed640b1100 2024-09-13T17:08:35.030 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:08:35.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.028+0000 7fed698da700 1 -- 172.21.15.123:0/601109948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed50066730 msgr2=0x7fed50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.028+0000 7fed698da700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed50066730 0x7fed50068bf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fed640b5c90 tx=0x7fed58008030 comp rx=0 tx=0).stop 2024-09-13T17:08:35.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.028+0000 7fed698da700 1 -- 172.21.15.123:0/601109948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed640b1100 msgr2=0x7fed6415c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.028+0000 7fed698da700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed640b1100 0x7fed6415c1c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fed5400e840 tx=0x7fed5400eb50 comp rx=0 tx=0).stop 2024-09-13T17:08:35.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.028+0000 7fed698da700 1 -- 172.21.15.123:0/601109948 shutdown_connections 2024-09-13T17:08:35.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.028+0000 7fed698da700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed50066730 0x7fed50068bf0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.028+0000 7fed698da700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640d0f40 0x7fed641f2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.028+0000 7fed698da700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed640b58b0 0x7fed6414eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.028+0000 7fed698da700 1 --2- 172.21.15.123:0/601109948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed640b1100 0x7fed6415c1c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.028+0000 7fed698da700 1 -- 172.21.15.123:0/601109948 >> 172.21.15.123:0/601109948 conn(0x7fed640d2a60 msgr2=0x7fed640b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:35.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.028+0000 7fed698da700 1 -- 172.21.15.123:0/601109948 shutdown_connections 2024-09-13T17:08:35.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.028+0000 7fed698da700 1 -- 172.21.15.123:0/601109948 wait complete. 2024-09-13T17:08:35.045 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:08:35.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f28add700 1 Processor -- start 2024-09-13T17:08:35.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f28add700 1 -- start start 2024-09-13T17:08:35.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f28add700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7f240af4d0 0x7f7f240af920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f28add700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f240ccb20 0x7f7f240ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f28add700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f240cc690 con 0x7f7f241599f0 2024-09-13T17:08:35.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f28add700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f240afe60 con 0x7f7f240af4d0 2024-09-13T17:08:35.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f28add700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f240c9970 con 0x7f7f240ccb20 2024-09-13T17:08:35.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f21d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7f240af4d0 0x7f7f240af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f21d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7f240af4d0 0x7f7f240af920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37232/0 (socket says 172.21.15.123:37232) 2024-09-13T17:08:35.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f21d9b700 1 -- 172.21.15.123:0/288001192 learned_addr learned my addr 172.21.15.123:0/288001192 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:35.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f22d9d700 1 --2- 172.21.15.123:0/288001192 >> v2:172.21.15.153:3300/0 conn(0x7f7f240ccb20 0x7f7f240ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f21d9b700 1 -- 172.21.15.123:0/288001192 >> v2:172.21.15.153:3300/0 conn(0x7f7f240ccb20 msgr2=0x7f7f240ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:35.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f21d9b700 1 --2- 172.21.15.123:0/288001192 >> v2:172.21.15.153:3300/0 conn(0x7f7f240ccb20 0x7f7f240ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f21d9b700 1 -- 172.21.15.123:0/288001192 >> v1:172.21.15.153:6789/0 conn(0x7f7f241599f0 legacy=0x7f7f240c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:35.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.160+0000 7f7f21d9b700 1 -- 172.21.15.123:0/288001192 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f240c9c50 con 0x7f7f240af4d0 2024-09-13T17:08:35.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f21d9b700 1 --2- 172.21.15.123:0/288001192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f240af4d0 0x7f7f240af920 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7f240cc210 tx=0x7f7f14009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873d192b5b8c9db1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:35.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f2159a700 1 -- 172.21.15.123:0/288001192 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f14004230 con 0x7f7f240af4d0 2024-09-13T17:08:35.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f2159a700 1 -- 172.21.15.123:0/288001192 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f14004390 con 0x7f7f240af4d0 2024-09-13T17:08:35.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f2159a700 1 -- 172.21.15.123:0/288001192 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f140036c0 con 0x7f7f240af4d0 2024-09-13T17:08:35.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 -- 172.21.15.123:0/288001192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f240af4d0 msgr2=0x7f7f240af920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 --2- 172.21.15.123:0/288001192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f240af4d0 0x7f7f240af920 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7f240cc210 tx=0x7f7f14009bf0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 -- 172.21.15.123:0/288001192 shutdown_connections 2024-09-13T17:08:35.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 --2- 172.21.15.123:0/288001192 >> v2:172.21.15.153:3300/0 conn(0x7f7f240ccb20 0x7f7f240ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 --2- 172.21.15.123:0/288001192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f240af4d0 0x7f7f240af920 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 -- 172.21.15.123:0/288001192 >> 172.21.15.123:0/288001192 conn(0x7f7f240b0450 msgr2=0x7f7f240b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:35.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 -- 172.21.15.123:0/288001192 shutdown_connections 2024-09-13T17:08:35.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 -- 172.21.15.123:0/288001192 wait complete. 2024-09-13T17:08:35.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 Processor -- start 2024-09-13T17:08:35.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 -- start start 2024-09-13T17:08:35.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f240af4d0 0x7f7f2414dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f240ccb20 0x7f7f2414bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f241599f0 0x7f7f2414c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2414ae40 con 0x7f7f241599f0 2024-09-13T17:08:35.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2414b120 con 0x7f7f240ccb20 2024-09-13T17:08:35.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.164+0000 7f7f28add700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2414b400 con 0x7f7f240af4d0 2024-09-13T17:08:35.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f22d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f241599f0 0x7f7f2414c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f21d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f240ccb20 0x7f7f2414bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f22d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f241599f0 0x7f7f2414c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37240/0 (socket says 172.21.15.123:37240) 2024-09-13T17:08:35.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f22d9d700 1 -- 172.21.15.123:0/1922511362 learned_addr learned my addr 172.21.15.123:0/1922511362 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:35.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f2259c700 1 --2- 172.21.15.123:0/1922511362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f240af4d0 0x7f7f2414dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f22d9d700 1 -- 172.21.15.123:0/1922511362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f240af4d0 msgr2=0x7f7f2414dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f22d9d700 1 --2- 172.21.15.123:0/1922511362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f240af4d0 0x7f7f2414dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f22d9d700 1 -- 172.21.15.123:0/1922511362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f240ccb20 msgr2=0x7f7f2414bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f22d9d700 1 --2- 172.21.15.123:0/1922511362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f240ccb20 0x7f7f2414bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f22d9d700 1 -- 172.21.15.123:0/1922511362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f14009570 con 0x7f7f241599f0 2024-09-13T17:08:35.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f22d9d700 1 --2- 172.21.15.123:0/1922511362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f241599f0 0x7f7f2414c420 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c007e40 tx=0x7f7f1c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:35.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f12ffd700 1 -- 172.21.15.123:0/1922511362 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c00ede0 con 0x7f7f241599f0 2024-09-13T17:08:35.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f12ffd700 1 -- 172.21.15.123:0/1922511362 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c014420 con 0x7f7f241599f0 2024-09-13T17:08:35.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f28add700 1 -- 172.21.15.123:0/1922511362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2414b6e0 con 0x7f7f241599f0 2024-09-13T17:08:35.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f12ffd700 1 -- 172.21.15.123:0/1922511362 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0147d0 con 0x7f7f241599f0 2024-09-13T17:08:35.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f28add700 1 -- 172.21.15.123:0/1922511362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2414a9d0 con 0x7f7f241599f0 2024-09-13T17:08:35.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.168+0000 7f7f28add700 1 -- 172.21.15.123:0/1922511362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2414bc00 con 0x7f7f241599f0 2024-09-13T17:08:35.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.172+0000 7f7f12ffd700 1 -- 172.21.15.123:0/1922511362 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7f1c014930 con 0x7f7f241599f0 2024-09-13T17:08:35.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.172+0000 7f7f12ffd700 1 --2- 172.21.15.123:0/1922511362 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f04066730 0x7f7f04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.172+0000 7f7f2259c700 1 --2- 172.21.15.123:0/1922511362 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f04066730 0x7f7f04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.172+0000 7f7f12ffd700 1 -- 172.21.15.123:0/1922511362 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7f1c0848e0 con 0x7f7f241599f0 2024-09-13T17:08:35.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.172+0000 7f7f2259c700 1 --2- 172.21.15.123:0/1922511362 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f04066730 0x7f7f04068bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7f18001710 tx=0x7f7f18009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:35.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.176+0000 7f7f12ffd700 1 -- 172.21.15.123:0/1922511362 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f2414bc00 con 0x7f7f241599f0 2024-09-13T17:08:35.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.344+0000 7f7f28add700 1 -- 172.21.15.123:0/1922511362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f2414bc00 con 0x7f7f241599f0 2024-09-13T17:08:35.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.348+0000 7f7f12ffd700 1 -- 172.21.15.123:0/1922511362 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f2414bc00 con 0x7f7f241599f0 2024-09-13T17:08:35.350 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:08:35.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.348+0000 7f7f28add700 1 -- 172.21.15.123:0/1922511362 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f04066730 msgr2=0x7f7f04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.348+0000 7f7f28add700 1 --2- 172.21.15.123:0/1922511362 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f04066730 0x7f7f04068bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7f18001710 tx=0x7f7f18009040 comp rx=0 tx=0).stop 2024-09-13T17:08:35.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.348+0000 7f7f28add700 1 -- 172.21.15.123:0/1922511362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f241599f0 msgr2=0x7f7f2414c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.348+0000 7f7f28add700 1 --2- 172.21.15.123:0/1922511362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f241599f0 0x7f7f2414c420 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c007e40 tx=0x7f7f1c00e3c0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.348+0000 7f7f28add700 1 -- 172.21.15.123:0/1922511362 shutdown_connections 2024-09-13T17:08:35.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.348+0000 7f7f28add700 1 --2- 172.21.15.123:0/1922511362 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f04066730 0x7f7f04068bf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.348+0000 7f7f28add700 1 --2- 172.21.15.123:0/1922511362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f241599f0 0x7f7f2414c420 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.348+0000 7f7f28add700 1 --2- 172.21.15.123:0/1922511362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f240ccb20 0x7f7f2414bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.348+0000 7f7f28add700 1 --2- 172.21.15.123:0/1922511362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7f240af4d0 0x7f7f2414dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.348+0000 7f7f28add700 1 -- 172.21.15.123:0/1922511362 >> 172.21.15.123:0/1922511362 conn(0x7f7f240b0450 msgr2=0x7f7f240cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:35.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.348+0000 7f7f28add700 1 -- 172.21.15.123:0/1922511362 shutdown_connections 2024-09-13T17:08:35.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.348+0000 7f7f28add700 1 -- 172.21.15.123:0/1922511362 wait complete. 2024-09-13T17:08:35.366 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:08:35.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.480+0000 7ff116130700 1 Processor -- start 2024-09-13T17:08:35.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.480+0000 7ff116130700 1 -- start start 2024-09-13T17:08:35.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.480+0000 7ff116130700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff110165760 0x7ff110167b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.480+0000 7ff116130700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1100d0cb0 con 0x7ff1100d0f40 2024-09-13T17:08:35.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.480+0000 7ff116130700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1100b0060 con 0x7ff1100b58b0 2024-09-13T17:08:35.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.480+0000 7ff116130700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1100b0340 con 0x7ff110165760 2024-09-13T17:08:35.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.480+0000 7ff11512e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff1100d0f40 0x7ff1100d1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43444/0 (socket says 172.21.15.123:43444) 2024-09-13T17:08:35.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.480+0000 7ff11512e700 1 -- 172.21.15.123:0/3398702575 learned_addr learned my addr 172.21.15.123:0/3398702575 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:35.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.480+0000 7ff11592f700 1 --2- 172.21.15.123:0/3398702575 >> v2:172.21.15.153:3300/0 conn(0x7ff110165760 0x7ff110167b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff107fff700 1 -- 172.21.15.123:0/3398702575 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036363569 0 0) 0x7ff1100d0cb0 con 0x7ff1100d0f40 2024-09-13T17:08:35.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff107fff700 1 -- 172.21.15.123:0/3398702575 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0fc0035d0 con 0x7ff1100d0f40 2024-09-13T17:08:35.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff11592f700 1 -- 172.21.15.123:0/3398702575 >> v1:172.21.15.153:6789/0 conn(0x7ff1100b58b0 legacy=0x7ff1100d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff11592f700 1 -- 172.21.15.123:0/3398702575 >> v1:172.21.15.123:6789/0 conn(0x7ff1100d0f40 legacy=0x7ff1100d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff11592f700 1 -- 172.21.15.123:0/3398702575 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1100b0620 con 0x7ff110165760 2024-09-13T17:08:35.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff11592f700 1 --2- 172.21.15.123:0/3398702575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff110165760 0x7ff110167b50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff108009d90 tx=0x7ff10800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=399e76e63ea71088 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:35.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff107fff700 1 -- 172.21.15.123:0/3398702575 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10800e070 con 0x7ff110165760 2024-09-13T17:08:35.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff107fff700 1 -- 172.21.15.123:0/3398702575 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10800bb20 con 0x7ff110165760 2024-09-13T17:08:35.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff107fff700 1 -- 172.21.15.123:0/3398702575 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10800be90 con 0x7ff110165760 2024-09-13T17:08:35.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff116130700 1 -- 172.21.15.123:0/3398702575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff110165760 msgr2=0x7ff110167b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff116130700 1 --2- 172.21.15.123:0/3398702575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff110165760 0x7ff110167b50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff108009d90 tx=0x7ff10800b330 comp rx=0 tx=0).stop 2024-09-13T17:08:35.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff116130700 1 -- 172.21.15.123:0/3398702575 shutdown_connections 2024-09-13T17:08:35.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff116130700 1 --2- 172.21.15.123:0/3398702575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff110165760 0x7ff110167b50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff116130700 1 -- 172.21.15.123:0/3398702575 >> 172.21.15.123:0/3398702575 conn(0x7ff1100d2a60 msgr2=0x7ff1100d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:35.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff116130700 1 -- 172.21.15.123:0/3398702575 shutdown_connections 2024-09-13T17:08:35.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.484+0000 7ff116130700 1 -- 172.21.15.123:0/3398702575 wait complete. 2024-09-13T17:08:35.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff116130700 1 Processor -- start 2024-09-13T17:08:35.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff116130700 1 -- start start 2024-09-13T17:08:35.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff116130700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1100b58b0 0x7ff11015ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff116130700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1100d0f40 0x7ff1100cf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff116130700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff110165760 0x7ff11015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff116130700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11015dc30 con 0x7ff1100d0f40 2024-09-13T17:08:35.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff116130700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11015df10 con 0x7ff1100b58b0 2024-09-13T17:08:35.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff116130700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11015e1f0 con 0x7ff110165760 2024-09-13T17:08:35.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff11492d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1100d0f40 0x7ff1100cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff11492d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1100d0f40 0x7ff1100cf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37252/0 (socket says 172.21.15.123:37252) 2024-09-13T17:08:35.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff11492d700 1 -- 172.21.15.123:0/2016498328 learned_addr learned my addr 172.21.15.123:0/2016498328 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:35.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff11512e700 1 --2- 172.21.15.123:0/2016498328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1100b58b0 0x7ff11015ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff11592f700 1 --2- 172.21.15.123:0/2016498328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff110165760 0x7ff11015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff11492d700 1 -- 172.21.15.123:0/2016498328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff110165760 msgr2=0x7ff11015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff11492d700 1 --2- 172.21.15.123:0/2016498328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff110165760 0x7ff11015a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff11492d700 1 -- 172.21.15.123:0/2016498328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1100b58b0 msgr2=0x7ff11015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff11492d700 1 --2- 172.21.15.123:0/2016498328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1100b58b0 0x7ff11015ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff11492d700 1 -- 172.21.15.123:0/2016498328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff108009a70 con 0x7ff1100d0f40 2024-09-13T17:08:35.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff11492d700 1 --2- 172.21.15.123:0/2016498328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1100d0f40 0x7ff1100cf270 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00c500 tx=0x7ff10c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:35.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff105ffb700 1 -- 172.21.15.123:0/2016498328 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0052d0 con 0x7ff1100d0f40 2024-09-13T17:08:35.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff105ffb700 1 -- 172.21.15.123:0/2016498328 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c005430 con 0x7ff1100d0f40 2024-09-13T17:08:35.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff105ffb700 1 -- 172.21.15.123:0/2016498328 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0055a0 con 0x7ff1100d0f40 2024-09-13T17:08:35.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff116130700 1 -- 172.21.15.123:0/2016498328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11015e4d0 con 0x7ff1100d0f40 2024-09-13T17:08:35.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.488+0000 7ff116130700 1 -- 172.21.15.123:0/2016498328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11015f210 con 0x7ff1100d0f40 2024-09-13T17:08:35.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.492+0000 7ff116130700 1 -- 172.21.15.123:0/2016498328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11015e9f0 con 0x7ff1100d0f40 2024-09-13T17:08:35.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.492+0000 7ff105ffb700 1 -- 172.21.15.123:0/2016498328 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff10c0036a0 con 0x7ff1100d0f40 2024-09-13T17:08:35.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.492+0000 7ff105ffb700 1 --2- 172.21.15.123:0/2016498328 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff0f4066730 0x7ff0f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.492+0000 7ff105ffb700 1 -- 172.21.15.123:0/2016498328 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff10c083550 con 0x7ff1100d0f40 2024-09-13T17:08:35.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.492+0000 7ff11512e700 1 --2- 172.21.15.123:0/2016498328 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff0f4066730 0x7ff0f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.492+0000 7ff11512e700 1 --2- 172.21.15.123:0/2016498328 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff0f4066730 0x7ff0f4068bf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff1000011e0 tx=0x7ff100009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:35.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.500+0000 7ff105ffb700 1 -- 172.21.15.123:0/2016498328 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff11015e9f0 con 0x7ff1100d0f40 2024-09-13T17:08:35.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.664+0000 7ff116130700 1 -- 172.21.15.123:0/2016498328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff11015e9f0 con 0x7ff1100d0f40 2024-09-13T17:08:35.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.664+0000 7ff105ffb700 1 -- 172.21.15.123:0/2016498328 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff11015e9f0 con 0x7ff1100d0f40 2024-09-13T17:08:35.667 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:08:35.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.664+0000 7ff116130700 1 -- 172.21.15.123:0/2016498328 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff0f4066730 msgr2=0x7ff0f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.664+0000 7ff116130700 1 --2- 172.21.15.123:0/2016498328 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff0f4066730 0x7ff0f4068bf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff1000011e0 tx=0x7ff100009040 comp rx=0 tx=0).stop 2024-09-13T17:08:35.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.664+0000 7ff116130700 1 -- 172.21.15.123:0/2016498328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1100d0f40 msgr2=0x7ff1100cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.664+0000 7ff116130700 1 --2- 172.21.15.123:0/2016498328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1100d0f40 0x7ff1100cf270 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00c500 tx=0x7ff10c00c8c0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.664+0000 7ff116130700 1 -- 172.21.15.123:0/2016498328 shutdown_connections 2024-09-13T17:08:35.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.664+0000 7ff116130700 1 --2- 172.21.15.123:0/2016498328 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff0f4066730 0x7ff0f4068bf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.664+0000 7ff116130700 1 --2- 172.21.15.123:0/2016498328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff110165760 0x7ff11015a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.664+0000 7ff116130700 1 --2- 172.21.15.123:0/2016498328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1100d0f40 0x7ff1100cf270 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.664+0000 7ff116130700 1 --2- 172.21.15.123:0/2016498328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1100b58b0 0x7ff11015ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.664+0000 7ff116130700 1 -- 172.21.15.123:0/2016498328 >> 172.21.15.123:0/2016498328 conn(0x7ff1100d2a60 msgr2=0x7ff1100b6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:35.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.664+0000 7ff116130700 1 -- 172.21.15.123:0/2016498328 shutdown_connections 2024-09-13T17:08:35.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.664+0000 7ff116130700 1 -- 172.21.15.123:0/2016498328 wait complete. 2024-09-13T17:08:35.683 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:08:35.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc582124700 1 Processor -- start 2024-09-13T17:08:35.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc582124700 1 -- start start 2024-09-13T17:08:35.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc582124700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc57c0cc9e0 0x7fc57c0cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc582124700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc57c0cbbe0 0x7fc57c0d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc582124700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57c1648d0 con 0x7fc57c1644f0 2024-09-13T17:08:35.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc582124700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c0ce280 con 0x7fc57c0cc9e0 2024-09-13T17:08:35.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc582124700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c070370 con 0x7fc57c0cbbe0 2024-09-13T17:08:35.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc580921700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc57c0cc9e0 0x7fc57c0cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc581122700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc57c1644f0 0x7fc57c0caf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43450/0 (socket says 172.21.15.123:43450) 2024-09-13T17:08:35.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc581122700 1 -- 172.21.15.123:0/1664555461 learned_addr learned my addr 172.21.15.123:0/1664555461 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:35.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc581923700 1 --2- 172.21.15.123:0/1664555461 >> v2:172.21.15.153:3300/0 conn(0x7fc57c0cbbe0 0x7fc57c0d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc573fff700 1 -- 172.21.15.123:0/1664555461 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935663155 0 0) 0x7fc57c1648d0 con 0x7fc57c1644f0 2024-09-13T17:08:35.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc573fff700 1 -- 172.21.15.123:0/1664555461 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5640035d0 con 0x7fc57c1644f0 2024-09-13T17:08:35.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc580921700 1 -- 172.21.15.123:0/1664555461 >> v2:172.21.15.153:3300/0 conn(0x7fc57c0cbbe0 msgr2=0x7fc57c0d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:35.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc580921700 1 --2- 172.21.15.123:0/1664555461 >> v2:172.21.15.153:3300/0 conn(0x7fc57c0cbbe0 0x7fc57c0d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc580921700 1 -- 172.21.15.123:0/1664555461 >> v1:172.21.15.123:6789/0 conn(0x7fc57c1644f0 legacy=0x7fc57c0caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc580921700 1 -- 172.21.15.123:0/1664555461 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c0cc140 con 0x7fc57c0cc9e0 2024-09-13T17:08:35.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc580921700 1 --2- 172.21.15.123:0/1664555461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc57c0cc9e0 0x7fc57c0cb6a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0cf730 tx=0x7fc56c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ade9850ac64417 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:35.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc573fff700 1 -- 172.21.15.123:0/1664555461 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c00e070 con 0x7fc57c0cc9e0 2024-09-13T17:08:35.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.788+0000 7fc573fff700 1 -- 172.21.15.123:0/1664555461 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c00bb20 con 0x7fc57c0cc9e0 2024-09-13T17:08:35.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.792+0000 7fc573fff700 1 -- 172.21.15.123:0/1664555461 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c012430 con 0x7fc57c0cc9e0 2024-09-13T17:08:35.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.792+0000 7fc582124700 1 -- 172.21.15.123:0/1664555461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc57c0cc9e0 msgr2=0x7fc57c0cb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.792+0000 7fc582124700 1 --2- 172.21.15.123:0/1664555461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc57c0cc9e0 0x7fc57c0cb6a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0cf730 tx=0x7fc56c00b330 comp rx=0 tx=0).stop 2024-09-13T17:08:35.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.792+0000 7fc582124700 1 -- 172.21.15.123:0/1664555461 shutdown_connections 2024-09-13T17:08:35.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.792+0000 7fc582124700 1 --2- 172.21.15.123:0/1664555461 >> v2:172.21.15.153:3300/0 conn(0x7fc57c0cbbe0 0x7fc57c0d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.792+0000 7fc582124700 1 --2- 172.21.15.123:0/1664555461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc57c0cc9e0 0x7fc57c0cb6a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.792+0000 7fc582124700 1 -- 172.21.15.123:0/1664555461 >> 172.21.15.123:0/1664555461 conn(0x7fc57c06e020 msgr2=0x7fc57c06e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:35.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.792+0000 7fc582124700 1 -- 172.21.15.123:0/1664555461 shutdown_connections 2024-09-13T17:08:35.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.792+0000 7fc582124700 1 -- 172.21.15.123:0/1664555461 wait complete. 2024-09-13T17:08:35.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.792+0000 7fc582124700 1 Processor -- start 2024-09-13T17:08:35.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.792+0000 7fc582124700 1 -- start start 2024-09-13T17:08:35.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc582124700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc57c0cbbe0 0x7fc57c1f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc582124700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc57c0cc9e0 0x7fc57c0b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc582124700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc57c1644f0 0x7fc57c160450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc582124700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0b5cd0 con 0x7fc57c0cbbe0 2024-09-13T17:08:35.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc582124700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0b5300 con 0x7fc57c1644f0 2024-09-13T17:08:35.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc582124700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0b49d0 con 0x7fc57c0cc9e0 2024-09-13T17:08:35.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc581122700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc57c0cbbe0 0x7fc57c1f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc581122700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc57c0cbbe0 0x7fc57c1f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37270/0 (socket says 172.21.15.123:37270) 2024-09-13T17:08:35.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc581122700 1 -- 172.21.15.123:0/3223715941 learned_addr learned my addr 172.21.15.123:0/3223715941 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:35.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc580921700 1 --2- 172.21.15.123:0/3223715941 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc57c0cc9e0 0x7fc57c0b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc581923700 1 --2- 172.21.15.123:0/3223715941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc57c1644f0 0x7fc57c160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc581122700 1 -- 172.21.15.123:0/3223715941 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc57c0cc9e0 msgr2=0x7fc57c0b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc581122700 1 --2- 172.21.15.123:0/3223715941 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc57c0cc9e0 0x7fc57c0b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc581122700 1 -- 172.21.15.123:0/3223715941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc57c1644f0 msgr2=0x7fc57c160450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:35.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc581122700 1 --2- 172.21.15.123:0/3223715941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc57c1644f0 0x7fc57c160450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:35.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc581122700 1 -- 172.21.15.123:0/3223715941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c009a70 con 0x7fc57c0cbbe0 2024-09-13T17:08:35.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc581122700 1 --2- 172.21.15.123:0/3223715941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc57c0cbbe0 0x7fc57c1f61c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc57800c4d0 tx=0x7fc57800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:35.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc571ffb700 1 -- 172.21.15.123:0/3223715941 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578005d90 con 0x7fc57c0cbbe0 2024-09-13T17:08:35.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc571ffb700 1 -- 172.21.15.123:0/3223715941 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5780070d0 con 0x7fc57c0cbbe0 2024-09-13T17:08:35.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc582124700 1 -- 172.21.15.123:0/3223715941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57c0b4cb0 con 0x7fc57c0cbbe0 2024-09-13T17:08:35.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc571ffb700 1 -- 172.21.15.123:0/3223715941 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578007480 con 0x7fc57c0cbbe0 2024-09-13T17:08:35.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc582124700 1 -- 172.21.15.123:0/3223715941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c160990 con 0x7fc57c0cbbe0 2024-09-13T17:08:35.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.796+0000 7fc582124700 1 -- 172.21.15.123:0/3223715941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c0caf90 con 0x7fc57c0cbbe0 2024-09-13T17:08:35.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.800+0000 7fc571ffb700 1 -- 172.21.15.123:0/3223715941 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc5780075e0 con 0x7fc57c0cbbe0 2024-09-13T17:08:35.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.800+0000 7fc571ffb700 1 --2- 172.21.15.123:0/3223715941 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc568066730 0x7fc568068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:35.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.800+0000 7fc580921700 1 --2- 172.21.15.123:0/3223715941 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc568066730 0x7fc568068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:35.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.800+0000 7fc571ffb700 1 -- 172.21.15.123:0/3223715941 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc578083580 con 0x7fc57c0cbbe0 2024-09-13T17:08:35.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.800+0000 7fc580921700 1 --2- 172.21.15.123:0/3223715941 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc568066730 0x7fc568068bf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc56c014040 tx=0x7fc56c011000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:35.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:35.804+0000 7fc571ffb700 1 -- 172.21.15.123:0/3223715941 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc5780508b0 con 0x7fc57c0cbbe0 2024-09-13T17:08:36.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.008+0000 7fc582124700 1 -- 172.21.15.123:0/3223715941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc57c0afdc0 con 0x7fc57c0cbbe0 2024-09-13T17:08:36.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.008+0000 7fc571ffb700 1 -- 172.21.15.123:0/3223715941 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fc578053ed0 con 0x7fc57c0cbbe0 2024-09-13T17:08:36.014 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:36.014 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5602,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3264962321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3264962321},{"type":"v1","addr":"172.21.15.153:6833","nonce":3264962321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5605,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1200497874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1200497874},{"type":"v1","addr":"172.21.15.153:6835","nonce":1200497874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/398437513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":398437513},{"type":"v1","addr":"172.21.15.123:6835","nonce":398437513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:08:19.726019+0000","modified":"2024-09-13T17:08:22.746133+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5730},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5730":{"gid":5730,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2449786141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2449786141},{"type":"v1","addr":"172.21.15.123:6837","nonce":2449786141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:08:36.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.012+0000 7fc582124700 1 -- 172.21.15.123:0/3223715941 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc568066730 msgr2=0x7fc568068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.012+0000 7fc582124700 1 --2- 172.21.15.123:0/3223715941 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc568066730 0x7fc568068bf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc56c014040 tx=0x7fc56c011000 comp rx=0 tx=0).stop 2024-09-13T17:08:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.012+0000 7fc582124700 1 -- 172.21.15.123:0/3223715941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc57c0cbbe0 msgr2=0x7fc57c1f61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.012+0000 7fc582124700 1 --2- 172.21.15.123:0/3223715941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc57c0cbbe0 0x7fc57c1f61c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc57800c4d0 tx=0x7fc57800c7e0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.012+0000 7fc582124700 1 -- 172.21.15.123:0/3223715941 shutdown_connections 2024-09-13T17:08:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.012+0000 7fc582124700 1 --2- 172.21.15.123:0/3223715941 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc568066730 0x7fc568068bf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.012+0000 7fc582124700 1 --2- 172.21.15.123:0/3223715941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc57c1644f0 0x7fc57c160450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.012+0000 7fc582124700 1 --2- 172.21.15.123:0/3223715941 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc57c0cc9e0 0x7fc57c0b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.012+0000 7fc582124700 1 --2- 172.21.15.123:0/3223715941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc57c0cbbe0 0x7fc57c1f61c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.012+0000 7fc582124700 1 -- 172.21.15.123:0/3223715941 >> 172.21.15.123:0/3223715941 conn(0x7fc57c06e020 msgr2=0x7fc57c1615c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.012+0000 7fc582124700 1 -- 172.21.15.123:0/3223715941 shutdown_connections 2024-09-13T17:08:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.012+0000 7fc582124700 1 -- 172.21.15.123:0/3223715941 wait complete. 2024-09-13T17:08:36.018 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 21 2024-09-13T17:08:36.028 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:36.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.136+0000 7fec716cc700 1 Processor -- start 2024-09-13T17:08:36.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.136+0000 7fec716cc700 1 -- start start 2024-09-13T17:08:36.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec716cc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fec6c15e920 0x7fec6c0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec716cc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec6c15ed00 0x7fec6c0cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec716cc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6c162550 con 0x7fec6c0cb020 2024-09-13T17:08:36.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec716cc700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec6c0cd690 con 0x7fec6c15e920 2024-09-13T17:08:36.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec716cc700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c161f90 con 0x7fec6c15ed00 2024-09-13T17:08:36.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec6b7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fec6c0cb020 0x7fec6c161540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43460/0 (socket says 172.21.15.123:43460) 2024-09-13T17:08:36.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec6b7fe700 1 -- 172.21.15.123:0/2703075772 learned_addr learned my addr 172.21.15.123:0/2703075772 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:36.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec6bfff700 1 --2- 172.21.15.123:0/2703075772 >> v2:172.21.15.153:3300/0 conn(0x7fec6c15e920 0x7fec6c0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec70ecb700 1 --2- 172.21.15.123:0/2703075772 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec6c15ed00 0x7fec6c0cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec6affd700 1 -- 172.21.15.123:0/2703075772 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889142683 0 0) 0x7fec6c162550 con 0x7fec6c0cb020 2024-09-13T17:08:36.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec6affd700 1 -- 172.21.15.123:0/2703075772 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec540035d0 con 0x7fec6c0cb020 2024-09-13T17:08:36.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec6bfff700 1 -- 172.21.15.123:0/2703075772 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec6c15ed00 msgr2=0x7fec6c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:36.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec6bfff700 1 --2- 172.21.15.123:0/2703075772 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec6c15ed00 0x7fec6c0cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec6bfff700 1 -- 172.21.15.123:0/2703075772 >> v1:172.21.15.123:6789/0 conn(0x7fec6c0cb020 legacy=0x7fec6c161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec6bfff700 1 -- 172.21.15.123:0/2703075772 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c162270 con 0x7fec6c15e920 2024-09-13T17:08:36.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec6bfff700 1 --2- 172.21.15.123:0/2703075772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec6c15e920 0x7fec6c0caae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009850 tx=0x7fec5c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b88b49ac1ef95bda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:36.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec6affd700 1 -- 172.21.15.123:0/2703075772 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c011830 con 0x7fec6c15e920 2024-09-13T17:08:36.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec6affd700 1 -- 172.21.15.123:0/2703075772 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c011990 con 0x7fec6c15e920 2024-09-13T17:08:36.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec6affd700 1 -- 172.21.15.123:0/2703075772 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c011d40 con 0x7fec6c15e920 2024-09-13T17:08:36.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec716cc700 1 -- 172.21.15.123:0/2703075772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec6c15e920 msgr2=0x7fec6c0caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec716cc700 1 --2- 172.21.15.123:0/2703075772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec6c15e920 0x7fec6c0caae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009850 tx=0x7fec5c009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:36.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec716cc700 1 -- 172.21.15.123:0/2703075772 shutdown_connections 2024-09-13T17:08:36.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec716cc700 1 --2- 172.21.15.123:0/2703075772 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec6c15ed00 0x7fec6c0cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec716cc700 1 --2- 172.21.15.123:0/2703075772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec6c15e920 0x7fec6c0caae0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.140+0000 7fec716cc700 1 -- 172.21.15.123:0/2703075772 >> 172.21.15.123:0/2703075772 conn(0x7fec6c066150 msgr2=0x7fec6c066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:36.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec716cc700 1 -- 172.21.15.123:0/2703075772 shutdown_connections 2024-09-13T17:08:36.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec716cc700 1 -- 172.21.15.123:0/2703075772 wait complete. 2024-09-13T17:08:36.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec716cc700 1 Processor -- start 2024-09-13T17:08:36.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec716cc700 1 -- start start 2024-09-13T17:08:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec716cc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec6c0cb020 0x7fec6c15db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec716cc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec6c15e920 0x7fec6c0c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec716cc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec6c15ed00 0x7fec6c15f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec716cc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0c9720 con 0x7fec6c15e920 2024-09-13T17:08:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec716cc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c15e050 con 0x7fec6c0cb020 2024-09-13T17:08:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec716cc700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0c8b10 con 0x7fec6c15ed00 2024-09-13T17:08:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec6c15e920 0x7fec6c0c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec6c15e920 0x7fec6c0c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37282/0 (socket says 172.21.15.123:37282) 2024-09-13T17:08:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec70ecb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec6c15ed00 0x7fec6c15f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec6b7fe700 1 -- 172.21.15.123:0/613253359 learned_addr learned my addr 172.21.15.123:0/613253359 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec6bfff700 1 --2- 172.21.15.123:0/613253359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec6c0cb020 0x7fec6c15db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec6b7fe700 1 -- 172.21.15.123:0/613253359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec6c15ed00 msgr2=0x7fec6c15f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec6b7fe700 1 --2- 172.21.15.123:0/613253359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec6c15ed00 0x7fec6c15f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec6b7fe700 1 -- 172.21.15.123:0/613253359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec6c0cb020 msgr2=0x7fec6c15db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec6b7fe700 1 --2- 172.21.15.123:0/613253359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec6c0cb020 0x7fec6c15db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec6b7fe700 1 -- 172.21.15.123:0/613253359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c0094b0 con 0x7fec6c15e920 2024-09-13T17:08:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec6bfff700 1 --2- 172.21.15.123:0/613253359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec6c0cb020 0x7fec6c15db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec6b7fe700 1 --2- 172.21.15.123:0/613253359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec6c15e920 0x7fec6c0c9bb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fec60005930 tx=0x7fec6000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec68ff9700 1 -- 172.21.15.123:0/613253359 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60005d90 con 0x7fec6c15e920 2024-09-13T17:08:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec68ff9700 1 -- 172.21.15.123:0/613253359 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec600070d0 con 0x7fec6c15e920 2024-09-13T17:08:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec716cc700 1 -- 172.21.15.123:0/613253359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6c0c8df0 con 0x7fec6c15e920 2024-09-13T17:08:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec68ff9700 1 -- 172.21.15.123:0/613253359 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60007480 con 0x7fec6c15e920 2024-09-13T17:08:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.144+0000 7fec716cc700 1 -- 172.21.15.123:0/613253359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c0c93b0 con 0x7fec6c15e920 2024-09-13T17:08:36.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.148+0000 7fec716cc700 1 -- 172.21.15.123:0/613253359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6c0677f0 con 0x7fec6c15e920 2024-09-13T17:08:36.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.148+0000 7fec68ff9700 1 -- 172.21.15.123:0/613253359 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fec600075e0 con 0x7fec6c15e920 2024-09-13T17:08:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.148+0000 7fec68ff9700 1 --2- 172.21.15.123:0/613253359 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec58066730 0x7fec58068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.148+0000 7fec68ff9700 1 -- 172.21.15.123:0/613253359 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fec60083660 con 0x7fec6c15e920 2024-09-13T17:08:36.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.148+0000 7fec6bfff700 1 --2- 172.21.15.123:0/613253359 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec58066730 0x7fec58068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.152+0000 7fec6bfff700 1 --2- 172.21.15.123:0/613253359 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec58066730 0x7fec58068bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0090b0 tx=0x7fec5c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:36.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.152+0000 7fec68ff9700 1 -- 172.21.15.123:0/613253359 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fec60050980 con 0x7fec6c15e920 2024-09-13T17:08:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.328+0000 7fec716cc700 1 -- 172.21.15.123:0/613253359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec6c0caae0 con 0x7fec6c15e920 2024-09-13T17:08:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.328+0000 7fec68ff9700 1 -- 172.21.15.123:0/613253359 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16652 (secure 0 0 0) 0x7fec60053fa0 con 0x7fec6c15e920 2024-09-13T17:08:36.333 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:36.334 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":48,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:32.853957+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:18.071457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:18.723653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.1b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.332+0000 7fec716cc700 1 -- 172.21.15.123:0/613253359 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec58066730 msgr2=0x7fec58068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.332+0000 7fec716cc700 1 --2- 172.21.15.123:0/613253359 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec58066730 0x7fec58068bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0090b0 tx=0x7fec5c008030 comp rx=0 tx=0).stop 2024-09-13T17:08:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.332+0000 7fec716cc700 1 -- 172.21.15.123:0/613253359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec6c15e920 msgr2=0x7fec6c0c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.332+0000 7fec716cc700 1 --2- 172.21.15.123:0/613253359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec6c15e920 0x7fec6c0c9bb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fec60005930 tx=0x7fec6000c9e0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.332+0000 7fec716cc700 1 -- 172.21.15.123:0/613253359 shutdown_connections 2024-09-13T17:08:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.332+0000 7fec716cc700 1 --2- 172.21.15.123:0/613253359 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fec58066730 0x7fec58068bf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.332+0000 7fec716cc700 1 --2- 172.21.15.123:0/613253359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec6c15ed00 0x7fec6c15f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.332+0000 7fec716cc700 1 --2- 172.21.15.123:0/613253359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec6c15e920 0x7fec6c0c9bb0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.332+0000 7fec716cc700 1 --2- 172.21.15.123:0/613253359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec6c0cb020 0x7fec6c15db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.332+0000 7fec716cc700 1 -- 172.21.15.123:0/613253359 >> 172.21.15.123:0/613253359 conn(0x7fec6c066150 msgr2=0x7fec6c071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.332+0000 7fec716cc700 1 -- 172.21.15.123:0/613253359 shutdown_connections 2024-09-13T17:08:36.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.332+0000 7fec716cc700 1 -- 172.21.15.123:0/613253359 wait complete. 2024-09-13T17:08:36.349 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:08:36.349 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:08:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f638896d700 1 Processor -- start 2024-09-13T17:08:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f638896d700 1 -- start start 2024-09-13T17:08:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f638896d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6384071580 0x7f63840705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f638896d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f638415b9b0 0x7f63840cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f638896d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63840cee80 con 0x7f638415a8c0 2024-09-13T17:08:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f638896d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63840ce270 con 0x7f6384071580 2024-09-13T17:08:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f638896d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63840ce550 con 0x7f638415b9b0 2024-09-13T17:08:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f638259c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6384071580 0x7f63840705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f6382d9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f638415a8c0 0x7f6384070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43472/0 (socket says 172.21.15.123:43472) 2024-09-13T17:08:36.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f6382d9d700 1 -- 172.21.15.123:0/1357027435 learned_addr learned my addr 172.21.15.123:0/1357027435 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:36.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f638359e700 1 --2- 172.21.15.123:0/1357027435 >> v2:172.21.15.153:3300/0 conn(0x7f638415b9b0 0x7f63840cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f638259c700 1 -- 172.21.15.123:0/1357027435 >> v2:172.21.15.153:3300/0 conn(0x7f638415b9b0 msgr2=0x7f63840cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:36.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f638259c700 1 --2- 172.21.15.123:0/1357027435 >> v2:172.21.15.153:3300/0 conn(0x7f638415b9b0 0x7f63840cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f638259c700 1 -- 172.21.15.123:0/1357027435 >> v1:172.21.15.123:6789/0 conn(0x7f638415a8c0 legacy=0x7f6384070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f638259c700 1 -- 172.21.15.123:0/1357027435 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63840ce830 con 0x7f6384071580 2024-09-13T17:08:36.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f638259c700 1 --2- 172.21.15.123:0/1357027435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6384071580 0x7f63840705b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f63840728f0 tx=0x7f637400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1cc781c46cb549 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:36.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f6381d9b700 1 -- 172.21.15.123:0/1357027435 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637400e070 con 0x7f6384071580 2024-09-13T17:08:36.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f6381d9b700 1 -- 172.21.15.123:0/1357027435 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6374003a40 con 0x7f6384071580 2024-09-13T17:08:36.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.460+0000 7f6381d9b700 1 -- 172.21.15.123:0/1357027435 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374003df0 con 0x7f6384071580 2024-09-13T17:08:36.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.464+0000 7f638896d700 1 -- 172.21.15.123:0/1357027435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6384071580 msgr2=0x7f63840705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.464+0000 7f638896d700 1 --2- 172.21.15.123:0/1357027435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6384071580 0x7f63840705b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f63840728f0 tx=0x7f637400b330 comp rx=0 tx=0).stop 2024-09-13T17:08:36.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.464+0000 7f638896d700 1 -- 172.21.15.123:0/1357027435 shutdown_connections 2024-09-13T17:08:36.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.464+0000 7f638896d700 1 --2- 172.21.15.123:0/1357027435 >> v2:172.21.15.153:3300/0 conn(0x7f638415b9b0 0x7f63840cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.464+0000 7f638896d700 1 --2- 172.21.15.123:0/1357027435 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6384071580 0x7f63840705b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.464+0000 7f638896d700 1 -- 172.21.15.123:0/1357027435 >> 172.21.15.123:0/1357027435 conn(0x7f6384066150 msgr2=0x7f6384066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:36.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.464+0000 7f638896d700 1 -- 172.21.15.123:0/1357027435 shutdown_connections 2024-09-13T17:08:36.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.464+0000 7f638896d700 1 -- 172.21.15.123:0/1357027435 wait complete. 2024-09-13T17:08:36.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.464+0000 7f638896d700 1 Processor -- start 2024-09-13T17:08:36.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.464+0000 7f638896d700 1 -- start start 2024-09-13T17:08:36.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.464+0000 7f638896d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6384071580 0x7f6384155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.464+0000 7f638896d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f638415a8c0 0x7f638406c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.464+0000 7f638896d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f638415b9b0 0x7f638406ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638896d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63841e61a0 con 0x7f638415a8c0 2024-09-13T17:08:36.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638896d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63841e4b90 con 0x7f6384071580 2024-09-13T17:08:36.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638896d700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63840b16d0 con 0x7f638415b9b0 2024-09-13T17:08:36.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f638415a8c0 0x7f638406c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f638415a8c0 0x7f638406c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37294/0 (socket says 172.21.15.123:37294) 2024-09-13T17:08:36.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638259c700 1 -- 172.21.15.123:0/3591022157 learned_addr learned my addr 172.21.15.123:0/3591022157 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:36.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638359e700 1 --2- 172.21.15.123:0/3591022157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f638415b9b0 0x7f638406ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f6382d9d700 1 --2- 172.21.15.123:0/3591022157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6384071580 0x7f6384155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638259c700 1 -- 172.21.15.123:0/3591022157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f638415b9b0 msgr2=0x7f638406ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638259c700 1 --2- 172.21.15.123:0/3591022157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f638415b9b0 0x7f638406ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638259c700 1 -- 172.21.15.123:0/3591022157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6384071580 msgr2=0x7f6384155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638259c700 1 --2- 172.21.15.123:0/3591022157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6384071580 0x7f6384155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638259c700 1 -- 172.21.15.123:0/3591022157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6374009a70 con 0x7f638415a8c0 2024-09-13T17:08:36.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638259c700 1 --2- 172.21.15.123:0/3591022157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f638415a8c0 0x7f638406c520 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6374000f80 tx=0x7f6374004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:36.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f636b7fe700 1 -- 172.21.15.123:0/3591022157 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374004640 con 0x7f638415a8c0 2024-09-13T17:08:36.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f636b7fe700 1 -- 172.21.15.123:0/3591022157 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63740047a0 con 0x7f638415a8c0 2024-09-13T17:08:36.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638896d700 1 -- 172.21.15.123:0/3591022157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6384155e50 con 0x7f638415a8c0 2024-09-13T17:08:36.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f636b7fe700 1 -- 172.21.15.123:0/3591022157 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374012670 con 0x7f638415a8c0 2024-09-13T17:08:36.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.468+0000 7f638896d700 1 -- 172.21.15.123:0/3591022157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63841e5080 con 0x7f638415a8c0 2024-09-13T17:08:36.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.472+0000 7f638896d700 1 -- 172.21.15.123:0/3591022157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63840677f0 con 0x7f638415a8c0 2024-09-13T17:08:36.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.472+0000 7f636b7fe700 1 -- 172.21.15.123:0/3591022157 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f63740127d0 con 0x7f638415a8c0 2024-09-13T17:08:36.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.472+0000 7f636b7fe700 1 --2- 172.21.15.123:0/3591022157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6370066730 0x7f6370068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.472+0000 7f636b7fe700 1 -- 172.21.15.123:0/3591022157 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f63740862b0 con 0x7f638415a8c0 2024-09-13T17:08:36.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.472+0000 7f6382d9d700 1 --2- 172.21.15.123:0/3591022157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6370066730 0x7f6370068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.472+0000 7f6382d9d700 1 --2- 172.21.15.123:0/3591022157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6370066730 0x7f6370068bf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6378000f60 tx=0x7f6378004a70 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:36.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.476+0000 7f636b7fe700 1 -- 172.21.15.123:0/3591022157 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f63740535d0 con 0x7f638415a8c0 2024-09-13T17:08:36.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.679+0000 7f638896d700 1 -- 172.21.15.123:0/3591022157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63840705b0 con 0x7f638415a8c0 2024-09-13T17:08:36.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.679+0000 7f636b7fe700 1 -- 172.21.15.123:0/3591022157 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f6374056bf0 con 0x7f638415a8c0 2024-09-13T17:08:36.683 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:36.683 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5602,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3264962321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3264962321},{"type":"v1","addr":"172.21.15.153:6833","nonce":3264962321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5605,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1200497874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1200497874},{"type":"v1","addr":"172.21.15.153:6835","nonce":1200497874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/398437513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":398437513},{"type":"v1","addr":"172.21.15.123:6835","nonce":398437513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:08:19.726019+0000","modified":"2024-09-13T17:08:22.746133+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5730},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5730":{"gid":5730,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2449786141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2449786141},{"type":"v1","addr":"172.21.15.123:6837","nonce":2449786141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:08:36.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.679+0000 7f638896d700 1 -- 172.21.15.123:0/3591022157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6370066730 msgr2=0x7f6370068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.679+0000 7f638896d700 1 --2- 172.21.15.123:0/3591022157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6370066730 0x7f6370068bf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6378000f60 tx=0x7f6378004a70 comp rx=0 tx=0).stop 2024-09-13T17:08:36.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.679+0000 7f638896d700 1 -- 172.21.15.123:0/3591022157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f638415a8c0 msgr2=0x7f638406c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.679+0000 7f638896d700 1 --2- 172.21.15.123:0/3591022157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f638415a8c0 0x7f638406c520 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6374000f80 tx=0x7f6374004af0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.679+0000 7f638896d700 1 -- 172.21.15.123:0/3591022157 shutdown_connections 2024-09-13T17:08:36.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.679+0000 7f638896d700 1 --2- 172.21.15.123:0/3591022157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6370066730 0x7f6370068bf0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.679+0000 7f638896d700 1 --2- 172.21.15.123:0/3591022157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f638415b9b0 0x7f638406ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.679+0000 7f638896d700 1 --2- 172.21.15.123:0/3591022157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f638415a8c0 0x7f638406c520 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.679+0000 7f638896d700 1 --2- 172.21.15.123:0/3591022157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6384071580 0x7f6384155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.679+0000 7f638896d700 1 -- 172.21.15.123:0/3591022157 >> 172.21.15.123:0/3591022157 conn(0x7f6384066150 msgr2=0x7f6384159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:36.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.679+0000 7f638896d700 1 -- 172.21.15.123:0/3591022157 shutdown_connections 2024-09-13T17:08:36.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.679+0000 7f638896d700 1 -- 172.21.15.123:0/3591022157 wait complete. 2024-09-13T17:08:36.687 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 21 2024-09-13T17:08:36.698 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:08:36.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.811+0000 7f2ccf59e700 1 Processor -- start 2024-09-13T17:08:36.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.811+0000 7f2ccf59e700 1 -- start start 2024-09-13T17:08:36.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.811+0000 7f2ccf59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2cd013f680 0x7f2cd015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.811+0000 7f2ccf59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2cd00ccd30 0x7f2cd015d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.811+0000 7f2ccf59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd00cf5c0 con 0x7f2cd00ce2a0 2024-09-13T17:08:36.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.811+0000 7f2ccf59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd00cd200 con 0x7f2cd00ccd30 2024-09-13T17:08:36.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.811+0000 7f2ccf59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00cd4e0 con 0x7f2cd013f680 2024-09-13T17:08:36.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.811+0000 7f2cced9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2cd00ccd30 0x7f2cd015d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.811+0000 7f2cced9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2cd00ccd30 0x7f2cd015d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37306/0 (socket says 172.21.15.123:37306) 2024-09-13T17:08:36.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.811+0000 7f2cced9d700 1 -- 172.21.15.123:0/39119606 learned_addr learned my addr 172.21.15.123:0/39119606 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:36.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.811+0000 7f2cce59c700 1 --2- 172.21.15.123:0/39119606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2cd013f680 0x7f2cd015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2cce59c700 1 -- 172.21.15.123:0/39119606 >> v2:172.21.15.123:3300/0 conn(0x7f2cd00ccd30 msgr2=0x7f2cd015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:36.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2cce59c700 1 --2- 172.21.15.123:0/39119606 >> v2:172.21.15.123:3300/0 conn(0x7f2cd00ccd30 0x7f2cd015d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2cce59c700 1 -- 172.21.15.123:0/39119606 >> v1:172.21.15.153:6789/0 conn(0x7f2cd00ce2a0 legacy=0x7f2cd00cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2cce59c700 1 -- 172.21.15.123:0/39119606 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd00cd7c0 con 0x7f2cd013f680 2024-09-13T17:08:36.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2cce59c700 1 --2- 172.21.15.123:0/39119606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2cd013f680 0x7f2cd015cb70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009850 tx=0x7f2cc0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d2dc6da9bfe4e5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:36.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2ccdd9b700 1 -- 172.21.15.123:0/39119606 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0011830 con 0x7f2cd013f680 2024-09-13T17:08:36.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2ccdd9b700 1 -- 172.21.15.123:0/39119606 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc0011990 con 0x7f2cd013f680 2024-09-13T17:08:36.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2ccdd9b700 1 -- 172.21.15.123:0/39119606 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0011d40 con 0x7f2cd013f680 2024-09-13T17:08:36.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2ccf59e700 1 -- 172.21.15.123:0/39119606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2cd013f680 msgr2=0x7f2cd015cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2ccf59e700 1 --2- 172.21.15.123:0/39119606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2cd013f680 0x7f2cd015cb70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009850 tx=0x7f2cc0009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:36.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2ccf59e700 1 -- 172.21.15.123:0/39119606 shutdown_connections 2024-09-13T17:08:36.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2ccf59e700 1 --2- 172.21.15.123:0/39119606 >> v2:172.21.15.123:3300/0 conn(0x7f2cd00ccd30 0x7f2cd015d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2ccf59e700 1 --2- 172.21.15.123:0/39119606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2cd013f680 0x7f2cd015cb70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2ccf59e700 1 -- 172.21.15.123:0/39119606 >> 172.21.15.123:0/39119606 conn(0x7f2cd0066150 msgr2=0x7f2cd0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:36.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2ccf59e700 1 -- 172.21.15.123:0/39119606 shutdown_connections 2024-09-13T17:08:36.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.815+0000 7f2ccf59e700 1 -- 172.21.15.123:0/39119606 wait complete. 2024-09-13T17:08:36.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2ccf59e700 1 Processor -- start 2024-09-13T17:08:36.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2ccf59e700 1 -- start start 2024-09-13T17:08:36.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2ccf59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2cd00ccd30 0x7f2cd0137000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2ccf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cd00ce2a0 0x7f2cd01528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2ccf59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cd013f680 0x7f2cd013e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2ccf59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd0152e20 con 0x7f2cd013f680 2024-09-13T17:08:36.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2ccf59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd013d270 con 0x7f2cd00ce2a0 2024-09-13T17:08:36.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2ccf59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd013d550 con 0x7f2cd00ccd30 2024-09-13T17:08:36.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2cced9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cd013f680 0x7f2cd013e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2cced9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cd013f680 0x7f2cd013e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37314/0 (socket says 172.21.15.123:37314) 2024-09-13T17:08:36.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2cced9d700 1 -- 172.21.15.123:0/4117366633 learned_addr learned my addr 172.21.15.123:0/4117366633 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:36.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2cce59c700 1 --2- 172.21.15.123:0/4117366633 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2cd00ccd30 0x7f2cd0137000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2cc5d9b700 1 --2- 172.21.15.123:0/4117366633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cd00ce2a0 0x7f2cd01528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2cced9d700 1 -- 172.21.15.123:0/4117366633 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2cd00ccd30 msgr2=0x7f2cd0137000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2cced9d700 1 --2- 172.21.15.123:0/4117366633 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2cd00ccd30 0x7f2cd0137000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2cced9d700 1 -- 172.21.15.123:0/4117366633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cd00ce2a0 msgr2=0x7f2cd01528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:36.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2cced9d700 1 --2- 172.21.15.123:0/4117366633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cd00ce2a0 0x7f2cd01528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:36.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.819+0000 7f2cced9d700 1 -- 172.21.15.123:0/4117366633 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc00094b0 con 0x7f2cd013f680 2024-09-13T17:08:36.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.823+0000 7f2cced9d700 1 --2- 172.21.15.123:0/4117366633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cd013f680 0x7f2cd013e310 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800efc0 tx=0x7f2cc800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:36.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.823+0000 7f2cc77fe700 1 -- 172.21.15.123:0/4117366633 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8003c40 con 0x7f2cd013f680 2024-09-13T17:08:36.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.823+0000 7f2cc77fe700 1 -- 172.21.15.123:0/4117366633 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc800f040 con 0x7f2cd013f680 2024-09-13T17:08:36.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.823+0000 7f2ccf59e700 1 -- 172.21.15.123:0/4117366633 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd013d830 con 0x7f2cd013f680 2024-09-13T17:08:36.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.823+0000 7f2cc77fe700 1 -- 172.21.15.123:0/4117366633 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8009e60 con 0x7f2cd013f680 2024-09-13T17:08:36.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.823+0000 7f2ccf59e700 1 -- 172.21.15.123:0/4117366633 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd013ddf0 con 0x7f2cd013f680 2024-09-13T17:08:36.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.823+0000 7f2ccf59e700 1 -- 172.21.15.123:0/4117366633 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd00677f0 con 0x7f2cd013f680 2024-09-13T17:08:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.823+0000 7f2cc77fe700 1 -- 172.21.15.123:0/4117366633 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2cc800c880 con 0x7f2cd013f680 2024-09-13T17:08:36.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.827+0000 7f2cc77fe700 1 --2- 172.21.15.123:0/4117366633 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2cb0066760 0x7f2cb0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:36.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.827+0000 7f2cce59c700 1 --2- 172.21.15.123:0/4117366633 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2cb0066760 0x7f2cb0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:36.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.827+0000 7f2cc77fe700 1 -- 172.21.15.123:0/4117366633 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2cc8084440 con 0x7f2cd013f680 2024-09-13T17:08:36.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.827+0000 7f2cce59c700 1 --2- 172.21.15.123:0/4117366633 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2cb0066760 0x7f2cb0068c20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0000c00 tx=0x7f2cc001c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:36.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:36.831+0000 7f2cc77fe700 1 -- 172.21.15.123:0/4117366633 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2cc8051760 con 0x7f2cd013f680 2024-09-13T17:08:37.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.039+0000 7f2ccf59e700 1 -- 172.21.15.123:0/4117366633 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2cd0072790 con 0x7f2cd013f680 2024-09-13T17:08:37.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.043+0000 7f2cc77fe700 1 -- 172.21.15.123:0/4117366633 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f2cc805b020 con 0x7f2cd013f680 2024-09-13T17:08:37.047 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:37.047 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5602,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3264962321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3264962321},{"type":"v1","addr":"172.21.15.153:6833","nonce":3264962321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5605,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1200497874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1200497874},{"type":"v1","addr":"172.21.15.153:6835","nonce":1200497874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/398437513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":398437513},{"type":"v1","addr":"172.21.15.123:6835","nonce":398437513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:08:19.726019+0000","modified":"2024-09-13T17:08:22.746133+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5730},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5730":{"gid":5730,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2449786141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2449786141},{"type":"v1","addr":"172.21.15.123:6837","nonce":2449786141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:08:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.043+0000 7f2ccf59e700 1 -- 172.21.15.123:0/4117366633 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2cb0066760 msgr2=0x7f2cb0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.043+0000 7f2ccf59e700 1 --2- 172.21.15.123:0/4117366633 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2cb0066760 0x7f2cb0068c20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0000c00 tx=0x7f2cc001c040 comp rx=0 tx=0).stop 2024-09-13T17:08:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.043+0000 7f2ccf59e700 1 -- 172.21.15.123:0/4117366633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cd013f680 msgr2=0x7f2cd013e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.043+0000 7f2ccf59e700 1 --2- 172.21.15.123:0/4117366633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cd013f680 0x7f2cd013e310 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800efc0 tx=0x7f2cc800c3a0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.043+0000 7f2ccf59e700 1 -- 172.21.15.123:0/4117366633 shutdown_connections 2024-09-13T17:08:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.043+0000 7f2ccf59e700 1 --2- 172.21.15.123:0/4117366633 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2cb0066760 0x7f2cb0068c20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.043+0000 7f2ccf59e700 1 --2- 172.21.15.123:0/4117366633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cd013f680 0x7f2cd013e310 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.043+0000 7f2ccf59e700 1 --2- 172.21.15.123:0/4117366633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cd00ce2a0 0x7f2cd01528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.043+0000 7f2ccf59e700 1 --2- 172.21.15.123:0/4117366633 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2cd00ccd30 0x7f2cd0137000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.043+0000 7f2ccf59e700 1 -- 172.21.15.123:0/4117366633 >> 172.21.15.123:0/4117366633 conn(0x7f2cd0066150 msgr2=0x7f2cd0071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.043+0000 7f2ccf59e700 1 -- 172.21.15.123:0/4117366633 shutdown_connections 2024-09-13T17:08:37.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.043+0000 7f2ccf59e700 1 -- 172.21.15.123:0/4117366633 wait complete. 2024-09-13T17:08:37.050 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 21 2024-09-13T17:08:37.062 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:37.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.167+0000 7f9e3dd96700 1 Processor -- start 2024-09-13T17:08:37.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.167+0000 7f9e3dd96700 1 -- start start 2024-09-13T17:08:37.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.167+0000 7f9e3dd96700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9e38071580 0x7f9e380705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.167+0000 7f9e3dd96700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e3815b9b0 0x7f9e380cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.167+0000 7f9e3dd96700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e380cee80 con 0x7f9e3815a8c0 2024-09-13T17:08:37.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.167+0000 7f9e3dd96700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3815be60 con 0x7f9e38071580 2024-09-13T17:08:37.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.167+0000 7f9e3dd96700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380ce270 con 0x7f9e3815b9b0 2024-09-13T17:08:37.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e3cd94700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9e3815a8c0 0x7f9e38070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43486/0 (socket says 172.21.15.123:43486) 2024-09-13T17:08:37.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e3d595700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e3815b9b0 0x7f9e380cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e37fff700 1 --2- 172.21.15.123:0/2015161409 >> v2:172.21.15.153:3300/0 conn(0x7f9e38071580 0x7f9e380705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e3cd94700 1 -- 172.21.15.123:0/2015161409 learned_addr learned my addr 172.21.15.123:0/2015161409 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:37.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e37fff700 1 -- 172.21.15.123:0/2015161409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e3815b9b0 msgr2=0x7f9e380cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:37.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e37fff700 1 --2- 172.21.15.123:0/2015161409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e3815b9b0 0x7f9e380cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e37fff700 1 -- 172.21.15.123:0/2015161409 >> v1:172.21.15.123:6789/0 conn(0x7f9e3815a8c0 legacy=0x7f9e38070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e377fe700 1 -- 172.21.15.123:0/2015161409 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653235972 0 0) 0x7f9e380cee80 con 0x7f9e3815a8c0 2024-09-13T17:08:37.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e37fff700 1 -- 172.21.15.123:0/2015161409 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e380ce550 con 0x7f9e38071580 2024-09-13T17:08:37.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e3d595700 1 --2- 172.21.15.123:0/2015161409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e3815b9b0 0x7f9e380cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e37fff700 1 --2- 172.21.15.123:0/2015161409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e38071580 0x7f9e380705b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009d90 tx=0x7f9e2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3324d4a6a1af092 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e377fe700 1 -- 172.21.15.123:0/2015161409 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800e070 con 0x7f9e38071580 2024-09-13T17:08:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e377fe700 1 -- 172.21.15.123:0/2015161409 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2800bb20 con 0x7f9e38071580 2024-09-13T17:08:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e377fe700 1 -- 172.21.15.123:0/2015161409 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e28012430 con 0x7f9e38071580 2024-09-13T17:08:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2015161409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e38071580 msgr2=0x7f9e380705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e3dd96700 1 --2- 172.21.15.123:0/2015161409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e38071580 0x7f9e380705b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009d90 tx=0x7f9e2800b330 comp rx=0 tx=0).stop 2024-09-13T17:08:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2015161409 shutdown_connections 2024-09-13T17:08:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e3dd96700 1 --2- 172.21.15.123:0/2015161409 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e3815b9b0 0x7f9e380cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e3dd96700 1 --2- 172.21.15.123:0/2015161409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e38071580 0x7f9e380705b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2015161409 >> 172.21.15.123:0/2015161409 conn(0x7f9e38066150 msgr2=0x7f9e38066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:37.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2015161409 shutdown_connections 2024-09-13T17:08:37.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2015161409 wait complete. 2024-09-13T17:08:37.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e3dd96700 1 Processor -- start 2024-09-13T17:08:37.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.171+0000 7f9e3dd96700 1 -- start start 2024-09-13T17:08:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e3dd96700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e3815a8c0 0x7f9e38143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e3dd96700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e3815b9b0 0x7f9e38154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e3dd96700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e380ac8b0 0x7f9e380acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e3dd96700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380ad280 con 0x7f9e380ac8b0 2024-09-13T17:08:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e3dd96700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e381528f0 con 0x7f9e3815a8c0 2024-09-13T17:08:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e3dd96700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38154660 con 0x7f9e3815b9b0 2024-09-13T17:08:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e3d595700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e380ac8b0 0x7f9e380acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e3d595700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e380ac8b0 0x7f9e380acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37328/0 (socket says 172.21.15.123:37328) 2024-09-13T17:08:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e37fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e3815b9b0 0x7f9e38154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e3d595700 1 -- 172.21.15.123:0/2981485342 learned_addr learned my addr 172.21.15.123:0/2981485342 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e3cd94700 1 --2- 172.21.15.123:0/2981485342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e3815a8c0 0x7f9e38143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e37fff700 1 -- 172.21.15.123:0/2981485342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e3815a8c0 msgr2=0x7f9e38143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e37fff700 1 --2- 172.21.15.123:0/2981485342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e3815a8c0 0x7f9e38143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e37fff700 1 -- 172.21.15.123:0/2981485342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e380ac8b0 msgr2=0x7f9e380acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e37fff700 1 --2- 172.21.15.123:0/2981485342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e380ac8b0 0x7f9e380acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e37fff700 1 -- 172.21.15.123:0/2981485342 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e300094b0 con 0x7f9e3815b9b0 2024-09-13T17:08:37.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e37fff700 1 --2- 172.21.15.123:0/2981485342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e3815b9b0 0x7f9e38154af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e380b39f0 tx=0x7f9e28004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:37.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e357fa700 1 -- 172.21.15.123:0/2981485342 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e28012430 con 0x7f9e3815b9b0 2024-09-13T17:08:37.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e357fa700 1 -- 172.21.15.123:0/2981485342 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e28020070 con 0x7f9e3815b9b0 2024-09-13T17:08:37.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e357fa700 1 -- 172.21.15.123:0/2981485342 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e28007000 con 0x7f9e3815b9b0 2024-09-13T17:08:37.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2981485342 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e28009a70 con 0x7f9e3815b9b0 2024-09-13T17:08:37.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.175+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2981485342 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e38154010 con 0x7f9e3815b9b0 2024-09-13T17:08:37.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.179+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2981485342 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e380677f0 con 0x7f9e3815b9b0 2024-09-13T17:08:37.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.179+0000 7f9e357fa700 1 -- 172.21.15.123:0/2981485342 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9e28004280 con 0x7f9e3815b9b0 2024-09-13T17:08:37.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.179+0000 7f9e357fa700 1 --2- 172.21.15.123:0/2981485342 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e24066730 0x7f9e24068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.179+0000 7f9e3cd94700 1 --2- 172.21.15.123:0/2981485342 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e24066730 0x7f9e24068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.179+0000 7f9e357fa700 1 -- 172.21.15.123:0/2981485342 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9e28022070 con 0x7f9e3815b9b0 2024-09-13T17:08:37.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.179+0000 7f9e3cd94700 1 --2- 172.21.15.123:0/2981485342 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e24066730 0x7f9e24068bf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c007b30 tx=0x7f9e2c007a80 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:37.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.187+0000 7f9e357fa700 1 -- 172.21.15.123:0/2981485342 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9e28053240 con 0x7f9e3815b9b0 2024-09-13T17:08:37.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.359+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2981485342 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e38072560 con 0x7f9e3815b9b0 2024-09-13T17:08:37.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.363+0000 7f9e357fa700 1 -- 172.21.15.123:0/2981485342 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16652 (secure 0 0 0) 0x7f9e28056860 con 0x7f9e3815b9b0 2024-09-13T17:08:37.369 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:37.369 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":48,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:32.853957+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:18.071457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:18.723653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.1b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:37.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.367+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2981485342 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e24066730 msgr2=0x7f9e24068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.367+0000 7f9e3dd96700 1 --2- 172.21.15.123:0/2981485342 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e24066730 0x7f9e24068bf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c007b30 tx=0x7f9e2c007a80 comp rx=0 tx=0).stop 2024-09-13T17:08:37.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.367+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2981485342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e3815b9b0 msgr2=0x7f9e38154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.367+0000 7f9e3dd96700 1 --2- 172.21.15.123:0/2981485342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e3815b9b0 0x7f9e38154af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e380b39f0 tx=0x7f9e28004af0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.367+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2981485342 shutdown_connections 2024-09-13T17:08:37.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.367+0000 7f9e3dd96700 1 --2- 172.21.15.123:0/2981485342 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e24066730 0x7f9e24068bf0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.367+0000 7f9e3dd96700 1 --2- 172.21.15.123:0/2981485342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e380ac8b0 0x7f9e380acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.367+0000 7f9e3dd96700 1 --2- 172.21.15.123:0/2981485342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e3815b9b0 0x7f9e38154af0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.367+0000 7f9e3dd96700 1 --2- 172.21.15.123:0/2981485342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e3815a8c0 0x7f9e38143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.367+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2981485342 >> 172.21.15.123:0/2981485342 conn(0x7f9e38066150 msgr2=0x7f9e380ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:37.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.367+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2981485342 shutdown_connections 2024-09-13T17:08:37.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.367+0000 7f9e3dd96700 1 -- 172.21.15.123:0/2981485342 wait complete. 2024-09-13T17:08:37.389 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:08:37.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 Processor -- start 2024-09-13T17:08:37.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 -- start start 2024-09-13T17:08:37.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d9815cd60 0x7f6d980d10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6d980d3600 0x7f6d980cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d980d1750 con 0x7f6d980cf9a0 2024-09-13T17:08:37.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d980cfe30 con 0x7f6d980d3600 2024-09-13T17:08:37.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d980d1a30 con 0x7f6d9815cd60 2024-09-13T17:08:37.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9ea02700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6d980cf9a0 0x7f6d980cd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43500/0 (socket says 172.21.15.123:43500) 2024-09-13T17:08:37.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9ea02700 1 -- 172.21.15.123:0/456612792 learned_addr learned my addr 172.21.15.123:0/456612792 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:37.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9e201700 1 --2- 172.21.15.123:0/456612792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d9815cd60 0x7f6d980d10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9da00700 1 --2- 172.21.15.123:0/456612792 >> v2:172.21.15.153:3300/0 conn(0x7f6d980d3600 0x7f6d980cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9d1ff700 1 -- 172.21.15.123:0/456612792 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505921265 0 0) 0x7f6d980d1750 con 0x7f6d980cf9a0 2024-09-13T17:08:37.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9d1ff700 1 -- 172.21.15.123:0/456612792 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d840035d0 con 0x7f6d980cf9a0 2024-09-13T17:08:37.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9e201700 1 -- 172.21.15.123:0/456612792 >> v2:172.21.15.153:3300/0 conn(0x7f6d980d3600 msgr2=0x7f6d980cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:37.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9e201700 1 --2- 172.21.15.123:0/456612792 >> v2:172.21.15.153:3300/0 conn(0x7f6d980d3600 0x7f6d980cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9e201700 1 -- 172.21.15.123:0/456612792 >> v1:172.21.15.123:6789/0 conn(0x7f6d980cf9a0 legacy=0x7f6d980cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9d1ff700 1 -- 172.21.15.123:0/456612792 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3683235803 0 0) 0x7f6d840035d0 con 0x7f6d980cf9a0 2024-09-13T17:08:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9e201700 1 -- 172.21.15.123:0/456612792 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d980b5930 con 0x7f6d9815cd60 2024-09-13T17:08:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9e201700 1 --2- 172.21.15.123:0/456612792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d9815cd60 0x7f6d980d10c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009850 tx=0x7f6d94009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=340f50d162c949c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9d1ff700 1 -- 172.21.15.123:0/456612792 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d900019f0 con 0x7f6d9815cd60 2024-09-13T17:08:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9d1ff700 1 -- 172.21.15.123:0/456612792 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d94004030 con 0x7f6d9815cd60 2024-09-13T17:08:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9d1ff700 1 -- 172.21.15.123:0/456612792 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d940043a0 con 0x7f6d9815cd60 2024-09-13T17:08:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 -- 172.21.15.123:0/456612792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d9815cd60 msgr2=0x7f6d980d10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 --2- 172.21.15.123:0/456612792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d9815cd60 0x7f6d980d10c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009850 tx=0x7f6d94009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 -- 172.21.15.123:0/456612792 shutdown_connections 2024-09-13T17:08:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 --2- 172.21.15.123:0/456612792 >> v2:172.21.15.153:3300/0 conn(0x7f6d980d3600 0x7f6d980cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 --2- 172.21.15.123:0/456612792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d9815cd60 0x7f6d980d10c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 -- 172.21.15.123:0/456612792 >> 172.21.15.123:0/456612792 conn(0x7f6d980d2ae0 msgr2=0x7f6d980d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 -- 172.21.15.123:0/456612792 shutdown_connections 2024-09-13T17:08:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.499+0000 7f6d9f203700 1 -- 172.21.15.123:0/456612792 wait complete. 2024-09-13T17:08:37.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9f203700 1 Processor -- start 2024-09-13T17:08:37.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9f203700 1 -- start start 2024-09-13T17:08:37.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9f203700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d980cf9a0 0x7f6d9809c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9f203700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d980d3600 0x7f6d9815a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9f203700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d9815cd60 0x7f6d9809e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9f203700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9815b680 con 0x7f6d980d3600 2024-09-13T17:08:37.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9f203700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9809cf90 con 0x7f6d980cf9a0 2024-09-13T17:08:37.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9f203700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9809d270 con 0x7f6d9815cd60 2024-09-13T17:08:37.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9da00700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d980d3600 0x7f6d9815a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9da00700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d980d3600 0x7f6d9815a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37342/0 (socket says 172.21.15.123:37342) 2024-09-13T17:08:37.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9da00700 1 -- 172.21.15.123:0/132990172 learned_addr learned my addr 172.21.15.123:0/132990172 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:37.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9e201700 1 --2- 172.21.15.123:0/132990172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d980cf9a0 0x7f6d9809c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9ea02700 1 --2- 172.21.15.123:0/132990172 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d9815cd60 0x7f6d9809e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9da00700 1 -- 172.21.15.123:0/132990172 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d9815cd60 msgr2=0x7f6d9809e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9da00700 1 --2- 172.21.15.123:0/132990172 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d9815cd60 0x7f6d9809e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9da00700 1 -- 172.21.15.123:0/132990172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d980cf9a0 msgr2=0x7f6d9809c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9da00700 1 --2- 172.21.15.123:0/132990172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d980cf9a0 0x7f6d9809c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9da00700 1 -- 172.21.15.123:0/132990172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d940094b0 con 0x7f6d980d3600 2024-09-13T17:08:37.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9da00700 1 --2- 172.21.15.123:0/132990172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d980d3600 0x7f6d9815a640 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800e9a0 tx=0x7f6d8800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:37.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d8effd700 1 -- 172.21.15.123:0/132990172 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88009720 con 0x7f6d980d3600 2024-09-13T17:08:37.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d8effd700 1 -- 172.21.15.123:0/132990172 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8800c690 con 0x7f6d980d3600 2024-09-13T17:08:37.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9f203700 1 -- 172.21.15.123:0/132990172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9809d550 con 0x7f6d980d3600 2024-09-13T17:08:37.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d8effd700 1 -- 172.21.15.123:0/132990172 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8800ca20 con 0x7f6d980d3600 2024-09-13T17:08:37.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.503+0000 7f6d9f203700 1 -- 172.21.15.123:0/132990172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9809db10 con 0x7f6d980d3600 2024-09-13T17:08:37.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.507+0000 7f6d9f203700 1 -- 172.21.15.123:0/132990172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9809dcd0 con 0x7f6d980d3600 2024-09-13T17:08:37.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.507+0000 7f6d8effd700 1 -- 172.21.15.123:0/132990172 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d8800cbe0 con 0x7f6d980d3600 2024-09-13T17:08:37.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.507+0000 7f6d8effd700 1 --2- 172.21.15.123:0/132990172 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6d7c066730 0x7f6d7c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.507+0000 7f6d9e201700 1 --2- 172.21.15.123:0/132990172 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6d7c066730 0x7f6d7c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.507+0000 7f6d8effd700 1 -- 172.21.15.123:0/132990172 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6d88084120 con 0x7f6d980d3600 2024-09-13T17:08:37.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.507+0000 7f6d9e201700 1 --2- 172.21.15.123:0/132990172 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6d7c066730 0x7f6d7c068bf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6d940090b0 tx=0x7f6d94008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:37.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.515+0000 7f6d8effd700 1 -- 172.21.15.123:0/132990172 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6d88051450 con 0x7f6d980d3600 2024-09-13T17:08:37.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.715+0000 7f6d9f203700 1 -- 172.21.15.123:0/132990172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6d980cf460 con 0x7f6d980d3600 2024-09-13T17:08:37.723 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-13T17:08:37.719+0000 7f1c63ac9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:08:37.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.731+0000 7f6d8effd700 1 -- 172.21.15.123:0/132990172 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6d88059e60 con 0x7f6d980d3600 2024-09-13T17:08:37.738 INFO:tasks.ceph.mds.c.smithi123.stderr: -1413> 2024-09-13T17:08:25.660+0000 7f01e9e70700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:08:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.735+0000 7f6d9f203700 1 -- 172.21.15.123:0/132990172 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6d7c066730 msgr2=0x7f6d7c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.735+0000 7f6d9f203700 1 --2- 172.21.15.123:0/132990172 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6d7c066730 0x7f6d7c068bf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6d940090b0 tx=0x7f6d94008030 comp rx=0 tx=0).stop 2024-09-13T17:08:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.735+0000 7f6d9f203700 1 -- 172.21.15.123:0/132990172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d980d3600 msgr2=0x7f6d9815a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.735+0000 7f6d9f203700 1 --2- 172.21.15.123:0/132990172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d980d3600 0x7f6d9815a640 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800e9a0 tx=0x7f6d8800ecb0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.735+0000 7f6d9f203700 1 -- 172.21.15.123:0/132990172 shutdown_connections 2024-09-13T17:08:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.735+0000 7f6d9f203700 1 --2- 172.21.15.123:0/132990172 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6d7c066730 0x7f6d7c068bf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.735+0000 7f6d9f203700 1 --2- 172.21.15.123:0/132990172 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d9815cd60 0x7f6d9809e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.735+0000 7f6d9f203700 1 --2- 172.21.15.123:0/132990172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d980d3600 0x7f6d9815a640 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.735+0000 7f6d9f203700 1 --2- 172.21.15.123:0/132990172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d980cf9a0 0x7f6d9809c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.735+0000 7f6d9f203700 1 -- 172.21.15.123:0/132990172 >> 172.21.15.123:0/132990172 conn(0x7f6d980d2ae0 msgr2=0x7f6d980b66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.735+0000 7f6d9f203700 1 -- 172.21.15.123:0/132990172 shutdown_connections 2024-09-13T17:08:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.735+0000 7f6d9f203700 1 -- 172.21.15.123:0/132990172 wait complete. 2024-09-13T17:08:37.741 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:08:37.752 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:08:37.769 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-13T17:08:37.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.859+0000 7f45ae54d700 1 Processor -- start 2024-09-13T17:08:37.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.859+0000 7f45ae54d700 1 -- start start 2024-09-13T17:08:37.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.859+0000 7f45ae54d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f45a80c98c0 0x7f45a80cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.859+0000 7f45ae54d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45a8160890 0x7f45a80b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.859+0000 7f45ae54d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a80ceec0 con 0x7f45a81604b0 2024-09-13T17:08:37.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.859+0000 7f45ae54d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a80ce430 con 0x7f45a80c98c0 2024-09-13T17:08:37.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.859+0000 7f45ae54d700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80d1ec0 con 0x7f45a8160890 2024-09-13T17:08:37.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.859+0000 7f45a7fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f45a81604b0 0x7f45a80cf2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43516/0 (socket says 172.21.15.123:43516) 2024-09-13T17:08:37.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.859+0000 7f45a7fff700 1 -- 172.21.15.123:0/1631370312 learned_addr learned my addr 172.21.15.123:0/1631370312 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:37.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.859+0000 7f45a77fe700 1 --2- 172.21.15.123:0/1631370312 >> v2:172.21.15.153:3300/0 conn(0x7f45a80c98c0 0x7f45a80cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.859+0000 7f45a6ffd700 1 -- 172.21.15.123:0/1631370312 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799241780 0 0) 0x7f45a80ceec0 con 0x7f45a81604b0 2024-09-13T17:08:37.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.859+0000 7f45acaea700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45a8160890 0x7f45a80b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.859+0000 7f45a6ffd700 1 -- 172.21.15.123:0/1631370312 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45940035d0 con 0x7f45a81604b0 2024-09-13T17:08:37.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 -- 172.21.15.123:0/1631370312 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4018663319 0 0) 0x7f45940035d0 con 0x7f45a81604b0 2024-09-13T17:08:37.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 -- 172.21.15.123:0/1631370312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45a8160890 msgr2=0x7f45a80b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:37.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45a8160890 0x7f45a80b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 -- 172.21.15.123:0/1631370312 >> v2:172.21.15.153:3300/0 conn(0x7f45a80c98c0 msgr2=0x7f45a80cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:37.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 --2- 172.21.15.123:0/1631370312 >> v2:172.21.15.153:3300/0 conn(0x7f45a80c98c0 0x7f45a80cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 -- 172.21.15.123:0/1631370312 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a80ce620 con 0x7f45a81604b0 2024-09-13T17:08:37.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 -- 172.21.15.123:0/1631370312 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f45a00019f0 con 0x7f45a81604b0 2024-09-13T17:08:37.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 -- 172.21.15.123:0/1631370312 >> v1:172.21.15.123:6789/0 conn(0x7f45a81604b0 legacy=0x7f45a80cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4594003a20 0x7f4594003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4594004410 0x7f45940048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4594005010 0x7f459400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 -- 172.21.15.123:0/1631370312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80d1ec0 con 0x7f4594005010 2024-09-13T17:08:37.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 -- 172.21.15.123:0/1631370312 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459400bf70 con 0x7f4594004410 2024-09-13T17:08:37.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 -- 172.21.15.123:0/1631370312 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459400c0e0 con 0x7f4594003a20 2024-09-13T17:08:37.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45acaea700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45a8160890 0x7f45a80b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:37.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45acaea700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4594005010 0x7f459400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a77fe700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4594004410 0x7f45940048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a7fff700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4594003a20 0x7f4594003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45acaea700 1 -- 172.21.15.123:0/1631370312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4594003a20 msgr2=0x7f4594003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:37.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45acaea700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4594003a20 0x7f4594003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45acaea700 1 -- 172.21.15.123:0/1631370312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4594004410 msgr2=0x7f45940048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:37.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45acaea700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4594004410 0x7f45940048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45acaea700 1 -- 172.21.15.123:0/1631370312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45940035d0 con 0x7f4594005010 2024-09-13T17:08:37.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a77fe700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4594004410 0x7f45940048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:37.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a7fff700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4594003a20 0x7f4594003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:37.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45acaea700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4594005010 0x7f459400ba30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4598009760 tx=0x7f45940058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495a253e551ecfc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:37.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 -- 172.21.15.123:0/1631370312 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598004230 con 0x7f4594005010 2024-09-13T17:08:37.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 -- 172.21.15.123:0/1631370312 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4598004390 con 0x7f4594005010 2024-09-13T17:08:37.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45a6ffd700 1 -- 172.21.15.123:0/1631370312 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45980036c0 con 0x7f4594005010 2024-09-13T17:08:37.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45ae54d700 1 -- 172.21.15.123:0/1631370312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4594005010 msgr2=0x7f459400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45ae54d700 1 --2- 172.21.15.123:0/1631370312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4594005010 0x7f459400ba30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4598009760 tx=0x7f45940058a0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45acaea700 1 -- 172.21.15.123:0/1631370312 reap_dead start 2024-09-13T17:08:37.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45ae54d700 1 -- 172.21.15.123:0/1631370312 shutdown_connections 2024-09-13T17:08:37.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45ae54d700 1 -- 172.21.15.123:0/1631370312 >> 172.21.15.123:0/1631370312 conn(0x7f45a80d2cb0 msgr2=0x7f45a80d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:37.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45ae54d700 1 -- 172.21.15.123:0/1631370312 shutdown_connections 2024-09-13T17:08:37.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.863+0000 7f45ae54d700 1 -- 172.21.15.123:0/1631370312 wait complete. 2024-09-13T17:08:37.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45ae54d700 1 Processor -- start 2024-09-13T17:08:37.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45ae54d700 1 -- start start 2024-09-13T17:08:37.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45ae54d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45a81591b0 0x7f45a80cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45ae54d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45a80b7ab0 0x7f45a80b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45ae54d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45a815ded0 0x7f45a815e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45ae54d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80b8b30 con 0x7f45a815ded0 2024-09-13T17:08:37.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45ae54d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a815e8c0 con 0x7f45a80b7ab0 2024-09-13T17:08:37.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45ae54d700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8159590 con 0x7f45a81591b0 2024-09-13T17:08:37.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45acaea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45a815ded0 0x7f45a815e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45acaea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45a815ded0 0x7f45a815e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37364/0 (socket says 172.21.15.123:37364) 2024-09-13T17:08:37.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45acaea700 1 -- 172.21.15.123:0/1994871928 learned_addr learned my addr 172.21.15.123:0/1994871928 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:37.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45a77fe700 1 --2- 172.21.15.123:0/1994871928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45a80b7ab0 0x7f45a80b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45a7fff700 1 --2- 172.21.15.123:0/1994871928 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45a81591b0 0x7f45a80cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45acaea700 1 -- 172.21.15.123:0/1994871928 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45a81591b0 msgr2=0x7f45a80cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45acaea700 1 --2- 172.21.15.123:0/1994871928 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45a81591b0 0x7f45a80cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45acaea700 1 -- 172.21.15.123:0/1994871928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45a80b7ab0 msgr2=0x7f45a80b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45acaea700 1 --2- 172.21.15.123:0/1994871928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45a80b7ab0 0x7f45a80b7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45acaea700 1 -- 172.21.15.123:0/1994871928 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a80cb8a0 con 0x7f45a815ded0 2024-09-13T17:08:37.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45acaea700 1 --2- 172.21.15.123:0/1994871928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45a815ded0 0x7f45a815e380 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4598013000 tx=0x7f45980047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:37.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45a4ff9700 1 -- 172.21.15.123:0/1994871928 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598006af0 con 0x7f45a815ded0 2024-09-13T17:08:37.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45a4ff9700 1 -- 172.21.15.123:0/1994871928 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4598013e10 con 0x7f45a815ded0 2024-09-13T17:08:37.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45ae54d700 1 -- 172.21.15.123:0/1994871928 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a80b8570 con 0x7f45a815ded0 2024-09-13T17:08:37.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45a4ff9700 1 -- 172.21.15.123:0/1994871928 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598027410 con 0x7f45a815ded0 2024-09-13T17:08:37.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.867+0000 7f45ae54d700 1 -- 172.21.15.123:0/1994871928 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a80b5c80 con 0x7f45a815ded0 2024-09-13T17:08:37.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.871+0000 7f45a4ff9700 1 -- 172.21.15.123:0/1994871928 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f459801d410 con 0x7f45a815ded0 2024-09-13T17:08:37.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.871+0000 7f45ae54d700 1 -- 172.21.15.123:0/1994871928 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a80b5ae0 con 0x7f45a815ded0 2024-09-13T17:08:37.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.871+0000 7f45a4ff9700 1 --2- 172.21.15.123:0/1994871928 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4588066730 0x7f4588068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.871+0000 7f45a4ff9700 1 -- 172.21.15.123:0/1994871928 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f45980849a0 con 0x7f45a815ded0 2024-09-13T17:08:37.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.871+0000 7f45a7fff700 1 --2- 172.21.15.123:0/1994871928 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4588066730 0x7f4588068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.871+0000 7f45a7fff700 1 --2- 172.21.15.123:0/1994871928 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4588066730 0x7f4588068bf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f45a0001b20 tx=0x7f45a0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:37.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:37.875+0000 7f45a4ff9700 1 -- 172.21.15.123:0/1994871928 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f45a80b5ae0 con 0x7f45a815ded0 2024-09-13T17:08:38.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.079+0000 7f45ae54d700 1 -- 172.21.15.123:0/1994871928 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f45a80b5ae0 con 0x7f45a815ded0 2024-09-13T17:08:38.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.735+0000 7f45a4ff9700 1 -- 172.21.15.123:0/1994871928 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f45a80b5ae0 con 0x7f45a815ded0 2024-09-13T17:08:38.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.739+0000 7f45ae54d700 1 -- 172.21.15.123:0/1994871928 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4588066730 msgr2=0x7f4588068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:38.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.739+0000 7f45ae54d700 1 --2- 172.21.15.123:0/1994871928 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4588066730 0x7f4588068bf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f45a0001b20 tx=0x7f45a0009040 comp rx=0 tx=0).stop 2024-09-13T17:08:38.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.739+0000 7f45ae54d700 1 -- 172.21.15.123:0/1994871928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45a815ded0 msgr2=0x7f45a815e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:38.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.739+0000 7f45ae54d700 1 --2- 172.21.15.123:0/1994871928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45a815ded0 0x7f45a815e380 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4598013000 tx=0x7f45980047e0 comp rx=0 tx=0).stop 2024-09-13T17:08:38.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.739+0000 7f45ae54d700 1 -- 172.21.15.123:0/1994871928 shutdown_connections 2024-09-13T17:08:38.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.739+0000 7f45ae54d700 1 --2- 172.21.15.123:0/1994871928 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4588066730 0x7f4588068bf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:38.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.739+0000 7f45ae54d700 1 --2- 172.21.15.123:0/1994871928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45a815ded0 0x7f45a815e380 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:38.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.739+0000 7f45ae54d700 1 --2- 172.21.15.123:0/1994871928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45a80b7ab0 0x7f45a80b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:38.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.739+0000 7f45ae54d700 1 --2- 172.21.15.123:0/1994871928 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45a81591b0 0x7f45a80cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:38.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.739+0000 7f45ae54d700 1 -- 172.21.15.123:0/1994871928 >> 172.21.15.123:0/1994871928 conn(0x7f45a80d2cb0 msgr2=0x7f45a815f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:38.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.739+0000 7f45ae54d700 1 -- 172.21.15.123:0/1994871928 shutdown_connections 2024-09-13T17:08:38.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.739+0000 7f45ae54d700 1 -- 172.21.15.123:0/1994871928 wait complete. 2024-09-13T17:08:38.763 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:08:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.883+0000 7ffb6f59e700 1 Processor -- start 2024-09-13T17:08:38.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.883+0000 7ffb6f59e700 1 -- start start 2024-09-13T17:08:38.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffb7015cdd0 0x7ffb700d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:38.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6f59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb700cf6b0 0x7ffb700cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:38.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6f59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb700d0060 con 0x7ffb700d1580 2024-09-13T17:08:38.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6f59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb700d3cb0 con 0x7ffb700cf6b0 2024-09-13T17:08:38.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb700cebc0 con 0x7ffb7015cdd0 2024-09-13T17:08:38.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6ed9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb700cf6b0 0x7ffb700cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:38.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6ed9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb700cf6b0 0x7ffb700cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37372/0 (socket says 172.21.15.123:37372) 2024-09-13T17:08:38.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6ed9d700 1 -- 172.21.15.123:0/1059803391 learned_addr learned my addr 172.21.15.123:0/1059803391 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:38.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6e59c700 1 --2- 172.21.15.123:0/1059803391 >> v2:172.21.15.153:3300/0 conn(0x7ffb7015cdd0 0x7ffb700d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:38.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6ed9d700 1 -- 172.21.15.123:0/1059803391 >> v2:172.21.15.153:3300/0 conn(0x7ffb7015cdd0 msgr2=0x7ffb700d33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:38.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6ed9d700 1 --2- 172.21.15.123:0/1059803391 >> v2:172.21.15.153:3300/0 conn(0x7ffb7015cdd0 0x7ffb700d33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:38.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6ed9d700 1 -- 172.21.15.123:0/1059803391 >> v1:172.21.15.153:6789/0 conn(0x7ffb700d1580 legacy=0x7ffb700ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:38.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6ed9d700 1 -- 172.21.15.123:0/1059803391 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700ce020 con 0x7ffb700cf6b0 2024-09-13T17:08:38.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6ed9d700 1 --2- 172.21.15.123:0/1059803391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb700cf6b0 0x7ffb700cfb20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ffb7008bd50 tx=0x7ffb6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d9084badfdcaea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:38.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6d59a700 1 -- 172.21.15.123:0/1059803391 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800e070 con 0x7ffb700cf6b0 2024-09-13T17:08:38.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6d59a700 1 -- 172.21.15.123:0/1059803391 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6800b9c0 con 0x7ffb700cf6b0 2024-09-13T17:08:38.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6d59a700 1 -- 172.21.15.123:0/1059803391 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800bd70 con 0x7ffb700cf6b0 2024-09-13T17:08:38.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6f59e700 1 -- 172.21.15.123:0/1059803391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb700cf6b0 msgr2=0x7ffb700cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:38.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6f59e700 1 --2- 172.21.15.123:0/1059803391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb700cf6b0 0x7ffb700cfb20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ffb7008bd50 tx=0x7ffb6800b330 comp rx=0 tx=0).stop 2024-09-13T17:08:38.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6f59e700 1 -- 172.21.15.123:0/1059803391 shutdown_connections 2024-09-13T17:08:38.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6f59e700 1 --2- 172.21.15.123:0/1059803391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb700cf6b0 0x7ffb700cfb20 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:38.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6f59e700 1 --2- 172.21.15.123:0/1059803391 >> v2:172.21.15.153:3300/0 conn(0x7ffb7015cdd0 0x7ffb700d33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:38.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6f59e700 1 -- 172.21.15.123:0/1059803391 >> 172.21.15.123:0/1059803391 conn(0x7ffb7009c010 msgr2=0x7ffb700d2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:38.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6f59e700 1 -- 172.21.15.123:0/1059803391 shutdown_connections 2024-09-13T17:08:38.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.887+0000 7ffb6f59e700 1 -- 172.21.15.123:0/1059803391 wait complete. 2024-09-13T17:08:38.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6f59e700 1 Processor -- start 2024-09-13T17:08:38.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6f59e700 1 -- start start 2024-09-13T17:08:38.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb700cf6b0 0x7ffb700c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:38.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb700d1580 0x7ffb7014f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:38.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6f59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb7015cdd0 0x7ffb700cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:38.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6f59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7014f680 con 0x7ffb700cf6b0 2024-09-13T17:08:38.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700cb6a0 con 0x7ffb700d1580 2024-09-13T17:08:38.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6f59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700b2490 con 0x7ffb7015cdd0 2024-09-13T17:08:38.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb700cf6b0 0x7ffb700c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:38.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb700cf6b0 0x7ffb700c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37378/0 (socket says 172.21.15.123:37378) 2024-09-13T17:08:38.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6e59c700 1 -- 172.21.15.123:0/792430996 learned_addr learned my addr 172.21.15.123:0/792430996 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:38.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6ed9d700 1 --2- 172.21.15.123:0/792430996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb7015cdd0 0x7ffb700cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:38.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6dd9b700 1 --2- 172.21.15.123:0/792430996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb700d1580 0x7ffb7014f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:38.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6e59c700 1 -- 172.21.15.123:0/792430996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb7015cdd0 msgr2=0x7ffb700cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:38.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6e59c700 1 --2- 172.21.15.123:0/792430996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb7015cdd0 0x7ffb700cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:38.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6e59c700 1 -- 172.21.15.123:0/792430996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb700d1580 msgr2=0x7ffb7014f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:38.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6e59c700 1 --2- 172.21.15.123:0/792430996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb700d1580 0x7ffb7014f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:38.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6e59c700 1 -- 172.21.15.123:0/792430996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68009b30 con 0x7ffb700cf6b0 2024-09-13T17:08:38.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.891+0000 7ffb6e59c700 1 --2- 172.21.15.123:0/792430996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb700cf6b0 0x7ffb700c72e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000d800 tx=0x7ffb6000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:38.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.895+0000 7ffb66ffd700 1 -- 172.21.15.123:0/792430996 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600125f0 con 0x7ffb700cf6b0 2024-09-13T17:08:38.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.895+0000 7ffb66ffd700 1 -- 172.21.15.123:0/792430996 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb60012750 con 0x7ffb700cf6b0 2024-09-13T17:08:38.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.895+0000 7ffb66ffd700 1 -- 172.21.15.123:0/792430996 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60012b00 con 0x7ffb700cf6b0 2024-09-13T17:08:38.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.895+0000 7ffb6f59e700 1 -- 172.21.15.123:0/792430996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb700b2770 con 0x7ffb700cf6b0 2024-09-13T17:08:38.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.895+0000 7ffb6f59e700 1 -- 172.21.15.123:0/792430996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb700b52e0 con 0x7ffb700cf6b0 2024-09-13T17:08:38.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.895+0000 7ffb6f59e700 1 -- 172.21.15.123:0/792430996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb700b22f0 con 0x7ffb700cf6b0 2024-09-13T17:08:38.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.895+0000 7ffb66ffd700 1 -- 172.21.15.123:0/792430996 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb60012c60 con 0x7ffb700cf6b0 2024-09-13T17:08:38.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.895+0000 7ffb66ffd700 1 --2- 172.21.15.123:0/792430996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb50066730 0x7ffb50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:38.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.895+0000 7ffb66ffd700 1 -- 172.21.15.123:0/792430996 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ffb600842e0 con 0x7ffb700cf6b0 2024-09-13T17:08:38.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.895+0000 7ffb6dd9b700 1 --2- 172.21.15.123:0/792430996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb50066730 0x7ffb50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:38.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.899+0000 7ffb6dd9b700 1 --2- 172.21.15.123:0/792430996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb50066730 0x7ffb50068bf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffb700cfee0 tx=0x7ffb58009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:38.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:38.903+0000 7ffb66ffd700 1 -- 172.21.15.123:0/792430996 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffb700b22f0 con 0x7ffb700cf6b0 2024-09-13T17:08:39.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:39.071+0000 7ffb6f59e700 1 -- 172.21.15.123:0/792430996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffb700b22f0 con 0x7ffb700cf6b0 2024-09-13T17:08:39.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:39.899+0000 7ffb66ffd700 1 -- 172.21.15.123:0/792430996 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) v1 ==== 181+0+0 (secure 0 0 0) 0x7ffb700b22f0 con 0x7ffb700cf6b0 2024-09-13T17:08:39.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:39.903+0000 7ffb6f59e700 1 -- 172.21.15.123:0/792430996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb50066730 msgr2=0x7ffb50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:39.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:39.903+0000 7ffb6f59e700 1 --2- 172.21.15.123:0/792430996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb50066730 0x7ffb50068bf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffb700cfee0 tx=0x7ffb58009040 comp rx=0 tx=0).stop 2024-09-13T17:08:39.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:39.903+0000 7ffb6f59e700 1 -- 172.21.15.123:0/792430996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb700cf6b0 msgr2=0x7ffb700c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:39.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:39.903+0000 7ffb6f59e700 1 --2- 172.21.15.123:0/792430996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb700cf6b0 0x7ffb700c72e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000d800 tx=0x7ffb6000db10 comp rx=0 tx=0).stop 2024-09-13T17:08:39.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:39.903+0000 7ffb6f59e700 1 -- 172.21.15.123:0/792430996 shutdown_connections 2024-09-13T17:08:39.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:39.903+0000 7ffb6f59e700 1 --2- 172.21.15.123:0/792430996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb50066730 0x7ffb50068bf0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:39.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:39.903+0000 7ffb6f59e700 1 --2- 172.21.15.123:0/792430996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb7015cdd0 0x7ffb700cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:39.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:39.903+0000 7ffb6f59e700 1 --2- 172.21.15.123:0/792430996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb700d1580 0x7ffb7014f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:39.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:39.903+0000 7ffb6f59e700 1 --2- 172.21.15.123:0/792430996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb700cf6b0 0x7ffb700c72e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:39.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:39.903+0000 7ffb6f59e700 1 -- 172.21.15.123:0/792430996 >> 172.21.15.123:0/792430996 conn(0x7ffb7009c010 msgr2=0x7ffb700ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:39.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:39.907+0000 7ffb6f59e700 1 -- 172.21.15.123:0/792430996 shutdown_connections 2024-09-13T17:08:39.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:39.907+0000 7ffb6f59e700 1 -- 172.21.15.123:0/792430996 wait complete. 2024-09-13T17:08:39.911 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:08:39.925 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:08:40.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d3e293700 1 Processor -- start 2024-09-13T17:08:40.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d3e293700 1 -- start start 2024-09-13T17:08:40.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d3e293700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6d380d3220 0x7f6d380d36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:40.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d3e293700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d381606f0 con 0x7f6d380d1080 2024-09-13T17:08:40.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d3e293700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d380ce7b0 con 0x7f6d38160310 2024-09-13T17:08:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d3e293700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d380cea90 con 0x7f6d380d3220 2024-09-13T17:08:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d3da92700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6d380d1080 0x7f6d380b5960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43524/0 (socket says 172.21.15.123:43524) 2024-09-13T17:08:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d3da92700 1 -- 172.21.15.123:0/1753494777 learned_addr learned my addr 172.21.15.123:0/1753494777 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d3ca90700 1 --2- 172.21.15.123:0/1753494777 >> v2:172.21.15.153:3300/0 conn(0x7f6d380d3220 0x7f6d380d36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d2bfff700 1 -- 172.21.15.123:0/1753494777 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919202075 0 0) 0x7f6d381606f0 con 0x7f6d380d1080 2024-09-13T17:08:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d2bfff700 1 -- 172.21.15.123:0/1753494777 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d240035d0 con 0x7f6d380d1080 2024-09-13T17:08:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d2bfff700 1 -- 172.21.15.123:0/1753494777 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567748372 0 0) 0x7f6d380ce7b0 con 0x7f6d38160310 2024-09-13T17:08:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d2bfff700 1 -- 172.21.15.123:0/1753494777 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d381606f0 con 0x7f6d38160310 2024-09-13T17:08:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d3ca90700 1 -- 172.21.15.123:0/1753494777 >> v1:172.21.15.153:6789/0 conn(0x7f6d38160310 legacy=0x7f6d380cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:40.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d3ca90700 1 -- 172.21.15.123:0/1753494777 >> v1:172.21.15.123:6789/0 conn(0x7f6d380d1080 legacy=0x7f6d380b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d3ca90700 1 -- 172.21.15.123:0/1753494777 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d380ced70 con 0x7f6d380d3220 2024-09-13T17:08:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d3ca90700 1 --2- 172.21.15.123:0/1753494777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d380d3220 0x7f6d380d36e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009880 tx=0x7f6d2c009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2afb10cf662db9de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d2bfff700 1 -- 172.21.15.123:0/1753494777 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c011830 con 0x7f6d380d3220 2024-09-13T17:08:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d2bfff700 1 -- 172.21.15.123:0/1753494777 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c011990 con 0x7f6d380d3220 2024-09-13T17:08:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.035+0000 7f6d2bfff700 1 -- 172.21.15.123:0/1753494777 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c011d00 con 0x7f6d380d3220 2024-09-13T17:08:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 -- 172.21.15.123:0/1753494777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d380d3220 msgr2=0x7f6d380d36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:40.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 --2- 172.21.15.123:0/1753494777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d380d3220 0x7f6d380d36e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009880 tx=0x7f6d2c009b90 comp rx=0 tx=0).stop 2024-09-13T17:08:40.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 -- 172.21.15.123:0/1753494777 shutdown_connections 2024-09-13T17:08:40.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 --2- 172.21.15.123:0/1753494777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d380d3220 0x7f6d380d36e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:40.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 -- 172.21.15.123:0/1753494777 >> 172.21.15.123:0/1753494777 conn(0x7f6d3809be50 msgr2=0x7f6d380d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 -- 172.21.15.123:0/1753494777 shutdown_connections 2024-09-13T17:08:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 -- 172.21.15.123:0/1753494777 wait complete. 2024-09-13T17:08:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 Processor -- start 2024-09-13T17:08:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 -- start start 2024-09-13T17:08:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d380d1080 0x7f6d3809d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d380d3220 0x7f6d381542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d38160310 0x7f6d3809fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d380b1750 con 0x7f6d38160310 2024-09-13T17:08:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d380b1ff0 con 0x7f6d380d1080 2024-09-13T17:08:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3e293700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d381519e0 con 0x7f6d380d3220 2024-09-13T17:08:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3da92700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d38160310 0x7f6d3809fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3da92700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d38160310 0x7f6d3809fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37384/0 (socket says 172.21.15.123:37384) 2024-09-13T17:08:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3da92700 1 -- 172.21.15.123:0/2977141887 learned_addr learned my addr 172.21.15.123:0/2977141887 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3d291700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d380d1080 0x7f6d3809d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3ca90700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d380d3220 0x7f6d381542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3da92700 1 -- 172.21.15.123:0/2977141887 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d380d3220 msgr2=0x7f6d381542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:40.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3da92700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d380d3220 0x7f6d381542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:40.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3da92700 1 -- 172.21.15.123:0/2977141887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d380d1080 msgr2=0x7f6d3809d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:40.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3da92700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d380d1080 0x7f6d3809d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:40.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3da92700 1 -- 172.21.15.123:0/2977141887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c0094b0 con 0x7f6d38160310 2024-09-13T17:08:40.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.039+0000 7f6d3ca90700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d380d3220 0x7f6d381542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:40.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.043+0000 7f6d3da92700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d38160310 0x7f6d3809fc90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000cba0 tx=0x7f6d3000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:40.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.043+0000 7f6d29ffb700 1 -- 172.21.15.123:0/2977141887 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000a7b0 con 0x7f6d38160310 2024-09-13T17:08:40.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.043+0000 7f6d3e293700 1 -- 172.21.15.123:0/2977141887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d38154820 con 0x7f6d38160310 2024-09-13T17:08:40.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.043+0000 7f6d29ffb700 1 -- 172.21.15.123:0/2977141887 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3000a910 con 0x7f6d38160310 2024-09-13T17:08:40.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.043+0000 7f6d29ffb700 1 -- 172.21.15.123:0/2977141887 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000ac80 con 0x7f6d38160310 2024-09-13T17:08:40.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.043+0000 7f6d3e293700 1 -- 172.21.15.123:0/2977141887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d380b1930 con 0x7f6d38160310 2024-09-13T17:08:40.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.043+0000 7f6d3e293700 1 -- 172.21.15.123:0/2977141887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d380677f0 con 0x7f6d38160310 2024-09-13T17:08:40.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.043+0000 7f6d29ffb700 1 -- 172.21.15.123:0/2977141887 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d3001b3b0 con 0x7f6d38160310 2024-09-13T17:08:40.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.043+0000 7f6d29ffb700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6d1c066730 0x7f6d1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:40.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.047+0000 7f6d3d291700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6d1c066730 0x7f6d1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:40.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.047+0000 7f6d29ffb700 1 -- 172.21.15.123:0/2977141887 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f6d30083a60 con 0x7f6d38160310 2024-09-13T17:08:40.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.047+0000 7f6d3d291700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6d1c066730 0x7f6d1c068bf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6d340017b0 tx=0x7f6d34009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:40.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.051+0000 7f6d29ffb700 1 -- 172.21.15.123:0/2977141887 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6d30050e80 con 0x7f6d38160310 2024-09-13T17:08:40.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.223+0000 7f6d3e293700 1 -- 172.21.15.123:0/2977141887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d380b2130 con 0x7f6d38160310 2024-09-13T17:08:40.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.911+0000 7f6d29ffb700 1 -- 172.21.15.123:0/2977141887 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6d380b2130 con 0x7f6d38160310 2024-09-13T17:08:40.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.919+0000 7f6d3e293700 1 -- 172.21.15.123:0/2977141887 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6d1c066730 msgr2=0x7f6d1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:40.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.919+0000 7f6d3e293700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6d1c066730 0x7f6d1c068bf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6d340017b0 tx=0x7f6d34009040 comp rx=0 tx=0).stop 2024-09-13T17:08:40.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.919+0000 7f6d3e293700 1 -- 172.21.15.123:0/2977141887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d38160310 msgr2=0x7f6d3809fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:40.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.919+0000 7f6d3e293700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d38160310 0x7f6d3809fc90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000cba0 tx=0x7f6d3000cbd0 comp rx=0 tx=0).stop 2024-09-13T17:08:40.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.919+0000 7f6d3e293700 1 -- 172.21.15.123:0/2977141887 shutdown_connections 2024-09-13T17:08:40.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.919+0000 7f6d3e293700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6d1c066730 0x7f6d1c068bf0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:40.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.919+0000 7f6d3e293700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d38160310 0x7f6d3809fc90 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:40.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.919+0000 7f6d3e293700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6d380d3220 0x7f6d381542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:40.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.919+0000 7f6d3e293700 1 --2- 172.21.15.123:0/2977141887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d380d1080 0x7f6d3809d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:40.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.919+0000 7f6d3e293700 1 -- 172.21.15.123:0/2977141887 >> 172.21.15.123:0/2977141887 conn(0x7f6d3809be50 msgr2=0x7f6d380d06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:40.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.919+0000 7f6d3e293700 1 -- 172.21.15.123:0/2977141887 shutdown_connections 2024-09-13T17:08:40.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:40.919+0000 7f6d3e293700 1 -- 172.21.15.123:0/2977141887 wait complete. 2024-09-13T17:08:40.927 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-13T17:08:40.938 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T17:08:41.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fe22a700 1 Processor -- start 2024-09-13T17:08:41.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fe22a700 1 -- start start 2024-09-13T17:08:41.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fe22a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe5f81592e0 0x7fe5f815d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:41.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fe22a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5f81596c0 0x7fe5f815d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:41.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fe22a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f80cd2e0 con 0x7fe5f806dc90 2024-09-13T17:08:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fe22a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f80cd5c0 con 0x7fe5f81592e0 2024-09-13T17:08:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fe22a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80cd8a0 con 0x7fe5f81596c0 2024-09-13T17:08:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fd228700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe5f81592e0 0x7fe5f815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fda29700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe5f806dc90 0x7fe5f80c8cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43528/0 (socket says 172.21.15.123:43528) 2024-09-13T17:08:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fd228700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe5f81592e0 0x7fe5f815d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37398/0 (socket says 172.21.15.123:37398) 2024-09-13T17:08:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fda29700 1 -- 172.21.15.123:0/1343806856 learned_addr learned my addr 172.21.15.123:0/1343806856 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:41.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fca27700 1 --2- 172.21.15.123:0/1343806856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5f81596c0 0x7fe5f815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:41.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fd228700 1 -- 172.21.15.123:0/1343806856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5f81596c0 msgr2=0x7fe5f815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:41.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fd228700 1 --2- 172.21.15.123:0/1343806856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5f81596c0 0x7fe5f815d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fd228700 1 -- 172.21.15.123:0/1343806856 >> v1:172.21.15.123:6789/0 conn(0x7fe5f806dc90 legacy=0x7fe5f80c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:41.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fd228700 1 -- 172.21.15.123:0/1343806856 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f80cdb80 con 0x7fe5f81592e0 2024-09-13T17:08:41.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fca27700 1 --2- 172.21.15.123:0/1343806856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5f81596c0 0x7fe5f815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:41.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.047+0000 7fe5fd228700 1 --2- 172.21.15.123:0/1343806856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5f81592e0 0x7fe5f815d030 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009850 tx=0x7fe5f4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ab09c8f3760b60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:41.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5effff700 1 -- 172.21.15.123:0/1343806856 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4011830 con 0x7fe5f81592e0 2024-09-13T17:08:41.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5effff700 1 -- 172.21.15.123:0/1343806856 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f4011990 con 0x7fe5f81592e0 2024-09-13T17:08:41.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5effff700 1 -- 172.21.15.123:0/1343806856 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4011d20 con 0x7fe5f81592e0 2024-09-13T17:08:41.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 -- 172.21.15.123:0/1343806856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5f81592e0 msgr2=0x7fe5f815d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:41.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 --2- 172.21.15.123:0/1343806856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5f81592e0 0x7fe5f815d030 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009850 tx=0x7fe5f4009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:41.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 -- 172.21.15.123:0/1343806856 shutdown_connections 2024-09-13T17:08:41.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 --2- 172.21.15.123:0/1343806856 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5f81596c0 0x7fe5f815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 --2- 172.21.15.123:0/1343806856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5f81592e0 0x7fe5f815d030 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 -- 172.21.15.123:0/1343806856 >> 172.21.15.123:0/1343806856 conn(0x7fe5f80b01d0 msgr2=0x7fe5f80b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:41.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 -- 172.21.15.123:0/1343806856 shutdown_connections 2024-09-13T17:08:41.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 -- 172.21.15.123:0/1343806856 wait complete. 2024-09-13T17:08:41.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 Processor -- start 2024-09-13T17:08:41.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 -- start start 2024-09-13T17:08:41.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5f806dc90 0x7fe5f815c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:41.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5f81592e0 0x7fe5f81f0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:41.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5f81596c0 0x7fe5f80c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:41.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f81f0bd0 con 0x7fe5f806dc90 2024-09-13T17:08:41.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f81f0e70 con 0x7fe5f81596c0 2024-09-13T17:08:41.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fe22a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f81f1150 con 0x7fe5f81592e0 2024-09-13T17:08:41.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fd228700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5f806dc90 0x7fe5f815c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:41.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fd228700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5f806dc90 0x7fe5f815c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37412/0 (socket says 172.21.15.123:37412) 2024-09-13T17:08:41.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fd228700 1 -- 172.21.15.123:0/3522236756 learned_addr learned my addr 172.21.15.123:0/3522236756 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:41.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fd228700 1 -- 172.21.15.123:0/3522236756 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5f81592e0 msgr2=0x7fe5f81f0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:41.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fd228700 1 --2- 172.21.15.123:0/3522236756 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5f81592e0 0x7fe5f81f0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fd228700 1 -- 172.21.15.123:0/3522236756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5f81596c0 msgr2=0x7fe5f80c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:41.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fd228700 1 --2- 172.21.15.123:0/3522236756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5f81596c0 0x7fe5f80c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fd228700 1 -- 172.21.15.123:0/3522236756 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f40094b0 con 0x7fe5f806dc90 2024-09-13T17:08:41.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.051+0000 7fe5fd228700 1 --2- 172.21.15.123:0/3522236756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5f806dc90 0x7fe5f815c370 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009fd0 tx=0x7fe5f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:41.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.055+0000 7fe5edffb700 1 -- 172.21.15.123:0/3522236756 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f40038c0 con 0x7fe5f806dc90 2024-09-13T17:08:41.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.055+0000 7fe5edffb700 1 -- 172.21.15.123:0/3522236756 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f401e070 con 0x7fe5f806dc90 2024-09-13T17:08:41.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.055+0000 7fe5fe22a700 1 -- 172.21.15.123:0/3522236756 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f81f1430 con 0x7fe5f806dc90 2024-09-13T17:08:41.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.055+0000 7fe5edffb700 1 -- 172.21.15.123:0/3522236756 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4003c80 con 0x7fe5f806dc90 2024-09-13T17:08:41.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.055+0000 7fe5fe22a700 1 -- 172.21.15.123:0/3522236756 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f80c9590 con 0x7fe5f806dc90 2024-09-13T17:08:41.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.055+0000 7fe5fe22a700 1 -- 172.21.15.123:0/3522236756 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f81f1640 con 0x7fe5f806dc90 2024-09-13T17:08:41.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.055+0000 7fe5edffb700 1 -- 172.21.15.123:0/3522236756 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe5f401a420 con 0x7fe5f806dc90 2024-09-13T17:08:41.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.055+0000 7fe5edffb700 1 --2- 172.21.15.123:0/3522236756 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe5dc066730 0x7fe5dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:41.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.055+0000 7fe5edffb700 1 -- 172.21.15.123:0/3522236756 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe5f4020070 con 0x7fe5f806dc90 2024-09-13T17:08:41.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.055+0000 7fe5fca27700 1 --2- 172.21.15.123:0/3522236756 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe5dc066730 0x7fe5dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:41.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.055+0000 7fe5fca27700 1 --2- 172.21.15.123:0/3522236756 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe5dc066730 0x7fe5dc068bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe5f806bd60 tx=0x7fe5e8008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:41.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.059+0000 7fe5edffb700 1 -- 172.21.15.123:0/3522236756 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe5f4052c50 con 0x7fe5f806dc90 2024-09-13T17:08:41.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.231+0000 7fe5fe22a700 1 -- 172.21.15.123:0/3522236756 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe5f80cb100 con 0x7fe5f806dc90 2024-09-13T17:08:41.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.239+0000 7fe5edffb700 1 -- 172.21.15.123:0/3522236756 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe5f4056270 con 0x7fe5f806dc90 2024-09-13T17:08:41.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.239+0000 7fe5fe22a700 1 -- 172.21.15.123:0/3522236756 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe5dc066730 msgr2=0x7fe5dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:41.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.239+0000 7fe5fe22a700 1 --2- 172.21.15.123:0/3522236756 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe5dc066730 0x7fe5dc068bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe5f806bd60 tx=0x7fe5e8008040 comp rx=0 tx=0).stop 2024-09-13T17:08:41.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.239+0000 7fe5fe22a700 1 -- 172.21.15.123:0/3522236756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5f806dc90 msgr2=0x7fe5f815c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:41.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.239+0000 7fe5fe22a700 1 --2- 172.21.15.123:0/3522236756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5f806dc90 0x7fe5f815c370 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009fd0 tx=0x7fe5f4004770 comp rx=0 tx=0).stop 2024-09-13T17:08:41.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.239+0000 7fe5fe22a700 1 -- 172.21.15.123:0/3522236756 shutdown_connections 2024-09-13T17:08:41.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.239+0000 7fe5fe22a700 1 --2- 172.21.15.123:0/3522236756 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe5dc066730 0x7fe5dc068bf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.239+0000 7fe5fe22a700 1 --2- 172.21.15.123:0/3522236756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5f81596c0 0x7fe5f80c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.239+0000 7fe5fe22a700 1 --2- 172.21.15.123:0/3522236756 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5f81592e0 0x7fe5f81f0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.239+0000 7fe5fe22a700 1 --2- 172.21.15.123:0/3522236756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5f806dc90 0x7fe5f815c370 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.239+0000 7fe5fe22a700 1 -- 172.21.15.123:0/3522236756 >> 172.21.15.123:0/3522236756 conn(0x7fe5f80b01d0 msgr2=0x7fe5f80b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:41.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.239+0000 7fe5fe22a700 1 -- 172.21.15.123:0/3522236756 shutdown_connections 2024-09-13T17:08:41.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.239+0000 7fe5fe22a700 1 -- 172.21.15.123:0/3522236756 wait complete. 2024-09-13T17:08:41.260 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values' 2024-09-13T17:08:41.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.371+0000 7f03e1336700 1 Processor -- start 2024-09-13T17:08:41.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.371+0000 7f03e1336700 1 -- start start 2024-09-13T17:08:41.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.371+0000 7f03e1336700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03dc157070 0x7f03dc0717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:41.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.371+0000 7f03e1336700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc072180 con 0x7f03dc071d20 2024-09-13T17:08:41.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.371+0000 7f03e1336700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc157450 con 0x7f03dc0ad620 2024-09-13T17:08:41.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.371+0000 7f03e1336700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc0adc80 con 0x7f03dc157070 2024-09-13T17:08:41.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.371+0000 7f03d3fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f03dc071d20 0x7f03dc0acf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43534/0 (socket says 172.21.15.123:43534) 2024-09-13T17:08:41.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.371+0000 7f03d3fff700 1 -- 172.21.15.123:0/1332604855 learned_addr learned my addr 172.21.15.123:0/1332604855 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:41.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03dbfff700 1 --2- 172.21.15.123:0/1332604855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03dc157070 0x7f03dc0717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:41.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571336194 0 0) 0x7f03dc072180 con 0x7f03dc071d20 2024-09-13T17:08:41.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c80035d0 con 0x7f03dc071d20 2024-09-13T17:08:41.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372491577 0 0) 0x7f03dc157450 con 0x7f03dc0ad620 2024-09-13T17:08:41.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03dc072180 con 0x7f03dc0ad620 2024-09-13T17:08:41.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1691663903 0 0) 0x7f03c80035d0 con 0x7f03dc071d20 2024-09-13T17:08:41.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03dc157070 msgr2=0x7f03dc0717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:41.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 --2- 172.21.15.123:0/1332604855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03dc157070 0x7f03dc0717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 >> v1:172.21.15.153:6789/0 conn(0x7f03dc0ad620 legacy=0x7f03dc06ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:41.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc15d1e0 con 0x7f03dc071d20 2024-09-13T17:08:41.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f03c4001670 con 0x7f03dc071d20 2024-09-13T17:08:41.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 >> v1:172.21.15.123:6789/0 conn(0x7f03dc071d20 legacy=0x7f03dc0acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:41.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 --2- 172.21.15.123:0/1332604855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03dc157070 0x7f03c8003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 --2- 172.21.15.123:0/1332604855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c8004140 0x7f03c8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 --2- 172.21.15.123:0/1332604855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c8004db0 0x7f03c8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc0adc80 con 0x7f03c8004db0 2024-09-13T17:08:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c800bb10 con 0x7f03c8004140 2024-09-13T17:08:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c800bcd0 con 0x7f03dc157070 2024-09-13T17:08:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03e0b35700 1 --2- 172.21.15.123:0/1332604855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c8004db0 0x7f03c8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03dbfff700 1 --2- 172.21.15.123:0/1332604855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03dc157070 0x7f03c8003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03d3fff700 1 --2- 172.21.15.123:0/1332604855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c8004140 0x7f03c8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03e0b35700 1 -- 172.21.15.123:0/1332604855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03dc157070 msgr2=0x7f03c8003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03e0b35700 1 --2- 172.21.15.123:0/1332604855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03dc157070 0x7f03c8003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03e0b35700 1 -- 172.21.15.123:0/1332604855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c8004140 msgr2=0x7f03c8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03e0b35700 1 --2- 172.21.15.123:0/1332604855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c8004140 0x7f03c8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03e0b35700 1 -- 172.21.15.123:0/1332604855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c80035d0 con 0x7f03c8004db0 2024-09-13T17:08:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03e0b35700 1 --2- 172.21.15.123:0/1332604855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c8004db0 0x7f03c8005230 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f03d400c2f0 tx=0x7f03c80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf27571a62fa746 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d4001f30 con 0x7f03c8004db0 2024-09-13T17:08:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d400ce90 con 0x7f03c8004db0 2024-09-13T17:08:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03db7fe700 1 -- 172.21.15.123:0/1332604855 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d4003c60 con 0x7f03c8004db0 2024-09-13T17:08:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03e1336700 1 -- 172.21.15.123:0/1332604855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c8004db0 msgr2=0x7f03c8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03e1336700 1 --2- 172.21.15.123:0/1332604855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c8004db0 0x7f03c8005230 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f03d400c2f0 tx=0x7f03c80058a0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03e0b35700 1 -- 172.21.15.123:0/1332604855 reap_dead start 2024-09-13T17:08:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03e1336700 1 -- 172.21.15.123:0/1332604855 shutdown_connections 2024-09-13T17:08:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03e1336700 1 -- 172.21.15.123:0/1332604855 >> 172.21.15.123:0/1332604855 conn(0x7f03dc066150 msgr2=0x7f03dc066560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03e1336700 1 -- 172.21.15.123:0/1332604855 shutdown_connections 2024-09-13T17:08:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.375+0000 7f03e1336700 1 -- 172.21.15.123:0/1332604855 wait complete. 2024-09-13T17:08:41.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03e1336700 1 Processor -- start 2024-09-13T17:08:41.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03e1336700 1 -- start start 2024-09-13T17:08:41.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03e1336700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c8004db0 0x7f03dc14d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:41.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03e1336700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03dc0ce650 0x7f03dc0cead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:41.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03e1336700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03dc0cca50 0x7f03dc0cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:41.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03e1336700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc0cf010 con 0x7f03dc0ce650 2024-09-13T17:08:41.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03e1336700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc14ee60 con 0x7f03c8004db0 2024-09-13T17:08:41.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03e1336700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc14d8d0 con 0x7f03dc0cca50 2024-09-13T17:08:41.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03d3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03dc0ce650 0x7f03dc0cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:41.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03d3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03dc0ce650 0x7f03dc0cead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37428/0 (socket says 172.21.15.123:37428) 2024-09-13T17:08:41.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03d3fff700 1 -- 172.21.15.123:0/3193009051 learned_addr learned my addr 172.21.15.123:0/3193009051 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03dbfff700 1 --2- 172.21.15.123:0/3193009051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c8004db0 0x7f03dc14d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03e0b35700 1 --2- 172.21.15.123:0/3193009051 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03dc0cca50 0x7f03dc0cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03d3fff700 1 -- 172.21.15.123:0/3193009051 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03dc0cca50 msgr2=0x7f03dc0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03d3fff700 1 --2- 172.21.15.123:0/3193009051 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03dc0cca50 0x7f03dc0cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03d3fff700 1 -- 172.21.15.123:0/3193009051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c8004db0 msgr2=0x7f03dc14d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03d3fff700 1 --2- 172.21.15.123:0/3193009051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c8004db0 0x7f03dc14d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03d3fff700 1 -- 172.21.15.123:0/3193009051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc0cd710 con 0x7f03dc0ce650 2024-09-13T17:08:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03d3fff700 1 --2- 172.21.15.123:0/3193009051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03dc0ce650 0x7f03dc0cead0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f03c4007310 tx=0x7f03c4007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03d97fa700 1 -- 172.21.15.123:0/3193009051 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c400f6c0 con 0x7f03dc0ce650 2024-09-13T17:08:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03d97fa700 1 -- 172.21.15.123:0/3193009051 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c400f840 con 0x7f03dc0ce650 2024-09-13T17:08:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03e1336700 1 -- 172.21.15.123:0/3193009051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc0cd9f0 con 0x7f03dc0ce650 2024-09-13T17:08:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03d97fa700 1 -- 172.21.15.123:0/3193009051 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c400fbf0 con 0x7f03dc0ce650 2024-09-13T17:08:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.379+0000 7f03e1336700 1 -- 172.21.15.123:0/3193009051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc0cd410 con 0x7f03dc0ce650 2024-09-13T17:08:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.383+0000 7f03e1336700 1 -- 172.21.15.123:0/3193009051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc0717e0 con 0x7f03dc0ce650 2024-09-13T17:08:41.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.383+0000 7f03d97fa700 1 -- 172.21.15.123:0/3193009051 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f03c400fd50 con 0x7f03dc0ce650 2024-09-13T17:08:41.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.383+0000 7f03d97fa700 1 --2- 172.21.15.123:0/3193009051 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f03bc066760 0x7f03bc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:41.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.383+0000 7f03d97fa700 1 -- 172.21.15.123:0/3193009051 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f03c4083da0 con 0x7f03dc0ce650 2024-09-13T17:08:41.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.383+0000 7f03dbfff700 1 --2- 172.21.15.123:0/3193009051 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f03bc066760 0x7f03bc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:41.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.383+0000 7f03dbfff700 1 --2- 172.21.15.123:0/3193009051 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f03bc066760 0x7f03bc068c20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009c70 tx=0x7f03cc009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:41.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.391+0000 7f03d97fa700 1 -- 172.21.15.123:0/3193009051 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f03c4051390 con 0x7f03dc0ce650 2024-09-13T17:08:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.619+0000 7f03e1336700 1 -- 172.21.15.123:0/3193009051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values"]} v 0) v1 -- 0x7f03dc1514d0 con 0x7f03dc0ce650 2024-09-13T17:08:41.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.907+0000 7f03d97fa700 1 -- 172.21.15.123:0/3193009051 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values"]}]=0 v129) v1 ==== 153+0+0 (secure 0 0 0) 0x7f03c40549b0 con 0x7f03dc0ce650 2024-09-13T17:08:41.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.911+0000 7f03e1336700 1 -- 172.21.15.123:0/3193009051 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f03bc066760 msgr2=0x7f03bc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:41.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.911+0000 7f03e1336700 1 --2- 172.21.15.123:0/3193009051 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f03bc066760 0x7f03bc068c20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009c70 tx=0x7f03cc009240 comp rx=0 tx=0).stop 2024-09-13T17:08:41.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.911+0000 7f03e1336700 1 -- 172.21.15.123:0/3193009051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03dc0ce650 msgr2=0x7f03dc0cead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:41.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.911+0000 7f03e1336700 1 --2- 172.21.15.123:0/3193009051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03dc0ce650 0x7f03dc0cead0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f03c4007310 tx=0x7f03c4007620 comp rx=0 tx=0).stop 2024-09-13T17:08:41.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.915+0000 7f03e1336700 1 -- 172.21.15.123:0/3193009051 shutdown_connections 2024-09-13T17:08:41.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.915+0000 7f03e1336700 1 --2- 172.21.15.123:0/3193009051 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f03bc066760 0x7f03bc068c20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.915+0000 7f03e1336700 1 --2- 172.21.15.123:0/3193009051 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03dc0cca50 0x7f03dc0cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.915+0000 7f03e1336700 1 --2- 172.21.15.123:0/3193009051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03dc0ce650 0x7f03dc0cead0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.915+0000 7f03e1336700 1 --2- 172.21.15.123:0/3193009051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c8004db0 0x7f03dc14d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:41.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.915+0000 7f03e1336700 1 -- 172.21.15.123:0/3193009051 >> 172.21.15.123:0/3193009051 conn(0x7f03dc066150 msgr2=0x7f03dc0b4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:41.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.915+0000 7f03e1336700 1 -- 172.21.15.123:0/3193009051 shutdown_connections 2024-09-13T17:08:41.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:41.915+0000 7f03e1336700 1 -- 172.21.15.123:0/3193009051 wait complete. 2024-09-13T17:08:41.935 INFO:tasks.cephfs_test_runner:test invalid values for ceph.quota.max_bytes ... ok 2024-09-13T17:08:41.936 INFO:tasks.cephfs_test_runner:Starting test: test_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) test human-readable values for setting ceph.quota.max_bytes 2024-09-13T17:08:41.936 INFO:tasks.cephfs_test_runner:test_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2024-09-13T17:08:41.936 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:42.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6cffff700 1 Processor -- start 2024-09-13T17:08:42.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6cffff700 1 -- start start 2024-09-13T17:08:42.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6cffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6d00c4f00 0x7fe6d00cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6cffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6d00cc1e0 0x7fe6d00cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6cffff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d00ccb80 con 0x7fe6d0159aa0 2024-09-13T17:08:42.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6cffff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d00c3650 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6cffff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d00c3930 con 0x7fe6d00c4f00 2024-09-13T17:08:42.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6ce7fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6d00cc1e0 0x7fe6d00cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6cf7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe6d0159aa0 0x7fe6d0159f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40710/0 (socket says 172.21.15.123:40710) 2024-09-13T17:08:42.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6cf7fe700 1 -- 172.21.15.123:0/1651999109 learned_addr learned my addr 172.21.15.123:0/1651999109 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:42.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6ceffd700 1 --2- 172.21.15.123:0/1651999109 >> v2:172.21.15.153:3300/0 conn(0x7fe6d00c4f00 0x7fe6d00cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6ce7fc700 1 -- 172.21.15.123:0/1651999109 >> v2:172.21.15.153:3300/0 conn(0x7fe6d00c4f00 msgr2=0x7fe6d00cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:42.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6ce7fc700 1 --2- 172.21.15.123:0/1651999109 >> v2:172.21.15.153:3300/0 conn(0x7fe6d00c4f00 0x7fe6d00cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6ce7fc700 1 -- 172.21.15.123:0/1651999109 >> v1:172.21.15.123:6789/0 conn(0x7fe6d0159aa0 legacy=0x7fe6d0159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6ce7fc700 1 -- 172.21.15.123:0/1651999109 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d00c3c10 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6ceffd700 1 --2- 172.21.15.123:0/1651999109 >> v2:172.21.15.153:3300/0 conn(0x7fe6d00c4f00 0x7fe6d00cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:42.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6ce7fc700 1 --2- 172.21.15.123:0/1651999109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d00cc1e0 0x7fe6d00cc640 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe6d006a320 tx=0x7fe6c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bacb5f1610890f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:42.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6cdffb700 1 -- 172.21.15.123:0/1651999109 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c000e070 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6cdffb700 1 -- 172.21.15.123:0/1651999109 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c000bbd0 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.051+0000 7fe6cdffb700 1 -- 172.21.15.123:0/1651999109 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0012430 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.055+0000 7fe6cffff700 1 -- 172.21.15.123:0/1651999109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d00cc1e0 msgr2=0x7fe6d00cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.055+0000 7fe6cffff700 1 --2- 172.21.15.123:0/1651999109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d00cc1e0 0x7fe6d00cc640 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe6d006a320 tx=0x7fe6c000b330 comp rx=0 tx=0).stop 2024-09-13T17:08:42.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.055+0000 7fe6cffff700 1 -- 172.21.15.123:0/1651999109 shutdown_connections 2024-09-13T17:08:42.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.055+0000 7fe6cffff700 1 --2- 172.21.15.123:0/1651999109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d00cc1e0 0x7fe6d00cc640 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.055+0000 7fe6cffff700 1 --2- 172.21.15.123:0/1651999109 >> v2:172.21.15.153:3300/0 conn(0x7fe6d00c4f00 0x7fe6d00cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.055+0000 7fe6cffff700 1 -- 172.21.15.123:0/1651999109 >> 172.21.15.123:0/1651999109 conn(0x7fe6d00b0240 msgr2=0x7fe6d00b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:42.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.055+0000 7fe6cffff700 1 -- 172.21.15.123:0/1651999109 shutdown_connections 2024-09-13T17:08:42.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.055+0000 7fe6cffff700 1 -- 172.21.15.123:0/1651999109 wait complete. 2024-09-13T17:08:42.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6cffff700 1 Processor -- start 2024-09-13T17:08:42.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6cffff700 1 -- start start 2024-09-13T17:08:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6d00c4f00 0x7fe6d0149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6cffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d00cc1e0 0x7fe6d0153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6cffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6d0159aa0 0x7fe6d00c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6cffff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d0154840 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6cffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d0154b20 con 0x7fe6d00c4f00 2024-09-13T17:08:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6cffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d0154e00 con 0x7fe6d0159aa0 2024-09-13T17:08:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6ce7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d00cc1e0 0x7fe6d0153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6ceffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6d00c4f00 0x7fe6d0149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6ce7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d00cc1e0 0x7fe6d0153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40864/0 (socket says 172.21.15.123:40864) 2024-09-13T17:08:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6cf7fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6d0159aa0 0x7fe6d00c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6ce7fc700 1 -- 172.21.15.123:0/1000297012 learned_addr learned my addr 172.21.15.123:0/1000297012 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6ce7fc700 1 -- 172.21.15.123:0/1000297012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6d0159aa0 msgr2=0x7fe6d00c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6ce7fc700 1 --2- 172.21.15.123:0/1000297012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6d0159aa0 0x7fe6d00c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6ce7fc700 1 -- 172.21.15.123:0/1000297012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6d00c4f00 msgr2=0x7fe6d0149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6ce7fc700 1 --2- 172.21.15.123:0/1000297012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6d00c4f00 0x7fe6d0149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6ce7fc700 1 -- 172.21.15.123:0/1000297012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c0009a70 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6ce7fc700 1 --2- 172.21.15.123:0/1000297012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d00cc1e0 0x7fe6d0153df0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0014040 tx=0x7fe6c0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:42.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6b77fe700 1 -- 172.21.15.123:0/1000297012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0012430 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.059+0000 7fe6b77fe700 1 -- 172.21.15.123:0/1000297012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c0020070 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.063+0000 7fe6b77fe700 1 -- 172.21.15.123:0/1000297012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0004280 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.063+0000 7fe6cffff700 1 -- 172.21.15.123:0/1000297012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d01550e0 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.063+0000 7fe6cffff700 1 -- 172.21.15.123:0/1000297012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d014da70 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.063+0000 7fe6cffff700 1 -- 172.21.15.123:0/1000297012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d014dc00 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.063+0000 7fe6b77fe700 1 -- 172.21.15.123:0/1000297012 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe6c00043e0 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.063+0000 7fe6b77fe700 1 --2- 172.21.15.123:0/1000297012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe6bc066730 0x7fe6bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.063+0000 7fe6b77fe700 1 -- 172.21.15.123:0/1000297012 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe6c0022070 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.063+0000 7fe6ceffd700 1 --2- 172.21.15.123:0/1000297012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe6bc066730 0x7fe6bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.067+0000 7fe6ceffd700 1 --2- 172.21.15.123:0/1000297012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe6bc066730 0x7fe6bc068bf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40099f0 tx=0x7fe6c4008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:42.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.075+0000 7fe6b77fe700 1 -- 172.21.15.123:0/1000297012 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe6c00531d0 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.239+0000 7fe6cffff700 1 -- 172.21.15.123:0/1000297012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6d00b2b90 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.243+0000 7fe6b77fe700 1 -- 172.21.15.123:0/1000297012 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+13036 (secure 0 0 0) 0x7fe6d00b2b90 con 0x7fe6d00cc1e0 2024-09-13T17:08:42.247 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:42.247 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":51,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:40.896669+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6837/2449786141":"2024-09-14T17:08:37.721778+0000","172.21.15.123:6836/2449786141":"2024-09-14T17:08:37.721778+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.243+0000 7fe6cffff700 1 -- 172.21.15.123:0/1000297012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe6bc066730 msgr2=0x7fe6bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.243+0000 7fe6cffff700 1 --2- 172.21.15.123:0/1000297012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe6bc066730 0x7fe6bc068bf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40099f0 tx=0x7fe6c4008040 comp rx=0 tx=0).stop 2024-09-13T17:08:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.243+0000 7fe6cffff700 1 -- 172.21.15.123:0/1000297012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d00cc1e0 msgr2=0x7fe6d0153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.243+0000 7fe6cffff700 1 --2- 172.21.15.123:0/1000297012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d00cc1e0 0x7fe6d0153df0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0014040 tx=0x7fe6c0004af0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.243+0000 7fe6cffff700 1 -- 172.21.15.123:0/1000297012 shutdown_connections 2024-09-13T17:08:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.243+0000 7fe6cffff700 1 --2- 172.21.15.123:0/1000297012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe6bc066730 0x7fe6bc068bf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.243+0000 7fe6cffff700 1 --2- 172.21.15.123:0/1000297012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe6d0159aa0 0x7fe6d00c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.243+0000 7fe6cffff700 1 --2- 172.21.15.123:0/1000297012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d00cc1e0 0x7fe6d0153df0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.243+0000 7fe6cffff700 1 --2- 172.21.15.123:0/1000297012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6d00c4f00 0x7fe6d0149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.243+0000 7fe6cffff700 1 -- 172.21.15.123:0/1000297012 >> 172.21.15.123:0/1000297012 conn(0x7fe6d00b0240 msgr2=0x7fe6d00af810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.243+0000 7fe6cffff700 1 -- 172.21.15.123:0/1000297012 shutdown_connections 2024-09-13T17:08:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.243+0000 7fe6cffff700 1 -- 172.21.15.123:0/1000297012 wait complete. 2024-09-13T17:08:42.262 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:08:42.263 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:08:42.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd7454700 1 Processor -- start 2024-09-13T17:08:42.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd7454700 1 -- start start 2024-09-13T17:08:42.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd7454700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8dd00cdda0 0x7f8dd015e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd7454700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd00ada60 con 0x7f8dd0070f90 2024-09-13T17:08:42.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd7454700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd015e680 con 0x7f8dd0159c60 2024-09-13T17:08:42.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd7454700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd00720a0 con 0x7f8dd00cdda0 2024-09-13T17:08:42.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd6c53700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8dd0070f90 0x7f8dd006c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40718/0 (socket says 172.21.15.123:40718) 2024-09-13T17:08:42.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd6c53700 1 -- 172.21.15.123:0/1762652469 learned_addr learned my addr 172.21.15.123:0/1762652469 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:42.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5c51700 1 --2- 172.21.15.123:0/1762652469 >> v2:172.21.15.153:3300/0 conn(0x7f8dd00cdda0 0x7f8dd015e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 -- 172.21.15.123:0/1762652469 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9039382 0 0) 0x7f8dd00ada60 con 0x7f8dd0070f90 2024-09-13T17:08:42.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 -- 172.21.15.123:0/1762652469 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8db80035d0 con 0x7f8dd0070f90 2024-09-13T17:08:42.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 -- 172.21.15.123:0/1762652469 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1729451516 0 0) 0x7f8db80035d0 con 0x7f8dd0070f90 2024-09-13T17:08:42.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 -- 172.21.15.123:0/1762652469 >> v2:172.21.15.153:3300/0 conn(0x7f8dd00cdda0 msgr2=0x7f8dd015e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:42.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 --2- 172.21.15.123:0/1762652469 >> v2:172.21.15.153:3300/0 conn(0x7f8dd00cdda0 0x7f8dd015e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 -- 172.21.15.123:0/1762652469 >> v1:172.21.15.153:6789/0 conn(0x7f8dd0159c60 legacy=0x7f8dd00cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 -- 172.21.15.123:0/1762652469 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd0072530 con 0x7f8dd0070f90 2024-09-13T17:08:42.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 -- 172.21.15.123:0/1762652469 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f8dc8001690 con 0x7f8dd0070f90 2024-09-13T17:08:42.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 -- 172.21.15.123:0/1762652469 >> v1:172.21.15.123:6789/0 conn(0x7f8dd0070f90 legacy=0x7f8dd006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 --2- 172.21.15.123:0/1762652469 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8db8003a20 0x7f8db8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 --2- 172.21.15.123:0/1762652469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8db8004870 0x7f8db8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 --2- 172.21.15.123:0/1762652469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8db8005230 0x7f8db800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 -- 172.21.15.123:0/1762652469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00720a0 con 0x7f8db8004870 2024-09-13T17:08:42.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 -- 172.21.15.123:0/1762652469 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db800c0d0 con 0x7f8db8005230 2024-09-13T17:08:42.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5450700 1 -- 172.21.15.123:0/1762652469 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db800c290 con 0x7f8db8003a20 2024-09-13T17:08:42.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd5c51700 1 --2- 172.21.15.123:0/1762652469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8db8004870 0x7f8db8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd6c53700 1 --2- 172.21.15.123:0/1762652469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8db8005230 0x7f8db800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd6452700 1 --2- 172.21.15.123:0/1762652469 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8db8003a20 0x7f8db8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd6c53700 1 -- 172.21.15.123:0/1762652469 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8db8003a20 msgr2=0x7f8db8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:42.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd6c53700 1 --2- 172.21.15.123:0/1762652469 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8db8003a20 0x7f8db8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd6c53700 1 -- 172.21.15.123:0/1762652469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8db8004870 msgr2=0x7f8db8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:42.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd6c53700 1 --2- 172.21.15.123:0/1762652469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8db8004870 0x7f8db8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd6c53700 1 -- 172.21.15.123:0/1762652469 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db80035d0 con 0x7f8db8005230 2024-09-13T17:08:42.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.375+0000 7f8dd6c53700 1 -- 172.21.15.123:0/1762652469 reap_dead start 2024-09-13T17:08:42.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd6c53700 1 --2- 172.21.15.123:0/1762652469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8db8005230 0x7f8db800ba30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8dd00c8c80 tx=0x7f8db80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3154a9d29560843f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:42.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd5450700 1 -- 172.21.15.123:0/1762652469 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800ce00 con 0x7f8db8005230 2024-09-13T17:08:42.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd5450700 1 -- 172.21.15.123:0/1762652469 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc8007bc0 con 0x7f8db8005230 2024-09-13T17:08:42.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd5450700 1 -- 172.21.15.123:0/1762652469 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8005bc0 con 0x7f8db8005230 2024-09-13T17:08:42.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 -- 172.21.15.123:0/1762652469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8db8005230 msgr2=0x7f8db800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 --2- 172.21.15.123:0/1762652469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8db8005230 0x7f8db800ba30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8dd00c8c80 tx=0x7f8db80058a0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 -- 172.21.15.123:0/1762652469 shutdown_connections 2024-09-13T17:08:42.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 --2- 172.21.15.123:0/1762652469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8db8005230 0x7f8db800ba30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 -- 172.21.15.123:0/1762652469 >> 172.21.15.123:0/1762652469 conn(0x7f8dd00b01d0 msgr2=0x7f8dd00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:42.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 -- 172.21.15.123:0/1762652469 shutdown_connections 2024-09-13T17:08:42.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 -- 172.21.15.123:0/1762652469 wait complete. 2024-09-13T17:08:42.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 Processor -- start 2024-09-13T17:08:42.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 -- start start 2024-09-13T17:08:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8db8005230 0x7f8dd00c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dd01589d0 0x7f8dd015c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dd015c8d0 0x7f8dd015cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd0147d20 con 0x7f8db8005230 2024-09-13T17:08:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00a84b0 con 0x7f8dd015c8d0 2024-09-13T17:08:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd7454700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00a8c80 con 0x7f8dd01589d0 2024-09-13T17:08:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd6452700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8db8005230 0x7f8dd00c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd6452700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8db8005230 0x7f8dd00c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40892/0 (socket says 172.21.15.123:40892) 2024-09-13T17:08:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.379+0000 7f8dd6452700 1 -- 172.21.15.123:0/1003687821 learned_addr learned my addr 172.21.15.123:0/1003687821 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dd6c53700 1 --2- 172.21.15.123:0/1003687821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dd015c8d0 0x7f8dd015cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dd5c51700 1 --2- 172.21.15.123:0/1003687821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dd01589d0 0x7f8dd015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dd6452700 1 -- 172.21.15.123:0/1003687821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dd01589d0 msgr2=0x7f8dd015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dd6452700 1 --2- 172.21.15.123:0/1003687821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dd01589d0 0x7f8dd015c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dd6452700 1 -- 172.21.15.123:0/1003687821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dd015c8d0 msgr2=0x7f8dd015cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dd6452700 1 --2- 172.21.15.123:0/1003687821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dd015c8d0 0x7f8dd015cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dd6452700 1 -- 172.21.15.123:0/1003687821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd00a86c0 con 0x7f8db8005230 2024-09-13T17:08:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dd6452700 1 --2- 172.21.15.123:0/1003687821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8db8005230 0x7f8dd00c9890 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400f7f0 tx=0x7f8dc400fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dceffd700 1 -- 172.21.15.123:0/1003687821 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4005320 con 0x7f8db8005230 2024-09-13T17:08:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dceffd700 1 -- 172.21.15.123:0/1003687821 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc4005480 con 0x7f8db8005230 2024-09-13T17:08:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dd7454700 1 -- 172.21.15.123:0/1003687821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd00a89a0 con 0x7f8db8005230 2024-09-13T17:08:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dceffd700 1 -- 172.21.15.123:0/1003687821 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4006aa0 con 0x7f8db8005230 2024-09-13T17:08:42.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dd7454700 1 -- 172.21.15.123:0/1003687821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd00c9dd0 con 0x7f8db8005230 2024-09-13T17:08:42.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dceffd700 1 -- 172.21.15.123:0/1003687821 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8dc4006c00 con 0x7f8db8005230 2024-09-13T17:08:42.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dd7454700 1 -- 172.21.15.123:0/1003687821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd01477a0 con 0x7f8db8005230 2024-09-13T17:08:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.383+0000 7f8dceffd700 1 --2- 172.21.15.123:0/1003687821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8dbc066730 0x7f8dbc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.387+0000 7f8dceffd700 1 -- 172.21.15.123:0/1003687821 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8dc4082ed0 con 0x7f8db8005230 2024-09-13T17:08:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.387+0000 7f8dd5c51700 1 --2- 172.21.15.123:0/1003687821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8dbc066730 0x7f8dbc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.387+0000 7f8dd5c51700 1 --2- 172.21.15.123:0/1003687821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8dbc066730 0x7f8dbc068bf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0158830 tx=0x7f8dc000b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.395+0000 7f8dceffd700 1 -- 172.21.15.123:0/1003687821 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8dd01477a0 con 0x7f8db8005230 2024-09-13T17:08:42.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.563+0000 7f8dd7454700 1 -- 172.21.15.123:0/1003687821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8dd015e680 con 0x7f8db8005230 2024-09-13T17:08:42.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.563+0000 7f8dceffd700 1 -- 172.21.15.123:0/1003687821 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8dd015e680 con 0x7f8db8005230 2024-09-13T17:08:42.569 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:08:42.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.567+0000 7f8dd7454700 1 -- 172.21.15.123:0/1003687821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8dbc066730 msgr2=0x7f8dbc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.567+0000 7f8dd7454700 1 --2- 172.21.15.123:0/1003687821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8dbc066730 0x7f8dbc068bf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0158830 tx=0x7f8dc000b040 comp rx=0 tx=0).stop 2024-09-13T17:08:42.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.567+0000 7f8dd7454700 1 -- 172.21.15.123:0/1003687821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8db8005230 msgr2=0x7f8dd00c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.567+0000 7f8dd7454700 1 --2- 172.21.15.123:0/1003687821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8db8005230 0x7f8dd00c9890 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400f7f0 tx=0x7f8dc400fb00 comp rx=0 tx=0).stop 2024-09-13T17:08:42.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.567+0000 7f8dd7454700 1 -- 172.21.15.123:0/1003687821 shutdown_connections 2024-09-13T17:08:42.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.567+0000 7f8dd7454700 1 --2- 172.21.15.123:0/1003687821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8dbc066730 0x7f8dbc068bf0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.567+0000 7f8dd7454700 1 --2- 172.21.15.123:0/1003687821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dd015c8d0 0x7f8dd015cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.567+0000 7f8dd7454700 1 --2- 172.21.15.123:0/1003687821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dd01589d0 0x7f8dd015c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.567+0000 7f8dd7454700 1 --2- 172.21.15.123:0/1003687821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8db8005230 0x7f8dd00c9890 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.567+0000 7f8dd7454700 1 -- 172.21.15.123:0/1003687821 >> 172.21.15.123:0/1003687821 conn(0x7f8dd00b01d0 msgr2=0x7f8dd00cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:42.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.567+0000 7f8dd7454700 1 -- 172.21.15.123:0/1003687821 shutdown_connections 2024-09-13T17:08:42.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.567+0000 7f8dd7454700 1 -- 172.21.15.123:0/1003687821 wait complete. 2024-09-13T17:08:42.590 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values' 2024-09-13T17:08:42.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.699+0000 7f7fa7fff700 1 Processor -- start 2024-09-13T17:08:42.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.699+0000 7f7fa7fff700 1 -- start start 2024-09-13T17:08:42.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa7fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa806d170 0x7f7fa8159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa7fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa815a3a0 con 0x7f7fa813e200 2024-09-13T17:08:42.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa7fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa813e7d0 con 0x7f7fa8159bb0 2024-09-13T17:08:42.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa7fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa813e5e0 con 0x7f7fa806d170 2024-09-13T17:08:42.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa6ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7fa813e200 0x7f7fa806ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40730/0 (socket says 172.21.15.123:40730) 2024-09-13T17:08:42.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa6ffd700 1 -- 172.21.15.123:0/1195293165 learned_addr learned my addr 172.21.15.123:0/1195293165 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:42.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7f9ffff700 1 --2- 172.21.15.123:0/1195293165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa806d170 0x7f7fa8159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa67fc700 1 -- 172.21.15.123:0/1195293165 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893471560 0 0) 0x7f7fa815a3a0 con 0x7f7fa813e200 2024-09-13T17:08:42.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa67fc700 1 -- 172.21.15.123:0/1195293165 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f940035d0 con 0x7f7fa813e200 2024-09-13T17:08:42.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7f9ffff700 1 -- 172.21.15.123:0/1195293165 >> v1:172.21.15.153:6789/0 conn(0x7f7fa8159bb0 legacy=0x7f7fa8156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7f9ffff700 1 -- 172.21.15.123:0/1195293165 >> v1:172.21.15.123:6789/0 conn(0x7f7fa813e200 legacy=0x7f7fa806ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7f9ffff700 1 -- 172.21.15.123:0/1195293165 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa813eab0 con 0x7f7fa806d170 2024-09-13T17:08:42.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7f9ffff700 1 --2- 172.21.15.123:0/1195293165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa806d170 0x7f7fa8159670 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009880 tx=0x7f7f90009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e00de1f7debaa37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:42.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa67fc700 1 -- 172.21.15.123:0/1195293165 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90010800 con 0x7f7fa806d170 2024-09-13T17:08:42.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa67fc700 1 -- 172.21.15.123:0/1195293165 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f90010960 con 0x7f7fa806d170 2024-09-13T17:08:42.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa67fc700 1 -- 172.21.15.123:0/1195293165 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90010cd0 con 0x7f7fa806d170 2024-09-13T17:08:42.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1195293165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa806d170 msgr2=0x7f7fa8159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa7fff700 1 --2- 172.21.15.123:0/1195293165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa806d170 0x7f7fa8159670 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009880 tx=0x7f7f90009b90 comp rx=0 tx=0).stop 2024-09-13T17:08:42.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1195293165 shutdown_connections 2024-09-13T17:08:42.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa7fff700 1 --2- 172.21.15.123:0/1195293165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa806d170 0x7f7fa8159670 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1195293165 >> 172.21.15.123:0/1195293165 conn(0x7f7fa80b4630 msgr2=0x7f7fa80b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:42.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1195293165 shutdown_connections 2024-09-13T17:08:42.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.703+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1195293165 wait complete. 2024-09-13T17:08:42.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa7fff700 1 Processor -- start 2024-09-13T17:08:42.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa7fff700 1 -- start start 2024-09-13T17:08:42.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa7fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa806d170 0x7f7fa813b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa813e200 0x7f7fa81e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa8159bb0 0x7f7fa81e3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa7fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8158960 con 0x7f7fa8159bb0 2024-09-13T17:08:42.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa7fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa81e4300 con 0x7f7fa813e200 2024-09-13T17:08:42.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa7fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa81e45e0 con 0x7f7fa806d170 2024-09-13T17:08:42.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa8159bb0 0x7f7fa81e3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa8159bb0 0x7f7fa81e3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40906/0 (socket says 172.21.15.123:40906) 2024-09-13T17:08:42.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa77fe700 1 -- 172.21.15.123:0/1697650359 learned_addr learned my addr 172.21.15.123:0/1697650359 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:42.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7f9ffff700 1 --2- 172.21.15.123:0/1697650359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa813e200 0x7f7fa81e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa6ffd700 1 --2- 172.21.15.123:0/1697650359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa806d170 0x7f7fa813b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa77fe700 1 -- 172.21.15.123:0/1697650359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa806d170 msgr2=0x7f7fa813b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa77fe700 1 --2- 172.21.15.123:0/1697650359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa806d170 0x7f7fa813b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa77fe700 1 -- 172.21.15.123:0/1697650359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa813e200 msgr2=0x7f7fa81e53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:42.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa77fe700 1 --2- 172.21.15.123:0/1697650359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa813e200 0x7f7fa81e53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:42.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa77fe700 1 -- 172.21.15.123:0/1697650359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f900094b0 con 0x7f7fa8159bb0 2024-09-13T17:08:42.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa77fe700 1 --2- 172.21.15.123:0/1697650359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa8159bb0 0x7f7fa81e3230 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000cbc0 tx=0x7f7fa000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:42.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7f9f7fe700 1 -- 172.21.15.123:0/1697650359 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0003c20 con 0x7f7fa8159bb0 2024-09-13T17:08:42.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7f9f7fe700 1 -- 172.21.15.123:0/1697650359 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa0003d80 con 0x7f7fa8159bb0 2024-09-13T17:08:42.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1697650359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa81e48c0 con 0x7f7fa8159bb0 2024-09-13T17:08:42.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7f9f7fe700 1 -- 172.21.15.123:0/1697650359 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000aa20 con 0x7f7fa8159bb0 2024-09-13T17:08:42.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.707+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1697650359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa81e4e80 con 0x7f7fa8159bb0 2024-09-13T17:08:42.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.711+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1697650359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa815a060 con 0x7f7fa8159bb0 2024-09-13T17:08:42.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.711+0000 7f7f9f7fe700 1 -- 172.21.15.123:0/1697650359 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7fa000ab80 con 0x7f7fa8159bb0 2024-09-13T17:08:42.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.711+0000 7f7f9f7fe700 1 --2- 172.21.15.123:0/1697650359 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f88066760 0x7f7f88068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:42.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.711+0000 7f7fa6ffd700 1 --2- 172.21.15.123:0/1697650359 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f88066760 0x7f7f88068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:42.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.711+0000 7f7f9f7fe700 1 -- 172.21.15.123:0/1697650359 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7fa0083d40 con 0x7f7fa8159bb0 2024-09-13T17:08:42.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.711+0000 7f7fa6ffd700 1 --2- 172.21.15.123:0/1697650359 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f88066760 0x7f7f88068c20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7f98007fd0 tx=0x7f7f98007de0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.719+0000 7f7f9f7fe700 1 -- 172.21.15.123:0/1697650359 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7fa00513b0 con 0x7f7fa8159bb0 2024-09-13T17:08:42.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:42.951+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1697650359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values"]} v 0) v1 -- 0x7f7fa80b01d0 con 0x7f7fa8159bb0 2024-09-13T17:08:43.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:43.919+0000 7f7f9f7fe700 1 -- 172.21.15.123:0/1697650359 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values"]}]=0 v131) v1 ==== 148+0+0 (secure 0 0 0) 0x7f7fa00549d0 con 0x7f7fa8159bb0 2024-09-13T17:08:43.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:43.923+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1697650359 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f88066760 msgr2=0x7f7f88068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:43.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:43.923+0000 7f7fa7fff700 1 --2- 172.21.15.123:0/1697650359 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f88066760 0x7f7f88068c20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7f98007fd0 tx=0x7f7f98007de0 comp rx=0 tx=0).stop 2024-09-13T17:08:43.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:43.923+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1697650359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa8159bb0 msgr2=0x7f7fa81e3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:43.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:43.923+0000 7f7fa7fff700 1 --2- 172.21.15.123:0/1697650359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa8159bb0 0x7f7fa81e3230 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000cbc0 tx=0x7f7fa000ced0 comp rx=0 tx=0).stop 2024-09-13T17:08:43.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:43.923+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1697650359 shutdown_connections 2024-09-13T17:08:43.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:43.923+0000 7f7fa7fff700 1 --2- 172.21.15.123:0/1697650359 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7f88066760 0x7f7f88068c20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:43.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:43.923+0000 7f7fa7fff700 1 --2- 172.21.15.123:0/1697650359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa8159bb0 0x7f7fa81e3230 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:43.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:43.923+0000 7f7fa7fff700 1 --2- 172.21.15.123:0/1697650359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fa813e200 0x7f7fa81e53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:43.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:43.923+0000 7f7fa7fff700 1 --2- 172.21.15.123:0/1697650359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7fa806d170 0x7f7fa813b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:43.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:43.923+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1697650359 >> 172.21.15.123:0/1697650359 conn(0x7f7fa80b4630 msgr2=0x7f7fa806ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:43.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:43.923+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1697650359 shutdown_connections 2024-09-13T17:08:43.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:43.923+0000 7f7fa7fff700 1 -- 172.21.15.123:0/1697650359 wait complete. 2024-09-13T17:08:43.944 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T17:08:44.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.067+0000 7f72e5cca700 1 Processor -- start 2024-09-13T17:08:44.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.067+0000 7f72e5cca700 1 -- start start 2024-09-13T17:08:44.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72e5cca700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f72e00b4b60 0x7f72e015d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72e5cca700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e00b37a0 0x7f72e015da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72e5cca700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e00b3310 con 0x7f72e01506b0 2024-09-13T17:08:44.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72e5cca700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e015e280 con 0x7f72e00b4b60 2024-09-13T17:08:44.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72e5cca700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e00b29e0 con 0x7f72e00b37a0 2024-09-13T17:08:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72dffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f72e00b4b60 0x7f72e015d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72e4cc8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f72e01506b0 0x7f72e00b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:40218/0 (socket says 172.21.15.123:40218) 2024-09-13T17:08:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72e4cc8700 1 -- 172.21.15.123:0/2702070808 learned_addr learned my addr 172.21.15.123:0/2702070808 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72e54c9700 1 --2- 172.21.15.123:0/2702070808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e00b37a0 0x7f72e015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72dffff700 1 -- 172.21.15.123:0/2702070808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e00b37a0 msgr2=0x7f72e015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72dffff700 1 --2- 172.21.15.123:0/2702070808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e00b37a0 0x7f72e015da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72dffff700 1 -- 172.21.15.123:0/2702070808 >> v1:172.21.15.153:6789/0 conn(0x7f72e01506b0 legacy=0x7f72e00b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72dffff700 1 -- 172.21.15.123:0/2702070808 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e00b2cc0 con 0x7f72e00b4b60 2024-09-13T17:08:44.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72dffff700 1 --2- 172.21.15.123:0/2702070808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00b4b60 0x7f72e015d4c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009850 tx=0x7f72cc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d35c78576a6a50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:44.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72df7fe700 1 -- 172.21.15.123:0/2702070808 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc011830 con 0x7f72e00b4b60 2024-09-13T17:08:44.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72df7fe700 1 -- 172.21.15.123:0/2702070808 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc011990 con 0x7f72e00b4b60 2024-09-13T17:08:44.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72df7fe700 1 -- 172.21.15.123:0/2702070808 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc011d40 con 0x7f72e00b4b60 2024-09-13T17:08:44.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72e5cca700 1 -- 172.21.15.123:0/2702070808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00b4b60 msgr2=0x7f72e015d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.071+0000 7f72e5cca700 1 --2- 172.21.15.123:0/2702070808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00b4b60 0x7f72e015d4c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009850 tx=0x7f72cc009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:44.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.075+0000 7f72e5cca700 1 -- 172.21.15.123:0/2702070808 shutdown_connections 2024-09-13T17:08:44.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.075+0000 7f72e5cca700 1 --2- 172.21.15.123:0/2702070808 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e00b37a0 0x7f72e015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.075+0000 7f72e5cca700 1 --2- 172.21.15.123:0/2702070808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00b4b60 0x7f72e015d4c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.075+0000 7f72e5cca700 1 -- 172.21.15.123:0/2702070808 >> 172.21.15.123:0/2702070808 conn(0x7f72e0066780 msgr2=0x7f72e00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:44.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.075+0000 7f72e5cca700 1 -- 172.21.15.123:0/2702070808 shutdown_connections 2024-09-13T17:08:44.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.075+0000 7f72e5cca700 1 -- 172.21.15.123:0/2702070808 wait complete. 2024-09-13T17:08:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.075+0000 7f72e5cca700 1 Processor -- start 2024-09-13T17:08:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.075+0000 7f72e5cca700 1 -- start start 2024-09-13T17:08:44.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72e5cca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00b37a0 0x7f72e01eeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72e5cca700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e00b4b60 0x7f72e01f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72e5cca700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e01506b0 0x7f72e015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72e5cca700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e01ef660 con 0x7f72e01506b0 2024-09-13T17:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72e5cca700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e01ef030 con 0x7f72e00b37a0 2024-09-13T17:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72e5cca700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e01f2fb0 con 0x7f72e00b4b60 2024-09-13T17:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72e54c9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e01506b0 0x7f72e015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72dffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e00b4b60 0x7f72e01f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72e4cc8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00b37a0 0x7f72e01eeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72e54c9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e01506b0 0x7f72e015bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40920/0 (socket says 172.21.15.123:40920) 2024-09-13T17:08:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72dffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e00b4b60 0x7f72e01f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:50368/0 (socket says 172.21.15.123:50368) 2024-09-13T17:08:44.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72e54c9700 1 -- 172.21.15.123:0/441990364 learned_addr learned my addr 172.21.15.123:0/441990364 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:44.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72dffff700 1 -- 172.21.15.123:0/441990364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00b37a0 msgr2=0x7f72e01eeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72dffff700 1 --2- 172.21.15.123:0/441990364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00b37a0 0x7f72e01eeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72dffff700 1 -- 172.21.15.123:0/441990364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e01506b0 msgr2=0x7f72e015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72dffff700 1 --2- 172.21.15.123:0/441990364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e01506b0 0x7f72e015bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72dffff700 1 -- 172.21.15.123:0/441990364 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc0094b0 con 0x7f72e00b4b60 2024-09-13T17:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72e4cc8700 1 --2- 172.21.15.123:0/441990364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00b37a0 0x7f72e01eeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72e54c9700 1 --2- 172.21.15.123:0/441990364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e01506b0 0x7f72e015bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72dffff700 1 --2- 172.21.15.123:0/441990364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e00b4b60 0x7f72e01f2760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f72cc016000 tx=0x7f72cc004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72dd7fa700 1 -- 172.21.15.123:0/441990364 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0036c0 con 0x7f72e00b4b60 2024-09-13T17:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72e5cca700 1 -- 172.21.15.123:0/441990364 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e01f3290 con 0x7f72e00b4b60 2024-09-13T17:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72dd7fa700 1 -- 172.21.15.123:0/441990364 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc01e070 con 0x7f72e00b4b60 2024-09-13T17:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72dd7fa700 1 -- 172.21.15.123:0/441990364 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc003a60 con 0x7f72e00b4b60 2024-09-13T17:08:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.079+0000 7f72e5cca700 1 -- 172.21.15.123:0/441990364 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e01f2ca0 con 0x7f72e00b4b60 2024-09-13T17:08:44.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.083+0000 7f72e5cca700 1 -- 172.21.15.123:0/441990364 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e01ef7a0 con 0x7f72e00b4b60 2024-09-13T17:08:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.083+0000 7f72dd7fa700 1 -- 172.21.15.123:0/441990364 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72cc003bc0 con 0x7f72e00b4b60 2024-09-13T17:08:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.087+0000 7f72dd7fa700 1 --2- 172.21.15.123:0/441990364 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f72c4066760 0x7f72c4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.087+0000 7f72dd7fa700 1 -- 172.21.15.123:0/441990364 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f72cc085050 con 0x7f72e00b4b60 2024-09-13T17:08:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.087+0000 7f72e4cc8700 1 --2- 172.21.15.123:0/441990364 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f72c4066760 0x7f72c4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.087+0000 7f72e4cc8700 1 --2- 172.21.15.123:0/441990364 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f72c4066760 0x7f72c4068c20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f72d4005930 tx=0x7f72d4007f70 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:44.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.095+0000 7f72dd7fa700 1 -- 172.21.15.123:0/441990364 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72cc0526b0 con 0x7f72e00b4b60 2024-09-13T17:08:44.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.267+0000 7f72e5cca700 1 -- 172.21.15.123:0/441990364 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f72e01ef7a0 con 0x7f72e00b4b60 2024-09-13T17:08:44.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.279+0000 7f72dd7fa700 1 -- 172.21.15.123:0/441990364 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72e01ef7a0 con 0x7f72e00b4b60 2024-09-13T17:08:44.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.279+0000 7f72e5cca700 1 -- 172.21.15.123:0/441990364 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f72c4066760 msgr2=0x7f72c4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.279+0000 7f72e5cca700 1 --2- 172.21.15.123:0/441990364 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f72c4066760 0x7f72c4068c20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f72d4005930 tx=0x7f72d4007f70 comp rx=0 tx=0).stop 2024-09-13T17:08:44.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.279+0000 7f72e5cca700 1 -- 172.21.15.123:0/441990364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e00b4b60 msgr2=0x7f72e01f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.279+0000 7f72e5cca700 1 --2- 172.21.15.123:0/441990364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e00b4b60 0x7f72e01f2760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f72cc016000 tx=0x7f72cc004770 comp rx=0 tx=0).stop 2024-09-13T17:08:44.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.279+0000 7f72e5cca700 1 -- 172.21.15.123:0/441990364 shutdown_connections 2024-09-13T17:08:44.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.279+0000 7f72e5cca700 1 --2- 172.21.15.123:0/441990364 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f72c4066760 0x7f72c4068c20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.279+0000 7f72e5cca700 1 --2- 172.21.15.123:0/441990364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72e01506b0 0x7f72e015bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.279+0000 7f72e5cca700 1 --2- 172.21.15.123:0/441990364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72e00b4b60 0x7f72e01f2760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.279+0000 7f72e5cca700 1 --2- 172.21.15.123:0/441990364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72e00b37a0 0x7f72e01eeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.279+0000 7f72e5cca700 1 -- 172.21.15.123:0/441990364 >> 172.21.15.123:0/441990364 conn(0x7f72e0066780 msgr2=0x7f72e0158de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:44.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.279+0000 7f72e5cca700 1 -- 172.21.15.123:0/441990364 shutdown_connections 2024-09-13T17:08:44.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.279+0000 7f72e5cca700 1 -- 172.21.15.123:0/441990364 wait complete. 2024-09-13T17:08:44.299 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:08:44.299 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:08:44.318 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:08:44.338 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:08:44.338 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:08:44.338 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:44.345 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:08:44.346 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:08:44.346 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:44.353 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:08:44.353 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:08:44.353 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:44.396 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:08:44.396 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:08:44.397 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:08:44.406 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:08:44.406 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T17:08:44.407 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:08:44.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e69f8700 1 Processor -- start 2024-09-13T17:08:44.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e69f8700 1 -- start start 2024-09-13T17:08:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e69f8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff0d80376d0 0x7ff0d8005e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e69f8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d803bc40 con 0x7ff0d80e6170 2024-09-13T17:08:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e69f8700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d8057e90 con 0x7ff0d8006340 2024-09-13T17:08:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e69f8700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d8056d80 con 0x7ff0d80376d0 2024-09-13T17:08:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e59f6700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff0d80e6170 0x7ff0d8058320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40736/0 (socket says 172.21.15.123:40736) 2024-09-13T17:08:44.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e59f6700 1 -- 172.21.15.123:0/1185709645 learned_addr learned my addr 172.21.15.123:0/1185709645 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:44.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e51f5700 1 --2- 172.21.15.123:0/1185709645 >> v2:172.21.15.153:3300/0 conn(0x7ff0d80376d0 0x7ff0d8005e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e49f4700 1 -- 172.21.15.123:0/1185709645 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946863417 0 0) 0x7ff0d803bc40 con 0x7ff0d80e6170 2024-09-13T17:08:44.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e49f4700 1 -- 172.21.15.123:0/1185709645 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0cc0035d0 con 0x7ff0d80e6170 2024-09-13T17:08:44.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e49f4700 1 -- 172.21.15.123:0/1185709645 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266518911 0 0) 0x7ff0d8057e90 con 0x7ff0d8006340 2024-09-13T17:08:44.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e49f4700 1 -- 172.21.15.123:0/1185709645 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d803bc40 con 0x7ff0d8006340 2024-09-13T17:08:44.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e51f5700 1 -- 172.21.15.123:0/1185709645 >> v1:172.21.15.153:6789/0 conn(0x7ff0d8006340 legacy=0x7ff0d80e6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e51f5700 1 -- 172.21.15.123:0/1185709645 >> v1:172.21.15.123:6789/0 conn(0x7ff0d80e6170 legacy=0x7ff0d8058320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e49f4700 1 -- 172.21.15.123:0/1185709645 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1854899261 0 0) 0x7ff0cc0035d0 con 0x7ff0d80e6170 2024-09-13T17:08:44.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e51f5700 1 -- 172.21.15.123:0/1185709645 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d80567c0 con 0x7ff0d80376d0 2024-09-13T17:08:44.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e51f5700 1 --2- 172.21.15.123:0/1185709645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d80376d0 0x7ff0d8005e00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009850 tx=0x7ff0d0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e722f259b242eff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:44.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e49f4700 1 -- 172.21.15.123:0/1185709645 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e004ec20 con 0x7ff0d80376d0 2024-09-13T17:08:44.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e49f4700 1 -- 172.21.15.123:0/1185709645 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d0004030 con 0x7ff0d80376d0 2024-09-13T17:08:44.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.527+0000 7ff0e49f4700 1 -- 172.21.15.123:0/1185709645 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00043e0 con 0x7ff0d80376d0 2024-09-13T17:08:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1185709645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d80376d0 msgr2=0x7ff0d8005e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 --2- 172.21.15.123:0/1185709645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d80376d0 0x7ff0d8005e00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009850 tx=0x7ff0d0009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1185709645 shutdown_connections 2024-09-13T17:08:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 --2- 172.21.15.123:0/1185709645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d80376d0 0x7ff0d8005e00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1185709645 >> 172.21.15.123:0/1185709645 conn(0x7ff0d803a5d0 msgr2=0x7ff0d803a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1185709645 shutdown_connections 2024-09-13T17:08:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1185709645 wait complete. 2024-09-13T17:08:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 Processor -- start 2024-09-13T17:08:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 -- start start 2024-09-13T17:08:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0d8006340 0x7ff0d80d72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d80376d0 0x7ff0d8036d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0d80e6170 0x7ff0d80d48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d817bc80 con 0x7ff0d80e6170 2024-09-13T17:08:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80d78a0 con 0x7ff0d80376d0 2024-09-13T17:08:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e69f8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80d7b80 con 0x7ff0d8006340 2024-09-13T17:08:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.531+0000 7ff0e61f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0d80e6170 0x7ff0d80d48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0e59f6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0d8006340 0x7ff0d80d72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0e61f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0d80e6170 0x7ff0d80d48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40934/0 (socket says 172.21.15.123:40934) 2024-09-13T17:08:44.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0e61f7700 1 -- 172.21.15.123:0/1206793169 learned_addr learned my addr 172.21.15.123:0/1206793169 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:44.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0e51f5700 1 --2- 172.21.15.123:0/1206793169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d80376d0 0x7ff0d8036d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0e61f7700 1 -- 172.21.15.123:0/1206793169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0d8006340 msgr2=0x7ff0d80d72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0e61f7700 1 --2- 172.21.15.123:0/1206793169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0d8006340 0x7ff0d80d72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0e61f7700 1 -- 172.21.15.123:0/1206793169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d80376d0 msgr2=0x7ff0d8036d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0e61f7700 1 --2- 172.21.15.123:0/1206793169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d80376d0 0x7ff0d8036d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0e61f7700 1 -- 172.21.15.123:0/1206793169 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d00094b0 con 0x7ff0d80e6170 2024-09-13T17:08:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0e61f7700 1 --2- 172.21.15.123:0/1206793169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0d80e6170 0x7ff0d80d48c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00c500 tx=0x7ff0dc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0d67fc700 1 -- 172.21.15.123:0/1206793169 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0052d0 con 0x7ff0d80e6170 2024-09-13T17:08:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0d67fc700 1 -- 172.21.15.123:0/1206793169 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc005430 con 0x7ff0d80e6170 2024-09-13T17:08:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1206793169 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d80d7e60 con 0x7ff0d80e6170 2024-09-13T17:08:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0d67fc700 1 -- 172.21.15.123:0/1206793169 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0055a0 con 0x7ff0d80e6170 2024-09-13T17:08:44.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1206793169 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d80db480 con 0x7ff0d80e6170 2024-09-13T17:08:44.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1206793169 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d817bdf0 con 0x7ff0d80e6170 2024-09-13T17:08:44.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.535+0000 7ff0d67fc700 1 -- 172.21.15.123:0/1206793169 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff0dc0038e0 con 0x7ff0d80e6170 2024-09-13T17:08:44.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.539+0000 7ff0d67fc700 1 --2- 172.21.15.123:0/1206793169 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff0c4066730 0x7ff0c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.539+0000 7ff0d67fc700 1 -- 172.21.15.123:0/1206793169 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff0dc083250 con 0x7ff0d80e6170 2024-09-13T17:08:44.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.539+0000 7ff0e59f6700 1 --2- 172.21.15.123:0/1206793169 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff0c4066730 0x7ff0c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.539+0000 7ff0e59f6700 1 --2- 172.21.15.123:0/1206793169 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff0c4066730 0x7ff0c4068bf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0000b60 tx=0x7ff0e008c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:44.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.543+0000 7ff0d67fc700 1 -- 172.21.15.123:0/1206793169 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff0dc050980 con 0x7ff0d80e6170 2024-09-13T17:08:44.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.747+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1206793169 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0d8005e00 con 0x7ff0d80e6170 2024-09-13T17:08:44.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.751+0000 7ff0d67fc700 1 -- 172.21.15.123:0/1206793169 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3535 (secure 0 0 0) 0x7ff0dc017de0 con 0x7ff0d80e6170 2024-09-13T17:08:44.755 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:44.756 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5602,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3264962321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3264962321},{"type":"v1","addr":"172.21.15.153:6833","nonce":3264962321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5605,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1200497874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1200497874},{"type":"v1","addr":"172.21.15.153:6835","nonce":1200497874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/398437513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":398437513},{"type":"v1","addr":"172.21.15.123:6835","nonce":398437513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":6039,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/274288543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":274288543},{"type":"v1","addr":"172.21.15.123:6837","nonce":274288543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[]} 2024-09-13T17:08:44.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.751+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1206793169 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff0c4066730 msgr2=0x7ff0c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.751+0000 7ff0e69f8700 1 --2- 172.21.15.123:0/1206793169 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff0c4066730 0x7ff0c4068bf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0000b60 tx=0x7ff0e008c040 comp rx=0 tx=0).stop 2024-09-13T17:08:44.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.751+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1206793169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0d80e6170 msgr2=0x7ff0d80d48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.751+0000 7ff0e69f8700 1 --2- 172.21.15.123:0/1206793169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0d80e6170 0x7ff0d80d48c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00c500 tx=0x7ff0dc00c810 comp rx=0 tx=0).stop 2024-09-13T17:08:44.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.751+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1206793169 shutdown_connections 2024-09-13T17:08:44.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.751+0000 7ff0e69f8700 1 --2- 172.21.15.123:0/1206793169 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff0c4066730 0x7ff0c4068bf0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.751+0000 7ff0e69f8700 1 --2- 172.21.15.123:0/1206793169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0d80e6170 0x7ff0d80d48c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.751+0000 7ff0e69f8700 1 --2- 172.21.15.123:0/1206793169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d80376d0 0x7ff0d8036d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.751+0000 7ff0e69f8700 1 --2- 172.21.15.123:0/1206793169 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0d8006340 0x7ff0d80d72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.751+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1206793169 >> 172.21.15.123:0/1206793169 conn(0x7ff0d803a5d0 msgr2=0x7ff0d800e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:44.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.751+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1206793169 shutdown_connections 2024-09-13T17:08:44.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.751+0000 7ff0e69f8700 1 -- 172.21.15.123:0/1206793169 wait complete. 2024-09-13T17:08:44.761 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 23 2024-09-13T17:08:44.771 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:08:44.771 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:08:44.772 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:08:44.772 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:08:44.772 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:08:44.773 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:08:44.773 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:08:44.773 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:08:44.774 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:08:44.774 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:08:44.774 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:08:44.774 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:08:44.774 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:08:44.774 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:08:44.775 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:08:44.775 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:08:44.786 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:08:44.787 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:08:44.788 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:08:44.788 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:08:44.793 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:08:44.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:08:44.794 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:08:44.794 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:08:44.795 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:08:44.796 DEBUG:teuthology.parallel:result is None 2024-09-13T17:08:44.796 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:08:44.797 DEBUG:teuthology.parallel:result is None 2024-09-13T17:08:44.831 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:08:44.831 DEBUG:teuthology.parallel:result is None 2024-09-13T17:08:44.832 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:08:44.832 DEBUG:teuthology.parallel:result is None 2024-09-13T17:08:44.833 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T17:08:44.873 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-09-13T17:08:44.874 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-09-13T17:08:44.908 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-13T17:08:44.915 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-13T17:08:44.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f37815ad700 1 Processor -- start 2024-09-13T17:08:44.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f37815ad700 1 -- start start 2024-09-13T17:08:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f37815ad700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f377c0cce60 0x7f377c0af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f37815ad700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c0afe40 con 0x7f377c159ba0 2024-09-13T17:08:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f37815ad700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c0cd3b0 con 0x7f377c0afa10 2024-09-13T17:08:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f37815ad700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c06db00 con 0x7f377c0cce60 2024-09-13T17:08:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f377affd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f377c159ba0 0x7f377c06d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40740/0 (socket says 172.21.15.123:40740) 2024-09-13T17:08:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f377affd700 1 -- 172.21.15.123:0/1557708836 learned_addr learned my addr 172.21.15.123:0/1557708836 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f377a7fc700 1 --2- 172.21.15.123:0/1557708836 >> v2:172.21.15.123:3300/0 conn(0x7f377c0cce60 0x7f377c0af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f3779ffb700 1 -- 172.21.15.123:0/1557708836 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016667734 0 0) 0x7f377c0afe40 con 0x7f377c159ba0 2024-09-13T17:08:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f3779ffb700 1 -- 172.21.15.123:0/1557708836 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37640035d0 con 0x7f377c159ba0 2024-09-13T17:08:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f377a7fc700 1 -- 172.21.15.123:0/1557708836 >> v1:172.21.15.153:6789/0 conn(0x7f377c0afa10 legacy=0x7f377c0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f3779ffb700 1 -- 172.21.15.123:0/1557708836 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968782480 0 0) 0x7f377c0cd3b0 con 0x7f377c0afa10 2024-09-13T17:08:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f377a7fc700 1 -- 172.21.15.123:0/1557708836 >> v1:172.21.15.123:6789/0 conn(0x7f377c159ba0 legacy=0x7f377c06d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.939+0000 7f377a7fc700 1 -- 172.21.15.123:0/1557708836 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0cd690 con 0x7f377c0cce60 2024-09-13T17:08:44.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.943+0000 7f377a7fc700 1 --2- 172.21.15.123:0/1557708836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f377c0cce60 0x7f377c0af4d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3770009850 tx=0x7f3770009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dea809c859b9fda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:44.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.943+0000 7f3779ffb700 1 -- 172.21.15.123:0/1557708836 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770011830 con 0x7f377c0cce60 2024-09-13T17:08:44.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.943+0000 7f3779ffb700 1 -- 172.21.15.123:0/1557708836 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770011990 con 0x7f377c0cce60 2024-09-13T17:08:44.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.943+0000 7f3779ffb700 1 -- 172.21.15.123:0/1557708836 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770011d40 con 0x7f377c0cce60 2024-09-13T17:08:44.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.943+0000 7f37815ad700 1 -- 172.21.15.123:0/1557708836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f377c0cce60 msgr2=0x7f377c0af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.943+0000 7f37815ad700 1 --2- 172.21.15.123:0/1557708836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f377c0cce60 0x7f377c0af4d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3770009850 tx=0x7f3770009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:44.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.943+0000 7f37815ad700 1 -- 172.21.15.123:0/1557708836 shutdown_connections 2024-09-13T17:08:44.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.943+0000 7f37815ad700 1 --2- 172.21.15.123:0/1557708836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f377c0cce60 0x7f377c0af4d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.943+0000 7f37815ad700 1 -- 172.21.15.123:0/1557708836 >> 172.21.15.123:0/1557708836 conn(0x7f377c0b0450 msgr2=0x7f377c0b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:44.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.943+0000 7f37815ad700 1 -- 172.21.15.123:0/1557708836 shutdown_connections 2024-09-13T17:08:44.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.943+0000 7f37815ad700 1 -- 172.21.15.123:0/1557708836 wait complete. 2024-09-13T17:08:44.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.943+0000 7f37815ad700 1 Processor -- start 2024-09-13T17:08:44.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.943+0000 7f37815ad700 1 -- start start 2024-09-13T17:08:44.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f37815ad700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f377c0afa10 0x7f377c1f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f37815ad700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f377c0cce60 0x7f377c0b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f37815ad700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f377c159ba0 0x7f377c0c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f37815ad700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0c7610 con 0x7f377c0afa10 2024-09-13T17:08:44.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f37815ad700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0c6a40 con 0x7f377c0cce60 2024-09-13T17:08:44.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f37815ad700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0c6ce0 con 0x7f377c159ba0 2024-09-13T17:08:44.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f377affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f377c0afa10 0x7f377c1f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f377affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f377c0afa10 0x7f377c1f2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40984/0 (socket says 172.21.15.123:40984) 2024-09-13T17:08:44.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f377affd700 1 -- 172.21.15.123:0/1385157471 learned_addr learned my addr 172.21.15.123:0/1385157471 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:44.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f377a7fc700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f377c0cce60 0x7f377c0b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f377b7fe700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f377c159ba0 0x7f377c0c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f377affd700 1 -- 172.21.15.123:0/1385157471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f377c159ba0 msgr2=0x7f377c0c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f377affd700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f377c159ba0 0x7f377c0c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f377affd700 1 -- 172.21.15.123:0/1385157471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f377c0cce60 msgr2=0x7f377c0b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:44.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f377affd700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f377c0cce60 0x7f377c0b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:44.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f377affd700 1 -- 172.21.15.123:0/1385157471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37700094b0 con 0x7f377c0afa10 2024-09-13T17:08:44.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f377b7fe700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f377c159ba0 0x7f377c0c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:44.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f377affd700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f377c0afa10 0x7f377c1f2220 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f376c00c4d0 tx=0x7f376c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:44.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f37637fe700 1 -- 172.21.15.123:0/1385157471 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0011d0 con 0x7f377c0afa10 2024-09-13T17:08:44.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f37637fe700 1 -- 172.21.15.123:0/1385157471 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c005d90 con 0x7f377c0afa10 2024-09-13T17:08:44.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f37637fe700 1 -- 172.21.15.123:0/1385157471 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0072d0 con 0x7f377c0afa10 2024-09-13T17:08:44.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f37815ad700 1 -- 172.21.15.123:0/1385157471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c0c6fc0 con 0x7f377c0afa10 2024-09-13T17:08:44.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f37815ad700 1 -- 172.21.15.123:0/1385157471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c1f2760 con 0x7f377c0afa10 2024-09-13T17:08:44.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.947+0000 7f37815ad700 1 -- 172.21.15.123:0/1385157471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c0ae0a0 con 0x7f377c0afa10 2024-09-13T17:08:44.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.951+0000 7f37637fe700 1 -- 172.21.15.123:0/1385157471 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f376c007430 con 0x7f377c0afa10 2024-09-13T17:08:44.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.951+0000 7f37637fe700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3768066730 0x7f3768068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:44.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.951+0000 7f37637fe700 1 -- 172.21.15.123:0/1385157471 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f376c0831e0 con 0x7f377c0afa10 2024-09-13T17:08:44.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.951+0000 7f377a7fc700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3768066730 0x7f3768068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:44.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.951+0000 7f377a7fc700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3768066730 0x7f3768068bf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f37700090b0 tx=0x7f3770008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:44.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:44.959+0000 7f37637fe700 1 -- 172.21.15.123:0/1385157471 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f376c050900 con 0x7f377c0afa10 2024-09-13T17:08:45.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:45.139+0000 7f37815ad700 1 -- 172.21.15.123:0/1385157471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f377c06f960 con 0x7f377c0afa10 2024-09-13T17:08:45.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:45.935+0000 7f37637fe700 1 -- 172.21.15.123:0/1385157471 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) v1 ==== 97+0+0 (secure 0 0 0) 0x7f376c053f20 con 0x7f377c0afa10 2024-09-13T17:08:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:45.939+0000 7f37815ad700 1 -- 172.21.15.123:0/1385157471 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3768066730 msgr2=0x7f3768068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:45.939+0000 7f37815ad700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3768066730 0x7f3768068bf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f37700090b0 tx=0x7f3770008030 comp rx=0 tx=0).stop 2024-09-13T17:08:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:45.939+0000 7f37815ad700 1 -- 172.21.15.123:0/1385157471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f377c0afa10 msgr2=0x7f377c1f2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:45.939+0000 7f37815ad700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f377c0afa10 0x7f377c1f2220 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f376c00c4d0 tx=0x7f376c00c890 comp rx=0 tx=0).stop 2024-09-13T17:08:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:45.939+0000 7f37815ad700 1 -- 172.21.15.123:0/1385157471 shutdown_connections 2024-09-13T17:08:45.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:45.939+0000 7f37815ad700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3768066730 0x7f3768068bf0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:45.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:45.939+0000 7f37815ad700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f377c159ba0 0x7f377c0c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:45.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:45.939+0000 7f37815ad700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f377c0cce60 0x7f377c0b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:45.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:45.939+0000 7f37815ad700 1 --2- 172.21.15.123:0/1385157471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f377c0afa10 0x7f377c1f2220 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:45.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:45.939+0000 7f37815ad700 1 -- 172.21.15.123:0/1385157471 >> 172.21.15.123:0/1385157471 conn(0x7f377c0b0450 msgr2=0x7f377c0c4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:45.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:45.939+0000 7f37815ad700 1 -- 172.21.15.123:0/1385157471 shutdown_connections 2024-09-13T17:08:45.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:45.939+0000 7f37815ad700 1 -- 172.21.15.123:0/1385157471 wait complete. 2024-09-13T17:08:45.946 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-13T17:08:45.961 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T17:08:46.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.071+0000 7fb719034700 1 Processor -- start 2024-09-13T17:08:46.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.071+0000 7fb719034700 1 -- start start 2024-09-13T17:08:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb719034700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb7140d3670 0x7fb7141614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb719034700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb7140ce850 0x7fb7140c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb719034700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7140d1130 con 0x7fb7140cf600 2024-09-13T17:08:46.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb719034700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7140c9aa0 con 0x7fb7140d3670 2024-09-13T17:08:46.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb719034700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7140d1c20 con 0x7fb7140ce850 2024-09-13T17:08:46.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb70b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb7140d3670 0x7fb7141614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb713fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb7140cf600 0x7fb714160d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40750/0 (socket says 172.21.15.123:40750) 2024-09-13T17:08:46.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb713fff700 1 -- 172.21.15.123:0/3179650783 learned_addr learned my addr 172.21.15.123:0/3179650783 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:46.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb718833700 1 --2- 172.21.15.123:0/3179650783 >> v2:172.21.15.153:3300/0 conn(0x7fb7140ce850 0x7fb7140c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb70b7fe700 1 -- 172.21.15.123:0/3179650783 >> v2:172.21.15.153:3300/0 conn(0x7fb7140ce850 msgr2=0x7fb7140c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:46.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb70b7fe700 1 --2- 172.21.15.123:0/3179650783 >> v2:172.21.15.153:3300/0 conn(0x7fb7140ce850 0x7fb7140c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb70b7fe700 1 -- 172.21.15.123:0/3179650783 >> v1:172.21.15.123:6789/0 conn(0x7fb7140cf600 legacy=0x7fb714160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb70b7fe700 1 -- 172.21.15.123:0/3179650783 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7140d1380 con 0x7fb7140d3670 2024-09-13T17:08:46.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb718833700 1 --2- 172.21.15.123:0/3179650783 >> v2:172.21.15.153:3300/0 conn(0x7fb7140ce850 0x7fb7140c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:46.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb70b7fe700 1 --2- 172.21.15.123:0/3179650783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7140d3670 0x7fb7141614a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009850 tx=0x7fb6fc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5ac63b8fae7185 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:46.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb7137fe700 1 -- 172.21.15.123:0/3179650783 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc011830 con 0x7fb7140d3670 2024-09-13T17:08:46.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb7137fe700 1 -- 172.21.15.123:0/3179650783 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc011990 con 0x7fb7140d3670 2024-09-13T17:08:46.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb7137fe700 1 -- 172.21.15.123:0/3179650783 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc011d20 con 0x7fb7140d3670 2024-09-13T17:08:46.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb719034700 1 -- 172.21.15.123:0/3179650783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7140d3670 msgr2=0x7fb7141614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb719034700 1 --2- 172.21.15.123:0/3179650783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7140d3670 0x7fb7141614a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009850 tx=0x7fb6fc009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:46.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb719034700 1 -- 172.21.15.123:0/3179650783 shutdown_connections 2024-09-13T17:08:46.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb719034700 1 --2- 172.21.15.123:0/3179650783 >> v2:172.21.15.153:3300/0 conn(0x7fb7140ce850 0x7fb7140c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb719034700 1 --2- 172.21.15.123:0/3179650783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7140d3670 0x7fb7141614a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb719034700 1 -- 172.21.15.123:0/3179650783 >> 172.21.15.123:0/3179650783 conn(0x7fb7140d2b50 msgr2=0x7fb7140d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:46.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb719034700 1 -- 172.21.15.123:0/3179650783 shutdown_connections 2024-09-13T17:08:46.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.075+0000 7fb719034700 1 -- 172.21.15.123:0/3179650783 wait complete. 2024-09-13T17:08:46.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb719034700 1 Processor -- start 2024-09-13T17:08:46.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb719034700 1 -- start start 2024-09-13T17:08:46.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb719034700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7140ce850 0x7fb71415a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb719034700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7140cf600 0x7fb71415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb719034700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714160080 0x7fb71409c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb719034700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140c78b0 con 0x7fb7140cf600 2024-09-13T17:08:46.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb719034700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71415bfd0 con 0x7fb714160080 2024-09-13T17:08:46.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb719034700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140a0570 con 0x7fb7140ce850 2024-09-13T17:08:46.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb70b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7140cf600 0x7fb71415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb70b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7140cf600 0x7fb71415ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40994/0 (socket says 172.21.15.123:40994) 2024-09-13T17:08:46.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb70b7fe700 1 -- 172.21.15.123:0/2195425904 learned_addr learned my addr 172.21.15.123:0/2195425904 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:46.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb718833700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714160080 0x7fb71409c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb713fff700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7140ce850 0x7fb71415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb70b7fe700 1 -- 172.21.15.123:0/2195425904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7140ce850 msgr2=0x7fb71415a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb70b7fe700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7140ce850 0x7fb71415a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb70b7fe700 1 -- 172.21.15.123:0/2195425904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714160080 msgr2=0x7fb71409c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb70b7fe700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714160080 0x7fb71409c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb70b7fe700 1 -- 172.21.15.123:0/2195425904 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc0094b0 con 0x7fb7140cf600 2024-09-13T17:08:46.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb713fff700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7140ce850 0x7fb71415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:46.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb70b7fe700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7140cf600 0x7fb71415ba90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc000c00 tx=0x7fb6fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:46.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb7117fa700 1 -- 172.21.15.123:0/2195425904 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc0036c0 con 0x7fb7140cf600 2024-09-13T17:08:46.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb7117fa700 1 -- 172.21.15.123:0/2195425904 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc01e070 con 0x7fb7140cf600 2024-09-13T17:08:46.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb7117fa700 1 -- 172.21.15.123:0/2195425904 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc003a20 con 0x7fb7140cf600 2024-09-13T17:08:46.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb719034700 1 -- 172.21.15.123:0/2195425904 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7140c72f0 con 0x7fb7140cf600 2024-09-13T17:08:46.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.079+0000 7fb719034700 1 -- 172.21.15.123:0/2195425904 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7140a0200 con 0x7fb7140cf600 2024-09-13T17:08:46.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.083+0000 7fb719034700 1 -- 172.21.15.123:0/2195425904 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7140a0060 con 0x7fb7140cf600 2024-09-13T17:08:46.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.083+0000 7fb7117fa700 1 -- 172.21.15.123:0/2195425904 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb6fc003b80 con 0x7fb7140cf600 2024-09-13T17:08:46.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.083+0000 7fb7117fa700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb6f4066760 0x7fb6f4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.083+0000 7fb7117fa700 1 -- 172.21.15.123:0/2195425904 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb6fc084da0 con 0x7fb7140cf600 2024-09-13T17:08:46.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.083+0000 7fb713fff700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb6f4066760 0x7fb6f4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.083+0000 7fb713fff700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb6f4066760 0x7fb6f4068c20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb704000f60 tx=0x7fb704009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:46.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.091+0000 7fb7117fa700 1 -- 172.21.15.123:0/2195425904 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb7140a0060 con 0x7fb7140cf600 2024-09-13T17:08:46.308 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:08:46.311 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:08:46.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.327+0000 7fb719034700 1 -- 172.21.15.123:0/2195425904 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb7140a0720 con 0x7fb7140cf600 2024-09-13T17:08:46.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.327+0000 7fb7117fa700 1 -- 172.21.15.123:0/2195425904 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb7140a0720 con 0x7fb7140cf600 2024-09-13T17:08:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:46.331 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:08:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-13T17:08:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-13T17:08:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmcINWChAAjEdCM4Sk1OsLUQerqFqnGg==", 2024-09-13T17:08:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:08:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:08:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-13T17:08:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmesC1ERAA2ZS4r6KU9vqfDLLX+0kwwg==", 2024-09-13T17:08:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:08:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:08:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-13T17:08:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORm+dvcDRAA5o6AtNdAEM2RTXMTKTuwvA==", 2024-09-13T17:08:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:08:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:08:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-13T17:08:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmnFIgGBAAZbqUsdKOG1nN0iHsKRqyHA==", 2024-09-13T17:08:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:08:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:08:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-13T17:08:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDucORmpvNQEhAAg2TDxfqiCxv8rfzNXd8ghw==", 2024-09-13T17:08:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-13T17:08:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDxcORmnAU+FxAAxjWreGRwyuQT2RRMicHAXg==", 2024-09-13T17:08:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-13T17:08:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD0cORmMXQpGhAADjhpu3evLXhYS+YKeKf8WQ==", 2024-09-13T17:08:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD3cORmAo7hHxAA80EcAMAxPmMPuKxUg6RYhQ==", 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD9cORm2j1KCxAA57ClQVuoJdhuk76L4nPHVQ==", 2024-09-13T17:08:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAAceRmu5IeExAAyUOWIVy5i703n829U0KSuw==", 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-13T17:08:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQADceRmhiXfFhAAt6aAa3EUOvKclLyGEl84SA==", 2024-09-13T17:08:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-13T17:08:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAGceRmjYdfHBAAHn19wbVS72wMYHvMh+Cpyg==", 2024-09-13T17:08:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:08:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmieDjGxAA9C8qfFqgRul4Kzk+0+UMTA==", 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-13T17:08:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmJvUUJRAAQci63exaXrtjPfssFai1jw==", 2024-09-13T17:08:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:08:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:08:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:08:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-13T17:08:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmgbzRIRAA8VlhYQpFRQUNOo6nplFySA==", 2024-09-13T17:08:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:08:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:08:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:08:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-13T17:08:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmwT+9KhAASidrLfvv55brtJ3Mk+qdxA==", 2024-09-13T17:08:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:08:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:08:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:08:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:08:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDqcORmn/ceNxAAxs8e7/yGRB9oykHDFVQ0lA==", 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmFSRNBhAAbI1RASXCwIZPggcjMdXynw==", 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:08:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-13T17:08:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-13T17:08:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmLhAcAxAAHSNEbQ2dLEBPGDMMKc7dQQ==", 2024-09-13T17:08:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:08:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:08:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-13T17:08:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:08:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-13T17:08:46.345 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:08:46.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.327+0000 7fb719034700 1 -- 172.21.15.123:0/2195425904 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb6f4066760 msgr2=0x7fb6f4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.327+0000 7fb719034700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb6f4066760 0x7fb6f4068c20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb704000f60 tx=0x7fb704009040 comp rx=0 tx=0).stop 2024-09-13T17:08:46.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.327+0000 7fb719034700 1 -- 172.21.15.123:0/2195425904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7140cf600 msgr2=0x7fb71415ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.327+0000 7fb719034700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7140cf600 0x7fb71415ba90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc000c00 tx=0x7fb6fc004770 comp rx=0 tx=0).stop 2024-09-13T17:08:46.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.327+0000 7fb719034700 1 -- 172.21.15.123:0/2195425904 shutdown_connections 2024-09-13T17:08:46.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.327+0000 7fb719034700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb6f4066760 0x7fb6f4068c20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.327+0000 7fb719034700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714160080 0x7fb71409c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.327+0000 7fb719034700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7140cf600 0x7fb71415ba90 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.327+0000 7fb719034700 1 --2- 172.21.15.123:0/2195425904 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7140ce850 0x7fb71415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.331+0000 7fb719034700 1 -- 172.21.15.123:0/2195425904 >> 172.21.15.123:0/2195425904 conn(0x7fb7140d2b50 msgr2=0x7fb7140b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:46.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.331+0000 7fb719034700 1 -- 172.21.15.123:0/2195425904 shutdown_connections 2024-09-13T17:08:46.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.331+0000 7fb719034700 1 -- 172.21.15.123:0/2195425904 wait complete. 2024-09-13T17:08:46.347 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:46.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b9b62700 1 Processor -- start 2024-09-13T17:08:46.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b9b62700 1 -- start start 2024-09-13T17:08:46.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b9b62700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81b415cd60 0x7f81b40cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b9b62700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f81b40b1970 0x7f81b40ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b9b62700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b40d1780 con 0x7f81b40b1fe0 2024-09-13T17:08:46.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b9b62700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b40d1c10 con 0x7f81b415cd60 2024-09-13T17:08:46.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b9b62700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b40d3670 con 0x7f81b40b1970 2024-09-13T17:08:46.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b8b60700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81b415cd60 0x7f81b40cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b8b60700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81b415cd60 0x7f81b40cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41004/0 (socket says 172.21.15.123:41004) 2024-09-13T17:08:46.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b8b60700 1 -- 172.21.15.123:0/3482963091 learned_addr learned my addr 172.21.15.123:0/3482963091 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:46.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b9361700 1 --2- 172.21.15.123:0/3482963091 >> v2:172.21.15.153:3300/0 conn(0x7f81b40b1970 0x7f81b40ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b8b60700 1 -- 172.21.15.123:0/3482963091 >> v2:172.21.15.153:3300/0 conn(0x7f81b40b1970 msgr2=0x7f81b40ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:46.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b8b60700 1 --2- 172.21.15.123:0/3482963091 >> v2:172.21.15.153:3300/0 conn(0x7f81b40b1970 0x7f81b40ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b8b60700 1 -- 172.21.15.123:0/3482963091 >> v1:172.21.15.153:6789/0 conn(0x7f81b40b1fe0 legacy=0x7f81b40af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b8b60700 1 -- 172.21.15.123:0/3482963091 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b40d3950 con 0x7f81b415cd60 2024-09-13T17:08:46.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b8b60700 1 --2- 172.21.15.123:0/3482963091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81b415cd60 0x7f81b40cf540 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f81b408d270 tx=0x7f81ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3218cc892d9840 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:46.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b37fe700 1 -- 172.21.15.123:0/3482963091 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00e070 con 0x7f81b415cd60 2024-09-13T17:08:46.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b37fe700 1 -- 172.21.15.123:0/3482963091 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac00b9c0 con 0x7f81b415cd60 2024-09-13T17:08:46.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b37fe700 1 -- 172.21.15.123:0/3482963091 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00bd70 con 0x7f81b415cd60 2024-09-13T17:08:46.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b9b62700 1 -- 172.21.15.123:0/3482963091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81b415cd60 msgr2=0x7f81b40cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.459+0000 7f81b9b62700 1 --2- 172.21.15.123:0/3482963091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81b415cd60 0x7f81b40cf540 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f81b408d270 tx=0x7f81ac00b330 comp rx=0 tx=0).stop 2024-09-13T17:08:46.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9b62700 1 -- 172.21.15.123:0/3482963091 shutdown_connections 2024-09-13T17:08:46.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9b62700 1 --2- 172.21.15.123:0/3482963091 >> v2:172.21.15.153:3300/0 conn(0x7f81b40b1970 0x7f81b40ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9b62700 1 --2- 172.21.15.123:0/3482963091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81b415cd60 0x7f81b40cf540 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9b62700 1 -- 172.21.15.123:0/3482963091 >> 172.21.15.123:0/3482963091 conn(0x7f81b40d2b50 msgr2=0x7f81b40d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:46.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9b62700 1 -- 172.21.15.123:0/3482963091 shutdown_connections 2024-09-13T17:08:46.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9b62700 1 -- 172.21.15.123:0/3482963091 wait complete. 2024-09-13T17:08:46.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9b62700 1 Processor -- start 2024-09-13T17:08:46.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9b62700 1 -- start start 2024-09-13T17:08:46.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9b62700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81b40b1970 0x7f81b415a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9b62700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81b40b1fe0 0x7f81b40c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9b62700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81b415cd60 0x7f81b40707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9b62700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b415aa60 con 0x7f81b415cd60 2024-09-13T17:08:46.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9b62700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b41f5d70 con 0x7f81b40b1fe0 2024-09-13T17:08:46.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9b62700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b41f6050 con 0x7f81b40b1970 2024-09-13T17:08:46.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9361700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81b415cd60 0x7f81b40707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9361700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81b415cd60 0x7f81b40707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41010/0 (socket says 172.21.15.123:41010) 2024-09-13T17:08:46.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b9361700 1 -- 172.21.15.123:0/3271951735 learned_addr learned my addr 172.21.15.123:0/3271951735 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:46.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b8b60700 1 --2- 172.21.15.123:0/3271951735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81b40b1970 0x7f81b415a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.463+0000 7f81b3fff700 1 --2- 172.21.15.123:0/3271951735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81b40b1fe0 0x7f81b40c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b9361700 1 -- 172.21.15.123:0/3271951735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81b40b1970 msgr2=0x7f81b415a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b9361700 1 --2- 172.21.15.123:0/3271951735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81b40b1970 0x7f81b415a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b9361700 1 -- 172.21.15.123:0/3271951735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81b40b1fe0 msgr2=0x7f81b40c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b9361700 1 --2- 172.21.15.123:0/3271951735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81b40b1fe0 0x7f81b40c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b9361700 1 -- 172.21.15.123:0/3271951735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac009b30 con 0x7f81b415cd60 2024-09-13T17:08:46.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b9361700 1 --2- 172.21.15.123:0/3271951735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81b415cd60 0x7f81b40707f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f81a400e810 tx=0x7f81a400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:46.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b17fa700 1 -- 172.21.15.123:0/3271951735 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a400c070 con 0x7f81b415cd60 2024-09-13T17:08:46.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b17fa700 1 -- 172.21.15.123:0/3271951735 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a4013650 con 0x7f81b415cd60 2024-09-13T17:08:46.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b17fa700 1 -- 172.21.15.123:0/3271951735 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4013a00 con 0x7f81b415cd60 2024-09-13T17:08:46.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b9b62700 1 -- 172.21.15.123:0/3271951735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b41f6330 con 0x7f81b415cd60 2024-09-13T17:08:46.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b9b62700 1 -- 172.21.15.123:0/3271951735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b40b35e0 con 0x7f81b415cd60 2024-09-13T17:08:46.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b9b62700 1 -- 172.21.15.123:0/3271951735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b40cf540 con 0x7f81b415cd60 2024-09-13T17:08:46.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b17fa700 1 -- 172.21.15.123:0/3271951735 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f81a4013b60 con 0x7f81b415cd60 2024-09-13T17:08:46.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b17fa700 1 --2- 172.21.15.123:0/3271951735 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8198066730 0x7f8198068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b17fa700 1 -- 172.21.15.123:0/3271951735 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f81a4083810 con 0x7f81b415cd60 2024-09-13T17:08:46.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.467+0000 7f81b8b60700 1 --2- 172.21.15.123:0/3271951735 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8198066730 0x7f8198068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.471+0000 7f81b8b60700 1 --2- 172.21.15.123:0/3271951735 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8198066730 0x7f8198068bf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f81ac000f80 tx=0x7f81ac009000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:46.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.475+0000 7f81b17fa700 1 -- 172.21.15.123:0/3271951735 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f81a4050ed0 con 0x7f81b415cd60 2024-09-13T17:08:46.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.647+0000 7f81b9b62700 1 -- 172.21.15.123:0/3271951735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81b40b37a0 con 0x7f81b415cd60 2024-09-13T17:08:46.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.651+0000 7f81b17fa700 1 -- 172.21.15.123:0/3271951735 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+12905 (secure 0 0 0) 0x7f81a40544f0 con 0x7f81b415cd60 2024-09-13T17:08:46.656 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:46.656 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":56,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:45.927099+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:46.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.651+0000 7f81b9b62700 1 -- 172.21.15.123:0/3271951735 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8198066730 msgr2=0x7f8198068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.651+0000 7f81b9b62700 1 --2- 172.21.15.123:0/3271951735 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8198066730 0x7f8198068bf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f81ac000f80 tx=0x7f81ac009000 comp rx=0 tx=0).stop 2024-09-13T17:08:46.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.651+0000 7f81b9b62700 1 -- 172.21.15.123:0/3271951735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81b415cd60 msgr2=0x7f81b40707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.651+0000 7f81b9b62700 1 --2- 172.21.15.123:0/3271951735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81b415cd60 0x7f81b40707f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f81a400e810 tx=0x7f81a400eb20 comp rx=0 tx=0).stop 2024-09-13T17:08:46.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.651+0000 7f81b9b62700 1 -- 172.21.15.123:0/3271951735 shutdown_connections 2024-09-13T17:08:46.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.651+0000 7f81b9b62700 1 --2- 172.21.15.123:0/3271951735 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8198066730 0x7f8198068bf0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.651+0000 7f81b9b62700 1 --2- 172.21.15.123:0/3271951735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81b415cd60 0x7f81b40707f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.651+0000 7f81b9b62700 1 --2- 172.21.15.123:0/3271951735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81b40b1fe0 0x7f81b40c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.651+0000 7f81b9b62700 1 --2- 172.21.15.123:0/3271951735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f81b40b1970 0x7f81b415a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.651+0000 7f81b9b62700 1 -- 172.21.15.123:0/3271951735 >> 172.21.15.123:0/3271951735 conn(0x7f81b40d2b50 msgr2=0x7f81b4071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:46.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.655+0000 7f81b9b62700 1 -- 172.21.15.123:0/3271951735 shutdown_connections 2024-09-13T17:08:46.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.655+0000 7f81b9b62700 1 -- 172.21.15.123:0/3271951735 wait complete. 2024-09-13T17:08:46.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:08:46.671 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:08:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.775+0000 7ff856b73700 1 Processor -- start 2024-09-13T17:08:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.775+0000 7ff856b73700 1 -- start start 2024-09-13T17:08:46.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff856b73700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff850071760 0x7ff8500b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff856b73700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff85006dc70 0x7ff8500cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff856b73700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8500cc030 con 0x7ff8501597c0 2024-09-13T17:08:46.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff856b73700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8500b2e60 con 0x7ff85006dc70 2024-09-13T17:08:46.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff856b73700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8500b17d0 con 0x7ff850071760 2024-09-13T17:08:46.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff856372700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff85006dc70 0x7ff8500cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff856372700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff85006dc70 0x7ff8500cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41024/0 (socket says 172.21.15.123:41024) 2024-09-13T17:08:46.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff856372700 1 -- 172.21.15.123:0/3846793150 learned_addr learned my addr 172.21.15.123:0/3846793150 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:46.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff855370700 1 --2- 172.21.15.123:0/3846793150 >> v2:172.21.15.153:3300/0 conn(0x7ff850071760 0x7ff8500b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff856372700 1 -- 172.21.15.123:0/3846793150 >> v2:172.21.15.153:3300/0 conn(0x7ff850071760 msgr2=0x7ff8500b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff856372700 1 --2- 172.21.15.123:0/3846793150 >> v2:172.21.15.153:3300/0 conn(0x7ff850071760 0x7ff8500b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff856372700 1 -- 172.21.15.123:0/3846793150 >> v1:172.21.15.153:6789/0 conn(0x7ff8501597c0 legacy=0x7ff850071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff856372700 1 -- 172.21.15.123:0/3846793150 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8500b25c0 con 0x7ff85006dc70 2024-09-13T17:08:46.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff856372700 1 --2- 172.21.15.123:0/3846793150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff85006dc70 0x7ff8500cc780 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff848009e50 tx=0x7ff84800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f32300e5350a29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:46.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff854b6f700 1 -- 172.21.15.123:0/3846793150 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84800e070 con 0x7ff85006dc70 2024-09-13T17:08:46.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff854b6f700 1 -- 172.21.15.123:0/3846793150 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84800b8d0 con 0x7ff85006dc70 2024-09-13T17:08:46.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.779+0000 7ff854b6f700 1 -- 172.21.15.123:0/3846793150 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84800bc80 con 0x7ff85006dc70 2024-09-13T17:08:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.783+0000 7ff856b73700 1 -- 172.21.15.123:0/3846793150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff85006dc70 msgr2=0x7ff8500cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.783+0000 7ff856b73700 1 --2- 172.21.15.123:0/3846793150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff85006dc70 0x7ff8500cc780 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff848009e50 tx=0x7ff84800b330 comp rx=0 tx=0).stop 2024-09-13T17:08:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.783+0000 7ff856b73700 1 -- 172.21.15.123:0/3846793150 shutdown_connections 2024-09-13T17:08:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.783+0000 7ff856b73700 1 --2- 172.21.15.123:0/3846793150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff85006dc70 0x7ff8500cc780 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.783+0000 7ff856b73700 1 --2- 172.21.15.123:0/3846793150 >> v2:172.21.15.153:3300/0 conn(0x7ff850071760 0x7ff8500b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.783+0000 7ff856b73700 1 -- 172.21.15.123:0/3846793150 >> 172.21.15.123:0/3846793150 conn(0x7ff85006f940 msgr2=0x7ff8500b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.783+0000 7ff856b73700 1 -- 172.21.15.123:0/3846793150 shutdown_connections 2024-09-13T17:08:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.783+0000 7ff856b73700 1 -- 172.21.15.123:0/3846793150 wait complete. 2024-09-13T17:08:46.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.783+0000 7ff856b73700 1 Processor -- start 2024-09-13T17:08:46.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.783+0000 7ff856b73700 1 -- start start 2024-09-13T17:08:46.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff856b73700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff85006dc70 0x7ff850153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff856b73700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff850071760 0x7ff850137280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff856b73700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8501597c0 0x7ff85013a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff856b73700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff850137b30 con 0x7ff850071760 2024-09-13T17:08:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff856b73700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8501377c0 con 0x7ff85006dc70 2024-09-13T17:08:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff856b73700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85013aa10 con 0x7ff8501597c0 2024-09-13T17:08:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff855370700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff850071760 0x7ff850137280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff855370700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff850071760 0x7ff850137280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41030/0 (socket says 172.21.15.123:41030) 2024-09-13T17:08:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff855370700 1 -- 172.21.15.123:0/2554038710 learned_addr learned my addr 172.21.15.123:0/2554038710 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff855b71700 1 --2- 172.21.15.123:0/2554038710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff85006dc70 0x7ff850153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff856372700 1 --2- 172.21.15.123:0/2554038710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8501597c0 0x7ff85013a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff855370700 1 -- 172.21.15.123:0/2554038710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8501597c0 msgr2=0x7ff85013a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff855370700 1 --2- 172.21.15.123:0/2554038710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8501597c0 0x7ff85013a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff855370700 1 -- 172.21.15.123:0/2554038710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff85006dc70 msgr2=0x7ff850153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff855370700 1 --2- 172.21.15.123:0/2554038710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff85006dc70 0x7ff850153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff855370700 1 -- 172.21.15.123:0/2554038710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff848009b30 con 0x7ff850071760 2024-09-13T17:08:46.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff855370700 1 --2- 172.21.15.123:0/2554038710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff850071760 0x7ff850137280 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff84000e9d0 tx=0x7ff84000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:46.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff8467fc700 1 -- 172.21.15.123:0/2554038710 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840009720 con 0x7ff850071760 2024-09-13T17:08:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff8467fc700 1 -- 172.21.15.123:0/2554038710 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84000ee70 con 0x7ff850071760 2024-09-13T17:08:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff856b73700 1 -- 172.21.15.123:0/2554038710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff850153c70 con 0x7ff850071760 2024-09-13T17:08:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff8467fc700 1 -- 172.21.15.123:0/2554038710 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84000c9f0 con 0x7ff850071760 2024-09-13T17:08:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff856b73700 1 -- 172.21.15.123:0/2554038710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff850154230 con 0x7ff850071760 2024-09-13T17:08:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff856b73700 1 -- 172.21.15.123:0/2554038710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8500b1f30 con 0x7ff850071760 2024-09-13T17:08:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.787+0000 7ff8467fc700 1 -- 172.21.15.123:0/2554038710 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff84000cb50 con 0x7ff850071760 2024-09-13T17:08:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.791+0000 7ff8467fc700 1 --2- 172.21.15.123:0/2554038710 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff834066730 0x7ff834068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.791+0000 7ff8467fc700 1 -- 172.21.15.123:0/2554038710 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff840084060 con 0x7ff850071760 2024-09-13T17:08:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.791+0000 7ff855b71700 1 --2- 172.21.15.123:0/2554038710 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff834066730 0x7ff834068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:46.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.791+0000 7ff855b71700 1 --2- 172.21.15.123:0/2554038710 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff834066730 0x7ff834068bf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff84c001800 tx=0x7ff84c009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:46.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.795+0000 7ff8467fc700 1 -- 172.21.15.123:0/2554038710 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff8400517b0 con 0x7ff850071760 2024-09-13T17:08:46.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.963+0000 7ff856b73700 1 -- 172.21.15.123:0/2554038710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff85006da50 con 0x7ff850071760 2024-09-13T17:08:46.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.963+0000 7ff8467fc700 1 -- 172.21.15.123:0/2554038710 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff840054dd0 con 0x7ff850071760 2024-09-13T17:08:46.969 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:08:46.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.967+0000 7ff856b73700 1 -- 172.21.15.123:0/2554038710 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff834066730 msgr2=0x7ff834068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.967+0000 7ff856b73700 1 --2- 172.21.15.123:0/2554038710 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff834066730 0x7ff834068bf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff84c001800 tx=0x7ff84c009040 comp rx=0 tx=0).stop 2024-09-13T17:08:46.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.967+0000 7ff856b73700 1 -- 172.21.15.123:0/2554038710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff850071760 msgr2=0x7ff850137280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:46.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.967+0000 7ff856b73700 1 --2- 172.21.15.123:0/2554038710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff850071760 0x7ff850137280 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff84000e9d0 tx=0x7ff84000ece0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.967+0000 7ff856b73700 1 -- 172.21.15.123:0/2554038710 shutdown_connections 2024-09-13T17:08:46.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.967+0000 7ff856b73700 1 --2- 172.21.15.123:0/2554038710 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff834066730 0x7ff834068bf0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.967+0000 7ff856b73700 1 --2- 172.21.15.123:0/2554038710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8501597c0 0x7ff85013a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.967+0000 7ff856b73700 1 --2- 172.21.15.123:0/2554038710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff850071760 0x7ff850137280 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.967+0000 7ff856b73700 1 --2- 172.21.15.123:0/2554038710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff85006dc70 0x7ff850153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:46.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.967+0000 7ff856b73700 1 -- 172.21.15.123:0/2554038710 >> 172.21.15.123:0/2554038710 conn(0x7ff85006f940 msgr2=0x7ff8500b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:46.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.967+0000 7ff856b73700 1 -- 172.21.15.123:0/2554038710 shutdown_connections 2024-09-13T17:08:46.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:46.967+0000 7ff856b73700 1 -- 172.21.15.123:0/2554038710 wait complete. 2024-09-13T17:08:46.990 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:08:47.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.095+0000 7fefe9692700 1 Processor -- start 2024-09-13T17:08:47.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.095+0000 7fefe9692700 1 -- start start 2024-09-13T17:08:47.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe9692700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fefe40cf3a0 0x7fefe406c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:47.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe9692700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe40acc00 con 0x7fefe415ff90 2024-09-13T17:08:47.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe9692700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe406cc30 con 0x7fefe406c590 2024-09-13T17:08:47.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe9692700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe406ca20 con 0x7fefe40cf3a0 2024-09-13T17:08:47.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe2ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fefe415ff90 0x7fefe40cec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40766/0 (socket says 172.21.15.123:40766) 2024-09-13T17:08:47.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe2ffd700 1 -- 172.21.15.123:0/190859728 learned_addr learned my addr 172.21.15.123:0/190859728 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:47.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe27fc700 1 --2- 172.21.15.123:0/190859728 >> v2:172.21.15.153:3300/0 conn(0x7fefe40cf3a0 0x7fefe406c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:47.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe1ffb700 1 -- 172.21.15.123:0/190859728 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369164910 0 0) 0x7fefe40acc00 con 0x7fefe415ff90 2024-09-13T17:08:47.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe1ffb700 1 -- 172.21.15.123:0/190859728 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd00035d0 con 0x7fefe415ff90 2024-09-13T17:08:47.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe27fc700 1 -- 172.21.15.123:0/190859728 >> v1:172.21.15.153:6789/0 conn(0x7fefe406c590 legacy=0x7fefe40b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:47.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe27fc700 1 -- 172.21.15.123:0/190859728 >> v1:172.21.15.123:6789/0 conn(0x7fefe415ff90 legacy=0x7fefe40cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:47.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe27fc700 1 -- 172.21.15.123:0/190859728 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe406cf10 con 0x7fefe40cf3a0 2024-09-13T17:08:47.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe27fc700 1 --2- 172.21.15.123:0/190859728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefe40cf3a0 0x7fefe406c050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009d90 tx=0x7fefd400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed82d7f71c599829 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:47.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe1ffb700 1 -- 172.21.15.123:0/190859728 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd400e070 con 0x7fefe40cf3a0 2024-09-13T17:08:47.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe1ffb700 1 -- 172.21.15.123:0/190859728 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd400bb20 con 0x7fefe40cf3a0 2024-09-13T17:08:47.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe1ffb700 1 -- 172.21.15.123:0/190859728 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4012430 con 0x7fefe40cf3a0 2024-09-13T17:08:47.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe9692700 1 -- 172.21.15.123:0/190859728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefe40cf3a0 msgr2=0x7fefe406c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:47.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe9692700 1 --2- 172.21.15.123:0/190859728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefe40cf3a0 0x7fefe406c050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009d90 tx=0x7fefd400b330 comp rx=0 tx=0).stop 2024-09-13T17:08:47.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe9692700 1 -- 172.21.15.123:0/190859728 shutdown_connections 2024-09-13T17:08:47.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe9692700 1 --2- 172.21.15.123:0/190859728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefe40cf3a0 0x7fefe406c050 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe9692700 1 -- 172.21.15.123:0/190859728 >> 172.21.15.123:0/190859728 conn(0x7fefe4066570 msgr2=0x7fefe4066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:47.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe9692700 1 -- 172.21.15.123:0/190859728 shutdown_connections 2024-09-13T17:08:47.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.099+0000 7fefe9692700 1 -- 172.21.15.123:0/190859728 wait complete. 2024-09-13T17:08:47.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe9692700 1 Processor -- start 2024-09-13T17:08:47.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe9692700 1 -- start start 2024-09-13T17:08:47.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe9692700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefe406c590 0x7fefe40cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:47.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe9692700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefe40cf3a0 0x7fefe4156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:47.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe9692700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe415ff90 0x7fefe4149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:47.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe9692700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40aeb40 con 0x7fefe415ff90 2024-09-13T17:08:47.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe9692700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40cc300 con 0x7fefe40cf3a0 2024-09-13T17:08:47.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe9692700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40cc5e0 con 0x7fefe406c590 2024-09-13T17:08:47.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe415ff90 0x7fefe4149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:47.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe27fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefe40cf3a0 0x7fefe4156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:47.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe415ff90 0x7fefe4149380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41046/0 (socket says 172.21.15.123:41046) 2024-09-13T17:08:47.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe37fe700 1 -- 172.21.15.123:0/1532107579 learned_addr learned my addr 172.21.15.123:0/1532107579 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:47.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe2ffd700 1 --2- 172.21.15.123:0/1532107579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefe406c590 0x7fefe40cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:47.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe37fe700 1 -- 172.21.15.123:0/1532107579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefe406c590 msgr2=0x7fefe40cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:47.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe37fe700 1 --2- 172.21.15.123:0/1532107579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefe406c590 0x7fefe40cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe37fe700 1 -- 172.21.15.123:0/1532107579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefe40cf3a0 msgr2=0x7fefe4156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe37fe700 1 --2- 172.21.15.123:0/1532107579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefe40cf3a0 0x7fefe4156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe37fe700 1 -- 172.21.15.123:0/1532107579 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd4009a70 con 0x7fefe415ff90 2024-09-13T17:08:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe37fe700 1 --2- 172.21.15.123:0/1532107579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe415ff90 0x7fefe4149380 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00c480 tx=0x7fefdc00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefdb7fe700 1 -- 172.21.15.123:0/1532107579 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc0052d0 con 0x7fefe415ff90 2024-09-13T17:08:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefdb7fe700 1 -- 172.21.15.123:0/1532107579 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc00ce90 con 0x7fefe415ff90 2024-09-13T17:08:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefdb7fe700 1 -- 172.21.15.123:0/1532107579 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc0036a0 con 0x7fefe415ff90 2024-09-13T17:08:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe9692700 1 -- 172.21.15.123:0/1532107579 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe40cc8c0 con 0x7fefe415ff90 2024-09-13T17:08:47.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.103+0000 7fefe9692700 1 -- 172.21.15.123:0/1532107579 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe40cbf60 con 0x7fefe415ff90 2024-09-13T17:08:47.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.107+0000 7fefe9692700 1 -- 172.21.15.123:0/1532107579 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe40aecb0 con 0x7fefe415ff90 2024-09-13T17:08:47.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.107+0000 7fefdb7fe700 1 -- 172.21.15.123:0/1532107579 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fefdc003800 con 0x7fefe415ff90 2024-09-13T17:08:47.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.107+0000 7fefdb7fe700 1 --2- 172.21.15.123:0/1532107579 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fefc4066730 0x7fefc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:47.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.107+0000 7fefdb7fe700 1 -- 172.21.15.123:0/1532107579 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fefdc083160 con 0x7fefe415ff90 2024-09-13T17:08:47.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.107+0000 7fefe2ffd700 1 --2- 172.21.15.123:0/1532107579 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fefc4066730 0x7fefc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:47.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.107+0000 7fefe2ffd700 1 --2- 172.21.15.123:0/1532107579 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fefc4066730 0x7fefc4068bf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fefcc007fd0 tx=0x7fefcc007de0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:47.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.115+0000 7fefdb7fe700 1 -- 172.21.15.123:0/1532107579 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fefdc050820 con 0x7fefe415ff90 2024-09-13T17:08:47.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.287+0000 7fefe9692700 1 -- 172.21.15.123:0/1532107579 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fefe406c050 con 0x7fefe415ff90 2024-09-13T17:08:47.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.287+0000 7fefdb7fe700 1 -- 172.21.15.123:0/1532107579 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v56) v1 ==== 84+0+65 (secure 0 0 0) 0x7fefdc053e40 con 0x7fefe415ff90 2024-09-13T17:08:47.293 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:47.293 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-13T17:08:47.293 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:08:47.293 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-13T17:08:47.293 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-13T17:08:47.293 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:47.293 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-13T17:08:47.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.287+0000 7fefe9692700 1 -- 172.21.15.123:0/1532107579 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fefc4066730 msgr2=0x7fefc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:47.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.287+0000 7fefe9692700 1 --2- 172.21.15.123:0/1532107579 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fefc4066730 0x7fefc4068bf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fefcc007fd0 tx=0x7fefcc007de0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.291+0000 7fefe9692700 1 -- 172.21.15.123:0/1532107579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe415ff90 msgr2=0x7fefe4149380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:47.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.291+0000 7fefe9692700 1 --2- 172.21.15.123:0/1532107579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe415ff90 0x7fefe4149380 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00c480 tx=0x7fefdc00c790 comp rx=0 tx=0).stop 2024-09-13T17:08:47.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.291+0000 7fefe9692700 1 -- 172.21.15.123:0/1532107579 shutdown_connections 2024-09-13T17:08:47.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.291+0000 7fefe9692700 1 --2- 172.21.15.123:0/1532107579 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fefc4066730 0x7fefc4068bf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.291+0000 7fefe9692700 1 --2- 172.21.15.123:0/1532107579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefe415ff90 0x7fefe4149380 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.291+0000 7fefe9692700 1 --2- 172.21.15.123:0/1532107579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefe40cf3a0 0x7fefe4156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.291+0000 7fefe9692700 1 --2- 172.21.15.123:0/1532107579 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefe406c590 0x7fefe40cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.291+0000 7fefe9692700 1 -- 172.21.15.123:0/1532107579 >> 172.21.15.123:0/1532107579 conn(0x7fefe4066570 msgr2=0x7fefe4066950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:47.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.291+0000 7fefe9692700 1 -- 172.21.15.123:0/1532107579 shutdown_connections 2024-09-13T17:08:47.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.291+0000 7fefe9692700 1 -- 172.21.15.123:0/1532107579 wait complete. 2024-09-13T17:08:47.306 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:08:47.307 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:08:47.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.419+0000 7f79b88e5700 1 Processor -- start 2024-09-13T17:08:47.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.419+0000 7f79b88e5700 1 -- start start 2024-09-13T17:08:47.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b88e5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f79b4160310 0x7f79b40d36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b88e5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79b40d1080 0x7f79b40d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b88e5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b41606f0 con 0x7f79b40d3220 2024-09-13T17:08:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b88e5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b40d1a70 con 0x7f79b4160310 2024-09-13T17:08:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b88e5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40ce7b0 con 0x7f79b40d1080 2024-09-13T17:08:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b259c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f79b40d3220 0x7f79b40cf850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40780/0 (socket says 172.21.15.123:40780) 2024-09-13T17:08:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b259c700 1 -- 172.21.15.123:0/1717778459 learned_addr learned my addr 172.21.15.123:0/1717778459 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b2d9d700 1 --2- 172.21.15.123:0/1717778459 >> v2:172.21.15.153:3300/0 conn(0x7f79b4160310 0x7f79b40d36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b359e700 1 --2- 172.21.15.123:0/1717778459 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79b40d1080 0x7f79b40d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 -- 172.21.15.123:0/1717778459 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380288499 0 0) 0x7f79b41606f0 con 0x7f79b40d3220 2024-09-13T17:08:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 -- 172.21.15.123:0/1717778459 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f799c0035d0 con 0x7f79b40d3220 2024-09-13T17:08:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 -- 172.21.15.123:0/1717778459 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2578727337 0 0) 0x7f799c0035d0 con 0x7f79b40d3220 2024-09-13T17:08:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 -- 172.21.15.123:0/1717778459 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79b40d1080 msgr2=0x7f79b40d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 --2- 172.21.15.123:0/1717778459 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79b40d1080 0x7f79b40d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 -- 172.21.15.123:0/1717778459 >> v2:172.21.15.153:3300/0 conn(0x7f79b4160310 msgr2=0x7f79b40d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 --2- 172.21.15.123:0/1717778459 >> v2:172.21.15.153:3300/0 conn(0x7f79b4160310 0x7f79b40d36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 -- 172.21.15.123:0/1717778459 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40cea90 con 0x7f79b40d3220 2024-09-13T17:08:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 -- 172.21.15.123:0/1717778459 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f79a4001670 con 0x7f79b40d3220 2024-09-13T17:08:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 -- 172.21.15.123:0/1717778459 >> v1:172.21.15.123:6789/0 conn(0x7f79b40d3220 legacy=0x7f79b40cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 --2- 172.21.15.123:0/1717778459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f799c003a20 0x7f799c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 --2- 172.21.15.123:0/1717778459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f799c004870 0x7f799c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 --2- 172.21.15.123:0/1717778459 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79b40d1080 0x7f799c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 -- 172.21.15.123:0/1717778459 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40d1a70 con 0x7f799c003a20 2024-09-13T17:08:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 -- 172.21.15.123:0/1717778459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40ce7b0 con 0x7f799c004870 2024-09-13T17:08:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 -- 172.21.15.123:0/1717778459 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c00ba30 con 0x7f79b40d1080 2024-09-13T17:08:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b2d9d700 1 --2- 172.21.15.123:0/1717778459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f799c003a20 0x7f799c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b259c700 1 --2- 172.21.15.123:0/1717778459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f799c004870 0x7f799c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b359e700 1 --2- 172.21.15.123:0/1717778459 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79b40d1080 0x7f799c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b2d9d700 1 -- 172.21.15.123:0/1717778459 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79b40d1080 msgr2=0x7f799c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b2d9d700 1 --2- 172.21.15.123:0/1717778459 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79b40d1080 0x7f799c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b2d9d700 1 -- 172.21.15.123:0/1717778459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f799c004870 msgr2=0x7f799c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b2d9d700 1 --2- 172.21.15.123:0/1717778459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f799c004870 0x7f799c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b2d9d700 1 -- 172.21.15.123:0/1717778459 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c0035d0 con 0x7f799c003a20 2024-09-13T17:08:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b2d9d700 1 --2- 172.21.15.123:0/1717778459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f799c003a20 0x7f799c003e40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009ba0 tx=0x7f799c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa49e94e0bc31669 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 -- 172.21.15.123:0/1717778459 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800e6c0 con 0x7f799c003a20 2024-09-13T17:08:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 -- 172.21.15.123:0/1717778459 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a800e820 con 0x7f799c003a20 2024-09-13T17:08:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.423+0000 7f79b1d9b700 1 -- 172.21.15.123:0/1717778459 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800eb90 con 0x7f799c003a20 2024-09-13T17:08:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.427+0000 7f79b88e5700 1 -- 172.21.15.123:0/1717778459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f799c003a20 msgr2=0x7f799c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.427+0000 7f79b88e5700 1 --2- 172.21.15.123:0/1717778459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f799c003a20 0x7f799c003e40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009ba0 tx=0x7f799c0058a0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.427+0000 7f79b359e700 1 -- 172.21.15.123:0/1717778459 reap_dead start 2024-09-13T17:08:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.427+0000 7f79b88e5700 1 -- 172.21.15.123:0/1717778459 shutdown_connections 2024-09-13T17:08:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.427+0000 7f79b88e5700 1 -- 172.21.15.123:0/1717778459 >> 172.21.15.123:0/1717778459 conn(0x7f79b409be50 msgr2=0x7f79b40d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.427+0000 7f79b88e5700 1 -- 172.21.15.123:0/1717778459 shutdown_connections 2024-09-13T17:08:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.427+0000 7f79b88e5700 1 -- 172.21.15.123:0/1717778459 wait complete. 2024-09-13T17:08:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.427+0000 7f79b88e5700 1 Processor -- start 2024-09-13T17:08:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.427+0000 7f79b88e5700 1 -- start start 2024-09-13T17:08:47.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b88e5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f799c003a20 0x7f79b40c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:47.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b88e5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b40c8fc0 0x7f79b41f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:47.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b88e5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79b40c7fd0 0x7f79b41f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:47.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b88e5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b41f6ed0 con 0x7f79b40c8fc0 2024-09-13T17:08:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b88e5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40c69f0 con 0x7f79b40c7fd0 2024-09-13T17:08:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b88e5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40c6cd0 con 0x7f799c003a20 2024-09-13T17:08:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b40c8fc0 0x7f79b41f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b40c8fc0 0x7f79b41f3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41054/0 (socket says 172.21.15.123:41054) 2024-09-13T17:08:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b259c700 1 -- 172.21.15.123:0/2194789958 learned_addr learned my addr 172.21.15.123:0/2194789958 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b2d9d700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f799c003a20 0x7f79b40c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b359e700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79b40c7fd0 0x7f79b41f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b259c700 1 -- 172.21.15.123:0/2194789958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f799c003a20 msgr2=0x7f79b40c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b259c700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f799c003a20 0x7f79b40c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b259c700 1 -- 172.21.15.123:0/2194789958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79b40c7fd0 msgr2=0x7f79b41f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b259c700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79b40c7fd0 0x7f79b41f40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b259c700 1 -- 172.21.15.123:0/2194789958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40c6fb0 con 0x7f79b40c8fc0 2024-09-13T17:08:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b359e700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79b40c7fd0 0x7f79b41f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b259c700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b40c8fc0 0x7f79b41f3b90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f79a4007290 tx=0x7f79a40075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f799b7fe700 1 -- 172.21.15.123:0/2194789958 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a400f600 con 0x7f79b40c8fc0 2024-09-13T17:08:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f799b7fe700 1 -- 172.21.15.123:0/2194789958 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a400f760 con 0x7f79b40c8fc0 2024-09-13T17:08:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b88e5700 1 -- 172.21.15.123:0/2194789958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b40c7290 con 0x7f79b40c8fc0 2024-09-13T17:08:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f799b7fe700 1 -- 172.21.15.123:0/2194789958 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a400fb10 con 0x7f79b40c8fc0 2024-09-13T17:08:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b88e5700 1 -- 172.21.15.123:0/2194789958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b415e550 con 0x7f79b40c8fc0 2024-09-13T17:08:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.431+0000 7f79b88e5700 1 -- 172.21.15.123:0/2194789958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b40677f0 con 0x7f79b40c8fc0 2024-09-13T17:08:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.435+0000 7f799b7fe700 1 -- 172.21.15.123:0/2194789958 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f79a400fc70 con 0x7f79b40c8fc0 2024-09-13T17:08:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.435+0000 7f799b7fe700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f79a0066760 0x7f79a0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.435+0000 7f79b2d9d700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f79a0066760 0x7f79a0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.435+0000 7f799b7fe700 1 -- 172.21.15.123:0/2194789958 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f79a4083da0 con 0x7f79b40c8fc0 2024-09-13T17:08:47.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.435+0000 7f79b2d9d700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f79a0066760 0x7f79a0068c20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f79a80090b0 tx=0x7f79a801f040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.439+0000 7f799b7fe700 1 -- 172.21.15.123:0/2194789958 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f79a4051450 con 0x7f79b40c8fc0 2024-09-13T17:08:47.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.611+0000 7f79b88e5700 1 -- 172.21.15.123:0/2194789958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f79b40ce410 con 0x7f79b40c8fc0 2024-09-13T17:08:47.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.951+0000 7f799b7fe700 1 -- 172.21.15.123:0/2194789958 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v57) v1 ==== 138+0+0 (secure 0 0 0) 0x7f79a4059e60 con 0x7f79b40c8fc0 2024-09-13T17:08:47.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.959+0000 7f79b88e5700 1 -- 172.21.15.123:0/2194789958 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f79a0066760 msgr2=0x7f79a0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:47.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.959+0000 7f79b88e5700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f79a0066760 0x7f79a0068c20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f79a80090b0 tx=0x7f79a801f040 comp rx=0 tx=0).stop 2024-09-13T17:08:47.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.959+0000 7f79b88e5700 1 -- 172.21.15.123:0/2194789958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b40c8fc0 msgr2=0x7f79b41f3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:47.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.959+0000 7f79b88e5700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b40c8fc0 0x7f79b41f3b90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f79a4007290 tx=0x7f79a40075a0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.963+0000 7f79b88e5700 1 -- 172.21.15.123:0/2194789958 shutdown_connections 2024-09-13T17:08:47.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.963+0000 7f79b88e5700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f79a0066760 0x7f79a0068c20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.963+0000 7f79b88e5700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79b40c7fd0 0x7f79b41f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.963+0000 7f79b88e5700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b40c8fc0 0x7f79b41f3b90 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.963+0000 7f79b88e5700 1 --2- 172.21.15.123:0/2194789958 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f799c003a20 0x7f79b40c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:47.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.963+0000 7f79b88e5700 1 -- 172.21.15.123:0/2194789958 >> 172.21.15.123:0/2194789958 conn(0x7f79b409be50 msgr2=0x7f79b40b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:47.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.963+0000 7f79b88e5700 1 -- 172.21.15.123:0/2194789958 shutdown_connections 2024-09-13T17:08:47.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:47.963+0000 7f79b88e5700 1 -- 172.21.15.123:0/2194789958 wait complete. 2024-09-13T17:08:47.967 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-13T17:08:47.979 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:08:48.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.095+0000 7fa76e0b8700 1 Processor -- start 2024-09-13T17:08:48.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.095+0000 7fa76e0b8700 1 -- start start 2024-09-13T17:08:48.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.095+0000 7fa76e0b8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa76815cfb0 0x7fa7680ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:48.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.095+0000 7fa76e0b8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7680cd890 con 0x7fa7680d3800 2024-09-13T17:08:48.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.095+0000 7fa76e0b8700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76815d390 con 0x7fa7680d12d0 2024-09-13T17:08:48.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.095+0000 7fa76e0b8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7680d10c0 con 0x7fa76815cfb0 2024-09-13T17:08:48.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.095+0000 7fa766ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa7680d3800 0x7fa7680d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40796/0 (socket says 172.21.15.123:40796) 2024-09-13T17:08:48.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.095+0000 7fa766ffd700 1 -- 172.21.15.123:0/3572760716 learned_addr learned my addr 172.21.15.123:0/3572760716 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:48.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.095+0000 7fa7677fe700 1 --2- 172.21.15.123:0/3572760716 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa76815cfb0 0x7fa7680ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:48.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa7667fc700 1 -- 172.21.15.123:0/3572760716 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748397590 0 0) 0x7fa7680cd890 con 0x7fa7680d3800 2024-09-13T17:08:48.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa7667fc700 1 -- 172.21.15.123:0/3572760716 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7500035d0 con 0x7fa7680d3800 2024-09-13T17:08:48.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa7677fe700 1 -- 172.21.15.123:0/3572760716 >> v1:172.21.15.153:6789/0 conn(0x7fa7680d12d0 legacy=0x7fa7680b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:48.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa7667fc700 1 -- 172.21.15.123:0/3572760716 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262932504 0 0) 0x7fa76815d390 con 0x7fa7680d12d0 2024-09-13T17:08:48.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa7677fe700 1 -- 172.21.15.123:0/3572760716 >> v1:172.21.15.123:6789/0 conn(0x7fa7680d3800 legacy=0x7fa7680d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:48.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa7677fe700 1 -- 172.21.15.123:0/3572760716 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7680cdac0 con 0x7fa76815cfb0 2024-09-13T17:08:48.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa7677fe700 1 --2- 172.21.15.123:0/3572760716 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa76815cfb0 0x7fa7680ce840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009880 tx=0x7fa75c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d994ad15f98fba08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:48.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa7667fc700 1 -- 172.21.15.123:0/3572760716 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa758001670 con 0x7fa76815cfb0 2024-09-13T17:08:48.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa7667fc700 1 -- 172.21.15.123:0/3572760716 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c010590 con 0x7fa76815cfb0 2024-09-13T17:08:48.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa7667fc700 1 -- 172.21.15.123:0/3572760716 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c010900 con 0x7fa76815cfb0 2024-09-13T17:08:48.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa76e0b8700 1 -- 172.21.15.123:0/3572760716 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa76815cfb0 msgr2=0x7fa7680ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:48.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa76e0b8700 1 --2- 172.21.15.123:0/3572760716 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa76815cfb0 0x7fa7680ce840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009880 tx=0x7fa75c009b90 comp rx=0 tx=0).stop 2024-09-13T17:08:48.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa76e0b8700 1 -- 172.21.15.123:0/3572760716 shutdown_connections 2024-09-13T17:08:48.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa76e0b8700 1 --2- 172.21.15.123:0/3572760716 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa76815cfb0 0x7fa7680ce840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:48.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa76e0b8700 1 -- 172.21.15.123:0/3572760716 >> 172.21.15.123:0/3572760716 conn(0x7fa7680d2d10 msgr2=0x7fa7680d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:48.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa76e0b8700 1 -- 172.21.15.123:0/3572760716 shutdown_connections 2024-09-13T17:08:48.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.099+0000 7fa76e0b8700 1 -- 172.21.15.123:0/3572760716 wait complete. 2024-09-13T17:08:48.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa76e0b8700 1 Processor -- start 2024-09-13T17:08:48.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa76e0b8700 1 -- start start 2024-09-13T17:08:48.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa76e0b8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7680d12d0 0x7fa7681f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:48.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa76e0b8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7680d3800 0x7fa768156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:48.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa76e0b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa76815cfb0 0x7fa76815ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:48.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa76e0b8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa768157cf0 con 0x7fa7680d3800 2024-09-13T17:08:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa76e0b8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa768157fd0 con 0x7fa76815cfb0 2024-09-13T17:08:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa76e0b8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7681582b0 con 0x7fa7680d12d0 2024-09-13T17:08:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa766ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7680d3800 0x7fa768156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa766ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7680d3800 0x7fa768156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41066/0 (socket says 172.21.15.123:41066) 2024-09-13T17:08:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa766ffd700 1 -- 172.21.15.123:0/1298922183 learned_addr learned my addr 172.21.15.123:0/1298922183 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa767fff700 1 --2- 172.21.15.123:0/1298922183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa76815cfb0 0x7fa76815ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa7677fe700 1 --2- 172.21.15.123:0/1298922183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7680d12d0 0x7fa7681f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa766ffd700 1 -- 172.21.15.123:0/1298922183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7680d12d0 msgr2=0x7fa7681f28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa766ffd700 1 --2- 172.21.15.123:0/1298922183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7680d12d0 0x7fa7681f28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa766ffd700 1 -- 172.21.15.123:0/1298922183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa76815cfb0 msgr2=0x7fa76815ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa766ffd700 1 --2- 172.21.15.123:0/1298922183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa76815cfb0 0x7fa76815ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa766ffd700 1 -- 172.21.15.123:0/1298922183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c0094b0 con 0x7fa7680d3800 2024-09-13T17:08:48.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa766ffd700 1 --2- 172.21.15.123:0/1298922183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7680d3800 0x7fa768156020 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa75800c780 tx=0x7fa75800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:48.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa74ffff700 1 -- 172.21.15.123:0/1298922183 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa758005d90 con 0x7fa7680d3800 2024-09-13T17:08:48.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa74ffff700 1 -- 172.21.15.123:0/1298922183 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7580070d0 con 0x7fa7680d3800 2024-09-13T17:08:48.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa76e0b8700 1 -- 172.21.15.123:0/1298922183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa768158590 con 0x7fa7680d3800 2024-09-13T17:08:48.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa74ffff700 1 -- 172.21.15.123:0/1298922183 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa758007460 con 0x7fa7680d3800 2024-09-13T17:08:48.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.103+0000 7fa76e0b8700 1 -- 172.21.15.123:0/1298922183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa768156560 con 0x7fa7680d3800 2024-09-13T17:08:48.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.107+0000 7fa76e0b8700 1 -- 172.21.15.123:0/1298922183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa768158ab0 con 0x7fa7680d3800 2024-09-13T17:08:48.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.107+0000 7fa74ffff700 1 -- 172.21.15.123:0/1298922183 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa7580075c0 con 0x7fa7680d3800 2024-09-13T17:08:48.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.107+0000 7fa74ffff700 1 --2- 172.21.15.123:0/1298922183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa754066730 0x7fa754068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:48.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.107+0000 7fa74ffff700 1 -- 172.21.15.123:0/1298922183 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa758083390 con 0x7fa7680d3800 2024-09-13T17:08:48.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.107+0000 7fa7677fe700 1 --2- 172.21.15.123:0/1298922183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa754066730 0x7fa754068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:48.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.111+0000 7fa7677fe700 1 --2- 172.21.15.123:0/1298922183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa754066730 0x7fa754068bf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0097d0 tx=0x7fa75c01c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:48.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.119+0000 7fa74ffff700 1 -- 172.21.15.123:0/1298922183 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa768158ab0 con 0x7fa7680d3800 2024-09-13T17:08:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.283+0000 7fa76e0b8700 1 -- 172.21.15.123:0/1298922183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa768158ab0 con 0x7fa7680d3800 2024-09-13T17:08:48.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.955+0000 7fa74ffff700 1 -- 172.21.15.123:0/1298922183 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v58) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa768158ab0 con 0x7fa7680d3800 2024-09-13T17:08:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.963+0000 7fa76e0b8700 1 -- 172.21.15.123:0/1298922183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa754066730 msgr2=0x7fa754068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.963+0000 7fa76e0b8700 1 --2- 172.21.15.123:0/1298922183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa754066730 0x7fa754068bf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0097d0 tx=0x7fa75c01c040 comp rx=0 tx=0).stop 2024-09-13T17:08:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.963+0000 7fa76e0b8700 1 -- 172.21.15.123:0/1298922183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7680d3800 msgr2=0x7fa768156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.963+0000 7fa76e0b8700 1 --2- 172.21.15.123:0/1298922183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7680d3800 0x7fa768156020 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa75800c780 tx=0x7fa75800ca90 comp rx=0 tx=0).stop 2024-09-13T17:08:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.963+0000 7fa76e0b8700 1 -- 172.21.15.123:0/1298922183 shutdown_connections 2024-09-13T17:08:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.963+0000 7fa76e0b8700 1 --2- 172.21.15.123:0/1298922183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa754066730 0x7fa754068bf0 secure :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0097d0 tx=0x7fa75c01c040 comp rx=0 tx=0).stop 2024-09-13T17:08:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.963+0000 7fa76e0b8700 1 --2- 172.21.15.123:0/1298922183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa76815cfb0 0x7fa76815ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.963+0000 7fa76e0b8700 1 --2- 172.21.15.123:0/1298922183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7680d3800 0x7fa768156020 secure :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa75800c780 tx=0x7fa75800ca90 comp rx=0 tx=0).stop 2024-09-13T17:08:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.963+0000 7fa76e0b8700 1 --2- 172.21.15.123:0/1298922183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7680d12d0 0x7fa7681f28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.963+0000 7fa76e0b8700 1 -- 172.21.15.123:0/1298922183 >> 172.21.15.123:0/1298922183 conn(0x7fa7680d2d10 msgr2=0x7fa76806ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:48.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.975+0000 7fa76e0b8700 1 -- 172.21.15.123:0/1298922183 shutdown_connections 2024-09-13T17:08:48.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:48.975+0000 7fa76e0b8700 1 -- 172.21.15.123:0/1298922183 wait complete. 2024-09-13T17:08:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-13T17:08:48.992 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:08:49.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.103+0000 7f355e93d700 1 Processor -- start 2024-09-13T17:08:49.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.103+0000 7f355e93d700 1 -- start start 2024-09-13T17:08:49.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355e93d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f35580cdda0 0x7f355815e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355e93d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35580ada60 con 0x7f3558159c60 2024-09-13T17:08:49.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355e93d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355815e680 con 0x7f3558070f90 2024-09-13T17:08:49.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355e93d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35580720a0 con 0x7f35580cdda0 2024-09-13T17:08:49.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355d93b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3558159c60 0x7f35580cd690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40798/0 (socket says 172.21.15.123:40798) 2024-09-13T17:08:49.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355d93b700 1 -- 172.21.15.123:0/3357803741 learned_addr learned my addr 172.21.15.123:0/3357803741 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:49.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355d13a700 1 --2- 172.21.15.123:0/3357803741 >> v2:172.21.15.153:3300/0 conn(0x7f35580cdda0 0x7f355815e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355c939700 1 -- 172.21.15.123:0/3357803741 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251007637 0 0) 0x7f35580ada60 con 0x7f3558159c60 2024-09-13T17:08:49.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355c939700 1 -- 172.21.15.123:0/3357803741 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35440035d0 con 0x7f3558159c60 2024-09-13T17:08:49.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355d13a700 1 -- 172.21.15.123:0/3357803741 >> v1:172.21.15.153:6789/0 conn(0x7f3558070f90 legacy=0x7f355806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355d13a700 1 -- 172.21.15.123:0/3357803741 >> v1:172.21.15.123:6789/0 conn(0x7f3558159c60 legacy=0x7f35580cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355d13a700 1 -- 172.21.15.123:0/3357803741 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558072530 con 0x7f35580cdda0 2024-09-13T17:08:49.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355d13a700 1 --2- 172.21.15.123:0/3357803741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35580cdda0 0x7f355815e140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3554009850 tx=0x7f3554009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d286fd266e934911 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:49.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355c939700 1 -- 172.21.15.123:0/3357803741 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554011830 con 0x7f35580cdda0 2024-09-13T17:08:49.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355c939700 1 -- 172.21.15.123:0/3357803741 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3554011990 con 0x7f35580cdda0 2024-09-13T17:08:49.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355c939700 1 -- 172.21.15.123:0/3357803741 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554011d00 con 0x7f35580cdda0 2024-09-13T17:08:49.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355e93d700 1 -- 172.21.15.123:0/3357803741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35580cdda0 msgr2=0x7f355815e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355e93d700 1 --2- 172.21.15.123:0/3357803741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35580cdda0 0x7f355815e140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3554009850 tx=0x7f3554009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:49.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355e93d700 1 -- 172.21.15.123:0/3357803741 shutdown_connections 2024-09-13T17:08:49.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355e93d700 1 --2- 172.21.15.123:0/3357803741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35580cdda0 0x7f355815e140 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355e93d700 1 -- 172.21.15.123:0/3357803741 >> 172.21.15.123:0/3357803741 conn(0x7f35580b01d0 msgr2=0x7f35580b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:49.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355e93d700 1 -- 172.21.15.123:0/3357803741 shutdown_connections 2024-09-13T17:08:49.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.107+0000 7f355e93d700 1 -- 172.21.15.123:0/3357803741 wait complete. 2024-09-13T17:08:49.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.111+0000 7f355e93d700 1 Processor -- start 2024-09-13T17:08:49.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.111+0000 7f355e93d700 1 -- start start 2024-09-13T17:08:49.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355e93d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3558070f90 0x7f3558154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355e93d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35580cdda0 0x7f3558156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355e93d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3558159c60 0x7f3558153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355e93d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35580c59c0 con 0x7f3558070f90 2024-09-13T17:08:49.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355e93d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558154b30 con 0x7f3558159c60 2024-09-13T17:08:49.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355e93d700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35581577b0 con 0x7f35580cdda0 2024-09-13T17:08:49.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355d93b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3558070f90 0x7f3558154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355d93b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3558070f90 0x7f3558154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41082/0 (socket says 172.21.15.123:41082) 2024-09-13T17:08:49.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355d93b700 1 -- 172.21.15.123:0/64294974 learned_addr learned my addr 172.21.15.123:0/64294974 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:49.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355d13a700 1 --2- 172.21.15.123:0/64294974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35580cdda0 0x7f3558156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355e13c700 1 --2- 172.21.15.123:0/64294974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3558159c60 0x7f3558153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355d93b700 1 -- 172.21.15.123:0/64294974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35580cdda0 msgr2=0x7f3558156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355d93b700 1 --2- 172.21.15.123:0/64294974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35580cdda0 0x7f3558156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355d93b700 1 -- 172.21.15.123:0/64294974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3558159c60 msgr2=0x7f3558153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355d93b700 1 --2- 172.21.15.123:0/64294974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3558159c60 0x7f3558153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355d93b700 1 -- 172.21.15.123:0/64294974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35540094b0 con 0x7f3558070f90 2024-09-13T17:08:49.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355d93b700 1 --2- 172.21.15.123:0/64294974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3558070f90 0x7f3558154e10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3548001200 tx=0x7f354800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:49.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f354e7fc700 1 -- 172.21.15.123:0/64294974 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548005d90 con 0x7f3558070f90 2024-09-13T17:08:49.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f354e7fc700 1 -- 172.21.15.123:0/64294974 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35480070d0 con 0x7f3558070f90 2024-09-13T17:08:49.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355e93d700 1 -- 172.21.15.123:0/64294974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3558157a90 con 0x7f3558070f90 2024-09-13T17:08:49.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f354e7fc700 1 -- 172.21.15.123:0/64294974 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548007460 con 0x7f3558070f90 2024-09-13T17:08:49.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355e93d700 1 -- 172.21.15.123:0/64294974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355815cfa0 con 0x7f3558070f90 2024-09-13T17:08:49.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.115+0000 7f355e93d700 1 -- 172.21.15.123:0/64294974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3558157fb0 con 0x7f3558070f90 2024-09-13T17:08:49.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.119+0000 7f354e7fc700 1 -- 172.21.15.123:0/64294974 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f35480075c0 con 0x7f3558070f90 2024-09-13T17:08:49.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.119+0000 7f354e7fc700 1 --2- 172.21.15.123:0/64294974 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f353c066730 0x7f353c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.119+0000 7f355d13a700 1 --2- 172.21.15.123:0/64294974 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f353c066730 0x7f353c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.119+0000 7f354e7fc700 1 -- 172.21.15.123:0/64294974 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3548083730 con 0x7f3558070f90 2024-09-13T17:08:49.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.119+0000 7f355d13a700 1 --2- 172.21.15.123:0/64294974 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f353c066730 0x7f353c068bf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3554009ba0 tx=0x7f3554008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:49.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.127+0000 7f354e7fc700 1 -- 172.21.15.123:0/64294974 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3548050be0 con 0x7f3558070f90 2024-09-13T17:08:49.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.331+0000 7f355e93d700 1 -- 172.21.15.123:0/64294974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3558157fb0 con 0x7f3558070f90 2024-09-13T17:08:49.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.343+0000 7f354e7fc700 1 -- 172.21.15.123:0/64294974 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v25) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3558157fb0 con 0x7f3558070f90 2024-09-13T17:08:49.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.355+0000 7f355e93d700 1 -- 172.21.15.123:0/64294974 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f353c066730 msgr2=0x7f353c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.355+0000 7f355e93d700 1 --2- 172.21.15.123:0/64294974 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f353c066730 0x7f353c068bf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3554009ba0 tx=0x7f3554008030 comp rx=0 tx=0).stop 2024-09-13T17:08:49.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.355+0000 7f355e93d700 1 -- 172.21.15.123:0/64294974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3558070f90 msgr2=0x7f3558154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.355+0000 7f355e93d700 1 --2- 172.21.15.123:0/64294974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3558070f90 0x7f3558154e10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3548001200 tx=0x7f354800c7d0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.355+0000 7f355e93d700 1 -- 172.21.15.123:0/64294974 shutdown_connections 2024-09-13T17:08:49.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.355+0000 7f355e93d700 1 --2- 172.21.15.123:0/64294974 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f353c066730 0x7f353c068bf0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.355+0000 7f355e93d700 1 --2- 172.21.15.123:0/64294974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3558159c60 0x7f3558153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.355+0000 7f355e93d700 1 --2- 172.21.15.123:0/64294974 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f35580cdda0 0x7f3558156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.355+0000 7f355e93d700 1 --2- 172.21.15.123:0/64294974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3558070f90 0x7f3558154e10 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.355+0000 7f355e93d700 1 -- 172.21.15.123:0/64294974 >> 172.21.15.123:0/64294974 conn(0x7f35580b01d0 msgr2=0x7f35580cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:49.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.355+0000 7f355e93d700 1 -- 172.21.15.123:0/64294974 shutdown_connections 2024-09-13T17:08:49.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.355+0000 7f355e93d700 1 -- 172.21.15.123:0/64294974 wait complete. 2024-09-13T17:08:49.361 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 8 and data pool 9 2024-09-13T17:08:49.380 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:49.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 Processor -- start 2024-09-13T17:08:49.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 -- start start 2024-09-13T17:08:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fce3815cf30 0x7fce3806d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce380b1cc0 0x7fce380c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3806e400 con 0x7fce3806dec0 2024-09-13T17:08:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce380cc340 con 0x7fce3815cf30 2024-09-13T17:08:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce380cc620 con 0x7fce380b1cc0 2024-09-13T17:08:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3d287700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fce3815cf30 0x7fce3806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3d287700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fce3815cf30 0x7fce3806d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:42938/0 (socket says 172.21.15.123:42938) 2024-09-13T17:08:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3d287700 1 -- 172.21.15.123:0/1628481760 learned_addr learned my addr 172.21.15.123:0/1628481760 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3ca86700 1 --1- 172.21.15.123:0/1628481760 >> v1:172.21.15.153:6789/0 conn(0x7fce3806dec0 0x7fce380b15b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:40296/0 (socket says 172.21.15.123:40296) 2024-09-13T17:08:49.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3da88700 1 --2- 172.21.15.123:0/1628481760 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce380b1cc0 0x7fce380c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3d287700 1 -- 172.21.15.123:0/1628481760 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce380b1cc0 msgr2=0x7fce380c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:49.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3d287700 1 --2- 172.21.15.123:0/1628481760 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce380b1cc0 0x7fce380c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3d287700 1 -- 172.21.15.123:0/1628481760 >> v1:172.21.15.153:6789/0 conn(0x7fce3806dec0 legacy=0x7fce380b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3d287700 1 -- 172.21.15.123:0/1628481760 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce380cc900 con 0x7fce3815cf30 2024-09-13T17:08:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3d287700 1 --2- 172.21.15.123:0/1628481760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce3815cf30 0x7fce3806d980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fce30009e50 tx=0x7fce3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5e10c2ebc4c5a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce2ffff700 1 -- 172.21.15.123:0/1628481760 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3000e070 con 0x7fce3815cf30 2024-09-13T17:08:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce2ffff700 1 -- 172.21.15.123:0/1628481760 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3000b910 con 0x7fce3815cf30 2024-09-13T17:08:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce2ffff700 1 -- 172.21.15.123:0/1628481760 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3000bcc0 con 0x7fce3815cf30 2024-09-13T17:08:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 -- 172.21.15.123:0/1628481760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce3815cf30 msgr2=0x7fce3806d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 --2- 172.21.15.123:0/1628481760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce3815cf30 0x7fce3806d980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fce30009e50 tx=0x7fce3000b330 comp rx=0 tx=0).stop 2024-09-13T17:08:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 -- 172.21.15.123:0/1628481760 shutdown_connections 2024-09-13T17:08:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 --2- 172.21.15.123:0/1628481760 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce380b1cc0 0x7fce380c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 --2- 172.21.15.123:0/1628481760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce3815cf30 0x7fce3806d980 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 -- 172.21.15.123:0/1628481760 >> 172.21.15.123:0/1628481760 conn(0x7fce3806a6b0 msgr2=0x7fce38066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 -- 172.21.15.123:0/1628481760 shutdown_connections 2024-09-13T17:08:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.479+0000 7fce3f4eb700 1 -- 172.21.15.123:0/1628481760 wait complete. 2024-09-13T17:08:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3f4eb700 1 Processor -- start 2024-09-13T17:08:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3f4eb700 1 -- start start 2024-09-13T17:08:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3f4eb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce3806dec0 0x7fce381f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3f4eb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce380b1cc0 0x7fce3815d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3f4eb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce3815cf30 0x7fce380b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3f4eb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3815e220 con 0x7fce380b1cc0 2024-09-13T17:08:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3f4eb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce381f6550 con 0x7fce3815cf30 2024-09-13T17:08:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3f4eb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce381f6eb0 con 0x7fce3806dec0 2024-09-13T17:08:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3ca86700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce380b1cc0 0x7fce3815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3da88700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce3815cf30 0x7fce380b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3d287700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce3806dec0 0x7fce381f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3ca86700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce380b1cc0 0x7fce3815d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41096/0 (socket says 172.21.15.123:41096) 2024-09-13T17:08:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3da88700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce3815cf30 0x7fce380b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:42952/0 (socket says 172.21.15.123:42952) 2024-09-13T17:08:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3d287700 1 --2- 172.21.15.123:0/805435791 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce3806dec0 0x7fce381f6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:50526/0 (socket says 172.21.15.123:50526) 2024-09-13T17:08:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.483+0000 7fce3ca86700 1 -- 172.21.15.123:0/805435791 learned_addr learned my addr 172.21.15.123:0/805435791 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.487+0000 7fce3ca86700 1 -- 172.21.15.123:0/805435791 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce3806dec0 msgr2=0x7fce381f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.487+0000 7fce3ca86700 1 --2- 172.21.15.123:0/805435791 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce3806dec0 0x7fce381f6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.487+0000 7fce3ca86700 1 -- 172.21.15.123:0/805435791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce3815cf30 msgr2=0x7fce380b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.487+0000 7fce3ca86700 1 --2- 172.21.15.123:0/805435791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce3815cf30 0x7fce380b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.487+0000 7fce3ca86700 1 -- 172.21.15.123:0/805435791 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce30009b30 con 0x7fce380b1cc0 2024-09-13T17:08:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.487+0000 7fce3ca86700 1 --2- 172.21.15.123:0/805435791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce380b1cc0 0x7fce3815d310 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fce2800c6b0 tx=0x7fce2800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.487+0000 7fce2dffb700 1 -- 172.21.15.123:0/805435791 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28005cd0 con 0x7fce380b1cc0 2024-09-13T17:08:49.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.487+0000 7fce2dffb700 1 -- 172.21.15.123:0/805435791 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce28005e30 con 0x7fce380b1cc0 2024-09-13T17:08:49.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.487+0000 7fce3f4eb700 1 -- 172.21.15.123:0/805435791 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3815dc60 con 0x7fce380b1cc0 2024-09-13T17:08:49.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.487+0000 7fce2dffb700 1 -- 172.21.15.123:0/805435791 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce280072d0 con 0x7fce380b1cc0 2024-09-13T17:08:49.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.487+0000 7fce3f4eb700 1 -- 172.21.15.123:0/805435791 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce381f6170 con 0x7fce380b1cc0 2024-09-13T17:08:49.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.487+0000 7fce3f4eb700 1 -- 172.21.15.123:0/805435791 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce381f6690 con 0x7fce380b1cc0 2024-09-13T17:08:49.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.491+0000 7fce2dffb700 1 -- 172.21.15.123:0/805435791 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fce28007430 con 0x7fce380b1cc0 2024-09-13T17:08:49.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.491+0000 7fce2dffb700 1 --2- 172.21.15.123:0/805435791 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fce1c066730 0x7fce1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.491+0000 7fce2dffb700 1 -- 172.21.15.123:0/805435791 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce28083330 con 0x7fce380b1cc0 2024-09-13T17:08:49.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.491+0000 7fce3d287700 1 --2- 172.21.15.123:0/805435791 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fce1c066730 0x7fce1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.491+0000 7fce3d287700 1 --2- 172.21.15.123:0/805435791 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fce1c066730 0x7fce1c068bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fce3000b370 tx=0x7fce30009000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:49.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.499+0000 7fce2dffb700 1 -- 172.21.15.123:0/805435791 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fce381f6690 con 0x7fce380b1cc0 2024-09-13T17:08:49.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.671+0000 7fce3f4eb700 1 -- 172.21.15.123:0/805435791 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce381f6690 con 0x7fce380b1cc0 2024-09-13T17:08:49.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.675+0000 7fce2dffb700 1 -- 172.21.15.123:0/805435791 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16626 (secure 0 0 0) 0x7fce381f6690 con 0x7fce380b1cc0 2024-09-13T17:08:49.679 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:49.679 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":59,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:49.336723+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:47.655349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:48.327675+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:49.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.675+0000 7fce3f4eb700 1 -- 172.21.15.123:0/805435791 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fce1c066730 msgr2=0x7fce1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.675+0000 7fce3f4eb700 1 --2- 172.21.15.123:0/805435791 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fce1c066730 0x7fce1c068bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fce3000b370 tx=0x7fce30009000 comp rx=0 tx=0).stop 2024-09-13T17:08:49.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.675+0000 7fce3f4eb700 1 -- 172.21.15.123:0/805435791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce380b1cc0 msgr2=0x7fce3815d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.675+0000 7fce3f4eb700 1 --2- 172.21.15.123:0/805435791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce380b1cc0 0x7fce3815d310 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fce2800c6b0 tx=0x7fce2800c9c0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.675+0000 7fce3f4eb700 1 -- 172.21.15.123:0/805435791 shutdown_connections 2024-09-13T17:08:49.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.675+0000 7fce3f4eb700 1 --2- 172.21.15.123:0/805435791 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fce1c066730 0x7fce1c068bf0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.675+0000 7fce3f4eb700 1 --2- 172.21.15.123:0/805435791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce3815cf30 0x7fce380b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.675+0000 7fce3f4eb700 1 --2- 172.21.15.123:0/805435791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce380b1cc0 0x7fce3815d310 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.675+0000 7fce3f4eb700 1 --2- 172.21.15.123:0/805435791 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fce3806dec0 0x7fce381f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.675+0000 7fce3f4eb700 1 -- 172.21.15.123:0/805435791 >> 172.21.15.123:0/805435791 conn(0x7fce3806a6b0 msgr2=0x7fce38153000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:49.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.679+0000 7fce3f4eb700 1 -- 172.21.15.123:0/805435791 shutdown_connections 2024-09-13T17:08:49.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.679+0000 7fce3f4eb700 1 -- 172.21.15.123:0/805435791 wait complete. 2024-09-13T17:08:49.697 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:49.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 Processor -- start 2024-09-13T17:08:49.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 -- start start 2024-09-13T17:08:49.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f700b1fe0 0x7f8f700cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8f700cfc50 0x7f8f700cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f700d1780 con 0x7f8f7015cd60 2024-09-13T17:08:49.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f700d1c10 con 0x7f8f700cfc50 2024-09-13T17:08:49.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700d3670 con 0x7f8f700b1fe0 2024-09-13T17:08:49.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f75eee700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8f700cfc50 0x7f8f700cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f756ed700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8f7015cd60 0x7f8f700cf540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40802/0 (socket says 172.21.15.123:40802) 2024-09-13T17:08:49.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f756ed700 1 -- 172.21.15.123:0/3380083495 learned_addr learned my addr 172.21.15.123:0/3380083495 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:49.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f74eec700 1 --2- 172.21.15.123:0/3380083495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f700b1fe0 0x7f8f700cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f74eec700 1 -- 172.21.15.123:0/3380083495 >> v2:172.21.15.123:3300/0 conn(0x7f8f700cfc50 msgr2=0x7f8f700cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f74eec700 1 --2- 172.21.15.123:0/3380083495 >> v2:172.21.15.123:3300/0 conn(0x7f8f700cfc50 0x7f8f700cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f74eec700 1 -- 172.21.15.123:0/3380083495 >> v1:172.21.15.123:6789/0 conn(0x7f8f7015cd60 legacy=0x7f8f700cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f74eec700 1 -- 172.21.15.123:0/3380083495 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f700d3950 con 0x7f8f700b1fe0 2024-09-13T17:08:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f75eee700 1 --2- 172.21.15.123:0/3380083495 >> v2:172.21.15.123:3300/0 conn(0x7f8f700cfc50 0x7f8f700cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f74eec700 1 --2- 172.21.15.123:0/3380083495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f700b1fe0 0x7f8f700cd760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009d90 tx=0x7f8f6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d4feea7003b230d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f67fff700 1 -- 172.21.15.123:0/3380083495 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c00e070 con 0x7f8f700b1fe0 2024-09-13T17:08:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f67fff700 1 -- 172.21.15.123:0/3380083495 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c00bb20 con 0x7f8f700b1fe0 2024-09-13T17:08:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f67fff700 1 -- 172.21.15.123:0/3380083495 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c012430 con 0x7f8f700b1fe0 2024-09-13T17:08:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 -- 172.21.15.123:0/3380083495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f700b1fe0 msgr2=0x7f8f700cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 --2- 172.21.15.123:0/3380083495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f700b1fe0 0x7f8f700cd760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009d90 tx=0x7f8f6c00b330 comp rx=0 tx=0).stop 2024-09-13T17:08:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 -- 172.21.15.123:0/3380083495 shutdown_connections 2024-09-13T17:08:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 --2- 172.21.15.123:0/3380083495 >> v2:172.21.15.123:3300/0 conn(0x7f8f700cfc50 0x7f8f700cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 --2- 172.21.15.123:0/3380083495 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f700b1fe0 0x7f8f700cd760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 -- 172.21.15.123:0/3380083495 >> 172.21.15.123:0/3380083495 conn(0x7f8f700d2b50 msgr2=0x7f8f700d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:49.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 -- 172.21.15.123:0/3380083495 shutdown_connections 2024-09-13T17:08:49.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.811+0000 7f8f766ef700 1 -- 172.21.15.123:0/3380083495 wait complete. 2024-09-13T17:08:49.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f766ef700 1 Processor -- start 2024-09-13T17:08:49.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f766ef700 1 -- start start 2024-09-13T17:08:49.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f766ef700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f700b1fe0 0x7f8f700c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f766ef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f700cfc50 0x7f8f7014af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f766ef700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7015cd60 0x7f8f7014b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f766ef700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700cb7c0 con 0x7f8f700cfc50 2024-09-13T17:08:49.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f766ef700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700ca450 con 0x7f8f7015cd60 2024-09-13T17:08:49.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f766ef700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700ca730 con 0x7f8f700b1fe0 2024-09-13T17:08:49.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f74eec700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f700cfc50 0x7f8f7014af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f756ed700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f700b1fe0 0x7f8f700c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f74eec700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f700cfc50 0x7f8f7014af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41108/0 (socket says 172.21.15.123:41108) 2024-09-13T17:08:49.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f75eee700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7015cd60 0x7f8f7014b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f74eec700 1 -- 172.21.15.123:0/1851369563 learned_addr learned my addr 172.21.15.123:0/1851369563 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:49.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f74eec700 1 -- 172.21.15.123:0/1851369563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f700b1fe0 msgr2=0x7f8f700c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f74eec700 1 --2- 172.21.15.123:0/1851369563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f700b1fe0 0x7f8f700c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f74eec700 1 -- 172.21.15.123:0/1851369563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7015cd60 msgr2=0x7f8f7014b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:49.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f74eec700 1 --2- 172.21.15.123:0/1851369563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7015cd60 0x7f8f7014b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:49.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f74eec700 1 -- 172.21.15.123:0/1851369563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f680094b0 con 0x7f8f700cfc50 2024-09-13T17:08:49.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f74eec700 1 --2- 172.21.15.123:0/1851369563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f700cfc50 0x7f8f7014af00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c014040 tx=0x7f8f6c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:49.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.815+0000 7f8f65ffb700 1 -- 172.21.15.123:0/1851369563 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c012430 con 0x7f8f700cfc50 2024-09-13T17:08:49.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.819+0000 7f8f766ef700 1 -- 172.21.15.123:0/1851369563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c009a70 con 0x7f8f700cfc50 2024-09-13T17:08:49.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.819+0000 7f8f766ef700 1 -- 172.21.15.123:0/1851369563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f700cb450 con 0x7f8f700cfc50 2024-09-13T17:08:49.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.819+0000 7f8f65ffb700 1 -- 172.21.15.123:0/1851369563 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c020070 con 0x7f8f700cfc50 2024-09-13T17:08:49.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.819+0000 7f8f65ffb700 1 -- 172.21.15.123:0/1851369563 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c004240 con 0x7f8f700cfc50 2024-09-13T17:08:49.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.819+0000 7f8f766ef700 1 -- 172.21.15.123:0/1851369563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f50005310 con 0x7f8f700cfc50 2024-09-13T17:08:49.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.823+0000 7f8f65ffb700 1 -- 172.21.15.123:0/1851369563 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8f6c0043a0 con 0x7f8f700cfc50 2024-09-13T17:08:49.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.823+0000 7f8f65ffb700 1 --2- 172.21.15.123:0/1851369563 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8f5c066730 0x7f8f5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:49.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.823+0000 7f8f65ffb700 1 -- 172.21.15.123:0/1851369563 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f6c022070 con 0x7f8f700cfc50 2024-09-13T17:08:49.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.823+0000 7f8f756ed700 1 --2- 172.21.15.123:0/1851369563 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8f5c066730 0x7f8f5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:49.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.823+0000 7f8f756ed700 1 --2- 172.21.15.123:0/1851369563 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8f5c066730 0x7f8f5c068bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8f60005930 tx=0x7f8f60009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:49.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.827+0000 7f8f65ffb700 1 -- 172.21.15.123:0/1851369563 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8f6c053bd0 con 0x7f8f700cfc50 2024-09-13T17:08:50.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.999+0000 7f8f766ef700 1 -- 172.21.15.123:0/1851369563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f50005890 con 0x7f8f700cfc50 2024-09-13T17:08:50.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:49.999+0000 7f8f65ffb700 1 -- 172.21.15.123:0/1851369563 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16626 (secure 0 0 0) 0x7f8f6c0571f0 con 0x7f8f700cfc50 2024-09-13T17:08:50.005 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:50.005 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":59,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:49.336723+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:47.655349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:48.327675+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:50.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.003+0000 7f8f766ef700 1 -- 172.21.15.123:0/1851369563 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8f5c066730 msgr2=0x7f8f5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:50.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.003+0000 7f8f766ef700 1 --2- 172.21.15.123:0/1851369563 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8f5c066730 0x7f8f5c068bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8f60005930 tx=0x7f8f60009040 comp rx=0 tx=0).stop 2024-09-13T17:08:50.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.003+0000 7f8f766ef700 1 -- 172.21.15.123:0/1851369563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f700cfc50 msgr2=0x7f8f7014af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:50.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.003+0000 7f8f766ef700 1 --2- 172.21.15.123:0/1851369563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f700cfc50 0x7f8f7014af00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c014040 tx=0x7f8f6c004af0 comp rx=0 tx=0).stop 2024-09-13T17:08:50.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.003+0000 7f8f766ef700 1 -- 172.21.15.123:0/1851369563 shutdown_connections 2024-09-13T17:08:50.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.003+0000 7f8f766ef700 1 --2- 172.21.15.123:0/1851369563 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8f5c066730 0x7f8f5c068bf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:50.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.003+0000 7f8f766ef700 1 --2- 172.21.15.123:0/1851369563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7015cd60 0x7f8f7014b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:50.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.003+0000 7f8f766ef700 1 --2- 172.21.15.123:0/1851369563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f700cfc50 0x7f8f7014af00 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:50.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.003+0000 7f8f766ef700 1 --2- 172.21.15.123:0/1851369563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f700b1fe0 0x7f8f700c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:50.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.003+0000 7f8f766ef700 1 -- 172.21.15.123:0/1851369563 >> 172.21.15.123:0/1851369563 conn(0x7f8f700d2b50 msgr2=0x7f8f700b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:50.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.003+0000 7f8f766ef700 1 -- 172.21.15.123:0/1851369563 shutdown_connections 2024-09-13T17:08:50.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.003+0000 7f8f766ef700 1 -- 172.21.15.123:0/1851369563 wait complete. 2024-09-13T17:08:50.020 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:08:50.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa8a4a24700 1 Processor -- start 2024-09-13T17:08:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa8a4a24700 1 -- start start 2024-09-13T17:08:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa8a4a24700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a0165760 0x7fa8a0167b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa8a4a24700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00d0cb0 con 0x7fa8a00b58b0 2024-09-13T17:08:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa8a4a24700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00b0060 con 0x7fa8a00d0f40 2024-09-13T17:08:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa8a4a24700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00b0340 con 0x7fa8a0165760 2024-09-13T17:08:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa89e59c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa8a00b58b0 0x7fa8a00d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40814/0 (socket says 172.21.15.123:40814) 2024-09-13T17:08:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa89e59c700 1 -- 172.21.15.123:0/1020051927 learned_addr learned my addr 172.21.15.123:0/1020051927 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa89f59e700 1 --2- 172.21.15.123:0/1020051927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a0165760 0x7fa8a0167b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa89dd9b700 1 -- 172.21.15.123:0/1020051927 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845597767 0 0) 0x7fa8a00d0cb0 con 0x7fa8a00b58b0 2024-09-13T17:08:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa89dd9b700 1 -- 172.21.15.123:0/1020051927 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa88c0035d0 con 0x7fa8a00b58b0 2024-09-13T17:08:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa89dd9b700 1 -- 172.21.15.123:0/1020051927 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1498539717 0 0) 0x7fa88c0035d0 con 0x7fa8a00b58b0 2024-09-13T17:08:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa89f59e700 1 -- 172.21.15.123:0/1020051927 >> v1:172.21.15.153:6789/0 conn(0x7fa8a00d0f40 legacy=0x7fa8a00d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa89f59e700 1 -- 172.21.15.123:0/1020051927 >> v1:172.21.15.123:6789/0 conn(0x7fa8a00b58b0 legacy=0x7fa8a00d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa89f59e700 1 -- 172.21.15.123:0/1020051927 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00b0620 con 0x7fa8a0165760 2024-09-13T17:08:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa89f59e700 1 --2- 172.21.15.123:0/1020051927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a0165760 0x7fa8a0167b50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa898009dc0 tx=0x7fa89800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95b4e2dc5662ce58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa89dd9b700 1 -- 172.21.15.123:0/1020051927 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800e070 con 0x7fa8a0165760 2024-09-13T17:08:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa89dd9b700 1 -- 172.21.15.123:0/1020051927 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898003a40 con 0x7fa8a0165760 2024-09-13T17:08:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.135+0000 7fa89dd9b700 1 -- 172.21.15.123:0/1020051927 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888001670 con 0x7fa8a0165760 2024-09-13T17:08:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 -- 172.21.15.123:0/1020051927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a0165760 msgr2=0x7fa8a0167b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 --2- 172.21.15.123:0/1020051927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a0165760 0x7fa8a0167b50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa898009dc0 tx=0x7fa89800b330 comp rx=0 tx=0).stop 2024-09-13T17:08:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 -- 172.21.15.123:0/1020051927 shutdown_connections 2024-09-13T17:08:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 --2- 172.21.15.123:0/1020051927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a0165760 0x7fa8a0167b50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 -- 172.21.15.123:0/1020051927 >> 172.21.15.123:0/1020051927 conn(0x7fa8a00d2a60 msgr2=0x7fa8a00d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 -- 172.21.15.123:0/1020051927 shutdown_connections 2024-09-13T17:08:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 -- 172.21.15.123:0/1020051927 wait complete. 2024-09-13T17:08:50.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 Processor -- start 2024-09-13T17:08:50.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 -- start start 2024-09-13T17:08:50.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a00b58b0 0x7fa8a00b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:50.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d0f40 0x7fa8a014f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:50.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a0165760 0x7fa8a0156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:50.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00b3500 con 0x7fa8a00d0f40 2024-09-13T17:08:50.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a0154da0 con 0x7fa8a0165760 2024-09-13T17:08:50.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa8a4a24700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a014fd90 con 0x7fa8a00b58b0 2024-09-13T17:08:50.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa89e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d0f40 0x7fa8a014f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:50.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa89e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d0f40 0x7fa8a014f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41122/0 (socket says 172.21.15.123:41122) 2024-09-13T17:08:50.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.139+0000 7fa89e59c700 1 -- 172.21.15.123:0/859951875 learned_addr learned my addr 172.21.15.123:0/859951875 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:50.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa89f59e700 1 --2- 172.21.15.123:0/859951875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a0165760 0x7fa8a0156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:50.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa89ed9d700 1 --2- 172.21.15.123:0/859951875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a00b58b0 0x7fa8a00b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:50.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa89e59c700 1 -- 172.21.15.123:0/859951875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a00b58b0 msgr2=0x7fa8a00b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:50.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa89e59c700 1 --2- 172.21.15.123:0/859951875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a00b58b0 0x7fa8a00b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:50.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa89e59c700 1 -- 172.21.15.123:0/859951875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a0165760 msgr2=0x7fa8a0156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:50.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa89e59c700 1 --2- 172.21.15.123:0/859951875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a0165760 0x7fa8a0156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:50.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa89e59c700 1 -- 172.21.15.123:0/859951875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa898009a70 con 0x7fa8a00d0f40 2024-09-13T17:08:50.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa89e59c700 1 --2- 172.21.15.123:0/859951875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d0f40 0x7fa8a014f850 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa88800c730 tx=0x7fa88800caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:50.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa8977fe700 1 -- 172.21.15.123:0/859951875 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888004ca0 con 0x7fa8a00d0f40 2024-09-13T17:08:50.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa8977fe700 1 -- 172.21.15.123:0/859951875 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa888004e00 con 0x7fa8a00d0f40 2024-09-13T17:08:50.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa8a4a24700 1 -- 172.21.15.123:0/859951875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a0156f40 con 0x7fa8a00d0f40 2024-09-13T17:08:50.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa8977fe700 1 -- 172.21.15.123:0/859951875 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888007310 con 0x7fa8a00d0f40 2024-09-13T17:08:50.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa8a4a24700 1 -- 172.21.15.123:0/859951875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a00b2f40 con 0x7fa8a00d0f40 2024-09-13T17:08:50.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa8977fe700 1 -- 172.21.15.123:0/859951875 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa888007470 con 0x7fa8a00d0f40 2024-09-13T17:08:50.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa8a4a24700 1 -- 172.21.15.123:0/859951875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a015ce70 con 0x7fa8a00d0f40 2024-09-13T17:08:50.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa8977fe700 1 --2- 172.21.15.123:0/859951875 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa880066730 0x7fa880068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:50.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa8977fe700 1 -- 172.21.15.123:0/859951875 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa888083330 con 0x7fa8a00d0f40 2024-09-13T17:08:50.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.143+0000 7fa89ed9d700 1 --2- 172.21.15.123:0/859951875 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa880066730 0x7fa880068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:50.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.147+0000 7fa89ed9d700 1 --2- 172.21.15.123:0/859951875 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa880066730 0x7fa880068bf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa890001800 tx=0x7fa890009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:50.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.151+0000 7fa8977fe700 1 -- 172.21.15.123:0/859951875 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8880506b0 con 0x7fa8a00d0f40 2024-09-13T17:08:50.300 INFO:tasks.ceph.mds.c.smithi123.stderr:2024-09-13T17:08:50.295+0000 7f9992992700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:08:50.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:50.367+0000 7fa8a4a24700 1 -- 172.21.15.123:0/859951875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa8a00b21a0 con 0x7fa8a00d0f40 2024-09-13T17:08:51.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.347+0000 7fa8977fe700 1 -- 172.21.15.123:0/859951875 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa888007720 con 0x7fa8a00d0f40 2024-09-13T17:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.351+0000 7fa8a4a24700 1 -- 172.21.15.123:0/859951875 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa880066730 msgr2=0x7fa880068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.351+0000 7fa8a4a24700 1 --2- 172.21.15.123:0/859951875 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa880066730 0x7fa880068bf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa890001800 tx=0x7fa890009040 comp rx=0 tx=0).stop 2024-09-13T17:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.351+0000 7fa8a4a24700 1 -- 172.21.15.123:0/859951875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d0f40 msgr2=0x7fa8a014f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.351+0000 7fa8a4a24700 1 --2- 172.21.15.123:0/859951875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d0f40 0x7fa8a014f850 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa88800c730 tx=0x7fa88800caf0 comp rx=0 tx=0).stop 2024-09-13T17:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.351+0000 7fa8a4a24700 1 -- 172.21.15.123:0/859951875 shutdown_connections 2024-09-13T17:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.351+0000 7fa8a4a24700 1 --2- 172.21.15.123:0/859951875 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa880066730 0x7fa880068bf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.351+0000 7fa8a4a24700 1 --2- 172.21.15.123:0/859951875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a0165760 0x7fa8a0156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.351+0000 7fa8a4a24700 1 --2- 172.21.15.123:0/859951875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8a00d0f40 0x7fa8a014f850 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.351+0000 7fa8a4a24700 1 --2- 172.21.15.123:0/859951875 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa8a00b58b0 0x7fa8a00b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:51.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.351+0000 7fa8a4a24700 1 -- 172.21.15.123:0/859951875 >> 172.21.15.123:0/859951875 conn(0x7fa8a00d2a60 msgr2=0x7fa8a00ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:51.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.351+0000 7fa8a4a24700 1 -- 172.21.15.123:0/859951875 shutdown_connections 2024-09-13T17:08:51.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.351+0000 7fa8a4a24700 1 -- 172.21.15.123:0/859951875 wait complete. 2024-09-13T17:08:51.372 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:08:51.373 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:08:51.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.491+0000 7fd816b66700 1 Processor -- start 2024-09-13T17:08:51.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.491+0000 7fd816b66700 1 -- start start 2024-09-13T17:08:51.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd816b66700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd810159c60 0x7fd81015e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:51.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd816b66700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8100ada60 con 0x7fd8100cdda0 2024-09-13T17:08:51.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd816b66700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81015e680 con 0x7fd810070f90 2024-09-13T17:08:51.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd816b66700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8100720a0 con 0x7fd810159c60 2024-09-13T17:08:51.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd815b64700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd810159c60 0x7fd81015e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:51.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd816365700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd8100cdda0 0x7fd81006c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40822/0 (socket says 172.21.15.123:40822) 2024-09-13T17:08:51.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd816365700 1 -- 172.21.15.123:0/2280731984 learned_addr learned my addr 172.21.15.123:0/2280731984 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:51.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd814b62700 1 -- 172.21.15.123:0/2280731984 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072947295 0 0) 0x7fd8100ada60 con 0x7fd8100cdda0 2024-09-13T17:08:51.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd814b62700 1 -- 172.21.15.123:0/2280731984 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7fc0035d0 con 0x7fd8100cdda0 2024-09-13T17:08:51.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd815b64700 1 -- 172.21.15.123:0/2280731984 >> v1:172.21.15.153:6789/0 conn(0x7fd810070f90 legacy=0x7fd8100cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:51.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd815b64700 1 -- 172.21.15.123:0/2280731984 >> v1:172.21.15.123:6789/0 conn(0x7fd8100cdda0 legacy=0x7fd81006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:51.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd815b64700 1 -- 172.21.15.123:0/2280731984 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd810072530 con 0x7fd810159c60 2024-09-13T17:08:51.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd815b64700 1 --2- 172.21.15.123:0/2280731984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd810159c60 0x7fd81015e140 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009850 tx=0x7fd80c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d6938713857385 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:51.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd814b62700 1 -- 172.21.15.123:0/2280731984 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c011830 con 0x7fd810159c60 2024-09-13T17:08:51.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd814b62700 1 -- 172.21.15.123:0/2280731984 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c011990 con 0x7fd810159c60 2024-09-13T17:08:51.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd814b62700 1 -- 172.21.15.123:0/2280731984 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c011d40 con 0x7fd810159c60 2024-09-13T17:08:51.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd816b66700 1 -- 172.21.15.123:0/2280731984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd810159c60 msgr2=0x7fd81015e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:51.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd816b66700 1 --2- 172.21.15.123:0/2280731984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd810159c60 0x7fd81015e140 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009850 tx=0x7fd80c009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:51.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd816b66700 1 -- 172.21.15.123:0/2280731984 shutdown_connections 2024-09-13T17:08:51.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd816b66700 1 --2- 172.21.15.123:0/2280731984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd810159c60 0x7fd81015e140 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:51.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd816b66700 1 -- 172.21.15.123:0/2280731984 >> 172.21.15.123:0/2280731984 conn(0x7fd8100b01d0 msgr2=0x7fd8100b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:51.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd816b66700 1 -- 172.21.15.123:0/2280731984 shutdown_connections 2024-09-13T17:08:51.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.495+0000 7fd816b66700 1 -- 172.21.15.123:0/2280731984 wait complete. 2024-09-13T17:08:51.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd816b66700 1 Processor -- start 2024-09-13T17:08:51.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd816b66700 1 -- start start 2024-09-13T17:08:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd816b66700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd810070f90 0x7fd8100b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd816b66700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8100cdda0 0x7fd8100ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd816b66700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd810159c60 0x7fd8100addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd816b66700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100c6c20 con 0x7fd8100cdda0 2024-09-13T17:08:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd816b66700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81015d630 con 0x7fd810159c60 2024-09-13T17:08:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd816b66700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81015d910 con 0x7fd810070f90 2024-09-13T17:08:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd815363700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8100cdda0 0x7fd8100ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd815363700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8100cdda0 0x7fd8100ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41134/0 (socket says 172.21.15.123:41134) 2024-09-13T17:08:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd815363700 1 -- 172.21.15.123:0/3305113001 learned_addr learned my addr 172.21.15.123:0/3305113001 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd815b64700 1 --2- 172.21.15.123:0/3305113001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd810070f90 0x7fd8100b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd816365700 1 --2- 172.21.15.123:0/3305113001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd810159c60 0x7fd8100addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd815363700 1 -- 172.21.15.123:0/3305113001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd810070f90 msgr2=0x7fd8100b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:51.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd815363700 1 --2- 172.21.15.123:0/3305113001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd810070f90 0x7fd8100b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd815363700 1 -- 172.21.15.123:0/3305113001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd810159c60 msgr2=0x7fd8100addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd815363700 1 --2- 172.21.15.123:0/3305113001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd810159c60 0x7fd8100addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd815363700 1 -- 172.21.15.123:0/3305113001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c0094b0 con 0x7fd8100cdda0 2024-09-13T17:08:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd815363700 1 --2- 172.21.15.123:0/3305113001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8100cdda0 0x7fd8100ad8b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd80000c500 tx=0x7fd80000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd8067fc700 1 -- 172.21.15.123:0/3305113001 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000052d0 con 0x7fd8100cdda0 2024-09-13T17:08:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd8067fc700 1 -- 172.21.15.123:0/3305113001 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800005430 con 0x7fd8100cdda0 2024-09-13T17:08:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd816b66700 1 -- 172.21.15.123:0/3305113001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8100c6ea0 con 0x7fd8100cdda0 2024-09-13T17:08:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd8067fc700 1 -- 172.21.15.123:0/3305113001 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000055a0 con 0x7fd8100cdda0 2024-09-13T17:08:51.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.499+0000 7fd816b66700 1 -- 172.21.15.123:0/3305113001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81014a170 con 0x7fd8100cdda0 2024-09-13T17:08:51.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.503+0000 7fd8067fc700 1 -- 172.21.15.123:0/3305113001 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd8000038e0 con 0x7fd8100cdda0 2024-09-13T17:08:51.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.503+0000 7fd816b66700 1 -- 172.21.15.123:0/3305113001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8100c73c0 con 0x7fd8100cdda0 2024-09-13T17:08:51.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.503+0000 7fd8067fc700 1 --2- 172.21.15.123:0/3305113001 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd7f4066760 0x7fd7f4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:51.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.503+0000 7fd8067fc700 1 -- 172.21.15.123:0/3305113001 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8000833b0 con 0x7fd8100cdda0 2024-09-13T17:08:51.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.503+0000 7fd815b64700 1 --2- 172.21.15.123:0/3305113001 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd7f4066760 0x7fd7f4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:51.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.503+0000 7fd815b64700 1 --2- 172.21.15.123:0/3305113001 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd7f4066760 0x7fd7f4068c20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0090b0 tx=0x7fd80c01c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:51.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.511+0000 7fd8067fc700 1 -- 172.21.15.123:0/3305113001 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd8100c73c0 con 0x7fd8100cdda0 2024-09-13T17:08:51.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:51.715+0000 7fd816b66700 1 -- 172.21.15.123:0/3305113001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd81015e680 con 0x7fd8100cdda0 2024-09-13T17:08:52.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.355+0000 7fd8067fc700 1 -- 172.21.15.123:0/3305113001 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd81015e680 con 0x7fd8100cdda0 2024-09-13T17:08:52.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.359+0000 7fd816b66700 1 -- 172.21.15.123:0/3305113001 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd7f4066760 msgr2=0x7fd7f4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:52.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.359+0000 7fd816b66700 1 --2- 172.21.15.123:0/3305113001 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd7f4066760 0x7fd7f4068c20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0090b0 tx=0x7fd80c01c040 comp rx=0 tx=0).stop 2024-09-13T17:08:52.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.359+0000 7fd816b66700 1 -- 172.21.15.123:0/3305113001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8100cdda0 msgr2=0x7fd8100ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:52.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.359+0000 7fd816b66700 1 --2- 172.21.15.123:0/3305113001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8100cdda0 0x7fd8100ad8b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd80000c500 tx=0x7fd80000c810 comp rx=0 tx=0).stop 2024-09-13T17:08:52.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.359+0000 7fd816b66700 1 -- 172.21.15.123:0/3305113001 shutdown_connections 2024-09-13T17:08:52.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.359+0000 7fd816b66700 1 --2- 172.21.15.123:0/3305113001 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd7f4066760 0x7fd7f4068c20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.359+0000 7fd816b66700 1 --2- 172.21.15.123:0/3305113001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd810159c60 0x7fd8100addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.359+0000 7fd816b66700 1 --2- 172.21.15.123:0/3305113001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8100cdda0 0x7fd8100ad8b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.359+0000 7fd816b66700 1 --2- 172.21.15.123:0/3305113001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd810070f90 0x7fd8100b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.359+0000 7fd816b66700 1 -- 172.21.15.123:0/3305113001 >> 172.21.15.123:0/3305113001 conn(0x7fd8100b01d0 msgr2=0x7fd81006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:52.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.359+0000 7fd816b66700 1 -- 172.21.15.123:0/3305113001 shutdown_connections 2024-09-13T17:08:52.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.359+0000 7fd816b66700 1 -- 172.21.15.123:0/3305113001 wait complete. 2024-09-13T17:08:52.382 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:08:52.382 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:08:52.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.491+0000 7f1483eea700 1 Processor -- start 2024-09-13T17:08:52.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.491+0000 7f1483eea700 1 -- start start 2024-09-13T17:08:52.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f147c06a260 0x7f147c14fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:52.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c0b17e0 0x7f147c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:52.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f147c070600 0x7f147c070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:52.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c06c050 con 0x7f147c070600 2024-09-13T17:08:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c15d050 con 0x7f147c06a260 2024-09-13T17:08:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c150000 con 0x7f147c0b17e0 2024-09-13T17:08:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1482487700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f147c070600 0x7f147c070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1482487700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f147c070600 0x7f147c070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41516/0 (socket says 172.21.15.123:41516) 2024-09-13T17:08:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1482487700 1 -- 172.21.15.123:0/2493581564 learned_addr learned my addr 172.21.15.123:0/2493581564 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1481485700 1 --2- 172.21.15.123:0/2493581564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c0b17e0 0x7f147c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1481c86700 1 --2- 172.21.15.123:0/2493581564 >> v2:172.21.15.153:3300/0 conn(0x7f147c06a260 0x7f147c14fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1482487700 1 -- 172.21.15.123:0/2493581564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c0b17e0 msgr2=0x7f147c0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1482487700 1 --2- 172.21.15.123:0/2493581564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c0b17e0 0x7f147c0b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1482487700 1 -- 172.21.15.123:0/2493581564 >> v2:172.21.15.153:3300/0 conn(0x7f147c06a260 msgr2=0x7f147c14fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1482487700 1 --2- 172.21.15.123:0/2493581564 >> v2:172.21.15.153:3300/0 conn(0x7f147c06a260 0x7f147c14fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1482487700 1 -- 172.21.15.123:0/2493581564 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c15c740 con 0x7f147c070600 2024-09-13T17:08:52.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1482487700 1 --2- 172.21.15.123:0/2493581564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f147c070600 0x7f147c070a50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f147c15c930 tx=0x7f147400ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83da93d076d4be90 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1480c84700 1 -- 172.21.15.123:0/2493581564 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147400cb40 con 0x7f147c070600 2024-09-13T17:08:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1480c84700 1 -- 172.21.15.123:0/2493581564 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147400cca0 con 0x7f147c070600 2024-09-13T17:08:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1480c84700 1 -- 172.21.15.123:0/2493581564 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474004250 con 0x7f147c070600 2024-09-13T17:08:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 -- 172.21.15.123:0/2493581564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f147c070600 msgr2=0x7f147c070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 --2- 172.21.15.123:0/2493581564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f147c070600 0x7f147c070a50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f147c15c930 tx=0x7f147400ad90 comp rx=0 tx=0).stop 2024-09-13T17:08:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 -- 172.21.15.123:0/2493581564 shutdown_connections 2024-09-13T17:08:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 --2- 172.21.15.123:0/2493581564 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c0b17e0 0x7f147c0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 --2- 172.21.15.123:0/2493581564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f147c070600 0x7f147c070a50 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 --2- 172.21.15.123:0/2493581564 >> v2:172.21.15.153:3300/0 conn(0x7f147c06a260 0x7f147c14fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 -- 172.21.15.123:0/2493581564 >> 172.21.15.123:0/2493581564 conn(0x7f147c066570 msgr2=0x7f147c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 -- 172.21.15.123:0/2493581564 shutdown_connections 2024-09-13T17:08:52.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.495+0000 7f1483eea700 1 -- 172.21.15.123:0/2493581564 wait complete. 2024-09-13T17:08:52.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1483eea700 1 Processor -- start 2024-09-13T17:08:52.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1483eea700 1 -- start start 2024-09-13T17:08:52.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1483eea700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c06a260 0x7f147c14c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:52.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1483eea700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f147c070600 0x7f147c0acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:52.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1483eea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f147c0b17e0 0x7f147c0ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:52.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1483eea700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1f3480 con 0x7f147c0b17e0 2024-09-13T17:08:52.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1483eea700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0ad590 con 0x7f147c070600 2024-09-13T17:08:52.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1483eea700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1f30d0 con 0x7f147c06a260 2024-09-13T17:08:52.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1482487700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f147c0b17e0 0x7f147c0ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:52.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1481c86700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c06a260 0x7f147c14c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:52.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1482487700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f147c0b17e0 0x7f147c0ad050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41528/0 (socket says 172.21.15.123:41528) 2024-09-13T17:08:52.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1481485700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f147c070600 0x7f147c0acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:52.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1482487700 1 -- 172.21.15.123:0/1233953183 learned_addr learned my addr 172.21.15.123:0/1233953183 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:52.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1482487700 1 -- 172.21.15.123:0/1233953183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c06a260 msgr2=0x7f147c14c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:52.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1482487700 1 --2- 172.21.15.123:0/1233953183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c06a260 0x7f147c14c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1482487700 1 -- 172.21.15.123:0/1233953183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f147c070600 msgr2=0x7f147c0acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:52.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.499+0000 7f1482487700 1 --2- 172.21.15.123:0/1233953183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f147c070600 0x7f147c0acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.503+0000 7f1482487700 1 -- 172.21.15.123:0/1233953183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147400a710 con 0x7f147c0b17e0 2024-09-13T17:08:52.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.503+0000 7f1481485700 1 --2- 172.21.15.123:0/1233953183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f147c070600 0x7f147c0acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:52.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.503+0000 7f1482487700 1 --2- 172.21.15.123:0/1233953183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f147c0b17e0 0x7f147c0ad050 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f147400add0 tx=0x7f1474004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:52.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.503+0000 7f146e7fc700 1 -- 172.21.15.123:0/1233953183 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147401d070 con 0x7f147c0b17e0 2024-09-13T17:08:52.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.503+0000 7f146e7fc700 1 -- 172.21.15.123:0/1233953183 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1474004400 con 0x7f147c0b17e0 2024-09-13T17:08:52.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.503+0000 7f1483eea700 1 -- 172.21.15.123:0/1233953183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c1f3690 con 0x7f147c0b17e0 2024-09-13T17:08:52.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.503+0000 7f146e7fc700 1 -- 172.21.15.123:0/1233953183 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474004030 con 0x7f147c0b17e0 2024-09-13T17:08:52.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.503+0000 7f1483eea700 1 -- 172.21.15.123:0/1233953183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c1f3c50 con 0x7f147c0b17e0 2024-09-13T17:08:52.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.503+0000 7f146e7fc700 1 -- 172.21.15.123:0/1233953183 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f14740183f0 con 0x7f147c0b17e0 2024-09-13T17:08:52.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.507+0000 7f1483eea700 1 -- 172.21.15.123:0/1233953183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c15d4e0 con 0x7f147c0b17e0 2024-09-13T17:08:52.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.507+0000 7f146e7fc700 1 --2- 172.21.15.123:0/1233953183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1460066730 0x7f1460068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:52.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.507+0000 7f146e7fc700 1 -- 172.21.15.123:0/1233953183 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14740852f0 con 0x7f147c0b17e0 2024-09-13T17:08:52.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.507+0000 7f1481c86700 1 --2- 172.21.15.123:0/1233953183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1460066730 0x7f1460068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:52.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.507+0000 7f1481c86700 1 --2- 172.21.15.123:0/1233953183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1460066730 0x7f1460068bf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f147c14cd10 tx=0x7f1470008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:52.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.515+0000 7f146e7fc700 1 -- 172.21.15.123:0/1233953183 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f14740526f0 con 0x7f147c0b17e0 2024-09-13T17:08:52.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.719+0000 7f1483eea700 1 -- 172.21.15.123:0/1233953183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f147c0ae670 con 0x7f147c0b17e0 2024-09-13T17:08:52.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.719+0000 7f146e7fc700 1 -- 172.21.15.123:0/1233953183 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4746 (secure 0 0 0) 0x7f1474055d10 con 0x7f147c0b17e0 2024-09-13T17:08:52.725 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:52.726 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2493352744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2493352744},{"type":"v1","addr":"172.21.15.153:6833","nonce":2493352744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3030199256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3030199256},{"type":"v1","addr":"172.21.15.153:6835","nonce":3030199256}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":6120,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2341008668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2341008668},{"type":"v1","addr":"172.21.15.123:6835","nonce":2341008668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:08:49.337652+0000","modified":"2024-09-13T17:08:52.352454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6126},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6126":{"gid":6126,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2270367518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2270367518},{"type":"v1","addr":"172.21.15.123:6837","nonce":2270367518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T17:08:52.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.723+0000 7f1483eea700 1 -- 172.21.15.123:0/1233953183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1460066730 msgr2=0x7f1460068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.723+0000 7f1483eea700 1 --2- 172.21.15.123:0/1233953183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1460066730 0x7f1460068bf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f147c14cd10 tx=0x7f1470008040 comp rx=0 tx=0).stop 2024-09-13T17:08:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.723+0000 7f1483eea700 1 -- 172.21.15.123:0/1233953183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f147c0b17e0 msgr2=0x7f147c0ad050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.723+0000 7f1483eea700 1 --2- 172.21.15.123:0/1233953183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f147c0b17e0 0x7f147c0ad050 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f147400add0 tx=0x7f1474004770 comp rx=0 tx=0).stop 2024-09-13T17:08:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.723+0000 7f1483eea700 1 -- 172.21.15.123:0/1233953183 shutdown_connections 2024-09-13T17:08:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.723+0000 7f1483eea700 1 --2- 172.21.15.123:0/1233953183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1460066730 0x7f1460068bf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.723+0000 7f1483eea700 1 --2- 172.21.15.123:0/1233953183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f147c0b17e0 0x7f147c0ad050 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.723+0000 7f1483eea700 1 --2- 172.21.15.123:0/1233953183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f147c070600 0x7f147c0acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.723+0000 7f1483eea700 1 --2- 172.21.15.123:0/1233953183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f147c06a260 0x7f147c14c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.723+0000 7f1483eea700 1 -- 172.21.15.123:0/1233953183 >> 172.21.15.123:0/1233953183 conn(0x7f147c066570 msgr2=0x7f147c0b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.723+0000 7f1483eea700 1 -- 172.21.15.123:0/1233953183 shutdown_connections 2024-09-13T17:08:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.723+0000 7f1483eea700 1 -- 172.21.15.123:0/1233953183 wait complete. 2024-09-13T17:08:52.731 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 28 2024-09-13T17:08:52.744 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:08:52.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa47fff700 1 Processor -- start 2024-09-13T17:08:52.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa47fff700 1 -- start start 2024-09-13T17:08:52.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa47fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa48160620 0x7ffa4815d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa47fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa4815dc30 0x7ffa4806cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa47fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa48161510 con 0x7ffa480b1b20 2024-09-13T17:08:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa47fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa48160a60 con 0x7ffa4815dc30 2024-09-13T17:08:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa47fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4815d260 con 0x7ffa48160620 2024-09-13T17:08:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa46ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ffa480b1b20 0x7ffa48072430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44274/0 (socket says 172.21.15.123:44274) 2024-09-13T17:08:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa46ffd700 1 -- 172.21.15.123:0/2495565705 learned_addr learned my addr 172.21.15.123:0/2495565705 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa477fe700 1 --2- 172.21.15.123:0/2495565705 >> v2:172.21.15.123:3300/0 conn(0x7ffa4815dc30 0x7ffa4806cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa467fc700 1 --2- 172.21.15.123:0/2495565705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa48160620 0x7ffa4815d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa45ffb700 1 -- 172.21.15.123:0/2495565705 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684316209 0 0) 0x7ffa48161510 con 0x7ffa480b1b20 2024-09-13T17:08:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa45ffb700 1 -- 172.21.15.123:0/2495565705 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa280035d0 con 0x7ffa480b1b20 2024-09-13T17:08:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa477fe700 1 -- 172.21.15.123:0/2495565705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa48160620 msgr2=0x7ffa4815d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:52.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa477fe700 1 --2- 172.21.15.123:0/2495565705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa48160620 0x7ffa4815d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa477fe700 1 -- 172.21.15.123:0/2495565705 >> v1:172.21.15.123:6789/0 conn(0x7ffa480b1b20 legacy=0x7ffa48072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:52.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa45ffb700 1 -- 172.21.15.123:0/2495565705 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1193550984 0 0) 0x7ffa280035d0 con 0x7ffa480b1b20 2024-09-13T17:08:52.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa477fe700 1 -- 172.21.15.123:0/2495565705 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa48160c70 con 0x7ffa4815dc30 2024-09-13T17:08:52.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa477fe700 1 --2- 172.21.15.123:0/2495565705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa4815dc30 0x7ffa4806cfb0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009850 tx=0x7ffa30009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c77b692dd095487 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:52.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa45ffb700 1 -- 172.21.15.123:0/2495565705 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa400019f0 con 0x7ffa4815dc30 2024-09-13T17:08:52.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa45ffb700 1 -- 172.21.15.123:0/2495565705 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa30004030 con 0x7ffa4815dc30 2024-09-13T17:08:52.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.855+0000 7ffa45ffb700 1 -- 172.21.15.123:0/2495565705 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300043a0 con 0x7ffa4815dc30 2024-09-13T17:08:52.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 -- 172.21.15.123:0/2495565705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa4815dc30 msgr2=0x7ffa4806cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:52.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 --2- 172.21.15.123:0/2495565705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa4815dc30 0x7ffa4806cfb0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009850 tx=0x7ffa30009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:52.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 -- 172.21.15.123:0/2495565705 shutdown_connections 2024-09-13T17:08:52.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 --2- 172.21.15.123:0/2495565705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa4815dc30 0x7ffa4806cfb0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 --2- 172.21.15.123:0/2495565705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa48160620 0x7ffa4815d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 -- 172.21.15.123:0/2495565705 >> 172.21.15.123:0/2495565705 conn(0x7ffa480733b0 msgr2=0x7ffa48066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:52.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 -- 172.21.15.123:0/2495565705 shutdown_connections 2024-09-13T17:08:52.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 -- 172.21.15.123:0/2495565705 wait complete. 2024-09-13T17:08:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 Processor -- start 2024-09-13T17:08:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 -- start start 2024-09-13T17:08:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa480b1b20 0x7ffa4814be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa4815dc30 0x7ffa481e6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa48160620 0x7ffa4814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4814bc70 con 0x7ffa480b1b20 2024-09-13T17:08:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa48159fa0 con 0x7ffa4815dc30 2024-09-13T17:08:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4815a280 con 0x7ffa48160620 2024-09-13T17:08:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa46ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa480b1b20 0x7ffa4814be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa46ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa480b1b20 0x7ffa4814be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41536/0 (socket says 172.21.15.123:41536) 2024-09-13T17:08:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa46ffd700 1 -- 172.21.15.123:0/1208988105 learned_addr learned my addr 172.21.15.123:0/1208988105 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:52.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa467fc700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa4815dc30 0x7ffa481e6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:52.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa477fe700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa48160620 0x7ffa4814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:52.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa46ffd700 1 -- 172.21.15.123:0/1208988105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa48160620 msgr2=0x7ffa4814b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:52.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa46ffd700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa48160620 0x7ffa4814b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa46ffd700 1 -- 172.21.15.123:0/1208988105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa4815dc30 msgr2=0x7ffa481e6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:52.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa46ffd700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa4815dc30 0x7ffa481e6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:52.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa46ffd700 1 -- 172.21.15.123:0/1208988105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa300094b0 con 0x7ffa480b1b20 2024-09-13T17:08:52.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa467fc700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa4815dc30 0x7ffa481e6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:52.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa46ffd700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa480b1b20 0x7ffa4814be10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000cc70 tx=0x7ffa4000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:52.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa3f7fe700 1 -- 172.21.15.123:0/1208988105 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4000ade0 con 0x7ffa480b1b20 2024-09-13T17:08:52.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa3f7fe700 1 -- 172.21.15.123:0/1208988105 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4000ce70 con 0x7ffa480b1b20 2024-09-13T17:08:52.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa47fff700 1 -- 172.21.15.123:0/1208988105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa48157800 con 0x7ffa480b1b20 2024-09-13T17:08:52.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.859+0000 7ffa3f7fe700 1 -- 172.21.15.123:0/1208988105 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa400072f0 con 0x7ffa480b1b20 2024-09-13T17:08:52.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.863+0000 7ffa47fff700 1 -- 172.21.15.123:0/1208988105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4814c510 con 0x7ffa480b1b20 2024-09-13T17:08:52.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.863+0000 7ffa47fff700 1 -- 172.21.15.123:0/1208988105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa48157660 con 0x7ffa480b1b20 2024-09-13T17:08:52.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.863+0000 7ffa3f7fe700 1 -- 172.21.15.123:0/1208988105 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffa40007450 con 0x7ffa480b1b20 2024-09-13T17:08:52.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.863+0000 7ffa3f7fe700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffa2c066730 0x7ffa2c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:52.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.863+0000 7ffa3f7fe700 1 -- 172.21.15.123:0/1208988105 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa40084090 con 0x7ffa480b1b20 2024-09-13T17:08:52.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.863+0000 7ffa467fc700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffa2c066730 0x7ffa2c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.867+0000 7ffa467fc700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffa2c066730 0x7ffa2c068bf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ffa4815f8b0 tx=0x7ffa38008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:52.871+0000 7ffa3f7fe700 1 -- 172.21.15.123:0/1208988105 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffa48157660 con 0x7ffa480b1b20 2024-09-13T17:08:53.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.039+0000 7ffa47fff700 1 -- 172.21.15.123:0/1208988105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa48157660 con 0x7ffa480b1b20 2024-09-13T17:08:53.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.043+0000 7ffa3f7fe700 1 -- 172.21.15.123:0/1208988105 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16613 (secure 0 0 0) 0x7ffa48157660 con 0x7ffa480b1b20 2024-09-13T17:08:53.047 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:53.047 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":60,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:50.340369+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:47.655349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:48.327675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:08:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.047+0000 7ffa47fff700 1 -- 172.21.15.123:0/1208988105 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffa2c066730 msgr2=0x7ffa2c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.047+0000 7ffa47fff700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffa2c066730 0x7ffa2c068bf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ffa4815f8b0 tx=0x7ffa38008040 comp rx=0 tx=0).stop 2024-09-13T17:08:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.047+0000 7ffa47fff700 1 -- 172.21.15.123:0/1208988105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa480b1b20 msgr2=0x7ffa4814be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.047+0000 7ffa47fff700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa480b1b20 0x7ffa4814be10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000cc70 tx=0x7ffa4000a340 comp rx=0 tx=0).stop 2024-09-13T17:08:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.047+0000 7ffa47fff700 1 -- 172.21.15.123:0/1208988105 shutdown_connections 2024-09-13T17:08:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.047+0000 7ffa47fff700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffa2c066730 0x7ffa2c068bf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.047+0000 7ffa47fff700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffa48160620 0x7ffa4814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.047+0000 7ffa47fff700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa4815dc30 0x7ffa481e6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.047+0000 7ffa47fff700 1 --2- 172.21.15.123:0/1208988105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa480b1b20 0x7ffa4814be10 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.047+0000 7ffa47fff700 1 -- 172.21.15.123:0/1208988105 >> 172.21.15.123:0/1208988105 conn(0x7ffa480733b0 msgr2=0x7ffa4815c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.047+0000 7ffa47fff700 1 -- 172.21.15.123:0/1208988105 shutdown_connections 2024-09-13T17:08:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.047+0000 7ffa47fff700 1 -- 172.21.15.123:0/1208988105 wait complete. 2024-09-13T17:08:53.066 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:08:53.066 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:08:53.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe171729700 1 Processor -- start 2024-09-13T17:08:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe171729700 1 -- start start 2024-09-13T17:08:53.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe171729700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe16c0cedc0 0x7fe16c071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe171729700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe16c0cdfd0 0x7fe16c159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe171729700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16c15d360 con 0x7fe16c1598b0 2024-09-13T17:08:53.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe171729700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16c0ce3f0 con 0x7fe16c0cdfd0 2024-09-13T17:08:53.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe171729700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16c0724c0 con 0x7fe16c0cedc0 2024-09-13T17:08:53.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe170f28700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe16c0cdfd0 0x7fe16c159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe16bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe16c1598b0 0x7fe16c0ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44280/0 (socket says 172.21.15.123:44280) 2024-09-13T17:08:53.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe16bfff700 1 -- 172.21.15.123:0/3500500114 learned_addr learned my addr 172.21.15.123:0/3500500114 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:53.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe170f28700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe16c0cdfd0 0x7fe16c159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41548/0 (socket says 172.21.15.123:41548) 2024-09-13T17:08:53.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe16b7fe700 1 --2- 172.21.15.123:0/3500500114 >> v2:172.21.15.153:3300/0 conn(0x7fe16c0cedc0 0x7fe16c071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe170f28700 1 -- 172.21.15.123:0/3500500114 >> v2:172.21.15.153:3300/0 conn(0x7fe16c0cedc0 msgr2=0x7fe16c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:53.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe170f28700 1 --2- 172.21.15.123:0/3500500114 >> v2:172.21.15.153:3300/0 conn(0x7fe16c0cedc0 0x7fe16c071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe170f28700 1 -- 172.21.15.123:0/3500500114 >> v1:172.21.15.123:6789/0 conn(0x7fe16c1598b0 legacy=0x7fe16c0ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe170f28700 1 -- 172.21.15.123:0/3500500114 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c15d5b0 con 0x7fe16c0cdfd0 2024-09-13T17:08:53.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe16b7fe700 1 --2- 172.21.15.123:0/3500500114 >> v2:172.21.15.153:3300/0 conn(0x7fe16c0cedc0 0x7fe16c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:53.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe170f28700 1 --2- 172.21.15.123:0/3500500114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe16c0cdfd0 0x7fe16c159c90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe16c06be20 tx=0x7fe16400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff504335dfc637a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:53.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe16affd700 1 -- 172.21.15.123:0/3500500114 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400e070 con 0x7fe16c0cdfd0 2024-09-13T17:08:53.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe16affd700 1 -- 172.21.15.123:0/3500500114 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16400bbd0 con 0x7fe16c0cdfd0 2024-09-13T17:08:53.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.171+0000 7fe16affd700 1 -- 172.21.15.123:0/3500500114 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164012430 con 0x7fe16c0cdfd0 2024-09-13T17:08:53.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 -- 172.21.15.123:0/3500500114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe16c0cdfd0 msgr2=0x7fe16c159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 --2- 172.21.15.123:0/3500500114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe16c0cdfd0 0x7fe16c159c90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe16c06be20 tx=0x7fe16400b330 comp rx=0 tx=0).stop 2024-09-13T17:08:53.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 -- 172.21.15.123:0/3500500114 shutdown_connections 2024-09-13T17:08:53.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 --2- 172.21.15.123:0/3500500114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe16c0cdfd0 0x7fe16c159c90 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 --2- 172.21.15.123:0/3500500114 >> v2:172.21.15.153:3300/0 conn(0x7fe16c0cedc0 0x7fe16c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 -- 172.21.15.123:0/3500500114 >> 172.21.15.123:0/3500500114 conn(0x7fe16c066150 msgr2=0x7fe16c066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:53.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 -- 172.21.15.123:0/3500500114 shutdown_connections 2024-09-13T17:08:53.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 -- 172.21.15.123:0/3500500114 wait complete. 2024-09-13T17:08:53.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 Processor -- start 2024-09-13T17:08:53.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 -- start start 2024-09-13T17:08:53.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe16c0cdfd0 0x7fe16c14c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe16c0cedc0 0x7fe16c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe16c1598b0 0x7fe16c0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0ad120 con 0x7fe16c1598b0 2024-09-13T17:08:53.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0ac080 con 0x7fe16c0cedc0 2024-09-13T17:08:53.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe171729700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0ac360 con 0x7fe16c0cdfd0 2024-09-13T17:08:53.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe170f28700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe16c1598b0 0x7fe16c0cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe170f28700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe16c1598b0 0x7fe16c0cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41554/0 (socket says 172.21.15.123:41554) 2024-09-13T17:08:53.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe170f28700 1 -- 172.21.15.123:0/2803013483 learned_addr learned my addr 172.21.15.123:0/2803013483 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:53.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe16bfff700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe16c0cdfd0 0x7fe16c14c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe16b7fe700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe16c0cedc0 0x7fe16c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe170f28700 1 -- 172.21.15.123:0/2803013483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe16c0cdfd0 msgr2=0x7fe16c14c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe170f28700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe16c0cdfd0 0x7fe16c14c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe170f28700 1 -- 172.21.15.123:0/2803013483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe16c0cedc0 msgr2=0x7fe16c0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe170f28700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe16c0cedc0 0x7fe16c0cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe170f28700 1 -- 172.21.15.123:0/2803013483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe164009a70 con 0x7fe16c1598b0 2024-09-13T17:08:53.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe16b7fe700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe16c0cedc0 0x7fe16c0cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:53.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe16bfff700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe16c0cdfd0 0x7fe16c14c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:53.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.175+0000 7fe170f28700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe16c1598b0 0x7fe16c0cb6e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe164014040 tx=0x7fe164004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:53.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.179+0000 7fe168ff9700 1 -- 172.21.15.123:0/2803013483 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164012430 con 0x7fe16c1598b0 2024-09-13T17:08:53.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.179+0000 7fe168ff9700 1 -- 172.21.15.123:0/2803013483 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe164020070 con 0x7fe16c1598b0 2024-09-13T17:08:53.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.179+0000 7fe168ff9700 1 -- 172.21.15.123:0/2803013483 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164004280 con 0x7fe16c1598b0 2024-09-13T17:08:53.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.179+0000 7fe171729700 1 -- 172.21.15.123:0/2803013483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16c0ac640 con 0x7fe16c1598b0 2024-09-13T17:08:53.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.179+0000 7fe171729700 1 -- 172.21.15.123:0/2803013483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16c0acc00 con 0x7fe16c1598b0 2024-09-13T17:08:53.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.179+0000 7fe171729700 1 -- 172.21.15.123:0/2803013483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16c0677f0 con 0x7fe16c1598b0 2024-09-13T17:08:53.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.179+0000 7fe168ff9700 1 -- 172.21.15.123:0/2803013483 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe1640043e0 con 0x7fe16c1598b0 2024-09-13T17:08:53.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.179+0000 7fe168ff9700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe150066730 0x7fe150068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.179+0000 7fe168ff9700 1 -- 172.21.15.123:0/2803013483 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe164022070 con 0x7fe16c1598b0 2024-09-13T17:08:53.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.183+0000 7fe16bfff700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe150066730 0x7fe150068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.183+0000 7fe16bfff700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe150066730 0x7fe150068bf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe15c005930 tx=0x7fe15c009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:53.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.187+0000 7fe168ff9700 1 -- 172.21.15.123:0/2803013483 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe164053310 con 0x7fe16c1598b0 2024-09-13T17:08:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.355+0000 7fe171729700 1 -- 172.21.15.123:0/2803013483 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe16c15db70 con 0x7fe150066730 2024-09-13T17:08:53.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.371+0000 7fe168ff9700 1 -- 172.21.15.123:0/2803013483 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287994 (secure 0 0 0) 0x7fe15c001c70 con 0x7fe150066730 2024-09-13T17:08:53.384 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.379+0000 7fe171729700 1 -- 172.21.15.123:0/2803013483 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe150066730 msgr2=0x7fe150068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.379+0000 7fe171729700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe150066730 0x7fe150068bf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe15c005930 tx=0x7fe15c009040 comp rx=0 tx=0).stop 2024-09-13T17:08:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.379+0000 7fe171729700 1 -- 172.21.15.123:0/2803013483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe16c1598b0 msgr2=0x7fe16c0cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.379+0000 7fe171729700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe16c1598b0 0x7fe16c0cb6e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe164014040 tx=0x7fe164004af0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.379+0000 7fe171729700 1 -- 172.21.15.123:0/2803013483 shutdown_connections 2024-09-13T17:08:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.379+0000 7fe171729700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe150066730 0x7fe150068bf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.379+0000 7fe171729700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe16c1598b0 0x7fe16c0cb6e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.379+0000 7fe171729700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe16c0cedc0 0x7fe16c0cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.379+0000 7fe171729700 1 --2- 172.21.15.123:0/2803013483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe16c0cdfd0 0x7fe16c14c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.379+0000 7fe171729700 1 -- 172.21.15.123:0/2803013483 >> 172.21.15.123:0/2803013483 conn(0x7fe16c066150 msgr2=0x7fe16c0b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:53.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.379+0000 7fe171729700 1 -- 172.21.15.123:0/2803013483 shutdown_connections 2024-09-13T17:08:53.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.379+0000 7fe171729700 1 -- 172.21.15.123:0/2803013483 wait complete. 2024-09-13T17:08:53.387 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:08:53.398 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-09-13T17:08:52.773390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231232,"kb_used_data":6856,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754743488,"statfs":{"total":773094113280,"available":772857331712,"internally_reserved":0,"allocated":7020544,"data_stored":3593932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":229625401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.823542"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348358+0000","last_change":"2024-09-13T17:08:49.361074+0000","last_active":"2024-09-13T17:08:50.348358+0000","last_peered":"2024-09-13T17:08:50.348358+0000","last_clean":"2024-09-13T17:08:50.348358+0000","last_became_active":"2024-09-13T17:08:49.360761+0000","last_became_peered":"2024-09-13T17:08:49.360761+0000","last_unstale":"2024-09-13T17:08:50.348358+0000","last_undegraded":"2024-09-13T17:08:50.348358+0000","last_fullsized":"2024-09-13T17:08:50.348358+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:17.790124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349473+0000","last_change":"2024-09-13T17:08:49.369653+0000","last_active":"2024-09-13T17:08:50.349473+0000","last_peered":"2024-09-13T17:08:50.349473+0000","last_clean":"2024-09-13T17:08:50.349473+0000","last_became_active":"2024-09-13T17:08:49.369417+0000","last_became_peered":"2024-09-13T17:08:49.369417+0000","last_unstale":"2024-09-13T17:08:50.349473+0000","last_undegraded":"2024-09-13T17:08:50.349473+0000","last_fullsized":"2024-09-13T17:08:50.349473+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:51.499507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349041+0000","last_change":"2024-09-13T17:08:49.362188+0000","last_active":"2024-09-13T17:08:50.349041+0000","last_peered":"2024-09-13T17:08:50.349041+0000","last_clean":"2024-09-13T17:08:50.349041+0000","last_became_active":"2024-09-13T17:08:49.360782+0000","last_became_peered":"2024-09-13T17:08:49.360782+0000","last_unstale":"2024-09-13T17:08:50.349041+0000","last_undegraded":"2024-09-13T17:08:50.349041+0000","last_fullsized":"2024-09-13T17:08:50.349041+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:43.013072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433673+0000","last_change":"2024-09-13T17:08:49.369188+0000","last_active":"2024-09-13T17:08:50.433673+0000","last_peered":"2024-09-13T17:08:50.433673+0000","last_clean":"2024-09-13T17:08:50.433673+0000","last_became_active":"2024-09-13T17:08:49.368919+0000","last_became_peered":"2024-09-13T17:08:49.368919+0000","last_unstale":"2024-09-13T17:08:50.433673+0000","last_undegraded":"2024-09-13T17:08:50.433673+0000","last_fullsized":"2024-09-13T17:08:50.433673+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:43.022139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348231+0000","last_change":"2024-09-13T17:08:49.365979+0000","last_active":"2024-09-13T17:08:50.348231+0000","last_peered":"2024-09-13T17:08:50.348231+0000","last_clean":"2024-09-13T17:08:50.348231+0000","last_became_active":"2024-09-13T17:08:49.365748+0000","last_became_peered":"2024-09-13T17:08:49.365748+0000","last_unstale":"2024-09-13T17:08:50.348231+0000","last_undegraded":"2024-09-13T17:08:50.348231+0000","last_fullsized":"2024-09-13T17:08:50.348231+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:28.781193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837856+0000","last_change":"2024-09-13T17:08:49.359950+0000","last_active":"2024-09-13T17:08:50.837856+0000","last_peered":"2024-09-13T17:08:50.837856+0000","last_clean":"2024-09-13T17:08:50.837856+0000","last_became_active":"2024-09-13T17:08:49.358747+0000","last_became_peered":"2024-09-13T17:08:49.358747+0000","last_unstale":"2024-09-13T17:08:50.837856+0000","last_undegraded":"2024-09-13T17:08:50.837856+0000","last_fullsized":"2024-09-13T17:08:50.837856+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:26.297277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836175+0000","last_change":"2024-09-13T17:08:49.370811+0000","last_active":"2024-09-13T17:08:50.836175+0000","last_peered":"2024-09-13T17:08:50.836175+0000","last_clean":"2024-09-13T17:08:50.836175+0000","last_became_active":"2024-09-13T17:08:49.370364+0000","last_became_peered":"2024-09-13T17:08:49.370364+0000","last_unstale":"2024-09-13T17:08:50.836175+0000","last_undegraded":"2024-09-13T17:08:50.836175+0000","last_fullsized":"2024-09-13T17:08:50.836175+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:41.075443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.347524+0000","last_change":"2024-09-13T17:08:49.360550+0000","last_active":"2024-09-13T17:08:50.347524+0000","last_peered":"2024-09-13T17:08:50.347524+0000","last_clean":"2024-09-13T17:08:50.347524+0000","last_became_active":"2024-09-13T17:08:49.360330+0000","last_became_peered":"2024-09-13T17:08:49.360330+0000","last_unstale":"2024-09-13T17:08:50.347524+0000","last_undegraded":"2024-09-13T17:08:50.347524+0000","last_fullsized":"2024-09-13T17:08:50.347524+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:26.297277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836844+0000","last_change":"2024-09-13T17:08:49.371728+0000","last_active":"2024-09-13T17:08:50.836844+0000","last_peered":"2024-09-13T17:08:50.836844+0000","last_clean":"2024-09-13T17:08:50.836844+0000","last_became_active":"2024-09-13T17:08:49.371461+0000","last_became_peered":"2024-09-13T17:08:49.371461+0000","last_unstale":"2024-09-13T17:08:50.836844+0000","last_undegraded":"2024-09-13T17:08:50.836844+0000","last_fullsized":"2024-09-13T17:08:50.836844+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:50.589830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.839029+0000","last_change":"2024-09-13T17:08:49.368108+0000","last_active":"2024-09-13T17:08:50.839029+0000","last_peered":"2024-09-13T17:08:50.839029+0000","last_clean":"2024-09-13T17:08:50.839029+0000","last_became_active":"2024-09-13T17:08:49.367897+0000","last_became_peered":"2024-09-13T17:08:49.367897+0000","last_unstale":"2024-09-13T17:08:50.839029+0000","last_undegraded":"2024-09-13T17:08:50.839029+0000","last_fullsized":"2024-09-13T17:08:50.839029+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:44.913263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838659+0000","last_change":"2024-09-13T17:08:49.372919+0000","last_active":"2024-09-13T17:08:50.838659+0000","last_peered":"2024-09-13T17:08:50.838659+0000","last_clean":"2024-09-13T17:08:50.838659+0000","last_became_active":"2024-09-13T17:08:49.372631+0000","last_became_peered":"2024-09-13T17:08:49.372631+0000","last_unstale":"2024-09-13T17:08:50.838659+0000","last_undegraded":"2024-09-13T17:08:50.838659+0000","last_fullsized":"2024-09-13T17:08:50.838659+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:34.851341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433726+0000","last_change":"2024-09-13T17:08:49.365905+0000","last_active":"2024-09-13T17:08:50.433726+0000","last_peered":"2024-09-13T17:08:50.433726+0000","last_clean":"2024-09-13T17:08:50.433726+0000","last_became_active":"2024-09-13T17:08:49.365552+0000","last_became_peered":"2024-09-13T17:08:49.365552+0000","last_unstale":"2024-09-13T17:08:50.433726+0000","last_undegraded":"2024-09-13T17:08:50.433726+0000","last_fullsized":"2024-09-13T17:08:50.433726+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:56.985959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837749+0000","last_change":"2024-09-13T17:08:49.365994+0000","last_active":"2024-09-13T17:08:50.837749+0000","last_peered":"2024-09-13T17:08:50.837749+0000","last_clean":"2024-09-13T17:08:50.837749+0000","last_became_active":"2024-09-13T17:08:49.365735+0000","last_became_peered":"2024-09-13T17:08:49.365735+0000","last_unstale":"2024-09-13T17:08:50.837749+0000","last_undegraded":"2024-09-13T17:08:50.837749+0000","last_fullsized":"2024-09-13T17:08:50.837749+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:48.939580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837052+0000","last_change":"2024-09-13T17:08:49.363550+0000","last_active":"2024-09-13T17:08:50.837052+0000","last_peered":"2024-09-13T17:08:50.837052+0000","last_clean":"2024-09-13T17:08:50.837052+0000","last_became_active":"2024-09-13T17:08:49.363130+0000","last_became_peered":"2024-09-13T17:08:49.363130+0000","last_unstale":"2024-09-13T17:08:50.837052+0000","last_undegraded":"2024-09-13T17:08:50.837052+0000","last_fullsized":"2024-09-13T17:08:50.837052+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:19.431286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836360+0000","last_change":"2024-09-13T17:08:49.370405+0000","last_active":"2024-09-13T17:08:50.836360+0000","last_peered":"2024-09-13T17:08:50.836360+0000","last_clean":"2024-09-13T17:08:50.836360+0000","last_became_active":"2024-09-13T17:08:49.370081+0000","last_became_peered":"2024-09-13T17:08:49.370081+0000","last_unstale":"2024-09-13T17:08:50.836360+0000","last_undegraded":"2024-09-13T17:08:50.836360+0000","last_fullsized":"2024-09-13T17:08:50.836360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:26.502069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837230+0000","last_change":"2024-09-13T17:08:49.363386+0000","last_active":"2024-09-13T17:08:50.837230+0000","last_peered":"2024-09-13T17:08:50.837230+0000","last_clean":"2024-09-13T17:08:50.837230+0000","last_became_active":"2024-09-13T17:08:49.363199+0000","last_became_peered":"2024-09-13T17:08:49.363199+0000","last_unstale":"2024-09-13T17:08:50.837230+0000","last_undegraded":"2024-09-13T17:08:50.837230+0000","last_fullsized":"2024-09-13T17:08:50.837230+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:25.848609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349798+0000","last_change":"2024-09-13T17:08:49.366293+0000","last_active":"2024-09-13T17:08:50.349798+0000","last_peered":"2024-09-13T17:08:50.349798+0000","last_clean":"2024-09-13T17:08:50.349798+0000","last_became_active":"2024-09-13T17:08:49.366044+0000","last_became_peered":"2024-09-13T17:08:49.366044+0000","last_unstale":"2024-09-13T17:08:50.349798+0000","last_undegraded":"2024-09-13T17:08:50.349798+0000","last_fullsized":"2024-09-13T17:08:50.349798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:59.335892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348912+0000","last_change":"2024-09-13T17:08:49.367146+0000","last_active":"2024-09-13T17:08:50.348912+0000","last_peered":"2024-09-13T17:08:50.348912+0000","last_clean":"2024-09-13T17:08:50.348912+0000","last_became_active":"2024-09-13T17:08:49.366892+0000","last_became_peered":"2024-09-13T17:08:49.366892+0000","last_unstale":"2024-09-13T17:08:50.348912+0000","last_undegraded":"2024-09-13T17:08:50.348912+0000","last_fullsized":"2024-09-13T17:08:50.348912+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:04.288666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348778+0000","last_change":"2024-09-13T17:08:49.358470+0000","last_active":"2024-09-13T17:08:50.348778+0000","last_peered":"2024-09-13T17:08:50.348778+0000","last_clean":"2024-09-13T17:08:50.348778+0000","last_became_active":"2024-09-13T17:08:49.358085+0000","last_became_peered":"2024-09-13T17:08:49.358085+0000","last_unstale":"2024-09-13T17:08:50.348778+0000","last_undegraded":"2024-09-13T17:08:50.348778+0000","last_fullsized":"2024-09-13T17:08:50.348778+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:51.492376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348996+0000","last_change":"2024-09-13T17:08:49.369692+0000","last_active":"2024-09-13T17:08:50.348996+0000","last_peered":"2024-09-13T17:08:50.348996+0000","last_clean":"2024-09-13T17:08:50.348996+0000","last_became_active":"2024-09-13T17:08:49.367841+0000","last_became_peered":"2024-09-13T17:08:49.367841+0000","last_unstale":"2024-09-13T17:08:50.348996+0000","last_undegraded":"2024-09-13T17:08:50.348996+0000","last_fullsized":"2024-09-13T17:08:50.348996+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:40.791465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348283+0000","last_change":"2024-09-13T17:08:49.366942+0000","last_active":"2024-09-13T17:08:50.348283+0000","last_peered":"2024-09-13T17:08:50.348283+0000","last_clean":"2024-09-13T17:08:50.348283+0000","last_became_active":"2024-09-13T17:08:49.366664+0000","last_became_peered":"2024-09-13T17:08:49.366664+0000","last_unstale":"2024-09-13T17:08:50.348283+0000","last_undegraded":"2024-09-13T17:08:50.348283+0000","last_fullsized":"2024-09-13T17:08:50.348283+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:26.297277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348154+0000","last_change":"2024-09-13T17:08:49.368860+0000","last_active":"2024-09-13T17:08:50.348154+0000","last_peered":"2024-09-13T17:08:50.348154+0000","last_clean":"2024-09-13T17:08:50.348154+0000","last_became_active":"2024-09-13T17:08:49.367627+0000","last_became_peered":"2024-09-13T17:08:49.367627+0000","last_unstale":"2024-09-13T17:08:50.348154+0000","last_undegraded":"2024-09-13T17:08:50.348154+0000","last_fullsized":"2024-09-13T17:08:50.348154+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:18:54.081657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348283+0000","last_change":"2024-09-13T17:08:49.364783+0000","last_active":"2024-09-13T17:08:50.348283+0000","last_peered":"2024-09-13T17:08:50.348283+0000","last_clean":"2024-09-13T17:08:50.348283+0000","last_became_active":"2024-09-13T17:08:49.362427+0000","last_became_peered":"2024-09-13T17:08:49.362427+0000","last_unstale":"2024-09-13T17:08:50.348283+0000","last_undegraded":"2024-09-13T17:08:50.348283+0000","last_fullsized":"2024-09-13T17:08:50.348283+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:59.335892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836943+0000","last_change":"2024-09-13T17:08:49.367274+0000","last_active":"2024-09-13T17:08:50.836943+0000","last_peered":"2024-09-13T17:08:50.836943+0000","last_clean":"2024-09-13T17:08:50.836943+0000","last_became_active":"2024-09-13T17:08:49.367014+0000","last_became_peered":"2024-09-13T17:08:49.367014+0000","last_unstale":"2024-09-13T17:08:50.836943+0000","last_undegraded":"2024-09-13T17:08:50.836943+0000","last_fullsized":"2024-09-13T17:08:50.836943+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:12.486261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348592+0000","last_change":"2024-09-13T17:08:49.368976+0000","last_active":"2024-09-13T17:08:50.348592+0000","last_peered":"2024-09-13T17:08:50.348592+0000","last_clean":"2024-09-13T17:08:50.348592+0000","last_became_active":"2024-09-13T17:08:49.368742+0000","last_became_peered":"2024-09-13T17:08:49.368742+0000","last_unstale":"2024-09-13T17:08:50.348592+0000","last_undegraded":"2024-09-13T17:08:50.348592+0000","last_fullsized":"2024-09-13T17:08:50.348592+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:26.686282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.434122+0000","last_change":"2024-09-13T17:08:49.361159+0000","last_active":"2024-09-13T17:08:50.434122+0000","last_peered":"2024-09-13T17:08:50.434122+0000","last_clean":"2024-09-13T17:08:50.434122+0000","last_became_active":"2024-09-13T17:08:49.360834+0000","last_became_peered":"2024-09-13T17:08:49.360834+0000","last_unstale":"2024-09-13T17:08:50.434122+0000","last_undegraded":"2024-09-13T17:08:50.434122+0000","last_fullsized":"2024-09-13T17:08:50.434122+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:01.192573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838324+0000","last_change":"2024-09-13T17:08:49.362819+0000","last_active":"2024-09-13T17:08:50.838324+0000","last_peered":"2024-09-13T17:08:50.838324+0000","last_clean":"2024-09-13T17:08:50.838324+0000","last_became_active":"2024-09-13T17:08:49.361903+0000","last_became_peered":"2024-09-13T17:08:49.361903+0000","last_unstale":"2024-09-13T17:08:50.838324+0000","last_undegraded":"2024-09-13T17:08:50.838324+0000","last_fullsized":"2024-09-13T17:08:50.838324+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:39.945915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348636+0000","last_change":"2024-09-13T17:08:49.367918+0000","last_active":"2024-09-13T17:08:50.348636+0000","last_peered":"2024-09-13T17:08:50.348636+0000","last_clean":"2024-09-13T17:08:50.348636+0000","last_became_active":"2024-09-13T17:08:49.367691+0000","last_became_peered":"2024-09-13T17:08:49.367691+0000","last_unstale":"2024-09-13T17:08:50.348636+0000","last_undegraded":"2024-09-13T17:08:50.348636+0000","last_fullsized":"2024-09-13T17:08:50.348636+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:00.837308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349056+0000","last_change":"2024-09-13T17:08:49.367007+0000","last_active":"2024-09-13T17:08:50.349056+0000","last_peered":"2024-09-13T17:08:50.349056+0000","last_clean":"2024-09-13T17:08:50.349056+0000","last_became_active":"2024-09-13T17:08:49.366743+0000","last_became_peered":"2024-09-13T17:08:49.366743+0000","last_unstale":"2024-09-13T17:08:50.349056+0000","last_undegraded":"2024-09-13T17:08:50.349056+0000","last_fullsized":"2024-09-13T17:08:50.349056+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:07.132403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348757+0000","last_change":"2024-09-13T17:08:49.358915+0000","last_active":"2024-09-13T17:08:50.348757+0000","last_peered":"2024-09-13T17:08:50.348757+0000","last_clean":"2024-09-13T17:08:50.348757+0000","last_became_active":"2024-09-13T17:08:49.358556+0000","last_became_peered":"2024-09-13T17:08:49.358556+0000","last_unstale":"2024-09-13T17:08:50.348757+0000","last_undegraded":"2024-09-13T17:08:50.348757+0000","last_fullsized":"2024-09-13T17:08:50.348757+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:04.785090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.347934+0000","last_change":"2024-09-13T17:08:49.364446+0000","last_active":"2024-09-13T17:08:50.347934+0000","last_peered":"2024-09-13T17:08:50.347934+0000","last_clean":"2024-09-13T17:08:50.347934+0000","last_became_active":"2024-09-13T17:08:49.364175+0000","last_became_peered":"2024-09-13T17:08:49.364175+0000","last_unstale":"2024-09-13T17:08:50.347934+0000","last_undegraded":"2024-09-13T17:08:50.347934+0000","last_fullsized":"2024-09-13T17:08:50.347934+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:02.484549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837359+0000","last_change":"2024-09-13T17:08:49.361340+0000","last_active":"2024-09-13T17:08:50.837359+0000","last_peered":"2024-09-13T17:08:50.837359+0000","last_clean":"2024-09-13T17:08:50.837359+0000","last_became_active":"2024-09-13T17:08:49.361111+0000","last_became_peered":"2024-09-13T17:08:49.361111+0000","last_unstale":"2024-09-13T17:08:50.837359+0000","last_undegraded":"2024-09-13T17:08:50.837359+0000","last_fullsized":"2024-09-13T17:08:50.837359+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:03.097018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838926+0000","last_change":"2024-09-13T17:08:49.360385+0000","last_active":"2024-09-13T17:08:50.838926+0000","last_peered":"2024-09-13T17:08:50.838926+0000","last_clean":"2024-09-13T17:08:50.838926+0000","last_became_active":"2024-09-13T17:08:49.360153+0000","last_became_peered":"2024-09-13T17:08:49.360153+0000","last_unstale":"2024-09-13T17:08:50.838926+0000","last_undegraded":"2024-09-13T17:08:50.838926+0000","last_fullsized":"2024-09-13T17:08:50.838926+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:02.994204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838080+0000","last_change":"2024-09-13T17:08:48.980236+0000","last_active":"2024-09-13T17:08:50.838080+0000","last_peered":"2024-09-13T17:08:50.838080+0000","last_clean":"2024-09-13T17:08:50.838080+0000","last_became_active":"2024-09-13T17:08:48.979911+0000","last_became_peered":"2024-09-13T17:08:48.979911+0000","last_unstale":"2024-09-13T17:08:50.838080+0000","last_undegraded":"2024-09-13T17:08:50.838080+0000","last_fullsized":"2024-09-13T17:08:50.838080+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:03.236371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.839486+0000","last_change":"2024-09-13T17:08:49.368734+0000","last_active":"2024-09-13T17:08:50.839486+0000","last_peered":"2024-09-13T17:08:50.839486+0000","last_clean":"2024-09-13T17:08:50.839486+0000","last_became_active":"2024-09-13T17:08:49.368492+0000","last_became_peered":"2024-09-13T17:08:49.368492+0000","last_unstale":"2024-09-13T17:08:50.839486+0000","last_undegraded":"2024-09-13T17:08:50.839486+0000","last_fullsized":"2024-09-13T17:08:50.839486+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:37.053929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349455+0000","last_change":"2024-09-13T17:08:48.971961+0000","last_active":"2024-09-13T17:08:50.349455+0000","last_peered":"2024-09-13T17:08:50.349455+0000","last_clean":"2024-09-13T17:08:50.349455+0000","last_became_active":"2024-09-13T17:08:48.971066+0000","last_became_peered":"2024-09-13T17:08:48.971066+0000","last_unstale":"2024-09-13T17:08:50.349455+0000","last_undegraded":"2024-09-13T17:08:50.349455+0000","last_fullsized":"2024-09-13T17:08:50.349455+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:28.183471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837988+0000","last_change":"2024-09-13T17:08:49.364886+0000","last_active":"2024-09-13T17:08:50.837988+0000","last_peered":"2024-09-13T17:08:50.837988+0000","last_clean":"2024-09-13T17:08:50.837988+0000","last_became_active":"2024-09-13T17:08:49.364660+0000","last_became_peered":"2024-09-13T17:08:49.364660+0000","last_unstale":"2024-09-13T17:08:50.837988+0000","last_undegraded":"2024-09-13T17:08:50.837988+0000","last_fullsized":"2024-09-13T17:08:50.837988+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:07.132403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838947+0000","last_change":"2024-09-13T17:08:48.977499+0000","last_active":"2024-09-13T17:08:50.838947+0000","last_peered":"2024-09-13T17:08:50.838947+0000","last_clean":"2024-09-13T17:08:50.838947+0000","last_became_active":"2024-09-13T17:08:48.977205+0000","last_became_peered":"2024-09-13T17:08:48.977205+0000","last_unstale":"2024-09-13T17:08:50.838947+0000","last_undegraded":"2024-09-13T17:08:50.838947+0000","last_fullsized":"2024-09-13T17:08:50.838947+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:28.183471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838538+0000","last_change":"2024-09-13T17:08:49.366486+0000","last_active":"2024-09-13T17:08:50.838538+0000","last_peered":"2024-09-13T17:08:50.838538+0000","last_clean":"2024-09-13T17:08:50.838538+0000","last_became_active":"2024-09-13T17:08:49.366261+0000","last_became_peered":"2024-09-13T17:08:49.366261+0000","last_unstale":"2024-09-13T17:08:50.838538+0000","last_undegraded":"2024-09-13T17:08:50.838538+0000","last_fullsized":"2024-09-13T17:08:50.838538+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:59.335892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433929+0000","last_change":"2024-09-13T17:08:48.975565+0000","last_active":"2024-09-13T17:08:50.433929+0000","last_peered":"2024-09-13T17:08:50.433929+0000","last_clean":"2024-09-13T17:08:50.433929+0000","last_became_active":"2024-09-13T17:08:48.975059+0000","last_became_peered":"2024-09-13T17:08:48.975059+0000","last_unstale":"2024-09-13T17:08:50.433929+0000","last_undegraded":"2024-09-13T17:08:50.433929+0000","last_fullsized":"2024-09-13T17:08:50.433929+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:15.729717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348353+0000","last_change":"2024-09-13T17:08:49.362633+0000","last_active":"2024-09-13T17:08:50.348353+0000","last_peered":"2024-09-13T17:08:50.348353+0000","last_clean":"2024-09-13T17:08:50.348353+0000","last_became_active":"2024-09-13T17:08:49.362434+0000","last_became_peered":"2024-09-13T17:08:49.362434+0000","last_unstale":"2024-09-13T17:08:50.348353+0000","last_undegraded":"2024-09-13T17:08:50.348353+0000","last_fullsized":"2024-09-13T17:08:50.348353+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:03.097018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836526+0000","last_change":"2024-09-13T17:08:48.972855+0000","last_active":"2024-09-13T17:08:50.836526+0000","last_peered":"2024-09-13T17:08:50.836526+0000","last_clean":"2024-09-13T17:08:50.836526+0000","last_became_active":"2024-09-13T17:08:48.972578+0000","last_became_peered":"2024-09-13T17:08:48.972578+0000","last_unstale":"2024-09-13T17:08:50.836526+0000","last_undegraded":"2024-09-13T17:08:50.836526+0000","last_fullsized":"2024-09-13T17:08:50.836526+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:01.359415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348647+0000","last_change":"2024-09-13T17:08:49.371788+0000","last_active":"2024-09-13T17:08:50.348647+0000","last_peered":"2024-09-13T17:08:50.348647+0000","last_clean":"2024-09-13T17:08:50.348647+0000","last_became_active":"2024-09-13T17:08:49.371551+0000","last_became_peered":"2024-09-13T17:08:49.371551+0000","last_unstale":"2024-09-13T17:08:50.348647+0000","last_undegraded":"2024-09-13T17:08:50.348647+0000","last_fullsized":"2024-09-13T17:08:50.348647+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:29.052928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838064+0000","last_change":"2024-09-13T17:08:48.978131+0000","last_active":"2024-09-13T17:08:50.838064+0000","last_peered":"2024-09-13T17:08:50.838064+0000","last_clean":"2024-09-13T17:08:50.838064+0000","last_became_active":"2024-09-13T17:08:48.977891+0000","last_became_peered":"2024-09-13T17:08:48.977891+0000","last_unstale":"2024-09-13T17:08:50.838064+0000","last_undegraded":"2024-09-13T17:08:50.838064+0000","last_fullsized":"2024-09-13T17:08:50.838064+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:18.427955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837230+0000","last_change":"2024-09-13T17:08:49.363450+0000","last_active":"2024-09-13T17:08:50.837230+0000","last_peered":"2024-09-13T17:08:50.837230+0000","last_clean":"2024-09-13T17:08:50.837230+0000","last_became_active":"2024-09-13T17:08:49.363030+0000","last_became_peered":"2024-09-13T17:08:49.363030+0000","last_unstale":"2024-09-13T17:08:50.837230+0000","last_undegraded":"2024-09-13T17:08:50.837230+0000","last_fullsized":"2024-09-13T17:08:50.837230+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:23.161513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433231+0000","last_change":"2024-09-13T17:08:48.975290+0000","last_active":"2024-09-13T17:08:50.433231+0000","last_peered":"2024-09-13T17:08:50.433231+0000","last_clean":"2024-09-13T17:08:50.433231+0000","last_became_active":"2024-09-13T17:08:48.975000+0000","last_became_peered":"2024-09-13T17:08:48.975000+0000","last_unstale":"2024-09-13T17:08:50.433231+0000","last_undegraded":"2024-09-13T17:08:50.433231+0000","last_fullsized":"2024-09-13T17:08:50.433231+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:13.596215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.347908+0000","last_change":"2024-09-13T17:08:49.366462+0000","last_active":"2024-09-13T17:08:50.347908+0000","last_peered":"2024-09-13T17:08:50.347908+0000","last_clean":"2024-09-13T17:08:50.347908+0000","last_became_active":"2024-09-13T17:08:49.366128+0000","last_became_peered":"2024-09-13T17:08:49.366128+0000","last_unstale":"2024-09-13T17:08:50.347908+0000","last_undegraded":"2024-09-13T17:08:50.347908+0000","last_fullsized":"2024-09-13T17:08:50.347908+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:26.531817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836248+0000","last_change":"2024-09-13T17:08:48.975962+0000","last_active":"2024-09-13T17:08:50.836248+0000","last_peered":"2024-09-13T17:08:50.836248+0000","last_clean":"2024-09-13T17:08:50.836248+0000","last_became_active":"2024-09-13T17:08:48.975243+0000","last_became_peered":"2024-09-13T17:08:48.975243+0000","last_unstale":"2024-09-13T17:08:50.836248+0000","last_undegraded":"2024-09-13T17:08:50.836248+0000","last_fullsized":"2024-09-13T17:08:50.836248+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:11.482930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837155+0000","last_change":"2024-09-13T17:08:49.369119+0000","last_active":"2024-09-13T17:08:50.837155+0000","last_peered":"2024-09-13T17:08:50.837155+0000","last_clean":"2024-09-13T17:08:50.837155+0000","last_became_active":"2024-09-13T17:08:49.368888+0000","last_became_peered":"2024-09-13T17:08:49.368888+0000","last_unstale":"2024-09-13T17:08:50.837155+0000","last_undegraded":"2024-09-13T17:08:50.837155+0000","last_fullsized":"2024-09-13T17:08:50.837155+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:29.186802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349349+0000","last_change":"2024-09-13T17:08:48.979805+0000","last_active":"2024-09-13T17:08:50.349349+0000","last_peered":"2024-09-13T17:08:50.349349+0000","last_clean":"2024-09-13T17:08:50.349349+0000","last_became_active":"2024-09-13T17:08:48.979547+0000","last_became_peered":"2024-09-13T17:08:48.979547+0000","last_unstale":"2024-09-13T17:08:50.349349+0000","last_undegraded":"2024-09-13T17:08:50.349349+0000","last_fullsized":"2024-09-13T17:08:50.349349+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:25.639744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349245+0000","last_change":"2024-09-13T17:08:49.365332+0000","last_active":"2024-09-13T17:08:50.349245+0000","last_peered":"2024-09-13T17:08:50.349245+0000","last_clean":"2024-09-13T17:08:50.349245+0000","last_became_active":"2024-09-13T17:08:49.362221+0000","last_became_peered":"2024-09-13T17:08:49.362221+0000","last_unstale":"2024-09-13T17:08:50.349245+0000","last_undegraded":"2024-09-13T17:08:50.349245+0000","last_fullsized":"2024-09-13T17:08:50.349245+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:25.848609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349545+0000","last_change":"2024-09-13T17:08:48.977856+0000","last_active":"2024-09-13T17:08:50.349545+0000","last_peered":"2024-09-13T17:08:50.349545+0000","last_clean":"2024-09-13T17:08:50.349545+0000","last_became_active":"2024-09-13T17:08:48.977603+0000","last_became_peered":"2024-09-13T17:08:48.977603+0000","last_unstale":"2024-09-13T17:08:50.349545+0000","last_undegraded":"2024-09-13T17:08:50.349545+0000","last_fullsized":"2024-09-13T17:08:50.349545+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:40.072111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838614+0000","last_change":"2024-09-13T17:08:49.370667+0000","last_active":"2024-09-13T17:08:50.838614+0000","last_peered":"2024-09-13T17:08:50.838614+0000","last_clean":"2024-09-13T17:08:50.838614+0000","last_became_active":"2024-09-13T17:08:49.370424+0000","last_became_peered":"2024-09-13T17:08:49.370424+0000","last_unstale":"2024-09-13T17:08:50.838614+0000","last_undegraded":"2024-09-13T17:08:50.838614+0000","last_fullsized":"2024-09-13T17:08:50.838614+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:26.643075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349674+0000","last_change":"2024-09-13T17:08:48.976985+0000","last_active":"2024-09-13T17:08:50.349674+0000","last_peered":"2024-09-13T17:08:50.349674+0000","last_clean":"2024-09-13T17:08:50.349674+0000","last_became_active":"2024-09-13T17:08:48.976628+0000","last_became_peered":"2024-09-13T17:08:48.976628+0000","last_unstale":"2024-09-13T17:08:50.349674+0000","last_undegraded":"2024-09-13T17:08:50.349674+0000","last_fullsized":"2024-09-13T17:08:50.349674+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:25.498737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349260+0000","last_change":"2024-09-13T17:08:49.364308+0000","last_active":"2024-09-13T17:08:50.349260+0000","last_peered":"2024-09-13T17:08:50.349260+0000","last_clean":"2024-09-13T17:08:50.349260+0000","last_became_active":"2024-09-13T17:08:49.363838+0000","last_became_peered":"2024-09-13T17:08:49.363838+0000","last_unstale":"2024-09-13T17:08:50.349260+0000","last_undegraded":"2024-09-13T17:08:50.349260+0000","last_fullsized":"2024-09-13T17:08:50.349260+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:07.132403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836800+0000","last_change":"2024-09-13T17:08:48.972685+0000","last_active":"2024-09-13T17:08:50.836800+0000","last_peered":"2024-09-13T17:08:50.836800+0000","last_clean":"2024-09-13T17:08:50.836800+0000","last_became_active":"2024-09-13T17:08:48.972425+0000","last_became_peered":"2024-09-13T17:08:48.972425+0000","last_unstale":"2024-09-13T17:08:50.836800+0000","last_undegraded":"2024-09-13T17:08:50.836800+0000","last_fullsized":"2024-09-13T17:08:50.836800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:48.441741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433340+0000","last_change":"2024-09-13T17:08:49.369695+0000","last_active":"2024-09-13T17:08:50.433340+0000","last_peered":"2024-09-13T17:08:50.433340+0000","last_clean":"2024-09-13T17:08:50.433340+0000","last_became_active":"2024-09-13T17:08:49.369440+0000","last_became_peered":"2024-09-13T17:08:49.369440+0000","last_unstale":"2024-09-13T17:08:50.433340+0000","last_undegraded":"2024-09-13T17:08:50.433340+0000","last_fullsized":"2024-09-13T17:08:50.433340+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:22.970691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348848+0000","last_change":"2024-09-13T17:08:48.977444+0000","last_active":"2024-09-13T17:08:50.348848+0000","last_peered":"2024-09-13T17:08:50.348848+0000","last_clean":"2024-09-13T17:08:50.348848+0000","last_became_active":"2024-09-13T17:08:48.977145+0000","last_became_peered":"2024-09-13T17:08:48.977145+0000","last_unstale":"2024-09-13T17:08:50.348848+0000","last_undegraded":"2024-09-13T17:08:50.348848+0000","last_fullsized":"2024-09-13T17:08:50.348848+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:03.236371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348428+0000","last_change":"2024-09-13T17:08:49.364147+0000","last_active":"2024-09-13T17:08:50.348428+0000","last_peered":"2024-09-13T17:08:50.348428+0000","last_clean":"2024-09-13T17:08:50.348428+0000","last_became_active":"2024-09-13T17:08:49.363889+0000","last_became_peered":"2024-09-13T17:08:49.363889+0000","last_unstale":"2024-09-13T17:08:50.348428+0000","last_undegraded":"2024-09-13T17:08:50.348428+0000","last_fullsized":"2024-09-13T17:08:50.348428+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:02.994204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837401+0000","last_change":"2024-09-13T17:08:48.970402+0000","last_active":"2024-09-13T17:08:50.837401+0000","last_peered":"2024-09-13T17:08:50.837401+0000","last_clean":"2024-09-13T17:08:50.837401+0000","last_became_active":"2024-09-13T17:08:48.970062+0000","last_became_peered":"2024-09-13T17:08:48.970062+0000","last_unstale":"2024-09-13T17:08:50.837401+0000","last_undegraded":"2024-09-13T17:08:50.837401+0000","last_fullsized":"2024-09-13T17:08:50.837401+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:54.224933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836128+0000","last_change":"2024-09-13T17:08:49.367908+0000","last_active":"2024-09-13T17:08:50.836128+0000","last_peered":"2024-09-13T17:08:50.836128+0000","last_clean":"2024-09-13T17:08:50.836128+0000","last_became_active":"2024-09-13T17:08:49.364757+0000","last_became_peered":"2024-09-13T17:08:49.364757+0000","last_unstale":"2024-09-13T17:08:50.836128+0000","last_undegraded":"2024-09-13T17:08:50.836128+0000","last_fullsized":"2024-09-13T17:08:50.836128+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:04.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433330+0000","last_change":"2024-09-13T17:08:48.975665+0000","last_active":"2024-09-13T17:08:50.433330+0000","last_peered":"2024-09-13T17:08:50.433330+0000","last_clean":"2024-09-13T17:08:50.433330+0000","last_became_active":"2024-09-13T17:08:48.975314+0000","last_became_peered":"2024-09-13T17:08:48.975314+0000","last_unstale":"2024-09-13T17:08:50.433330+0000","last_undegraded":"2024-09-13T17:08:50.433330+0000","last_fullsized":"2024-09-13T17:08:50.433330+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:33.848010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348468+0000","last_change":"2024-09-13T17:08:49.364052+0000","last_active":"2024-09-13T17:08:50.348468+0000","last_peered":"2024-09-13T17:08:50.348468+0000","last_clean":"2024-09-13T17:08:50.348468+0000","last_became_active":"2024-09-13T17:08:49.362209+0000","last_became_peered":"2024-09-13T17:08:49.362209+0000","last_unstale":"2024-09-13T17:08:50.348468+0000","last_undegraded":"2024-09-13T17:08:50.348468+0000","last_fullsized":"2024-09-13T17:08:50.348468+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:18.369863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":19,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348134+0000","last_change":"2024-09-13T17:08:48.982008+0000","last_active":"2024-09-13T17:08:50.348134+0000","last_peered":"2024-09-13T17:08:50.348134+0000","last_clean":"2024-09-13T17:08:50.348134+0000","last_became_active":"2024-09-13T17:08:48.981781+0000","last_became_peered":"2024-09-13T17:08:48.981781+0000","last_unstale":"2024-09-13T17:08:50.348134+0000","last_undegraded":"2024-09-13T17:08:50.348134+0000","last_fullsized":"2024-09-13T17:08:50.348134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:36.050598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348964+0000","last_change":"2024-09-13T17:08:49.361110+0000","last_active":"2024-09-13T17:08:50.348964+0000","last_peered":"2024-09-13T17:08:50.348964+0000","last_clean":"2024-09-13T17:08:50.348964+0000","last_became_active":"2024-09-13T17:08:49.359953+0000","last_became_peered":"2024-09-13T17:08:49.359953+0000","last_unstale":"2024-09-13T17:08:50.348964+0000","last_undegraded":"2024-09-13T17:08:50.348964+0000","last_fullsized":"2024-09-13T17:08:50.348964+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:26.531817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.350318+0000","last_change":"2024-09-13T17:08:48.973266+0000","last_active":"2024-09-13T17:08:50.350318+0000","last_peered":"2024-09-13T17:08:50.350318+0000","last_clean":"2024-09-13T17:08:50.350318+0000","last_became_active":"2024-09-13T17:08:48.973012+0000","last_became_peered":"2024-09-13T17:08:48.973012+0000","last_unstale":"2024-09-13T17:08:50.350318+0000","last_undegraded":"2024-09-13T17:08:50.350318+0000","last_fullsized":"2024-09-13T17:08:50.350318+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:49.586498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433989+0000","last_change":"2024-09-13T17:08:49.372342+0000","last_active":"2024-09-13T17:08:50.433989+0000","last_peered":"2024-09-13T17:08:50.433989+0000","last_clean":"2024-09-13T17:08:50.433989+0000","last_became_active":"2024-09-13T17:08:49.370393+0000","last_became_peered":"2024-09-13T17:08:49.370393+0000","last_unstale":"2024-09-13T17:08:50.433989+0000","last_undegraded":"2024-09-13T17:08:50.433989+0000","last_fullsized":"2024-09-13T17:08:50.433989+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:48.210028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.839119+0000","last_change":"2024-09-13T17:08:48.975718+0000","last_active":"2024-09-13T17:08:50.839119+0000","last_peered":"2024-09-13T17:08:50.839119+0000","last_clean":"2024-09-13T17:08:50.839119+0000","last_became_active":"2024-09-13T17:08:48.975425+0000","last_became_peered":"2024-09-13T17:08:48.975425+0000","last_unstale":"2024-09-13T17:08:50.839119+0000","last_undegraded":"2024-09-13T17:08:50.839119+0000","last_fullsized":"2024-09-13T17:08:50.839119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:49.586498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349198+0000","last_change":"2024-09-13T17:08:49.361321+0000","last_active":"2024-09-13T17:08:50.349198+0000","last_peered":"2024-09-13T17:08:50.349198+0000","last_clean":"2024-09-13T17:08:50.349198+0000","last_became_active":"2024-09-13T17:08:49.361072+0000","last_became_peered":"2024-09-13T17:08:49.361072+0000","last_unstale":"2024-09-13T17:08:50.349198+0000","last_undegraded":"2024-09-13T17:08:50.349198+0000","last_fullsized":"2024-09-13T17:08:50.349198+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:25.848609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433945+0000","last_change":"2024-09-13T17:08:48.977460+0000","last_active":"2024-09-13T17:08:50.433945+0000","last_peered":"2024-09-13T17:08:50.433945+0000","last_clean":"2024-09-13T17:08:50.433945+0000","last_became_active":"2024-09-13T17:08:48.977207+0000","last_became_peered":"2024-09-13T17:08:48.977207+0000","last_unstale":"2024-09-13T17:08:50.433945+0000","last_undegraded":"2024-09-13T17:08:50.433945+0000","last_fullsized":"2024-09-13T17:08:50.433945+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:50.292650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349475+0000","last_change":"2024-09-13T17:08:49.364519+0000","last_active":"2024-09-13T17:08:50.349475+0000","last_peered":"2024-09-13T17:08:50.349475+0000","last_clean":"2024-09-13T17:08:50.349475+0000","last_became_active":"2024-09-13T17:08:49.363799+0000","last_became_peered":"2024-09-13T17:08:49.363799+0000","last_unstale":"2024-09-13T17:08:50.349475+0000","last_undegraded":"2024-09-13T17:08:50.349475+0000","last_fullsized":"2024-09-13T17:08:50.349475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:43.022139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838173+0000","last_change":"2024-09-13T17:08:48.977753+0000","last_active":"2024-09-13T17:08:50.838173+0000","last_peered":"2024-09-13T17:08:50.838173+0000","last_clean":"2024-09-13T17:08:50.838173+0000","last_became_active":"2024-09-13T17:08:48.976512+0000","last_became_peered":"2024-09-13T17:08:48.976512+0000","last_unstale":"2024-09-13T17:08:50.838173+0000","last_undegraded":"2024-09-13T17:08:50.838173+0000","last_fullsized":"2024-09-13T17:08:50.838173+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:25.498737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433389+0000","last_change":"2024-09-13T17:08:49.370163+0000","last_active":"2024-09-13T17:08:50.433389+0000","last_peered":"2024-09-13T17:08:50.433389+0000","last_clean":"2024-09-13T17:08:50.433389+0000","last_became_active":"2024-09-13T17:08:49.369921+0000","last_became_peered":"2024-09-13T17:08:49.369921+0000","last_unstale":"2024-09-13T17:08:50.433389+0000","last_undegraded":"2024-09-13T17:08:50.433389+0000","last_fullsized":"2024-09-13T17:08:50.433389+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:21.413430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349246+0000","last_change":"2024-09-13T17:08:48.973965+0000","last_active":"2024-09-13T17:08:50.349246+0000","last_peered":"2024-09-13T17:08:50.349246+0000","last_clean":"2024-09-13T17:08:50.349246+0000","last_became_active":"2024-09-13T17:08:48.973437+0000","last_became_peered":"2024-09-13T17:08:48.973437+0000","last_unstale":"2024-09-13T17:08:50.349246+0000","last_undegraded":"2024-09-13T17:08:50.349246+0000","last_fullsized":"2024-09-13T17:08:50.349246+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:36.050598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838636+0000","last_change":"2024-09-13T17:08:49.363719+0000","last_active":"2024-09-13T17:08:50.838636+0000","last_peered":"2024-09-13T17:08:50.838636+0000","last_clean":"2024-09-13T17:08:50.838636+0000","last_became_active":"2024-09-13T17:08:49.363500+0000","last_became_peered":"2024-09-13T17:08:49.363500+0000","last_unstale":"2024-09-13T17:08:50.838636+0000","last_undegraded":"2024-09-13T17:08:50.838636+0000","last_fullsized":"2024-09-13T17:08:50.838636+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:26.531817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838386+0000","last_change":"2024-09-13T17:08:48.976663+0000","last_active":"2024-09-13T17:08:50.838386+0000","last_peered":"2024-09-13T17:08:50.838386+0000","last_clean":"2024-09-13T17:08:50.838386+0000","last_became_active":"2024-09-13T17:08:48.976386+0000","last_became_peered":"2024-09-13T17:08:48.976386+0000","last_unstale":"2024-09-13T17:08:50.838386+0000","last_undegraded":"2024-09-13T17:08:50.838386+0000","last_fullsized":"2024-09-13T17:08:50.838386+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:34.962771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837494+0000","last_change":"2024-09-13T17:08:49.360147+0000","last_active":"2024-09-13T17:08:50.837494+0000","last_peered":"2024-09-13T17:08:50.837494+0000","last_clean":"2024-09-13T17:08:50.837494+0000","last_became_active":"2024-09-13T17:08:49.358430+0000","last_became_peered":"2024-09-13T17:08:49.358430+0000","last_unstale":"2024-09-13T17:08:50.837494+0000","last_undegraded":"2024-09-13T17:08:50.837494+0000","last_fullsized":"2024-09-13T17:08:50.837494+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:43.022139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433128+0000","last_change":"2024-09-13T17:08:48.977123+0000","last_active":"2024-09-13T17:08:50.433128+0000","last_peered":"2024-09-13T17:08:50.433128+0000","last_clean":"2024-09-13T17:08:50.433128+0000","last_became_active":"2024-09-13T17:08:48.976877+0000","last_became_peered":"2024-09-13T17:08:48.976877+0000","last_unstale":"2024-09-13T17:08:50.433128+0000","last_undegraded":"2024-09-13T17:08:50.433128+0000","last_fullsized":"2024-09-13T17:08:50.433128+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:14.906722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433965+0000","last_change":"2024-09-13T17:08:49.364609+0000","last_active":"2024-09-13T17:08:50.433965+0000","last_peered":"2024-09-13T17:08:50.433965+0000","last_clean":"2024-09-13T17:08:50.433965+0000","last_became_active":"2024-09-13T17:08:49.364379+0000","last_became_peered":"2024-09-13T17:08:49.364379+0000","last_unstale":"2024-09-13T17:08:50.433965+0000","last_undegraded":"2024-09-13T17:08:50.433965+0000","last_fullsized":"2024-09-13T17:08:50.433965+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.075821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.839412+0000","last_change":"2024-09-13T17:08:48.977568+0000","last_active":"2024-09-13T17:08:50.839412+0000","last_peered":"2024-09-13T17:08:50.839412+0000","last_clean":"2024-09-13T17:08:50.839412+0000","last_became_active":"2024-09-13T17:08:48.977311+0000","last_became_peered":"2024-09-13T17:08:48.977311+0000","last_unstale":"2024-09-13T17:08:50.839412+0000","last_undegraded":"2024-09-13T17:08:50.839412+0000","last_fullsized":"2024-09-13T17:08:50.839412+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.988864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.434297+0000","last_change":"2024-09-13T17:08:49.362139+0000","last_active":"2024-09-13T17:08:50.434297+0000","last_peered":"2024-09-13T17:08:50.434297+0000","last_clean":"2024-09-13T17:08:50.434297+0000","last_became_active":"2024-09-13T17:08:49.361892+0000","last_became_peered":"2024-09-13T17:08:49.361892+0000","last_unstale":"2024-09-13T17:08:50.434297+0000","last_undegraded":"2024-09-13T17:08:50.434297+0000","last_fullsized":"2024-09-13T17:08:50.434297+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:50.351863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.839176+0000","last_change":"2024-09-13T17:08:48.974471+0000","last_active":"2024-09-13T17:08:50.839176+0000","last_peered":"2024-09-13T17:08:50.839176+0000","last_clean":"2024-09-13T17:08:50.839176+0000","last_became_active":"2024-09-13T17:08:48.974191+0000","last_became_peered":"2024-09-13T17:08:48.974191+0000","last_unstale":"2024-09-13T17:08:50.839176+0000","last_undegraded":"2024-09-13T17:08:50.839176+0000","last_fullsized":"2024-09-13T17:08:50.839176+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:40.072111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838846+0000","last_change":"2024-09-13T17:08:49.368387+0000","last_active":"2024-09-13T17:08:50.838846+0000","last_peered":"2024-09-13T17:08:50.838846+0000","last_clean":"2024-09-13T17:08:50.838846+0000","last_became_active":"2024-09-13T17:08:49.364953+0000","last_became_peered":"2024-09-13T17:08:49.364953+0000","last_unstale":"2024-09-13T17:08:50.838846+0000","last_undegraded":"2024-09-13T17:08:50.838846+0000","last_fullsized":"2024-09-13T17:08:50.838846+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:14.599546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837213+0000","last_change":"2024-09-13T17:08:48.973204+0000","last_active":"2024-09-13T17:08:50.837213+0000","last_peered":"2024-09-13T17:08:50.837213+0000","last_clean":"2024-09-13T17:08:50.837213+0000","last_became_active":"2024-09-13T17:08:48.972995+0000","last_became_peered":"2024-09-13T17:08:48.972995+0000","last_unstale":"2024-09-13T17:08:50.837213+0000","last_undegraded":"2024-09-13T17:08:50.837213+0000","last_fullsized":"2024-09-13T17:08:50.837213+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.988864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838750+0000","last_change":"2024-09-13T17:08:49.367985+0000","last_active":"2024-09-13T17:08:50.838750+0000","last_peered":"2024-09-13T17:08:50.838750+0000","last_clean":"2024-09-13T17:08:50.838750+0000","last_became_active":"2024-09-13T17:08:49.367764+0000","last_became_peered":"2024-09-13T17:08:49.367764+0000","last_unstale":"2024-09-13T17:08:50.838750+0000","last_undegraded":"2024-09-13T17:08:50.838750+0000","last_fullsized":"2024-09-13T17:08:50.838750+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:04.785090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433970+0000","last_change":"2024-09-13T17:08:48.975753+0000","last_active":"2024-09-13T17:08:50.433970+0000","last_peered":"2024-09-13T17:08:50.433970+0000","last_clean":"2024-09-13T17:08:50.433970+0000","last_became_active":"2024-09-13T17:08:48.975516+0000","last_became_peered":"2024-09-13T17:08:48.975516+0000","last_unstale":"2024-09-13T17:08:50.433970+0000","last_undegraded":"2024-09-13T17:08:50.433970+0000","last_fullsized":"2024-09-13T17:08:50.433970+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:25.639744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348528+0000","last_change":"2024-09-13T17:08:49.371237+0000","last_active":"2024-09-13T17:08:50.348528+0000","last_peered":"2024-09-13T17:08:50.348528+0000","last_clean":"2024-09-13T17:08:50.348528+0000","last_became_active":"2024-09-13T17:08:49.370962+0000","last_became_peered":"2024-09-13T17:08:49.370962+0000","last_unstale":"2024-09-13T17:08:50.348528+0000","last_undegraded":"2024-09-13T17:08:50.348528+0000","last_fullsized":"2024-09-13T17:08:50.348528+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:39.945915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838149+0000","last_change":"2024-09-13T17:08:48.977103+0000","last_active":"2024-09-13T17:08:50.838149+0000","last_peered":"2024-09-13T17:08:50.838149+0000","last_clean":"2024-09-13T17:08:50.838149+0000","last_became_active":"2024-09-13T17:08:48.976852+0000","last_became_peered":"2024-09-13T17:08:48.976852+0000","last_unstale":"2024-09-13T17:08:50.838149+0000","last_undegraded":"2024-09-13T17:08:50.838149+0000","last_fullsized":"2024-09-13T17:08:50.838149+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:02.729492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348540+0000","last_change":"2024-09-13T17:08:49.358235+0000","last_active":"2024-09-13T17:08:50.348540+0000","last_peered":"2024-09-13T17:08:50.348540+0000","last_clean":"2024-09-13T17:08:50.348540+0000","last_became_active":"2024-09-13T17:08:49.356984+0000","last_became_peered":"2024-09-13T17:08:49.356984+0000","last_unstale":"2024-09-13T17:08:50.348540+0000","last_undegraded":"2024-09-13T17:08:50.348540+0000","last_fullsized":"2024-09-13T17:08:50.348540+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:39.945915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837160+0000","last_change":"2024-09-13T17:08:48.972109+0000","last_active":"2024-09-13T17:08:50.837160+0000","last_peered":"2024-09-13T17:08:50.837160+0000","last_clean":"2024-09-13T17:08:50.837160+0000","last_became_active":"2024-09-13T17:08:48.971778+0000","last_became_peered":"2024-09-13T17:08:48.971778+0000","last_unstale":"2024-09-13T17:08:50.837160+0000","last_undegraded":"2024-09-13T17:08:50.837160+0000","last_fullsized":"2024-09-13T17:08:50.837160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:04.268137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837364+0000","last_change":"2024-09-13T17:08:49.368105+0000","last_active":"2024-09-13T17:08:50.837364+0000","last_peered":"2024-09-13T17:08:50.837364+0000","last_clean":"2024-09-13T17:08:50.837364+0000","last_became_active":"2024-09-13T17:08:49.367856+0000","last_became_peered":"2024-09-13T17:08:49.367856+0000","last_unstale":"2024-09-13T17:08:50.837364+0000","last_undegraded":"2024-09-13T17:08:50.837364+0000","last_fullsized":"2024-09-13T17:08:50.837364+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:16.733048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837918+0000","last_change":"2024-09-13T17:08:48.980860+0000","last_active":"2024-09-13T17:08:50.837918+0000","last_peered":"2024-09-13T17:08:50.837918+0000","last_clean":"2024-09-13T17:08:50.837918+0000","last_became_active":"2024-09-13T17:08:48.980583+0000","last_became_peered":"2024-09-13T17:08:48.980583+0000","last_unstale":"2024-09-13T17:08:50.837918+0000","last_undegraded":"2024-09-13T17:08:50.837918+0000","last_fullsized":"2024-09-13T17:08:50.837918+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:07.996765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348303+0000","last_change":"2024-09-13T17:08:49.366797+0000","last_active":"2024-09-13T17:08:50.348303+0000","last_peered":"2024-09-13T17:08:50.348303+0000","last_clean":"2024-09-13T17:08:50.348303+0000","last_became_active":"2024-09-13T17:08:49.366473+0000","last_became_peered":"2024-09-13T17:08:49.366473+0000","last_unstale":"2024-09-13T17:08:50.348303+0000","last_undegraded":"2024-09-13T17:08:50.348303+0000","last_fullsized":"2024-09-13T17:08:50.348303+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:01.192573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.347782+0000","last_change":"2024-09-13T17:08:48.982526+0000","last_active":"2024-09-13T17:08:50.347782+0000","last_peered":"2024-09-13T17:08:50.347782+0000","last_clean":"2024-09-13T17:08:50.347782+0000","last_became_active":"2024-09-13T17:08:48.982180+0000","last_became_peered":"2024-09-13T17:08:48.982180+0000","last_unstale":"2024-09-13T17:08:50.347782+0000","last_undegraded":"2024-09-13T17:08:50.347782+0000","last_fullsized":"2024-09-13T17:08:50.347782+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:25.498737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.347839+0000","last_change":"2024-09-13T17:08:49.369315+0000","last_active":"2024-09-13T17:08:50.347839+0000","last_peered":"2024-09-13T17:08:50.347839+0000","last_clean":"2024-09-13T17:08:50.347839+0000","last_became_active":"2024-09-13T17:08:49.369090+0000","last_became_peered":"2024-09-13T17:08:49.369090+0000","last_unstale":"2024-09-13T17:08:50.347839+0000","last_undegraded":"2024-09-13T17:08:50.347839+0000","last_fullsized":"2024-09-13T17:08:50.347839+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:42.186958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836773+0000","last_change":"2024-09-13T17:08:48.977623+0000","last_active":"2024-09-13T17:08:50.836773+0000","last_peered":"2024-09-13T17:08:50.836773+0000","last_clean":"2024-09-13T17:08:50.836773+0000","last_became_active":"2024-09-13T17:08:48.977282+0000","last_became_peered":"2024-09-13T17:08:48.977282+0000","last_unstale":"2024-09-13T17:08:50.836773+0000","last_undegraded":"2024-09-13T17:08:50.836773+0000","last_fullsized":"2024-09-13T17:08:50.836773+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:52.151931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T17:08:49.345560+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:08:49.345560+0000","last_peered":"2024-09-13T17:08:49.345560+0000","last_clean":"2024-09-13T17:08:49.345560+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:08:49.345560+0000","last_undegraded":"2024-09-13T17:08:49.345560+0000","last_fullsized":"2024-09-13T17:08:49.345560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1323008,"data_stored":891587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85299999999999998,"15min":0.85499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90300000000000002,"15min":0.91400000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.98499999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91900000000000004,"15min":0.92500000000000004},"min":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.415,"5min":1.456,"15min":1.456},"last":1.3979999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.84999999999999998,"15min":0.84399999999999997},"min":{"1min":0.58899999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.88900000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.99399999999999999,"15min":1.0069999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.83699999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91900000000000004,"15min":0.91700000000000004},"min":{"1min":0.63100000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.208,"5min":1.288,"15min":1.288},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.98999999999999999,"15min":1},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.179}]},{"osd":4,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.90900000000000003,"15min":0.90400000000000003},"min":{"1min":0.65000000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.119,"15min":1.1240000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.302}]},{"osd":5,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0329999999999999,"15min":1.0389999999999999},"min":{"1min":0.69699999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.395,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.022,"15min":1.018},"min":{"1min":0.77200000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.149}]},{"osd":6,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.1140000000000001,"15min":1.1279999999999999},"min":{"1min":0.76600000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.405,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.1339999999999999,"15min":1.139},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.452,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.3580000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":720896,"data_stored":301059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.75600000000000001,"15min":0.754},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97799999999999998,"5min":1.024,"15min":1.024},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.872,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.27,"5min":1.431,"15min":1.431},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91600000000000004,"15min":0.92400000000000004},"min":{"1min":0.60399999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.161,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.747},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91400000000000003,"15min":0.91200000000000003},"min":{"1min":0.64300000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.179,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.89100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.60799999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1459999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.96599999999999997,"15min":0.98199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1379999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.1679999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.96099999999999997,"15min":0.97799999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.0700000000000001,"5min":1.359,"15min":1.359},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0509999999999999,"15min":1.054},"min":{"1min":0.79900000000000004,"5min":0.749,"15min":0.749},"max":{"1min":1.262,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.92400000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.90700000000000003,"15min":0.90900000000000003},"min":{"1min":0.626,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0209999999999999,"15min":1.024},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.2070000000000001,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0169999999999999,"15min":1.0189999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.069,"15min":1.073},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.264,"5min":1.597,"15min":1.597},"last":1.085}]},{"osd":7,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1060000000000001,"15min":1.109},"min":{"1min":0.79900000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3360000000000001,"5min":1.728,"15min":1.728},"last":1.115},{"interface":"front","average":{"1min":1.131,"5min":1.1870000000000001,"15min":1.1970000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.518,"5min":2.194,"15min":2.194},"last":1.0609999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":301711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.86399999999999999,"15min":0.872},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1339999999999999,"5min":1.395,"15min":1.395},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.879,"15min":0.88800000000000001},"min":{"1min":0.56999999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.94999999999999996,"15min":0.95799999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.339,"5min":1.508,"15min":1.508},"last":1.004},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.622,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.0669999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84899999999999998,"15min":0.85199999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.137,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.91200000000000003,"15min":0.92100000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2370000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.84199999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.98599999999999999,"15min":1.004},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.377,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91700000000000004,"15min":0.93000000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.272,"5min":1.603,"15min":1.603},"last":0.94099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.044,"15min":1.0660000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1180000000000001,"5min":1.466,"15min":1.466},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":1.0189999999999999,"15min":1.038},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2090000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.748}]},{"osd":6,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.0549999999999999,"15min":1.071},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.347,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.04,"5min":1.171,"15min":1.1930000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.248,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.98199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.1299999999999999,"15min":1.1479999999999999},"min":{"1min":0.78500000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5269999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.1930000000000001,"15min":1.2130000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.4530000000000001,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.042}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":302623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.82299999999999995,"15min":0.83599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0589999999999999,"5min":1.306,"15min":1.306},"last":1.028}]},{"osd":1,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91000000000000003,"15min":0.90900000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.29,"5min":1.357,"15min":1.357},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.99099999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88900000000000001,"15min":0.88300000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.92400000000000004,"15min":0.91000000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.101}]},{"osd":3,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.91200000000000003,"15min":0.92200000000000004},"min":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1990000000000001,"5min":1.464,"15min":1.464},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.89300000000000002,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.88200000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.94999999999999996,"15min":0.94099999999999995},"min":{"1min":0.63600000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0640000000000001,"15min":1.0620000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.1379999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.96899999999999997,"15min":0.97299999999999998},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.208,"5min":1.26,"15min":1.26},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.048,"15min":1.044},"min":{"1min":0.77000000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.169}]},{"osd":7,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.083,"15min":1.085},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.4119999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.129,"15min":1.127},"min":{"1min":0.93000000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":1.0640000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":729088,"data_stored":301115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75800000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.33600000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.82799999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.373}]},{"osd":1,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83899999999999997,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.56399999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96599999999999997,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.76200000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.51800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.96199999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91700000000000004,"15min":0.92400000000000004},"min":{"1min":0.66500000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1759999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.876,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.73699999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.0149999999999999,"5min":1.899,"15min":1.899},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.91700000000000004,"15min":0.92900000000000005},"min":{"1min":0.59499999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.94399999999999995,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.99399999999999999,"15min":0.996},"min":{"1min":0.72699999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.337,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.628}]},{"osd":6,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.018,"15min":1.024},"min":{"1min":0.754,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.157,"5min":1.635,"15min":1.635},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.028,"15min":1.044},"min":{"1min":0.71499999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1970000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.085,"15min":1.093},"min":{"1min":0.746,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.288,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.78700000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2549999999999999,"5min":1.756,"15min":1.756},"last":0.64200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":301115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.628,"15min":0.63500000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.86199999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.76600000000000001,"15min":0.77900000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.038,"5min":1.103,"15min":1.103},"last":0.92100000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.93600000000000005,"15min":0.94499999999999995},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2190000000000001,"5min":1.3,"15min":1.3},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92900000000000005,"15min":0.92700000000000005},"min":{"1min":0.748,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.877}]},{"osd":5,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.95499999999999996,"15min":0.95799999999999996},"min":{"1min":0.76300000000000001,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.92000000000000004,"15min":0.91600000000000004},"min":{"1min":0.70799999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.67000000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.194,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.999,"15min":0.99199999999999999},"min":{"1min":0.82699999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.2250000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0529999999999999,"15min":1.0609999999999999},"min":{"1min":0.78600000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.998,"5min":1.03,"15min":1.0349999999999999},"min":{"1min":0.73599999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.268,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.94699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":301149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.48899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.873,"5min":1.151,"15min":1.151},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65900000000000003,"15min":0.66900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86699999999999999,"5min":1.306,"15min":1.306},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.752,"15min":0.755},"min":{"1min":0.38800000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.98399999999999999,"5min":1.28,"15min":1.28},"last":0.82199999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.437,"5min":0.308,"15min":0.308},"max":{"1min":1.0149999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0269999999999999,"5min":1.905,"15min":1.905},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.96099999999999997,"15min":0.96599999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3580000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.026,"15min":1.0389999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.202,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.88500000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0669999999999999,"15min":1.0780000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3140000000000001,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.107,"15min":1.119},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.377,"5min":1.556,"15min":1.556},"last":0.91100000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0700000000000001,"15min":1.0820000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4530000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1339999999999999,"15min":1.1439999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4199999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.054}]},{"osd":7,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.1539999999999999,"15min":1.165},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3839999999999999,"5min":1.712,"15min":1.712},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.095,"15min":1.101},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5720000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.022}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1331200,"data_stored":893573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.38400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.99399999999999999,"5min":3.25,"15min":3.25},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.80700000000000005,"15min":0.81999999999999995},"min":{"1min":0.53100000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95599999999999996,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.91800000000000004,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.85999999999999999,"15min":0.89000000000000001},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.999,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.84599999999999997,"15min":0.874},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96299999999999997,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":1.016},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.94499999999999995,"15min":0.97099999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.333,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.88400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.012,"15min":1.0329999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5289999999999999,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0449999999999999,"15min":1.0620000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.4239999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":1.379}]},{"osd":5,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.069,"15min":1.083},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.421,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.091},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.091,"15min":1.1180000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.222,"5min":5.399,"15min":5.399},"last":1.3049999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.143,"15min":1.161},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.482,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.032,"5min":1.111,"15min":1.1240000000000001},"min":{"1min":0.79100000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3720000000000001,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.3360000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.127,"15min":1.135},"min":{"1min":0.76200000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6379999999999999,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.419},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.202,"15min":1.23},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5760000000000001,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":1.2}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:08:53.403 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:08:53.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.515+0000 7f7d9da81700 1 Processor -- start 2024-09-13T17:08:53.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.515+0000 7f7d9da81700 1 -- start start 2024-09-13T17:08:53.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.515+0000 7f7d9da81700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7d980cdb20 0x7f7d980cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.515+0000 7f7d9da81700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d98162550 con 0x7f7d9815ed00 2024-09-13T17:08:53.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.515+0000 7f7d9da81700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d980ce4a0 con 0x7f7d9815e920 2024-09-13T17:08:53.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.515+0000 7f7d9da81700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d980cd690 con 0x7f7d980cdb20 2024-09-13T17:08:53.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d9d280700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7d980cdb20 0x7f7d980cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d97fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7d9815ed00 0x7f7d98161540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44296/0 (socket says 172.21.15.123:44296) 2024-09-13T17:08:53.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d97fff700 1 -- 172.21.15.123:0/1296911729 learned_addr learned my addr 172.21.15.123:0/1296911729 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:53.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d9d280700 1 -- 172.21.15.123:0/1296911729 >> v1:172.21.15.153:6789/0 conn(0x7f7d9815e920 legacy=0x7f7d980caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d9d280700 1 -- 172.21.15.123:0/1296911729 >> v1:172.21.15.123:6789/0 conn(0x7f7d9815ed00 legacy=0x7f7d98161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d9d280700 1 -- 172.21.15.123:0/1296911729 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d98161f90 con 0x7f7d980cdb20 2024-09-13T17:08:53.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d977fe700 1 -- 172.21.15.123:0/1296911729 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416980276 0 0) 0x7f7d98162550 con 0x7f7d9815ed00 2024-09-13T17:08:53.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d9d280700 1 --2- 172.21.15.123:0/1296911729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d980cdb20 0x7f7d980cdf60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009850 tx=0x7f7d90009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e15066af45f09a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:53.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d977fe700 1 -- 172.21.15.123:0/1296911729 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90011830 con 0x7f7d980cdb20 2024-09-13T17:08:53.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d977fe700 1 -- 172.21.15.123:0/1296911729 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d90011990 con 0x7f7d980cdb20 2024-09-13T17:08:53.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d977fe700 1 -- 172.21.15.123:0/1296911729 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90011d20 con 0x7f7d980cdb20 2024-09-13T17:08:53.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d9da81700 1 -- 172.21.15.123:0/1296911729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d980cdb20 msgr2=0x7f7d980cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d9da81700 1 --2- 172.21.15.123:0/1296911729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d980cdb20 0x7f7d980cdf60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009850 tx=0x7f7d90009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:53.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d9da81700 1 -- 172.21.15.123:0/1296911729 shutdown_connections 2024-09-13T17:08:53.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d9da81700 1 --2- 172.21.15.123:0/1296911729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d980cdb20 0x7f7d980cdf60 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d9da81700 1 -- 172.21.15.123:0/1296911729 >> 172.21.15.123:0/1296911729 conn(0x7f7d98066150 msgr2=0x7f7d98066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:53.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d9da81700 1 -- 172.21.15.123:0/1296911729 shutdown_connections 2024-09-13T17:08:53.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d9da81700 1 -- 172.21.15.123:0/1296911729 wait complete. 2024-09-13T17:08:53.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.519+0000 7f7d9da81700 1 Processor -- start 2024-09-13T17:08:53.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9da81700 1 -- start start 2024-09-13T17:08:53.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9da81700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d980cdb20 0x7f7d9814fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9da81700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d9815e920 0x7f7d980a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9da81700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d9815ed00 0x7f7d981595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9da81700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98157030 con 0x7f7d9815ed00 2024-09-13T17:08:53.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9da81700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9815c2e0 con 0x7f7d9815e920 2024-09-13T17:08:53.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9da81700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9815c7e0 con 0x7f7d980cdb20 2024-09-13T17:08:53.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9d280700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d9815ed00 0x7f7d981595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9d280700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d9815ed00 0x7f7d981595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41568/0 (socket says 172.21.15.123:41568) 2024-09-13T17:08:53.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9d280700 1 -- 172.21.15.123:0/2874088984 learned_addr learned my addr 172.21.15.123:0/2874088984 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:53.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d97fff700 1 --2- 172.21.15.123:0/2874088984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d9815e920 0x7f7d980a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9ca7f700 1 --2- 172.21.15.123:0/2874088984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d980cdb20 0x7f7d9814fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9d280700 1 -- 172.21.15.123:0/2874088984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d980cdb20 msgr2=0x7f7d9814fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9d280700 1 --2- 172.21.15.123:0/2874088984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d980cdb20 0x7f7d9814fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9d280700 1 -- 172.21.15.123:0/2874088984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d9815e920 msgr2=0x7f7d980a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9d280700 1 --2- 172.21.15.123:0/2874088984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d9815e920 0x7f7d980a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9d280700 1 -- 172.21.15.123:0/2874088984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d900094b0 con 0x7f7d9815ed00 2024-09-13T17:08:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9d280700 1 --2- 172.21.15.123:0/2874088984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d9815ed00 0x7f7d981595e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7d900090b0 tx=0x7f7d90004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d957fa700 1 -- 172.21.15.123:0/2874088984 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9000ba70 con 0x7f7d9815ed00 2024-09-13T17:08:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d957fa700 1 -- 172.21.15.123:0/2874088984 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9001f070 con 0x7f7d9815ed00 2024-09-13T17:08:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9da81700 1 -- 172.21.15.123:0/2874088984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9815cac0 con 0x7f7d9815ed00 2024-09-13T17:08:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d957fa700 1 -- 172.21.15.123:0/2874088984 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9000be30 con 0x7f7d9815ed00 2024-09-13T17:08:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.523+0000 7f7d9da81700 1 -- 172.21.15.123:0/2874088984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9815d080 con 0x7f7d9815ed00 2024-09-13T17:08:53.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.527+0000 7f7d9da81700 1 -- 172.21.15.123:0/2874088984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d980677f0 con 0x7f7d9815ed00 2024-09-13T17:08:53.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.527+0000 7f7d957fa700 1 -- 172.21.15.123:0/2874088984 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7d9001a430 con 0x7f7d9815ed00 2024-09-13T17:08:53.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.527+0000 7f7d957fa700 1 --2- 172.21.15.123:0/2874088984 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7d78066730 0x7f7d78068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.527+0000 7f7d9ca7f700 1 --2- 172.21.15.123:0/2874088984 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7d78066730 0x7f7d78068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.527+0000 7f7d957fa700 1 -- 172.21.15.123:0/2874088984 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d90021070 con 0x7f7d9815ed00 2024-09-13T17:08:53.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.527+0000 7f7d9ca7f700 1 --2- 172.21.15.123:0/2874088984 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7d78066730 0x7f7d78068bf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7d80000f60 tx=0x7f7d80009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:53.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.531+0000 7f7d957fa700 1 -- 172.21.15.123:0/2874088984 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d90052c20 con 0x7f7d9815ed00 2024-09-13T17:08:53.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.695+0000 7f7d9da81700 1 -- 172.21.15.123:0/2874088984 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d980cb1f0 con 0x7f7d78066730 2024-09-13T17:08:53.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.711+0000 7f7d957fa700 1 -- 172.21.15.123:0/2874088984 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287994 (secure 0 0 0) 0x7f7d800015e0 con 0x7f7d78066730 2024-09-13T17:08:53.720 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:53.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.719+0000 7f7d9da81700 1 -- 172.21.15.123:0/2874088984 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7d78066730 msgr2=0x7f7d78068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.719+0000 7f7d9da81700 1 --2- 172.21.15.123:0/2874088984 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7d78066730 0x7f7d78068bf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7d80000f60 tx=0x7f7d80009040 comp rx=0 tx=0).stop 2024-09-13T17:08:53.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.719+0000 7f7d9da81700 1 -- 172.21.15.123:0/2874088984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d9815ed00 msgr2=0x7f7d981595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.719+0000 7f7d9da81700 1 --2- 172.21.15.123:0/2874088984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d9815ed00 0x7f7d981595e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7d900090b0 tx=0x7f7d90004770 comp rx=0 tx=0).stop 2024-09-13T17:08:53.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.719+0000 7f7d9da81700 1 -- 172.21.15.123:0/2874088984 shutdown_connections 2024-09-13T17:08:53.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.719+0000 7f7d9da81700 1 --2- 172.21.15.123:0/2874088984 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7d78066730 0x7f7d78068bf0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.719+0000 7f7d9da81700 1 --2- 172.21.15.123:0/2874088984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d9815ed00 0x7f7d981595e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.719+0000 7f7d9da81700 1 --2- 172.21.15.123:0/2874088984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d9815e920 0x7f7d980a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.719+0000 7f7d9da81700 1 --2- 172.21.15.123:0/2874088984 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7d980cdb20 0x7f7d9814fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.719+0000 7f7d9da81700 1 -- 172.21.15.123:0/2874088984 >> 172.21.15.123:0/2874088984 conn(0x7f7d98066150 msgr2=0x7f7d980b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:53.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.719+0000 7f7d9da81700 1 -- 172.21.15.123:0/2874088984 shutdown_connections 2024-09-13T17:08:53.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.719+0000 7f7d9da81700 1 -- 172.21.15.123:0/2874088984 wait complete. 2024-09-13T17:08:53.726 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:08:53.737 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-09-13T17:08:52.773390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231232,"kb_used_data":6856,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754743488,"statfs":{"total":773094113280,"available":772857331712,"internally_reserved":0,"allocated":7020544,"data_stored":3593932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":229625401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.823542"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348358+0000","last_change":"2024-09-13T17:08:49.361074+0000","last_active":"2024-09-13T17:08:50.348358+0000","last_peered":"2024-09-13T17:08:50.348358+0000","last_clean":"2024-09-13T17:08:50.348358+0000","last_became_active":"2024-09-13T17:08:49.360761+0000","last_became_peered":"2024-09-13T17:08:49.360761+0000","last_unstale":"2024-09-13T17:08:50.348358+0000","last_undegraded":"2024-09-13T17:08:50.348358+0000","last_fullsized":"2024-09-13T17:08:50.348358+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:17.790124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349473+0000","last_change":"2024-09-13T17:08:49.369653+0000","last_active":"2024-09-13T17:08:50.349473+0000","last_peered":"2024-09-13T17:08:50.349473+0000","last_clean":"2024-09-13T17:08:50.349473+0000","last_became_active":"2024-09-13T17:08:49.369417+0000","last_became_peered":"2024-09-13T17:08:49.369417+0000","last_unstale":"2024-09-13T17:08:50.349473+0000","last_undegraded":"2024-09-13T17:08:50.349473+0000","last_fullsized":"2024-09-13T17:08:50.349473+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:51.499507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349041+0000","last_change":"2024-09-13T17:08:49.362188+0000","last_active":"2024-09-13T17:08:50.349041+0000","last_peered":"2024-09-13T17:08:50.349041+0000","last_clean":"2024-09-13T17:08:50.349041+0000","last_became_active":"2024-09-13T17:08:49.360782+0000","last_became_peered":"2024-09-13T17:08:49.360782+0000","last_unstale":"2024-09-13T17:08:50.349041+0000","last_undegraded":"2024-09-13T17:08:50.349041+0000","last_fullsized":"2024-09-13T17:08:50.349041+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:43.013072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433673+0000","last_change":"2024-09-13T17:08:49.369188+0000","last_active":"2024-09-13T17:08:50.433673+0000","last_peered":"2024-09-13T17:08:50.433673+0000","last_clean":"2024-09-13T17:08:50.433673+0000","last_became_active":"2024-09-13T17:08:49.368919+0000","last_became_peered":"2024-09-13T17:08:49.368919+0000","last_unstale":"2024-09-13T17:08:50.433673+0000","last_undegraded":"2024-09-13T17:08:50.433673+0000","last_fullsized":"2024-09-13T17:08:50.433673+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:43.022139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348231+0000","last_change":"2024-09-13T17:08:49.365979+0000","last_active":"2024-09-13T17:08:50.348231+0000","last_peered":"2024-09-13T17:08:50.348231+0000","last_clean":"2024-09-13T17:08:50.348231+0000","last_became_active":"2024-09-13T17:08:49.365748+0000","last_became_peered":"2024-09-13T17:08:49.365748+0000","last_unstale":"2024-09-13T17:08:50.348231+0000","last_undegraded":"2024-09-13T17:08:50.348231+0000","last_fullsized":"2024-09-13T17:08:50.348231+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:28.781193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837856+0000","last_change":"2024-09-13T17:08:49.359950+0000","last_active":"2024-09-13T17:08:50.837856+0000","last_peered":"2024-09-13T17:08:50.837856+0000","last_clean":"2024-09-13T17:08:50.837856+0000","last_became_active":"2024-09-13T17:08:49.358747+0000","last_became_peered":"2024-09-13T17:08:49.358747+0000","last_unstale":"2024-09-13T17:08:50.837856+0000","last_undegraded":"2024-09-13T17:08:50.837856+0000","last_fullsized":"2024-09-13T17:08:50.837856+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:26.297277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836175+0000","last_change":"2024-09-13T17:08:49.370811+0000","last_active":"2024-09-13T17:08:50.836175+0000","last_peered":"2024-09-13T17:08:50.836175+0000","last_clean":"2024-09-13T17:08:50.836175+0000","last_became_active":"2024-09-13T17:08:49.370364+0000","last_became_peered":"2024-09-13T17:08:49.370364+0000","last_unstale":"2024-09-13T17:08:50.836175+0000","last_undegraded":"2024-09-13T17:08:50.836175+0000","last_fullsized":"2024-09-13T17:08:50.836175+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:41.075443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.347524+0000","last_change":"2024-09-13T17:08:49.360550+0000","last_active":"2024-09-13T17:08:50.347524+0000","last_peered":"2024-09-13T17:08:50.347524+0000","last_clean":"2024-09-13T17:08:50.347524+0000","last_became_active":"2024-09-13T17:08:49.360330+0000","last_became_peered":"2024-09-13T17:08:49.360330+0000","last_unstale":"2024-09-13T17:08:50.347524+0000","last_undegraded":"2024-09-13T17:08:50.347524+0000","last_fullsized":"2024-09-13T17:08:50.347524+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:26.297277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836844+0000","last_change":"2024-09-13T17:08:49.371728+0000","last_active":"2024-09-13T17:08:50.836844+0000","last_peered":"2024-09-13T17:08:50.836844+0000","last_clean":"2024-09-13T17:08:50.836844+0000","last_became_active":"2024-09-13T17:08:49.371461+0000","last_became_peered":"2024-09-13T17:08:49.371461+0000","last_unstale":"2024-09-13T17:08:50.836844+0000","last_undegraded":"2024-09-13T17:08:50.836844+0000","last_fullsized":"2024-09-13T17:08:50.836844+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:50.589830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.839029+0000","last_change":"2024-09-13T17:08:49.368108+0000","last_active":"2024-09-13T17:08:50.839029+0000","last_peered":"2024-09-13T17:08:50.839029+0000","last_clean":"2024-09-13T17:08:50.839029+0000","last_became_active":"2024-09-13T17:08:49.367897+0000","last_became_peered":"2024-09-13T17:08:49.367897+0000","last_unstale":"2024-09-13T17:08:50.839029+0000","last_undegraded":"2024-09-13T17:08:50.839029+0000","last_fullsized":"2024-09-13T17:08:50.839029+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:44.913263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838659+0000","last_change":"2024-09-13T17:08:49.372919+0000","last_active":"2024-09-13T17:08:50.838659+0000","last_peered":"2024-09-13T17:08:50.838659+0000","last_clean":"2024-09-13T17:08:50.838659+0000","last_became_active":"2024-09-13T17:08:49.372631+0000","last_became_peered":"2024-09-13T17:08:49.372631+0000","last_unstale":"2024-09-13T17:08:50.838659+0000","last_undegraded":"2024-09-13T17:08:50.838659+0000","last_fullsized":"2024-09-13T17:08:50.838659+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:34.851341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433726+0000","last_change":"2024-09-13T17:08:49.365905+0000","last_active":"2024-09-13T17:08:50.433726+0000","last_peered":"2024-09-13T17:08:50.433726+0000","last_clean":"2024-09-13T17:08:50.433726+0000","last_became_active":"2024-09-13T17:08:49.365552+0000","last_became_peered":"2024-09-13T17:08:49.365552+0000","last_unstale":"2024-09-13T17:08:50.433726+0000","last_undegraded":"2024-09-13T17:08:50.433726+0000","last_fullsized":"2024-09-13T17:08:50.433726+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:56.985959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837749+0000","last_change":"2024-09-13T17:08:49.365994+0000","last_active":"2024-09-13T17:08:50.837749+0000","last_peered":"2024-09-13T17:08:50.837749+0000","last_clean":"2024-09-13T17:08:50.837749+0000","last_became_active":"2024-09-13T17:08:49.365735+0000","last_became_peered":"2024-09-13T17:08:49.365735+0000","last_unstale":"2024-09-13T17:08:50.837749+0000","last_undegraded":"2024-09-13T17:08:50.837749+0000","last_fullsized":"2024-09-13T17:08:50.837749+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:48.939580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837052+0000","last_change":"2024-09-13T17:08:49.363550+0000","last_active":"2024-09-13T17:08:50.837052+0000","last_peered":"2024-09-13T17:08:50.837052+0000","last_clean":"2024-09-13T17:08:50.837052+0000","last_became_active":"2024-09-13T17:08:49.363130+0000","last_became_peered":"2024-09-13T17:08:49.363130+0000","last_unstale":"2024-09-13T17:08:50.837052+0000","last_undegraded":"2024-09-13T17:08:50.837052+0000","last_fullsized":"2024-09-13T17:08:50.837052+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:19.431286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836360+0000","last_change":"2024-09-13T17:08:49.370405+0000","last_active":"2024-09-13T17:08:50.836360+0000","last_peered":"2024-09-13T17:08:50.836360+0000","last_clean":"2024-09-13T17:08:50.836360+0000","last_became_active":"2024-09-13T17:08:49.370081+0000","last_became_peered":"2024-09-13T17:08:49.370081+0000","last_unstale":"2024-09-13T17:08:50.836360+0000","last_undegraded":"2024-09-13T17:08:50.836360+0000","last_fullsized":"2024-09-13T17:08:50.836360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:26.502069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837230+0000","last_change":"2024-09-13T17:08:49.363386+0000","last_active":"2024-09-13T17:08:50.837230+0000","last_peered":"2024-09-13T17:08:50.837230+0000","last_clean":"2024-09-13T17:08:50.837230+0000","last_became_active":"2024-09-13T17:08:49.363199+0000","last_became_peered":"2024-09-13T17:08:49.363199+0000","last_unstale":"2024-09-13T17:08:50.837230+0000","last_undegraded":"2024-09-13T17:08:50.837230+0000","last_fullsized":"2024-09-13T17:08:50.837230+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:25.848609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349798+0000","last_change":"2024-09-13T17:08:49.366293+0000","last_active":"2024-09-13T17:08:50.349798+0000","last_peered":"2024-09-13T17:08:50.349798+0000","last_clean":"2024-09-13T17:08:50.349798+0000","last_became_active":"2024-09-13T17:08:49.366044+0000","last_became_peered":"2024-09-13T17:08:49.366044+0000","last_unstale":"2024-09-13T17:08:50.349798+0000","last_undegraded":"2024-09-13T17:08:50.349798+0000","last_fullsized":"2024-09-13T17:08:50.349798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:59.335892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348912+0000","last_change":"2024-09-13T17:08:49.367146+0000","last_active":"2024-09-13T17:08:50.348912+0000","last_peered":"2024-09-13T17:08:50.348912+0000","last_clean":"2024-09-13T17:08:50.348912+0000","last_became_active":"2024-09-13T17:08:49.366892+0000","last_became_peered":"2024-09-13T17:08:49.366892+0000","last_unstale":"2024-09-13T17:08:50.348912+0000","last_undegraded":"2024-09-13T17:08:50.348912+0000","last_fullsized":"2024-09-13T17:08:50.348912+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:04.288666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348778+0000","last_change":"2024-09-13T17:08:49.358470+0000","last_active":"2024-09-13T17:08:50.348778+0000","last_peered":"2024-09-13T17:08:50.348778+0000","last_clean":"2024-09-13T17:08:50.348778+0000","last_became_active":"2024-09-13T17:08:49.358085+0000","last_became_peered":"2024-09-13T17:08:49.358085+0000","last_unstale":"2024-09-13T17:08:50.348778+0000","last_undegraded":"2024-09-13T17:08:50.348778+0000","last_fullsized":"2024-09-13T17:08:50.348778+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:51.492376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348996+0000","last_change":"2024-09-13T17:08:49.369692+0000","last_active":"2024-09-13T17:08:50.348996+0000","last_peered":"2024-09-13T17:08:50.348996+0000","last_clean":"2024-09-13T17:08:50.348996+0000","last_became_active":"2024-09-13T17:08:49.367841+0000","last_became_peered":"2024-09-13T17:08:49.367841+0000","last_unstale":"2024-09-13T17:08:50.348996+0000","last_undegraded":"2024-09-13T17:08:50.348996+0000","last_fullsized":"2024-09-13T17:08:50.348996+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:40.791465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348283+0000","last_change":"2024-09-13T17:08:49.366942+0000","last_active":"2024-09-13T17:08:50.348283+0000","last_peered":"2024-09-13T17:08:50.348283+0000","last_clean":"2024-09-13T17:08:50.348283+0000","last_became_active":"2024-09-13T17:08:49.366664+0000","last_became_peered":"2024-09-13T17:08:49.366664+0000","last_unstale":"2024-09-13T17:08:50.348283+0000","last_undegraded":"2024-09-13T17:08:50.348283+0000","last_fullsized":"2024-09-13T17:08:50.348283+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:26.297277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348154+0000","last_change":"2024-09-13T17:08:49.368860+0000","last_active":"2024-09-13T17:08:50.348154+0000","last_peered":"2024-09-13T17:08:50.348154+0000","last_clean":"2024-09-13T17:08:50.348154+0000","last_became_active":"2024-09-13T17:08:49.367627+0000","last_became_peered":"2024-09-13T17:08:49.367627+0000","last_unstale":"2024-09-13T17:08:50.348154+0000","last_undegraded":"2024-09-13T17:08:50.348154+0000","last_fullsized":"2024-09-13T17:08:50.348154+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:18:54.081657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348283+0000","last_change":"2024-09-13T17:08:49.364783+0000","last_active":"2024-09-13T17:08:50.348283+0000","last_peered":"2024-09-13T17:08:50.348283+0000","last_clean":"2024-09-13T17:08:50.348283+0000","last_became_active":"2024-09-13T17:08:49.362427+0000","last_became_peered":"2024-09-13T17:08:49.362427+0000","last_unstale":"2024-09-13T17:08:50.348283+0000","last_undegraded":"2024-09-13T17:08:50.348283+0000","last_fullsized":"2024-09-13T17:08:50.348283+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:59.335892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836943+0000","last_change":"2024-09-13T17:08:49.367274+0000","last_active":"2024-09-13T17:08:50.836943+0000","last_peered":"2024-09-13T17:08:50.836943+0000","last_clean":"2024-09-13T17:08:50.836943+0000","last_became_active":"2024-09-13T17:08:49.367014+0000","last_became_peered":"2024-09-13T17:08:49.367014+0000","last_unstale":"2024-09-13T17:08:50.836943+0000","last_undegraded":"2024-09-13T17:08:50.836943+0000","last_fullsized":"2024-09-13T17:08:50.836943+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:12.486261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348592+0000","last_change":"2024-09-13T17:08:49.368976+0000","last_active":"2024-09-13T17:08:50.348592+0000","last_peered":"2024-09-13T17:08:50.348592+0000","last_clean":"2024-09-13T17:08:50.348592+0000","last_became_active":"2024-09-13T17:08:49.368742+0000","last_became_peered":"2024-09-13T17:08:49.368742+0000","last_unstale":"2024-09-13T17:08:50.348592+0000","last_undegraded":"2024-09-13T17:08:50.348592+0000","last_fullsized":"2024-09-13T17:08:50.348592+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:26.686282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.434122+0000","last_change":"2024-09-13T17:08:49.361159+0000","last_active":"2024-09-13T17:08:50.434122+0000","last_peered":"2024-09-13T17:08:50.434122+0000","last_clean":"2024-09-13T17:08:50.434122+0000","last_became_active":"2024-09-13T17:08:49.360834+0000","last_became_peered":"2024-09-13T17:08:49.360834+0000","last_unstale":"2024-09-13T17:08:50.434122+0000","last_undegraded":"2024-09-13T17:08:50.434122+0000","last_fullsized":"2024-09-13T17:08:50.434122+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:01.192573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838324+0000","last_change":"2024-09-13T17:08:49.362819+0000","last_active":"2024-09-13T17:08:50.838324+0000","last_peered":"2024-09-13T17:08:50.838324+0000","last_clean":"2024-09-13T17:08:50.838324+0000","last_became_active":"2024-09-13T17:08:49.361903+0000","last_became_peered":"2024-09-13T17:08:49.361903+0000","last_unstale":"2024-09-13T17:08:50.838324+0000","last_undegraded":"2024-09-13T17:08:50.838324+0000","last_fullsized":"2024-09-13T17:08:50.838324+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:39.945915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348636+0000","last_change":"2024-09-13T17:08:49.367918+0000","last_active":"2024-09-13T17:08:50.348636+0000","last_peered":"2024-09-13T17:08:50.348636+0000","last_clean":"2024-09-13T17:08:50.348636+0000","last_became_active":"2024-09-13T17:08:49.367691+0000","last_became_peered":"2024-09-13T17:08:49.367691+0000","last_unstale":"2024-09-13T17:08:50.348636+0000","last_undegraded":"2024-09-13T17:08:50.348636+0000","last_fullsized":"2024-09-13T17:08:50.348636+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:00.837308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349056+0000","last_change":"2024-09-13T17:08:49.367007+0000","last_active":"2024-09-13T17:08:50.349056+0000","last_peered":"2024-09-13T17:08:50.349056+0000","last_clean":"2024-09-13T17:08:50.349056+0000","last_became_active":"2024-09-13T17:08:49.366743+0000","last_became_peered":"2024-09-13T17:08:49.366743+0000","last_unstale":"2024-09-13T17:08:50.349056+0000","last_undegraded":"2024-09-13T17:08:50.349056+0000","last_fullsized":"2024-09-13T17:08:50.349056+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:07.132403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348757+0000","last_change":"2024-09-13T17:08:49.358915+0000","last_active":"2024-09-13T17:08:50.348757+0000","last_peered":"2024-09-13T17:08:50.348757+0000","last_clean":"2024-09-13T17:08:50.348757+0000","last_became_active":"2024-09-13T17:08:49.358556+0000","last_became_peered":"2024-09-13T17:08:49.358556+0000","last_unstale":"2024-09-13T17:08:50.348757+0000","last_undegraded":"2024-09-13T17:08:50.348757+0000","last_fullsized":"2024-09-13T17:08:50.348757+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:04.785090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.347934+0000","last_change":"2024-09-13T17:08:49.364446+0000","last_active":"2024-09-13T17:08:50.347934+0000","last_peered":"2024-09-13T17:08:50.347934+0000","last_clean":"2024-09-13T17:08:50.347934+0000","last_became_active":"2024-09-13T17:08:49.364175+0000","last_became_peered":"2024-09-13T17:08:49.364175+0000","last_unstale":"2024-09-13T17:08:50.347934+0000","last_undegraded":"2024-09-13T17:08:50.347934+0000","last_fullsized":"2024-09-13T17:08:50.347934+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:02.484549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837359+0000","last_change":"2024-09-13T17:08:49.361340+0000","last_active":"2024-09-13T17:08:50.837359+0000","last_peered":"2024-09-13T17:08:50.837359+0000","last_clean":"2024-09-13T17:08:50.837359+0000","last_became_active":"2024-09-13T17:08:49.361111+0000","last_became_peered":"2024-09-13T17:08:49.361111+0000","last_unstale":"2024-09-13T17:08:50.837359+0000","last_undegraded":"2024-09-13T17:08:50.837359+0000","last_fullsized":"2024-09-13T17:08:50.837359+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:03.097018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838926+0000","last_change":"2024-09-13T17:08:49.360385+0000","last_active":"2024-09-13T17:08:50.838926+0000","last_peered":"2024-09-13T17:08:50.838926+0000","last_clean":"2024-09-13T17:08:50.838926+0000","last_became_active":"2024-09-13T17:08:49.360153+0000","last_became_peered":"2024-09-13T17:08:49.360153+0000","last_unstale":"2024-09-13T17:08:50.838926+0000","last_undegraded":"2024-09-13T17:08:50.838926+0000","last_fullsized":"2024-09-13T17:08:50.838926+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:02.994204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838080+0000","last_change":"2024-09-13T17:08:48.980236+0000","last_active":"2024-09-13T17:08:50.838080+0000","last_peered":"2024-09-13T17:08:50.838080+0000","last_clean":"2024-09-13T17:08:50.838080+0000","last_became_active":"2024-09-13T17:08:48.979911+0000","last_became_peered":"2024-09-13T17:08:48.979911+0000","last_unstale":"2024-09-13T17:08:50.838080+0000","last_undegraded":"2024-09-13T17:08:50.838080+0000","last_fullsized":"2024-09-13T17:08:50.838080+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:03.236371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.839486+0000","last_change":"2024-09-13T17:08:49.368734+0000","last_active":"2024-09-13T17:08:50.839486+0000","last_peered":"2024-09-13T17:08:50.839486+0000","last_clean":"2024-09-13T17:08:50.839486+0000","last_became_active":"2024-09-13T17:08:49.368492+0000","last_became_peered":"2024-09-13T17:08:49.368492+0000","last_unstale":"2024-09-13T17:08:50.839486+0000","last_undegraded":"2024-09-13T17:08:50.839486+0000","last_fullsized":"2024-09-13T17:08:50.839486+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:37.053929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349455+0000","last_change":"2024-09-13T17:08:48.971961+0000","last_active":"2024-09-13T17:08:50.349455+0000","last_peered":"2024-09-13T17:08:50.349455+0000","last_clean":"2024-09-13T17:08:50.349455+0000","last_became_active":"2024-09-13T17:08:48.971066+0000","last_became_peered":"2024-09-13T17:08:48.971066+0000","last_unstale":"2024-09-13T17:08:50.349455+0000","last_undegraded":"2024-09-13T17:08:50.349455+0000","last_fullsized":"2024-09-13T17:08:50.349455+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:28.183471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837988+0000","last_change":"2024-09-13T17:08:49.364886+0000","last_active":"2024-09-13T17:08:50.837988+0000","last_peered":"2024-09-13T17:08:50.837988+0000","last_clean":"2024-09-13T17:08:50.837988+0000","last_became_active":"2024-09-13T17:08:49.364660+0000","last_became_peered":"2024-09-13T17:08:49.364660+0000","last_unstale":"2024-09-13T17:08:50.837988+0000","last_undegraded":"2024-09-13T17:08:50.837988+0000","last_fullsized":"2024-09-13T17:08:50.837988+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:07.132403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838947+0000","last_change":"2024-09-13T17:08:48.977499+0000","last_active":"2024-09-13T17:08:50.838947+0000","last_peered":"2024-09-13T17:08:50.838947+0000","last_clean":"2024-09-13T17:08:50.838947+0000","last_became_active":"2024-09-13T17:08:48.977205+0000","last_became_peered":"2024-09-13T17:08:48.977205+0000","last_unstale":"2024-09-13T17:08:50.838947+0000","last_undegraded":"2024-09-13T17:08:50.838947+0000","last_fullsized":"2024-09-13T17:08:50.838947+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:28.183471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838538+0000","last_change":"2024-09-13T17:08:49.366486+0000","last_active":"2024-09-13T17:08:50.838538+0000","last_peered":"2024-09-13T17:08:50.838538+0000","last_clean":"2024-09-13T17:08:50.838538+0000","last_became_active":"2024-09-13T17:08:49.366261+0000","last_became_peered":"2024-09-13T17:08:49.366261+0000","last_unstale":"2024-09-13T17:08:50.838538+0000","last_undegraded":"2024-09-13T17:08:50.838538+0000","last_fullsized":"2024-09-13T17:08:50.838538+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:59.335892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433929+0000","last_change":"2024-09-13T17:08:48.975565+0000","last_active":"2024-09-13T17:08:50.433929+0000","last_peered":"2024-09-13T17:08:50.433929+0000","last_clean":"2024-09-13T17:08:50.433929+0000","last_became_active":"2024-09-13T17:08:48.975059+0000","last_became_peered":"2024-09-13T17:08:48.975059+0000","last_unstale":"2024-09-13T17:08:50.433929+0000","last_undegraded":"2024-09-13T17:08:50.433929+0000","last_fullsized":"2024-09-13T17:08:50.433929+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:15.729717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348353+0000","last_change":"2024-09-13T17:08:49.362633+0000","last_active":"2024-09-13T17:08:50.348353+0000","last_peered":"2024-09-13T17:08:50.348353+0000","last_clean":"2024-09-13T17:08:50.348353+0000","last_became_active":"2024-09-13T17:08:49.362434+0000","last_became_peered":"2024-09-13T17:08:49.362434+0000","last_unstale":"2024-09-13T17:08:50.348353+0000","last_undegraded":"2024-09-13T17:08:50.348353+0000","last_fullsized":"2024-09-13T17:08:50.348353+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:03.097018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836526+0000","last_change":"2024-09-13T17:08:48.972855+0000","last_active":"2024-09-13T17:08:50.836526+0000","last_peered":"2024-09-13T17:08:50.836526+0000","last_clean":"2024-09-13T17:08:50.836526+0000","last_became_active":"2024-09-13T17:08:48.972578+0000","last_became_peered":"2024-09-13T17:08:48.972578+0000","last_unstale":"2024-09-13T17:08:50.836526+0000","last_undegraded":"2024-09-13T17:08:50.836526+0000","last_fullsized":"2024-09-13T17:08:50.836526+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:01.359415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348647+0000","last_change":"2024-09-13T17:08:49.371788+0000","last_active":"2024-09-13T17:08:50.348647+0000","last_peered":"2024-09-13T17:08:50.348647+0000","last_clean":"2024-09-13T17:08:50.348647+0000","last_became_active":"2024-09-13T17:08:49.371551+0000","last_became_peered":"2024-09-13T17:08:49.371551+0000","last_unstale":"2024-09-13T17:08:50.348647+0000","last_undegraded":"2024-09-13T17:08:50.348647+0000","last_fullsized":"2024-09-13T17:08:50.348647+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:29.052928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838064+0000","last_change":"2024-09-13T17:08:48.978131+0000","last_active":"2024-09-13T17:08:50.838064+0000","last_peered":"2024-09-13T17:08:50.838064+0000","last_clean":"2024-09-13T17:08:50.838064+0000","last_became_active":"2024-09-13T17:08:48.977891+0000","last_became_peered":"2024-09-13T17:08:48.977891+0000","last_unstale":"2024-09-13T17:08:50.838064+0000","last_undegraded":"2024-09-13T17:08:50.838064+0000","last_fullsized":"2024-09-13T17:08:50.838064+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:18.427955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837230+0000","last_change":"2024-09-13T17:08:49.363450+0000","last_active":"2024-09-13T17:08:50.837230+0000","last_peered":"2024-09-13T17:08:50.837230+0000","last_clean":"2024-09-13T17:08:50.837230+0000","last_became_active":"2024-09-13T17:08:49.363030+0000","last_became_peered":"2024-09-13T17:08:49.363030+0000","last_unstale":"2024-09-13T17:08:50.837230+0000","last_undegraded":"2024-09-13T17:08:50.837230+0000","last_fullsized":"2024-09-13T17:08:50.837230+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:23.161513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433231+0000","last_change":"2024-09-13T17:08:48.975290+0000","last_active":"2024-09-13T17:08:50.433231+0000","last_peered":"2024-09-13T17:08:50.433231+0000","last_clean":"2024-09-13T17:08:50.433231+0000","last_became_active":"2024-09-13T17:08:48.975000+0000","last_became_peered":"2024-09-13T17:08:48.975000+0000","last_unstale":"2024-09-13T17:08:50.433231+0000","last_undegraded":"2024-09-13T17:08:50.433231+0000","last_fullsized":"2024-09-13T17:08:50.433231+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:13.596215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.347908+0000","last_change":"2024-09-13T17:08:49.366462+0000","last_active":"2024-09-13T17:08:50.347908+0000","last_peered":"2024-09-13T17:08:50.347908+0000","last_clean":"2024-09-13T17:08:50.347908+0000","last_became_active":"2024-09-13T17:08:49.366128+0000","last_became_peered":"2024-09-13T17:08:49.366128+0000","last_unstale":"2024-09-13T17:08:50.347908+0000","last_undegraded":"2024-09-13T17:08:50.347908+0000","last_fullsized":"2024-09-13T17:08:50.347908+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:26.531817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836248+0000","last_change":"2024-09-13T17:08:48.975962+0000","last_active":"2024-09-13T17:08:50.836248+0000","last_peered":"2024-09-13T17:08:50.836248+0000","last_clean":"2024-09-13T17:08:50.836248+0000","last_became_active":"2024-09-13T17:08:48.975243+0000","last_became_peered":"2024-09-13T17:08:48.975243+0000","last_unstale":"2024-09-13T17:08:50.836248+0000","last_undegraded":"2024-09-13T17:08:50.836248+0000","last_fullsized":"2024-09-13T17:08:50.836248+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:11.482930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837155+0000","last_change":"2024-09-13T17:08:49.369119+0000","last_active":"2024-09-13T17:08:50.837155+0000","last_peered":"2024-09-13T17:08:50.837155+0000","last_clean":"2024-09-13T17:08:50.837155+0000","last_became_active":"2024-09-13T17:08:49.368888+0000","last_became_peered":"2024-09-13T17:08:49.368888+0000","last_unstale":"2024-09-13T17:08:50.837155+0000","last_undegraded":"2024-09-13T17:08:50.837155+0000","last_fullsized":"2024-09-13T17:08:50.837155+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:29.186802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349349+0000","last_change":"2024-09-13T17:08:48.979805+0000","last_active":"2024-09-13T17:08:50.349349+0000","last_peered":"2024-09-13T17:08:50.349349+0000","last_clean":"2024-09-13T17:08:50.349349+0000","last_became_active":"2024-09-13T17:08:48.979547+0000","last_became_peered":"2024-09-13T17:08:48.979547+0000","last_unstale":"2024-09-13T17:08:50.349349+0000","last_undegraded":"2024-09-13T17:08:50.349349+0000","last_fullsized":"2024-09-13T17:08:50.349349+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:25.639744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349245+0000","last_change":"2024-09-13T17:08:49.365332+0000","last_active":"2024-09-13T17:08:50.349245+0000","last_peered":"2024-09-13T17:08:50.349245+0000","last_clean":"2024-09-13T17:08:50.349245+0000","last_became_active":"2024-09-13T17:08:49.362221+0000","last_became_peered":"2024-09-13T17:08:49.362221+0000","last_unstale":"2024-09-13T17:08:50.349245+0000","last_undegraded":"2024-09-13T17:08:50.349245+0000","last_fullsized":"2024-09-13T17:08:50.349245+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:25.848609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349545+0000","last_change":"2024-09-13T17:08:48.977856+0000","last_active":"2024-09-13T17:08:50.349545+0000","last_peered":"2024-09-13T17:08:50.349545+0000","last_clean":"2024-09-13T17:08:50.349545+0000","last_became_active":"2024-09-13T17:08:48.977603+0000","last_became_peered":"2024-09-13T17:08:48.977603+0000","last_unstale":"2024-09-13T17:08:50.349545+0000","last_undegraded":"2024-09-13T17:08:50.349545+0000","last_fullsized":"2024-09-13T17:08:50.349545+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:40.072111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838614+0000","last_change":"2024-09-13T17:08:49.370667+0000","last_active":"2024-09-13T17:08:50.838614+0000","last_peered":"2024-09-13T17:08:50.838614+0000","last_clean":"2024-09-13T17:08:50.838614+0000","last_became_active":"2024-09-13T17:08:49.370424+0000","last_became_peered":"2024-09-13T17:08:49.370424+0000","last_unstale":"2024-09-13T17:08:50.838614+0000","last_undegraded":"2024-09-13T17:08:50.838614+0000","last_fullsized":"2024-09-13T17:08:50.838614+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:26.643075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349674+0000","last_change":"2024-09-13T17:08:48.976985+0000","last_active":"2024-09-13T17:08:50.349674+0000","last_peered":"2024-09-13T17:08:50.349674+0000","last_clean":"2024-09-13T17:08:50.349674+0000","last_became_active":"2024-09-13T17:08:48.976628+0000","last_became_peered":"2024-09-13T17:08:48.976628+0000","last_unstale":"2024-09-13T17:08:50.349674+0000","last_undegraded":"2024-09-13T17:08:50.349674+0000","last_fullsized":"2024-09-13T17:08:50.349674+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:25.498737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349260+0000","last_change":"2024-09-13T17:08:49.364308+0000","last_active":"2024-09-13T17:08:50.349260+0000","last_peered":"2024-09-13T17:08:50.349260+0000","last_clean":"2024-09-13T17:08:50.349260+0000","last_became_active":"2024-09-13T17:08:49.363838+0000","last_became_peered":"2024-09-13T17:08:49.363838+0000","last_unstale":"2024-09-13T17:08:50.349260+0000","last_undegraded":"2024-09-13T17:08:50.349260+0000","last_fullsized":"2024-09-13T17:08:50.349260+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:07.132403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836800+0000","last_change":"2024-09-13T17:08:48.972685+0000","last_active":"2024-09-13T17:08:50.836800+0000","last_peered":"2024-09-13T17:08:50.836800+0000","last_clean":"2024-09-13T17:08:50.836800+0000","last_became_active":"2024-09-13T17:08:48.972425+0000","last_became_peered":"2024-09-13T17:08:48.972425+0000","last_unstale":"2024-09-13T17:08:50.836800+0000","last_undegraded":"2024-09-13T17:08:50.836800+0000","last_fullsized":"2024-09-13T17:08:50.836800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:48.441741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433340+0000","last_change":"2024-09-13T17:08:49.369695+0000","last_active":"2024-09-13T17:08:50.433340+0000","last_peered":"2024-09-13T17:08:50.433340+0000","last_clean":"2024-09-13T17:08:50.433340+0000","last_became_active":"2024-09-13T17:08:49.369440+0000","last_became_peered":"2024-09-13T17:08:49.369440+0000","last_unstale":"2024-09-13T17:08:50.433340+0000","last_undegraded":"2024-09-13T17:08:50.433340+0000","last_fullsized":"2024-09-13T17:08:50.433340+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:22.970691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348848+0000","last_change":"2024-09-13T17:08:48.977444+0000","last_active":"2024-09-13T17:08:50.348848+0000","last_peered":"2024-09-13T17:08:50.348848+0000","last_clean":"2024-09-13T17:08:50.348848+0000","last_became_active":"2024-09-13T17:08:48.977145+0000","last_became_peered":"2024-09-13T17:08:48.977145+0000","last_unstale":"2024-09-13T17:08:50.348848+0000","last_undegraded":"2024-09-13T17:08:50.348848+0000","last_fullsized":"2024-09-13T17:08:50.348848+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:03.236371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348428+0000","last_change":"2024-09-13T17:08:49.364147+0000","last_active":"2024-09-13T17:08:50.348428+0000","last_peered":"2024-09-13T17:08:50.348428+0000","last_clean":"2024-09-13T17:08:50.348428+0000","last_became_active":"2024-09-13T17:08:49.363889+0000","last_became_peered":"2024-09-13T17:08:49.363889+0000","last_unstale":"2024-09-13T17:08:50.348428+0000","last_undegraded":"2024-09-13T17:08:50.348428+0000","last_fullsized":"2024-09-13T17:08:50.348428+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:02.994204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837401+0000","last_change":"2024-09-13T17:08:48.970402+0000","last_active":"2024-09-13T17:08:50.837401+0000","last_peered":"2024-09-13T17:08:50.837401+0000","last_clean":"2024-09-13T17:08:50.837401+0000","last_became_active":"2024-09-13T17:08:48.970062+0000","last_became_peered":"2024-09-13T17:08:48.970062+0000","last_unstale":"2024-09-13T17:08:50.837401+0000","last_undegraded":"2024-09-13T17:08:50.837401+0000","last_fullsized":"2024-09-13T17:08:50.837401+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:54.224933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836128+0000","last_change":"2024-09-13T17:08:49.367908+0000","last_active":"2024-09-13T17:08:50.836128+0000","last_peered":"2024-09-13T17:08:50.836128+0000","last_clean":"2024-09-13T17:08:50.836128+0000","last_became_active":"2024-09-13T17:08:49.364757+0000","last_became_peered":"2024-09-13T17:08:49.364757+0000","last_unstale":"2024-09-13T17:08:50.836128+0000","last_undegraded":"2024-09-13T17:08:50.836128+0000","last_fullsized":"2024-09-13T17:08:50.836128+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:04.239703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433330+0000","last_change":"2024-09-13T17:08:48.975665+0000","last_active":"2024-09-13T17:08:50.433330+0000","last_peered":"2024-09-13T17:08:50.433330+0000","last_clean":"2024-09-13T17:08:50.433330+0000","last_became_active":"2024-09-13T17:08:48.975314+0000","last_became_peered":"2024-09-13T17:08:48.975314+0000","last_unstale":"2024-09-13T17:08:50.433330+0000","last_undegraded":"2024-09-13T17:08:50.433330+0000","last_fullsized":"2024-09-13T17:08:50.433330+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:33.848010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348468+0000","last_change":"2024-09-13T17:08:49.364052+0000","last_active":"2024-09-13T17:08:50.348468+0000","last_peered":"2024-09-13T17:08:50.348468+0000","last_clean":"2024-09-13T17:08:50.348468+0000","last_became_active":"2024-09-13T17:08:49.362209+0000","last_became_peered":"2024-09-13T17:08:49.362209+0000","last_unstale":"2024-09-13T17:08:50.348468+0000","last_undegraded":"2024-09-13T17:08:50.348468+0000","last_fullsized":"2024-09-13T17:08:50.348468+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:18.369863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":19,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348134+0000","last_change":"2024-09-13T17:08:48.982008+0000","last_active":"2024-09-13T17:08:50.348134+0000","last_peered":"2024-09-13T17:08:50.348134+0000","last_clean":"2024-09-13T17:08:50.348134+0000","last_became_active":"2024-09-13T17:08:48.981781+0000","last_became_peered":"2024-09-13T17:08:48.981781+0000","last_unstale":"2024-09-13T17:08:50.348134+0000","last_undegraded":"2024-09-13T17:08:50.348134+0000","last_fullsized":"2024-09-13T17:08:50.348134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:36.050598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348964+0000","last_change":"2024-09-13T17:08:49.361110+0000","last_active":"2024-09-13T17:08:50.348964+0000","last_peered":"2024-09-13T17:08:50.348964+0000","last_clean":"2024-09-13T17:08:50.348964+0000","last_became_active":"2024-09-13T17:08:49.359953+0000","last_became_peered":"2024-09-13T17:08:49.359953+0000","last_unstale":"2024-09-13T17:08:50.348964+0000","last_undegraded":"2024-09-13T17:08:50.348964+0000","last_fullsized":"2024-09-13T17:08:50.348964+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:26.531817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.350318+0000","last_change":"2024-09-13T17:08:48.973266+0000","last_active":"2024-09-13T17:08:50.350318+0000","last_peered":"2024-09-13T17:08:50.350318+0000","last_clean":"2024-09-13T17:08:50.350318+0000","last_became_active":"2024-09-13T17:08:48.973012+0000","last_became_peered":"2024-09-13T17:08:48.973012+0000","last_unstale":"2024-09-13T17:08:50.350318+0000","last_undegraded":"2024-09-13T17:08:50.350318+0000","last_fullsized":"2024-09-13T17:08:50.350318+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:49.586498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433989+0000","last_change":"2024-09-13T17:08:49.372342+0000","last_active":"2024-09-13T17:08:50.433989+0000","last_peered":"2024-09-13T17:08:50.433989+0000","last_clean":"2024-09-13T17:08:50.433989+0000","last_became_active":"2024-09-13T17:08:49.370393+0000","last_became_peered":"2024-09-13T17:08:49.370393+0000","last_unstale":"2024-09-13T17:08:50.433989+0000","last_undegraded":"2024-09-13T17:08:50.433989+0000","last_fullsized":"2024-09-13T17:08:50.433989+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:48.210028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.839119+0000","last_change":"2024-09-13T17:08:48.975718+0000","last_active":"2024-09-13T17:08:50.839119+0000","last_peered":"2024-09-13T17:08:50.839119+0000","last_clean":"2024-09-13T17:08:50.839119+0000","last_became_active":"2024-09-13T17:08:48.975425+0000","last_became_peered":"2024-09-13T17:08:48.975425+0000","last_unstale":"2024-09-13T17:08:50.839119+0000","last_undegraded":"2024-09-13T17:08:50.839119+0000","last_fullsized":"2024-09-13T17:08:50.839119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:49.586498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349198+0000","last_change":"2024-09-13T17:08:49.361321+0000","last_active":"2024-09-13T17:08:50.349198+0000","last_peered":"2024-09-13T17:08:50.349198+0000","last_clean":"2024-09-13T17:08:50.349198+0000","last_became_active":"2024-09-13T17:08:49.361072+0000","last_became_peered":"2024-09-13T17:08:49.361072+0000","last_unstale":"2024-09-13T17:08:50.349198+0000","last_undegraded":"2024-09-13T17:08:50.349198+0000","last_fullsized":"2024-09-13T17:08:50.349198+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:25.848609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433945+0000","last_change":"2024-09-13T17:08:48.977460+0000","last_active":"2024-09-13T17:08:50.433945+0000","last_peered":"2024-09-13T17:08:50.433945+0000","last_clean":"2024-09-13T17:08:50.433945+0000","last_became_active":"2024-09-13T17:08:48.977207+0000","last_became_peered":"2024-09-13T17:08:48.977207+0000","last_unstale":"2024-09-13T17:08:50.433945+0000","last_undegraded":"2024-09-13T17:08:50.433945+0000","last_fullsized":"2024-09-13T17:08:50.433945+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:50.292650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349475+0000","last_change":"2024-09-13T17:08:49.364519+0000","last_active":"2024-09-13T17:08:50.349475+0000","last_peered":"2024-09-13T17:08:50.349475+0000","last_clean":"2024-09-13T17:08:50.349475+0000","last_became_active":"2024-09-13T17:08:49.363799+0000","last_became_peered":"2024-09-13T17:08:49.363799+0000","last_unstale":"2024-09-13T17:08:50.349475+0000","last_undegraded":"2024-09-13T17:08:50.349475+0000","last_fullsized":"2024-09-13T17:08:50.349475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:43.022139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838173+0000","last_change":"2024-09-13T17:08:48.977753+0000","last_active":"2024-09-13T17:08:50.838173+0000","last_peered":"2024-09-13T17:08:50.838173+0000","last_clean":"2024-09-13T17:08:50.838173+0000","last_became_active":"2024-09-13T17:08:48.976512+0000","last_became_peered":"2024-09-13T17:08:48.976512+0000","last_unstale":"2024-09-13T17:08:50.838173+0000","last_undegraded":"2024-09-13T17:08:50.838173+0000","last_fullsized":"2024-09-13T17:08:50.838173+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:25.498737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433389+0000","last_change":"2024-09-13T17:08:49.370163+0000","last_active":"2024-09-13T17:08:50.433389+0000","last_peered":"2024-09-13T17:08:50.433389+0000","last_clean":"2024-09-13T17:08:50.433389+0000","last_became_active":"2024-09-13T17:08:49.369921+0000","last_became_peered":"2024-09-13T17:08:49.369921+0000","last_unstale":"2024-09-13T17:08:50.433389+0000","last_undegraded":"2024-09-13T17:08:50.433389+0000","last_fullsized":"2024-09-13T17:08:50.433389+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:21.413430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.349246+0000","last_change":"2024-09-13T17:08:48.973965+0000","last_active":"2024-09-13T17:08:50.349246+0000","last_peered":"2024-09-13T17:08:50.349246+0000","last_clean":"2024-09-13T17:08:50.349246+0000","last_became_active":"2024-09-13T17:08:48.973437+0000","last_became_peered":"2024-09-13T17:08:48.973437+0000","last_unstale":"2024-09-13T17:08:50.349246+0000","last_undegraded":"2024-09-13T17:08:50.349246+0000","last_fullsized":"2024-09-13T17:08:50.349246+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:36.050598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838636+0000","last_change":"2024-09-13T17:08:49.363719+0000","last_active":"2024-09-13T17:08:50.838636+0000","last_peered":"2024-09-13T17:08:50.838636+0000","last_clean":"2024-09-13T17:08:50.838636+0000","last_became_active":"2024-09-13T17:08:49.363500+0000","last_became_peered":"2024-09-13T17:08:49.363500+0000","last_unstale":"2024-09-13T17:08:50.838636+0000","last_undegraded":"2024-09-13T17:08:50.838636+0000","last_fullsized":"2024-09-13T17:08:50.838636+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:26.531817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838386+0000","last_change":"2024-09-13T17:08:48.976663+0000","last_active":"2024-09-13T17:08:50.838386+0000","last_peered":"2024-09-13T17:08:50.838386+0000","last_clean":"2024-09-13T17:08:50.838386+0000","last_became_active":"2024-09-13T17:08:48.976386+0000","last_became_peered":"2024-09-13T17:08:48.976386+0000","last_unstale":"2024-09-13T17:08:50.838386+0000","last_undegraded":"2024-09-13T17:08:50.838386+0000","last_fullsized":"2024-09-13T17:08:50.838386+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:34.962771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837494+0000","last_change":"2024-09-13T17:08:49.360147+0000","last_active":"2024-09-13T17:08:50.837494+0000","last_peered":"2024-09-13T17:08:50.837494+0000","last_clean":"2024-09-13T17:08:50.837494+0000","last_became_active":"2024-09-13T17:08:49.358430+0000","last_became_peered":"2024-09-13T17:08:49.358430+0000","last_unstale":"2024-09-13T17:08:50.837494+0000","last_undegraded":"2024-09-13T17:08:50.837494+0000","last_fullsized":"2024-09-13T17:08:50.837494+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:43.022139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433128+0000","last_change":"2024-09-13T17:08:48.977123+0000","last_active":"2024-09-13T17:08:50.433128+0000","last_peered":"2024-09-13T17:08:50.433128+0000","last_clean":"2024-09-13T17:08:50.433128+0000","last_became_active":"2024-09-13T17:08:48.976877+0000","last_became_peered":"2024-09-13T17:08:48.976877+0000","last_unstale":"2024-09-13T17:08:50.433128+0000","last_undegraded":"2024-09-13T17:08:50.433128+0000","last_fullsized":"2024-09-13T17:08:50.433128+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:14.906722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433965+0000","last_change":"2024-09-13T17:08:49.364609+0000","last_active":"2024-09-13T17:08:50.433965+0000","last_peered":"2024-09-13T17:08:50.433965+0000","last_clean":"2024-09-13T17:08:50.433965+0000","last_became_active":"2024-09-13T17:08:49.364379+0000","last_became_peered":"2024-09-13T17:08:49.364379+0000","last_unstale":"2024-09-13T17:08:50.433965+0000","last_undegraded":"2024-09-13T17:08:50.433965+0000","last_fullsized":"2024-09-13T17:08:50.433965+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.075821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.839412+0000","last_change":"2024-09-13T17:08:48.977568+0000","last_active":"2024-09-13T17:08:50.839412+0000","last_peered":"2024-09-13T17:08:50.839412+0000","last_clean":"2024-09-13T17:08:50.839412+0000","last_became_active":"2024-09-13T17:08:48.977311+0000","last_became_peered":"2024-09-13T17:08:48.977311+0000","last_unstale":"2024-09-13T17:08:50.839412+0000","last_undegraded":"2024-09-13T17:08:50.839412+0000","last_fullsized":"2024-09-13T17:08:50.839412+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.988864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.434297+0000","last_change":"2024-09-13T17:08:49.362139+0000","last_active":"2024-09-13T17:08:50.434297+0000","last_peered":"2024-09-13T17:08:50.434297+0000","last_clean":"2024-09-13T17:08:50.434297+0000","last_became_active":"2024-09-13T17:08:49.361892+0000","last_became_peered":"2024-09-13T17:08:49.361892+0000","last_unstale":"2024-09-13T17:08:50.434297+0000","last_undegraded":"2024-09-13T17:08:50.434297+0000","last_fullsized":"2024-09-13T17:08:50.434297+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:50.351863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.839176+0000","last_change":"2024-09-13T17:08:48.974471+0000","last_active":"2024-09-13T17:08:50.839176+0000","last_peered":"2024-09-13T17:08:50.839176+0000","last_clean":"2024-09-13T17:08:50.839176+0000","last_became_active":"2024-09-13T17:08:48.974191+0000","last_became_peered":"2024-09-13T17:08:48.974191+0000","last_unstale":"2024-09-13T17:08:50.839176+0000","last_undegraded":"2024-09-13T17:08:50.839176+0000","last_fullsized":"2024-09-13T17:08:50.839176+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:40.072111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838846+0000","last_change":"2024-09-13T17:08:49.368387+0000","last_active":"2024-09-13T17:08:50.838846+0000","last_peered":"2024-09-13T17:08:50.838846+0000","last_clean":"2024-09-13T17:08:50.838846+0000","last_became_active":"2024-09-13T17:08:49.364953+0000","last_became_peered":"2024-09-13T17:08:49.364953+0000","last_unstale":"2024-09-13T17:08:50.838846+0000","last_undegraded":"2024-09-13T17:08:50.838846+0000","last_fullsized":"2024-09-13T17:08:50.838846+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:14.599546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837213+0000","last_change":"2024-09-13T17:08:48.973204+0000","last_active":"2024-09-13T17:08:50.837213+0000","last_peered":"2024-09-13T17:08:50.837213+0000","last_clean":"2024-09-13T17:08:50.837213+0000","last_became_active":"2024-09-13T17:08:48.972995+0000","last_became_peered":"2024-09-13T17:08:48.972995+0000","last_unstale":"2024-09-13T17:08:50.837213+0000","last_undegraded":"2024-09-13T17:08:50.837213+0000","last_fullsized":"2024-09-13T17:08:50.837213+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.988864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838750+0000","last_change":"2024-09-13T17:08:49.367985+0000","last_active":"2024-09-13T17:08:50.838750+0000","last_peered":"2024-09-13T17:08:50.838750+0000","last_clean":"2024-09-13T17:08:50.838750+0000","last_became_active":"2024-09-13T17:08:49.367764+0000","last_became_peered":"2024-09-13T17:08:49.367764+0000","last_unstale":"2024-09-13T17:08:50.838750+0000","last_undegraded":"2024-09-13T17:08:50.838750+0000","last_fullsized":"2024-09-13T17:08:50.838750+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:04.785090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.433970+0000","last_change":"2024-09-13T17:08:48.975753+0000","last_active":"2024-09-13T17:08:50.433970+0000","last_peered":"2024-09-13T17:08:50.433970+0000","last_clean":"2024-09-13T17:08:50.433970+0000","last_became_active":"2024-09-13T17:08:48.975516+0000","last_became_peered":"2024-09-13T17:08:48.975516+0000","last_unstale":"2024-09-13T17:08:50.433970+0000","last_undegraded":"2024-09-13T17:08:50.433970+0000","last_fullsized":"2024-09-13T17:08:50.433970+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:25.639744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348528+0000","last_change":"2024-09-13T17:08:49.371237+0000","last_active":"2024-09-13T17:08:50.348528+0000","last_peered":"2024-09-13T17:08:50.348528+0000","last_clean":"2024-09-13T17:08:50.348528+0000","last_became_active":"2024-09-13T17:08:49.370962+0000","last_became_peered":"2024-09-13T17:08:49.370962+0000","last_unstale":"2024-09-13T17:08:50.348528+0000","last_undegraded":"2024-09-13T17:08:50.348528+0000","last_fullsized":"2024-09-13T17:08:50.348528+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:39.945915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.838149+0000","last_change":"2024-09-13T17:08:48.977103+0000","last_active":"2024-09-13T17:08:50.838149+0000","last_peered":"2024-09-13T17:08:50.838149+0000","last_clean":"2024-09-13T17:08:50.838149+0000","last_became_active":"2024-09-13T17:08:48.976852+0000","last_became_peered":"2024-09-13T17:08:48.976852+0000","last_unstale":"2024-09-13T17:08:50.838149+0000","last_undegraded":"2024-09-13T17:08:50.838149+0000","last_fullsized":"2024-09-13T17:08:50.838149+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:02.729492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348540+0000","last_change":"2024-09-13T17:08:49.358235+0000","last_active":"2024-09-13T17:08:50.348540+0000","last_peered":"2024-09-13T17:08:50.348540+0000","last_clean":"2024-09-13T17:08:50.348540+0000","last_became_active":"2024-09-13T17:08:49.356984+0000","last_became_peered":"2024-09-13T17:08:49.356984+0000","last_unstale":"2024-09-13T17:08:50.348540+0000","last_undegraded":"2024-09-13T17:08:50.348540+0000","last_fullsized":"2024-09-13T17:08:50.348540+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:39.945915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837160+0000","last_change":"2024-09-13T17:08:48.972109+0000","last_active":"2024-09-13T17:08:50.837160+0000","last_peered":"2024-09-13T17:08:50.837160+0000","last_clean":"2024-09-13T17:08:50.837160+0000","last_became_active":"2024-09-13T17:08:48.971778+0000","last_became_peered":"2024-09-13T17:08:48.971778+0000","last_unstale":"2024-09-13T17:08:50.837160+0000","last_undegraded":"2024-09-13T17:08:50.837160+0000","last_fullsized":"2024-09-13T17:08:50.837160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:04.268137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837364+0000","last_change":"2024-09-13T17:08:49.368105+0000","last_active":"2024-09-13T17:08:50.837364+0000","last_peered":"2024-09-13T17:08:50.837364+0000","last_clean":"2024-09-13T17:08:50.837364+0000","last_became_active":"2024-09-13T17:08:49.367856+0000","last_became_peered":"2024-09-13T17:08:49.367856+0000","last_unstale":"2024-09-13T17:08:50.837364+0000","last_undegraded":"2024-09-13T17:08:50.837364+0000","last_fullsized":"2024-09-13T17:08:50.837364+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:16.733048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.837918+0000","last_change":"2024-09-13T17:08:48.980860+0000","last_active":"2024-09-13T17:08:50.837918+0000","last_peered":"2024-09-13T17:08:50.837918+0000","last_clean":"2024-09-13T17:08:50.837918+0000","last_became_active":"2024-09-13T17:08:48.980583+0000","last_became_peered":"2024-09-13T17:08:48.980583+0000","last_unstale":"2024-09-13T17:08:50.837918+0000","last_undegraded":"2024-09-13T17:08:50.837918+0000","last_fullsized":"2024-09-13T17:08:50.837918+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:07.996765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.348303+0000","last_change":"2024-09-13T17:08:49.366797+0000","last_active":"2024-09-13T17:08:50.348303+0000","last_peered":"2024-09-13T17:08:50.348303+0000","last_clean":"2024-09-13T17:08:50.348303+0000","last_became_active":"2024-09-13T17:08:49.366473+0000","last_became_peered":"2024-09-13T17:08:49.366473+0000","last_unstale":"2024-09-13T17:08:50.348303+0000","last_undegraded":"2024-09-13T17:08:50.348303+0000","last_fullsized":"2024-09-13T17:08:50.348303+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:01.192573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.347782+0000","last_change":"2024-09-13T17:08:48.982526+0000","last_active":"2024-09-13T17:08:50.347782+0000","last_peered":"2024-09-13T17:08:50.347782+0000","last_clean":"2024-09-13T17:08:50.347782+0000","last_became_active":"2024-09-13T17:08:48.982180+0000","last_became_peered":"2024-09-13T17:08:48.982180+0000","last_unstale":"2024-09-13T17:08:50.347782+0000","last_undegraded":"2024-09-13T17:08:50.347782+0000","last_fullsized":"2024-09-13T17:08:50.347782+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:25.498737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.347839+0000","last_change":"2024-09-13T17:08:49.369315+0000","last_active":"2024-09-13T17:08:50.347839+0000","last_peered":"2024-09-13T17:08:50.347839+0000","last_clean":"2024-09-13T17:08:50.347839+0000","last_became_active":"2024-09-13T17:08:49.369090+0000","last_became_peered":"2024-09-13T17:08:49.369090+0000","last_unstale":"2024-09-13T17:08:50.347839+0000","last_undegraded":"2024-09-13T17:08:50.347839+0000","last_fullsized":"2024-09-13T17:08:50.347839+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:48.948648+0000","last_clean_scrub_stamp":"2024-09-13T17:08:48.948648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:42.186958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T17:08:50.836773+0000","last_change":"2024-09-13T17:08:48.977623+0000","last_active":"2024-09-13T17:08:50.836773+0000","last_peered":"2024-09-13T17:08:50.836773+0000","last_clean":"2024-09-13T17:08:50.836773+0000","last_became_active":"2024-09-13T17:08:48.977282+0000","last_became_peered":"2024-09-13T17:08:48.977282+0000","last_unstale":"2024-09-13T17:08:50.836773+0000","last_undegraded":"2024-09-13T17:08:50.836773+0000","last_fullsized":"2024-09-13T17:08:50.836773+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:08:47.945317+0000","last_clean_scrub_stamp":"2024-09-13T17:08:47.945317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:52.151931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T17:08:49.345560+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:08:49.345560+0000","last_peered":"2024-09-13T17:08:49.345560+0000","last_clean":"2024-09-13T17:08:49.345560+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:08:49.345560+0000","last_undegraded":"2024-09-13T17:08:49.345560+0000","last_fullsized":"2024-09-13T17:08:49.345560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1323008,"data_stored":891587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85299999999999998,"15min":0.85499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90300000000000002,"15min":0.91400000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.98499999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91900000000000004,"15min":0.92500000000000004},"min":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.415,"5min":1.456,"15min":1.456},"last":1.3979999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.84999999999999998,"15min":0.84399999999999997},"min":{"1min":0.58899999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.88900000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.99399999999999999,"15min":1.0069999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.83699999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91900000000000004,"15min":0.91700000000000004},"min":{"1min":0.63100000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.208,"5min":1.288,"15min":1.288},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.98999999999999999,"15min":1},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.179}]},{"osd":4,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.90900000000000003,"15min":0.90400000000000003},"min":{"1min":0.65000000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.119,"15min":1.1240000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.302}]},{"osd":5,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0329999999999999,"15min":1.0389999999999999},"min":{"1min":0.69699999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.395,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.022,"15min":1.018},"min":{"1min":0.77200000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.149}]},{"osd":6,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.1140000000000001,"15min":1.1279999999999999},"min":{"1min":0.76600000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.405,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.1339999999999999,"15min":1.139},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.452,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.3580000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":720896,"data_stored":301059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.75600000000000001,"15min":0.754},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97799999999999998,"5min":1.024,"15min":1.024},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.872,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.27,"5min":1.431,"15min":1.431},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91600000000000004,"15min":0.92400000000000004},"min":{"1min":0.60399999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.161,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.747},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91400000000000003,"15min":0.91200000000000003},"min":{"1min":0.64300000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.179,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.89100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.60799999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1459999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.96599999999999997,"15min":0.98199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1379999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.1679999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.96099999999999997,"15min":0.97799999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.0700000000000001,"5min":1.359,"15min":1.359},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0509999999999999,"15min":1.054},"min":{"1min":0.79900000000000004,"5min":0.749,"15min":0.749},"max":{"1min":1.262,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.92400000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.90700000000000003,"15min":0.90900000000000003},"min":{"1min":0.626,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0209999999999999,"15min":1.024},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.2070000000000001,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0169999999999999,"15min":1.0189999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.069,"15min":1.073},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.264,"5min":1.597,"15min":1.597},"last":1.085}]},{"osd":7,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1060000000000001,"15min":1.109},"min":{"1min":0.79900000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3360000000000001,"5min":1.728,"15min":1.728},"last":1.115},{"interface":"front","average":{"1min":1.131,"5min":1.1870000000000001,"15min":1.1970000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.518,"5min":2.194,"15min":2.194},"last":1.0609999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":301711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.86399999999999999,"15min":0.872},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1339999999999999,"5min":1.395,"15min":1.395},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.879,"15min":0.88800000000000001},"min":{"1min":0.56999999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.94999999999999996,"15min":0.95799999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.339,"5min":1.508,"15min":1.508},"last":1.004},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.622,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.0669999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84899999999999998,"15min":0.85199999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.137,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.91200000000000003,"15min":0.92100000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2370000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.84199999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.98599999999999999,"15min":1.004},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.377,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91700000000000004,"15min":0.93000000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.272,"5min":1.603,"15min":1.603},"last":0.94099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.044,"15min":1.0660000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1180000000000001,"5min":1.466,"15min":1.466},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":1.0189999999999999,"15min":1.038},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2090000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.748}]},{"osd":6,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.0549999999999999,"15min":1.071},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.347,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.04,"5min":1.171,"15min":1.1930000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.248,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.98199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.1299999999999999,"15min":1.1479999999999999},"min":{"1min":0.78500000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5269999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.1930000000000001,"15min":1.2130000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.4530000000000001,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.042}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":302623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.82299999999999995,"15min":0.83599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0589999999999999,"5min":1.306,"15min":1.306},"last":1.028}]},{"osd":1,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91000000000000003,"15min":0.90900000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.29,"5min":1.357,"15min":1.357},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.99099999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88900000000000001,"15min":0.88300000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.92400000000000004,"15min":0.91000000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.101}]},{"osd":3,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.91200000000000003,"15min":0.92200000000000004},"min":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1990000000000001,"5min":1.464,"15min":1.464},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.89300000000000002,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.88200000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.94999999999999996,"15min":0.94099999999999995},"min":{"1min":0.63600000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0640000000000001,"15min":1.0620000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.1379999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.96899999999999997,"15min":0.97299999999999998},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.208,"5min":1.26,"15min":1.26},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.048,"15min":1.044},"min":{"1min":0.77000000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.169}]},{"osd":7,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.083,"15min":1.085},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.4119999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.129,"15min":1.127},"min":{"1min":0.93000000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":1.0640000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":729088,"data_stored":301115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75800000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.33600000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.82799999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.373}]},{"osd":1,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83899999999999997,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.56399999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96599999999999997,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.76200000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.51800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.96199999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91700000000000004,"15min":0.92400000000000004},"min":{"1min":0.66500000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1759999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.876,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.73699999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.0149999999999999,"5min":1.899,"15min":1.899},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.91700000000000004,"15min":0.92900000000000005},"min":{"1min":0.59499999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.94399999999999995,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.99399999999999999,"15min":0.996},"min":{"1min":0.72699999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.337,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.628}]},{"osd":6,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.018,"15min":1.024},"min":{"1min":0.754,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.157,"5min":1.635,"15min":1.635},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.028,"15min":1.044},"min":{"1min":0.71499999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1970000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.085,"15min":1.093},"min":{"1min":0.746,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.288,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.78700000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2549999999999999,"5min":1.756,"15min":1.756},"last":0.64200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":301115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.628,"15min":0.63500000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.86199999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.76600000000000001,"15min":0.77900000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.038,"5min":1.103,"15min":1.103},"last":0.92100000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.93600000000000005,"15min":0.94499999999999995},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2190000000000001,"5min":1.3,"15min":1.3},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92900000000000005,"15min":0.92700000000000005},"min":{"1min":0.748,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.877}]},{"osd":5,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.95499999999999996,"15min":0.95799999999999996},"min":{"1min":0.76300000000000001,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.92000000000000004,"15min":0.91600000000000004},"min":{"1min":0.70799999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.67000000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.194,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.999,"15min":0.99199999999999999},"min":{"1min":0.82699999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.2250000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0529999999999999,"15min":1.0609999999999999},"min":{"1min":0.78600000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.998,"5min":1.03,"15min":1.0349999999999999},"min":{"1min":0.73599999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.268,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.94699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":301149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.48899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.873,"5min":1.151,"15min":1.151},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65900000000000003,"15min":0.66900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86699999999999999,"5min":1.306,"15min":1.306},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.752,"15min":0.755},"min":{"1min":0.38800000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.98399999999999999,"5min":1.28,"15min":1.28},"last":0.82199999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.437,"5min":0.308,"15min":0.308},"max":{"1min":1.0149999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0269999999999999,"5min":1.905,"15min":1.905},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.96099999999999997,"15min":0.96599999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3580000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.026,"15min":1.0389999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.202,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.88500000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0669999999999999,"15min":1.0780000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3140000000000001,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.107,"15min":1.119},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.377,"5min":1.556,"15min":1.556},"last":0.91100000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0700000000000001,"15min":1.0820000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4530000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1339999999999999,"15min":1.1439999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4199999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.054}]},{"osd":7,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.1539999999999999,"15min":1.165},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3839999999999999,"5min":1.712,"15min":1.712},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.095,"15min":1.101},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5720000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.022}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1331200,"data_stored":893573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.38400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.99399999999999999,"5min":3.25,"15min":3.25},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.80700000000000005,"15min":0.81999999999999995},"min":{"1min":0.53100000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95599999999999996,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.91800000000000004,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.85999999999999999,"15min":0.89000000000000001},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.999,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.84599999999999997,"15min":0.874},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96299999999999997,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":1.016},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.94499999999999995,"15min":0.97099999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.333,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.88400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.012,"15min":1.0329999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5289999999999999,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0449999999999999,"15min":1.0620000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.4239999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":1.379}]},{"osd":5,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.069,"15min":1.083},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.421,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.091},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.091,"15min":1.1180000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.222,"5min":5.399,"15min":5.399},"last":1.3049999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.143,"15min":1.161},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.482,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.032,"5min":1.111,"15min":1.1240000000000001},"min":{"1min":0.79100000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3720000000000001,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.3360000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.127,"15min":1.135},"min":{"1min":0.76200000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6379999999999999,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.419},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.202,"15min":1.23},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5760000000000001,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":1.2}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:08:53.742 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:08:53.742 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T17:08:53.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f93fff700 1 Processor -- start 2024-09-13T17:08:53.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f93fff700 1 -- start start 2024-09-13T17:08:53.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f93fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6f8c00ce60 0x7f6f8c0085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f93fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c007760 con 0x7f6f8c053910 2024-09-13T17:08:53.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f93fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c007a40 con 0x7f6f8c0e2b90 2024-09-13T17:08:53.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f93fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c0557a0 con 0x7f6f8c00ce60 2024-09-13T17:08:53.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f927fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6f8c053910 0x7f6f8c007ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44312/0 (socket says 172.21.15.123:44312) 2024-09-13T17:08:53.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f927fc700 1 -- 172.21.15.123:0/320117228 learned_addr learned my addr 172.21.15.123:0/320117228 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:53.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f937fe700 1 --2- 172.21.15.123:0/320117228 >> v2:172.21.15.153:3300/0 conn(0x7f6f8c00ce60 0x7f6f8c0085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041746124 0 0) 0x7f6f8c007760 con 0x7f6f8c053910 2024-09-13T17:08:53.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f800035d0 con 0x7f6f8c053910 2024-09-13T17:08:53.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466170434 0 0) 0x7f6f8c007a40 con 0x7f6f8c0e2b90 2024-09-13T17:08:53.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f8c007760 con 0x7f6f8c0e2b90 2024-09-13T17:08:53.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4262969645 0 0) 0x7f6f800035d0 con 0x7f6f8c053910 2024-09-13T17:08:53.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 >> v2:172.21.15.153:3300/0 conn(0x7f6f8c00ce60 msgr2=0x7f6f8c0085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:53.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 --2- 172.21.15.123:0/320117228 >> v2:172.21.15.153:3300/0 conn(0x7f6f8c00ce60 0x7f6f8c0085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 >> v1:172.21.15.153:6789/0 conn(0x7f6f8c0e2b90 legacy=0x7f6f8c053200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c055a80 con 0x7f6f8c053910 2024-09-13T17:08:53.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f6f84001670 con 0x7f6f8c053910 2024-09-13T17:08:53.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 >> v1:172.21.15.123:6789/0 conn(0x7f6f8c053910 legacy=0x7f6f8c007ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 --2- 172.21.15.123:0/320117228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f80003c00 0x7f6f80004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 --2- 172.21.15.123:0/320117228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f80004870 0x7f6f80004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 --2- 172.21.15.123:0/320117228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f80005280 0x7f6f8000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0557a0 con 0x7f6f80003c00 2024-09-13T17:08:53.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8000c1b0 con 0x7f6f80004870 2024-09-13T17:08:53.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8000c370 con 0x7f6f80005280 2024-09-13T17:08:53.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.863+0000 7f6f92ffd700 1 --2- 172.21.15.123:0/320117228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f80003c00 0x7f6f80004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f927fc700 1 --2- 172.21.15.123:0/320117228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f80004870 0x7f6f80004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f92ffd700 1 -- 172.21.15.123:0/320117228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f80005280 msgr2=0x7f6f8000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:53.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f92ffd700 1 --2- 172.21.15.123:0/320117228 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f80005280 0x7f6f8000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f92ffd700 1 -- 172.21.15.123:0/320117228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f80004870 msgr2=0x7f6f80004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:53.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f92ffd700 1 --2- 172.21.15.123:0/320117228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f80004870 0x7f6f80004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f92ffd700 1 -- 172.21.15.123:0/320117228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f800035d0 con 0x7f6f80003c00 2024-09-13T17:08:53.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f937fe700 1 -- 172.21.15.123:0/320117228 reap_dead start 2024-09-13T17:08:53.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f92ffd700 1 --2- 172.21.15.123:0/320117228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f80003c00 0x7f6f80004000 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c007fd0 tx=0x7f6f800058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b112b483c52e48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:53.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c001450 con 0x7f6f80003c00 2024-09-13T17:08:53.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c006aa0 con 0x7f6f80003c00 2024-09-13T17:08:53.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f91ffb700 1 -- 172.21.15.123:0/320117228 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c006e50 con 0x7f6f80003c00 2024-09-13T17:08:53.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 -- 172.21.15.123:0/320117228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f80003c00 msgr2=0x7f6f80004000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 --2- 172.21.15.123:0/320117228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f80003c00 0x7f6f80004000 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c007fd0 tx=0x7f6f800058a0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 -- 172.21.15.123:0/320117228 shutdown_connections 2024-09-13T17:08:53.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 --2- 172.21.15.123:0/320117228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f80003c00 0x7f6f80004000 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 -- 172.21.15.123:0/320117228 >> 172.21.15.123:0/320117228 conn(0x7f6f8c01fbf0 msgr2=0x7f6f8c056860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:53.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 -- 172.21.15.123:0/320117228 shutdown_connections 2024-09-13T17:08:53.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 -- 172.21.15.123:0/320117228 wait complete. 2024-09-13T17:08:53.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 Processor -- start 2024-09-13T17:08:53.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 -- start start 2024-09-13T17:08:53.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f80003c00 0x7f6f8c039690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f8c0df080 0x7f6f8c050050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f8c0e3300 0x7f6f8c0e3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c050590 con 0x7f6f8c0df080 2024-09-13T17:08:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c039c70 con 0x7f6f8c0e3300 2024-09-13T17:08:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.867+0000 7f6f93fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c039f50 con 0x7f6f80003c00 2024-09-13T17:08:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f927fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f8c0df080 0x7f6f8c050050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f92ffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f80003c00 0x7f6f8c039690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f92ffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f80003c00 0x7f6f8c039690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:60522/0 (socket says 172.21.15.123:60522) 2024-09-13T17:08:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f937fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f8c0e3300 0x7f6f8c0e3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f92ffd700 1 -- 172.21.15.123:0/3012217371 learned_addr learned my addr 172.21.15.123:0/3012217371 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f927fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f8c0df080 0x7f6f8c050050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41590/0 (socket says 172.21.15.123:41590) 2024-09-13T17:08:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f927fc700 1 -- 172.21.15.123:0/3012217371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f80003c00 msgr2=0x7f6f8c039690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f927fc700 1 --2- 172.21.15.123:0/3012217371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f80003c00 0x7f6f8c039690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f927fc700 1 -- 172.21.15.123:0/3012217371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f8c0e3300 msgr2=0x7f6f8c0e3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f927fc700 1 --2- 172.21.15.123:0/3012217371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f8c0e3300 0x7f6f8c0e3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f927fc700 1 -- 172.21.15.123:0/3012217371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c03a230 con 0x7f6f8c0df080 2024-09-13T17:08:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f937fe700 1 --2- 172.21.15.123:0/3012217371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f8c0e3300 0x7f6f8c0e3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:53.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f927fc700 1 --2- 172.21.15.123:0/3012217371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f8c0df080 0x7f6f8c050050 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400e790 tx=0x7f6f8400eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:53.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f8b7fe700 1 -- 172.21.15.123:0/3012217371 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84014480 con 0x7f6f8c0df080 2024-09-13T17:08:53.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f8b7fe700 1 -- 172.21.15.123:0/3012217371 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f840145e0 con 0x7f6f8c0df080 2024-09-13T17:08:53.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f93fff700 1 -- 172.21.15.123:0/3012217371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c03a510 con 0x7f6f8c0df080 2024-09-13T17:08:53.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f8b7fe700 1 -- 172.21.15.123:0/3012217371 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84014990 con 0x7f6f8c0df080 2024-09-13T17:08:53.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f93fff700 1 -- 172.21.15.123:0/3012217371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c0df4e0 con 0x7f6f8c0df080 2024-09-13T17:08:53.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.871+0000 7f6f93fff700 1 -- 172.21.15.123:0/3012217371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f78005310 con 0x7f6f8c0df080 2024-09-13T17:08:53.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.875+0000 7f6f8b7fe700 1 -- 172.21.15.123:0/3012217371 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6f840114f0 con 0x7f6f8c0df080 2024-09-13T17:08:53.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.875+0000 7f6f8b7fe700 1 --2- 172.21.15.123:0/3012217371 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f74066760 0x7f6f74068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:53.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.875+0000 7f6f92ffd700 1 --2- 172.21.15.123:0/3012217371 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f74066760 0x7f6f74068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:53.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.875+0000 7f6f8b7fe700 1 -- 172.21.15.123:0/3012217371 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f84083910 con 0x7f6f8c0df080 2024-09-13T17:08:53.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.875+0000 7f6f92ffd700 1 --2- 172.21.15.123:0/3012217371 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f74066760 0x7f6f74068c20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c015040 tx=0x7f6f7c005040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:53.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:53.883+0000 7f6f8b7fe700 1 -- 172.21.15.123:0/3012217371 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6f84050c10 con 0x7f6f8c0df080 2024-09-13T17:08:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.115+0000 7f6f93fff700 1 -- 172.21.15.123:0/3012217371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6f780055c0 con 0x7f6f8c0df080 2024-09-13T17:08:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.119+0000 7f6f8b7fe700 1 -- 172.21.15.123:0/3012217371 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6f84019030 con 0x7f6f8c0df080 2024-09-13T17:08:54.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.123+0000 7f6f93fff700 1 -- 172.21.15.123:0/3012217371 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f74066760 msgr2=0x7f6f74068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:54.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.123+0000 7f6f93fff700 1 --2- 172.21.15.123:0/3012217371 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f74066760 0x7f6f74068c20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c015040 tx=0x7f6f7c005040 comp rx=0 tx=0).stop 2024-09-13T17:08:54.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.123+0000 7f6f93fff700 1 -- 172.21.15.123:0/3012217371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f8c0df080 msgr2=0x7f6f8c050050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:54.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.123+0000 7f6f93fff700 1 --2- 172.21.15.123:0/3012217371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f8c0df080 0x7f6f8c050050 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400e790 tx=0x7f6f8400eaa0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.123+0000 7f6f93fff700 1 -- 172.21.15.123:0/3012217371 shutdown_connections 2024-09-13T17:08:54.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.123+0000 7f6f93fff700 1 --2- 172.21.15.123:0/3012217371 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f74066760 0x7f6f74068c20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.123+0000 7f6f93fff700 1 --2- 172.21.15.123:0/3012217371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f8c0e3300 0x7f6f8c0e3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.123+0000 7f6f93fff700 1 --2- 172.21.15.123:0/3012217371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f8c0df080 0x7f6f8c050050 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.123+0000 7f6f93fff700 1 --2- 172.21.15.123:0/3012217371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f80003c00 0x7f6f8c039690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.123+0000 7f6f93fff700 1 -- 172.21.15.123:0/3012217371 >> 172.21.15.123:0/3012217371 conn(0x7f6f8c01fbf0 msgr2=0x7f6f8c005090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:54.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.123+0000 7f6f93fff700 1 -- 172.21.15.123:0/3012217371 shutdown_connections 2024-09-13T17:08:54.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.123+0000 7f6f93fff700 1 -- 172.21.15.123:0/3012217371 wait complete. 2024-09-13T17:08:54.129 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-13T17:08:54.142 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:08:54.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.251+0000 7f02e8195700 1 Processor -- start 2024-09-13T17:08:54.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.251+0000 7f02e8195700 1 -- start start 2024-09-13T17:08:54.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.251+0000 7f02e8195700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02e015cee0 0x7f02e00d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:54.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.251+0000 7f02e8195700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f02e00af8f0 0x7f02e00cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.251+0000 7f02e8195700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f02e00d0f00 0x7f02e00cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.251+0000 7f02e8195700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e00cdbe0 con 0x7f02e00d0f00 2024-09-13T17:08:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.251+0000 7f02e8195700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e00d1720 con 0x7f02e00af8f0 2024-09-13T17:08:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.251+0000 7f02e8195700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00d1a00 con 0x7f02e015cee0 2024-09-13T17:08:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e6732700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f02e00d0f00 0x7f02e00cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e5730700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f02e00af8f0 0x7f02e00cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e5730700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f02e00af8f0 0x7f02e00cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:47662/0 (socket says 172.21.15.123:47662) 2024-09-13T17:08:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e5730700 1 -- 172.21.15.123:0/2440743518 learned_addr learned my addr 172.21.15.123:0/2440743518 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e5f31700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02e015cee0 0x7f02e00d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e6732700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f02e00d0f00 0x7f02e00cfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41600/0 (socket says 172.21.15.123:41600) 2024-09-13T17:08:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e6732700 1 -- 172.21.15.123:0/2440743518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02e015cee0 msgr2=0x7f02e00d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e6732700 1 --2- 172.21.15.123:0/2440743518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02e015cee0 0x7f02e00d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e6732700 1 -- 172.21.15.123:0/2440743518 >> v2:172.21.15.153:3300/0 conn(0x7f02e00af8f0 msgr2=0x7f02e00cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:54.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e6732700 1 --2- 172.21.15.123:0/2440743518 >> v2:172.21.15.153:3300/0 conn(0x7f02e00af8f0 0x7f02e00cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e6732700 1 -- 172.21.15.123:0/2440743518 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e00d1ce0 con 0x7f02e00d0f00 2024-09-13T17:08:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e5730700 1 --2- 172.21.15.123:0/2440743518 >> v2:172.21.15.153:3300/0 conn(0x7f02e00af8f0 0x7f02e00cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e6732700 1 --2- 172.21.15.123:0/2440743518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e00d0f00 0x7f02e00cfcb0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f02e006f9e0 tx=0x7f02d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d31a7c1d95d73b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e4f2f700 1 -- 172.21.15.123:0/2440743518 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8011830 con 0x7f02e00d0f00 2024-09-13T17:08:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e4f2f700 1 -- 172.21.15.123:0/2440743518 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d8011990 con 0x7f02e00d0f00 2024-09-13T17:08:54.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e4f2f700 1 -- 172.21.15.123:0/2440743518 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8011d20 con 0x7f02e00d0f00 2024-09-13T17:08:54.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e8195700 1 -- 172.21.15.123:0/2440743518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e00d0f00 msgr2=0x7f02e00cfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:54.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e8195700 1 --2- 172.21.15.123:0/2440743518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e00d0f00 0x7f02e00cfcb0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f02e006f9e0 tx=0x7f02d8009b30 comp rx=0 tx=0).stop 2024-09-13T17:08:54.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e8195700 1 -- 172.21.15.123:0/2440743518 shutdown_connections 2024-09-13T17:08:54.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e8195700 1 --2- 172.21.15.123:0/2440743518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e00d0f00 0x7f02e00cfcb0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e8195700 1 --2- 172.21.15.123:0/2440743518 >> v2:172.21.15.153:3300/0 conn(0x7f02e00af8f0 0x7f02e00cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e8195700 1 --2- 172.21.15.123:0/2440743518 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02e015cee0 0x7f02e00d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e8195700 1 -- 172.21.15.123:0/2440743518 >> 172.21.15.123:0/2440743518 conn(0x7f02e00d2df0 msgr2=0x7f02e00d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:54.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e8195700 1 -- 172.21.15.123:0/2440743518 shutdown_connections 2024-09-13T17:08:54.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.255+0000 7f02e8195700 1 -- 172.21.15.123:0/2440743518 wait complete. 2024-09-13T17:08:54.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e8195700 1 Processor -- start 2024-09-13T17:08:54.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e8195700 1 -- start start 2024-09-13T17:08:54.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e8195700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02e00af8f0 0x7f02e01f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:54.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e8195700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02e00d0f00 0x7f02e01f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:54.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e8195700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e015cee0 0x7f02e00b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:54.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e8195700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e01f6280 con 0x7f02e015cee0 2024-09-13T17:08:54.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e8195700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00cc3a0 con 0x7f02e00d0f00 2024-09-13T17:08:54.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e8195700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e01f2a70 con 0x7f02e00af8f0 2024-09-13T17:08:54.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e6732700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e015cee0 0x7f02e00b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:54.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e6732700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e015cee0 0x7f02e00b8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41612/0 (socket says 172.21.15.123:41612) 2024-09-13T17:08:54.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e5730700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02e00d0f00 0x7f02e01f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:54.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e6732700 1 -- 172.21.15.123:0/2628828639 learned_addr learned my addr 172.21.15.123:0/2628828639 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:54.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e5f31700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02e00af8f0 0x7f02e01f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:54.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e6732700 1 -- 172.21.15.123:0/2628828639 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02e00af8f0 msgr2=0x7f02e01f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:54.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e6732700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02e00af8f0 0x7f02e01f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e6732700 1 -- 172.21.15.123:0/2628828639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02e00d0f00 msgr2=0x7f02e01f3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:54.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e6732700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02e00d0f00 0x7f02e01f3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e6732700 1 -- 172.21.15.123:0/2628828639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d0009b30 con 0x7f02e015cee0 2024-09-13T17:08:54.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e5730700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02e00d0f00 0x7f02e01f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:54.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e6732700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e015cee0 0x7f02e00b8110 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009b70 tx=0x7f02d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:54.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02de7fc700 1 -- 172.21.15.123:0/2628828639 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8004240 con 0x7f02e015cee0 2024-09-13T17:08:54.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02de7fc700 1 -- 172.21.15.123:0/2628828639 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d801f070 con 0x7f02e015cee0 2024-09-13T17:08:54.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e8195700 1 -- 172.21.15.123:0/2628828639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d80094b0 con 0x7f02e015cee0 2024-09-13T17:08:54.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02de7fc700 1 -- 172.21.15.123:0/2628828639 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80045e0 con 0x7f02e015cee0 2024-09-13T17:08:54.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.259+0000 7f02e8195700 1 -- 172.21.15.123:0/2628828639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e01f3030 con 0x7f02e015cee0 2024-09-13T17:08:54.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.263+0000 7f02e8195700 1 -- 172.21.15.123:0/2628828639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e00677f0 con 0x7f02e015cee0 2024-09-13T17:08:54.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.263+0000 7f02de7fc700 1 -- 172.21.15.123:0/2628828639 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f02d8021030 con 0x7f02e015cee0 2024-09-13T17:08:54.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.263+0000 7f02de7fc700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f02cc066730 0x7f02cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:54.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.263+0000 7f02de7fc700 1 -- 172.21.15.123:0/2628828639 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02d8085180 con 0x7f02e015cee0 2024-09-13T17:08:54.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.263+0000 7f02e5f31700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f02cc066730 0x7f02cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:54.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.267+0000 7f02e5f31700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f02cc066730 0x7f02cc068bf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009b50 tx=0x7f02d4009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:54.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.271+0000 7f02de7fc700 1 -- 172.21.15.123:0/2628828639 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f02d8052580 con 0x7f02e015cee0 2024-09-13T17:08:54.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.471+0000 7f02e8195700 1 -- 172.21.15.123:0/2628828639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02e01f3220 con 0x7f02e015cee0 2024-09-13T17:08:54.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.475+0000 7f02de7fc700 1 -- 172.21.15.123:0/2628828639 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4746 (secure 0 0 0) 0x7f02d8055ba0 con 0x7f02e015cee0 2024-09-13T17:08:54.478 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:08:54.479 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2493352744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2493352744},{"type":"v1","addr":"172.21.15.153:6833","nonce":2493352744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3030199256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3030199256},{"type":"v1","addr":"172.21.15.153:6835","nonce":3030199256}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":6120,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2341008668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2341008668},{"type":"v1","addr":"172.21.15.123:6835","nonce":2341008668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:08:49.337652+0000","modified":"2024-09-13T17:08:52.352454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6126},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6126":{"gid":6126,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2270367518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2270367518},{"type":"v1","addr":"172.21.15.123:6837","nonce":2270367518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T17:08:54.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.475+0000 7f02e8195700 1 -- 172.21.15.123:0/2628828639 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f02cc066730 msgr2=0x7f02cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:54.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.475+0000 7f02e8195700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f02cc066730 0x7f02cc068bf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009b50 tx=0x7f02d4009240 comp rx=0 tx=0).stop 2024-09-13T17:08:54.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.475+0000 7f02e8195700 1 -- 172.21.15.123:0/2628828639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e015cee0 msgr2=0x7f02e00b8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:54.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.475+0000 7f02e8195700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e015cee0 0x7f02e00b8110 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009b70 tx=0x7f02d8004770 comp rx=0 tx=0).stop 2024-09-13T17:08:54.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.475+0000 7f02e8195700 1 -- 172.21.15.123:0/2628828639 shutdown_connections 2024-09-13T17:08:54.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.475+0000 7f02e8195700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f02cc066730 0x7f02cc068bf0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.475+0000 7f02e8195700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e015cee0 0x7f02e00b8110 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.475+0000 7f02e8195700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02e00d0f00 0x7f02e01f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.475+0000 7f02e8195700 1 --2- 172.21.15.123:0/2628828639 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02e00af8f0 0x7f02e01f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:54.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.475+0000 7f02e8195700 1 -- 172.21.15.123:0/2628828639 >> 172.21.15.123:0/2628828639 conn(0x7f02e00d2df0 msgr2=0x7f02e00d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:54.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.475+0000 7f02e8195700 1 -- 172.21.15.123:0/2628828639 shutdown_connections 2024-09-13T17:08:54.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:54.475+0000 7f02e8195700 1 -- 172.21.15.123:0/2628828639 wait complete. 2024-09-13T17:08:54.482 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 28 2024-09-13T17:08:54.902 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:08:49.337652+0000', 'modified': '2024-09-13T17:08:52.352454+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6126}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6126': {'gid': 6126, 'name': 'c', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6837/2270367518', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6836', 'nonce': 2270367518}, {'type': 'v1', 'addr': '172.21.15.123:6837', 'nonce': 2270367518}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:08:54.902 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:08:54.902 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T17:08:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.019+0000 7f3e236eb700 1 Processor -- start 2024-09-13T17:08:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.019+0000 7f3e236eb700 1 -- start start 2024-09-13T17:08:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.019+0000 7f3e236eb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3e1c153480 0x7f3e1c0ae280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.019+0000 7f3e236eb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e1c0c95e0 0x7f3e1c0cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.019+0000 7f3e236eb700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1c0aebf0 con 0x7f3e1c159750 2024-09-13T17:08:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.019+0000 7f3e236eb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1c0aeed0 con 0x7f3e1c153480 2024-09-13T17:08:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.019+0000 7f3e236eb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c0af1b0 con 0x7f3e1c0c95e0 2024-09-13T17:08:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e20c86700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3e1c159750 0x7f3e1c0c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44320/0 (socket says 172.21.15.123:44320) 2024-09-13T17:08:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e20c86700 1 -- 172.21.15.123:0/3961507013 learned_addr learned my addr 172.21.15.123:0/3961507013 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e21c88700 1 --2- 172.21.15.123:0/3961507013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e1c0c95e0 0x7f3e1c0cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e21487700 1 --2- 172.21.15.123:0/3961507013 >> v2:172.21.15.153:3300/0 conn(0x7f3e1c153480 0x7f3e1c0ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e13fff700 1 -- 172.21.15.123:0/3961507013 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696303626 0 0) 0x7f3e1c0aebf0 con 0x7f3e1c159750 2024-09-13T17:08:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e13fff700 1 -- 172.21.15.123:0/3961507013 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e080035d0 con 0x7f3e1c159750 2024-09-13T17:08:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e21c88700 1 -- 172.21.15.123:0/3961507013 >> v2:172.21.15.153:3300/0 conn(0x7f3e1c153480 msgr2=0x7f3e1c0ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e21c88700 1 --2- 172.21.15.123:0/3961507013 >> v2:172.21.15.153:3300/0 conn(0x7f3e1c153480 0x7f3e1c0ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e21c88700 1 -- 172.21.15.123:0/3961507013 >> v1:172.21.15.123:6789/0 conn(0x7f3e1c159750 legacy=0x7f3e1c0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e21c88700 1 -- 172.21.15.123:0/3961507013 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c0af490 con 0x7f3e1c0c95e0 2024-09-13T17:08:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e21c88700 1 --2- 172.21.15.123:0/3961507013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e1c0c95e0 0x7f3e1c0cc450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009850 tx=0x7f3e14009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fffe4dd3215e301 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e13fff700 1 -- 172.21.15.123:0/3961507013 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14011830 con 0x7f3e1c0c95e0 2024-09-13T17:08:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e13fff700 1 -- 172.21.15.123:0/3961507013 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e14011990 con 0x7f3e1c0c95e0 2024-09-13T17:08:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e13fff700 1 -- 172.21.15.123:0/3961507013 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14011d00 con 0x7f3e1c0c95e0 2024-09-13T17:08:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e236eb700 1 -- 172.21.15.123:0/3961507013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e1c0c95e0 msgr2=0x7f3e1c0cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e236eb700 1 --2- 172.21.15.123:0/3961507013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e1c0c95e0 0x7f3e1c0cc450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009850 tx=0x7f3e14009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e236eb700 1 -- 172.21.15.123:0/3961507013 shutdown_connections 2024-09-13T17:08:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e236eb700 1 --2- 172.21.15.123:0/3961507013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e1c0c95e0 0x7f3e1c0cc450 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e236eb700 1 --2- 172.21.15.123:0/3961507013 >> v2:172.21.15.153:3300/0 conn(0x7f3e1c153480 0x7f3e1c0ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e236eb700 1 -- 172.21.15.123:0/3961507013 >> 172.21.15.123:0/3961507013 conn(0x7f3e1c0b0450 msgr2=0x7f3e1c0b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e236eb700 1 -- 172.21.15.123:0/3961507013 shutdown_connections 2024-09-13T17:08:55.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.023+0000 7f3e236eb700 1 -- 172.21.15.123:0/3961507013 wait complete. 2024-09-13T17:08:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.027+0000 7f3e236eb700 1 Processor -- start 2024-09-13T17:08:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.027+0000 7f3e236eb700 1 -- start start 2024-09-13T17:08:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e236eb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e1c0c95e0 0x7f3e1c0b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e236eb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e1c153480 0x7f3e1c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e236eb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e1c159750 0x7f3e1c0c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e236eb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c0c5950 con 0x7f3e1c153480 2024-09-13T17:08:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e236eb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c0c5b60 con 0x7f3e1c0c95e0 2024-09-13T17:08:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e236eb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c0c5e40 con 0x7f3e1c159750 2024-09-13T17:08:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e20c86700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e1c153480 0x7f3e1c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e20c86700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e1c153480 0x7f3e1c0b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41622/0 (socket says 172.21.15.123:41622) 2024-09-13T17:08:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e20c86700 1 -- 172.21.15.123:0/1865056948 learned_addr learned my addr 172.21.15.123:0/1865056948 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e21487700 1 --2- 172.21.15.123:0/1865056948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e1c0c95e0 0x7f3e1c0b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e21c88700 1 --2- 172.21.15.123:0/1865056948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e1c159750 0x7f3e1c0c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e20c86700 1 -- 172.21.15.123:0/1865056948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e1c159750 msgr2=0x7f3e1c0c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e20c86700 1 --2- 172.21.15.123:0/1865056948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e1c159750 0x7f3e1c0c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e20c86700 1 -- 172.21.15.123:0/1865056948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e1c0c95e0 msgr2=0x7f3e1c0b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e20c86700 1 --2- 172.21.15.123:0/1865056948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e1c0c95e0 0x7f3e1c0b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e20c86700 1 -- 172.21.15.123:0/1865056948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e140094b0 con 0x7f3e1c153480 2024-09-13T17:08:55.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e20c86700 1 --2- 172.21.15.123:0/1865056948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e1c153480 0x7f3e1c0b1890 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800cb40 tx=0x7f3e1800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:55.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e11ffb700 1 -- 172.21.15.123:0/1865056948 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18007500 con 0x7f3e1c153480 2024-09-13T17:08:55.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e11ffb700 1 -- 172.21.15.123:0/1865056948 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e18007660 con 0x7f3e1c153480 2024-09-13T17:08:55.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e236eb700 1 -- 172.21.15.123:0/1865056948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1c0c6120 con 0x7f3e1c153480 2024-09-13T17:08:55.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e11ffb700 1 -- 172.21.15.123:0/1865056948 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e180079f0 con 0x7f3e1c153480 2024-09-13T17:08:55.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.031+0000 7f3e236eb700 1 -- 172.21.15.123:0/1865056948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c0b4330 con 0x7f3e1c153480 2024-09-13T17:08:55.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.035+0000 7f3e11ffb700 1 -- 172.21.15.123:0/1865056948 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e1801b3b0 con 0x7f3e1c153480 2024-09-13T17:08:55.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.035+0000 7f3e11ffb700 1 --2- 172.21.15.123:0/1865056948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e00066730 0x7f3e00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.035+0000 7f3e11ffb700 1 -- 172.21.15.123:0/1865056948 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e18083af0 con 0x7f3e1c153480 2024-09-13T17:08:55.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.035+0000 7f3e21487700 1 --2- 172.21.15.123:0/1865056948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e00066730 0x7f3e00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.035+0000 7f3e21487700 1 --2- 172.21.15.123:0/1865056948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e00066730 0x7f3e00068bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009bf0 tx=0x7f3e0c009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:55.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.035+0000 7f3e2699c740 1 Processor -- start 2024-09-13T17:08:55.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.035+0000 7f3e2699c740 1 -- start start 2024-09-13T17:08:55.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25e8da0 0x25e9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c7d00 0x25b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25e96c0 0x25b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x2510d80 con 0x25e8da0 2024-09-13T17:08:55.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x250e510 con 0x25c7d00 2024-09-13T17:08:55.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x2509e00 con 0x25e96c0 2024-09-13T17:08:55.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e21487700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25e8da0 0x25e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e21487700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25e8da0 0x25e9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41624/0 (socket says 172.21.15.123:41624) 2024-09-13T17:08:55.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e21487700 1 -- 172.21.15.123:0/4044610814 learned_addr learned my addr 172.21.15.123:0/4044610814 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:55.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e21c88700 1 --2- 172.21.15.123:0/4044610814 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25e96c0 0x25b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e20c86700 1 --2- 172.21.15.123:0/4044610814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c7d00 0x25b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e21487700 1 -- 172.21.15.123:0/4044610814 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25e96c0 msgr2=0x25b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:55.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e21487700 1 --2- 172.21.15.123:0/4044610814 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25e96c0 0x25b1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e21487700 1 -- 172.21.15.123:0/4044610814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c7d00 msgr2=0x25b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:55.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e21487700 1 --2- 172.21.15.123:0/4044610814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c7d00 0x25b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e21487700 1 -- 172.21.15.123:0/4044610814 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x237c960 con 0x25e8da0 2024-09-13T17:08:55.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e20c86700 1 --2- 172.21.15.123:0/4044610814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c7d00 0x25b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:55.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e21487700 1 --2- 172.21.15.123:0/4044610814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25e8da0 0x25e9180 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0044f0 tx=0x7f3e0c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0430c26829eeba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:55.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e06ffd700 1 -- 172.21.15.123:0/4044610814 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c01c040 con 0x25e8da0 2024-09-13T17:08:55.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e06ffd700 1 -- 172.21.15.123:0/4044610814 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c0038d0 con 0x25e8da0 2024-09-13T17:08:55.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e06ffd700 1 -- 172.21.15.123:0/4044610814 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c003c60 con 0x25e8da0 2024-09-13T17:08:55.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 -- 172.21.15.123:0/4044610814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25e8da0 msgr2=0x25e9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 --2- 172.21.15.123:0/4044610814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25e8da0 0x25e9180 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0044f0 tx=0x7f3e0c014000 comp rx=0 tx=0).stop 2024-09-13T17:08:55.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 -- 172.21.15.123:0/4044610814 shutdown_connections 2024-09-13T17:08:55.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 --2- 172.21.15.123:0/4044610814 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25e96c0 0x25b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 --2- 172.21.15.123:0/4044610814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c7d00 0x25b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 --2- 172.21.15.123:0/4044610814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25e8da0 0x25e9180 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 -- 172.21.15.123:0/4044610814 >> 172.21.15.123:0/4044610814 conn(0x23314d0 msgr2=0x25cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:55.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 -- 172.21.15.123:0/4044610814 shutdown_connections 2024-09-13T17:08:55.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.039+0000 7f3e2699c740 1 -- 172.21.15.123:0/4044610814 wait complete. 2024-09-13T17:08:55.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 1 -- start start 2024-09-13T17:08:55.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 1 Processor -- start 2024-09-13T17:08:55.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25c7d00 0x25e9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25e8da0 0x25e9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25e96c0 0x25c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x24c7730 con 0x25c7d00 2024-09-13T17:08:55.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x24cd5b0 con 0x25e8da0 2024-09-13T17:08:55.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x23b5aa0 con 0x25e96c0 2024-09-13T17:08:55.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 10 client.0 _ll_register_callbacks cb 0x2503610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:08:55.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e21487700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25c7d00 0x25e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e21487700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25c7d00 0x25e9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41634/0 (socket says 172.21.15.123:41634) 2024-09-13T17:08:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e21487700 1 -- 172.21.15.123:0/2001252415 learned_addr learned my addr 172.21.15.123:0/2001252415 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e21c88700 1 --2- 172.21.15.123:0/2001252415 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25e96c0 0x25c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e20c86700 1 --2- 172.21.15.123:0/2001252415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25e8da0 0x25e9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e21487700 1 -- 172.21.15.123:0/2001252415 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25e96c0 msgr2=0x25c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e21487700 1 --2- 172.21.15.123:0/2001252415 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25e96c0 0x25c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e21487700 1 -- 172.21.15.123:0/2001252415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25e8da0 msgr2=0x25e9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e21487700 1 --2- 172.21.15.123:0/2001252415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25e8da0 0x25e9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e21487700 1 -- 172.21.15.123:0/2001252415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0c0041d0 con 0x25c7d00 2024-09-13T17:08:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e21487700 1 --2- 172.21.15.123:0/2001252415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25c7d00 0x25e9180 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009ab0 tx=0x7f3e0c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3837c372c9231535 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3dfbfff700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-13T17:08:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3dfbfff700 1 -- 172.21.15.123:0/2001252415 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c022670 con 0x25c7d00 2024-09-13T17:08:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3dfbfff700 1 -- 172.21.15.123:0/2001252415 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e0c037ae0 con 0x25c7d00 2024-09-13T17:08:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 1 -- 172.21.15.123:0/2001252415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x233e1e0 con 0x25c7d00 2024-09-13T17:08:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3dfbfff700 1 -- 172.21.15.123:0/2001252415 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e0c037ca0 con 0x25c7d00 2024-09-13T17:08:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 10 client.6264 fetch_fsmap learned FSMap version 28 2024-09-13T17:08:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 1 -- 172.21.15.123:0/2001252415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x24d0220 con 0x25c7d00 2024-09-13T17:08:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3dfbfff700 1 -- 172.21.15.123:0/2001252415 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x233e1e0 con 0x25c7d00 2024-09-13T17:08:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3dfbfff700 1 -- 172.21.15.123:0/2001252415 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 28) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3e0c0227d0 con 0x25c7d00 2024-09-13T17:08:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 10 client.6264 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T17:08:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 10 client.6264 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:08:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 20 client.6264 populate_metadata read hostname 'smithi123' 2024-09-13T17:08:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 1 --2- 172.21.15.123:0/2001252415 >> [v2:172.21.15.123:6836/2270367518,v1:172.21.15.123:6837/2270367518] conn(0x25a1230 0x25a1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 4 client.6264 mds_command: new command op to 6126 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:08:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e2699c740 1 -- 172.21.15.123:0/2001252415 --> [v2:172.21.15.123:6836/2270367518,v1:172.21.15.123:6837/2270367518] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2388460 con 0x25a1230 2024-09-13T17:08:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.043+0000 7f3e20c86700 1 --2- 172.21.15.123:0/2001252415 >> [v2:172.21.15.123:6836/2270367518,v1:172.21.15.123:6837/2270367518] conn(0x25a1230 0x25a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3dfbfff700 10 client.6264 ms_handle_connect on v2:172.21.15.123:6836/2270367518 2024-09-13T17:08:55.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3e20c86700 1 --2- 172.21.15.123:0/2001252415 >> [v2:172.21.15.123:6836/2270367518,v1:172.21.15.123:6837/2270367518] conn(0x25a1230 0x25a1610 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fc17b2deff7f096 server_cookie=1fbdd90152ece125 in_seq=0 out_seq=0 2024-09-13T17:08:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3dfbfff700 1 -- 172.21.15.123:0/2001252415 <== mds.0 v2:172.21.15.123:6836/2270367518 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2388460 con 0x25a1230 2024-09-13T17:08:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3dfbfff700 10 client.6264 handle_command_reply: tid=0 2024-09-13T17:08:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3e2699c740 1 client.6264 shutdown 2024-09-13T17:08:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3e2699c740 1 -- 172.21.15.123:0/2001252415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25c7d00 msgr2=0x25e9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3e2699c740 1 --2- 172.21.15.123:0/2001252415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25c7d00 0x25e9180 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009ab0 tx=0x7f3e0c0047e0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3e2699c740 1 -- 172.21.15.123:0/2001252415 shutdown_connections 2024-09-13T17:08:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3e2699c740 1 --2- 172.21.15.123:0/2001252415 >> [v2:172.21.15.123:6836/2270367518,v1:172.21.15.123:6837/2270367518] conn(0x25a1230 0x25a1610 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3dfbfff700 0 client.6264 ms_handle_reset on v2:172.21.15.123:6836/2270367518 2024-09-13T17:08:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3e2699c740 1 --2- 172.21.15.123:0/2001252415 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25e96c0 0x25c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3e2699c740 1 --2- 172.21.15.123:0/2001252415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25e8da0 0x25e9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3e2699c740 1 --2- 172.21.15.123:0/2001252415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25c7d00 0x25e9180 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3e2699c740 1 -- 172.21.15.123:0/2001252415 >> 172.21.15.123:0/2001252415 conn(0x23314d0 msgr2=0x25c4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:55.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3e2699c740 1 -- 172.21.15.123:0/2001252415 shutdown_connections 2024-09-13T17:08:55.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3e2699c740 1 -- 172.21.15.123:0/2001252415 wait complete. 2024-09-13T17:08:55.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.047+0000 7f3e2699c740 20 client.6264 trim_cache size 0 max 16384 2024-09-13T17:08:55.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e2699c740 1 Processor -- start 2024-09-13T17:08:55.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e2699c740 1 -- start start 2024-09-13T17:08:55.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e2699c740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25a1230 0x25f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e2699c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c7d00 0x25f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e2699c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25e8da0 0x25c6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e2699c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x2538ec0 con 0x25e8da0 2024-09-13T17:08:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e2699c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x25a4210 con 0x25c7d00 2024-09-13T17:08:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e2699c740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x24b0950 con 0x25a1230 2024-09-13T17:08:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e21c88700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25e8da0 0x25c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e21c88700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25e8da0 0x25c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41646/0 (socket says 172.21.15.123:41646) 2024-09-13T17:08:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e21c88700 1 -- 172.21.15.123:0/1208705548 learned_addr learned my addr 172.21.15.123:0/1208705548 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e20c86700 1 --2- 172.21.15.123:0/1208705548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c7d00 0x25f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e21487700 1 --2- 172.21.15.123:0/1208705548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25a1230 0x25f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e21c88700 1 -- 172.21.15.123:0/1208705548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25a1230 msgr2=0x25f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e21c88700 1 --2- 172.21.15.123:0/1208705548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25a1230 0x25f89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e21c88700 1 -- 172.21.15.123:0/1208705548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c7d00 msgr2=0x25f8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e21c88700 1 --2- 172.21.15.123:0/1208705548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c7d00 0x25f8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.071+0000 7f3e21c88700 1 -- 172.21.15.123:0/1208705548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x24b6450 con 0x25e8da0 2024-09-13T17:08:55.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e21c88700 1 --2- 172.21.15.123:0/1208705548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25e8da0 0x25c6600 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0af2f0 tx=0x7f3e14010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c206af4b83cc3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:55.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e077fe700 1 -- 172.21.15.123:0/1208705548 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1401f040 con 0x25e8da0 2024-09-13T17:08:55.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e077fe700 1 -- 172.21.15.123:0/1208705548 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e14011630 con 0x25e8da0 2024-09-13T17:08:55.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e077fe700 1 -- 172.21.15.123:0/1208705548 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14004280 con 0x25e8da0 2024-09-13T17:08:55.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 -- 172.21.15.123:0/1208705548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25e8da0 msgr2=0x25c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 --2- 172.21.15.123:0/1208705548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25e8da0 0x25c6600 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0af2f0 tx=0x7f3e14010000 comp rx=0 tx=0).stop 2024-09-13T17:08:55.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 -- 172.21.15.123:0/1208705548 shutdown_connections 2024-09-13T17:08:55.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 --2- 172.21.15.123:0/1208705548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25e8da0 0x25c6600 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 --2- 172.21.15.123:0/1208705548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c7d00 0x25f8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 --2- 172.21.15.123:0/1208705548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25a1230 0x25f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 -- 172.21.15.123:0/1208705548 >> 172.21.15.123:0/1208705548 conn(0x23314d0 msgr2=0x25f82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 -- 172.21.15.123:0/1208705548 shutdown_connections 2024-09-13T17:08:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 -- 172.21.15.123:0/1208705548 wait complete. 2024-09-13T17:08:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 -- start start 2024-09-13T17:08:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 Processor -- start 2024-09-13T17:08:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25a1230 0x264a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25c7d00 0x264a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25e8da0 0x264abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x25f1f40 con 0x25a1230 2024-09-13T17:08:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x25e4e80 con 0x25e8da0 2024-09-13T17:08:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x25a4980 con 0x25c7d00 2024-09-13T17:08:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e2699c740 10 client.0 _ll_register_callbacks cb 0x2560710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:08:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e21487700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25a1230 0x264a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e21487700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25a1230 0x264a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41662/0 (socket says 172.21.15.123:41662) 2024-09-13T17:08:55.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e21487700 1 -- 172.21.15.123:0/1650659522 learned_addr learned my addr 172.21.15.123:0/1650659522 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:55.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e21c88700 1 --2- 172.21.15.123:0/1650659522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25e8da0 0x264abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e20c86700 1 --2- 172.21.15.123:0/1650659522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25c7d00 0x264a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e21487700 1 -- 172.21.15.123:0/1650659522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25c7d00 msgr2=0x264a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:55.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e21487700 1 --2- 172.21.15.123:0/1650659522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25c7d00 0x264a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e21487700 1 -- 172.21.15.123:0/1650659522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25e8da0 msgr2=0x264abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:55.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e21487700 1 --2- 172.21.15.123:0/1650659522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25e8da0 0x264abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.075+0000 7f3e21487700 1 -- 172.21.15.123:0/1650659522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c0af490 con 0x25a1230 2024-09-13T17:08:55.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e21487700 1 --2- 172.21.15.123:0/1650659522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25a1230 0x264a140 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c011c20 tx=0x7f3e0c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b0324890ac0477 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:55.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3dfbfff700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-13T17:08:55.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3dfbfff700 1 -- 172.21.15.123:0/1650659522 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c022880 con 0x25a1230 2024-09-13T17:08:55.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3dfbfff700 1 -- 172.21.15.123:0/1650659522 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e0c022d30 con 0x25a1230 2024-09-13T17:08:55.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 -- 172.21.15.123:0/1650659522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e0c0038d0 con 0x25a1230 2024-09-13T17:08:55.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3dfbfff700 1 -- 172.21.15.123:0/1650659522 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e0c005a40 con 0x25a1230 2024-09-13T17:08:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 10 client.6270 fetch_fsmap learned FSMap version 28 2024-09-13T17:08:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 -- 172.21.15.123:0/1650659522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x24aa720 con 0x25a1230 2024-09-13T17:08:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3dfbfff700 1 -- 172.21.15.123:0/1650659522 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c0038d0 con 0x25a1230 2024-09-13T17:08:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3dfbfff700 1 -- 172.21.15.123:0/1650659522 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 28) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3e0c005ba0 con 0x25a1230 2024-09-13T17:08:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 10 client.6270 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T17:08:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 10 client.6270 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:08:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 20 client.6270 populate_metadata read hostname 'smithi123' 2024-09-13T17:08:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 --2- 172.21.15.123:0/1650659522 >> [v2:172.21.15.123:6836/2270367518,v1:172.21.15.123:6837/2270367518] conn(0x25e96c0 0x264b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 4 client.6270 mds_command: new command op to 6126 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:08:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 -- 172.21.15.123:0/1650659522 --> [v2:172.21.15.123:6836/2270367518,v1:172.21.15.123:6837/2270367518] -- command(tid 0: {"prefix": "status"}) v1 -- 0x23ad1e0 con 0x25e96c0 2024-09-13T17:08:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e20c86700 1 --2- 172.21.15.123:0/1650659522 >> [v2:172.21.15.123:6836/2270367518,v1:172.21.15.123:6837/2270367518] conn(0x25e96c0 0x264b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3dfbfff700 10 client.6270 ms_handle_connect on v2:172.21.15.123:6836/2270367518 2024-09-13T17:08:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e20c86700 1 --2- 172.21.15.123:0/1650659522 >> [v2:172.21.15.123:6836/2270367518,v1:172.21.15.123:6837/2270367518] conn(0x25e96c0 0x264b100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86135c6e29e756de server_cookie=ee2439b560045560 in_seq=0 out_seq=0 2024-09-13T17:08:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3dfbfff700 1 -- 172.21.15.123:0/1650659522 <== mds.0 v2:172.21.15.123:6836/2270367518 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x23ad1e0 con 0x25e96c0 2024-09-13T17:08:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3dfbfff700 10 client.6270 handle_command_reply: tid=0 2024-09-13T17:08:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 client.6270 shutdown 2024-09-13T17:08:55.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 -- 172.21.15.123:0/1650659522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25a1230 msgr2=0x264a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 --2- 172.21.15.123:0/1650659522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25a1230 0x264a140 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c011c20 tx=0x7f3e0c018000 comp rx=0 tx=0).stop 2024-09-13T17:08:55.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 -- 172.21.15.123:0/1650659522 shutdown_connections 2024-09-13T17:08:55.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 --2- 172.21.15.123:0/1650659522 >> [v2:172.21.15.123:6836/2270367518,v1:172.21.15.123:6837/2270367518] conn(0x25e96c0 0x264b100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 --2- 172.21.15.123:0/1650659522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25e8da0 0x264abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3dfbfff700 0 client.6270 ms_handle_reset on v2:172.21.15.123:6836/2270367518 2024-09-13T17:08:55.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 --2- 172.21.15.123:0/1650659522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25c7d00 0x264a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 --2- 172.21.15.123:0/1650659522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x25a1230 0x264a140 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 -- 172.21.15.123:0/1650659522 >> 172.21.15.123:0/1650659522 conn(0x23314d0 msgr2=0x25f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:55.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 -- 172.21.15.123:0/1650659522 shutdown_connections 2024-09-13T17:08:55.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 1 -- 172.21.15.123:0/1650659522 wait complete. 2024-09-13T17:08:55.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.079+0000 7f3e2699c740 20 client.6270 trim_cache size 0 max 16384 2024-09-13T17:08:55.089 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:08:55.089 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "c45759e3-62b7-46ff-ad19-917097e4c126", 2024-09-13T17:08:55.089 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-13T17:08:55.089 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 6126, 2024-09-13T17:08:55.089 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-13T17:08:55.089 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-13T17:08:55.090 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-13T17:08:55.090 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 5.7426881209999996, 2024-09-13T17:08:55.090 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 28, 2024-09-13T17:08:55.090 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 60, 2024-09-13T17:08:55.090 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 60, 2024-09-13T17:08:55.090 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 10.16734555 2024-09-13T17:08:55.090 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:08:55.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.083+0000 7f3e236eb700 1 -- 172.21.15.123:0/1865056948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e00066730 msgr2=0x7f3e00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.083+0000 7f3e236eb700 1 --2- 172.21.15.123:0/1865056948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e00066730 0x7f3e00068bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009bf0 tx=0x7f3e0c009240 comp rx=0 tx=0).stop 2024-09-13T17:08:55.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.083+0000 7f3e236eb700 1 -- 172.21.15.123:0/1865056948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e1c153480 msgr2=0x7f3e1c0b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.083+0000 7f3e236eb700 1 --2- 172.21.15.123:0/1865056948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e1c153480 0x7f3e1c0b1890 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800cb40 tx=0x7f3e1800cb70 comp rx=0 tx=0).stop 2024-09-13T17:08:55.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.083+0000 7f3e236eb700 1 -- 172.21.15.123:0/1865056948 shutdown_connections 2024-09-13T17:08:55.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.083+0000 7f3e236eb700 1 --2- 172.21.15.123:0/1865056948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e00066730 0x7f3e00068bf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.083+0000 7f3e236eb700 1 --2- 172.21.15.123:0/1865056948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e1c159750 0x7f3e1c0c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.083+0000 7f3e236eb700 1 --2- 172.21.15.123:0/1865056948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e1c153480 0x7f3e1c0b1890 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.083+0000 7f3e236eb700 1 --2- 172.21.15.123:0/1865056948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e1c0c95e0 0x7f3e1c0b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.083+0000 7f3e236eb700 1 -- 172.21.15.123:0/1865056948 >> 172.21.15.123:0/1865056948 conn(0x7f3e1c0b0450 msgr2=0x7f3e1c152c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:55.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.083+0000 7f3e236eb700 1 -- 172.21.15.123:0/1865056948 shutdown_connections 2024-09-13T17:08:55.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.083+0000 7f3e236eb700 1 -- 172.21.15.123:0/1865056948 wait complete. 2024-09-13T17:08:55.104 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:08:55.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.215+0000 7fc03bfff700 1 Processor -- start 2024-09-13T17:08:55.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.215+0000 7fc03bfff700 1 -- start start 2024-09-13T17:08:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc03c159620 0x7fc03c06d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc03c06de30 0x7fc03c0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03bfff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03c0b29a0 con 0x7fc03c0b3f80 2024-09-13T17:08:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03bfff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03c06cd00 con 0x7fc03c06de30 2024-09-13T17:08:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c0b2c80 con 0x7fc03c159620 2024-09-13T17:08:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03b7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc03c0b3f80 0x7fc03c0b1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44332/0 (socket says 172.21.15.123:44332) 2024-09-13T17:08:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03b7fe700 1 -- 172.21.15.123:0/2460859222 learned_addr learned my addr 172.21.15.123:0/2460859222 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:08:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc0327fc700 1 --2- 172.21.15.123:0/2460859222 >> v2:172.21.15.123:3300/0 conn(0x7fc03c06de30 0x7fc03c0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03affd700 1 --2- 172.21.15.123:0/2460859222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc03c159620 0x7fc03c06d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03a7fc700 1 -- 172.21.15.123:0/2460859222 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038172910 0 0) 0x7fc03c0b29a0 con 0x7fc03c0b3f80 2024-09-13T17:08:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03a7fc700 1 -- 172.21.15.123:0/2460859222 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0280035d0 con 0x7fc03c0b3f80 2024-09-13T17:08:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc0327fc700 1 -- 172.21.15.123:0/2460859222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc03c159620 msgr2=0x7fc03c06d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc0327fc700 1 --2- 172.21.15.123:0/2460859222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc03c159620 0x7fc03c06d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc0327fc700 1 -- 172.21.15.123:0/2460859222 >> v1:172.21.15.123:6789/0 conn(0x7fc03c0b3f80 legacy=0x7fc03c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc0327fc700 1 -- 172.21.15.123:0/2460859222 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c0b2f60 con 0x7fc03c06de30 2024-09-13T17:08:55.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc0327fc700 1 --2- 172.21.15.123:0/2460859222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c06de30 0x7fc03c0b3a40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc024009850 tx=0x7fc024009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990fe726e1e42ed2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:55.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03a7fc700 1 -- 172.21.15.123:0/2460859222 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc024011830 con 0x7fc03c06de30 2024-09-13T17:08:55.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03a7fc700 1 -- 172.21.15.123:0/2460859222 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc024011990 con 0x7fc03c06de30 2024-09-13T17:08:55.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03a7fc700 1 -- 172.21.15.123:0/2460859222 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc024011d00 con 0x7fc03c06de30 2024-09-13T17:08:55.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03bfff700 1 -- 172.21.15.123:0/2460859222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c06de30 msgr2=0x7fc03c0b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03bfff700 1 --2- 172.21.15.123:0/2460859222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c06de30 0x7fc03c0b3a40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc024009850 tx=0x7fc024009b60 comp rx=0 tx=0).stop 2024-09-13T17:08:55.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03bfff700 1 -- 172.21.15.123:0/2460859222 shutdown_connections 2024-09-13T17:08:55.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03bfff700 1 --2- 172.21.15.123:0/2460859222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c06de30 0x7fc03c0b3a40 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03bfff700 1 --2- 172.21.15.123:0/2460859222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc03c159620 0x7fc03c06d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03bfff700 1 -- 172.21.15.123:0/2460859222 >> 172.21.15.123:0/2460859222 conn(0x7fc03c0b4630 msgr2=0x7fc03c0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:55.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03bfff700 1 -- 172.21.15.123:0/2460859222 shutdown_connections 2024-09-13T17:08:55.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.219+0000 7fc03bfff700 1 -- 172.21.15.123:0/2460859222 wait complete. 2024-09-13T17:08:55.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.223+0000 7fc03bfff700 1 Processor -- start 2024-09-13T17:08:55.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.223+0000 7fc03bfff700 1 -- start start 2024-09-13T17:08:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc03c06de30 0x7fc03c145b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc03c0b3f80 0x7fc03c146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c159620 0x7fc03c1465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03bfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c145730 con 0x7fc03c159620 2024-09-13T17:08:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03bfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c0cda60 con 0x7fc03c06de30 2024-09-13T17:08:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c141410 con 0x7fc03c0b3f80 2024-09-13T17:08:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc03c06de30 0x7fc03c145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c159620 0x7fc03c1465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc0327fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc03c0b3f80 0x7fc03c146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc03c06de30 0x7fc03c145b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:47744/0 (socket says 172.21.15.123:47744) 2024-09-13T17:08:55.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03affd700 1 -- 172.21.15.123:0/534003892 learned_addr learned my addr 172.21.15.123:0/534003892 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:55.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03affd700 1 -- 172.21.15.123:0/534003892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc03c0b3f80 msgr2=0x7fc03c146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03affd700 1 --2- 172.21.15.123:0/534003892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc03c0b3f80 0x7fc03c146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03affd700 1 -- 172.21.15.123:0/534003892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c159620 msgr2=0x7fc03c1465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03affd700 1 --2- 172.21.15.123:0/534003892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c159620 0x7fc03c1465d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03affd700 1 -- 172.21.15.123:0/534003892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0240094b0 con 0x7fc03c06de30 2024-09-13T17:08:55.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03b7fe700 1 --2- 172.21.15.123:0/534003892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c159620 0x7fc03c1465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:08:55.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03affd700 1 --2- 172.21.15.123:0/534003892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc03c06de30 0x7fc03c145b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00ea00 tx=0x7fc02c00ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:55.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc033fff700 1 -- 172.21.15.123:0/534003892 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c009720 con 0x7fc03c06de30 2024-09-13T17:08:55.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc033fff700 1 -- 172.21.15.123:0/534003892 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02c00eea0 con 0x7fc03c06de30 2024-09-13T17:08:55.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc033fff700 1 -- 172.21.15.123:0/534003892 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c00ca50 con 0x7fc03c06de30 2024-09-13T17:08:55.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03bfff700 1 -- 172.21.15.123:0/534003892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03c144d90 con 0x7fc03c06de30 2024-09-13T17:08:55.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.227+0000 7fc03bfff700 1 -- 172.21.15.123:0/534003892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc03c145350 con 0x7fc03c06de30 2024-09-13T17:08:55.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.231+0000 7fc03bfff700 1 -- 172.21.15.123:0/534003892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03c0b3a40 con 0x7fc03c06de30 2024-09-13T17:08:55.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.231+0000 7fc033fff700 1 -- 172.21.15.123:0/534003892 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc02c00cbb0 con 0x7fc03c06de30 2024-09-13T17:08:55.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.231+0000 7fc033fff700 1 --2- 172.21.15.123:0/534003892 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc01c066730 0x7fc01c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:55.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.231+0000 7fc033fff700 1 -- 172.21.15.123:0/534003892 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc02c084590 con 0x7fc03c06de30 2024-09-13T17:08:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.231+0000 7fc0327fc700 1 --2- 172.21.15.123:0/534003892 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc01c066730 0x7fc01c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.231+0000 7fc0327fc700 1 --2- 172.21.15.123:0/534003892 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc01c066730 0x7fc01c068bf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc024009850 tx=0x7fc02401c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:55.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.239+0000 7fc033fff700 1 -- 172.21.15.123:0/534003892 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc02c0518e0 con 0x7fc03c06de30 2024-09-13T17:08:55.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.447+0000 7fc03bfff700 1 -- 172.21.15.123:0/534003892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc03c156870 con 0x7fc03c06de30 2024-09-13T17:08:55.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.451+0000 7fc033fff700 1 -- 172.21.15.123:0/534003892 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc02c017060 con 0x7fc03c06de30 2024-09-13T17:08:55.454 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:08:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.451+0000 7fc03bfff700 1 -- 172.21.15.123:0/534003892 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc01c066730 msgr2=0x7fc01c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.451+0000 7fc03bfff700 1 --2- 172.21.15.123:0/534003892 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc01c066730 0x7fc01c068bf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc024009850 tx=0x7fc02401c040 comp rx=0 tx=0).stop 2024-09-13T17:08:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.451+0000 7fc03bfff700 1 -- 172.21.15.123:0/534003892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc03c06de30 msgr2=0x7fc03c145b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.451+0000 7fc03bfff700 1 --2- 172.21.15.123:0/534003892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc03c06de30 0x7fc03c145b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00ea00 tx=0x7fc02c00ed10 comp rx=0 tx=0).stop 2024-09-13T17:08:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.451+0000 7fc03bfff700 1 -- 172.21.15.123:0/534003892 shutdown_connections 2024-09-13T17:08:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.451+0000 7fc03bfff700 1 --2- 172.21.15.123:0/534003892 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc01c066730 0x7fc01c068bf0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.451+0000 7fc03bfff700 1 --2- 172.21.15.123:0/534003892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c159620 0x7fc03c1465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.451+0000 7fc03bfff700 1 --2- 172.21.15.123:0/534003892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc03c0b3f80 0x7fc03c146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.451+0000 7fc03bfff700 1 --2- 172.21.15.123:0/534003892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc03c06de30 0x7fc03c145b50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.451+0000 7fc03bfff700 1 -- 172.21.15.123:0/534003892 >> 172.21.15.123:0/534003892 conn(0x7fc03c0b4630 msgr2=0x7fc03c0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:55.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.451+0000 7fc03bfff700 1 -- 172.21.15.123:0/534003892 shutdown_connections 2024-09-13T17:08:55.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:55.451+0000 7fc03bfff700 1 -- 172.21.15.123:0/534003892 wait complete. 2024-09-13T17:08:55.469 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:08:55.470 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:08:55.470 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-13T17:08:55.470 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:08:55.470 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:08:55.470 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:08:55.470 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:08:55.470 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:08:55.470 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:08:55.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:55.471 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-13T17:08:55.477 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:08:55.477 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:08:55.477 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:08:55.477 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:55.478 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-13T17:08:55.478 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:55.478 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:08:55.478 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:55.478 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:08:55.478 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:55.479 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:08:55.479 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:55.479 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:08:55.479 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:55.479 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:08:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42472sec preferred_lft 42472sec 2024-09-13T17:08:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-09-13T17:08:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:55.480 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:08:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:b1:d7:75:e9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:08:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:55.480 INFO:teuthology.orchestra.run.smithi123.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:08:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether d6:8a:3c:97:49:a9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:08:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:55.480 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::a038:65ff:fec0:5513/64 scope link 2024-09-13T17:08:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:55.481 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:08:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether da:a9:95:cd:41:8c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:08:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::d8a9:95ff:fecd:418c/64 scope link 2024-09-13T17:08:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:55.481 INFO:teuthology.orchestra.run.smithi123.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:08:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether d6:8a:3c:97:49:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:08:55.481 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::d48a:3cff:fe97:49a9/64 scope link 2024-09-13T17:08:55.482 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:55.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:55.482 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:08:55.533 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-13T17:08:55.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:55.535 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-13T17:08:55.544 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-13T17:08:55.544 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:08:55.544 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:08:55.544 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:08:55.544 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:08:55.544 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:08:55.544 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:08:55.545 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:08:55.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:55.545 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:08:55.545 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:08:55.545 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:08:55.545 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:08:55.545 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:08:55.545 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:08:55.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:55.582 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-13T17:08:55.589 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:08:55.589 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:08:55.589 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:08:55.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:55.590 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-13T17:08:55.603 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:08:55.604 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:08:55.604 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:08:55.653 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:08:55.653 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:08:55.653 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:08:55.660 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:08:55.677 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:08:55.677 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:08:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:08:55.688 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:08:55.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:55.689 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:08:55.736 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:08:55.736 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:08:55.739 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:08:55.755 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:08:55.755 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:08:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:08:55.813 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:08:55.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:55.814 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:08:55.831 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:2024-09-13T17:08:55.827+0000 7fdadd2c1640 -1 init, newargv = 0x5619fd554540 newargc=15 2024-09-13T17:08:55.831 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[40818]: starting ceph client 2024-09-13T17:08:55.841 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[40818]: starting fuse 2024-09-13T17:08:56.920 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:08:56.938 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:08:56.938 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:08:56.993 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:08:56.994 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:08:56.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:56.995 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:08:57.002 INFO:teuthology.orchestra.run.smithi123.stdout:52 2024-09-13T17:08:57.003 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:08:57.003 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:08:57.003 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2024-09-13T17:08:57.003 DEBUG:teuthology.orchestra.run.smithi123:> import re 2024-09-13T17:08:57.003 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-13T17:08:57.003 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2024-09-13T17:08:57.003 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:08:57.003 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2024-09-13T17:08:57.003 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:08:57.003 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2024-09-13T17:08:57.003 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:08:57.003 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:08:57.004 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2024-09-13T17:08:57.004 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2024-09-13T17:08:57.004 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2024-09-13T17:08:57.004 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2024-09-13T17:08:57.004 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:08:57.004 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2024-09-13T17:08:57.004 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:08:57.004 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:08:57.004 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:08:57.004 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2024-09-13T17:08:57.004 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2024-09-13T17:08:57.004 DEBUG:teuthology.orchestra.run.smithi123:> return f 2024-09-13T17:08:57.004 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:08:57.004 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:08:57.005 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.0")) 2024-09-13T17:08:57.005 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-13T17:08:57.082 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.0.40818.asok 2024-09-13T17:08:57.268 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40818.asok 2024-09-13T17:08:57.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:57.269 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40818.asok status 2024-09-13T17:08:57.377 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:08:57.377 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2024-09-13T17:08:57.377 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:08:57.377 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:08:57.377 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "0", 2024-09-13T17:08:57.377 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2024-09-13T17:08:57.377 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:08:57.377 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "40818", 2024-09-13T17:08:57.378 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2024-09-13T17:08:57.378 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:57.378 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2024-09-13T17:08:57.378 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2024-09-13T17:08:57.378 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 6285, 2024-09-13T17:08:57.378 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2024-09-13T17:08:57.378 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2024-09-13T17:08:57.378 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2024-09-13T17:08:57.378 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6285 2024-09-13T17:08:57.378 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:57.378 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:08:57.378 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:08:57.378 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:08:57.379 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1670769661 2024-09-13T17:08:57.379 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:08:57.379 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:57.379 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:08:57.379 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:08:57.379 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:08:57.379 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1670769661 2024-09-13T17:08:57.379 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:08:57.379 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.6285 192.168.0.1:0/1670769661", 2024-09-13T17:08:57.379 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.1:0/1670769661", 2024-09-13T17:08:57.379 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2024-09-13T17:08:57.379 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 28, 2024-09-13T17:08:57.379 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 60, 2024-09-13T17:08:57.380 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:08:57.380 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2024-09-13T17:08:57.380 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2024-09-13T17:08:57.380 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:08:57.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:57.387 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2024-09-13T17:08:57.387 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:08:57.393 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2024-09-13T17:08:57.393 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:08:57.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:57.394 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:08:57.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:08:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a759e700 1 Processor -- start 2024-09-13T17:08:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a759e700 1 -- start start 2024-09-13T17:08:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a759e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb0a80cedc0 0x7fb0a8071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0a80cdfd0 0x7fb0a8159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a759e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a815d360 con 0x7fb0a81598b0 2024-09-13T17:08:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a759e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a80ce440 con 0x7fb0a80cedc0 2024-09-13T17:08:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80724c0 con 0x7fb0a80cdfd0 2024-09-13T17:08:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a5d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb0a80cedc0 0x7fb0a8071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a5d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb0a80cedc0 0x7fb0a8071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41690/0 (socket says 172.21.15.123:41690) 2024-09-13T17:08:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a5d9b700 1 -- 172.21.15.123:0/4207006522 learned_addr learned my addr 172.21.15.123:0/4207006522 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a6d9d700 1 --2- 172.21.15.123:0/4207006522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0a80cdfd0 0x7fb0a8159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a5d9b700 1 -- 172.21.15.123:0/4207006522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0a80cdfd0 msgr2=0x7fb0a8159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:08:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a5d9b700 1 --2- 172.21.15.123:0/4207006522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0a80cdfd0 0x7fb0a8159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a5d9b700 1 -- 172.21.15.123:0/4207006522 >> v1:172.21.15.123:6789/0 conn(0x7fb0a81598b0 legacy=0x7fb0a80ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a5d9b700 1 -- 172.21.15.123:0/4207006522 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a815d5b0 con 0x7fb0a80cedc0 2024-09-13T17:08:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a6d9d700 1 --2- 172.21.15.123:0/4207006522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0a80cdfd0 0x7fb0a8159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:08:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a5d9b700 1 --2- 172.21.15.123:0/4207006522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0a80cedc0 0x7fb0a8071e60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb098009e50 tx=0x7fb09800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823f05b366248fe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a559a700 1 -- 172.21.15.123:0/4207006522 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800e070 con 0x7fb0a80cedc0 2024-09-13T17:08:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a559a700 1 -- 172.21.15.123:0/4207006522 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09800b9c0 con 0x7fb0a80cedc0 2024-09-13T17:08:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.519+0000 7fb0a559a700 1 -- 172.21.15.123:0/4207006522 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800bd70 con 0x7fb0a80cedc0 2024-09-13T17:08:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 -- 172.21.15.123:0/4207006522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0a80cedc0 msgr2=0x7fb0a8071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 --2- 172.21.15.123:0/4207006522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0a80cedc0 0x7fb0a8071e60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb098009e50 tx=0x7fb09800b330 comp rx=0 tx=0).stop 2024-09-13T17:08:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 -- 172.21.15.123:0/4207006522 shutdown_connections 2024-09-13T17:08:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 --2- 172.21.15.123:0/4207006522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0a80cdfd0 0x7fb0a8159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 --2- 172.21.15.123:0/4207006522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0a80cedc0 0x7fb0a8071e60 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 -- 172.21.15.123:0/4207006522 >> 172.21.15.123:0/4207006522 conn(0x7fb0a8066150 msgr2=0x7fb0a8066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 -- 172.21.15.123:0/4207006522 shutdown_connections 2024-09-13T17:08:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 -- 172.21.15.123:0/4207006522 wait complete. 2024-09-13T17:08:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 Processor -- start 2024-09-13T17:08:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 -- start start 2024-09-13T17:08:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a80cdfd0 0x7fb0a814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0a80cedc0 0x7fb0a814f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0a81598b0 0x7fb0a8147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a814cf50 con 0x7fb0a80cedc0 2024-09-13T17:08:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a814bc50 con 0x7fb0a80cdfd0 2024-09-13T17:08:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a814bf30 con 0x7fb0a81598b0 2024-09-13T17:08:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a5d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0a80cedc0 0x7fb0a814f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a5d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0a80cedc0 0x7fb0a814f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41706/0 (socket says 172.21.15.123:41706) 2024-09-13T17:08:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a5d9b700 1 -- 172.21.15.123:0/2378792266 learned_addr learned my addr 172.21.15.123:0/2378792266 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:08:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a6d9d700 1 --2- 172.21.15.123:0/2378792266 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0a81598b0 0x7fb0a8147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a659c700 1 --2- 172.21.15.123:0/2378792266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a80cdfd0 0x7fb0a814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a5d9b700 1 -- 172.21.15.123:0/2378792266 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0a81598b0 msgr2=0x7fb0a8147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a5d9b700 1 --2- 172.21.15.123:0/2378792266 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0a81598b0 0x7fb0a8147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a5d9b700 1 -- 172.21.15.123:0/2378792266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a80cdfd0 msgr2=0x7fb0a814ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:57.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a5d9b700 1 --2- 172.21.15.123:0/2378792266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a80cdfd0 0x7fb0a814ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.523+0000 7fb0a5d9b700 1 -- 172.21.15.123:0/2378792266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb098009b30 con 0x7fb0a80cedc0 2024-09-13T17:08:57.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.527+0000 7fb0a5d9b700 1 --2- 172.21.15.123:0/2378792266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0a80cedc0 0x7fb0a814f9e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb09800b370 tx=0x7fb098004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:57.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.527+0000 7fb096ffd700 1 -- 172.21.15.123:0/2378792266 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0980099b0 con 0x7fb0a80cedc0 2024-09-13T17:08:57.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.527+0000 7fb096ffd700 1 -- 172.21.15.123:0/2378792266 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0980092e0 con 0x7fb0a80cedc0 2024-09-13T17:08:57.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.527+0000 7fb096ffd700 1 -- 172.21.15.123:0/2378792266 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09801c640 con 0x7fb0a80cedc0 2024-09-13T17:08:57.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.527+0000 7fb0a759e700 1 -- 172.21.15.123:0/2378792266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a814c210 con 0x7fb0a80cedc0 2024-09-13T17:08:57.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.527+0000 7fb0a759e700 1 -- 172.21.15.123:0/2378792266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a815cc60 con 0x7fb0a80cedc0 2024-09-13T17:08:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.527+0000 7fb0a759e700 1 -- 172.21.15.123:0/2378792266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a80677f0 con 0x7fb0a80cedc0 2024-09-13T17:08:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.527+0000 7fb096ffd700 1 -- 172.21.15.123:0/2378792266 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb09801c7a0 con 0x7fb0a80cedc0 2024-09-13T17:08:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.527+0000 7fb096ffd700 1 --2- 172.21.15.123:0/2378792266 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb088066730 0x7fb088068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.527+0000 7fb0a659c700 1 --2- 172.21.15.123:0/2378792266 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb088066730 0x7fb088068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.527+0000 7fb096ffd700 1 -- 172.21.15.123:0/2378792266 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb098085bc0 con 0x7fb0a80cedc0 2024-09-13T17:08:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.527+0000 7fb0a659c700 1 --2- 172.21.15.123:0/2378792266 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb088066730 0x7fb088068bf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb09c001700 tx=0x7fb09c009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:57.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.531+0000 7fb096ffd700 1 -- 172.21.15.123:0/2378792266 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb098052fc0 con 0x7fb0a80cedc0 2024-09-13T17:08:57.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.743+0000 7fb0a759e700 1 -- 172.21.15.123:0/2378792266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb0a814c6d0 con 0x7fb0a80cedc0 2024-09-13T17:08:57.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.743+0000 7fb096ffd700 1 -- 172.21.15.123:0/2378792266 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb0980565e0 con 0x7fb0a80cedc0 2024-09-13T17:08:57.748 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:08:57.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.747+0000 7fb0a759e700 1 -- 172.21.15.123:0/2378792266 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb088066730 msgr2=0x7fb088068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:57.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.747+0000 7fb0a759e700 1 --2- 172.21.15.123:0/2378792266 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb088066730 0x7fb088068bf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb09c001700 tx=0x7fb09c009040 comp rx=0 tx=0).stop 2024-09-13T17:08:57.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.747+0000 7fb0a759e700 1 -- 172.21.15.123:0/2378792266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0a80cedc0 msgr2=0x7fb0a814f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:57.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.747+0000 7fb0a759e700 1 --2- 172.21.15.123:0/2378792266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0a80cedc0 0x7fb0a814f9e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb09800b370 tx=0x7fb098004af0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.747+0000 7fb0a759e700 1 -- 172.21.15.123:0/2378792266 shutdown_connections 2024-09-13T17:08:57.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.747+0000 7fb0a759e700 1 --2- 172.21.15.123:0/2378792266 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb088066730 0x7fb088068bf0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.747+0000 7fb0a759e700 1 --2- 172.21.15.123:0/2378792266 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb0a81598b0 0x7fb0a8147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.747+0000 7fb0a759e700 1 --2- 172.21.15.123:0/2378792266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0a80cedc0 0x7fb0a814f9e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.747+0000 7fb0a759e700 1 --2- 172.21.15.123:0/2378792266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a80cdfd0 0x7fb0a814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:57.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.747+0000 7fb0a759e700 1 -- 172.21.15.123:0/2378792266 >> 172.21.15.123:0/2378792266 conn(0x7fb0a8066150 msgr2=0x7fb0a8066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:57.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.747+0000 7fb0a759e700 1 -- 172.21.15.123:0/2378792266 shutdown_connections 2024-09-13T17:08:57.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:08:57.747+0000 7fb0a759e700 1 -- 172.21.15.123:0/2378792266 wait complete. 2024-09-13T17:08:57.766 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:08:57.766 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:08:57.766 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-13T17:08:57.766 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:08:57.767 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:57.767 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:08:57.767 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:08:57.767 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:08:57.767 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:08:57.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:57.767 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-13T17:08:57.777 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:08:57.778 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:08:57.778 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:08:57.778 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:57.778 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-13T17:08:57.778 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:57.778 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:08:57.778 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:57.779 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:08:57.779 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:57.779 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:08:57.779 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:57.779 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:08:57.779 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:57.779 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:08:57.779 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42473sec preferred_lft 42473sec 2024-09-13T17:08:57.779 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-09-13T17:08:57.779 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:57.779 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:08:57.779 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:73:6c:03:01 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:57.780 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:08:57.780 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:57.780 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:08:57.780 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:08:57.780 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:08:57.780 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:57.780 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::f82f:21ff:fe0c:65de/64 scope link 2024-09-13T17:08:57.780 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:57.780 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:08:57.780 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:08:57.780 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::346e:9ff:fe92:ffa0/64 scope link 2024-09-13T17:08:57.780 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:57.781 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:08:57.781 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether c6:e2:c1:7b:16:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:08:57.781 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::c4e2:c1ff:fe7b:1657/64 scope link 2024-09-13T17:08:57.781 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:08:57.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:57.781 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:08:57.796 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-13T17:08:57.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:57.798 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-13T17:08:57.853 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-13T17:08:57.854 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:08:57.854 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:08:57.854 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:08:57.854 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:08:57.854 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:08:57.854 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:08:57.855 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:08:57.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:57.855 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:08:57.855 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:08:57.855 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:08:57.855 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:08:57.856 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:08:57.856 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:08:57.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:57.896 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-13T17:08:57.903 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:08:57.904 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:08:57.904 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:08:57.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:57.904 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-09-13T17:08:57.964 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:08:57.965 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:08:57.965 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:57.970 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:08:57.970 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:08:57.970 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:57.974 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:08:57.990 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:08:57.990 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:08:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:08:58.000 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:08:58.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:58.001 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:08:58.007 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:08:58.007 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:08:58.010 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:08:58.028 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:08:58.028 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:08:58.093 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:08:58.094 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:08:58.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:58.094 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:08:58.095 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:2024-09-13T17:08:58.090+0000 7f3dcf0d3640 -1 init, newargv = 0x556264a363c0 newargc=15 2024-09-13T17:08:58.095 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33183]: starting ceph client 2024-09-13T17:08:58.104 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33183]: starting fuse 2024-09-13T17:08:59.201 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:08:59.220 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:08:59.220 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:08:59.230 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:08:59.231 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:08:59.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.232 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:08:59.282 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-09-13T17:08:59.282 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:08:59.283 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:08:59.283 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-09-13T17:08:59.283 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-09-13T17:08:59.283 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-13T17:08:59.283 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-09-13T17:08:59.283 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:08:59.283 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-09-13T17:08:59.283 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:08:59.283 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-09-13T17:08:59.283 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:08:59.283 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:08:59.283 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-09-13T17:08:59.284 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-09-13T17:08:59.284 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-09-13T17:08:59.284 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-09-13T17:08:59.284 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:08:59.284 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-09-13T17:08:59.284 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:08:59.284 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:08:59.284 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:08:59.284 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-09-13T17:08:59.284 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-09-13T17:08:59.284 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-09-13T17:08:59.284 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:08:59.284 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:08:59.284 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.1")) 2024-09-13T17:08:59.285 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-13T17:08:59.365 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.1.33183.asok 2024-09-13T17:08:59.551 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33183.asok 2024-09-13T17:08:59.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.551 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33183.asok status 2024-09-13T17:08:59.657 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-13T17:08:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-09-13T17:08:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:08:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:08:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "1", 2024-09-13T17:08:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-09-13T17:08:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:08:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "33183", 2024-09-13T17:08:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-09-13T17:08:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:08:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-09-13T17:08:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-09-13T17:08:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 6157, 2024-09-13T17:08:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-09-13T17:08:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-09-13T17:08:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-09-13T17:08:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 6157 2024-09-13T17:08:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:08:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:08:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:08:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:08:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 4180804101 2024-09-13T17:08:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-13T17:08:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:08:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:08:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:08:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:08:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 4180804101 2024-09-13T17:08:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:08:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.6157 192.168.0.1:0/4180804101", 2024-09-13T17:08:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.1:0/4180804101", 2024-09-13T17:08:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-09-13T17:08:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 28, 2024-09-13T17:08:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 60, 2024-09-13T17:08:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:08:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-09-13T17:08:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-09-13T17:08:59.660 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-13T17:08:59.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.667 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-09-13T17:08:59.668 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:59.674 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-09-13T17:08:59.675 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:59.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.675 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:08:59.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.685 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-13T17:08:59.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.704 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T17:08:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:./subdir: ceph.quota.max_bytes: No such attribute 2024-09-13T17:08:59.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:08:59.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.758 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 10K ./subdir) 2024-09-13T17:08:59.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.772 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T17:08:59.783 INFO:teuthology.orchestra.run.smithi123.stdout:10240 2024-09-13T17:08:59.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.784 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 100Ki ./subdir) 2024-09-13T17:08:59.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.842 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T17:08:59.854 INFO:teuthology.orchestra.run.smithi123.stdout:102400 2024-09-13T17:08:59.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.855 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 10M ./subdir) 2024-09-13T17:08:59.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.869 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T17:08:59.880 INFO:teuthology.orchestra.run.smithi123.stdout:10485760 2024-09-13T17:08:59.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.880 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 100Mi ./subdir) 2024-09-13T17:08:59.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.896 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T17:08:59.949 INFO:teuthology.orchestra.run.smithi123.stdout:104857600 2024-09-13T17:08:59.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.949 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 2G ./subdir) 2024-09-13T17:08:59.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.963 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T17:08:59.974 INFO:teuthology.orchestra.run.smithi123.stdout:2147483648 2024-09-13T17:08:59.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.974 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 4Gi ./subdir) 2024-09-13T17:08:59.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:08:59.988 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T17:09:00.000 INFO:teuthology.orchestra.run.smithi123.stdout:4294967296 2024-09-13T17:09:00.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:00.000 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1T ./subdir) 2024-09-13T17:09:00.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:00.059 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T17:09:00.069 INFO:teuthology.orchestra.run.smithi123.stdout:1099511627776 2024-09-13T17:09:00.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:00.069 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 2Ti ./subdir) 2024-09-13T17:09:00.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:00.081 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T17:09:00.136 INFO:teuthology.orchestra.run.smithi123.stdout:2199023255552 2024-09-13T17:09:00.136 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:09:00.141 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:09:00.155 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:09:00.174 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:09:00.175 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:09:00.175 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:00.182 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:00.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.335+0000 7f67855c6700 1 Processor -- start 2024-09-13T17:09:00.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.335+0000 7f67855c6700 1 -- start start 2024-09-13T17:09:00.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f67855c6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678015a780 0x7f67800cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f67855c6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f67800b2af0 0x7f67800ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f67855c6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67800b48b0 con 0x7f67800b3750 2024-09-13T17:09:00.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f67855c6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67800b3ca0 con 0x7f67800b2af0 2024-09-13T17:09:00.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f67855c6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67800b3f80 con 0x7f678015a780 2024-09-13T17:09:00.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f677f7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f67800b3750 0x7f67800b23e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44344/0 (socket says 172.21.15.123:44344) 2024-09-13T17:09:00.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f677f7fe700 1 -- 172.21.15.123:0/666291753 learned_addr learned my addr 172.21.15.123:0/666291753 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:00.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f6784dc5700 1 --2- 172.21.15.123:0/666291753 >> v2:172.21.15.153:3300/0 conn(0x7f67800b2af0 0x7f67800ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f677ffff700 1 --2- 172.21.15.123:0/666291753 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678015a780 0x7f67800cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f677effd700 1 -- 172.21.15.123:0/666291753 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316413147 0 0) 0x7f67800b48b0 con 0x7f67800b3750 2024-09-13T17:09:00.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f677effd700 1 -- 172.21.15.123:0/666291753 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f676c0035d0 con 0x7f67800b3750 2024-09-13T17:09:00.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f6784dc5700 1 -- 172.21.15.123:0/666291753 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678015a780 msgr2=0x7f67800cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:00.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f6784dc5700 1 --2- 172.21.15.123:0/666291753 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678015a780 0x7f67800cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f6784dc5700 1 -- 172.21.15.123:0/666291753 >> v1:172.21.15.123:6789/0 conn(0x7f67800b3750 legacy=0x7f67800b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f6784dc5700 1 -- 172.21.15.123:0/666291753 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800b4260 con 0x7f67800b2af0 2024-09-13T17:09:00.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f6784dc5700 1 --2- 172.21.15.123:0/666291753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67800b2af0 0x7f67800ceb00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6778009d90 tx=0x7f677800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b00f59babf5de63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:00.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f677effd700 1 -- 172.21.15.123:0/666291753 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677800e070 con 0x7f67800b2af0 2024-09-13T17:09:00.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f677effd700 1 -- 172.21.15.123:0/666291753 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677800bb20 con 0x7f67800b2af0 2024-09-13T17:09:00.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f677effd700 1 -- 172.21.15.123:0/666291753 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778012430 con 0x7f67800b2af0 2024-09-13T17:09:00.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f67855c6700 1 -- 172.21.15.123:0/666291753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67800b2af0 msgr2=0x7f67800ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f67855c6700 1 --2- 172.21.15.123:0/666291753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67800b2af0 0x7f67800ceb00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6778009d90 tx=0x7f677800b330 comp rx=0 tx=0).stop 2024-09-13T17:09:00.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f67855c6700 1 -- 172.21.15.123:0/666291753 shutdown_connections 2024-09-13T17:09:00.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f67855c6700 1 --2- 172.21.15.123:0/666291753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67800b2af0 0x7f67800ceb00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f67855c6700 1 --2- 172.21.15.123:0/666291753 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f678015a780 0x7f67800cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f67855c6700 1 -- 172.21.15.123:0/666291753 >> 172.21.15.123:0/666291753 conn(0x7f6780066150 msgr2=0x7f6780066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:00.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f67855c6700 1 -- 172.21.15.123:0/666291753 shutdown_connections 2024-09-13T17:09:00.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.339+0000 7f67855c6700 1 -- 172.21.15.123:0/666291753 wait complete. 2024-09-13T17:09:00.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f67855c6700 1 Processor -- start 2024-09-13T17:09:00.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f67855c6700 1 -- start start 2024-09-13T17:09:00.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f67855c6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800b2af0 0x7f67800ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f67855c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800b3750 0x7f678015b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f67855c6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678015a780 0x7f678014e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f67855c6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678015beb0 con 0x7f67800b3750 2024-09-13T17:09:00.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f67855c6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800ad990 con 0x7f678015a780 2024-09-13T17:09:00.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f67855c6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67800adc70 con 0x7f67800b2af0 2024-09-13T17:09:00.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f677f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800b3750 0x7f678015b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f677f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800b3750 0x7f678015b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41714/0 (socket says 172.21.15.123:41714) 2024-09-13T17:09:00.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f677f7fe700 1 -- 172.21.15.123:0/2507888454 learned_addr learned my addr 172.21.15.123:0/2507888454 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:00.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f677ffff700 1 --2- 172.21.15.123:0/2507888454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800b2af0 0x7f67800ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f6784dc5700 1 --2- 172.21.15.123:0/2507888454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678015a780 0x7f678014e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f677f7fe700 1 -- 172.21.15.123:0/2507888454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800b2af0 msgr2=0x7f67800ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f677f7fe700 1 --2- 172.21.15.123:0/2507888454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800b2af0 0x7f67800ad3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f677f7fe700 1 -- 172.21.15.123:0/2507888454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678015a780 msgr2=0x7f678014e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f677f7fe700 1 --2- 172.21.15.123:0/2507888454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678015a780 0x7f678014e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f677f7fe700 1 -- 172.21.15.123:0/2507888454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6778009a70 con 0x7f67800b3750 2024-09-13T17:09:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f677f7fe700 1 --2- 172.21.15.123:0/2507888454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800b3750 0x7f678015b970 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f676800c4f0 tx=0x7f676800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f677cff9700 1 -- 172.21.15.123:0/2507888454 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768005d90 con 0x7f67800b3750 2024-09-13T17:09:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f677cff9700 1 -- 172.21.15.123:0/2507888454 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67680070d0 con 0x7f67800b3750 2024-09-13T17:09:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f67855c6700 1 -- 172.21.15.123:0/2507888454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67800adf50 con 0x7f67800b3750 2024-09-13T17:09:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f677cff9700 1 -- 172.21.15.123:0/2507888454 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768007440 con 0x7f67800b3750 2024-09-13T17:09:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.343+0000 7f67855c6700 1 -- 172.21.15.123:0/2507888454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67800ae510 con 0x7f67800b3750 2024-09-13T17:09:00.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.347+0000 7f67855c6700 1 -- 172.21.15.123:0/2507888454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67800ae730 con 0x7f67800b3750 2024-09-13T17:09:00.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.347+0000 7f677cff9700 1 -- 172.21.15.123:0/2507888454 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f67680075a0 con 0x7f67800b3750 2024-09-13T17:09:00.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.347+0000 7f677cff9700 1 --2- 172.21.15.123:0/2507888454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6760066730 0x7f6760068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.347+0000 7f677cff9700 1 -- 172.21.15.123:0/2507888454 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6768083460 con 0x7f67800b3750 2024-09-13T17:09:00.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.347+0000 7f677ffff700 1 --2- 172.21.15.123:0/2507888454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6760066730 0x7f6760068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.347+0000 7f677ffff700 1 --2- 172.21.15.123:0/2507888454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6760066730 0x7f6760068bf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6770009b50 tx=0x7f6770009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:00.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.351+0000 7f677cff9700 1 -- 172.21.15.123:0/2507888454 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6768050880 con 0x7f67800b3750 2024-09-13T17:09:00.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.527+0000 7f67855c6700 1 -- 172.21.15.123:0/2507888454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67800b23e0 con 0x7f67800b3750 2024-09-13T17:09:00.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.527+0000 7f677cff9700 1 -- 172.21.15.123:0/2507888454 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16613 (secure 0 0 0) 0x7f6768053ea0 con 0x7f67800b3750 2024-09-13T17:09:00.534 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:00.534 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":60,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:50.340369+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:47.655349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:48.327675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:00.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.531+0000 7f67855c6700 1 -- 172.21.15.123:0/2507888454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6760066730 msgr2=0x7f6760068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.531+0000 7f67855c6700 1 --2- 172.21.15.123:0/2507888454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6760066730 0x7f6760068bf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6770009b50 tx=0x7f6770009240 comp rx=0 tx=0).stop 2024-09-13T17:09:00.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.531+0000 7f67855c6700 1 -- 172.21.15.123:0/2507888454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800b3750 msgr2=0x7f678015b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.531+0000 7f67855c6700 1 --2- 172.21.15.123:0/2507888454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800b3750 0x7f678015b970 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f676800c4f0 tx=0x7f676800c800 comp rx=0 tx=0).stop 2024-09-13T17:09:00.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.531+0000 7f67855c6700 1 -- 172.21.15.123:0/2507888454 shutdown_connections 2024-09-13T17:09:00.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.531+0000 7f67855c6700 1 --2- 172.21.15.123:0/2507888454 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6760066730 0x7f6760068bf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.531+0000 7f67855c6700 1 --2- 172.21.15.123:0/2507888454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678015a780 0x7f678014e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.531+0000 7f67855c6700 1 --2- 172.21.15.123:0/2507888454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800b3750 0x7f678015b970 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.531+0000 7f67855c6700 1 --2- 172.21.15.123:0/2507888454 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800b2af0 0x7f67800ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.531+0000 7f67855c6700 1 -- 172.21.15.123:0/2507888454 >> 172.21.15.123:0/2507888454 conn(0x7f6780066150 msgr2=0x7f67800ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:00.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.531+0000 7f67855c6700 1 -- 172.21.15.123:0/2507888454 shutdown_connections 2024-09-13T17:09:00.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.531+0000 7f67855c6700 1 -- 172.21.15.123:0/2507888454 wait complete. 2024-09-13T17:09:00.549 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:08:47.655349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:08:48.327675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:09:00.550 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:09:00.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.663+0000 7f5bd0be5700 1 Processor -- start 2024-09-13T17:09:00.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.663+0000 7f5bd0be5700 1 -- start start 2024-09-13T17:09:00.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.663+0000 7f5bd0be5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5bcc0cb7e0 0x7f5bcc0c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.663+0000 7f5bd0be5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5bcc06bdb0 0x7f5bcc071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.663+0000 7f5bd0be5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5bcc0c1480 0x7f5bcc072090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.663+0000 7f5bd0be5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bcc0ca750 con 0x7f5bcc0cb7e0 2024-09-13T17:09:00.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.663+0000 7f5bd0be5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bcc0c9210 con 0x7f5bcc06bdb0 2024-09-13T17:09:00.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.663+0000 7f5bd0be5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc1617b0 con 0x7f5bcc0c1480 2024-09-13T17:09:00.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.663+0000 7f5bcb7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5bcc0cb7e0 0x7f5bcc0c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.663+0000 7f5bcb7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5bcc0cb7e0 0x7f5bcc0c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41722/0 (socket says 172.21.15.123:41722) 2024-09-13T17:09:00.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.663+0000 7f5bcb7fe700 1 -- 172.21.15.123:0/1991745078 learned_addr learned my addr 172.21.15.123:0/1991745078 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:00.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.663+0000 7f5bcbfff700 1 --2- 172.21.15.123:0/1991745078 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5bcc0c1480 0x7f5bcc072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.663+0000 7f5bcaffd700 1 --2- 172.21.15.123:0/1991745078 >> v2:172.21.15.153:3300/0 conn(0x7f5bcc06bdb0 0x7f5bcc071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.663+0000 7f5bcb7fe700 1 -- 172.21.15.123:0/1991745078 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5bcc0c1480 msgr2=0x7f5bcc072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:00.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bcb7fe700 1 --2- 172.21.15.123:0/1991745078 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5bcc0c1480 0x7f5bcc072090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bcb7fe700 1 -- 172.21.15.123:0/1991745078 >> v2:172.21.15.153:3300/0 conn(0x7f5bcc06bdb0 msgr2=0x7f5bcc071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:00.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bcb7fe700 1 --2- 172.21.15.123:0/1991745078 >> v2:172.21.15.153:3300/0 conn(0x7f5bcc06bdb0 0x7f5bcc071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bcb7fe700 1 -- 172.21.15.123:0/1991745078 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc0cbbc0 con 0x7f5bcc0cb7e0 2024-09-13T17:09:00.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bcaffd700 1 --2- 172.21.15.123:0/1991745078 >> v2:172.21.15.153:3300/0 conn(0x7f5bcc06bdb0 0x7f5bcc071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:00.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bcb7fe700 1 --2- 172.21.15.123:0/1991745078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bcc0cb7e0 0x7f5bcc0c8cd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0c56e0 tx=0x7f5bb4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fa667170cf01bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:00.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bca7fc700 1 -- 172.21.15.123:0/1991745078 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4011830 con 0x7f5bcc0cb7e0 2024-09-13T17:09:00.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bca7fc700 1 -- 172.21.15.123:0/1991745078 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb4011990 con 0x7f5bcc0cb7e0 2024-09-13T17:09:00.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bca7fc700 1 -- 172.21.15.123:0/1991745078 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4011d20 con 0x7f5bcc0cb7e0 2024-09-13T17:09:00.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bd0be5700 1 -- 172.21.15.123:0/1991745078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bcc0cb7e0 msgr2=0x7f5bcc0c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bd0be5700 1 --2- 172.21.15.123:0/1991745078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bcc0cb7e0 0x7f5bcc0c8cd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0c56e0 tx=0x7f5bb4009bf0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bd0be5700 1 -- 172.21.15.123:0/1991745078 shutdown_connections 2024-09-13T17:09:00.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bd0be5700 1 --2- 172.21.15.123:0/1991745078 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5bcc0c1480 0x7f5bcc072090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bd0be5700 1 --2- 172.21.15.123:0/1991745078 >> v2:172.21.15.153:3300/0 conn(0x7f5bcc06bdb0 0x7f5bcc071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bd0be5700 1 --2- 172.21.15.123:0/1991745078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bcc0cb7e0 0x7f5bcc0c8cd0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bd0be5700 1 -- 172.21.15.123:0/1991745078 >> 172.21.15.123:0/1991745078 conn(0x7f5bcc0b01d0 msgr2=0x7f5bcc0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:00.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bd0be5700 1 -- 172.21.15.123:0/1991745078 shutdown_connections 2024-09-13T17:09:00.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bd0be5700 1 -- 172.21.15.123:0/1991745078 wait complete. 2024-09-13T17:09:00.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bd0be5700 1 Processor -- start 2024-09-13T17:09:00.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.667+0000 7f5bd0be5700 1 -- start start 2024-09-13T17:09:00.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bd0be5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bcc06bdb0 0x7f5bcc163480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bd0be5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5bcc0c1480 0x7f5bcc1639c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bd0be5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bcc0cb7e0 0x7f5bcc0b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bd0be5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc1f7960 con 0x7f5bcc06bdb0 2024-09-13T17:09:00.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bd0be5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0b2ae0 con 0x7f5bcc0cb7e0 2024-09-13T17:09:00.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bd0be5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0b2dc0 con 0x7f5bcc0c1480 2024-09-13T17:09:00.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bcb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bcc06bdb0 0x7f5bcc163480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bcb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bcc06bdb0 0x7f5bcc163480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41726/0 (socket says 172.21.15.123:41726) 2024-09-13T17:09:00.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bcb7fe700 1 -- 172.21.15.123:0/4040170397 learned_addr learned my addr 172.21.15.123:0/4040170397 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:00.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bcaffd700 1 --2- 172.21.15.123:0/4040170397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5bcc0c1480 0x7f5bcc1639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bcbfff700 1 --2- 172.21.15.123:0/4040170397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bcc0cb7e0 0x7f5bcc0b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bcb7fe700 1 -- 172.21.15.123:0/4040170397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5bcc0c1480 msgr2=0x7f5bcc1639c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bcb7fe700 1 --2- 172.21.15.123:0/4040170397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5bcc0c1480 0x7f5bcc1639c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bcb7fe700 1 -- 172.21.15.123:0/4040170397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bcc0cb7e0 msgr2=0x7f5bcc0b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bcb7fe700 1 --2- 172.21.15.123:0/4040170397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bcc0cb7e0 0x7f5bcc0b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bcb7fe700 1 -- 172.21.15.123:0/4040170397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb4009570 con 0x7f5bcc06bdb0 2024-09-13T17:09:00.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bcb7fe700 1 --2- 172.21.15.123:0/4040170397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bcc06bdb0 0x7f5bcc163480 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0cf750 tx=0x7f5bb4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:00.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bc3fff700 1 -- 172.21.15.123:0/4040170397 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb40044d0 con 0x7f5bcc06bdb0 2024-09-13T17:09:00.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bc3fff700 1 -- 172.21.15.123:0/4040170397 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb401f070 con 0x7f5bcc06bdb0 2024-09-13T17:09:00.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bd0be5700 1 -- 172.21.15.123:0/4040170397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bcc0b30a0 con 0x7f5bcc06bdb0 2024-09-13T17:09:00.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bc3fff700 1 -- 172.21.15.123:0/4040170397 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4003900 con 0x7f5bcc06bdb0 2024-09-13T17:09:00.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bd0be5700 1 -- 172.21.15.123:0/4040170397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bcc1f7f40 con 0x7f5bcc06bdb0 2024-09-13T17:09:00.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.671+0000 7f5bd0be5700 1 -- 172.21.15.123:0/4040170397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bcc0b32e0 con 0x7f5bcc06bdb0 2024-09-13T17:09:00.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.675+0000 7f5bc3fff700 1 -- 172.21.15.123:0/4040170397 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5bb4003a60 con 0x7f5bcc06bdb0 2024-09-13T17:09:00.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.675+0000 7f5bc3fff700 1 --2- 172.21.15.123:0/4040170397 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5bac066730 0x7f5bac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.675+0000 7f5bcaffd700 1 --2- 172.21.15.123:0/4040170397 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5bac066730 0x7f5bac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.675+0000 7f5bc3fff700 1 -- 172.21.15.123:0/4040170397 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bb4021070 con 0x7f5bcc06bdb0 2024-09-13T17:09:00.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.675+0000 7f5bcaffd700 1 --2- 172.21.15.123:0/4040170397 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5bac066730 0x7f5bac068bf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0c2260 tx=0x7f5bbc008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:00.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.679+0000 7f5bc3fff700 1 -- 172.21.15.123:0/4040170397 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5bb4052920 con 0x7f5bcc06bdb0 2024-09-13T17:09:00.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.847+0000 7f5bd0be5700 1 -- 172.21.15.123:0/4040170397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5bcc0c8cd0 con 0x7f5bcc06bdb0 2024-09-13T17:09:00.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.847+0000 7f5bc3fff700 1 -- 172.21.15.123:0/4040170397 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5bb4055f40 con 0x7f5bcc06bdb0 2024-09-13T17:09:00.852 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:09:00.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.851+0000 7f5bd0be5700 1 -- 172.21.15.123:0/4040170397 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5bac066730 msgr2=0x7f5bac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.851+0000 7f5bd0be5700 1 --2- 172.21.15.123:0/4040170397 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5bac066730 0x7f5bac068bf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0c2260 tx=0x7f5bbc008040 comp rx=0 tx=0).stop 2024-09-13T17:09:00.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.851+0000 7f5bd0be5700 1 -- 172.21.15.123:0/4040170397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bcc06bdb0 msgr2=0x7f5bcc163480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.851+0000 7f5bd0be5700 1 --2- 172.21.15.123:0/4040170397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bcc06bdb0 0x7f5bcc163480 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0cf750 tx=0x7f5bb4004770 comp rx=0 tx=0).stop 2024-09-13T17:09:00.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.851+0000 7f5bd0be5700 1 -- 172.21.15.123:0/4040170397 shutdown_connections 2024-09-13T17:09:00.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.851+0000 7f5bd0be5700 1 --2- 172.21.15.123:0/4040170397 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5bac066730 0x7f5bac068bf0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.851+0000 7f5bd0be5700 1 --2- 172.21.15.123:0/4040170397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bcc0cb7e0 0x7f5bcc0b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.851+0000 7f5bd0be5700 1 --2- 172.21.15.123:0/4040170397 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5bcc0c1480 0x7f5bcc1639c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.851+0000 7f5bd0be5700 1 --2- 172.21.15.123:0/4040170397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5bcc06bdb0 0x7f5bcc163480 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.851+0000 7f5bd0be5700 1 -- 172.21.15.123:0/4040170397 >> 172.21.15.123:0/4040170397 conn(0x7f5bcc0b01d0 msgr2=0x7f5bcc0ae420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:00.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.851+0000 7f5bd0be5700 1 -- 172.21.15.123:0/4040170397 shutdown_connections 2024-09-13T17:09:00.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.851+0000 7f5bd0be5700 1 -- 172.21.15.123:0/4040170397 wait complete. 2024-09-13T17:09:00.867 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:09:00.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.979+0000 7f4bdf028700 1 Processor -- start 2024-09-13T17:09:00.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.979+0000 7f4bdf028700 1 -- start start 2024-09-13T17:09:00.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdf028700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4bd80cc520 0x7f4bd80b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdf028700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bd806ca30 0x7f4bd806ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdf028700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd815b180 con 0x7f4bd815e820 2024-09-13T17:09:00.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdf028700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd806b280 con 0x7f4bd80cc520 2024-09-13T17:09:00.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdf028700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd815f3a0 con 0x7f4bd806ca30 2024-09-13T17:09:00.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdd5c5700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4bd815e820 0x7f4bd815ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44358/0 (socket says 172.21.15.123:44358) 2024-09-13T17:09:00.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdd5c5700 1 -- 172.21.15.123:0/1255926073 learned_addr learned my addr 172.21.15.123:0/1255926073 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:00.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdcdc4700 1 --2- 172.21.15.123:0/1255926073 >> v2:172.21.15.123:3300/0 conn(0x7f4bd80cc520 0x7f4bd80b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bd7fff700 1 --2- 172.21.15.123:0/1255926073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bd806ca30 0x7f4bd806ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdcdc4700 1 -- 172.21.15.123:0/1255926073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bd806ca30 msgr2=0x7f4bd806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:00.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdcdc4700 1 --2- 172.21.15.123:0/1255926073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bd806ca30 0x7f4bd806ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdcdc4700 1 -- 172.21.15.123:0/1255926073 >> v1:172.21.15.123:6789/0 conn(0x7f4bd815e820 legacy=0x7f4bd815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdcdc4700 1 -- 172.21.15.123:0/1255926073 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd815f5f0 con 0x7f4bd80cc520 2024-09-13T17:09:00.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bd77fe700 1 -- 172.21.15.123:0/1255926073 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789573269 0 0) 0x7f4bd0001490 con 0x7f4bd815e820 2024-09-13T17:09:00.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdcdc4700 1 --2- 172.21.15.123:0/1255926073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bd80cc520 0x7f4bd80b4fb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009850 tx=0x7f4bcc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c59b00bb7047d35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:00.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bd77fe700 1 -- 172.21.15.123:0/1255926073 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc011830 con 0x7f4bd80cc520 2024-09-13T17:09:00.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bd77fe700 1 -- 172.21.15.123:0/1255926073 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc011990 con 0x7f4bd80cc520 2024-09-13T17:09:00.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bd77fe700 1 -- 172.21.15.123:0/1255926073 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc011d40 con 0x7f4bd80cc520 2024-09-13T17:09:00.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdf028700 1 -- 172.21.15.123:0/1255926073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bd80cc520 msgr2=0x7f4bd80b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdf028700 1 --2- 172.21.15.123:0/1255926073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bd80cc520 0x7f4bd80b4fb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009850 tx=0x7f4bcc009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:00.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdf028700 1 -- 172.21.15.123:0/1255926073 shutdown_connections 2024-09-13T17:09:00.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdf028700 1 --2- 172.21.15.123:0/1255926073 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bd806ca30 0x7f4bd806ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdf028700 1 --2- 172.21.15.123:0/1255926073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bd80cc520 0x7f4bd80b4fb0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdf028700 1 -- 172.21.15.123:0/1255926073 >> 172.21.15.123:0/1255926073 conn(0x7f4bd80b0eb0 msgr2=0x7f4bd80b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:00.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdf028700 1 -- 172.21.15.123:0/1255926073 shutdown_connections 2024-09-13T17:09:00.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.983+0000 7f4bdf028700 1 -- 172.21.15.123:0/1255926073 wait complete. 2024-09-13T17:09:00.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdf028700 1 Processor -- start 2024-09-13T17:09:00.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdf028700 1 -- start start 2024-09-13T17:09:00.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdf028700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bd806ca30 0x7f4bd80ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdf028700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bd80cc520 0x7f4bd81f06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdf028700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bd815e820 0x7f4bd80c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdf028700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd8159160 con 0x7f4bd815e820 2024-09-13T17:09:00.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdf028700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80c67f0 con 0x7f4bd806ca30 2024-09-13T17:09:00.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdf028700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80c64f0 con 0x7f4bd80cc520 2024-09-13T17:09:00.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdd5c5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bd815e820 0x7f4bd80c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdd5c5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bd815e820 0x7f4bd80c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41742/0 (socket says 172.21.15.123:41742) 2024-09-13T17:09:00.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdd5c5700 1 -- 172.21.15.123:0/1044223810 learned_addr learned my addr 172.21.15.123:0/1044223810 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:00.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdcdc4700 1 --2- 172.21.15.123:0/1044223810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bd806ca30 0x7f4bd80ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bd7fff700 1 --2- 172.21.15.123:0/1044223810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bd80cc520 0x7f4bd81f06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdd5c5700 1 -- 172.21.15.123:0/1044223810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bd80cc520 msgr2=0x7f4bd81f06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdd5c5700 1 --2- 172.21.15.123:0/1044223810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bd80cc520 0x7f4bd81f06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdd5c5700 1 -- 172.21.15.123:0/1044223810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bd806ca30 msgr2=0x7f4bd80ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:00.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdd5c5700 1 --2- 172.21.15.123:0/1044223810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bd806ca30 0x7f4bd80ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:00.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdd5c5700 1 -- 172.21.15.123:0/1044223810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc0094b0 con 0x7f4bd815e820 2024-09-13T17:09:00.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdd5c5700 1 --2- 172.21.15.123:0/1044223810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bd815e820 0x7f4bd80c6c80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000cac0 tx=0x7f4bd000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:00.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bd57fa700 1 -- 172.21.15.123:0/1044223810 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000a7b0 con 0x7f4bd815e820 2024-09-13T17:09:00.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bd57fa700 1 -- 172.21.15.123:0/1044223810 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd000a910 con 0x7f4bd815e820 2024-09-13T17:09:00.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdf028700 1 -- 172.21.15.123:0/1044223810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd81f0f50 con 0x7f4bd815e820 2024-09-13T17:09:00.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bd57fa700 1 -- 172.21.15.123:0/1044223810 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000aca0 con 0x7f4bd815e820 2024-09-13T17:09:00.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.987+0000 7f4bdf028700 1 -- 172.21.15.123:0/1044223810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd81f0bf0 con 0x7f4bd815e820 2024-09-13T17:09:00.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.991+0000 7f4bdf028700 1 -- 172.21.15.123:0/1044223810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd80cae30 con 0x7f4bd815e820 2024-09-13T17:09:00.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.991+0000 7f4bd57fa700 1 -- 172.21.15.123:0/1044223810 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4bd001b3b0 con 0x7f4bd815e820 2024-09-13T17:09:00.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.991+0000 7f4bd57fa700 1 --2- 172.21.15.123:0/1044223810 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4bbc066730 0x7f4bbc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:00.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.991+0000 7f4bdcdc4700 1 --2- 172.21.15.123:0/1044223810 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4bbc066730 0x7f4bbc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:00.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.991+0000 7f4bd57fa700 1 -- 172.21.15.123:0/1044223810 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bd00839b0 con 0x7f4bd815e820 2024-09-13T17:09:00.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.991+0000 7f4bdcdc4700 1 --2- 172.21.15.123:0/1044223810 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4bbc066730 0x7f4bbc068bf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0090b0 tx=0x7f4bcc008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:01.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:00.999+0000 7f4bd57fa700 1 -- 172.21.15.123:0/1044223810 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4bd0050d20 con 0x7f4bd815e820 2024-09-13T17:09:01.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.163+0000 7f4bdf028700 1 -- 172.21.15.123:0/1044223810 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4bd815c2e0 con 0x7f4bd815e820 2024-09-13T17:09:01.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.163+0000 7f4bd57fa700 1 -- 172.21.15.123:0/1044223810 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4bd0017020 con 0x7f4bd815e820 2024-09-13T17:09:01.168 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:09:01.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.163+0000 7f4bdf028700 1 -- 172.21.15.123:0/1044223810 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4bbc066730 msgr2=0x7f4bbc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.163+0000 7f4bdf028700 1 --2- 172.21.15.123:0/1044223810 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4bbc066730 0x7f4bbc068bf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0090b0 tx=0x7f4bcc008030 comp rx=0 tx=0).stop 2024-09-13T17:09:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.163+0000 7f4bdf028700 1 -- 172.21.15.123:0/1044223810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bd815e820 msgr2=0x7f4bd80c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.163+0000 7f4bdf028700 1 --2- 172.21.15.123:0/1044223810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bd815e820 0x7f4bd80c6c80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000cac0 tx=0x7f4bd000cba0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.163+0000 7f4bdf028700 1 -- 172.21.15.123:0/1044223810 shutdown_connections 2024-09-13T17:09:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.163+0000 7f4bdf028700 1 --2- 172.21.15.123:0/1044223810 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4bbc066730 0x7f4bbc068bf0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.163+0000 7f4bdf028700 1 --2- 172.21.15.123:0/1044223810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bd815e820 0x7f4bd80c6c80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.163+0000 7f4bdf028700 1 --2- 172.21.15.123:0/1044223810 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bd80cc520 0x7f4bd81f06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.163+0000 7f4bdf028700 1 --2- 172.21.15.123:0/1044223810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bd806ca30 0x7f4bd80ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.163+0000 7f4bdf028700 1 -- 172.21.15.123:0/1044223810 >> 172.21.15.123:0/1044223810 conn(0x7f4bd80b0eb0 msgr2=0x7f4bd80c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.163+0000 7f4bdf028700 1 -- 172.21.15.123:0/1044223810 shutdown_connections 2024-09-13T17:09:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.163+0000 7f4bdf028700 1 -- 172.21.15.123:0/1044223810 wait complete. 2024-09-13T17:09:01.182 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:09:01.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.295+0000 7fc8a7467700 1 Processor -- start 2024-09-13T17:09:01.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.295+0000 7fc8a7467700 1 -- start start 2024-09-13T17:09:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a7467700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc8a01506b0 0x7fc8a00b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a7467700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc8a00b37a0 0x7fc8a00b4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a7467700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a015e040 con 0x7fc8a015d4c0 2024-09-13T17:09:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a7467700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a00b3310 con 0x7fc8a01506b0 2024-09-13T17:09:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a7467700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a015e280 con 0x7fc8a00b37a0 2024-09-13T17:09:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a6465700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc8a01506b0 0x7fc8a00b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a6c66700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc8a015d4c0 0x7fc8a015d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44360/0 (socket says 172.21.15.123:44360) 2024-09-13T17:09:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a6c66700 1 -- 172.21.15.123:0/1258111931 learned_addr learned my addr 172.21.15.123:0/1258111931 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a5c64700 1 --2- 172.21.15.123:0/1258111931 >> v2:172.21.15.153:3300/0 conn(0x7fc8a00b37a0 0x7fc8a00b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a6465700 1 -- 172.21.15.123:0/1258111931 >> v2:172.21.15.153:3300/0 conn(0x7fc8a00b37a0 msgr2=0x7fc8a00b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:01.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a6465700 1 --2- 172.21.15.123:0/1258111931 >> v2:172.21.15.153:3300/0 conn(0x7fc8a00b37a0 0x7fc8a00b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a6465700 1 -- 172.21.15.123:0/1258111931 >> v1:172.21.15.123:6789/0 conn(0x7fc8a015d4c0 legacy=0x7fc8a015d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a6465700 1 -- 172.21.15.123:0/1258111931 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a00b29e0 con 0x7fc8a01506b0 2024-09-13T17:09:01.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a5c64700 1 --2- 172.21.15.123:0/1258111931 >> v2:172.21.15.153:3300/0 conn(0x7fc8a00b37a0 0x7fc8a00b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:01.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a5463700 1 -- 172.21.15.123:0/1258111931 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883668829 0 0) 0x7fc898001490 con 0x7fc8a015d4c0 2024-09-13T17:09:01.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a6465700 1 --2- 172.21.15.123:0/1258111931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8a01506b0 0x7fc8a00b4450 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0072890 tx=0x7fc89c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bee04c33f3f8471 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:01.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a5463700 1 -- 172.21.15.123:0/1258111931 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c011830 con 0x7fc8a01506b0 2024-09-13T17:09:01.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a5463700 1 -- 172.21.15.123:0/1258111931 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c011990 con 0x7fc8a01506b0 2024-09-13T17:09:01.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a5463700 1 -- 172.21.15.123:0/1258111931 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c011d40 con 0x7fc8a01506b0 2024-09-13T17:09:01.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a7467700 1 -- 172.21.15.123:0/1258111931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8a01506b0 msgr2=0x7fc8a00b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a7467700 1 --2- 172.21.15.123:0/1258111931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8a01506b0 0x7fc8a00b4450 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0072890 tx=0x7fc89c009b30 comp rx=0 tx=0).stop 2024-09-13T17:09:01.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a7467700 1 -- 172.21.15.123:0/1258111931 shutdown_connections 2024-09-13T17:09:01.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a7467700 1 --2- 172.21.15.123:0/1258111931 >> v2:172.21.15.153:3300/0 conn(0x7fc8a00b37a0 0x7fc8a00b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a7467700 1 --2- 172.21.15.123:0/1258111931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8a01506b0 0x7fc8a00b4450 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a7467700 1 -- 172.21.15.123:0/1258111931 >> 172.21.15.123:0/1258111931 conn(0x7fc8a0066780 msgr2=0x7fc8a00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:01.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a7467700 1 -- 172.21.15.123:0/1258111931 shutdown_connections 2024-09-13T17:09:01.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.299+0000 7fc8a7467700 1 -- 172.21.15.123:0/1258111931 wait complete. 2024-09-13T17:09:01.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.303+0000 7fc8a7467700 1 Processor -- start 2024-09-13T17:09:01.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.303+0000 7fc8a7467700 1 -- start start 2024-09-13T17:09:01.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.303+0000 7fc8a7467700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8a00b37a0 0x7fc8a01452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.303+0000 7fc8a7467700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8a01506b0 0x7fc8a0147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.303+0000 7fc8a7467700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8a015d4c0 0x7fc8a0147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.303+0000 7fc8a7467700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a01f42a0 con 0x7fc8a01506b0 2024-09-13T17:09:01.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.303+0000 7fc8a7467700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a01f36f0 con 0x7fc8a00b37a0 2024-09-13T17:09:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.303+0000 7fc8a7467700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a0148dc0 con 0x7fc8a015d4c0 2024-09-13T17:09:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.303+0000 7fc8a5c64700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8a01506b0 0x7fc8a0147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.303+0000 7fc8a5c64700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8a01506b0 0x7fc8a0147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41762/0 (socket says 172.21.15.123:41762) 2024-09-13T17:09:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.303+0000 7fc8a5c64700 1 -- 172.21.15.123:0/3155640824 learned_addr learned my addr 172.21.15.123:0/3155640824 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.303+0000 7fc8a6465700 1 --2- 172.21.15.123:0/3155640824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8a00b37a0 0x7fc8a01452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.303+0000 7fc8a6c66700 1 --2- 172.21.15.123:0/3155640824 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8a015d4c0 0x7fc8a0147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.307+0000 7fc8a5c64700 1 -- 172.21.15.123:0/3155640824 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8a015d4c0 msgr2=0x7fc8a0147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.307+0000 7fc8a5c64700 1 --2- 172.21.15.123:0/3155640824 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8a015d4c0 0x7fc8a0147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.307+0000 7fc8a5c64700 1 -- 172.21.15.123:0/3155640824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8a00b37a0 msgr2=0x7fc8a01452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.307+0000 7fc8a5c64700 1 --2- 172.21.15.123:0/3155640824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8a00b37a0 0x7fc8a01452d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.307+0000 7fc8a5c64700 1 -- 172.21.15.123:0/3155640824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c0094b0 con 0x7fc8a01506b0 2024-09-13T17:09:01.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.307+0000 7fc8a5c64700 1 --2- 172.21.15.123:0/3155640824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8a01506b0 0x7fc8a0147810 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc89000e840 tx=0x7fc89000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:01.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.307+0000 7fc896ffd700 1 -- 172.21.15.123:0/3155640824 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890004230 con 0x7fc8a01506b0 2024-09-13T17:09:01.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.307+0000 7fc896ffd700 1 -- 172.21.15.123:0/3155640824 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc890004390 con 0x7fc8a01506b0 2024-09-13T17:09:01.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.307+0000 7fc8a7467700 1 -- 172.21.15.123:0/3155640824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a0145810 con 0x7fc8a01506b0 2024-09-13T17:09:01.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.307+0000 7fc896ffd700 1 -- 172.21.15.123:0/3155640824 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8900036c0 con 0x7fc8a01506b0 2024-09-13T17:09:01.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.307+0000 7fc8a7467700 1 -- 172.21.15.123:0/3155640824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a01f3be0 con 0x7fc8a01506b0 2024-09-13T17:09:01.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.307+0000 7fc8a7467700 1 -- 172.21.15.123:0/3155640824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a01f43e0 con 0x7fc8a01506b0 2024-09-13T17:09:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.307+0000 7fc896ffd700 1 -- 172.21.15.123:0/3155640824 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc890003840 con 0x7fc8a01506b0 2024-09-13T17:09:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.311+0000 7fc896ffd700 1 --2- 172.21.15.123:0/3155640824 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc884066730 0x7fc884068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.311+0000 7fc896ffd700 1 -- 172.21.15.123:0/3155640824 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc890083aa0 con 0x7fc8a01506b0 2024-09-13T17:09:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.311+0000 7fc8a6465700 1 --2- 172.21.15.123:0/3155640824 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc884066730 0x7fc884068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.311+0000 7fc8a6465700 1 --2- 172.21.15.123:0/3155640824 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc884066730 0x7fc884068bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0090b0 tx=0x7fc89c01c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:01.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.319+0000 7fc896ffd700 1 -- 172.21.15.123:0/3155640824 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc8a01f43e0 con 0x7fc8a01506b0 2024-09-13T17:09:01.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.491+0000 7fc8a7467700 1 -- 172.21.15.123:0/3155640824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8a01f43e0 con 0x7fc8a01506b0 2024-09-13T17:09:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.491+0000 7fc896ffd700 1 -- 172.21.15.123:0/3155640824 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc8a01f43e0 con 0x7fc8a01506b0 2024-09-13T17:09:01.495 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:09:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.495+0000 7fc8a7467700 1 -- 172.21.15.123:0/3155640824 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc884066730 msgr2=0x7fc884068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.495+0000 7fc8a7467700 1 --2- 172.21.15.123:0/3155640824 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc884066730 0x7fc884068bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0090b0 tx=0x7fc89c01c040 comp rx=0 tx=0).stop 2024-09-13T17:09:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.495+0000 7fc8a7467700 1 -- 172.21.15.123:0/3155640824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8a01506b0 msgr2=0x7fc8a0147810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.495+0000 7fc8a7467700 1 --2- 172.21.15.123:0/3155640824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8a01506b0 0x7fc8a0147810 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc89000e840 tx=0x7fc89000eb50 comp rx=0 tx=0).stop 2024-09-13T17:09:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.495+0000 7fc8a7467700 1 -- 172.21.15.123:0/3155640824 shutdown_connections 2024-09-13T17:09:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.495+0000 7fc8a7467700 1 --2- 172.21.15.123:0/3155640824 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc884066730 0x7fc884068bf0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.495+0000 7fc8a7467700 1 --2- 172.21.15.123:0/3155640824 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8a015d4c0 0x7fc8a0147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.495+0000 7fc8a7467700 1 --2- 172.21.15.123:0/3155640824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8a01506b0 0x7fc8a0147810 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.495+0000 7fc8a7467700 1 --2- 172.21.15.123:0/3155640824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8a00b37a0 0x7fc8a01452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.495+0000 7fc8a7467700 1 -- 172.21.15.123:0/3155640824 >> 172.21.15.123:0/3155640824 conn(0x7fc8a0066780 msgr2=0x7fc8a00b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.495+0000 7fc8a7467700 1 -- 172.21.15.123:0/3155640824 shutdown_connections 2024-09-13T17:09:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.495+0000 7fc8a7467700 1 -- 172.21.15.123:0/3155640824 wait complete. 2024-09-13T17:09:01.515 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:09:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.623+0000 7fc45d074700 1 Processor -- start 2024-09-13T17:09:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.623+0000 7fc45d074700 1 -- start start 2024-09-13T17:09:01.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc458159750 0x7fc4580ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4580cd2a0 0x7fc4580af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc458159b30 0x7fc4580afa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45806d6f0 con 0x7fc458159750 2024-09-13T17:09:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45806d9d0 con 0x7fc458159b30 2024-09-13T17:09:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580c8f70 con 0x7fc4580cd2a0 2024-09-13T17:09:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc456d9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc458159750 0x7fc4580ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc456d9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc458159750 0x7fc4580ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41770/0 (socket says 172.21.15.123:41770) 2024-09-13T17:09:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc458159b30 0x7fc4580afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc456d9d700 1 -- 172.21.15.123:0/4129367879 learned_addr learned my addr 172.21.15.123:0/4129367879 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc44ffff700 1 --2- 172.21.15.123:0/4129367879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4580cd2a0 0x7fc4580af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc456d9d700 1 -- 172.21.15.123:0/4129367879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4580cd2a0 msgr2=0x7fc4580af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc456d9d700 1 --2- 172.21.15.123:0/4129367879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4580cd2a0 0x7fc4580af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc456d9d700 1 -- 172.21.15.123:0/4129367879 >> v2:172.21.15.153:3300/0 conn(0x7fc458159b30 msgr2=0x7fc4580afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:01.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc456d9d700 1 --2- 172.21.15.123:0/4129367879 >> v2:172.21.15.153:3300/0 conn(0x7fc458159b30 0x7fc4580afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc456d9d700 1 -- 172.21.15.123:0/4129367879 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4580c9250 con 0x7fc458159750 2024-09-13T17:09:01.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc456d9d700 1 --2- 172.21.15.123:0/4129367879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc458159750 0x7fc4580ccd60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc45815a010 tx=0x7fc448009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad328e386f66c4ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:01.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45659c700 1 -- 172.21.15.123:0/4129367879 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448011830 con 0x7fc458159750 2024-09-13T17:09:01.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45659c700 1 -- 172.21.15.123:0/4129367879 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc448011990 con 0x7fc458159750 2024-09-13T17:09:01.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45659c700 1 -- 172.21.15.123:0/4129367879 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448011d20 con 0x7fc458159750 2024-09-13T17:09:01.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 -- 172.21.15.123:0/4129367879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc458159750 msgr2=0x7fc4580ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 --2- 172.21.15.123:0/4129367879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc458159750 0x7fc4580ccd60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc45815a010 tx=0x7fc448009bf0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 -- 172.21.15.123:0/4129367879 shutdown_connections 2024-09-13T17:09:01.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 --2- 172.21.15.123:0/4129367879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4580cd2a0 0x7fc4580af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 --2- 172.21.15.123:0/4129367879 >> v2:172.21.15.153:3300/0 conn(0x7fc458159b30 0x7fc4580afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 --2- 172.21.15.123:0/4129367879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc458159750 0x7fc4580ccd60 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 -- 172.21.15.123:0/4129367879 >> 172.21.15.123:0/4129367879 conn(0x7fc4580b0450 msgr2=0x7fc4580b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:01.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 -- 172.21.15.123:0/4129367879 shutdown_connections 2024-09-13T17:09:01.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.627+0000 7fc45d074700 1 -- 172.21.15.123:0/4129367879 wait complete. 2024-09-13T17:09:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc45d074700 1 Processor -- start 2024-09-13T17:09:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc45d074700 1 -- start start 2024-09-13T17:09:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc45d074700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4580cd2a0 0x7fc458151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc45d074700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc458159750 0x7fc4580c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc45d074700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc458159b30 0x7fc4580c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc45d074700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580b3f60 con 0x7fc4580cd2a0 2024-09-13T17:09:01.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc45d074700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580b4240 con 0x7fc458159750 2024-09-13T17:09:01.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc45d074700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580c25d0 con 0x7fc458159b30 2024-09-13T17:09:01.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc456d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4580cd2a0 0x7fc458151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc456d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4580cd2a0 0x7fc458151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41780/0 (socket says 172.21.15.123:41780) 2024-09-13T17:09:01.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc456d9d700 1 -- 172.21.15.123:0/3401465563 learned_addr learned my addr 172.21.15.123:0/3401465563 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc44ffff700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc458159750 0x7fc4580c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc45759e700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc458159b30 0x7fc4580c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc456d9d700 1 -- 172.21.15.123:0/3401465563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc458159b30 msgr2=0x7fc4580c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc456d9d700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc458159b30 0x7fc4580c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc456d9d700 1 -- 172.21.15.123:0/3401465563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc458159750 msgr2=0x7fc4580c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.631+0000 7fc456d9d700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc458159750 0x7fc4580c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.635+0000 7fc456d9d700 1 -- 172.21.15.123:0/3401465563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc448009570 con 0x7fc4580cd2a0 2024-09-13T17:09:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.635+0000 7fc45759e700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc458159b30 0x7fc4580c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.635+0000 7fc456d9d700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4580cd2a0 0x7fc458151680 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc4580cb260 tx=0x7fc448004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.635+0000 7fc44f7fe700 1 -- 172.21.15.123:0/3401465563 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448004300 con 0x7fc4580cd2a0 2024-09-13T17:09:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.635+0000 7fc44f7fe700 1 -- 172.21.15.123:0/3401465563 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44801f070 con 0x7fc4580cd2a0 2024-09-13T17:09:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.635+0000 7fc44f7fe700 1 -- 172.21.15.123:0/3401465563 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4480036c0 con 0x7fc4580cd2a0 2024-09-13T17:09:01.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.635+0000 7fc45d074700 1 -- 172.21.15.123:0/3401465563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4580c28b0 con 0x7fc4580cd2a0 2024-09-13T17:09:01.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.635+0000 7fc45d074700 1 -- 172.21.15.123:0/3401465563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc458151bc0 con 0x7fc4580cd2a0 2024-09-13T17:09:01.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.635+0000 7fc45d074700 1 -- 172.21.15.123:0/3401465563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4580ccd60 con 0x7fc4580cd2a0 2024-09-13T17:09:01.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.635+0000 7fc44f7fe700 1 -- 172.21.15.123:0/3401465563 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc448021030 con 0x7fc4580cd2a0 2024-09-13T17:09:01.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.635+0000 7fc44f7fe700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc43c066760 0x7fc43c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.635+0000 7fc44f7fe700 1 -- 172.21.15.123:0/3401465563 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4480852a0 con 0x7fc4580cd2a0 2024-09-13T17:09:01.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.635+0000 7fc44ffff700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc43c066760 0x7fc43c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.639+0000 7fc44ffff700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc43c066760 0x7fc43c068c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc4580b49f0 tx=0x7fc440008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:01.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.643+0000 7fc44f7fe700 1 -- 172.21.15.123:0/3401465563 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc4480527c0 con 0x7fc4580cd2a0 2024-09-13T17:09:01.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.823+0000 7fc45d074700 1 -- 172.21.15.123:0/3401465563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc4580cc910 con 0x7fc4580cd2a0 2024-09-13T17:09:01.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.823+0000 7fc44f7fe700 1 -- 172.21.15.123:0/3401465563 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc448055de0 con 0x7fc4580cd2a0 2024-09-13T17:09:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.823+0000 7fc45d074700 1 -- 172.21.15.123:0/3401465563 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc43c066760 msgr2=0x7fc43c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.823+0000 7fc45d074700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc43c066760 0x7fc43c068c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc4580b49f0 tx=0x7fc440008040 comp rx=0 tx=0).stop 2024-09-13T17:09:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.823+0000 7fc45d074700 1 -- 172.21.15.123:0/3401465563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4580cd2a0 msgr2=0x7fc458151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.823+0000 7fc45d074700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4580cd2a0 0x7fc458151680 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc4580cb260 tx=0x7fc448004770 comp rx=0 tx=0).stop 2024-09-13T17:09:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.823+0000 7fc45d074700 1 -- 172.21.15.123:0/3401465563 shutdown_connections 2024-09-13T17:09:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.823+0000 7fc45d074700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc43c066760 0x7fc43c068c20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.823+0000 7fc45d074700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc458159b30 0x7fc4580c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.823+0000 7fc45d074700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc458159750 0x7fc4580c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.823+0000 7fc45d074700 1 --2- 172.21.15.123:0/3401465563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4580cd2a0 0x7fc458151680 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.823+0000 7fc45d074700 1 -- 172.21.15.123:0/3401465563 >> 172.21.15.123:0/3401465563 conn(0x7fc4580b0450 msgr2=0x7fc4580721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.823+0000 7fc45d074700 1 -- 172.21.15.123:0/3401465563 shutdown_connections 2024-09-13T17:09:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:01.823+0000 7fc45d074700 1 -- 172.21.15.123:0/3401465563 wait complete. 2024-09-13T17:09:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:09:01.845 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2024-09-13T17:09:01.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:01.846 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:09:01.860 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[40818]: fuse finished with error 0 and tester_r 0 2024-09-13T17:09:01.861 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:09:01.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:01.862 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:09:01.986 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:09:01.986 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:01.994 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff46933c700 1 Processor -- start 2024-09-13T17:09:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff46933c700 1 -- start start 2024-09-13T17:09:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff46933c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff4640cec90 0x7ff4640adef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff46933c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4640ad9a0 0x7ff4640cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff46933c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff464071710 0x7ff464071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff46933c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4640cf5b0 con 0x7ff464071710 2024-09-13T17:09:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff46933c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46406d220 con 0x7ff4640cec90 2024-09-13T17:09:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff46933c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46406d500 con 0x7ff4640ad9a0 2024-09-13T17:09:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff4637fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff464071710 0x7ff464071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff4637fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff464071710 0x7ff464071ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42666/0 (socket says 172.21.15.123:42666) 2024-09-13T17:09:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff4637fe700 1 -- 172.21.15.123:0/3432737527 learned_addr learned my addr 172.21.15.123:0/3432737527 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff4627fc700 1 --2- 172.21.15.123:0/3432737527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4640ad9a0 0x7ff4640cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff462ffd700 1 --2- 172.21.15.123:0/3432737527 >> v2:172.21.15.153:3300/0 conn(0x7ff4640cec90 0x7ff4640adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff4637fe700 1 -- 172.21.15.123:0/3432737527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4640ad9a0 msgr2=0x7ff4640cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff4637fe700 1 --2- 172.21.15.123:0/3432737527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4640ad9a0 0x7ff4640cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff4637fe700 1 -- 172.21.15.123:0/3432737527 >> v2:172.21.15.153:3300/0 conn(0x7ff4640cec90 msgr2=0x7ff4640adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff4637fe700 1 --2- 172.21.15.123:0/3432737527 >> v2:172.21.15.153:3300/0 conn(0x7ff4640cec90 0x7ff4640adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff4637fe700 1 -- 172.21.15.123:0/3432737527 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46406d7e0 con 0x7ff464071710 2024-09-13T17:09:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff4627fc700 1 --2- 172.21.15.123:0/3432737527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4640ad9a0 0x7ff4640cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff4637fe700 1 --2- 172.21.15.123:0/3432737527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff464071710 0x7ff464071ba0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff4640cf850 tx=0x7ff45c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401ee053d5b8db01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:02.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff461ffb700 1 -- 172.21.15.123:0/3432737527 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c00b8a0 con 0x7ff464071710 2024-09-13T17:09:02.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff461ffb700 1 -- 172.21.15.123:0/3432737527 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c00ba00 con 0x7ff464071710 2024-09-13T17:09:02.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.111+0000 7ff461ffb700 1 -- 172.21.15.123:0/3432737527 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c00bd90 con 0x7ff464071710 2024-09-13T17:09:02.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.115+0000 7ff46933c700 1 -- 172.21.15.123:0/3432737527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff464071710 msgr2=0x7ff464071ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.115+0000 7ff46933c700 1 --2- 172.21.15.123:0/3432737527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff464071710 0x7ff464071ba0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff4640cf850 tx=0x7ff45c009bf0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.115+0000 7ff46933c700 1 -- 172.21.15.123:0/3432737527 shutdown_connections 2024-09-13T17:09:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.115+0000 7ff46933c700 1 --2- 172.21.15.123:0/3432737527 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4640ad9a0 0x7ff4640cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.115+0000 7ff46933c700 1 --2- 172.21.15.123:0/3432737527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff464071710 0x7ff464071ba0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.115+0000 7ff46933c700 1 --2- 172.21.15.123:0/3432737527 >> v2:172.21.15.153:3300/0 conn(0x7ff4640cec90 0x7ff4640adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.115+0000 7ff46933c700 1 -- 172.21.15.123:0/3432737527 >> 172.21.15.123:0/3432737527 conn(0x7ff464066570 msgr2=0x7ff464066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.115+0000 7ff46933c700 1 -- 172.21.15.123:0/3432737527 shutdown_connections 2024-09-13T17:09:02.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.115+0000 7ff46933c700 1 -- 172.21.15.123:0/3432737527 wait complete. 2024-09-13T17:09:02.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff46933c700 1 Processor -- start 2024-09-13T17:09:02.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff46933c700 1 -- start start 2024-09-13T17:09:02.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff46933c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff464071710 0x7ff464147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff46933c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4640ad9a0 0x7ff4640ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff46933c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4640cec90 0x7ff4640b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff46933c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46414ac10 con 0x7ff464071710 2024-09-13T17:09:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff46933c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff464149f90 con 0x7ff4640ad9a0 2024-09-13T17:09:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff46933c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46414a270 con 0x7ff4640cec90 2024-09-13T17:09:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff462ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff464071710 0x7ff464147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff462ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff464071710 0x7ff464147f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42676/0 (socket says 172.21.15.123:42676) 2024-09-13T17:09:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff462ffd700 1 -- 172.21.15.123:0/3267057212 learned_addr learned my addr 172.21.15.123:0/3267057212 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff4627fc700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4640ad9a0 0x7ff4640ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff4637fe700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4640cec90 0x7ff4640b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff462ffd700 1 -- 172.21.15.123:0/3267057212 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4640cec90 msgr2=0x7ff4640b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff462ffd700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4640cec90 0x7ff4640b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff462ffd700 1 -- 172.21.15.123:0/3267057212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4640ad9a0 msgr2=0x7ff4640ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff462ffd700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4640ad9a0 0x7ff4640ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff462ffd700 1 -- 172.21.15.123:0/3267057212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c009570 con 0x7ff464071710 2024-09-13T17:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff4637fe700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4640cec90 0x7ff4640b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff4627fc700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4640ad9a0 0x7ff4640ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff462ffd700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff464071710 0x7ff464147f50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff45800d800 tx=0x7ff45800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff44b7fe700 1 -- 172.21.15.123:0/3267057212 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580125f0 con 0x7ff464071710 2024-09-13T17:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff44b7fe700 1 -- 172.21.15.123:0/3267057212 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff458012750 con 0x7ff464071710 2024-09-13T17:09:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff46933c700 1 -- 172.21.15.123:0/3267057212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46414a550 con 0x7ff464071710 2024-09-13T17:09:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff44b7fe700 1 -- 172.21.15.123:0/3267057212 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458012ac0 con 0x7ff464071710 2024-09-13T17:09:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.119+0000 7ff46933c700 1 -- 172.21.15.123:0/3267057212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff464148490 con 0x7ff464071710 2024-09-13T17:09:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.123+0000 7ff46933c700 1 -- 172.21.15.123:0/3267057212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4640cf070 con 0x7ff464071710 2024-09-13T17:09:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.123+0000 7ff44b7fe700 1 -- 172.21.15.123:0/3267057212 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff458012c20 con 0x7ff464071710 2024-09-13T17:09:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.123+0000 7ff44b7fe700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff450066730 0x7ff450068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.123+0000 7ff44b7fe700 1 -- 172.21.15.123:0/3267057212 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4580843c0 con 0x7ff464071710 2024-09-13T17:09:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.123+0000 7ff4627fc700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff450066730 0x7ff450068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.123+0000 7ff4627fc700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff450066730 0x7ff450068bf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff464164400 tx=0x7ff454003ae0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:02.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.131+0000 7ff44b7fe700 1 -- 172.21.15.123:0/3267057212 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff4580517c0 con 0x7ff464071710 2024-09-13T17:09:02.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.307+0000 7ff46933c700 1 -- 172.21.15.123:0/3267057212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4640b2490 con 0x7ff464071710 2024-09-13T17:09:02.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.307+0000 7ff44b7fe700 1 -- 172.21.15.123:0/3267057212 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16613 (secure 0 0 0) 0x7ff458012ed0 con 0x7ff464071710 2024-09-13T17:09:02.313 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:02.313 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":60,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:50.340369+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:47.655349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:48.327675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.311+0000 7ff46933c700 1 -- 172.21.15.123:0/3267057212 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff450066730 msgr2=0x7ff450068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.311+0000 7ff46933c700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff450066730 0x7ff450068bf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff464164400 tx=0x7ff454003ae0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.311+0000 7ff46933c700 1 -- 172.21.15.123:0/3267057212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff464071710 msgr2=0x7ff464147f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.311+0000 7ff46933c700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff464071710 0x7ff464147f50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff45800d800 tx=0x7ff45800dbc0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.311+0000 7ff46933c700 1 -- 172.21.15.123:0/3267057212 shutdown_connections 2024-09-13T17:09:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.311+0000 7ff46933c700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff450066730 0x7ff450068bf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.311+0000 7ff46933c700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4640cec90 0x7ff4640b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.311+0000 7ff46933c700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4640ad9a0 0x7ff4640ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.311+0000 7ff46933c700 1 --2- 172.21.15.123:0/3267057212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff464071710 0x7ff464147f50 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.311+0000 7ff46933c700 1 -- 172.21.15.123:0/3267057212 >> 172.21.15.123:0/3267057212 conn(0x7ff464066570 msgr2=0x7ff464071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.311+0000 7ff46933c700 1 -- 172.21.15.123:0/3267057212 shutdown_connections 2024-09-13T17:09:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.311+0000 7ff46933c700 1 -- 172.21.15.123:0/3267057212 wait complete. 2024-09-13T17:09:02.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:08:47.655349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:08:48.327675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:09:02.334 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:09:02.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.447+0000 7fb4a160b700 1 Processor -- start 2024-09-13T17:09:02.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.447+0000 7fb4a160b700 1 -- start start 2024-09-13T17:09:02.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.447+0000 7fb4a160b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb49c0cd2b0 0x7fb49c15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.447+0000 7fb4a160b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb49c0cf740 con 0x7fb49c0ce790 2024-09-13T17:09:02.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.447+0000 7fb4a160b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb49c0cb2c0 con 0x7fb49c0ceb70 2024-09-13T17:09:02.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.447+0000 7fb4a160b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb49c0b61f0 con 0x7fb49c0cd2b0 2024-09-13T17:09:02.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.447+0000 7fb49bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb49c0ce790 0x7fb49c06bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60346/0 (socket says 172.21.15.123:60346) 2024-09-13T17:09:02.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.447+0000 7fb49bfff700 1 -- 172.21.15.123:0/1868606491 learned_addr learned my addr 172.21.15.123:0/1868606491 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:02.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.447+0000 7fb4937fe700 1 --2- 172.21.15.123:0/1868606491 >> v2:172.21.15.123:3300/0 conn(0x7fb49c0cd2b0 0x7fb49c15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.447+0000 7fb49b7fe700 1 -- 172.21.15.123:0/1868606491 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557713657 0 0) 0x7fb49c0cf740 con 0x7fb49c0ce790 2024-09-13T17:09:02.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.447+0000 7fb49b7fe700 1 -- 172.21.15.123:0/1868606491 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4880035d0 con 0x7fb49c0ce790 2024-09-13T17:09:02.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.447+0000 7fb4937fe700 1 -- 172.21.15.123:0/1868606491 >> v1:172.21.15.153:6789/0 conn(0x7fb49c0ceb70 legacy=0x7fb49c0af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.447+0000 7fb4937fe700 1 -- 172.21.15.123:0/1868606491 >> v1:172.21.15.123:6789/0 conn(0x7fb49c0ce790 legacy=0x7fb49c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.447+0000 7fb4937fe700 1 -- 172.21.15.123:0/1868606491 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c0cd770 con 0x7fb49c0cd2b0 2024-09-13T17:09:02.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.451+0000 7fb4937fe700 1 --2- 172.21.15.123:0/1868606491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb49c0cd2b0 0x7fb49c15a7d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb484009850 tx=0x7fb484009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a786c65c64796545 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:02.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.451+0000 7fb49b7fe700 1 -- 172.21.15.123:0/1868606491 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484011830 con 0x7fb49c0cd2b0 2024-09-13T17:09:02.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.451+0000 7fb49b7fe700 1 -- 172.21.15.123:0/1868606491 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb484011990 con 0x7fb49c0cd2b0 2024-09-13T17:09:02.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.451+0000 7fb49b7fe700 1 -- 172.21.15.123:0/1868606491 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484011d40 con 0x7fb49c0cd2b0 2024-09-13T17:09:02.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.451+0000 7fb4a160b700 1 -- 172.21.15.123:0/1868606491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb49c0cd2b0 msgr2=0x7fb49c15a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.451+0000 7fb4a160b700 1 --2- 172.21.15.123:0/1868606491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb49c0cd2b0 0x7fb49c15a7d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb484009850 tx=0x7fb484009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:02.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.451+0000 7fb4a160b700 1 -- 172.21.15.123:0/1868606491 shutdown_connections 2024-09-13T17:09:02.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.451+0000 7fb4a160b700 1 --2- 172.21.15.123:0/1868606491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb49c0cd2b0 0x7fb49c15a7d0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.451+0000 7fb4a160b700 1 -- 172.21.15.123:0/1868606491 >> 172.21.15.123:0/1868606491 conn(0x7fb49c06e090 msgr2=0x7fb49c06e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:02.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.451+0000 7fb4a160b700 1 -- 172.21.15.123:0/1868606491 shutdown_connections 2024-09-13T17:09:02.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.451+0000 7fb4a160b700 1 -- 172.21.15.123:0/1868606491 wait complete. 2024-09-13T17:09:02.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.451+0000 7fb4a160b700 1 Processor -- start 2024-09-13T17:09:02.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.451+0000 7fb4a160b700 1 -- start start 2024-09-13T17:09:02.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a160b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49c0cd2b0 0x7fb49c14b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a160b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb49c0ce790 0x7fb49c14bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a160b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb49c0ceb70 0x7fb49c0af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a160b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c0acf80 con 0x7fb49c0ceb70 2024-09-13T17:09:02.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a160b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c0b1660 con 0x7fb49c0ce790 2024-09-13T17:09:02.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a160b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c14eb50 con 0x7fb49c0cd2b0 2024-09-13T17:09:02.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a0e0a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb49c0ceb70 0x7fb49c0af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a0e0a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb49c0ceb70 0x7fb49c0af640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42692/0 (socket says 172.21.15.123:42692) 2024-09-13T17:09:02.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a0e0a700 1 -- 172.21.15.123:0/906701390 learned_addr learned my addr 172.21.15.123:0/906701390 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:02.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb49bfff700 1 --2- 172.21.15.123:0/906701390 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49c0cd2b0 0x7fb49c14b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4937fe700 1 --2- 172.21.15.123:0/906701390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb49c0ce790 0x7fb49c14bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a0e0a700 1 -- 172.21.15.123:0/906701390 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49c0cd2b0 msgr2=0x7fb49c14b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a0e0a700 1 --2- 172.21.15.123:0/906701390 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49c0cd2b0 0x7fb49c14b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a0e0a700 1 -- 172.21.15.123:0/906701390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb49c0ce790 msgr2=0x7fb49c14bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a0e0a700 1 --2- 172.21.15.123:0/906701390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb49c0ce790 0x7fb49c14bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a0e0a700 1 -- 172.21.15.123:0/906701390 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4840094b0 con 0x7fb49c0ceb70 2024-09-13T17:09:02.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a0e0a700 1 --2- 172.21.15.123:0/906701390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb49c0ceb70 0x7fb49c0af640 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb49400cb80 tx=0x7fb49400ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4997fa700 1 -- 172.21.15.123:0/906701390 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494003c20 con 0x7fb49c0ceb70 2024-09-13T17:09:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4997fa700 1 -- 172.21.15.123:0/906701390 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb494003d80 con 0x7fb49c0ceb70 2024-09-13T17:09:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a160b700 1 -- 172.21.15.123:0/906701390 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49c14b8e0 con 0x7fb49c0ceb70 2024-09-13T17:09:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4997fa700 1 -- 172.21.15.123:0/906701390 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49400aaa0 con 0x7fb49c0ceb70 2024-09-13T17:09:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.455+0000 7fb4a160b700 1 -- 172.21.15.123:0/906701390 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49c0b1b70 con 0x7fb49c0ceb70 2024-09-13T17:09:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.459+0000 7fb4a160b700 1 -- 172.21.15.123:0/906701390 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49c06bc70 con 0x7fb49c0ceb70 2024-09-13T17:09:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.459+0000 7fb4997fa700 1 -- 172.21.15.123:0/906701390 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb49400ac00 con 0x7fb49c0ceb70 2024-09-13T17:09:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.459+0000 7fb4997fa700 1 --2- 172.21.15.123:0/906701390 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb47c066730 0x7fb47c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.459+0000 7fb4997fa700 1 -- 172.21.15.123:0/906701390 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb494084100 con 0x7fb49c0ceb70 2024-09-13T17:09:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.459+0000 7fb49bfff700 1 --2- 172.21.15.123:0/906701390 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb47c066730 0x7fb47c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.459+0000 7fb49bfff700 1 --2- 172.21.15.123:0/906701390 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb47c066730 0x7fb47c068bf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb48c007fd0 tx=0x7fb48c007de0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:02.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.463+0000 7fb4997fa700 1 -- 172.21.15.123:0/906701390 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb4940513f0 con 0x7fb49c0ceb70 2024-09-13T17:09:02.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.631+0000 7fb4a160b700 1 -- 172.21.15.123:0/906701390 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb49c06c3e0 con 0x7fb49c0ceb70 2024-09-13T17:09:02.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.631+0000 7fb4997fa700 1 -- 172.21.15.123:0/906701390 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb494054a10 con 0x7fb49c0ceb70 2024-09-13T17:09:02.637 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:09:02.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.635+0000 7fb4a160b700 1 -- 172.21.15.123:0/906701390 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb47c066730 msgr2=0x7fb47c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.635+0000 7fb4a160b700 1 --2- 172.21.15.123:0/906701390 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb47c066730 0x7fb47c068bf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb48c007fd0 tx=0x7fb48c007de0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.635+0000 7fb4a160b700 1 -- 172.21.15.123:0/906701390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb49c0ceb70 msgr2=0x7fb49c0af640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.635+0000 7fb4a160b700 1 --2- 172.21.15.123:0/906701390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb49c0ceb70 0x7fb49c0af640 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb49400cb80 tx=0x7fb49400ce90 comp rx=0 tx=0).stop 2024-09-13T17:09:02.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.639+0000 7fb4a160b700 1 -- 172.21.15.123:0/906701390 shutdown_connections 2024-09-13T17:09:02.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.639+0000 7fb4a160b700 1 --2- 172.21.15.123:0/906701390 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb47c066730 0x7fb47c068bf0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.639+0000 7fb4a160b700 1 --2- 172.21.15.123:0/906701390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb49c0ceb70 0x7fb49c0af640 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.639+0000 7fb4a160b700 1 --2- 172.21.15.123:0/906701390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb49c0ce790 0x7fb49c14bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.639+0000 7fb4a160b700 1 --2- 172.21.15.123:0/906701390 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb49c0cd2b0 0x7fb49c14b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.639+0000 7fb4a160b700 1 -- 172.21.15.123:0/906701390 >> 172.21.15.123:0/906701390 conn(0x7fb49c06e090 msgr2=0x7fb49c0b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:02.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.639+0000 7fb4a160b700 1 -- 172.21.15.123:0/906701390 shutdown_connections 2024-09-13T17:09:02.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.639+0000 7fb4a160b700 1 -- 172.21.15.123:0/906701390 wait complete. 2024-09-13T17:09:02.658 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:09:02.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21d48f6700 1 Processor -- start 2024-09-13T17:09:02.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21d48f6700 1 -- start start 2024-09-13T17:09:02.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21d48f6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21d00b3990 0x7f21d00cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21d48f6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21d00cb780 0x7f21d015a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21d48f6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d00ce180 con 0x7f21d00ccac0 2024-09-13T17:09:02.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21d48f6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d00cd990 con 0x7f21d00cb780 2024-09-13T17:09:02.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21d48f6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d00cd0f0 con 0x7f21d00b3990 2024-09-13T17:09:02.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21cffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21d00cb780 0x7f21d015a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21ceffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f21d00ccac0 0x7f21d00cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60352/0 (socket says 172.21.15.123:60352) 2024-09-13T17:09:02.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21cffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21d00cb780 0x7f21d015a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42706/0 (socket says 172.21.15.123:42706) 2024-09-13T17:09:02.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21ceffd700 1 -- 172.21.15.123:0/1069191915 learned_addr learned my addr 172.21.15.123:0/1069191915 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:02.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21cf7fe700 1 --2- 172.21.15.123:0/1069191915 >> v2:172.21.15.153:3300/0 conn(0x7f21d00b3990 0x7f21d00cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21ce7fc700 1 -- 172.21.15.123:0/1069191915 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452745190 0 0) 0x7f21d00ce180 con 0x7f21d00ccac0 2024-09-13T17:09:02.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21cffff700 1 -- 172.21.15.123:0/1069191915 >> v2:172.21.15.153:3300/0 conn(0x7f21d00b3990 msgr2=0x7f21d00cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:02.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21cffff700 1 --2- 172.21.15.123:0/1069191915 >> v2:172.21.15.153:3300/0 conn(0x7f21d00b3990 0x7f21d00cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21cffff700 1 -- 172.21.15.123:0/1069191915 >> v1:172.21.15.123:6789/0 conn(0x7f21d00ccac0 legacy=0x7f21d00cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.771+0000 7f21cffff700 1 -- 172.21.15.123:0/1069191915 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d00cd3d0 con 0x7f21d00cb780 2024-09-13T17:09:02.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.775+0000 7f21cffff700 1 --2- 172.21.15.123:0/1069191915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d00cb780 0x7f21d015a2f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f21d00cf750 tx=0x7f21c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d3bf9642432f32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:02.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.775+0000 7f21ce7fc700 1 -- 172.21.15.123:0/1069191915 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800e070 con 0x7f21d00cb780 2024-09-13T17:09:02.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.775+0000 7f21ce7fc700 1 -- 172.21.15.123:0/1069191915 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c800bb20 con 0x7f21d00cb780 2024-09-13T17:09:02.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.775+0000 7f21ce7fc700 1 -- 172.21.15.123:0/1069191915 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8012430 con 0x7f21d00cb780 2024-09-13T17:09:02.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.775+0000 7f21d48f6700 1 -- 172.21.15.123:0/1069191915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d00cb780 msgr2=0x7f21d015a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.775+0000 7f21d48f6700 1 --2- 172.21.15.123:0/1069191915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d00cb780 0x7f21d015a2f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f21d00cf750 tx=0x7f21c800b330 comp rx=0 tx=0).stop 2024-09-13T17:09:02.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.775+0000 7f21d48f6700 1 -- 172.21.15.123:0/1069191915 shutdown_connections 2024-09-13T17:09:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.775+0000 7f21d48f6700 1 --2- 172.21.15.123:0/1069191915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d00cb780 0x7f21d015a2f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.775+0000 7f21d48f6700 1 --2- 172.21.15.123:0/1069191915 >> v2:172.21.15.153:3300/0 conn(0x7f21d00b3990 0x7f21d00cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.775+0000 7f21d48f6700 1 -- 172.21.15.123:0/1069191915 >> 172.21.15.123:0/1069191915 conn(0x7f21d00b01d0 msgr2=0x7f21d00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.775+0000 7f21d48f6700 1 -- 172.21.15.123:0/1069191915 shutdown_connections 2024-09-13T17:09:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.775+0000 7f21d48f6700 1 -- 172.21.15.123:0/1069191915 wait complete. 2024-09-13T17:09:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.775+0000 7f21d48f6700 1 Processor -- start 2024-09-13T17:09:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.775+0000 7f21d48f6700 1 -- start start 2024-09-13T17:09:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21d48f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d00b3990 0x7f21d0154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21d48f6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00cb780 0x7f21d00b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21d48f6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d00ccac0 0x7f21d00c3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21d48f6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c71b0 con 0x7f21d00ccac0 2024-09-13T17:09:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21d48f6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c8180 con 0x7f21d00b3990 2024-09-13T17:09:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21d48f6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c73c0 con 0x7f21d00cb780 2024-09-13T17:09:02.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21cffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d00ccac0 0x7f21d00c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21cffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d00ccac0 0x7f21d00c3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42710/0 (socket says 172.21.15.123:42710) 2024-09-13T17:09:02.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21cffff700 1 -- 172.21.15.123:0/3482040975 learned_addr learned my addr 172.21.15.123:0/3482040975 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:02.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21cf7fe700 1 --2- 172.21.15.123:0/3482040975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d00b3990 0x7f21d0154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21ceffd700 1 --2- 172.21.15.123:0/3482040975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00cb780 0x7f21d00b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21cffff700 1 -- 172.21.15.123:0/3482040975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00cb780 msgr2=0x7f21d00b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21cffff700 1 --2- 172.21.15.123:0/3482040975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00cb780 0x7f21d00b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21cffff700 1 -- 172.21.15.123:0/3482040975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d00b3990 msgr2=0x7f21d0154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21cffff700 1 --2- 172.21.15.123:0/3482040975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d00b3990 0x7f21d0154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21cffff700 1 -- 172.21.15.123:0/3482040975 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c8009a70 con 0x7f21d00ccac0 2024-09-13T17:09:02.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21cffff700 1 --2- 172.21.15.123:0/3482040975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d00ccac0 0x7f21d00c3620 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f21c800b680 tx=0x7f21c8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:02.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21c7fff700 1 -- 172.21.15.123:0/3482040975 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8012430 con 0x7f21d00ccac0 2024-09-13T17:09:02.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21c7fff700 1 -- 172.21.15.123:0/3482040975 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c8020070 con 0x7f21d00ccac0 2024-09-13T17:09:02.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21c7fff700 1 -- 172.21.15.123:0/3482040975 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8004280 con 0x7f21d00ccac0 2024-09-13T17:09:02.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21d48f6700 1 -- 172.21.15.123:0/3482040975 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d00c76a0 con 0x7f21d00ccac0 2024-09-13T17:09:02.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21d48f6700 1 -- 172.21.15.123:0/3482040975 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d00c7c60 con 0x7f21d00ccac0 2024-09-13T17:09:02.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.779+0000 7f21d48f6700 1 -- 172.21.15.123:0/3482040975 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d00c7e80 con 0x7f21d00ccac0 2024-09-13T17:09:02.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.783+0000 7f21c7fff700 1 -- 172.21.15.123:0/3482040975 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f21c80043e0 con 0x7f21d00ccac0 2024-09-13T17:09:02.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.783+0000 7f21c7fff700 1 --2- 172.21.15.123:0/3482040975 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f21b0066730 0x7f21b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:02.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.783+0000 7f21cf7fe700 1 --2- 172.21.15.123:0/3482040975 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f21b0066730 0x7f21b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:02.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.783+0000 7f21c7fff700 1 -- 172.21.15.123:0/3482040975 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21c8022070 con 0x7f21d00ccac0 2024-09-13T17:09:02.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.783+0000 7f21cf7fe700 1 --2- 172.21.15.123:0/3482040975 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f21b0066730 0x7f21b0068bf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009bf0 tx=0x7f21b8009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:02.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.787+0000 7f21c7fff700 1 -- 172.21.15.123:0/3482040975 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f21c80537b0 con 0x7f21d00ccac0 2024-09-13T17:09:02.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.959+0000 7f21d48f6700 1 -- 172.21.15.123:0/3482040975 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21d00cc580 con 0x7f21d00ccac0 2024-09-13T17:09:02.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.959+0000 7f21c7fff700 1 -- 172.21.15.123:0/3482040975 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21c802c020 con 0x7f21d00ccac0 2024-09-13T17:09:02.963 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:09:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.959+0000 7f21d48f6700 1 -- 172.21.15.123:0/3482040975 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f21b0066730 msgr2=0x7f21b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.959+0000 7f21d48f6700 1 --2- 172.21.15.123:0/3482040975 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f21b0066730 0x7f21b0068bf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009bf0 tx=0x7f21b8009240 comp rx=0 tx=0).stop 2024-09-13T17:09:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.959+0000 7f21d48f6700 1 -- 172.21.15.123:0/3482040975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d00ccac0 msgr2=0x7f21d00c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.959+0000 7f21d48f6700 1 --2- 172.21.15.123:0/3482040975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d00ccac0 0x7f21d00c3620 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f21c800b680 tx=0x7f21c8004af0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.959+0000 7f21d48f6700 1 -- 172.21.15.123:0/3482040975 shutdown_connections 2024-09-13T17:09:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.959+0000 7f21d48f6700 1 --2- 172.21.15.123:0/3482040975 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f21b0066730 0x7f21b0068bf0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.959+0000 7f21d48f6700 1 --2- 172.21.15.123:0/3482040975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21d00ccac0 0x7f21d00c3620 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.959+0000 7f21d48f6700 1 --2- 172.21.15.123:0/3482040975 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21d00cb780 0x7f21d00b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.959+0000 7f21d48f6700 1 --2- 172.21.15.123:0/3482040975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21d00b3990 0x7f21d0154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:02.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.959+0000 7f21d48f6700 1 -- 172.21.15.123:0/3482040975 >> 172.21.15.123:0/3482040975 conn(0x7f21d00b01d0 msgr2=0x7f21d0071700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:02.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.963+0000 7f21d48f6700 1 -- 172.21.15.123:0/3482040975 shutdown_connections 2024-09-13T17:09:02.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:02.963+0000 7f21d48f6700 1 -- 172.21.15.123:0/3482040975 wait complete. 2024-09-13T17:09:02.978 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:09:03.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.095+0000 7f51ff59e700 1 Processor -- start 2024-09-13T17:09:03.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.095+0000 7f51ff59e700 1 -- start start 2024-09-13T17:09:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.095+0000 7f51ff59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52000d0f40 0x7f52000d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.095+0000 7f51ff59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f52000cd5e0 0x7f52000cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.095+0000 7f51ff59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52000d0cb0 con 0x7f52000b58b0 2024-09-13T17:09:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.095+0000 7f51ff59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52000b0060 con 0x7f52000cd5e0 2024-09-13T17:09:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.095+0000 7f51ff59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52000b0340 con 0x7f52000d0f40 2024-09-13T17:09:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fe59c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52000d0f40 0x7f52000d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fdd9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f52000b58b0 0x7f52000d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:59308/0 (socket says 172.21.15.123:59308) 2024-09-13T17:09:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fed9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f52000cd5e0 0x7f52000cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fe59c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52000d0f40 0x7f52000d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:56266/0 (socket says 172.21.15.123:56266) 2024-09-13T17:09:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fdd9b700 1 -- 172.21.15.123:0/2047968291 learned_addr learned my addr 172.21.15.123:0/2047968291 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fd59a700 1 -- 172.21.15.123:0/2047968291 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765081051 0 0) 0x7f52000d0cb0 con 0x7f52000b58b0 2024-09-13T17:09:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fd59a700 1 -- 172.21.15.123:0/2047968291 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51ec0035d0 con 0x7f52000b58b0 2024-09-13T17:09:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fe59c700 1 -- 172.21.15.123:0/2047968291 >> v2:172.21.15.153:3300/0 conn(0x7f52000cd5e0 msgr2=0x7f52000cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fe59c700 1 --2- 172.21.15.123:0/2047968291 >> v2:172.21.15.153:3300/0 conn(0x7f52000cd5e0 0x7f52000cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fe59c700 1 -- 172.21.15.123:0/2047968291 >> v1:172.21.15.153:6789/0 conn(0x7f52000b58b0 legacy=0x7f52000d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fe59c700 1 -- 172.21.15.123:0/2047968291 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52000b0620 con 0x7f52000d0f40 2024-09-13T17:09:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fed9d700 1 --2- 172.21.15.123:0/2047968291 >> v2:172.21.15.153:3300/0 conn(0x7f52000cd5e0 0x7f52000cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fe59c700 1 --2- 172.21.15.123:0/2047968291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52000d0f40 0x7f52000d1320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009850 tx=0x7f51e8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8fb44d84ce01f24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fd59a700 1 -- 172.21.15.123:0/2047968291 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8011830 con 0x7f52000d0f40 2024-09-13T17:09:03.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fd59a700 1 -- 172.21.15.123:0/2047968291 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8011990 con 0x7f52000d0f40 2024-09-13T17:09:03.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51fd59a700 1 -- 172.21.15.123:0/2047968291 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8011d00 con 0x7f52000d0f40 2024-09-13T17:09:03.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51ff59e700 1 -- 172.21.15.123:0/2047968291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52000d0f40 msgr2=0x7f52000d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51ff59e700 1 --2- 172.21.15.123:0/2047968291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52000d0f40 0x7f52000d1320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009850 tx=0x7f51e8009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:03.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51ff59e700 1 -- 172.21.15.123:0/2047968291 shutdown_connections 2024-09-13T17:09:03.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51ff59e700 1 --2- 172.21.15.123:0/2047968291 >> v2:172.21.15.153:3300/0 conn(0x7f52000cd5e0 0x7f52000cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51ff59e700 1 --2- 172.21.15.123:0/2047968291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52000d0f40 0x7f52000d1320 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51ff59e700 1 -- 172.21.15.123:0/2047968291 >> 172.21.15.123:0/2047968291 conn(0x7f52000d2a60 msgr2=0x7f52000d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:03.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51ff59e700 1 -- 172.21.15.123:0/2047968291 shutdown_connections 2024-09-13T17:09:03.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.099+0000 7f51ff59e700 1 -- 172.21.15.123:0/2047968291 wait complete. 2024-09-13T17:09:03.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.103+0000 7f51ff59e700 1 Processor -- start 2024-09-13T17:09:03.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.103+0000 7f51ff59e700 1 -- start start 2024-09-13T17:09:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.103+0000 7f51ff59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52000b58b0 0x7f520015fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.103+0000 7f51ff59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52000cd5e0 0x7f52000ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.103+0000 7f51ff59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52000d0f40 0x7f52000c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.103+0000 7f51ff59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52000cc680 con 0x7f52000d0f40 2024-09-13T17:09:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.103+0000 7f51ff59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52000cc350 con 0x7f52000b58b0 2024-09-13T17:09:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.103+0000 7f51ff59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52000c9c40 con 0x7f52000cd5e0 2024-09-13T17:09:03.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.103+0000 7f51fed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52000d0f40 0x7f52000c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.103+0000 7f51fed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52000d0f40 0x7f52000c7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42712/0 (socket says 172.21.15.123:42712) 2024-09-13T17:09:03.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.103+0000 7f51fe59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52000b58b0 0x7f520015fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.103+0000 7f51fed9d700 1 -- 172.21.15.123:0/3839254216 learned_addr learned my addr 172.21.15.123:0/3839254216 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:03.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.103+0000 7f51fdd9b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52000cd5e0 0x7f52000ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.107+0000 7f51fed9d700 1 -- 172.21.15.123:0/3839254216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52000cd5e0 msgr2=0x7f52000ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.107+0000 7f51fed9d700 1 --2- 172.21.15.123:0/3839254216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52000cd5e0 0x7f52000ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.107+0000 7f51fed9d700 1 -- 172.21.15.123:0/3839254216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52000b58b0 msgr2=0x7f520015fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.107+0000 7f51fed9d700 1 --2- 172.21.15.123:0/3839254216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52000b58b0 0x7f520015fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.107+0000 7f51fed9d700 1 -- 172.21.15.123:0/3839254216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f8009a70 con 0x7f52000d0f40 2024-09-13T17:09:03.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.107+0000 7f51fdd9b700 1 --2- 172.21.15.123:0/3839254216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52000cd5e0 0x7f52000ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:03.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.107+0000 7f51fed9d700 1 --2- 172.21.15.123:0/3839254216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52000d0f40 0x7f52000c7510 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f51f800efc0 tx=0x7f51f800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:03.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.107+0000 7f51f6ffd700 1 -- 172.21.15.123:0/3839254216 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f800ca90 con 0x7f52000d0f40 2024-09-13T17:09:03.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.107+0000 7f51f6ffd700 1 -- 172.21.15.123:0/3839254216 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f800f040 con 0x7f52000d0f40 2024-09-13T17:09:03.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.107+0000 7f51ff59e700 1 -- 172.21.15.123:0/3839254216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e80094b0 con 0x7f52000d0f40 2024-09-13T17:09:03.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.107+0000 7f51f6ffd700 1 -- 172.21.15.123:0/3839254216 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f800ce10 con 0x7f52000d0f40 2024-09-13T17:09:03.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.107+0000 7f51ff59e700 1 -- 172.21.15.123:0/3839254216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52001602b0 con 0x7f52000d0f40 2024-09-13T17:09:03.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.107+0000 7f51ff59e700 1 -- 172.21.15.123:0/3839254216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520015ce70 con 0x7f52000d0f40 2024-09-13T17:09:03.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.107+0000 7f51f6ffd700 1 -- 172.21.15.123:0/3839254216 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f51f8003a40 con 0x7f52000d0f40 2024-09-13T17:09:03.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.111+0000 7f51f6ffd700 1 --2- 172.21.15.123:0/3839254216 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f51e0066730 0x7f51e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.111+0000 7f51f6ffd700 1 -- 172.21.15.123:0/3839254216 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51f80850f0 con 0x7f52000d0f40 2024-09-13T17:09:03.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.111+0000 7f51fe59c700 1 --2- 172.21.15.123:0/3839254216 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f51e0066730 0x7f51e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.111+0000 7f51fe59c700 1 --2- 172.21.15.123:0/3839254216 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f51e0066730 0x7f51e0068bf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f51e80090b0 tx=0x7f51e8008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:03.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.115+0000 7f51f6ffd700 1 -- 172.21.15.123:0/3839254216 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f51f80524f0 con 0x7f52000d0f40 2024-09-13T17:09:03.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.283+0000 7f51ff59e700 1 -- 172.21.15.123:0/3839254216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52000cc4c0 con 0x7f52000d0f40 2024-09-13T17:09:03.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.283+0000 7f51f6ffd700 1 -- 172.21.15.123:0/3839254216 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f52000cc4c0 con 0x7f52000d0f40 2024-09-13T17:09:03.289 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:09:03.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.287+0000 7f51ff59e700 1 -- 172.21.15.123:0/3839254216 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f51e0066730 msgr2=0x7f51e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.287+0000 7f51ff59e700 1 --2- 172.21.15.123:0/3839254216 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f51e0066730 0x7f51e0068bf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f51e80090b0 tx=0x7f51e8008030 comp rx=0 tx=0).stop 2024-09-13T17:09:03.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.287+0000 7f51ff59e700 1 -- 172.21.15.123:0/3839254216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52000d0f40 msgr2=0x7f52000c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.287+0000 7f51ff59e700 1 --2- 172.21.15.123:0/3839254216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52000d0f40 0x7f52000c7510 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f51f800efc0 tx=0x7f51f800c3a0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.287+0000 7f51ff59e700 1 -- 172.21.15.123:0/3839254216 shutdown_connections 2024-09-13T17:09:03.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.287+0000 7f51ff59e700 1 --2- 172.21.15.123:0/3839254216 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f51e0066730 0x7f51e0068bf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.287+0000 7f51ff59e700 1 --2- 172.21.15.123:0/3839254216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52000d0f40 0x7f52000c7510 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.287+0000 7f51ff59e700 1 --2- 172.21.15.123:0/3839254216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52000cd5e0 0x7f52000ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.287+0000 7f51ff59e700 1 --2- 172.21.15.123:0/3839254216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52000b58b0 0x7f520015fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.287+0000 7f51ff59e700 1 -- 172.21.15.123:0/3839254216 >> 172.21.15.123:0/3839254216 conn(0x7f52000d2a60 msgr2=0x7f52000b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:03.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.287+0000 7f51ff59e700 1 -- 172.21.15.123:0/3839254216 shutdown_connections 2024-09-13T17:09:03.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.287+0000 7f51ff59e700 1 -- 172.21.15.123:0/3839254216 wait complete. 2024-09-13T17:09:03.304 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:09:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 Processor -- start 2024-09-13T17:09:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 -- start start 2024-09-13T17:09:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd3400cfb70 0x7fd3400d10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd3400d3600 0x7fd3400b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3400d1750 con 0x7fd34015cd60 2024-09-13T17:09:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3400d1a30 con 0x7fd3400cfb70 2024-09-13T17:09:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3400b5930 con 0x7fd3400d3600 2024-09-13T17:09:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd345bd3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd3400cfb70 0x7fd3400d10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd345bd3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd3400cfb70 0x7fd3400d10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42716/0 (socket says 172.21.15.123:42716) 2024-09-13T17:09:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd345bd3700 1 -- 172.21.15.123:0/471663880 learned_addr learned my addr 172.21.15.123:0/471663880 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd346bd5700 1 --2- 172.21.15.123:0/471663880 >> v2:172.21.15.153:3300/0 conn(0x7fd3400d3600 0x7fd3400b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd345bd3700 1 -- 172.21.15.123:0/471663880 >> v2:172.21.15.153:3300/0 conn(0x7fd3400d3600 msgr2=0x7fd3400b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:03.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd345bd3700 1 --2- 172.21.15.123:0/471663880 >> v2:172.21.15.153:3300/0 conn(0x7fd3400d3600 0x7fd3400b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd345bd3700 1 -- 172.21.15.123:0/471663880 >> v1:172.21.15.123:6789/0 conn(0x7fd34015cd60 legacy=0x7fd3400cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd345bd3700 1 -- 172.21.15.123:0/471663880 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3400b5c10 con 0x7fd3400cfb70 2024-09-13T17:09:03.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd345bd3700 1 --2- 172.21.15.123:0/471663880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3400cfb70 0x7fd3400d10c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd340067e20 tx=0x7fd33800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31abe2e55103e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:03.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3453d2700 1 -- 172.21.15.123:0/471663880 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33800e070 con 0x7fd3400cfb70 2024-09-13T17:09:03.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3453d2700 1 -- 172.21.15.123:0/471663880 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33800b9c0 con 0x7fd3400cfb70 2024-09-13T17:09:03.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3453d2700 1 -- 172.21.15.123:0/471663880 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33800bd70 con 0x7fd3400cfb70 2024-09-13T17:09:03.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 -- 172.21.15.123:0/471663880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3400cfb70 msgr2=0x7fd3400d10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 --2- 172.21.15.123:0/471663880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3400cfb70 0x7fd3400d10c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd340067e20 tx=0x7fd33800b330 comp rx=0 tx=0).stop 2024-09-13T17:09:03.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 -- 172.21.15.123:0/471663880 shutdown_connections 2024-09-13T17:09:03.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 --2- 172.21.15.123:0/471663880 >> v2:172.21.15.153:3300/0 conn(0x7fd3400d3600 0x7fd3400b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 --2- 172.21.15.123:0/471663880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3400cfb70 0x7fd3400d10c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 -- 172.21.15.123:0/471663880 >> 172.21.15.123:0/471663880 conn(0x7fd3400d2ae0 msgr2=0x7fd3400d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:03.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 -- 172.21.15.123:0/471663880 shutdown_connections 2024-09-13T17:09:03.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.411+0000 7fd3473d6700 1 -- 172.21.15.123:0/471663880 wait complete. 2024-09-13T17:09:03.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.415+0000 7fd3473d6700 1 Processor -- start 2024-09-13T17:09:03.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.415+0000 7fd3473d6700 1 -- start start 2024-09-13T17:09:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.415+0000 7fd3473d6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3400cfb70 0x7fd3401f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.415+0000 7fd3473d6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3400d3600 0x7fd34015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.415+0000 7fd3473d6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd34015cd60 0x7fd34015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.415+0000 7fd3473d6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34014c2d0 con 0x7fd34015cd60 2024-09-13T17:09:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.415+0000 7fd3473d6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd340158c30 con 0x7fd3400d3600 2024-09-13T17:09:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.415+0000 7fd3473d6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd340158f10 con 0x7fd3400cfb70 2024-09-13T17:09:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.415+0000 7fd346bd5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd34015cd60 0x7fd34015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.415+0000 7fd346bd5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd34015cd60 0x7fd34015ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42726/0 (socket says 172.21.15.123:42726) 2024-09-13T17:09:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.415+0000 7fd346bd5700 1 -- 172.21.15.123:0/3133406855 learned_addr learned my addr 172.21.15.123:0/3133406855 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.415+0000 7fd345bd3700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3400d3600 0x7fd34015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.415+0000 7fd3463d4700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3400cfb70 0x7fd3401f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd346bd5700 1 -- 172.21.15.123:0/3133406855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3400cfb70 msgr2=0x7fd3401f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd346bd5700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3400cfb70 0x7fd3401f24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd346bd5700 1 -- 172.21.15.123:0/3133406855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3400d3600 msgr2=0x7fd34015a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd346bd5700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3400d3600 0x7fd34015a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd346bd5700 1 -- 172.21.15.123:0/3133406855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd338009b30 con 0x7fd34015cd60 2024-09-13T17:09:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd3463d4700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3400cfb70 0x7fd3401f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd345bd3700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3400d3600 0x7fd34015a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd346bd5700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd34015cd60 0x7fd34015ae90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00e810 tx=0x7fd33c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd336ffd700 1 -- 172.21.15.123:0/3133406855 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c013610 con 0x7fd34015cd60 2024-09-13T17:09:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd336ffd700 1 -- 172.21.15.123:0/3133406855 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c013770 con 0x7fd34015cd60 2024-09-13T17:09:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd3473d6700 1 -- 172.21.15.123:0/3133406855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34015d2c0 con 0x7fd34015cd60 2024-09-13T17:09:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd336ffd700 1 -- 172.21.15.123:0/3133406855 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c013b20 con 0x7fd34015cd60 2024-09-13T17:09:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd3473d6700 1 -- 172.21.15.123:0/3133406855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3401594d0 con 0x7fd34015cd60 2024-09-13T17:09:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd3473d6700 1 -- 172.21.15.123:0/3133406855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3400672d0 con 0x7fd34015cd60 2024-09-13T17:09:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd336ffd700 1 -- 172.21.15.123:0/3133406855 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd33c013c80 con 0x7fd34015cd60 2024-09-13T17:09:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.419+0000 7fd336ffd700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd324066730 0x7fd324068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.423+0000 7fd336ffd700 1 -- 172.21.15.123:0/3133406855 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd33c083df0 con 0x7fd34015cd60 2024-09-13T17:09:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.423+0000 7fd3463d4700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd324066730 0x7fd324068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.423+0000 7fd3463d4700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd324066730 0x7fd324068bf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd330000f60 tx=0x7fd330009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:03.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.431+0000 7fd336ffd700 1 -- 172.21.15.123:0/3133406855 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd33c051170 con 0x7fd34015cd60 2024-09-13T17:09:03.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.611+0000 7fd3473d6700 1 -- 172.21.15.123:0/3133406855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd3400d10a0 con 0x7fd34015cd60 2024-09-13T17:09:03.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.615+0000 7fd336ffd700 1 -- 172.21.15.123:0/3133406855 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd33c054790 con 0x7fd34015cd60 2024-09-13T17:09:03.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.615+0000 7fd3473d6700 1 -- 172.21.15.123:0/3133406855 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd324066730 msgr2=0x7fd324068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.615+0000 7fd3473d6700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd324066730 0x7fd324068bf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd330000f60 tx=0x7fd330009040 comp rx=0 tx=0).stop 2024-09-13T17:09:03.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.615+0000 7fd3473d6700 1 -- 172.21.15.123:0/3133406855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd34015cd60 msgr2=0x7fd34015ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.615+0000 7fd3473d6700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd34015cd60 0x7fd34015ae90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00e810 tx=0x7fd33c00ebd0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.615+0000 7fd3473d6700 1 -- 172.21.15.123:0/3133406855 shutdown_connections 2024-09-13T17:09:03.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.615+0000 7fd3473d6700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd324066730 0x7fd324068bf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.615+0000 7fd3473d6700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd34015cd60 0x7fd34015ae90 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.615+0000 7fd3473d6700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3400d3600 0x7fd34015a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.615+0000 7fd3473d6700 1 --2- 172.21.15.123:0/3133406855 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd3400cfb70 0x7fd3401f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.615+0000 7fd3473d6700 1 -- 172.21.15.123:0/3133406855 >> 172.21.15.123:0/3133406855 conn(0x7fd3400d2ae0 msgr2=0x7fd340071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:03.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.615+0000 7fd3473d6700 1 -- 172.21.15.123:0/3133406855 shutdown_connections 2024-09-13T17:09:03.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.615+0000 7fd3473d6700 1 -- 172.21.15.123:0/3133406855 wait complete. 2024-09-13T17:09:03.622 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:09:03.632 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-09-13T17:09:03.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:03.633 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:03.649 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33183]: fuse finished with error 0 and tester_r 0 2024-09-13T17:09:03.650 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:09:03.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:03.651 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:09:03.689 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:09:03.690 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:03.697 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:09:03.697 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:09:03.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:03.698 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:09:03.704 INFO:teuthology.orchestra.run.smithi123.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T17:09:03.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:09:03.705 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:09:03.705 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:03.713 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:09:03.713 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:09:03.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:03.713 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:09:03.763 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T17:09:03.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:09:03.764 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:09:03.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.879+0000 7fd183042700 1 Processor -- start 2024-09-13T17:09:03.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.879+0000 7fd183042700 1 -- start start 2024-09-13T17:09:03.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd183042700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd17c072510 0x7fd17c0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd183042700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd17c0cd200 0x7fd17c0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd183042700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17c0b1cf0 con 0x7fd17c15aa80 2024-09-13T17:09:03.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd183042700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17c15ae60 con 0x7fd17c072510 2024-09-13T17:09:03.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd183042700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17c0b3150 con 0x7fd17c0cd200 2024-09-13T17:09:03.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd17bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd17c072510 0x7fd17c0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd17bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd17c072510 0x7fd17c0cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42734/0 (socket says 172.21.15.123:42734) 2024-09-13T17:09:03.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd17bfff700 1 -- 172.21.15.123:0/401964423 learned_addr learned my addr 172.21.15.123:0/401964423 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:03.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd1815df700 1 --2- 172.21.15.123:0/401964423 >> v2:172.21.15.153:3300/0 conn(0x7fd17c0cd200 0x7fd17c0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd17bfff700 1 -- 172.21.15.123:0/401964423 >> v2:172.21.15.153:3300/0 conn(0x7fd17c0cd200 msgr2=0x7fd17c0cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:03.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd17bfff700 1 --2- 172.21.15.123:0/401964423 >> v2:172.21.15.153:3300/0 conn(0x7fd17c0cd200 0x7fd17c0cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd17bfff700 1 -- 172.21.15.123:0/401964423 >> v1:172.21.15.153:6789/0 conn(0x7fd17c15aa80 legacy=0x7fd17c15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:03.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd17bfff700 1 -- 172.21.15.123:0/401964423 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c0b37f0 con 0x7fd17c072510 2024-09-13T17:09:03.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd1815df700 1 --2- 172.21.15.123:0/401964423 >> v2:172.21.15.153:3300/0 conn(0x7fd17c0cd200 0x7fd17c0cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:03.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd17bfff700 1 --2- 172.21.15.123:0/401964423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c072510 0x7fd17c0cccc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd17c0729a0 tx=0x7fd16c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2bd4061030307 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:03.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd17b7fe700 1 -- 172.21.15.123:0/401964423 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c00e070 con 0x7fd17c072510 2024-09-13T17:09:03.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd17b7fe700 1 -- 172.21.15.123:0/401964423 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16c003a40 con 0x7fd17c072510 2024-09-13T17:09:03.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd17b7fe700 1 -- 172.21.15.123:0/401964423 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c003df0 con 0x7fd17c072510 2024-09-13T17:09:03.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd183042700 1 -- 172.21.15.123:0/401964423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c072510 msgr2=0x7fd17c0cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd183042700 1 --2- 172.21.15.123:0/401964423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c072510 0x7fd17c0cccc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd17c0729a0 tx=0x7fd16c00b330 comp rx=0 tx=0).stop 2024-09-13T17:09:03.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd183042700 1 -- 172.21.15.123:0/401964423 shutdown_connections 2024-09-13T17:09:03.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd183042700 1 --2- 172.21.15.123:0/401964423 >> v2:172.21.15.153:3300/0 conn(0x7fd17c0cd200 0x7fd17c0cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd183042700 1 --2- 172.21.15.123:0/401964423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c072510 0x7fd17c0cccc0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd183042700 1 -- 172.21.15.123:0/401964423 >> 172.21.15.123:0/401964423 conn(0x7fd17c066570 msgr2=0x7fd17c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:03.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd183042700 1 -- 172.21.15.123:0/401964423 shutdown_connections 2024-09-13T17:09:03.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.883+0000 7fd183042700 1 -- 172.21.15.123:0/401964423 wait complete. 2024-09-13T17:09:03.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.887+0000 7fd183042700 1 Processor -- start 2024-09-13T17:09:03.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.887+0000 7fd183042700 1 -- start start 2024-09-13T17:09:03.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.887+0000 7fd183042700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c072510 0x7fd17c159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.887+0000 7fd183042700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd17c0cd200 0x7fd17c143250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.887+0000 7fd183042700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd17c15aa80 0x7fd17c152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.887+0000 7fd183042700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c0b0090 con 0x7fd17c072510 2024-09-13T17:09:03.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd183042700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c0af4a0 con 0x7fd17c15aa80 2024-09-13T17:09:03.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd183042700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c159da0 con 0x7fd17c0cd200 2024-09-13T17:09:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd180dde700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c072510 0x7fd17c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd180dde700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c072510 0x7fd17c159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42736/0 (socket says 172.21.15.123:42736) 2024-09-13T17:09:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd180dde700 1 -- 172.21.15.123:0/2233806223 learned_addr learned my addr 172.21.15.123:0/2233806223 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd17bfff700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd17c0cd200 0x7fd17c143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd1815df700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd17c15aa80 0x7fd17c152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd180dde700 1 -- 172.21.15.123:0/2233806223 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd17c0cd200 msgr2=0x7fd17c143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd180dde700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd17c0cd200 0x7fd17c143250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd180dde700 1 -- 172.21.15.123:0/2233806223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd17c15aa80 msgr2=0x7fd17c152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd180dde700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd17c15aa80 0x7fd17c152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:03.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd180dde700 1 -- 172.21.15.123:0/2233806223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c009b30 con 0x7fd17c072510 2024-09-13T17:09:03.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd1815df700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd17c15aa80 0x7fd17c152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:03.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd180dde700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c072510 0x7fd17c159860 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd16400b4d0 tx=0x7fd16400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:03.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd1797fa700 1 -- 172.21.15.123:0/2233806223 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164011830 con 0x7fd17c072510 2024-09-13T17:09:03.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd1797fa700 1 -- 172.21.15.123:0/2233806223 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd164011990 con 0x7fd17c072510 2024-09-13T17:09:03.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd183042700 1 -- 172.21.15.123:0/2233806223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17c0af6f0 con 0x7fd17c072510 2024-09-13T17:09:03.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd1797fa700 1 -- 172.21.15.123:0/2233806223 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164011d40 con 0x7fd17c072510 2024-09-13T17:09:03.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd183042700 1 -- 172.21.15.123:0/2233806223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17c0afcb0 con 0x7fd17c072510 2024-09-13T17:09:03.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd183042700 1 -- 172.21.15.123:0/2233806223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17c0cccc0 con 0x7fd17c072510 2024-09-13T17:09:03.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.891+0000 7fd1797fa700 1 -- 172.21.15.123:0/2233806223 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd16401a400 con 0x7fd17c072510 2024-09-13T17:09:03.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.895+0000 7fd1797fa700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd15c066730 0x7fd15c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:03.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.895+0000 7fd1797fa700 1 -- 172.21.15.123:0/2233806223 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd164083ea0 con 0x7fd17c072510 2024-09-13T17:09:03.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.895+0000 7fd17bfff700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd15c066730 0x7fd15c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:03.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.895+0000 7fd17bfff700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd15c066730 0x7fd15c068bf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd16c015040 tx=0x7fd16c009000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:03.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:03.899+0000 7fd1797fa700 1 -- 172.21.15.123:0/2233806223 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd164051280 con 0x7fd17c072510 2024-09-13T17:09:04.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.107+0000 7fd183042700 1 -- 172.21.15.123:0/2233806223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd17c15e100 con 0x7fd17c072510 2024-09-13T17:09:04.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.107+0000 7fd1797fa700 1 -- 172.21.15.123:0/2233806223 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4746 (secure 0 0 0) 0x7fd1640548a0 con 0x7fd17c072510 2024-09-13T17:09:04.113 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:04.113 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2493352744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2493352744},{"type":"v1","addr":"172.21.15.153:6833","nonce":2493352744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3030199256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3030199256},{"type":"v1","addr":"172.21.15.153:6835","nonce":3030199256}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":6120,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2341008668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2341008668},{"type":"v1","addr":"172.21.15.123:6835","nonce":2341008668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:08:49.337652+0000","modified":"2024-09-13T17:08:52.352454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6126},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6126":{"gid":6126,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2270367518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2270367518},{"type":"v1","addr":"172.21.15.123:6837","nonce":2270367518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T17:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.111+0000 7fd183042700 1 -- 172.21.15.123:0/2233806223 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd15c066730 msgr2=0x7fd15c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.111+0000 7fd183042700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd15c066730 0x7fd15c068bf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd16c015040 tx=0x7fd16c009000 comp rx=0 tx=0).stop 2024-09-13T17:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.111+0000 7fd183042700 1 -- 172.21.15.123:0/2233806223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c072510 msgr2=0x7fd17c159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.111+0000 7fd183042700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c072510 0x7fd17c159860 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd16400b4d0 tx=0x7fd16400b890 comp rx=0 tx=0).stop 2024-09-13T17:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.111+0000 7fd183042700 1 -- 172.21.15.123:0/2233806223 shutdown_connections 2024-09-13T17:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.111+0000 7fd183042700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd15c066730 0x7fd15c068bf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.111+0000 7fd183042700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd17c15aa80 0x7fd17c152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.111+0000 7fd183042700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd17c0cd200 0x7fd17c143250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.111+0000 7fd183042700 1 --2- 172.21.15.123:0/2233806223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd17c072510 0x7fd17c159860 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.111+0000 7fd183042700 1 -- 172.21.15.123:0/2233806223 >> 172.21.15.123:0/2233806223 conn(0x7fd17c066570 msgr2=0x7fd17c15b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.111+0000 7fd183042700 1 -- 172.21.15.123:0/2233806223 shutdown_connections 2024-09-13T17:09:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.111+0000 7fd183042700 1 -- 172.21.15.123:0/2233806223 wait complete. 2024-09-13T17:09:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 28 2024-09-13T17:09:04.128 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:04.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f1724dcb700 1 Processor -- start 2024-09-13T17:09:04.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f1724dcb700 1 -- start start 2024-09-13T17:09:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f1724dcb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f172015a8c0 0x7f17200705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f1724dcb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1720071580 0x7f17200cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f1724dcb700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17200cee80 con 0x7f172015b9b0 2024-09-13T17:09:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f1724dcb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17200ce270 con 0x7f1720071580 2024-09-13T17:09:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f1724dcb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17200ce550 con 0x7f172015a8c0 2024-09-13T17:09:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171effd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f172015b9b0 0x7f1720070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60362/0 (socket says 172.21.15.123:60362) 2024-09-13T17:09:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171effd700 1 -- 172.21.15.123:0/367327622 learned_addr learned my addr 172.21.15.123:0/367327622 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171ffff700 1 --2- 172.21.15.123:0/367327622 >> v2:172.21.15.153:3300/0 conn(0x7f1720071580 0x7f17200cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171f7fe700 1 --2- 172.21.15.123:0/367327622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f172015a8c0 0x7f17200705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 -- 172.21.15.123:0/367327622 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277887742 0 0) 0x7f17200cee80 con 0x7f172015b9b0 2024-09-13T17:09:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 -- 172.21.15.123:0/367327622 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17080035d0 con 0x7f172015b9b0 2024-09-13T17:09:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 -- 172.21.15.123:0/367327622 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1023536688 0 0) 0x7f17080035d0 con 0x7f172015b9b0 2024-09-13T17:09:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 -- 172.21.15.123:0/367327622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f172015a8c0 msgr2=0x7f17200705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 --2- 172.21.15.123:0/367327622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f172015a8c0 0x7f17200705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 -- 172.21.15.123:0/367327622 >> v2:172.21.15.153:3300/0 conn(0x7f1720071580 msgr2=0x7f17200cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 --2- 172.21.15.123:0/367327622 >> v2:172.21.15.153:3300/0 conn(0x7f1720071580 0x7f17200cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 -- 172.21.15.123:0/367327622 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17200ce830 con 0x7f172015b9b0 2024-09-13T17:09:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 -- 172.21.15.123:0/367327622 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f17100019f0 con 0x7f172015b9b0 2024-09-13T17:09:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171ffff700 1 --2- 172.21.15.123:0/367327622 >> v2:172.21.15.153:3300/0 conn(0x7f1720071580 0x7f17200cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 -- 172.21.15.123:0/367327622 >> v1:172.21.15.123:6789/0 conn(0x7f172015b9b0 legacy=0x7f1720070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 --2- 172.21.15.123:0/367327622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1708003a20 0x7f1708003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 --2- 172.21.15.123:0/367327622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f172015a8c0 0x7f1708004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 --2- 172.21.15.123:0/367327622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1708004db0 0x7f1708005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 -- 172.21.15.123:0/367327622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17200ce270 con 0x7f1708004db0 2024-09-13T17:09:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 -- 172.21.15.123:0/367327622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17200ce550 con 0x7f1708003a20 2024-09-13T17:09:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171e7fc700 1 -- 172.21.15.123:0/367327622 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170800fe40 con 0x7f172015a8c0 2024-09-13T17:09:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.235+0000 7f171ffff700 1 --2- 172.21.15.123:0/367327622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1708004db0 0x7f1708005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f171effd700 1 --2- 172.21.15.123:0/367327622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f172015a8c0 0x7f1708004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f171f7fe700 1 --2- 172.21.15.123:0/367327622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1708003a20 0x7f1708003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f171ffff700 1 -- 172.21.15.123:0/367327622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f172015a8c0 msgr2=0x7f1708004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f171ffff700 1 --2- 172.21.15.123:0/367327622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f172015a8c0 0x7f1708004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f171ffff700 1 -- 172.21.15.123:0/367327622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1708003a20 msgr2=0x7f1708003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f171ffff700 1 --2- 172.21.15.123:0/367327622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1708003a20 0x7f1708003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f171ffff700 1 -- 172.21.15.123:0/367327622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17080035d0 con 0x7f1708004db0 2024-09-13T17:09:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f171ffff700 1 --2- 172.21.15.123:0/367327622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1708004db0 0x7f1708005230 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1718014f10 tx=0x7f17080058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb82660dee1785f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f171e7fc700 1 -- 172.21.15.123:0/367327622 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718019070 con 0x7f1708004db0 2024-09-13T17:09:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f171e7fc700 1 -- 172.21.15.123:0/367327622 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718004030 con 0x7f1708004db0 2024-09-13T17:09:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f171e7fc700 1 -- 172.21.15.123:0/367327622 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17180043e0 con 0x7f1708004db0 2024-09-13T17:09:04.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f1724dcb700 1 -- 172.21.15.123:0/367327622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1708004db0 msgr2=0x7f1708005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f1724dcb700 1 --2- 172.21.15.123:0/367327622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1708004db0 0x7f1708005230 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1718014f10 tx=0x7f17080058a0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f171ffff700 1 -- 172.21.15.123:0/367327622 reap_dead start 2024-09-13T17:09:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f1724dcb700 1 -- 172.21.15.123:0/367327622 shutdown_connections 2024-09-13T17:09:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f1724dcb700 1 -- 172.21.15.123:0/367327622 >> 172.21.15.123:0/367327622 conn(0x7f1720066150 msgr2=0x7f1720066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f1724dcb700 1 -- 172.21.15.123:0/367327622 shutdown_connections 2024-09-13T17:09:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f1724dcb700 1 -- 172.21.15.123:0/367327622 wait complete. 2024-09-13T17:09:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f1724dcb700 1 Processor -- start 2024-09-13T17:09:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f1724dcb700 1 -- start start 2024-09-13T17:09:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f1724dcb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1720141aa0 0x7f1720157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f1724dcb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1720141e80 0x7f17201581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f1724dcb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17200a84a0 0x7f1720158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f1724dcb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17200a8a10 con 0x7f17200a84a0 2024-09-13T17:09:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f1724dcb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17201428a0 con 0x7f1720141aa0 2024-09-13T17:09:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f1724dcb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17200b0ba0 con 0x7f1720141e80 2024-09-13T17:09:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.239+0000 7f171ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17200a84a0 0x7f1720158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f171ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17200a84a0 0x7f1720158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42756/0 (socket says 172.21.15.123:42756) 2024-09-13T17:09:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f171ffff700 1 -- 172.21.15.123:0/1419990783 learned_addr learned my addr 172.21.15.123:0/1419990783 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f171f7fe700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1720141aa0 0x7f1720157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f171effd700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1720141e80 0x7f17201581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f171f7fe700 1 -- 172.21.15.123:0/1419990783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1720141e80 msgr2=0x7f17201581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f171f7fe700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1720141e80 0x7f17201581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f171f7fe700 1 -- 172.21.15.123:0/1419990783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17200a84a0 msgr2=0x7f1720158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f171f7fe700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17200a84a0 0x7f1720158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f171f7fe700 1 -- 172.21.15.123:0/1419990783 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17200b10f0 con 0x7f1720141aa0 2024-09-13T17:09:04.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f171ffff700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17200a84a0 0x7f1720158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:04.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f171f7fe700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1720141aa0 0x7f1720157c90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1714010920 tx=0x7f1714010c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:04.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f1707fff700 1 -- 172.21.15.123:0/1419990783 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714004030 con 0x7f1720141aa0 2024-09-13T17:09:04.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f1724dcb700 1 -- 172.21.15.123:0/1419990783 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1720142570 con 0x7f1720141aa0 2024-09-13T17:09:04.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f1707fff700 1 -- 172.21.15.123:0/1419990783 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1714004190 con 0x7f1720141aa0 2024-09-13T17:09:04.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f1707fff700 1 -- 172.21.15.123:0/1419990783 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714004520 con 0x7f1720141aa0 2024-09-13T17:09:04.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f1724dcb700 1 -- 172.21.15.123:0/1419990783 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1720153d00 con 0x7f1720141aa0 2024-09-13T17:09:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f1724dcb700 1 -- 172.21.15.123:0/1419990783 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17200677f0 con 0x7f1720141aa0 2024-09-13T17:09:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.243+0000 7f1707fff700 1 -- 172.21.15.123:0/1419990783 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f17140036c0 con 0x7f1720141aa0 2024-09-13T17:09:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.247+0000 7f1707fff700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f170c066760 0x7f170c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.247+0000 7f1707fff700 1 -- 172.21.15.123:0/1419990783 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1714084790 con 0x7f1720141aa0 2024-09-13T17:09:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.247+0000 7f171effd700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f170c066760 0x7f170c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.247+0000 7f171effd700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f170c066760 0x7f170c068c20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1710000f80 tx=0x7f1710006040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.255+0000 7f1707fff700 1 -- 172.21.15.123:0/1419990783 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1714051b90 con 0x7f1720141aa0 2024-09-13T17:09:04.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.427+0000 7f1724dcb700 1 -- 172.21.15.123:0/1419990783 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17200705b0 con 0x7f1720141aa0 2024-09-13T17:09:04.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.431+0000 7f1707fff700 1 -- 172.21.15.123:0/1419990783 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16613 (secure 0 0 0) 0x7f17140551b0 con 0x7f1720141aa0 2024-09-13T17:09:04.435 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:04.435 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":60,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:50.340369+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:47.655349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:48.327675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:04.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.431+0000 7f1724dcb700 1 -- 172.21.15.123:0/1419990783 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f170c066760 msgr2=0x7f170c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.431+0000 7f1724dcb700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f170c066760 0x7f170c068c20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1710000f80 tx=0x7f1710006040 comp rx=0 tx=0).stop 2024-09-13T17:09:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.431+0000 7f1724dcb700 1 -- 172.21.15.123:0/1419990783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1720141aa0 msgr2=0x7f1720157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.431+0000 7f1724dcb700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1720141aa0 0x7f1720157c90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1714010920 tx=0x7f1714010c30 comp rx=0 tx=0).stop 2024-09-13T17:09:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.431+0000 7f1724dcb700 1 -- 172.21.15.123:0/1419990783 shutdown_connections 2024-09-13T17:09:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.431+0000 7f1724dcb700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f170c066760 0x7f170c068c20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.431+0000 7f1724dcb700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17200a84a0 0x7f1720158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.431+0000 7f1724dcb700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1720141e80 0x7f17201581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.431+0000 7f1724dcb700 1 --2- 172.21.15.123:0/1419990783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1720141aa0 0x7f1720157c90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.431+0000 7f1724dcb700 1 -- 172.21.15.123:0/1419990783 >> 172.21.15.123:0/1419990783 conn(0x7f1720066150 msgr2=0x7f17200b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.431+0000 7f1724dcb700 1 -- 172.21.15.123:0/1419990783 shutdown_connections 2024-09-13T17:09:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.431+0000 7f1724dcb700 1 -- 172.21.15.123:0/1419990783 wait complete. 2024-09-13T17:09:04.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:08:47.655349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:08:48.327675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:09:04.451 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:09:04.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd3531a700 1 Processor -- start 2024-09-13T17:09:04.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd3531a700 1 -- start start 2024-09-13T17:09:04.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd3531a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcd3015ceb0 0x7fcd300cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd3531a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd300cc6e0 0x7fcd3006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd3531a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcd300d08e0 0x7fcd300d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd3531a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd300d12d0 con 0x7fcd300d08e0 2024-09-13T17:09:04.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd3531a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd300cc250 con 0x7fcd3015ceb0 2024-09-13T17:09:04.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd3531a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300cb960 con 0x7fcd300cc6e0 2024-09-13T17:09:04.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd34b19700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcd300d08e0 0x7fcd300d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd34b19700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcd300d08e0 0x7fcd300d0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42766/0 (socket says 172.21.15.123:42766) 2024-09-13T17:09:04.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd34b19700 1 -- 172.21.15.123:0/3205623350 learned_addr learned my addr 172.21.15.123:0/3205623350 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:04.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd2ffff700 1 --2- 172.21.15.123:0/3205623350 >> v2:172.21.15.153:3300/0 conn(0x7fcd3015ceb0 0x7fcd300cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd2f7fe700 1 --2- 172.21.15.123:0/3205623350 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd300cc6e0 0x7fcd3006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd34b19700 1 -- 172.21.15.123:0/3205623350 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd300cc6e0 msgr2=0x7fcd3006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:04.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd34b19700 1 --2- 172.21.15.123:0/3205623350 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd300cc6e0 0x7fcd3006c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.563+0000 7fcd34b19700 1 -- 172.21.15.123:0/3205623350 >> v2:172.21.15.153:3300/0 conn(0x7fcd3015ceb0 msgr2=0x7fcd300cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:04.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd34b19700 1 --2- 172.21.15.123:0/3205623350 >> v2:172.21.15.153:3300/0 conn(0x7fcd3015ceb0 0x7fcd300cfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd34b19700 1 -- 172.21.15.123:0/3205623350 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd300d0560 con 0x7fcd300d08e0 2024-09-13T17:09:04.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd34b19700 1 --2- 172.21.15.123:0/3205623350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd300d08e0 0x7fcd300d0d90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fcd300b3510 tx=0x7fcd2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359005882e7a82b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:04.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd2effd700 1 -- 172.21.15.123:0/3205623350 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800e070 con 0x7fcd300d08e0 2024-09-13T17:09:04.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd2effd700 1 -- 172.21.15.123:0/3205623350 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2800b9c0 con 0x7fcd300d08e0 2024-09-13T17:09:04.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd2effd700 1 -- 172.21.15.123:0/3205623350 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800bd70 con 0x7fcd300d08e0 2024-09-13T17:09:04.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd3531a700 1 -- 172.21.15.123:0/3205623350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd300d08e0 msgr2=0x7fcd300d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd3531a700 1 --2- 172.21.15.123:0/3205623350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd300d08e0 0x7fcd300d0d90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fcd300b3510 tx=0x7fcd2800b330 comp rx=0 tx=0).stop 2024-09-13T17:09:04.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd3531a700 1 -- 172.21.15.123:0/3205623350 shutdown_connections 2024-09-13T17:09:04.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd3531a700 1 --2- 172.21.15.123:0/3205623350 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd300cc6e0 0x7fcd3006c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd3531a700 1 --2- 172.21.15.123:0/3205623350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd300d08e0 0x7fcd300d0d90 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd3531a700 1 --2- 172.21.15.123:0/3205623350 >> v2:172.21.15.153:3300/0 conn(0x7fcd3015ceb0 0x7fcd300cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd3531a700 1 -- 172.21.15.123:0/3205623350 >> 172.21.15.123:0/3205623350 conn(0x7fcd3006e090 msgr2=0x7fcd3006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:04.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd3531a700 1 -- 172.21.15.123:0/3205623350 shutdown_connections 2024-09-13T17:09:04.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd3531a700 1 -- 172.21.15.123:0/3205623350 wait complete. 2024-09-13T17:09:04.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd3531a700 1 Processor -- start 2024-09-13T17:09:04.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.567+0000 7fcd3531a700 1 -- start start 2024-09-13T17:09:04.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd3531a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd300cc6e0 0x7fcd301f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd3531a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd300d08e0 0x7fcd3015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd3531a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd3015ceb0 0x7fcd3015f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd3531a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd301f2680 con 0x7fcd300cc6e0 2024-09-13T17:09:04.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd3531a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd301f3de0 con 0x7fcd3015ceb0 2024-09-13T17:09:04.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd3531a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3015a750 con 0x7fcd300d08e0 2024-09-13T17:09:04.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd2ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd300cc6e0 0x7fcd301f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd2f7fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd300d08e0 0x7fcd3015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd2ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd300cc6e0 0x7fcd301f38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42768/0 (socket says 172.21.15.123:42768) 2024-09-13T17:09:04.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd34b19700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd3015ceb0 0x7fcd3015f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd2ffff700 1 -- 172.21.15.123:0/2556043452 learned_addr learned my addr 172.21.15.123:0/2556043452 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:04.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd2ffff700 1 -- 172.21.15.123:0/2556043452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd300d08e0 msgr2=0x7fcd3015a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd2ffff700 1 --2- 172.21.15.123:0/2556043452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd300d08e0 0x7fcd3015a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd2ffff700 1 -- 172.21.15.123:0/2556043452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd3015ceb0 msgr2=0x7fcd3015f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd2ffff700 1 --2- 172.21.15.123:0/2556043452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd3015ceb0 0x7fcd3015f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd2ffff700 1 -- 172.21.15.123:0/2556043452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28009b30 con 0x7fcd300cc6e0 2024-09-13T17:09:04.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd2ffff700 1 --2- 172.21.15.123:0/2556043452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd300cc6e0 0x7fcd301f38a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400e7c0 tx=0x7fcd2400ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd2cff9700 1 -- 172.21.15.123:0/2556043452 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24013610 con 0x7fcd300cc6e0 2024-09-13T17:09:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd2cff9700 1 -- 172.21.15.123:0/2556043452 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd24013770 con 0x7fcd300cc6e0 2024-09-13T17:09:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd3531a700 1 -- 172.21.15.123:0/2556043452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd300ac8c0 con 0x7fcd300cc6e0 2024-09-13T17:09:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd2cff9700 1 -- 172.21.15.123:0/2556043452 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24013ae0 con 0x7fcd300cc6e0 2024-09-13T17:09:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.571+0000 7fcd3531a700 1 -- 172.21.15.123:0/2556043452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd300ace80 con 0x7fcd300cc6e0 2024-09-13T17:09:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.575+0000 7fcd3531a700 1 -- 172.21.15.123:0/2556043452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd30072520 con 0x7fcd300cc6e0 2024-09-13T17:09:04.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.575+0000 7fcd2cff9700 1 -- 172.21.15.123:0/2556043452 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd24013c40 con 0x7fcd300cc6e0 2024-09-13T17:09:04.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.575+0000 7fcd2cff9700 1 --2- 172.21.15.123:0/2556043452 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd1c066730 0x7fcd1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.575+0000 7fcd2cff9700 1 -- 172.21.15.123:0/2556043452 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd24083cd0 con 0x7fcd300cc6e0 2024-09-13T17:09:04.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.575+0000 7fcd2f7fe700 1 --2- 172.21.15.123:0/2556043452 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd1c066730 0x7fcd1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.575+0000 7fcd2f7fe700 1 --2- 172.21.15.123:0/2556043452 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd1c066730 0x7fcd1c068bf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcd300b1c90 tx=0x7fcd20008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:04.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.583+0000 7fcd2cff9700 1 -- 172.21.15.123:0/2556043452 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcd24051030 con 0x7fcd300cc6e0 2024-09-13T17:09:04.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.751+0000 7fcd3531a700 1 -- 172.21.15.123:0/2556043452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd300d0d90 con 0x7fcd300cc6e0 2024-09-13T17:09:04.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.751+0000 7fcd2cff9700 1 -- 172.21.15.123:0/2556043452 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd24021020 con 0x7fcd300cc6e0 2024-09-13T17:09:04.756 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:09:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.755+0000 7fcd3531a700 1 -- 172.21.15.123:0/2556043452 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd1c066730 msgr2=0x7fcd1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.755+0000 7fcd3531a700 1 --2- 172.21.15.123:0/2556043452 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd1c066730 0x7fcd1c068bf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcd300b1c90 tx=0x7fcd20008040 comp rx=0 tx=0).stop 2024-09-13T17:09:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.755+0000 7fcd3531a700 1 -- 172.21.15.123:0/2556043452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd300cc6e0 msgr2=0x7fcd301f38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.755+0000 7fcd3531a700 1 --2- 172.21.15.123:0/2556043452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd300cc6e0 0x7fcd301f38a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400e7c0 tx=0x7fcd2400ead0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.755+0000 7fcd3531a700 1 -- 172.21.15.123:0/2556043452 shutdown_connections 2024-09-13T17:09:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.755+0000 7fcd3531a700 1 --2- 172.21.15.123:0/2556043452 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd1c066730 0x7fcd1c068bf0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.755+0000 7fcd3531a700 1 --2- 172.21.15.123:0/2556043452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd3015ceb0 0x7fcd3015f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.755+0000 7fcd3531a700 1 --2- 172.21.15.123:0/2556043452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd300d08e0 0x7fcd3015a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.755+0000 7fcd3531a700 1 --2- 172.21.15.123:0/2556043452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd300cc6e0 0x7fcd301f38a0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.755+0000 7fcd3531a700 1 -- 172.21.15.123:0/2556043452 >> 172.21.15.123:0/2556043452 conn(0x7fcd3006e090 msgr2=0x7fcd3006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.755+0000 7fcd3531a700 1 -- 172.21.15.123:0/2556043452 shutdown_connections 2024-09-13T17:09:04.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.755+0000 7fcd3531a700 1 -- 172.21.15.123:0/2556043452 wait complete. 2024-09-13T17:09:04.771 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:09:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.879+0000 7fabf759e700 1 Processor -- start 2024-09-13T17:09:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.879+0000 7fabf759e700 1 -- start start 2024-09-13T17:09:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.879+0000 7fabf759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf80d0f40 0x7fabf80d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.879+0000 7fabf759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fabf80b58b0 0x7fabf80d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.879+0000 7fabf759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf80b0060 con 0x7fabf80b1100 2024-09-13T17:09:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.879+0000 7fabf759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf80b0340 con 0x7fabf80b58b0 2024-09-13T17:09:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.879+0000 7fabf759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf80b0620 con 0x7fabf80d0f40 2024-09-13T17:09:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.879+0000 7fabf5d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fabf80b58b0 0x7fabf80d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.879+0000 7fabf659c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf80d0f40 0x7fabf80d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf5d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fabf80b58b0 0x7fabf80d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:35980/0 (socket says 172.21.15.123:35980) 2024-09-13T17:09:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf5d9b700 1 -- 172.21.15.123:0/3122749826 learned_addr learned my addr 172.21.15.123:0/3122749826 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:04.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf5d9b700 1 -- 172.21.15.123:0/3122749826 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf80d0f40 msgr2=0x7fabf80d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:04.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf5d9b700 1 --2- 172.21.15.123:0/3122749826 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf80d0f40 0x7fabf80d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf5d9b700 1 -- 172.21.15.123:0/3122749826 >> v1:172.21.15.153:6789/0 conn(0x7fabf80b1100 legacy=0x7fabf80b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf5d9b700 1 -- 172.21.15.123:0/3122749826 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf80b0900 con 0x7fabf80b58b0 2024-09-13T17:09:04.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf5d9b700 1 --2- 172.21.15.123:0/3122749826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf80b58b0 0x7fabf80d05a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009910 tx=0x7fabe8009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c8d718021f9fcc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:04.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf559a700 1 -- 172.21.15.123:0/3122749826 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8011830 con 0x7fabf80b58b0 2024-09-13T17:09:04.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf559a700 1 -- 172.21.15.123:0/3122749826 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe8011990 con 0x7fabf80b58b0 2024-09-13T17:09:04.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf559a700 1 -- 172.21.15.123:0/3122749826 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8011d40 con 0x7fabf80b58b0 2024-09-13T17:09:04.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf759e700 1 -- 172.21.15.123:0/3122749826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf80b58b0 msgr2=0x7fabf80d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf759e700 1 --2- 172.21.15.123:0/3122749826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf80b58b0 0x7fabf80d05a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009910 tx=0x7fabe8009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf759e700 1 -- 172.21.15.123:0/3122749826 shutdown_connections 2024-09-13T17:09:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf759e700 1 --2- 172.21.15.123:0/3122749826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf80b58b0 0x7fabf80d05a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf759e700 1 --2- 172.21.15.123:0/3122749826 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf80d0f40 0x7fabf80d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf759e700 1 -- 172.21.15.123:0/3122749826 >> 172.21.15.123:0/3122749826 conn(0x7fabf80d2a60 msgr2=0x7fabf80d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf759e700 1 -- 172.21.15.123:0/3122749826 shutdown_connections 2024-09-13T17:09:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.883+0000 7fabf759e700 1 -- 172.21.15.123:0/3122749826 wait complete. 2024-09-13T17:09:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf759e700 1 Processor -- start 2024-09-13T17:09:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf759e700 1 -- start start 2024-09-13T17:09:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80b1100 0x7fabf80ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf80b58b0 0x7fabf815e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf80d0f40 0x7fabf815f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf815d5d0 con 0x7fabf80b1100 2024-09-13T17:09:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf815d8b0 con 0x7fabf80d0f40 2024-09-13T17:09:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf815db90 con 0x7fabf80b58b0 2024-09-13T17:09:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80b1100 0x7fabf80ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80b1100 0x7fabf80ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42770/0 (socket says 172.21.15.123:42770) 2024-09-13T17:09:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf659c700 1 -- 172.21.15.123:0/2356982296 learned_addr learned my addr 172.21.15.123:0/2356982296 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf6d9d700 1 --2- 172.21.15.123:0/2356982296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf80d0f40 0x7fabf815f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf5d9b700 1 --2- 172.21.15.123:0/2356982296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf80b58b0 0x7fabf815e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf659c700 1 -- 172.21.15.123:0/2356982296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf80b58b0 msgr2=0x7fabf815e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf659c700 1 --2- 172.21.15.123:0/2356982296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf80b58b0 0x7fabf815e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf659c700 1 -- 172.21.15.123:0/2356982296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf80d0f40 msgr2=0x7fabf815f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf659c700 1 --2- 172.21.15.123:0/2356982296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf80d0f40 0x7fabf815f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf659c700 1 -- 172.21.15.123:0/2356982296 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe8009570 con 0x7fabf80b1100 2024-09-13T17:09:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf659c700 1 --2- 172.21.15.123:0/2356982296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80b1100 0x7fabf80ccbe0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fabec00e840 tx=0x7fabec00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabe6ffd700 1 -- 172.21.15.123:0/2356982296 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0095a0 con 0x7fabf80b1100 2024-09-13T17:09:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabe6ffd700 1 -- 172.21.15.123:0/2356982296 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec013680 con 0x7fabf80b1100 2024-09-13T17:09:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf759e700 1 -- 172.21.15.123:0/2356982296 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf815de70 con 0x7fabf80b1100 2024-09-13T17:09:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabe6ffd700 1 -- 172.21.15.123:0/2356982296 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0139f0 con 0x7fabf80b1100 2024-09-13T17:09:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.887+0000 7fabf759e700 1 -- 172.21.15.123:0/2356982296 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf80cd120 con 0x7fabf80b1100 2024-09-13T17:09:04.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.891+0000 7fabf759e700 1 -- 172.21.15.123:0/2356982296 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf808c250 con 0x7fabf80b1100 2024-09-13T17:09:04.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.891+0000 7fabe6ffd700 1 -- 172.21.15.123:0/2356982296 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fabec013b50 con 0x7fabf80b1100 2024-09-13T17:09:04.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.891+0000 7fabe6ffd700 1 --2- 172.21.15.123:0/2356982296 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fabd8066730 0x7fabd8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:04.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.891+0000 7fabe6ffd700 1 -- 172.21.15.123:0/2356982296 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabec083f10 con 0x7fabf80b1100 2024-09-13T17:09:04.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.891+0000 7fabf5d9b700 1 --2- 172.21.15.123:0/2356982296 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fabd8066730 0x7fabd8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:04.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.891+0000 7fabf5d9b700 1 --2- 172.21.15.123:0/2356982296 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fabd8066730 0x7fabd8068bf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fabf80b5c90 tx=0x7fabe8008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:04.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:04.899+0000 7fabe6ffd700 1 -- 172.21.15.123:0/2356982296 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fabec051310 con 0x7fabf80b1100 2024-09-13T17:09:05.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.063+0000 7fabf759e700 1 -- 172.21.15.123:0/2356982296 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fabf80b7ac0 con 0x7fabf80b1100 2024-09-13T17:09:05.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.067+0000 7fabe6ffd700 1 -- 172.21.15.123:0/2356982296 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7fabec054930 con 0x7fabf80b1100 2024-09-13T17:09:05.073 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:09:05.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.067+0000 7fabf759e700 1 -- 172.21.15.123:0/2356982296 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fabd8066730 msgr2=0x7fabd8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.067+0000 7fabf759e700 1 --2- 172.21.15.123:0/2356982296 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fabd8066730 0x7fabd8068bf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fabf80b5c90 tx=0x7fabe8008030 comp rx=0 tx=0).stop 2024-09-13T17:09:05.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.067+0000 7fabf759e700 1 -- 172.21.15.123:0/2356982296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80b1100 msgr2=0x7fabf80ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.067+0000 7fabf759e700 1 --2- 172.21.15.123:0/2356982296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80b1100 0x7fabf80ccbe0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fabec00e840 tx=0x7fabec00eb50 comp rx=0 tx=0).stop 2024-09-13T17:09:05.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.067+0000 7fabf759e700 1 -- 172.21.15.123:0/2356982296 shutdown_connections 2024-09-13T17:09:05.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.067+0000 7fabf759e700 1 --2- 172.21.15.123:0/2356982296 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fabd8066730 0x7fabd8068bf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.067+0000 7fabf759e700 1 --2- 172.21.15.123:0/2356982296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf80d0f40 0x7fabf815f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.067+0000 7fabf759e700 1 --2- 172.21.15.123:0/2356982296 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf80b58b0 0x7fabf815e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.067+0000 7fabf759e700 1 --2- 172.21.15.123:0/2356982296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabf80b1100 0x7fabf80ccbe0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.067+0000 7fabf759e700 1 -- 172.21.15.123:0/2356982296 >> 172.21.15.123:0/2356982296 conn(0x7fabf80d2a60 msgr2=0x7fabf80c84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:05.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.067+0000 7fabf759e700 1 -- 172.21.15.123:0/2356982296 shutdown_connections 2024-09-13T17:09:05.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.067+0000 7fabf759e700 1 -- 172.21.15.123:0/2356982296 wait complete. 2024-09-13T17:09:05.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:09:05.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.199+0000 7fbd64825700 1 Processor -- start 2024-09-13T17:09:05.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.199+0000 7fbd64825700 1 -- start start 2024-09-13T17:09:05.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd60159c60 0x7fbd6015e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbd60070f90 0x7fbd600cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbd600cdbd0 0x7fbd600cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd600ce060 con 0x7fbd600cdbd0 2024-09-13T17:09:05.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd600ada60 con 0x7fbd60070f90 2024-09-13T17:09:05.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6015e680 con 0x7fbd60159c60 2024-09-13T17:09:05.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd5ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbd600cdbd0 0x7fbd600cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd5ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbd600cdbd0 0x7fbd600cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42774/0 (socket says 172.21.15.123:42774) 2024-09-13T17:09:05.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd5ffff700 1 -- 172.21.15.123:0/4049012892 learned_addr learned my addr 172.21.15.123:0/4049012892 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:05.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd57fff700 1 --2- 172.21.15.123:0/4049012892 >> v2:172.21.15.153:3300/0 conn(0x7fbd60070f90 0x7fbd600cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd5f7fe700 1 --2- 172.21.15.123:0/4049012892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd60159c60 0x7fbd6015e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd5ffff700 1 -- 172.21.15.123:0/4049012892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd60159c60 msgr2=0x7fbd6015e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:05.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd5ffff700 1 --2- 172.21.15.123:0/4049012892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd60159c60 0x7fbd6015e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd5ffff700 1 -- 172.21.15.123:0/4049012892 >> v2:172.21.15.153:3300/0 conn(0x7fbd60070f90 msgr2=0x7fbd600cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:05.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd5ffff700 1 --2- 172.21.15.123:0/4049012892 >> v2:172.21.15.153:3300/0 conn(0x7fbd60070f90 0x7fbd600cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd5ffff700 1 -- 172.21.15.123:0/4049012892 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd600720a0 con 0x7fbd600cdbd0 2024-09-13T17:09:05.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd5ffff700 1 --2- 172.21.15.123:0/4049012892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd600cdbd0 0x7fbd600cb090 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fbd600cc200 tx=0x7fbd5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db86f5f504e2e97d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:05.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd5effd700 1 -- 172.21.15.123:0/4049012892 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800e070 con 0x7fbd600cdbd0 2024-09-13T17:09:05.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd5effd700 1 -- 172.21.15.123:0/4049012892 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5800b910 con 0x7fbd600cdbd0 2024-09-13T17:09:05.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd5effd700 1 -- 172.21.15.123:0/4049012892 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800bcc0 con 0x7fbd600cdbd0 2024-09-13T17:09:05.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 -- 172.21.15.123:0/4049012892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd600cdbd0 msgr2=0x7fbd600cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 --2- 172.21.15.123:0/4049012892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd600cdbd0 0x7fbd600cb090 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fbd600cc200 tx=0x7fbd5800b330 comp rx=0 tx=0).stop 2024-09-13T17:09:05.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 -- 172.21.15.123:0/4049012892 shutdown_connections 2024-09-13T17:09:05.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 --2- 172.21.15.123:0/4049012892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd600cdbd0 0x7fbd600cb090 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 --2- 172.21.15.123:0/4049012892 >> v2:172.21.15.153:3300/0 conn(0x7fbd60070f90 0x7fbd600cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 --2- 172.21.15.123:0/4049012892 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd60159c60 0x7fbd6015e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 -- 172.21.15.123:0/4049012892 >> 172.21.15.123:0/4049012892 conn(0x7fbd600b01d0 msgr2=0x7fbd600b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:05.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 -- 172.21.15.123:0/4049012892 shutdown_connections 2024-09-13T17:09:05.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.203+0000 7fbd64825700 1 -- 172.21.15.123:0/4049012892 wait complete. 2024-09-13T17:09:05.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.207+0000 7fbd64825700 1 Processor -- start 2024-09-13T17:09:05.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.207+0000 7fbd64825700 1 -- start start 2024-09-13T17:09:05.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.207+0000 7fbd64825700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd60070f90 0x7fbd6015cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.207+0000 7fbd64825700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd600cdbd0 0x7fbd600c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.207+0000 7fbd64825700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd60159c60 0x7fbd600b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.207+0000 7fbd64825700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600c5070 con 0x7fbd60070f90 2024-09-13T17:09:05.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.207+0000 7fbd64825700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6015a3f0 con 0x7fbd600cdbd0 2024-09-13T17:09:05.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.207+0000 7fbd64825700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600c4e40 con 0x7fbd60159c60 2024-09-13T17:09:05.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd5f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd60070f90 0x7fbd6015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd5f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd60070f90 0x7fbd6015cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42782/0 (socket says 172.21.15.123:42782) 2024-09-13T17:09:05.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd5f7fe700 1 -- 172.21.15.123:0/1689340995 learned_addr learned my addr 172.21.15.123:0/1689340995 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:05.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd57fff700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd600cdbd0 0x7fbd600c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd5ffff700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd60159c60 0x7fbd600b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd5f7fe700 1 -- 172.21.15.123:0/1689340995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd60159c60 msgr2=0x7fbd600b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd5f7fe700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd60159c60 0x7fbd600b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd5f7fe700 1 -- 172.21.15.123:0/1689340995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd600cdbd0 msgr2=0x7fbd600c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd5f7fe700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd600cdbd0 0x7fbd600c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd5f7fe700 1 -- 172.21.15.123:0/1689340995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd58009b30 con 0x7fbd60070f90 2024-09-13T17:09:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd57fff700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd600cdbd0 0x7fbd600c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd5f7fe700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd60070f90 0x7fbd6015cd50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000e8a0 tx=0x7fbd5000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd5cff9700 1 -- 172.21.15.123:0/1689340995 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd500095c0 con 0x7fbd60070f90 2024-09-13T17:09:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd5cff9700 1 -- 172.21.15.123:0/1689340995 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5000eea0 con 0x7fbd60070f90 2024-09-13T17:09:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd64825700 1 -- 172.21.15.123:0/1689340995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd600b4370 con 0x7fbd60070f90 2024-09-13T17:09:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd5cff9700 1 -- 172.21.15.123:0/1689340995 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5000ca70 con 0x7fbd60070f90 2024-09-13T17:09:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd64825700 1 -- 172.21.15.123:0/1689340995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd600b3370 con 0x7fbd60070f90 2024-09-13T17:09:05.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd64825700 1 -- 172.21.15.123:0/1689340995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd60071a50 con 0x7fbd60070f90 2024-09-13T17:09:05.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.211+0000 7fbd5cff9700 1 -- 172.21.15.123:0/1689340995 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd5000cbf0 con 0x7fbd60070f90 2024-09-13T17:09:05.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.215+0000 7fbd5cff9700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbd40066730 0x7fbd40068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.215+0000 7fbd5cff9700 1 -- 172.21.15.123:0/1689340995 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd500848b0 con 0x7fbd60070f90 2024-09-13T17:09:05.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.215+0000 7fbd57fff700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbd40066730 0x7fbd40068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.215+0000 7fbd57fff700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbd40066730 0x7fbd40068bf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbd600ad9f0 tx=0x7fbd48008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:05.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.219+0000 7fbd5cff9700 1 -- 172.21.15.123:0/1689340995 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbd50051d00 con 0x7fbd60070f90 2024-09-13T17:09:05.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.391+0000 7fbd64825700 1 -- 172.21.15.123:0/1689340995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd600b4600 con 0x7fbd60070f90 2024-09-13T17:09:05.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.391+0000 7fbd5cff9700 1 -- 172.21.15.123:0/1689340995 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd5000cea0 con 0x7fbd60070f90 2024-09-13T17:09:05.397 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:09:05.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.395+0000 7fbd64825700 1 -- 172.21.15.123:0/1689340995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbd40066730 msgr2=0x7fbd40068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.395+0000 7fbd64825700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbd40066730 0x7fbd40068bf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbd600ad9f0 tx=0x7fbd48008040 comp rx=0 tx=0).stop 2024-09-13T17:09:05.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.395+0000 7fbd64825700 1 -- 172.21.15.123:0/1689340995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd60070f90 msgr2=0x7fbd6015cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.395+0000 7fbd64825700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd60070f90 0x7fbd6015cd50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000e8a0 tx=0x7fbd5000ec60 comp rx=0 tx=0).stop 2024-09-13T17:09:05.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.395+0000 7fbd64825700 1 -- 172.21.15.123:0/1689340995 shutdown_connections 2024-09-13T17:09:05.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.395+0000 7fbd64825700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbd40066730 0x7fbd40068bf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.395+0000 7fbd64825700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd60159c60 0x7fbd600b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.395+0000 7fbd64825700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd600cdbd0 0x7fbd600c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.395+0000 7fbd64825700 1 --2- 172.21.15.123:0/1689340995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd60070f90 0x7fbd6015cd50 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.395+0000 7fbd64825700 1 -- 172.21.15.123:0/1689340995 >> 172.21.15.123:0/1689340995 conn(0x7fbd600b01d0 msgr2=0x7fbd600ae1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:05.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.395+0000 7fbd64825700 1 -- 172.21.15.123:0/1689340995 shutdown_connections 2024-09-13T17:09:05.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.395+0000 7fbd64825700 1 -- 172.21.15.123:0/1689340995 wait complete. 2024-09-13T17:09:05.412 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:09:05.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.515+0000 7f15ca0fe700 1 Processor -- start 2024-09-13T17:09:05.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.515+0000 7f15ca0fe700 1 -- start start 2024-09-13T17:09:05.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15ca0fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15c4071580 0x7f15c40705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15ca0fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f15c415b9b0 0x7f15c40cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15ca0fe700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c40cee80 con 0x7f15c415a8c0 2024-09-13T17:09:05.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15ca0fe700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c40ce270 con 0x7f15c4071580 2024-09-13T17:09:05.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15ca0fe700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c40ce550 con 0x7f15c415b9b0 2024-09-13T17:09:05.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15c88fb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15c4071580 0x7f15c40705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15c88fb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15c4071580 0x7f15c40705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42794/0 (socket says 172.21.15.123:42794) 2024-09-13T17:09:05.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15c88fb700 1 -- 172.21.15.123:0/4131722179 learned_addr learned my addr 172.21.15.123:0/4131722179 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:05.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15c98fd700 1 --2- 172.21.15.123:0/4131722179 >> v2:172.21.15.153:3300/0 conn(0x7f15c415b9b0 0x7f15c40cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15c88fb700 1 -- 172.21.15.123:0/4131722179 >> v2:172.21.15.153:3300/0 conn(0x7f15c415b9b0 msgr2=0x7f15c40cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:05.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15c88fb700 1 --2- 172.21.15.123:0/4131722179 >> v2:172.21.15.153:3300/0 conn(0x7f15c415b9b0 0x7f15c40cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15c88fb700 1 -- 172.21.15.123:0/4131722179 >> v1:172.21.15.123:6789/0 conn(0x7f15c415a8c0 legacy=0x7f15c4070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15c88fb700 1 -- 172.21.15.123:0/4131722179 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40ce830 con 0x7f15c4071580 2024-09-13T17:09:05.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15c88fb700 1 --2- 172.21.15.123:0/4131722179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15c4071580 0x7f15c40705b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f15c40728f0 tx=0x7f15b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674bfb90bdb35b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:05.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15b7fff700 1 -- 172.21.15.123:0/4131722179 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8011830 con 0x7f15c4071580 2024-09-13T17:09:05.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15b7fff700 1 -- 172.21.15.123:0/4131722179 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b8011990 con 0x7f15c4071580 2024-09-13T17:09:05.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15b7fff700 1 -- 172.21.15.123:0/4131722179 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8011d20 con 0x7f15c4071580 2024-09-13T17:09:05.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15ca0fe700 1 -- 172.21.15.123:0/4131722179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15c4071580 msgr2=0x7f15c40705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15ca0fe700 1 --2- 172.21.15.123:0/4131722179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15c4071580 0x7f15c40705b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f15c40728f0 tx=0x7f15b8009bf0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15ca0fe700 1 -- 172.21.15.123:0/4131722179 shutdown_connections 2024-09-13T17:09:05.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15ca0fe700 1 --2- 172.21.15.123:0/4131722179 >> v2:172.21.15.153:3300/0 conn(0x7f15c415b9b0 0x7f15c40cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15ca0fe700 1 --2- 172.21.15.123:0/4131722179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15c4071580 0x7f15c40705b0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15ca0fe700 1 -- 172.21.15.123:0/4131722179 >> 172.21.15.123:0/4131722179 conn(0x7f15c4066150 msgr2=0x7f15c4066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:05.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15ca0fe700 1 -- 172.21.15.123:0/4131722179 shutdown_connections 2024-09-13T17:09:05.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.519+0000 7f15ca0fe700 1 -- 172.21.15.123:0/4131722179 wait complete. 2024-09-13T17:09:05.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15ca0fe700 1 Processor -- start 2024-09-13T17:09:05.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15ca0fe700 1 -- start start 2024-09-13T17:09:05.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15ca0fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15c4071580 0x7f15c4159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15ca0fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c415a8c0 0x7f15c40b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15ca0fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15c415b9b0 0x7f15c4154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15ca0fe700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40b3740 con 0x7f15c415b9b0 2024-09-13T17:09:05.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15ca0fe700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c41513e0 con 0x7f15c415a8c0 2024-09-13T17:09:05.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15ca0fe700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4154650 con 0x7f15c4071580 2024-09-13T17:09:05.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15c98fd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15c415b9b0 0x7f15c4154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15c98fd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15c415b9b0 0x7f15c4154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42808/0 (socket says 172.21.15.123:42808) 2024-09-13T17:09:05.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15c98fd700 1 -- 172.21.15.123:0/2087356701 learned_addr learned my addr 172.21.15.123:0/2087356701 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:05.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15c88fb700 1 --2- 172.21.15.123:0/2087356701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c415a8c0 0x7f15c40b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15c90fc700 1 --2- 172.21.15.123:0/2087356701 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15c4071580 0x7f15c4159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15c98fd700 1 -- 172.21.15.123:0/2087356701 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15c4071580 msgr2=0x7f15c4159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15c98fd700 1 --2- 172.21.15.123:0/2087356701 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15c4071580 0x7f15c4159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15c98fd700 1 -- 172.21.15.123:0/2087356701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c415a8c0 msgr2=0x7f15c40b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15c98fd700 1 --2- 172.21.15.123:0/2087356701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c415a8c0 0x7f15c40b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15c98fd700 1 -- 172.21.15.123:0/2087356701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b8009570 con 0x7f15c415b9b0 2024-09-13T17:09:05.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15c98fd700 1 --2- 172.21.15.123:0/2087356701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15c415b9b0 0x7f15c4154aa0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00efc0 tx=0x7f15bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:05.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15b5ffb700 1 -- 172.21.15.123:0/2087356701 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc009ba0 con 0x7f15c415b9b0 2024-09-13T17:09:05.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15b5ffb700 1 -- 172.21.15.123:0/2087356701 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc00f040 con 0x7f15c415b9b0 2024-09-13T17:09:05.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15ca0fe700 1 -- 172.21.15.123:0/2087356701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c4151ed0 con 0x7f15c415b9b0 2024-09-13T17:09:05.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15b5ffb700 1 -- 172.21.15.123:0/2087356701 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc014480 con 0x7f15c415b9b0 2024-09-13T17:09:05.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.523+0000 7f15ca0fe700 1 -- 172.21.15.123:0/2087356701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c4152490 con 0x7f15c415b9b0 2024-09-13T17:09:05.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.527+0000 7f15b5ffb700 1 -- 172.21.15.123:0/2087356701 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f15bc0145e0 con 0x7f15c415b9b0 2024-09-13T17:09:05.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.527+0000 7f15ca0fe700 1 -- 172.21.15.123:0/2087356701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c40677f0 con 0x7f15c415b9b0 2024-09-13T17:09:05.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.527+0000 7f15b5ffb700 1 --2- 172.21.15.123:0/2087356701 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f15a8066760 0x7f15a8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.527+0000 7f15c90fc700 1 --2- 172.21.15.123:0/2087356701 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f15a8066760 0x7f15a8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.527+0000 7f15b5ffb700 1 -- 172.21.15.123:0/2087356701 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15bc0849b0 con 0x7f15c415b9b0 2024-09-13T17:09:05.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.527+0000 7f15c90fc700 1 --2- 172.21.15.123:0/2087356701 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f15a8066760 0x7f15a8068c20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f15c0000f60 tx=0x7f15c0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:05.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.535+0000 7f15b5ffb700 1 -- 172.21.15.123:0/2087356701 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f15bc051d10 con 0x7f15c415b9b0 2024-09-13T17:09:05.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.735+0000 7f15ca0fe700 1 -- 172.21.15.123:0/2087356701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15c41547c0 con 0x7f15c415b9b0 2024-09-13T17:09:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.739+0000 7f15b5ffb700 1 -- 172.21.15.123:0/2087356701 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4746 (secure 0 0 0) 0x7f15c41547c0 con 0x7f15c415b9b0 2024-09-13T17:09:05.742 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:05.742 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2493352744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2493352744},{"type":"v1","addr":"172.21.15.153:6833","nonce":2493352744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3030199256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3030199256},{"type":"v1","addr":"172.21.15.153:6835","nonce":3030199256}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":6120,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2341008668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2341008668},{"type":"v1","addr":"172.21.15.123:6835","nonce":2341008668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:08:49.337652+0000","modified":"2024-09-13T17:08:52.352454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6126},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6126":{"gid":6126,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2270367518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2270367518},{"type":"v1","addr":"172.21.15.123:6837","nonce":2270367518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T17:09:05.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.739+0000 7f15ca0fe700 1 -- 172.21.15.123:0/2087356701 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f15a8066760 msgr2=0x7f15a8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.739+0000 7f15ca0fe700 1 --2- 172.21.15.123:0/2087356701 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f15a8066760 0x7f15a8068c20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f15c0000f60 tx=0x7f15c0009040 comp rx=0 tx=0).stop 2024-09-13T17:09:05.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.739+0000 7f15ca0fe700 1 -- 172.21.15.123:0/2087356701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15c415b9b0 msgr2=0x7f15c4154aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.739+0000 7f15ca0fe700 1 --2- 172.21.15.123:0/2087356701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15c415b9b0 0x7f15c4154aa0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00efc0 tx=0x7f15bc00c3a0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.739+0000 7f15ca0fe700 1 -- 172.21.15.123:0/2087356701 shutdown_connections 2024-09-13T17:09:05.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.739+0000 7f15ca0fe700 1 --2- 172.21.15.123:0/2087356701 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f15a8066760 0x7f15a8068c20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.739+0000 7f15ca0fe700 1 --2- 172.21.15.123:0/2087356701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15c415b9b0 0x7f15c4154aa0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.739+0000 7f15ca0fe700 1 --2- 172.21.15.123:0/2087356701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c415a8c0 0x7f15c40b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.739+0000 7f15ca0fe700 1 --2- 172.21.15.123:0/2087356701 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f15c4071580 0x7f15c4159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.739+0000 7f15ca0fe700 1 -- 172.21.15.123:0/2087356701 >> 172.21.15.123:0/2087356701 conn(0x7f15c4066150 msgr2=0x7f15c406dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:05.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.739+0000 7f15ca0fe700 1 -- 172.21.15.123:0/2087356701 shutdown_connections 2024-09-13T17:09:05.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.739+0000 7f15ca0fe700 1 -- 172.21.15.123:0/2087356701 wait complete. 2024-09-13T17:09:05.745 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 28 2024-09-13T17:09:05.763 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:05.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.871+0000 7efc0c7f7700 1 Processor -- start 2024-09-13T17:09:05.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.871+0000 7efc0c7f7700 1 -- start start 2024-09-13T17:09:05.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0c7f7700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc0415aa80 0x7efc0415b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0c7f7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efc04072510 0x7efc040cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0c7f7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc040b1cf0 con 0x7efc040cd200 2024-09-13T17:09:05.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0c7f7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0415ae60 con 0x7efc04072510 2024-09-13T17:09:05.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0c7f7700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc040b3150 con 0x7efc0415aa80 2024-09-13T17:09:05.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc09d92700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efc04072510 0x7efc040cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc09d92700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efc04072510 0x7efc040cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42816/0 (socket says 172.21.15.123:42816) 2024-09-13T17:09:05.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc09d92700 1 -- 172.21.15.123:0/3936165907 learned_addr learned my addr 172.21.15.123:0/3936165907 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:05.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc09d92700 1 -- 172.21.15.123:0/3936165907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc0415aa80 msgr2=0x7efc0415b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:05.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0a593700 1 --2- 172.21.15.123:0/3936165907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc0415aa80 0x7efc0415b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc09d92700 1 --2- 172.21.15.123:0/3936165907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc0415aa80 0x7efc0415b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc09d92700 1 -- 172.21.15.123:0/3936165907 >> v1:172.21.15.123:6789/0 conn(0x7efc040cd200 legacy=0x7efc040cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc09d92700 1 -- 172.21.15.123:0/3936165907 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0415bf00 con 0x7efc04072510 2024-09-13T17:09:05.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0a593700 1 --2- 172.21.15.123:0/3936165907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc0415aa80 0x7efc0415b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:05.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc09d92700 1 --2- 172.21.15.123:0/3936165907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc04072510 0x7efc040cccc0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7efc00009940 tx=0x7efc00009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c17fe81c667a27 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:05.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc09591700 1 -- 172.21.15.123:0/3936165907 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000ba20 con 0x7efc04072510 2024-09-13T17:09:05.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc09591700 1 -- 172.21.15.123:0/3936165907 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc00009e90 con 0x7efc04072510 2024-09-13T17:09:05.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc09591700 1 -- 172.21.15.123:0/3936165907 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000bda0 con 0x7efc04072510 2024-09-13T17:09:05.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0c7f7700 1 -- 172.21.15.123:0/3936165907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc04072510 msgr2=0x7efc040cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0c7f7700 1 --2- 172.21.15.123:0/3936165907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc04072510 0x7efc040cccc0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7efc00009940 tx=0x7efc00009c50 comp rx=0 tx=0).stop 2024-09-13T17:09:05.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0c7f7700 1 -- 172.21.15.123:0/3936165907 shutdown_connections 2024-09-13T17:09:05.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0c7f7700 1 --2- 172.21.15.123:0/3936165907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc04072510 0x7efc040cccc0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0c7f7700 1 --2- 172.21.15.123:0/3936165907 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc0415aa80 0x7efc0415b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0c7f7700 1 -- 172.21.15.123:0/3936165907 >> 172.21.15.123:0/3936165907 conn(0x7efc04066570 msgr2=0x7efc04066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:05.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0c7f7700 1 -- 172.21.15.123:0/3936165907 shutdown_connections 2024-09-13T17:09:05.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.875+0000 7efc0c7f7700 1 -- 172.21.15.123:0/3936165907 wait complete. 2024-09-13T17:09:05.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0c7f7700 1 Processor -- start 2024-09-13T17:09:05.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0c7f7700 1 -- start start 2024-09-13T17:09:05.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0c7f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc04072510 0x7efc0414bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0c7f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc040cd200 0x7efc040ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0c7f7700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc0415aa80 0x7efc040acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0c7f7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc04151d60 con 0x7efc04072510 2024-09-13T17:09:05.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0c7f7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc040ae450 con 0x7efc040cd200 2024-09-13T17:09:05.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0c7f7700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc041f33e0 con 0x7efc0415aa80 2024-09-13T17:09:05.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0a593700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc04072510 0x7efc0414bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0a593700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc04072510 0x7efc0414bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42824/0 (socket says 172.21.15.123:42824) 2024-09-13T17:09:05.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0a593700 1 -- 172.21.15.123:0/2849705687 learned_addr learned my addr 172.21.15.123:0/2849705687 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:05.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0ad94700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc0415aa80 0x7efc040acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc09d92700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc040cd200 0x7efc040ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0a593700 1 -- 172.21.15.123:0/2849705687 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc0415aa80 msgr2=0x7efc040acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0a593700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc0415aa80 0x7efc040acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0a593700 1 -- 172.21.15.123:0/2849705687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc040cd200 msgr2=0x7efc040ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:05.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0a593700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc040cd200 0x7efc040ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:05.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0a593700 1 -- 172.21.15.123:0/2849705687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc00009570 con 0x7efc04072510 2024-09-13T17:09:05.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc09d92700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc040cd200 0x7efc040ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:05.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efc0a593700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc04072510 0x7efc0414bc40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7efbf400c7c0 tx=0x7efbf400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:05.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.879+0000 7efbfaffd700 1 -- 172.21.15.123:0/2849705687 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4011800 con 0x7efc04072510 2024-09-13T17:09:05.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.883+0000 7efbfaffd700 1 -- 172.21.15.123:0/2849705687 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf4011960 con 0x7efc04072510 2024-09-13T17:09:05.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.883+0000 7efc0c7f7700 1 -- 172.21.15.123:0/2849705687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0406da10 con 0x7efc04072510 2024-09-13T17:09:05.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.883+0000 7efbfaffd700 1 -- 172.21.15.123:0/2849705687 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4011cf0 con 0x7efc04072510 2024-09-13T17:09:05.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.883+0000 7efc0c7f7700 1 -- 172.21.15.123:0/2849705687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc041f2900 con 0x7efc04072510 2024-09-13T17:09:05.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.883+0000 7efc0c7f7700 1 -- 172.21.15.123:0/2849705687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc040cccc0 con 0x7efc04072510 2024-09-13T17:09:05.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.883+0000 7efbfaffd700 1 -- 172.21.15.123:0/2849705687 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efbf4021350 con 0x7efc04072510 2024-09-13T17:09:05.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.883+0000 7efbfaffd700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efbe8066730 0x7efbe8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:05.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.883+0000 7efbfaffd700 1 -- 172.21.15.123:0/2849705687 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efbf4084130 con 0x7efc04072510 2024-09-13T17:09:05.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.883+0000 7efc09d92700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efbe8066730 0x7efbe8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:05.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.887+0000 7efc09d92700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efbe8066730 0x7efbe8068bf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efc00009940 tx=0x7efc00008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:05.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:05.895+0000 7efbfaffd700 1 -- 172.21.15.123:0/2849705687 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efbf40514b0 con 0x7efc04072510 2024-09-13T17:09:06.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.067+0000 7efc0c7f7700 1 -- 172.21.15.123:0/2849705687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc04158730 con 0x7efc04072510 2024-09-13T17:09:06.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.071+0000 7efbfaffd700 1 -- 172.21.15.123:0/2849705687 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16613 (secure 0 0 0) 0x7efbf4054ad0 con 0x7efc04072510 2024-09-13T17:09:06.077 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:06.077 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":60,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:50.340369+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:47.655349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:48.327675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.075+0000 7efc0c7f7700 1 -- 172.21.15.123:0/2849705687 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efbe8066730 msgr2=0x7efbe8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.075+0000 7efc0c7f7700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efbe8066730 0x7efbe8068bf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efc00009940 tx=0x7efc00008030 comp rx=0 tx=0).stop 2024-09-13T17:09:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.075+0000 7efc0c7f7700 1 -- 172.21.15.123:0/2849705687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc04072510 msgr2=0x7efc0414bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.075+0000 7efc0c7f7700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc04072510 0x7efc0414bc40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7efbf400c7c0 tx=0x7efbf400cb80 comp rx=0 tx=0).stop 2024-09-13T17:09:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.075+0000 7efc0c7f7700 1 -- 172.21.15.123:0/2849705687 shutdown_connections 2024-09-13T17:09:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.075+0000 7efc0c7f7700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7efbe8066730 0x7efbe8068bf0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.075+0000 7efc0c7f7700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc0415aa80 0x7efc040acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.075+0000 7efc0c7f7700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc040cd200 0x7efc040ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.075+0000 7efc0c7f7700 1 --2- 172.21.15.123:0/2849705687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc04072510 0x7efc0414bc40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.075+0000 7efc0c7f7700 1 -- 172.21.15.123:0/2849705687 >> 172.21.15.123:0/2849705687 conn(0x7efc04066570 msgr2=0x7efc040b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:06.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.075+0000 7efc0c7f7700 1 -- 172.21.15.123:0/2849705687 shutdown_connections 2024-09-13T17:09:06.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.075+0000 7efc0c7f7700 1 -- 172.21.15.123:0/2849705687 wait complete. 2024-09-13T17:09:06.093 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:09:06.093 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:09:06.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.207+0000 7f8fe62cc700 1 Processor -- start 2024-09-13T17:09:06.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.207+0000 7f8fe62cc700 1 -- start start 2024-09-13T17:09:06.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.207+0000 7f8fe62cc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fe015a8c0 0x7f8fe00705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.207+0000 7f8fe62cc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8fe015b9b0 0x7f8fe0070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe62cc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe00cee80 con 0x7f8fe00713b0 2024-09-13T17:09:06.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe62cc700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe0071860 con 0x7f8fe015b9b0 2024-09-13T17:09:06.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe62cc700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00ce270 con 0x7f8fe015a8c0 2024-09-13T17:09:06.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe4ac9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8fe015b9b0 0x7f8fe0070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe5acb700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8fe00713b0 0x7f8fe00cb130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60394/0 (socket says 172.21.15.123:60394) 2024-09-13T17:09:06.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe5acb700 1 -- 172.21.15.123:0/768862646 learned_addr learned my addr 172.21.15.123:0/768862646 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:06.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe52ca700 1 --2- 172.21.15.123:0/768862646 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fe015a8c0 0x7f8fe00705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fd3fff700 1 -- 172.21.15.123:0/768862646 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367974072 0 0) 0x7f8fe00cee80 con 0x7f8fe00713b0 2024-09-13T17:09:06.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fd3fff700 1 -- 172.21.15.123:0/768862646 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fcc0035d0 con 0x7f8fe00713b0 2024-09-13T17:09:06.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fd3fff700 1 -- 172.21.15.123:0/768862646 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2592284681 0 0) 0x7f8fcc0035d0 con 0x7f8fe00713b0 2024-09-13T17:09:06.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe4ac9700 1 -- 172.21.15.123:0/768862646 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fe015a8c0 msgr2=0x7f8fe00705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:06.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe4ac9700 1 --2- 172.21.15.123:0/768862646 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fe015a8c0 0x7f8fe00705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe4ac9700 1 -- 172.21.15.123:0/768862646 >> v1:172.21.15.123:6789/0 conn(0x7f8fe00713b0 legacy=0x7f8fe00cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe4ac9700 1 -- 172.21.15.123:0/768862646 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe00ce550 con 0x7f8fe015b9b0 2024-09-13T17:09:06.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe4ac9700 1 --2- 172.21.15.123:0/768862646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe015b9b0 0x7f8fe0070e70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009dc0 tx=0x7f8fdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e005887f967e1cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:06.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fd3fff700 1 -- 172.21.15.123:0/768862646 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00e070 con 0x7f8fe015b9b0 2024-09-13T17:09:06.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fd3fff700 1 -- 172.21.15.123:0/768862646 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc003a40 con 0x7f8fe015b9b0 2024-09-13T17:09:06.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fd3fff700 1 -- 172.21.15.123:0/768862646 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8001670 con 0x7f8fe015b9b0 2024-09-13T17:09:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe62cc700 1 -- 172.21.15.123:0/768862646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe015b9b0 msgr2=0x7f8fe0070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe62cc700 1 --2- 172.21.15.123:0/768862646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe015b9b0 0x7f8fe0070e70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009dc0 tx=0x7f8fdc00b330 comp rx=0 tx=0).stop 2024-09-13T17:09:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe62cc700 1 -- 172.21.15.123:0/768862646 shutdown_connections 2024-09-13T17:09:06.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe62cc700 1 --2- 172.21.15.123:0/768862646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe015b9b0 0x7f8fe0070e70 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe62cc700 1 --2- 172.21.15.123:0/768862646 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fe015a8c0 0x7f8fe00705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe62cc700 1 -- 172.21.15.123:0/768862646 >> 172.21.15.123:0/768862646 conn(0x7f8fe0066150 msgr2=0x7f8fe0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:06.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe62cc700 1 -- 172.21.15.123:0/768862646 shutdown_connections 2024-09-13T17:09:06.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe62cc700 1 -- 172.21.15.123:0/768862646 wait complete. 2024-09-13T17:09:06.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe62cc700 1 Processor -- start 2024-09-13T17:09:06.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.211+0000 7f8fe62cc700 1 -- start start 2024-09-13T17:09:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe62cc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fe00713b0 0x7f8fe014b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe62cc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe015a8c0 0x7f8fe015c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe62cc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fe015b9b0 0x7f8fe0154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe62cc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe015cc70 con 0x7f8fe015a8c0 2024-09-13T17:09:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe62cc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe015cf50 con 0x7f8fe00713b0 2024-09-13T17:09:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe62cc700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe015d230 con 0x7f8fe015b9b0 2024-09-13T17:09:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe4ac9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe015a8c0 0x7f8fe015c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe4ac9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe015a8c0 0x7f8fe015c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42848/0 (socket says 172.21.15.123:42848) 2024-09-13T17:09:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe4ac9700 1 -- 172.21.15.123:0/3814105483 learned_addr learned my addr 172.21.15.123:0/3814105483 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe5acb700 1 --2- 172.21.15.123:0/3814105483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fe015b9b0 0x7f8fe0154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe52ca700 1 --2- 172.21.15.123:0/3814105483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fe00713b0 0x7f8fe014b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe4ac9700 1 -- 172.21.15.123:0/3814105483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fe015b9b0 msgr2=0x7f8fe0154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe4ac9700 1 --2- 172.21.15.123:0/3814105483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fe015b9b0 0x7f8fe0154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe4ac9700 1 -- 172.21.15.123:0/3814105483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fe00713b0 msgr2=0x7f8fe014b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe4ac9700 1 --2- 172.21.15.123:0/3814105483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fe00713b0 0x7f8fe014b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe4ac9700 1 -- 172.21.15.123:0/3814105483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc009a70 con 0x7f8fe015a8c0 2024-09-13T17:09:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe4ac9700 1 --2- 172.21.15.123:0/3814105483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe015a8c0 0x7f8fe015c1b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc000f80 tx=0x7f8fdc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fd1ffb700 1 -- 172.21.15.123:0/3814105483 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0044c0 con 0x7f8fe015a8c0 2024-09-13T17:09:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fd1ffb700 1 -- 172.21.15.123:0/3814105483 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc004620 con 0x7f8fe015a8c0 2024-09-13T17:09:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe62cc700 1 -- 172.21.15.123:0/3814105483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe015d510 con 0x7f8fe015a8c0 2024-09-13T17:09:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fd1ffb700 1 -- 172.21.15.123:0/3814105483 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc012450 con 0x7f8fe015a8c0 2024-09-13T17:09:06.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe62cc700 1 -- 172.21.15.123:0/3814105483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe0158c30 con 0x7f8fe015a8c0 2024-09-13T17:09:06.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.215+0000 7f8fe62cc700 1 -- 172.21.15.123:0/3814105483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe00677f0 con 0x7f8fe015a8c0 2024-09-13T17:09:06.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.219+0000 7f8fd1ffb700 1 -- 172.21.15.123:0/3814105483 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8fdc0125b0 con 0x7f8fe015a8c0 2024-09-13T17:09:06.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.219+0000 7f8fd1ffb700 1 --2- 172.21.15.123:0/3814105483 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8fc4066730 0x7f8fc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.219+0000 7f8fd1ffb700 1 -- 172.21.15.123:0/3814105483 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fdc085a80 con 0x7f8fe015a8c0 2024-09-13T17:09:06.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.219+0000 7f8fe52ca700 1 --2- 172.21.15.123:0/3814105483 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8fc4066730 0x7f8fc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.219+0000 7f8fe52ca700 1 --2- 172.21.15.123:0/3814105483 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8fc4066730 0x7f8fc4068bf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009bf0 tx=0x7f8fd4009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:06.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.227+0000 7f8fd1ffb700 1 -- 172.21.15.123:0/3814105483 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8fdc052d60 con 0x7f8fe015a8c0 2024-09-13T17:09:06.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.435+0000 7f8fe62cc700 1 -- 172.21.15.123:0/3814105483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fe015da30 con 0x7f8fe015a8c0 2024-09-13T17:09:06.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.435+0000 7f8fd1ffb700 1 -- 172.21.15.123:0/3814105483 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4746 (secure 0 0 0) 0x7f8fe015da30 con 0x7f8fe015a8c0 2024-09-13T17:09:06.441 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:06.441 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2493352744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2493352744},{"type":"v1","addr":"172.21.15.153:6833","nonce":2493352744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3030199256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3030199256},{"type":"v1","addr":"172.21.15.153:6835","nonce":3030199256}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":6120,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2341008668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2341008668},{"type":"v1","addr":"172.21.15.123:6835","nonce":2341008668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:08:49.337652+0000","modified":"2024-09-13T17:08:52.352454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6126},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6126":{"gid":6126,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2270367518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2270367518},{"type":"v1","addr":"172.21.15.123:6837","nonce":2270367518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T17:09:06.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.439+0000 7f8fe62cc700 1 -- 172.21.15.123:0/3814105483 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8fc4066730 msgr2=0x7f8fc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.439+0000 7f8fe62cc700 1 --2- 172.21.15.123:0/3814105483 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8fc4066730 0x7f8fc4068bf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009bf0 tx=0x7f8fd4009240 comp rx=0 tx=0).stop 2024-09-13T17:09:06.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.439+0000 7f8fe62cc700 1 -- 172.21.15.123:0/3814105483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe015a8c0 msgr2=0x7f8fe015c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.439+0000 7f8fe62cc700 1 --2- 172.21.15.123:0/3814105483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe015a8c0 0x7f8fe015c1b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc000f80 tx=0x7f8fdc004af0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.439+0000 7f8fe62cc700 1 -- 172.21.15.123:0/3814105483 shutdown_connections 2024-09-13T17:09:06.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.439+0000 7f8fe62cc700 1 --2- 172.21.15.123:0/3814105483 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8fc4066730 0x7f8fc4068bf0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.439+0000 7f8fe62cc700 1 --2- 172.21.15.123:0/3814105483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8fe015b9b0 0x7f8fe0154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.439+0000 7f8fe62cc700 1 --2- 172.21.15.123:0/3814105483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fe015a8c0 0x7f8fe015c1b0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.439+0000 7f8fe62cc700 1 --2- 172.21.15.123:0/3814105483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fe00713b0 0x7f8fe014b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.439+0000 7f8fe62cc700 1 -- 172.21.15.123:0/3814105483 >> 172.21.15.123:0/3814105483 conn(0x7f8fe0066150 msgr2=0x7f8fe006cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:06.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.439+0000 7f8fe62cc700 1 -- 172.21.15.123:0/3814105483 shutdown_connections 2024-09-13T17:09:06.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.439+0000 7f8fe62cc700 1 -- 172.21.15.123:0/3814105483 wait complete. 2024-09-13T17:09:06.444 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 28 2024-09-13T17:09:06.456 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:09:06.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.559+0000 7f66f48c5700 1 Processor -- start 2024-09-13T17:09:06.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66f48c5700 1 -- start start 2024-09-13T17:09:06.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66f48c5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f66f015a8c0 0x7f66f00705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66f48c5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f00cee80 con 0x7f66f0071580 2024-09-13T17:09:06.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66f48c5700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f00ce270 con 0x7f66f015b9b0 2024-09-13T17:09:06.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66f48c5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f00ce550 con 0x7f66f015a8c0 2024-09-13T17:09:06.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66ef59e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f66f0071580 0x7f66f00cc620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60396/0 (socket says 172.21.15.123:60396) 2024-09-13T17:09:06.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66ef59e700 1 -- 172.21.15.123:0/2302717544 learned_addr learned my addr 172.21.15.123:0/2302717544 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:06.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66eed9d700 1 --2- 172.21.15.123:0/2302717544 >> v2:172.21.15.153:3300/0 conn(0x7f66f015a8c0 0x7f66f00705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66edd9b700 1 -- 172.21.15.123:0/2302717544 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9153885 0 0) 0x7f66f00cee80 con 0x7f66f0071580 2024-09-13T17:09:06.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66edd9b700 1 -- 172.21.15.123:0/2302717544 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66dc0035d0 con 0x7f66f0071580 2024-09-13T17:09:06.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66edd9b700 1 -- 172.21.15.123:0/2302717544 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628410374 0 0) 0x7f66f00ce270 con 0x7f66f015b9b0 2024-09-13T17:09:06.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66edd9b700 1 -- 172.21.15.123:0/2302717544 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f00cee80 con 0x7f66f015b9b0 2024-09-13T17:09:06.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66eed9d700 1 -- 172.21.15.123:0/2302717544 >> v1:172.21.15.153:6789/0 conn(0x7f66f015b9b0 legacy=0x7f66f0070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66edd9b700 1 -- 172.21.15.123:0/2302717544 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1891542057 0 0) 0x7f66dc0035d0 con 0x7f66f0071580 2024-09-13T17:09:06.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66eed9d700 1 -- 172.21.15.123:0/2302717544 >> v1:172.21.15.123:6789/0 conn(0x7f66f0071580 legacy=0x7f66f00cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66eed9d700 1 -- 172.21.15.123:0/2302717544 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f00ce830 con 0x7f66f015a8c0 2024-09-13T17:09:06.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66eed9d700 1 --2- 172.21.15.123:0/2302717544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f015a8c0 0x7f66f00705b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009850 tx=0x7f66e0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffb94e7ebebf8628 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:06.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66edd9b700 1 -- 172.21.15.123:0/2302717544 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80019f0 con 0x7f66f015a8c0 2024-09-13T17:09:06.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66edd9b700 1 -- 172.21.15.123:0/2302717544 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e0004030 con 0x7f66f015a8c0 2024-09-13T17:09:06.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66edd9b700 1 -- 172.21.15.123:0/2302717544 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e00043c0 con 0x7f66f015a8c0 2024-09-13T17:09:06.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66f48c5700 1 -- 172.21.15.123:0/2302717544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f015a8c0 msgr2=0x7f66f00705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66f48c5700 1 --2- 172.21.15.123:0/2302717544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f015a8c0 0x7f66f00705b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009850 tx=0x7f66e0009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:06.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66f48c5700 1 -- 172.21.15.123:0/2302717544 shutdown_connections 2024-09-13T17:09:06.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.563+0000 7f66f48c5700 1 --2- 172.21.15.123:0/2302717544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f015a8c0 0x7f66f00705b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66f48c5700 1 -- 172.21.15.123:0/2302717544 >> 172.21.15.123:0/2302717544 conn(0x7f66f0066150 msgr2=0x7f66f0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:06.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66f48c5700 1 -- 172.21.15.123:0/2302717544 shutdown_connections 2024-09-13T17:09:06.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66f48c5700 1 -- 172.21.15.123:0/2302717544 wait complete. 2024-09-13T17:09:06.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66f48c5700 1 Processor -- start 2024-09-13T17:09:06.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66f48c5700 1 -- start start 2024-09-13T17:09:06.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66f48c5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66f0071580 0x7f66f014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66f48c5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f015a8c0 0x7f66f0154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66f48c5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66f015b9b0 0x7f66f0158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66f48c5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f0153ae0 con 0x7f66f0071580 2024-09-13T17:09:06.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66f48c5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f014eee0 con 0x7f66f015a8c0 2024-09-13T17:09:06.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66f48c5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f0153d30 con 0x7f66f015b9b0 2024-09-13T17:09:06.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66eed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66f0071580 0x7f66f014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66eed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66f0071580 0x7f66f014e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42856/0 (socket says 172.21.15.123:42856) 2024-09-13T17:09:06.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66eed9d700 1 -- 172.21.15.123:0/1055401544 learned_addr learned my addr 172.21.15.123:0/1055401544 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:06.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66ee59c700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f015a8c0 0x7f66f0154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66ef59e700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66f015b9b0 0x7f66f0158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66eed9d700 1 -- 172.21.15.123:0/1055401544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66f015b9b0 msgr2=0x7f66f0158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66eed9d700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66f015b9b0 0x7f66f0158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66eed9d700 1 -- 172.21.15.123:0/1055401544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f015a8c0 msgr2=0x7f66f0154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66eed9d700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f015a8c0 0x7f66f0154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66eed9d700 1 -- 172.21.15.123:0/1055401544 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e00094b0 con 0x7f66f0071580 2024-09-13T17:09:06.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66ee59c700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f015a8c0 0x7f66f0154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:06.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.567+0000 7f66ef59e700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66f015b9b0 0x7f66f0158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:06.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.571+0000 7f66eed9d700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66f0071580 0x7f66f014e9a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f66f00b1390 tx=0x7f66e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:06.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.571+0000 7f66e77fe700 1 -- 172.21.15.123:0/1055401544 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e0011830 con 0x7f66f0071580 2024-09-13T17:09:06.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.571+0000 7f66e77fe700 1 -- 172.21.15.123:0/1055401544 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e001f070 con 0x7f66f0071580 2024-09-13T17:09:06.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.571+0000 7f66f48c5700 1 -- 172.21.15.123:0/1055401544 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f0154010 con 0x7f66f0071580 2024-09-13T17:09:06.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.571+0000 7f66e77fe700 1 -- 172.21.15.123:0/1055401544 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e0011bd0 con 0x7f66f0071580 2024-09-13T17:09:06.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.571+0000 7f66f48c5700 1 -- 172.21.15.123:0/1055401544 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f01545d0 con 0x7f66f0071580 2024-09-13T17:09:06.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.571+0000 7f66f48c5700 1 -- 172.21.15.123:0/1055401544 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f00677f0 con 0x7f66f0071580 2024-09-13T17:09:06.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.571+0000 7f66e77fe700 1 -- 172.21.15.123:0/1055401544 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f66e0011d30 con 0x7f66f0071580 2024-09-13T17:09:06.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.571+0000 7f66e77fe700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66d0066730 0x7f66d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.571+0000 7f66e77fe700 1 -- 172.21.15.123:0/1055401544 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66e0021070 con 0x7f66f0071580 2024-09-13T17:09:06.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.571+0000 7f66ee59c700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66d0066730 0x7f66d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.575+0000 7f66ee59c700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66d0066730 0x7f66d0068bf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f66f015a1e0 tx=0x7f66d8009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:06.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.583+0000 7f66e77fe700 1 -- 172.21.15.123:0/1055401544 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f66e0052e90 con 0x7f66f0071580 2024-09-13T17:09:06.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.787+0000 7f66f48c5700 1 -- 172.21.15.123:0/1055401544 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66f00705b0 con 0x7f66f0071580 2024-09-13T17:09:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.787+0000 7f66e77fe700 1 -- 172.21.15.123:0/1055401544 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4746 (secure 0 0 0) 0x7f66e002b090 con 0x7f66f0071580 2024-09-13T17:09:06.791 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:06.792 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2493352744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2493352744},{"type":"v1","addr":"172.21.15.153:6833","nonce":2493352744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3030199256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3030199256},{"type":"v1","addr":"172.21.15.153:6835","nonce":3030199256}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":6120,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2341008668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2341008668},{"type":"v1","addr":"172.21.15.123:6835","nonce":2341008668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:08:49.337652+0000","modified":"2024-09-13T17:08:52.352454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6126},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6126":{"gid":6126,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2270367518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2270367518},{"type":"v1","addr":"172.21.15.123:6837","nonce":2270367518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T17:09:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.787+0000 7f66f48c5700 1 -- 172.21.15.123:0/1055401544 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66d0066730 msgr2=0x7f66d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.787+0000 7f66f48c5700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66d0066730 0x7f66d0068bf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f66f015a1e0 tx=0x7f66d8009040 comp rx=0 tx=0).stop 2024-09-13T17:09:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.787+0000 7f66f48c5700 1 -- 172.21.15.123:0/1055401544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66f0071580 msgr2=0x7f66f014e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.787+0000 7f66f48c5700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66f0071580 0x7f66f014e9a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f66f00b1390 tx=0x7f66e0004770 comp rx=0 tx=0).stop 2024-09-13T17:09:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.791+0000 7f66f48c5700 1 -- 172.21.15.123:0/1055401544 shutdown_connections 2024-09-13T17:09:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.791+0000 7f66f48c5700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f66d0066730 0x7f66d0068bf0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.791+0000 7f66f48c5700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66f015b9b0 0x7f66f0158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.791+0000 7f66f48c5700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f015a8c0 0x7f66f0154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.791+0000 7f66f48c5700 1 --2- 172.21.15.123:0/1055401544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66f0071580 0x7f66f014e9a0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.791+0000 7f66f48c5700 1 -- 172.21.15.123:0/1055401544 >> 172.21.15.123:0/1055401544 conn(0x7f66f0066150 msgr2=0x7f66f00ae2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:06.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.791+0000 7f66f48c5700 1 -- 172.21.15.123:0/1055401544 shutdown_connections 2024-09-13T17:09:06.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.791+0000 7f66f48c5700 1 -- 172.21.15.123:0/1055401544 wait complete. 2024-09-13T17:09:06.795 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 28 2024-09-13T17:09:06.807 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:06.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.907+0000 7f3adc836700 1 Processor -- start 2024-09-13T17:09:06.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.907+0000 7f3adc836700 1 -- start start 2024-09-13T17:09:06.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3adc836700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3ad80b12c0 0x7f3ad80cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3adc836700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad80b27d0 con 0x7f3ad80b3f80 2024-09-13T17:09:06.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3adc836700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad80b2ab0 con 0x7f3ad80b16a0 2024-09-13T17:09:06.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3adc836700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad80b2d90 con 0x7f3ad80b12c0 2024-09-13T17:09:06.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3ad759e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3ad80b3f80 0x7f3ad806d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60412/0 (socket says 172.21.15.123:60412) 2024-09-13T17:09:06.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3ad759e700 1 -- 172.21.15.123:0/2352770557 learned_addr learned my addr 172.21.15.123:0/2352770557 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:06.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3ad6d9d700 1 --2- 172.21.15.123:0/2352770557 >> v2:172.21.15.153:3300/0 conn(0x7f3ad80b12c0 0x7f3ad80cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3ad659c700 1 -- 172.21.15.123:0/2352770557 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023394295 0 0) 0x7f3ad80b27d0 con 0x7f3ad80b3f80 2024-09-13T17:09:06.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3ad659c700 1 -- 172.21.15.123:0/2352770557 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ac40035d0 con 0x7f3ad80b3f80 2024-09-13T17:09:06.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3ad659c700 1 -- 172.21.15.123:0/2352770557 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980826713 0 0) 0x7f3ad80b2ab0 con 0x7f3ad80b16a0 2024-09-13T17:09:06.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3ad659c700 1 -- 172.21.15.123:0/2352770557 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ad80b27d0 con 0x7f3ad80b16a0 2024-09-13T17:09:06.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3ad6d9d700 1 -- 172.21.15.123:0/2352770557 >> v1:172.21.15.153:6789/0 conn(0x7f3ad80b16a0 legacy=0x7f3ad80b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3ad6d9d700 1 -- 172.21.15.123:0/2352770557 >> v1:172.21.15.123:6789/0 conn(0x7f3ad80b3f80 legacy=0x7f3ad806d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3ad6d9d700 1 -- 172.21.15.123:0/2352770557 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad80b3070 con 0x7f3ad80b12c0 2024-09-13T17:09:06.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3ad6d9d700 1 --2- 172.21.15.123:0/2352770557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad80b12c0 0x7f3ad80cc0b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80098b0 tx=0x7f3ac8009bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f1d6e296de26c3f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:06.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3ad659c700 1 -- 172.21.15.123:0/2352770557 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8011830 con 0x7f3ad80b12c0 2024-09-13T17:09:06.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3ad659c700 1 -- 172.21.15.123:0/2352770557 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac8011990 con 0x7f3ad80b12c0 2024-09-13T17:09:06.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.911+0000 7f3ad659c700 1 -- 172.21.15.123:0/2352770557 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8011d00 con 0x7f3ad80b12c0 2024-09-13T17:09:06.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 -- 172.21.15.123:0/2352770557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad80b12c0 msgr2=0x7f3ad80cc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 --2- 172.21.15.123:0/2352770557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad80b12c0 0x7f3ad80cc0b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80098b0 tx=0x7f3ac8009bc0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 -- 172.21.15.123:0/2352770557 shutdown_connections 2024-09-13T17:09:06.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 --2- 172.21.15.123:0/2352770557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad80b12c0 0x7f3ad80cc0b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 -- 172.21.15.123:0/2352770557 >> 172.21.15.123:0/2352770557 conn(0x7f3ad80b4630 msgr2=0x7f3ad80b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:06.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 -- 172.21.15.123:0/2352770557 shutdown_connections 2024-09-13T17:09:06.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 -- 172.21.15.123:0/2352770557 wait complete. 2024-09-13T17:09:06.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 Processor -- start 2024-09-13T17:09:06.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 -- start start 2024-09-13T17:09:06.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad80b12c0 0x7f3ad80ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ad80b16a0 0x7f3ad8142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad80b3f80 0x7f3ad8152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad8152a20 con 0x7f3ad80b12c0 2024-09-13T17:09:06.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad8151e10 con 0x7f3ad80b3f80 2024-09-13T17:09:06.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3adc836700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad81520f0 con 0x7f3ad80b16a0 2024-09-13T17:09:06.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3ad6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad80b12c0 0x7f3ad80ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3ad6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad80b12c0 0x7f3ad80ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42862/0 (socket says 172.21.15.123:42862) 2024-09-13T17:09:06.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3ad6d9d700 1 -- 172.21.15.123:0/465831223 learned_addr learned my addr 172.21.15.123:0/465831223 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:06.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3ad759e700 1 --2- 172.21.15.123:0/465831223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad80b3f80 0x7f3ad8152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.915+0000 7f3acffff700 1 --2- 172.21.15.123:0/465831223 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ad80b16a0 0x7f3ad8142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3ad6d9d700 1 -- 172.21.15.123:0/465831223 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ad80b16a0 msgr2=0x7f3ad8142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3ad6d9d700 1 --2- 172.21.15.123:0/465831223 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ad80b16a0 0x7f3ad8142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3ad6d9d700 1 -- 172.21.15.123:0/465831223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad80b3f80 msgr2=0x7f3ad8152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:06.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3ad6d9d700 1 --2- 172.21.15.123:0/465831223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad80b3f80 0x7f3ad8152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:06.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3ad6d9d700 1 -- 172.21.15.123:0/465831223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac80094b0 con 0x7f3ad80b12c0 2024-09-13T17:09:06.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3ad6d9d700 1 --2- 172.21.15.123:0/465831223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad80b12c0 0x7f3ad80ae0b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80090b0 tx=0x7f3ac8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:06.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3acf7fe700 1 -- 172.21.15.123:0/465831223 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80044d0 con 0x7f3ad80b12c0 2024-09-13T17:09:06.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3acf7fe700 1 -- 172.21.15.123:0/465831223 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac801f070 con 0x7f3ad80b12c0 2024-09-13T17:09:06.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3adc836700 1 -- 172.21.15.123:0/465831223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad81523d0 con 0x7f3ad80b12c0 2024-09-13T17:09:06.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3acf7fe700 1 -- 172.21.15.123:0/465831223 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8003900 con 0x7f3ad80b12c0 2024-09-13T17:09:06.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3adc836700 1 -- 172.21.15.123:0/465831223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad81533f0 con 0x7f3ad80b12c0 2024-09-13T17:09:06.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3adc836700 1 -- 172.21.15.123:0/465831223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad80ce570 con 0x7f3ad80b12c0 2024-09-13T17:09:06.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3acf7fe700 1 -- 172.21.15.123:0/465831223 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ac8003a60 con 0x7f3ad80b12c0 2024-09-13T17:09:06.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3acf7fe700 1 --2- 172.21.15.123:0/465831223 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ab8066730 0x7f3ab8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:06.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3acf7fe700 1 -- 172.21.15.123:0/465831223 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ac8021070 con 0x7f3ad80b12c0 2024-09-13T17:09:06.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.919+0000 7f3acffff700 1 --2- 172.21.15.123:0/465831223 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ab8066730 0x7f3ab8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:06.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.923+0000 7f3acffff700 1 --2- 172.21.15.123:0/465831223 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ab8066730 0x7f3ab8068bf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80cb100 tx=0x7f3ac0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:06.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:06.931+0000 7f3acf7fe700 1 -- 172.21.15.123:0/465831223 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3ac8052cf0 con 0x7f3ad80b12c0 2024-09-13T17:09:07.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.103+0000 7f3adc836700 1 -- 172.21.15.123:0/465831223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ad80cc7a0 con 0x7f3ad80b12c0 2024-09-13T17:09:07.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.107+0000 7f3acf7fe700 1 -- 172.21.15.123:0/465831223 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16613 (secure 0 0 0) 0x7f3ac8056310 con 0x7f3ad80b12c0 2024-09-13T17:09:07.111 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:07.111 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":60,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:08:50.340369+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:08:47.655349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T17:08:48.327675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:07.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.107+0000 7f3adc836700 1 -- 172.21.15.123:0/465831223 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ab8066730 msgr2=0x7f3ab8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.107+0000 7f3adc836700 1 --2- 172.21.15.123:0/465831223 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ab8066730 0x7f3ab8068bf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80cb100 tx=0x7f3ac0009040 comp rx=0 tx=0).stop 2024-09-13T17:09:07.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.107+0000 7f3adc836700 1 -- 172.21.15.123:0/465831223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad80b12c0 msgr2=0x7f3ad80ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.107+0000 7f3adc836700 1 --2- 172.21.15.123:0/465831223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad80b12c0 0x7f3ad80ae0b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80090b0 tx=0x7f3ac8004770 comp rx=0 tx=0).stop 2024-09-13T17:09:07.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.107+0000 7f3adc836700 1 -- 172.21.15.123:0/465831223 shutdown_connections 2024-09-13T17:09:07.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.107+0000 7f3adc836700 1 --2- 172.21.15.123:0/465831223 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3ab8066730 0x7f3ab8068bf0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.107+0000 7f3adc836700 1 --2- 172.21.15.123:0/465831223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad80b3f80 0x7f3ad8152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.107+0000 7f3adc836700 1 --2- 172.21.15.123:0/465831223 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3ad80b16a0 0x7f3ad8142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.107+0000 7f3adc836700 1 --2- 172.21.15.123:0/465831223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad80b12c0 0x7f3ad80ae0b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.107+0000 7f3adc836700 1 -- 172.21.15.123:0/465831223 >> 172.21.15.123:0/465831223 conn(0x7f3ad80b4630 msgr2=0x7f3ad8158460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:07.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.107+0000 7f3adc836700 1 -- 172.21.15.123:0/465831223 shutdown_connections 2024-09-13T17:09:07.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.107+0000 7f3adc836700 1 -- 172.21.15.123:0/465831223 wait complete. 2024-09-13T17:09:07.126 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:09:07.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c9759e700 1 Processor -- start 2024-09-13T17:09:07.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c9759e700 1 -- start start 2024-09-13T17:09:07.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c9759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8c980cdcb0 0x7f8c980b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:07.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c9759e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c980cf3f0 con 0x7f8c980b2920 2024-09-13T17:09:07.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c9759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c980ce630 con 0x7f8c980b5c10 2024-09-13T17:09:07.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c9759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c980b2dd0 con 0x7f8c980cdcb0 2024-09-13T17:09:07.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c96d9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8c980b2920 0x7f8c9815a510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60420/0 (socket says 172.21.15.123:60420) 2024-09-13T17:09:07.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c96d9d700 1 -- 172.21.15.123:0/2075094520 learned_addr learned my addr 172.21.15.123:0/2075094520 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:07.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c95d9b700 1 --2- 172.21.15.123:0/2075094520 >> v2:172.21.15.153:3300/0 conn(0x7f8c980cdcb0 0x7f8c980b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:07.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c9559a700 1 -- 172.21.15.123:0/2075094520 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033080476 0 0) 0x7f8c980cf3f0 con 0x7f8c980b2920 2024-09-13T17:09:07.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c9559a700 1 -- 172.21.15.123:0/2075094520 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c780035d0 con 0x7f8c980b2920 2024-09-13T17:09:07.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c95d9b700 1 -- 172.21.15.123:0/2075094520 >> v1:172.21.15.153:6789/0 conn(0x7f8c980b5c10 legacy=0x7f8c980cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c95d9b700 1 -- 172.21.15.123:0/2075094520 >> v1:172.21.15.123:6789/0 conn(0x7f8c980b2920 legacy=0x7f8c9815a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c95d9b700 1 -- 172.21.15.123:0/2075094520 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c980ce910 con 0x7f8c980cdcb0 2024-09-13T17:09:07.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.239+0000 7f8c95d9b700 1 --2- 172.21.15.123:0/2075094520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980cdcb0 0x7f8c980b23e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8c88009850 tx=0x7f8c88009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae974747e1373317 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:07.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.243+0000 7f8c9559a700 1 -- 172.21.15.123:0/2075094520 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88011830 con 0x7f8c980cdcb0 2024-09-13T17:09:07.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.243+0000 7f8c9559a700 1 -- 172.21.15.123:0/2075094520 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c88011990 con 0x7f8c980cdcb0 2024-09-13T17:09:07.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.243+0000 7f8c9559a700 1 -- 172.21.15.123:0/2075094520 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88011d40 con 0x7f8c980cdcb0 2024-09-13T17:09:07.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.243+0000 7f8c9759e700 1 -- 172.21.15.123:0/2075094520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980cdcb0 msgr2=0x7f8c980b23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.243+0000 7f8c9759e700 1 --2- 172.21.15.123:0/2075094520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980cdcb0 0x7f8c980b23e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8c88009850 tx=0x7f8c88009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:07.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.243+0000 7f8c9759e700 1 -- 172.21.15.123:0/2075094520 shutdown_connections 2024-09-13T17:09:07.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.243+0000 7f8c9759e700 1 --2- 172.21.15.123:0/2075094520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980cdcb0 0x7f8c980b23e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.243+0000 7f8c9759e700 1 -- 172.21.15.123:0/2075094520 >> 172.21.15.123:0/2075094520 conn(0x7f8c98066150 msgr2=0x7f8c98066560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:07.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.243+0000 7f8c9759e700 1 -- 172.21.15.123:0/2075094520 shutdown_connections 2024-09-13T17:09:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.243+0000 7f8c9759e700 1 -- 172.21.15.123:0/2075094520 wait complete. 2024-09-13T17:09:07.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.243+0000 7f8c9759e700 1 Processor -- start 2024-09-13T17:09:07.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.243+0000 7f8c9759e700 1 -- start start 2024-09-13T17:09:07.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c9759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c980b2920 0x7f8c980aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c9759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c980b5c10 0x7f8c98071640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c9759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980cdcb0 0x7f8c98154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c9759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c98072400 con 0x7f8c980b5c10 2024-09-13T17:09:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c9759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980ad350 con 0x7f8c980cdcb0 2024-09-13T17:09:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c9759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980ad630 con 0x7f8c980b2920 2024-09-13T17:09:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c95d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c980b5c10 0x7f8c98071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c95d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c980b5c10 0x7f8c98071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42872/0 (socket says 172.21.15.123:42872) 2024-09-13T17:09:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c95d9b700 1 -- 172.21.15.123:0/3894879500 learned_addr learned my addr 172.21.15.123:0/3894879500 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c96d9d700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980cdcb0 0x7f8c98154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c9659c700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c980b2920 0x7f8c980aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c95d9b700 1 -- 172.21.15.123:0/3894879500 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c980b2920 msgr2=0x7f8c980aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c95d9b700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c980b2920 0x7f8c980aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c95d9b700 1 -- 172.21.15.123:0/3894879500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980cdcb0 msgr2=0x7f8c98154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c95d9b700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980cdcb0 0x7f8c98154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c95d9b700 1 -- 172.21.15.123:0/3894879500 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c880094b0 con 0x7f8c980b5c10 2024-09-13T17:09:07.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c96d9d700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980cdcb0 0x7f8c98154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:07.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c95d9b700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c980b5c10 0x7f8c98071640 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8c88000c00 tx=0x7f8c88004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:07.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c8effd700 1 -- 172.21.15.123:0/3894879500 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8801aac0 con 0x7f8c980b5c10 2024-09-13T17:09:07.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c8effd700 1 -- 172.21.15.123:0/3894879500 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8801f070 con 0x7f8c980b5c10 2024-09-13T17:09:07.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c8effd700 1 -- 172.21.15.123:0/3894879500 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8801ae60 con 0x7f8c980b5c10 2024-09-13T17:09:07.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c9759e700 1 -- 172.21.15.123:0/3894879500 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c98070e40 con 0x7f8c980b5c10 2024-09-13T17:09:07.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.247+0000 7f8c9759e700 1 -- 172.21.15.123:0/3894879500 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c980af410 con 0x7f8c980b5c10 2024-09-13T17:09:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.251+0000 7f8c8effd700 1 -- 172.21.15.123:0/3894879500 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8c8801b430 con 0x7f8c980b5c10 2024-09-13T17:09:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.251+0000 7f8c9759e700 1 -- 172.21.15.123:0/3894879500 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c98071360 con 0x7f8c980b5c10 2024-09-13T17:09:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.251+0000 7f8c8effd700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8c7c066730 0x7f8c7c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.251+0000 7f8c8effd700 1 -- 172.21.15.123:0/3894879500 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c88085290 con 0x7f8c980b5c10 2024-09-13T17:09:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.251+0000 7f8c9659c700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8c7c066730 0x7f8c7c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:07.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.251+0000 7f8c9659c700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8c7c066730 0x7f8c7c068bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8c800012e0 tx=0x7f8c80009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:07.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.255+0000 7f8c8effd700 1 -- 172.21.15.123:0/3894879500 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8c98071360 con 0x7f8c980b5c10 2024-09-13T17:09:07.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.463+0000 7f8c9759e700 1 -- 172.21.15.123:0/3894879500 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8c98071360 con 0x7f8c980b5c10 2024-09-13T17:09:07.468 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-13T17:09:07.463+0000 7f1c63ac9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:09:07.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.479+0000 7f8c8effd700 1 -- 172.21.15.123:0/3894879500 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8c98071360 con 0x7f8c980b5c10 2024-09-13T17:09:07.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.479+0000 7f8c9759e700 1 -- 172.21.15.123:0/3894879500 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8c7c066730 msgr2=0x7f8c7c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.479+0000 7f8c9759e700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8c7c066730 0x7f8c7c068bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8c800012e0 tx=0x7f8c80009040 comp rx=0 tx=0).stop 2024-09-13T17:09:07.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.479+0000 7f8c9759e700 1 -- 172.21.15.123:0/3894879500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c980b5c10 msgr2=0x7f8c98071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.479+0000 7f8c9759e700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c980b5c10 0x7f8c98071640 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8c88000c00 tx=0x7f8c88004770 comp rx=0 tx=0).stop 2024-09-13T17:09:07.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.479+0000 7f8c9759e700 1 -- 172.21.15.123:0/3894879500 shutdown_connections 2024-09-13T17:09:07.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.479+0000 7f8c9759e700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8c7c066730 0x7f8c7c068bf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.479+0000 7f8c9759e700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c980cdcb0 0x7f8c98154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.479+0000 7f8c9759e700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c980b5c10 0x7f8c98071640 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.479+0000 7f8c9759e700 1 --2- 172.21.15.123:0/3894879500 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8c980b2920 0x7f8c980aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.479+0000 7f8c9759e700 1 -- 172.21.15.123:0/3894879500 >> 172.21.15.123:0/3894879500 conn(0x7f8c98066150 msgr2=0x7f8c980c6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:07.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.479+0000 7f8c9759e700 1 -- 172.21.15.123:0/3894879500 shutdown_connections 2024-09-13T17:09:07.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.479+0000 7f8c9759e700 1 -- 172.21.15.123:0/3894879500 wait complete. 2024-09-13T17:09:07.488 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:09:07.489 INFO:tasks.ceph.mds.c.smithi123.stderr: -3192> 2024-09-13T17:08:50.295+0000 7f9992992700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:09:07.502 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:09:07.519 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-13T17:09:07.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.611+0000 7f681443e700 1 Processor -- start 2024-09-13T17:09:07.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.611+0000 7f681443e700 1 -- start start 2024-09-13T17:09:07.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f681443e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f680c15ad20 0x7f680c0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:07.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f681443e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f680c0afc00 0x7f680c06c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:07.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f681443e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c06b300 con 0x7f680c0ccbf0 2024-09-13T17:09:07.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f681443e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680c06b5c0 con 0x7f680c15ad20 2024-09-13T17:09:07.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f681443e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680c0af7e0 con 0x7f680c0afc00 2024-09-13T17:09:07.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f68121da700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f680c15ad20 0x7f680c0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:07.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f68121da700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f680c15ad20 0x7f680c0cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42896/0 (socket says 172.21.15.123:42896) 2024-09-13T17:09:07.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f68121da700 1 -- 172.21.15.123:0/1817421746 learned_addr learned my addr 172.21.15.123:0/1817421746 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:07.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f68119d9700 1 --2- 172.21.15.123:0/1817421746 >> v2:172.21.15.153:3300/0 conn(0x7f680c0afc00 0x7f680c06c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:07.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f68121da700 1 -- 172.21.15.123:0/1817421746 >> v2:172.21.15.153:3300/0 conn(0x7f680c0afc00 msgr2=0x7f680c06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:07.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f68121da700 1 --2- 172.21.15.123:0/1817421746 >> v2:172.21.15.153:3300/0 conn(0x7f680c0afc00 0x7f680c06c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f68121da700 1 -- 172.21.15.123:0/1817421746 >> v1:172.21.15.153:6789/0 conn(0x7f680c0ccbf0 legacy=0x7f680c0ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f68121da700 1 -- 172.21.15.123:0/1817421746 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c06bd50 con 0x7f680c15ad20 2024-09-13T17:09:07.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f68121da700 1 --2- 172.21.15.123:0/1817421746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f680c15ad20 0x7f680c0cc6b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f680c0cbb80 tx=0x7f6808009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854539b7728de9ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:07.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f68111d8700 1 -- 172.21.15.123:0/1817421746 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808011830 con 0x7f680c15ad20 2024-09-13T17:09:07.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f68111d8700 1 -- 172.21.15.123:0/1817421746 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808011990 con 0x7f680c15ad20 2024-09-13T17:09:07.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f68111d8700 1 -- 172.21.15.123:0/1817421746 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808011d20 con 0x7f680c15ad20 2024-09-13T17:09:07.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f681443e700 1 -- 172.21.15.123:0/1817421746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f680c15ad20 msgr2=0x7f680c0cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f681443e700 1 --2- 172.21.15.123:0/1817421746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f680c15ad20 0x7f680c0cc6b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f680c0cbb80 tx=0x7f6808009bf0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f681443e700 1 -- 172.21.15.123:0/1817421746 shutdown_connections 2024-09-13T17:09:07.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f681443e700 1 --2- 172.21.15.123:0/1817421746 >> v2:172.21.15.153:3300/0 conn(0x7f680c0afc00 0x7f680c06c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f681443e700 1 --2- 172.21.15.123:0/1817421746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f680c15ad20 0x7f680c0cc6b0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f681443e700 1 -- 172.21.15.123:0/1817421746 >> 172.21.15.123:0/1817421746 conn(0x7f680c06a660 msgr2=0x7f680c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:07.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f681443e700 1 -- 172.21.15.123:0/1817421746 shutdown_connections 2024-09-13T17:09:07.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.615+0000 7f681443e700 1 -- 172.21.15.123:0/1817421746 wait complete. 2024-09-13T17:09:07.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f681443e700 1 Processor -- start 2024-09-13T17:09:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f681443e700 1 -- start start 2024-09-13T17:09:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f681443e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f680c0afc00 0x7f680c0ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f681443e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f680c0ccbf0 0x7f680c15b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f681443e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f680c15ad20 0x7f680c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f681443e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c15cf90 con 0x7f680c0afc00 2024-09-13T17:09:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f681443e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c15bef0 con 0x7f680c15ad20 2024-09-13T17:09:07.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f681443e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c15c1d0 con 0x7f680c0ccbf0 2024-09-13T17:09:07.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f68121da700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f680c0afc00 0x7f680c0ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:07.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f68121da700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f680c0afc00 0x7f680c0ca550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42912/0 (socket says 172.21.15.123:42912) 2024-09-13T17:09:07.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f68121da700 1 -- 172.21.15.123:0/1372094519 learned_addr learned my addr 172.21.15.123:0/1372094519 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f68119d9700 1 --2- 172.21.15.123:0/1372094519 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f680c0ccbf0 0x7f680c15b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f68129db700 1 --2- 172.21.15.123:0/1372094519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f680c15ad20 0x7f680c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f68121da700 1 -- 172.21.15.123:0/1372094519 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f680c0ccbf0 msgr2=0x7f680c15b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f68121da700 1 --2- 172.21.15.123:0/1372094519 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f680c0ccbf0 0x7f680c15b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f68121da700 1 -- 172.21.15.123:0/1372094519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f680c15ad20 msgr2=0x7f680c15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f68121da700 1 --2- 172.21.15.123:0/1372094519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f680c15ad20 0x7f680c15d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.619+0000 7f68121da700 1 -- 172.21.15.123:0/1372094519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6808009570 con 0x7f680c0afc00 2024-09-13T17:09:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.623+0000 7f68121da700 1 --2- 172.21.15.123:0/1372094519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f680c0afc00 0x7f680c0ca550 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f680c067130 tx=0x7f6808004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:07.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.623+0000 7f6802ffd700 1 -- 172.21.15.123:0/1372094519 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808004450 con 0x7f680c0afc00 2024-09-13T17:09:07.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.623+0000 7f6802ffd700 1 -- 172.21.15.123:0/1372094519 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680801f070 con 0x7f680c0afc00 2024-09-13T17:09:07.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.623+0000 7f681443e700 1 -- 172.21.15.123:0/1372094519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680c15c4b0 con 0x7f680c0afc00 2024-09-13T17:09:07.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.623+0000 7f6802ffd700 1 -- 172.21.15.123:0/1372094519 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808003900 con 0x7f680c0afc00 2024-09-13T17:09:07.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.623+0000 7f681443e700 1 -- 172.21.15.123:0/1372094519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c15ca70 con 0x7f680c0afc00 2024-09-13T17:09:07.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.623+0000 7f681443e700 1 -- 172.21.15.123:0/1372094519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680c06c270 con 0x7f680c0afc00 2024-09-13T17:09:07.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.623+0000 7f6802ffd700 1 -- 172.21.15.123:0/1372094519 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6808003a60 con 0x7f680c0afc00 2024-09-13T17:09:07.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.623+0000 7f6802ffd700 1 --2- 172.21.15.123:0/1372094519 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f67f0066730 0x7f67f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:07.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.627+0000 7f6802ffd700 1 -- 172.21.15.123:0/1372094519 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6808021070 con 0x7f680c0afc00 2024-09-13T17:09:07.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.627+0000 7f68119d9700 1 --2- 172.21.15.123:0/1372094519 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f67f0066730 0x7f67f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:07.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.627+0000 7f68119d9700 1 --2- 172.21.15.123:0/1372094519 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f67f0066730 0x7f67f0068bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f680c15a730 tx=0x7f67fc009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.631+0000 7f6802ffd700 1 -- 172.21.15.123:0/1372094519 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6808052940 con 0x7f680c0afc00 2024-09-13T17:09:07.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:07.835+0000 7f681443e700 1 -- 172.21.15.123:0/1372094519 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f680c0caef0 con 0x7f680c0afc00 2024-09-13T17:09:08.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.479+0000 7f6802ffd700 1 -- 172.21.15.123:0/1372094519 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) v1 ==== 104+0+0 (secure 0 0 0) 0x7f68080045d0 con 0x7f680c0afc00 2024-09-13T17:09:08.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.483+0000 7f681443e700 1 -- 172.21.15.123:0/1372094519 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f67f0066730 msgr2=0x7f67f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:08.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.483+0000 7f681443e700 1 --2- 172.21.15.123:0/1372094519 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f67f0066730 0x7f67f0068bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f680c15a730 tx=0x7f67fc009240 comp rx=0 tx=0).stop 2024-09-13T17:09:08.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.483+0000 7f681443e700 1 -- 172.21.15.123:0/1372094519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f680c0afc00 msgr2=0x7f680c0ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:08.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.483+0000 7f681443e700 1 --2- 172.21.15.123:0/1372094519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f680c0afc00 0x7f680c0ca550 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f680c067130 tx=0x7f6808004770 comp rx=0 tx=0).stop 2024-09-13T17:09:08.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.483+0000 7f681443e700 1 -- 172.21.15.123:0/1372094519 shutdown_connections 2024-09-13T17:09:08.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.483+0000 7f681443e700 1 --2- 172.21.15.123:0/1372094519 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f67f0066730 0x7f67f0068bf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:08.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.483+0000 7f681443e700 1 --2- 172.21.15.123:0/1372094519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f680c15ad20 0x7f680c15d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:08.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.483+0000 7f681443e700 1 --2- 172.21.15.123:0/1372094519 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f680c0ccbf0 0x7f680c15b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:08.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.483+0000 7f681443e700 1 --2- 172.21.15.123:0/1372094519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f680c0afc00 0x7f680c0ca550 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:08.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.483+0000 7f681443e700 1 -- 172.21.15.123:0/1372094519 >> 172.21.15.123:0/1372094519 conn(0x7f680c06a660 msgr2=0x7f680c0b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:08.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.483+0000 7f681443e700 1 -- 172.21.15.123:0/1372094519 shutdown_connections 2024-09-13T17:09:08.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.487+0000 7f681443e700 1 -- 172.21.15.123:0/1372094519 wait complete. 2024-09-13T17:09:08.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:09:08.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.675+0000 7ff3ff59e700 1 Processor -- start 2024-09-13T17:09:08.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.675+0000 7ff3ff59e700 1 -- start start 2024-09-13T17:09:08.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff400159550 0x7ff40006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:08.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff4000ce210 0x7ff400070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:08.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff400070d90 0x7ff40006e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:08.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff400071220 con 0x7ff4000ce210 2024-09-13T17:09:08.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40006d500 con 0x7ff400159550 2024-09-13T17:09:08.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40006e080 con 0x7ff400070d90 2024-09-13T17:09:08.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3fdd9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff4000ce210 0x7ff400070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:08.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3fdd9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff4000ce210 0x7ff400070850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42916/0 (socket says 172.21.15.123:42916) 2024-09-13T17:09:08.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3fdd9b700 1 -- 172.21.15.123:0/3205751253 learned_addr learned my addr 172.21.15.123:0/3205751253 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:08.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3fe59c700 1 --2- 172.21.15.123:0/3205751253 >> v2:172.21.15.153:3300/0 conn(0x7ff400159550 0x7ff40006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:08.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3fed9d700 1 --2- 172.21.15.123:0/3205751253 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff400070d90 0x7ff40006e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:08.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3fdd9b700 1 -- 172.21.15.123:0/3205751253 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff400070d90 msgr2=0x7ff40006e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:08.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3fdd9b700 1 --2- 172.21.15.123:0/3205751253 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff400070d90 0x7ff40006e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:08.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3fdd9b700 1 -- 172.21.15.123:0/3205751253 >> v2:172.21.15.153:3300/0 conn(0x7ff400159550 msgr2=0x7ff40006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:08.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3fdd9b700 1 --2- 172.21.15.123:0/3205751253 >> v2:172.21.15.153:3300/0 conn(0x7ff400159550 0x7ff40006c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:08.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3fdd9b700 1 -- 172.21.15.123:0/3205751253 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40006d750 con 0x7ff4000ce210 2024-09-13T17:09:08.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3fdd9b700 1 --2- 172.21.15.123:0/3205751253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4000ce210 0x7ff400070850 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff40006a2c0 tx=0x7ff3e8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd39858e620fb91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:08.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3fd59a700 1 -- 172.21.15.123:0/3205751253 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8011830 con 0x7ff4000ce210 2024-09-13T17:09:08.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3fd59a700 1 -- 172.21.15.123:0/3205751253 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e8011990 con 0x7ff4000ce210 2024-09-13T17:09:08.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3fd59a700 1 -- 172.21.15.123:0/3205751253 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8011d20 con 0x7ff4000ce210 2024-09-13T17:09:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3205751253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4000ce210 msgr2=0x7ff400070850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 --2- 172.21.15.123:0/3205751253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4000ce210 0x7ff400070850 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff40006a2c0 tx=0x7ff3e8009bf0 comp rx=0 tx=0).stop 2024-09-13T17:09:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3205751253 shutdown_connections 2024-09-13T17:09:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 --2- 172.21.15.123:0/3205751253 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff400070d90 0x7ff40006e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 --2- 172.21.15.123:0/3205751253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4000ce210 0x7ff400070850 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 --2- 172.21.15.123:0/3205751253 >> v2:172.21.15.153:3300/0 conn(0x7ff400159550 0x7ff40006c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3205751253 >> 172.21.15.123:0/3205751253 conn(0x7ff400072730 msgr2=0x7ff400066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3205751253 shutdown_connections 2024-09-13T17:09:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.679+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3205751253 wait complete. 2024-09-13T17:09:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3ff59e700 1 Processor -- start 2024-09-13T17:09:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3ff59e700 1 -- start start 2024-09-13T17:09:08.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3ff59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff400070d90 0x7ff400147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:08.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3ff59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4000ce210 0x7ff40015b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:08.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3ff59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff400159550 0x7ff400144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:08.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3ff59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40015cc60 con 0x7ff400070d90 2024-09-13T17:09:08.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3ff59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40015bdb0 con 0x7ff400159550 2024-09-13T17:09:08.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3ff59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40014cfd0 con 0x7ff4000ce210 2024-09-13T17:09:08.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3fe59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff400070d90 0x7ff400147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:08.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3fe59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff400070d90 0x7ff400147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42918/0 (socket says 172.21.15.123:42918) 2024-09-13T17:09:08.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3fe59c700 1 -- 172.21.15.123:0/3912118143 learned_addr learned my addr 172.21.15.123:0/3912118143 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:08.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3fed9d700 1 --2- 172.21.15.123:0/3912118143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff400159550 0x7ff400144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:08.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3fdd9b700 1 --2- 172.21.15.123:0/3912118143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4000ce210 0x7ff40015b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:08.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3fe59c700 1 -- 172.21.15.123:0/3912118143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4000ce210 msgr2=0x7ff40015b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:08.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3fe59c700 1 --2- 172.21.15.123:0/3912118143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4000ce210 0x7ff40015b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:08.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3fe59c700 1 -- 172.21.15.123:0/3912118143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff400159550 msgr2=0x7ff400144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:08.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3fe59c700 1 --2- 172.21.15.123:0/3912118143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff400159550 0x7ff400144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:08.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3fe59c700 1 -- 172.21.15.123:0/3912118143 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8009570 con 0x7ff400070d90 2024-09-13T17:09:08.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3fe59c700 1 --2- 172.21.15.123:0/3912118143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff400070d90 0x7ff400147ff0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000e870 tx=0x7ff3f000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:08.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3f6ffd700 1 -- 172.21.15.123:0/3912118143 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f00095a0 con 0x7ff400070d90 2024-09-13T17:09:08.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3f6ffd700 1 -- 172.21.15.123:0/3912118143 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f0013680 con 0x7ff400070d90 2024-09-13T17:09:08.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3912118143 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff400144890 con 0x7ff400070d90 2024-09-13T17:09:08.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3f6ffd700 1 -- 172.21.15.123:0/3912118143 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f00139f0 con 0x7ff400070d90 2024-09-13T17:09:08.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.683+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3912118143 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40015c2c0 con 0x7ff400070d90 2024-09-13T17:09:08.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.687+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3912118143 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4000677f0 con 0x7ff400070d90 2024-09-13T17:09:08.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.687+0000 7ff3f6ffd700 1 -- 172.21.15.123:0/3912118143 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3f0013b50 con 0x7ff400070d90 2024-09-13T17:09:08.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.687+0000 7ff3f6ffd700 1 --2- 172.21.15.123:0/3912118143 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3e0066730 0x7ff3e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:08.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.687+0000 7ff3f6ffd700 1 -- 172.21.15.123:0/3912118143 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff3f0083ed0 con 0x7ff400070d90 2024-09-13T17:09:08.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.687+0000 7ff3fdd9b700 1 --2- 172.21.15.123:0/3912118143 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3e0066730 0x7ff3e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:08.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.687+0000 7ff3fdd9b700 1 --2- 172.21.15.123:0/3912118143 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3e0066730 0x7ff3e0068bf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009c30 tx=0x7ff3e8008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:08.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.695+0000 7ff3f6ffd700 1 -- 172.21.15.123:0/3912118143 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3f0051270 con 0x7ff400070d90 2024-09-13T17:09:08.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:08.863+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3912118143 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff40006ee40 con 0x7ff400070d90 2024-09-13T17:09:09.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.483+0000 7ff3f6ffd700 1 -- 172.21.15.123:0/3912118143 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v62) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff3f0054890 con 0x7ff400070d90 2024-09-13T17:09:09.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.491+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3912118143 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3e0066730 msgr2=0x7ff3e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:09.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.491+0000 7ff3ff59e700 1 --2- 172.21.15.123:0/3912118143 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3e0066730 0x7ff3e0068bf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009c30 tx=0x7ff3e8008030 comp rx=0 tx=0).stop 2024-09-13T17:09:09.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.491+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3912118143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff400070d90 msgr2=0x7ff400147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:09.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.491+0000 7ff3ff59e700 1 --2- 172.21.15.123:0/3912118143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff400070d90 0x7ff400147ff0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000e870 tx=0x7ff3f000eb80 comp rx=0 tx=0).stop 2024-09-13T17:09:09.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.491+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3912118143 shutdown_connections 2024-09-13T17:09:09.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.491+0000 7ff3ff59e700 1 --2- 172.21.15.123:0/3912118143 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3e0066730 0x7ff3e0068bf0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:09.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.491+0000 7ff3ff59e700 1 --2- 172.21.15.123:0/3912118143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff400159550 0x7ff400144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:09.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.491+0000 7ff3ff59e700 1 --2- 172.21.15.123:0/3912118143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4000ce210 0x7ff40015b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:09.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.491+0000 7ff3ff59e700 1 --2- 172.21.15.123:0/3912118143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff400070d90 0x7ff400147ff0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:09.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.491+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3912118143 >> 172.21.15.123:0/3912118143 conn(0x7ff400072730 msgr2=0x7ff4000b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:09.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.491+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3912118143 shutdown_connections 2024-09-13T17:09:09.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.491+0000 7ff3ff59e700 1 -- 172.21.15.123:0/3912118143 wait complete. 2024-09-13T17:09:09.498 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:09:09.510 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:09:09.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.623+0000 7fcfa55b5700 1 Processor -- start 2024-09-13T17:09:09.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.623+0000 7fcfa55b5700 1 -- start start 2024-09-13T17:09:09.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.623+0000 7fcfa55b5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcfa00d3220 0x7fcfa00d36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:09.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.623+0000 7fcfa55b5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcfa00d1080 0x7fcfa00d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:09.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.623+0000 7fcfa55b5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa01606f0 con 0x7fcfa0160310 2024-09-13T17:09:09.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.623+0000 7fcfa55b5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa00d1a30 con 0x7fcfa00d1080 2024-09-13T17:09:09.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.623+0000 7fcfa55b5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa00ce7b0 con 0x7fcfa00d3220 2024-09-13T17:09:09.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcf9ffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcfa0160310 0x7fcfa00cf850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60426/0 (socket says 172.21.15.123:60426) 2024-09-13T17:09:09.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcf9ffff700 1 -- 172.21.15.123:0/3945372259 learned_addr learned my addr 172.21.15.123:0/3945372259 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:09.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcfa4db4700 1 --2- 172.21.15.123:0/3945372259 >> v2:172.21.15.123:3300/0 conn(0x7fcfa00d1080 0x7fcfa00d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:09.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcf9f7fe700 1 --2- 172.21.15.123:0/3945372259 >> v2:172.21.15.153:3300/0 conn(0x7fcfa00d3220 0x7fcfa00d36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:09.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcf9effd700 1 -- 172.21.15.123:0/3945372259 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419959344 0 0) 0x7fcfa01606f0 con 0x7fcfa0160310 2024-09-13T17:09:09.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcf9effd700 1 -- 172.21.15.123:0/3945372259 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf8c0035d0 con 0x7fcfa0160310 2024-09-13T17:09:09.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcfa4db4700 1 -- 172.21.15.123:0/3945372259 >> v2:172.21.15.153:3300/0 conn(0x7fcfa00d3220 msgr2=0x7fcfa00d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:09.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcfa4db4700 1 --2- 172.21.15.123:0/3945372259 >> v2:172.21.15.153:3300/0 conn(0x7fcfa00d3220 0x7fcfa00d36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:09.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcfa4db4700 1 -- 172.21.15.123:0/3945372259 >> v1:172.21.15.123:6789/0 conn(0x7fcfa0160310 legacy=0x7fcfa00cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:09.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcfa4db4700 1 -- 172.21.15.123:0/3945372259 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa00cea90 con 0x7fcfa00d1080 2024-09-13T17:09:09.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcfa4db4700 1 --2- 172.21.15.123:0/3945372259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfa00d1080 0x7fcfa00d14f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009d90 tx=0x7fcf9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae41af92fbd7b96d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:09.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcf9effd700 1 -- 172.21.15.123:0/3945372259 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9000e070 con 0x7fcfa00d1080 2024-09-13T17:09:09.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcf9effd700 1 -- 172.21.15.123:0/3945372259 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9000bae0 con 0x7fcfa00d1080 2024-09-13T17:09:09.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcf9effd700 1 -- 172.21.15.123:0/3945372259 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9000be90 con 0x7fcfa00d1080 2024-09-13T17:09:09.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcfa55b5700 1 -- 172.21.15.123:0/3945372259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfa00d1080 msgr2=0x7fcfa00d14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:09.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcfa55b5700 1 --2- 172.21.15.123:0/3945372259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfa00d1080 0x7fcfa00d14f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009d90 tx=0x7fcf9000b330 comp rx=0 tx=0).stop 2024-09-13T17:09:09.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcfa55b5700 1 -- 172.21.15.123:0/3945372259 shutdown_connections 2024-09-13T17:09:09.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcfa55b5700 1 --2- 172.21.15.123:0/3945372259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfa00d1080 0x7fcfa00d14f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:09.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcfa55b5700 1 --2- 172.21.15.123:0/3945372259 >> v2:172.21.15.153:3300/0 conn(0x7fcfa00d3220 0x7fcfa00d36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:09.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcfa55b5700 1 -- 172.21.15.123:0/3945372259 >> 172.21.15.123:0/3945372259 conn(0x7fcfa009be50 msgr2=0x7fcfa00d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:09.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcfa55b5700 1 -- 172.21.15.123:0/3945372259 shutdown_connections 2024-09-13T17:09:09.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.627+0000 7fcfa55b5700 1 -- 172.21.15.123:0/3945372259 wait complete. 2024-09-13T17:09:09.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcfa55b5700 1 Processor -- start 2024-09-13T17:09:09.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcfa55b5700 1 -- start start 2024-09-13T17:09:09.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcfa55b5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfa00d1080 0x7fcfa0154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:09.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcfa55b5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfa00d3220 0x7fcfa015b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:09.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcfa55b5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfa0160310 0x7fcfa00b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:09.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcfa55b5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa015e440 con 0x7fcfa00d1080 2024-09-13T17:09:09.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcfa55b5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa015e720 con 0x7fcfa00d3220 2024-09-13T17:09:09.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcfa55b5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa015ea00 con 0x7fcfa0160310 2024-09-13T17:09:09.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcf9ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfa00d1080 0x7fcfa0154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:09.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcf9ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfa00d1080 0x7fcfa0154f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42936/0 (socket says 172.21.15.123:42936) 2024-09-13T17:09:09.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcf9ffff700 1 -- 172.21.15.123:0/1972720995 learned_addr learned my addr 172.21.15.123:0/1972720995 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:09.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcfa4db4700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfa0160310 0x7fcfa00b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:09.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcf9f7fe700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfa00d3220 0x7fcfa015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:09.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcf9ffff700 1 -- 172.21.15.123:0/1972720995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfa0160310 msgr2=0x7fcfa00b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:09.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcf9ffff700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfa0160310 0x7fcfa00b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:09.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcf9ffff700 1 -- 172.21.15.123:0/1972720995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfa00d3220 msgr2=0x7fcfa015b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:09.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcf9ffff700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfa00d3220 0x7fcfa015b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:09.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcf9ffff700 1 -- 172.21.15.123:0/1972720995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf90009a70 con 0x7fcfa00d1080 2024-09-13T17:09:09.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcfa4db4700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfa0160310 0x7fcfa00b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:09.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcf9f7fe700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfa00d3220 0x7fcfa015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:09.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcf9ffff700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfa00d1080 0x7fcfa0154f40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800c4d0 tx=0x7fcf9800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:09.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcf9cff9700 1 -- 172.21.15.123:0/1972720995 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98005d90 con 0x7fcfa00d1080 2024-09-13T17:09:09.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcf9cff9700 1 -- 172.21.15.123:0/1972720995 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf980070d0 con 0x7fcfa00d1080 2024-09-13T17:09:09.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcfa55b5700 1 -- 172.21.15.123:0/1972720995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa015ece0 con 0x7fcfa00d1080 2024-09-13T17:09:09.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcf9cff9700 1 -- 172.21.15.123:0/1972720995 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98007480 con 0x7fcfa00d1080 2024-09-13T17:09:09.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.631+0000 7fcfa55b5700 1 -- 172.21.15.123:0/1972720995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa015baa0 con 0x7fcfa00d1080 2024-09-13T17:09:09.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.635+0000 7fcfa55b5700 1 -- 172.21.15.123:0/1972720995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa00677f0 con 0x7fcfa00d1080 2024-09-13T17:09:09.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.635+0000 7fcf9cff9700 1 -- 172.21.15.123:0/1972720995 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf980075e0 con 0x7fcfa00d1080 2024-09-13T17:09:09.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.635+0000 7fcf9cff9700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcf80066730 0x7fcf80068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:09.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.635+0000 7fcf9cff9700 1 -- 172.21.15.123:0/1972720995 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fcf980834f0 con 0x7fcfa00d1080 2024-09-13T17:09:09.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.635+0000 7fcf9f7fe700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcf80066730 0x7fcf80068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:09.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.635+0000 7fcf9f7fe700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcf80066730 0x7fcf80068bf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00d0830 tx=0x7fcf88008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:09.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.643+0000 7fcf9cff9700 1 -- 172.21.15.123:0/1972720995 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf98050a50 con 0x7fcfa00d1080 2024-09-13T17:09:09.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:09.815+0000 7fcfa55b5700 1 -- 172.21.15.123:0/1972720995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcfa00ce410 con 0x7fcfa00d1080 2024-09-13T17:09:10.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.499+0000 7fcf9cff9700 1 -- 172.21.15.123:0/1972720995 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v63) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcf98054070 con 0x7fcfa00d1080 2024-09-13T17:09:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.503+0000 7fcfa55b5700 1 -- 172.21.15.123:0/1972720995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcf80066730 msgr2=0x7fcf80068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.503+0000 7fcfa55b5700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcf80066730 0x7fcf80068bf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00d0830 tx=0x7fcf88008040 comp rx=0 tx=0).stop 2024-09-13T17:09:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.503+0000 7fcfa55b5700 1 -- 172.21.15.123:0/1972720995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfa00d1080 msgr2=0x7fcfa0154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.503+0000 7fcfa55b5700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfa00d1080 0x7fcfa0154f40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800c4d0 tx=0x7fcf9800c890 comp rx=0 tx=0).stop 2024-09-13T17:09:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.503+0000 7fcfa55b5700 1 -- 172.21.15.123:0/1972720995 shutdown_connections 2024-09-13T17:09:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.503+0000 7fcfa55b5700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcf80066730 0x7fcf80068bf0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.503+0000 7fcfa55b5700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcfa0160310 0x7fcfa00b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.503+0000 7fcfa55b5700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfa00d3220 0x7fcfa015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.503+0000 7fcfa55b5700 1 --2- 172.21.15.123:0/1972720995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfa00d1080 0x7fcfa0154f40 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.503+0000 7fcfa55b5700 1 -- 172.21.15.123:0/1972720995 >> 172.21.15.123:0/1972720995 conn(0x7fcfa009be50 msgr2=0x7fcfa00b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:10.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.503+0000 7fcfa55b5700 1 -- 172.21.15.123:0/1972720995 shutdown_connections 2024-09-13T17:09:10.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.503+0000 7fcfa55b5700 1 -- 172.21.15.123:0/1972720995 wait complete. 2024-09-13T17:09:10.510 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-13T17:09:10.523 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T17:09:10.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4091a4b700 1 Processor -- start 2024-09-13T17:09:10.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4091a4b700 1 -- start start 2024-09-13T17:09:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4091a4b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f408c15cd90 0x7f408c0ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4091a4b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408c0ca550 con 0x7f408c0cb6e0 2024-09-13T17:09:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4091a4b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408c0c94b0 con 0x7f408c0c8ff0 2024-09-13T17:09:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4091a4b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c0ca130 con 0x7f408c15cd90 2024-09-13T17:09:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4090a49700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f408c15cd90 0x7f408c0ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f409124a700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f408c0cb6e0 0x7f408c0cc580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60440/0 (socket says 172.21.15.123:60440) 2024-09-13T17:09:10.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f409124a700 1 -- 172.21.15.123:0/4129211854 learned_addr learned my addr 172.21.15.123:0/4129211854 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:10.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4090a49700 1 -- 172.21.15.123:0/4129211854 >> v1:172.21.15.153:6789/0 conn(0x7f408c0c8ff0 legacy=0x7f408c0cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:10.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f408b7fe700 1 -- 172.21.15.123:0/4129211854 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555347239 0 0) 0x7f408c0ca550 con 0x7f408c0cb6e0 2024-09-13T17:09:10.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4090a49700 1 -- 172.21.15.123:0/4129211854 >> v1:172.21.15.123:6789/0 conn(0x7f408c0cb6e0 legacy=0x7f408c0cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:10.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4090a49700 1 -- 172.21.15.123:0/4129211854 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c0c9790 con 0x7f408c15cd90 2024-09-13T17:09:10.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4090a49700 1 --2- 172.21.15.123:0/4129211854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f408c15cd90 0x7f408c0ca8f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4074009850 tx=0x7f4074009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b171c68d8380909b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:10.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f408b7fe700 1 -- 172.21.15.123:0/4129211854 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074004230 con 0x7f408c15cd90 2024-09-13T17:09:10.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f408b7fe700 1 -- 172.21.15.123:0/4129211854 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4074004390 con 0x7f408c15cd90 2024-09-13T17:09:10.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f408b7fe700 1 -- 172.21.15.123:0/4129211854 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40740036c0 con 0x7f408c15cd90 2024-09-13T17:09:10.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4091a4b700 1 -- 172.21.15.123:0/4129211854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f408c15cd90 msgr2=0x7f408c0ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:10.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4091a4b700 1 --2- 172.21.15.123:0/4129211854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f408c15cd90 0x7f408c0ca8f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4074009850 tx=0x7f4074009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:10.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4091a4b700 1 -- 172.21.15.123:0/4129211854 shutdown_connections 2024-09-13T17:09:10.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4091a4b700 1 --2- 172.21.15.123:0/4129211854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f408c15cd90 0x7f408c0ca8f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.635+0000 7f4091a4b700 1 -- 172.21.15.123:0/4129211854 >> 172.21.15.123:0/4129211854 conn(0x7f408c0b01d0 msgr2=0x7f408c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:10.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.639+0000 7f4091a4b700 1 -- 172.21.15.123:0/4129211854 shutdown_connections 2024-09-13T17:09:10.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.639+0000 7f4091a4b700 1 -- 172.21.15.123:0/4129211854 wait complete. 2024-09-13T17:09:10.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.639+0000 7f4091a4b700 1 Processor -- start 2024-09-13T17:09:10.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.639+0000 7f4091a4b700 1 -- start start 2024-09-13T17:09:10.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.639+0000 7f4091a4b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f408c0c8ff0 0x7f408c159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.639+0000 7f4091a4b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f408c0cb6e0 0x7f408c0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.639+0000 7f4091a4b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f408c15cd90 0x7f408c156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.639+0000 7f4091a4b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0b3ec0 con 0x7f408c0c8ff0 2024-09-13T17:09:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.639+0000 7f4091a4b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0b3a30 con 0x7f408c0cb6e0 2024-09-13T17:09:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.639+0000 7f4091a4b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c14c5d0 con 0x7f408c15cd90 2024-09-13T17:09:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.639+0000 7f4090a49700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f408c0c8ff0 0x7f408c159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.639+0000 7f4090a49700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f408c0c8ff0 0x7f408c159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42960/0 (socket says 172.21.15.123:42960) 2024-09-13T17:09:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.639+0000 7f4090a49700 1 -- 172.21.15.123:0/41104274 learned_addr learned my addr 172.21.15.123:0/41104274 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f408bfff700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f408c0cb6e0 0x7f408c0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f409124a700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f408c15cd90 0x7f408c156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f4090a49700 1 -- 172.21.15.123:0/41104274 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f408c15cd90 msgr2=0x7f408c156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f4090a49700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f408c15cd90 0x7f408c156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f4090a49700 1 -- 172.21.15.123:0/41104274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f408c0cb6e0 msgr2=0x7f408c0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f4090a49700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f408c0cb6e0 0x7f408c0b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f4090a49700 1 -- 172.21.15.123:0/41104274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40740094b0 con 0x7f408c0c8ff0 2024-09-13T17:09:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f408bfff700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f408c0cb6e0 0x7f408c0b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f409124a700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f408c15cd90 0x7f408c156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f4090a49700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f408c0c8ff0 0x7f408c159700 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f40740090b0 tx=0x7f4074004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f40897fa700 1 -- 172.21.15.123:0/41104274 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074006ea0 con 0x7f408c0c8ff0 2024-09-13T17:09:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f40897fa700 1 -- 172.21.15.123:0/41104274 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4074011a40 con 0x7f408c0c8ff0 2024-09-13T17:09:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f4091a4b700 1 -- 172.21.15.123:0/41104274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408c0b2e20 con 0x7f408c0c8ff0 2024-09-13T17:09:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f40897fa700 1 -- 172.21.15.123:0/41104274 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074011df0 con 0x7f408c0c8ff0 2024-09-13T17:09:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f4091a4b700 1 -- 172.21.15.123:0/41104274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408c0b33e0 con 0x7f408c0c8ff0 2024-09-13T17:09:10.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f4091a4b700 1 -- 172.21.15.123:0/41104274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408c15d200 con 0x7f408c0c8ff0 2024-09-13T17:09:10.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f40897fa700 1 -- 172.21.15.123:0/41104274 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4074024460 con 0x7f408c0c8ff0 2024-09-13T17:09:10.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f40897fa700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f406c066760 0x7f406c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:10.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f40897fa700 1 -- 172.21.15.123:0/41104274 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f40740858c0 con 0x7f408c0c8ff0 2024-09-13T17:09:10.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.643+0000 7f408bfff700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f406c066760 0x7f406c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:10.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.647+0000 7f408bfff700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f406c066760 0x7f406c068c20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f408c0ad230 tx=0x7f407c009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:10.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.651+0000 7f40897fa700 1 -- 172.21.15.123:0/41104274 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4074053060 con 0x7f408c0c8ff0 2024-09-13T17:09:10.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.819+0000 7f4091a4b700 1 -- 172.21.15.123:0/41104274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f408c06c3b0 con 0x7f408c0c8ff0 2024-09-13T17:09:10.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.827+0000 7f40897fa700 1 -- 172.21.15.123:0/41104274 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4074056680 con 0x7f408c0c8ff0 2024-09-13T17:09:10.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.831+0000 7f4091a4b700 1 -- 172.21.15.123:0/41104274 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f406c066760 msgr2=0x7f406c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:10.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.831+0000 7f4091a4b700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f406c066760 0x7f406c068c20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f408c0ad230 tx=0x7f407c009040 comp rx=0 tx=0).stop 2024-09-13T17:09:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.831+0000 7f4091a4b700 1 -- 172.21.15.123:0/41104274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f408c0c8ff0 msgr2=0x7f408c159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.831+0000 7f4091a4b700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f408c0c8ff0 0x7f408c159700 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f40740090b0 tx=0x7f4074004770 comp rx=0 tx=0).stop 2024-09-13T17:09:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.831+0000 7f4091a4b700 1 -- 172.21.15.123:0/41104274 shutdown_connections 2024-09-13T17:09:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.831+0000 7f4091a4b700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f406c066760 0x7f406c068c20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.831+0000 7f4091a4b700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f408c15cd90 0x7f408c156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.831+0000 7f4091a4b700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f408c0cb6e0 0x7f408c0b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.831+0000 7f4091a4b700 1 --2- 172.21.15.123:0/41104274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f408c0c8ff0 0x7f408c159700 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.831+0000 7f4091a4b700 1 -- 172.21.15.123:0/41104274 >> 172.21.15.123:0/41104274 conn(0x7f408c0b01d0 msgr2=0x7f408c0ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.831+0000 7f4091a4b700 1 -- 172.21.15.123:0/41104274 shutdown_connections 2024-09-13T17:09:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.831+0000 7f4091a4b700 1 -- 172.21.15.123:0/41104274 wait complete. 2024-09-13T17:09:10.850 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values' 2024-09-13T17:09:10.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.959+0000 7f46aac8f700 1 Processor -- start 2024-09-13T17:09:10.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.959+0000 7f46aac8f700 1 -- start start 2024-09-13T17:09:10.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46a41602d0 0x7f46a40d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:10.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f46a40d3680 0x7f46a40cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:10.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a40d0ea0 con 0x7f46a40cf750 2024-09-13T17:09:10.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a40ceab0 con 0x7f46a40d3680 2024-09-13T17:09:10.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a40cff00 con 0x7f46a41602d0 2024-09-13T17:09:10.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46a948c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f46a40d3680 0x7f46a40cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:10.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46a948c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f46a40d3680 0x7f46a40cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42964/0 (socket says 172.21.15.123:42964) 2024-09-13T17:09:10.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46a948c700 1 -- 172.21.15.123:0/2056649828 learned_addr learned my addr 172.21.15.123:0/2056649828 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:10.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46a9c8d700 1 --2- 172.21.15.123:0/2056649828 >> v2:172.21.15.153:3300/0 conn(0x7f46a41602d0 0x7f46a40d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:10.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46a948c700 1 -- 172.21.15.123:0/2056649828 >> v2:172.21.15.153:3300/0 conn(0x7f46a41602d0 msgr2=0x7f46a40d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:10.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46a948c700 1 --2- 172.21.15.123:0/2056649828 >> v2:172.21.15.153:3300/0 conn(0x7f46a41602d0 0x7f46a40d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46a948c700 1 -- 172.21.15.123:0/2056649828 >> v1:172.21.15.153:6789/0 conn(0x7f46a40cf750 legacy=0x7f46a40cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:10.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46a948c700 1 -- 172.21.15.123:0/2056649828 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a40d0c70 con 0x7f46a40d3680 2024-09-13T17:09:10.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46a948c700 1 --2- 172.21.15.123:0/2056649828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a40d3680 0x7f46a40cf210 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4694009910 tx=0x7f4694009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c41aa6845312788 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:10.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46a8c8b700 1 -- 172.21.15.123:0/2056649828 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694011830 con 0x7f46a40d3680 2024-09-13T17:09:10.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46a8c8b700 1 -- 172.21.15.123:0/2056649828 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4694011990 con 0x7f46a40d3680 2024-09-13T17:09:10.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46a8c8b700 1 -- 172.21.15.123:0/2056649828 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694011d40 con 0x7f46a40d3680 2024-09-13T17:09:10.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 -- 172.21.15.123:0/2056649828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a40d3680 msgr2=0x7f46a40cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:10.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 --2- 172.21.15.123:0/2056649828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a40d3680 0x7f46a40cf210 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4694009910 tx=0x7f4694009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:10.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 -- 172.21.15.123:0/2056649828 shutdown_connections 2024-09-13T17:09:10.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 --2- 172.21.15.123:0/2056649828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a40d3680 0x7f46a40cf210 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 --2- 172.21.15.123:0/2056649828 >> v2:172.21.15.153:3300/0 conn(0x7f46a41602d0 0x7f46a40d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 -- 172.21.15.123:0/2056649828 >> 172.21.15.123:0/2056649828 conn(0x7f46a40d2b60 msgr2=0x7f46a40d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:10.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 -- 172.21.15.123:0/2056649828 shutdown_connections 2024-09-13T17:09:10.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 -- 172.21.15.123:0/2056649828 wait complete. 2024-09-13T17:09:10.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 Processor -- start 2024-09-13T17:09:10.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.963+0000 7f46aac8f700 1 -- start start 2024-09-13T17:09:10.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46aac8f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a40cf750 0x7f46a41517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:10.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46aac8f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a40d3680 0x7f46a414e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:10.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46aac8f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46a41602d0 0x7f46a40b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:10.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46aac8f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40b1df0 con 0x7f46a40cf750 2024-09-13T17:09:10.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46aac8f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40b20c0 con 0x7f46a40d3680 2024-09-13T17:09:10.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46aac8f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40b23a0 con 0x7f46a41602d0 2024-09-13T17:09:10.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46a9c8d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a40cf750 0x7f46a41517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:10.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46a948c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a40d3680 0x7f46a414e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:10.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46a948c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a40d3680 0x7f46a414e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:36202/0 (socket says 172.21.15.123:36202) 2024-09-13T17:09:10.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46a948c700 1 -- 172.21.15.123:0/847542514 learned_addr learned my addr 172.21.15.123:0/847542514 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46aa48e700 1 --2- 172.21.15.123:0/847542514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46a41602d0 0x7f46a40b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46a948c700 1 -- 172.21.15.123:0/847542514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46a41602d0 msgr2=0x7f46a40b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46a948c700 1 --2- 172.21.15.123:0/847542514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46a41602d0 0x7f46a40b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46a948c700 1 -- 172.21.15.123:0/847542514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a40cf750 msgr2=0x7f46a41517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46a948c700 1 --2- 172.21.15.123:0/847542514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a40cf750 0x7f46a41517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46a948c700 1 -- 172.21.15.123:0/847542514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694009570 con 0x7f46a40d3680 2024-09-13T17:09:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46a9c8d700 1 --2- 172.21.15.123:0/847542514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a40cf750 0x7f46a41517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46a948c700 1 --2- 172.21.15.123:0/847542514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a40d3680 0x7f46a414e3b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f46a408b160 tx=0x7f4694004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f469a7fc700 1 -- 172.21.15.123:0/847542514 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694004300 con 0x7f46a40d3680 2024-09-13T17:09:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f469a7fc700 1 -- 172.21.15.123:0/847542514 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469401f070 con 0x7f46a40d3680 2024-09-13T17:09:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f469a7fc700 1 -- 172.21.15.123:0/847542514 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940036c0 con 0x7f46a40d3680 2024-09-13T17:09:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46aac8f700 1 -- 172.21.15.123:0/847542514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a40b2680 con 0x7f46a40d3680 2024-09-13T17:09:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46aac8f700 1 -- 172.21.15.123:0/847542514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a40b43a0 con 0x7f46a40d3680 2024-09-13T17:09:10.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f46aac8f700 1 -- 172.21.15.123:0/847542514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a41606b0 con 0x7f46a40d3680 2024-09-13T17:09:10.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.967+0000 7f469a7fc700 1 -- 172.21.15.123:0/847542514 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4694021030 con 0x7f46a40d3680 2024-09-13T17:09:10.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.971+0000 7f469a7fc700 1 --2- 172.21.15.123:0/847542514 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4688066730 0x7f4688068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:10.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.971+0000 7f469a7fc700 1 -- 172.21.15.123:0/847542514 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f46940856f0 con 0x7f46a40d3680 2024-09-13T17:09:10.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.971+0000 7f46a9c8d700 1 --2- 172.21.15.123:0/847542514 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4688066730 0x7f4688068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:10.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.971+0000 7f46a9c8d700 1 --2- 172.21.15.123:0/847542514 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4688066730 0x7f4688068bf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f46a00112c0 tx=0x7f46a0009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:10.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:10.975+0000 7f469a7fc700 1 -- 172.21.15.123:0/847542514 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4694052dd0 con 0x7f46a40d3680 2024-09-13T17:09:11.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.211+0000 7f46aac8f700 1 -- 172.21.15.123:0/847542514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values"]} v 0) v1 -- 0x7f46a4071150 con 0x7f46a40d3680 2024-09-13T17:09:11.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.511+0000 7f469a7fc700 1 -- 172.21.15.123:0/847542514 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values"]}]=0 v156) v1 ==== 145+0+0 (secure 0 0 0) 0x7f46940563f0 con 0x7f46a40d3680 2024-09-13T17:09:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.511+0000 7f46aac8f700 1 -- 172.21.15.123:0/847542514 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4688066730 msgr2=0x7f4688068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.511+0000 7f46aac8f700 1 --2- 172.21.15.123:0/847542514 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4688066730 0x7f4688068bf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f46a00112c0 tx=0x7f46a0009240 comp rx=0 tx=0).stop 2024-09-13T17:09:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.511+0000 7f46aac8f700 1 -- 172.21.15.123:0/847542514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a40d3680 msgr2=0x7f46a414e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.511+0000 7f46aac8f700 1 --2- 172.21.15.123:0/847542514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a40d3680 0x7f46a414e3b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f46a408b160 tx=0x7f4694004770 comp rx=0 tx=0).stop 2024-09-13T17:09:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.511+0000 7f46aac8f700 1 -- 172.21.15.123:0/847542514 shutdown_connections 2024-09-13T17:09:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.511+0000 7f46aac8f700 1 --2- 172.21.15.123:0/847542514 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4688066730 0x7f4688068bf0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.511+0000 7f46aac8f700 1 --2- 172.21.15.123:0/847542514 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46a41602d0 0x7f46a40b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.511+0000 7f46aac8f700 1 --2- 172.21.15.123:0/847542514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a40d3680 0x7f46a414e3b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.511+0000 7f46aac8f700 1 --2- 172.21.15.123:0/847542514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46a40cf750 0x7f46a41517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.511+0000 7f46aac8f700 1 -- 172.21.15.123:0/847542514 >> 172.21.15.123:0/847542514 conn(0x7f46a40d2b60 msgr2=0x7f46a40cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.511+0000 7f46aac8f700 1 -- 172.21.15.123:0/847542514 shutdown_connections 2024-09-13T17:09:11.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.511+0000 7f46aac8f700 1 -- 172.21.15.123:0/847542514 wait complete. 2024-09-13T17:09:11.531 INFO:tasks.cephfs_test_runner:test human-readable values for setting ceph.quota.max_bytes ... ok 2024-09-13T17:09:11.531 INFO:tasks.cephfs_test_runner:Starting test: test_remote_update_df (tasks.cephfs.test_quota.TestQuota) That when a client modifies the quota on a directory used 2024-09-13T17:09:11.532 INFO:tasks.cephfs_test_runner:test_remote_update_df (tasks.cephfs.test_quota.TestQuota) 2024-09-13T17:09:11.532 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 Processor -- start 2024-09-13T17:09:11.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 -- start start 2024-09-13T17:09:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb24160fb0 0x7fbb2406de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbb240cec90 0x7fbb240cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb240cf5f0 con 0x7fbb2406c050 2024-09-13T17:09:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2406cb60 con 0x7fbb240cec90 2024-09-13T17:09:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2406e340 con 0x7fbb24160fb0 2024-09-13T17:09:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb23fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbb240cec90 0x7fbb240cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb23fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbb240cec90 0x7fbb240cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42974/0 (socket says 172.21.15.123:42974) 2024-09-13T17:09:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb23fff700 1 -- 172.21.15.123:0/1763748993 learned_addr learned my addr 172.21.15.123:0/1763748993 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb28fe3700 1 --2- 172.21.15.123:0/1763748993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb24160fb0 0x7fbb2406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb23fff700 1 -- 172.21.15.123:0/1763748993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb24160fb0 msgr2=0x7fbb2406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb23fff700 1 --2- 172.21.15.123:0/1763748993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb24160fb0 0x7fbb2406de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb23fff700 1 -- 172.21.15.123:0/1763748993 >> v1:172.21.15.153:6789/0 conn(0x7fbb2406c050 legacy=0x7fbb2406c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb23fff700 1 -- 172.21.15.123:0/1763748993 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2406cd60 con 0x7fbb240cec90 2024-09-13T17:09:11.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb23fff700 1 --2- 172.21.15.123:0/1763748993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb240cec90 0x7fbb240cf0b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009e50 tx=0x7fbb1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a237226d1df3b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:11.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb237fe700 1 -- 172.21.15.123:0/1763748993 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c00e070 con 0x7fbb240cec90 2024-09-13T17:09:11.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb237fe700 1 -- 172.21.15.123:0/1763748993 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c00b910 con 0x7fbb240cec90 2024-09-13T17:09:11.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb237fe700 1 -- 172.21.15.123:0/1763748993 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c00bcc0 con 0x7fbb240cec90 2024-09-13T17:09:11.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 -- 172.21.15.123:0/1763748993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb240cec90 msgr2=0x7fbb240cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:11.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 --2- 172.21.15.123:0/1763748993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb240cec90 0x7fbb240cf0b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009e50 tx=0x7fbb1c00b330 comp rx=0 tx=0).stop 2024-09-13T17:09:11.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 -- 172.21.15.123:0/1763748993 shutdown_connections 2024-09-13T17:09:11.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 --2- 172.21.15.123:0/1763748993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb240cec90 0x7fbb240cf0b0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 --2- 172.21.15.123:0/1763748993 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb24160fb0 0x7fbb2406de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 -- 172.21.15.123:0/1763748993 >> 172.21.15.123:0/1763748993 conn(0x7fbb24066570 msgr2=0x7fbb24066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:11.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 -- 172.21.15.123:0/1763748993 shutdown_connections 2024-09-13T17:09:11.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.647+0000 7fbb2b247700 1 -- 172.21.15.123:0/1763748993 wait complete. 2024-09-13T17:09:11.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.651+0000 7fbb2b247700 1 Processor -- start 2024-09-13T17:09:11.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.651+0000 7fbb2b247700 1 -- start start 2024-09-13T17:09:11.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.651+0000 7fbb2b247700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb2406c050 0x7fbb2414cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:11.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.651+0000 7fbb2b247700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240cec90 0x7fbb240abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.651+0000 7fbb2b247700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb24160fb0 0x7fbb240a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.651+0000 7fbb2b247700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2414d080 con 0x7fbb24160fb0 2024-09-13T17:09:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.651+0000 7fbb2b247700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240aae80 con 0x7fbb2406c050 2024-09-13T17:09:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.651+0000 7fbb2b247700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240ab160 con 0x7fbb240cec90 2024-09-13T17:09:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.651+0000 7fbb28fe3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb2406c050 0x7fbb2414cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.651+0000 7fbb297e4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb24160fb0 0x7fbb240a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.651+0000 7fbb28fe3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb2406c050 0x7fbb2414cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:36218/0 (socket says 172.21.15.123:36218) 2024-09-13T17:09:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.651+0000 7fbb297e4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb24160fb0 0x7fbb240a8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42976/0 (socket says 172.21.15.123:42976) 2024-09-13T17:09:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.651+0000 7fbb28fe3700 1 -- 172.21.15.123:0/1177800064 learned_addr learned my addr 172.21.15.123:0/1177800064 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb23fff700 1 --2- 172.21.15.123:0/1177800064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240cec90 0x7fbb240abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb297e4700 1 -- 172.21.15.123:0/1177800064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240cec90 msgr2=0x7fbb240abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb297e4700 1 --2- 172.21.15.123:0/1177800064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240cec90 0x7fbb240abf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb297e4700 1 -- 172.21.15.123:0/1177800064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb2406c050 msgr2=0x7fbb2414cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb297e4700 1 --2- 172.21.15.123:0/1177800064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb2406c050 0x7fbb2414cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb297e4700 1 -- 172.21.15.123:0/1177800064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c009b30 con 0x7fbb24160fb0 2024-09-13T17:09:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb297e4700 1 --2- 172.21.15.123:0/1177800064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb24160fb0 0x7fbb240a8d70 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbb14001eb0 tx=0x7fbb1400c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb217fa700 1 -- 172.21.15.123:0/1177800064 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb140052d0 con 0x7fbb24160fb0 2024-09-13T17:09:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb217fa700 1 -- 172.21.15.123:0/1177800064 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb14005430 con 0x7fbb24160fb0 2024-09-13T17:09:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb2b247700 1 -- 172.21.15.123:0/1177800064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb240ab440 con 0x7fbb24160fb0 2024-09-13T17:09:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb217fa700 1 -- 172.21.15.123:0/1177800064 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb140055a0 con 0x7fbb24160fb0 2024-09-13T17:09:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb2b247700 1 -- 172.21.15.123:0/1177800064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb240aba00 con 0x7fbb24160fb0 2024-09-13T17:09:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb217fa700 1 -- 172.21.15.123:0/1177800064 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbb140038e0 con 0x7fbb24160fb0 2024-09-13T17:09:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb2b247700 1 -- 172.21.15.123:0/1177800064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb240cf0b0 con 0x7fbb24160fb0 2024-09-13T17:09:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.655+0000 7fbb217fa700 1 --2- 172.21.15.123:0/1177800064 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb04066730 0x7fbb04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.659+0000 7fbb28fe3700 1 --2- 172.21.15.123:0/1177800064 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb04066730 0x7fbb04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.659+0000 7fbb217fa700 1 -- 172.21.15.123:0/1177800064 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbb14083110 con 0x7fbb24160fb0 2024-09-13T17:09:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.659+0000 7fbb28fe3700 1 --2- 172.21.15.123:0/1177800064 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb04066730 0x7fbb04068bf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbb240b1540 tx=0x7fbb0c009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.663+0000 7fbb217fa700 1 -- 172.21.15.123:0/1177800064 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbb14050700 con 0x7fbb24160fb0 2024-09-13T17:09:11.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.839+0000 7fbb2b247700 1 -- 172.21.15.123:0/1177800064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb2406f9d0 con 0x7fbb24160fb0 2024-09-13T17:09:11.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.843+0000 7fbb217fa700 1 -- 172.21.15.123:0/1177800064 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+13036 (secure 0 0 0) 0x7fbb14053d20 con 0x7fbb24160fb0 2024-09-13T17:09:11.847 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:11.848 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":63,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:09:10.491849+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6837/2270367518":"2024-09-14T17:09:07.467108+0000","172.21.15.123:6836/2270367518":"2024-09-14T17:09:07.467108+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.843+0000 7fbb2b247700 1 -- 172.21.15.123:0/1177800064 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb04066730 msgr2=0x7fbb04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.843+0000 7fbb2b247700 1 --2- 172.21.15.123:0/1177800064 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb04066730 0x7fbb04068bf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbb240b1540 tx=0x7fbb0c009240 comp rx=0 tx=0).stop 2024-09-13T17:09:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.843+0000 7fbb2b247700 1 -- 172.21.15.123:0/1177800064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb24160fb0 msgr2=0x7fbb240a8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.843+0000 7fbb2b247700 1 --2- 172.21.15.123:0/1177800064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb24160fb0 0x7fbb240a8d70 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbb14001eb0 tx=0x7fbb1400c6e0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.843+0000 7fbb2b247700 1 -- 172.21.15.123:0/1177800064 shutdown_connections 2024-09-13T17:09:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.847+0000 7fbb2b247700 1 --2- 172.21.15.123:0/1177800064 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb04066730 0x7fbb04068bf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.847+0000 7fbb2b247700 1 --2- 172.21.15.123:0/1177800064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb24160fb0 0x7fbb240a8d70 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.847+0000 7fbb2b247700 1 --2- 172.21.15.123:0/1177800064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240cec90 0x7fbb240abf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.847+0000 7fbb2b247700 1 --2- 172.21.15.123:0/1177800064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb2406c050 0x7fbb2414cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.847+0000 7fbb2b247700 1 -- 172.21.15.123:0/1177800064 >> 172.21.15.123:0/1177800064 conn(0x7fbb24066570 msgr2=0x7fbb240ac930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:11.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.847+0000 7fbb2b247700 1 -- 172.21.15.123:0/1177800064 shutdown_connections 2024-09-13T17:09:11.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.847+0000 7fbb2b247700 1 -- 172.21.15.123:0/1177800064 wait complete. 2024-09-13T17:09:11.863 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:09:11.863 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:09:11.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f520f700 1 Processor -- start 2024-09-13T17:09:11.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f520f700 1 -- start start 2024-09-13T17:09:11.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f520f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff2f00cb070 0x7ff2f00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:11.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f520f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f00ce180 con 0x7ff2f015a2f0 2024-09-13T17:09:11.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f520f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f00cd990 con 0x7ff2f00b3990 2024-09-13T17:09:11.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f520f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f00cba20 con 0x7ff2f00cb070 2024-09-13T17:09:11.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2ef7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff2f00cb070 0x7ff2f00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:11.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f4a0e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff2f015a2f0 0x7ff2f015a760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32868/0 (socket says 172.21.15.123:32868) 2024-09-13T17:09:11.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f4a0e700 1 -- 172.21.15.123:0/3076132980 learned_addr learned my addr 172.21.15.123:0/3076132980 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2ef7fe700 1 -- 172.21.15.123:0/3076132980 >> v1:172.21.15.153:6789/0 conn(0x7ff2f00b3990 legacy=0x7ff2f00cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2ef7fe700 1 -- 172.21.15.123:0/3076132980 >> v1:172.21.15.123:6789/0 conn(0x7ff2f015a2f0 legacy=0x7ff2f015a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2ef7fe700 1 -- 172.21.15.123:0/3076132980 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f00cd0f0 con 0x7ff2f00cb070 2024-09-13T17:09:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2ef7fe700 1 --2- 172.21.15.123:0/3076132980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f00cb070 0x7ff2f00cb4e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009850 tx=0x7ff2e4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b62c9d01809499 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2eeffd700 1 -- 172.21.15.123:0/3076132980 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4011830 con 0x7ff2f00cb070 2024-09-13T17:09:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2eeffd700 1 -- 172.21.15.123:0/3076132980 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e4011990 con 0x7ff2f00cb070 2024-09-13T17:09:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2eeffd700 1 -- 172.21.15.123:0/3076132980 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4011d20 con 0x7ff2f00cb070 2024-09-13T17:09:11.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f520f700 1 -- 172.21.15.123:0/3076132980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f00cb070 msgr2=0x7ff2f00cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:11.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f520f700 1 --2- 172.21.15.123:0/3076132980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f00cb070 0x7ff2f00cb4e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009850 tx=0x7ff2e4009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:11.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f520f700 1 -- 172.21.15.123:0/3076132980 shutdown_connections 2024-09-13T17:09:11.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f520f700 1 --2- 172.21.15.123:0/3076132980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f00cb070 0x7ff2f00cb4e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f520f700 1 -- 172.21.15.123:0/3076132980 >> 172.21.15.123:0/3076132980 conn(0x7ff2f00b01d0 msgr2=0x7ff2f00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:11.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f520f700 1 -- 172.21.15.123:0/3076132980 shutdown_connections 2024-09-13T17:09:11.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.979+0000 7ff2f520f700 1 -- 172.21.15.123:0/3076132980 wait complete. 2024-09-13T17:09:11.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2f520f700 1 Processor -- start 2024-09-13T17:09:11.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2f520f700 1 -- start start 2024-09-13T17:09:11.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2f520f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2f00b3990 0x7ff2f01597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:11.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2f520f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f00cb070 0x7ff2f00c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:11.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2f520f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2f015a2f0 0x7ff2f015d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2f520f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f0159d30 con 0x7ff2f00cb070 2024-09-13T17:09:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2f520f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00c40a0 con 0x7ff2f015a2f0 2024-09-13T17:09:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2f520f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00c4380 con 0x7ff2f00b3990 2024-09-13T17:09:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2ef7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f00cb070 0x7ff2f00c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2ef7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f00cb070 0x7ff2f00c28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47184/0 (socket says 172.21.15.123:47184) 2024-09-13T17:09:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2ef7fe700 1 -- 172.21.15.123:0/383176476 learned_addr learned my addr 172.21.15.123:0/383176476 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2effff700 1 --2- 172.21.15.123:0/383176476 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2f00b3990 0x7ff2f01597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2f4a0e700 1 --2- 172.21.15.123:0/383176476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2f015a2f0 0x7ff2f015d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2ef7fe700 1 -- 172.21.15.123:0/383176476 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2f00b3990 msgr2=0x7ff2f01597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:11.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2ef7fe700 1 --2- 172.21.15.123:0/383176476 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2f00b3990 0x7ff2f01597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2ef7fe700 1 -- 172.21.15.123:0/383176476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2f015a2f0 msgr2=0x7ff2f015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2ef7fe700 1 --2- 172.21.15.123:0/383176476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2f015a2f0 0x7ff2f015d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2ef7fe700 1 -- 172.21.15.123:0/383176476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e40094b0 con 0x7ff2f00cb070 2024-09-13T17:09:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2ef7fe700 1 --2- 172.21.15.123:0/383176476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f00cb070 0x7ff2f00c28c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff2f006b4a0 tx=0x7ff2e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2ecff9700 1 -- 172.21.15.123:0/383176476 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40036c0 con 0x7ff2f00cb070 2024-09-13T17:09:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2ecff9700 1 -- 172.21.15.123:0/383176476 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e4003820 con 0x7ff2f00cb070 2024-09-13T17:09:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2f520f700 1 -- 172.21.15.123:0/383176476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f00c4660 con 0x7ff2f00cb070 2024-09-13T17:09:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2ecff9700 1 -- 172.21.15.123:0/383176476 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4003bd0 con 0x7ff2f00cb070 2024-09-13T17:09:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2f520f700 1 -- 172.21.15.123:0/383176476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f015abe0 con 0x7ff2f00cb070 2024-09-13T17:09:11.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.983+0000 7ff2d67fc700 1 -- 172.21.15.123:0/383176476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c8005310 con 0x7ff2f00cb070 2024-09-13T17:09:11.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.987+0000 7ff2ecff9700 1 -- 172.21.15.123:0/383176476 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2e4003d30 con 0x7ff2f00cb070 2024-09-13T17:09:11.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.987+0000 7ff2ecff9700 1 --2- 172.21.15.123:0/383176476 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff2dc066730 0x7ff2dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:11.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.987+0000 7ff2effff700 1 --2- 172.21.15.123:0/383176476 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff2dc066730 0x7ff2dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:11.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.987+0000 7ff2ecff9700 1 -- 172.21.15.123:0/383176476 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff2e4021030 con 0x7ff2f00cb070 2024-09-13T17:09:11.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.987+0000 7ff2effff700 1 --2- 172.21.15.123:0/383176476 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff2dc066730 0x7ff2dc068bf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0072710 tx=0x7ff2e0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:11.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:11.995+0000 7ff2ecff9700 1 -- 172.21.15.123:0/383176476 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff2e4052cd0 con 0x7ff2f00cb070 2024-09-13T17:09:12.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.163+0000 7ff2d67fc700 1 -- 172.21.15.123:0/383176476 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2c8005b40 con 0x7ff2f00cb070 2024-09-13T17:09:12.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.163+0000 7ff2ecff9700 1 -- 172.21.15.123:0/383176476 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2e40150a0 con 0x7ff2f00cb070 2024-09-13T17:09:12.169 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:09:12.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.167+0000 7ff2d67fc700 1 -- 172.21.15.123:0/383176476 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff2dc066730 msgr2=0x7ff2dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:12.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.167+0000 7ff2d67fc700 1 --2- 172.21.15.123:0/383176476 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff2dc066730 0x7ff2dc068bf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0072710 tx=0x7ff2e0009040 comp rx=0 tx=0).stop 2024-09-13T17:09:12.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.167+0000 7ff2d67fc700 1 -- 172.21.15.123:0/383176476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f00cb070 msgr2=0x7ff2f00c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:12.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.167+0000 7ff2d67fc700 1 --2- 172.21.15.123:0/383176476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f00cb070 0x7ff2f00c28c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff2f006b4a0 tx=0x7ff2e4004770 comp rx=0 tx=0).stop 2024-09-13T17:09:12.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.167+0000 7ff2d67fc700 1 -- 172.21.15.123:0/383176476 shutdown_connections 2024-09-13T17:09:12.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.167+0000 7ff2d67fc700 1 --2- 172.21.15.123:0/383176476 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff2dc066730 0x7ff2dc068bf0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.167+0000 7ff2d67fc700 1 --2- 172.21.15.123:0/383176476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2f015a2f0 0x7ff2f015d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.167+0000 7ff2d67fc700 1 --2- 172.21.15.123:0/383176476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f00cb070 0x7ff2f00c28c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.167+0000 7ff2d67fc700 1 --2- 172.21.15.123:0/383176476 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff2f00b3990 0x7ff2f01597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.167+0000 7ff2d67fc700 1 -- 172.21.15.123:0/383176476 >> 172.21.15.123:0/383176476 conn(0x7ff2f00b01d0 msgr2=0x7ff2f00b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:12.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.167+0000 7ff2d67fc700 1 -- 172.21.15.123:0/383176476 shutdown_connections 2024-09-13T17:09:12.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.167+0000 7ff2d67fc700 1 -- 172.21.15.123:0/383176476 wait complete. 2024-09-13T17:09:12.183 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_df' 2024-09-13T17:09:12.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.287+0000 7f57049d4700 1 Processor -- start 2024-09-13T17:09:12.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.287+0000 7f57049d4700 1 -- start start 2024-09-13T17:09:12.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.287+0000 7f57049d4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f570015ff90 0x7f57000cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:12.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.287+0000 7f57049d4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57000acc00 con 0x7f570006c760 2024-09-13T17:09:12.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.287+0000 7f57049d4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f570006cc30 con 0x7f57000cf1d0 2024-09-13T17:09:12.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.287+0000 7f57049d4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57000cf640 con 0x7f570015ff90 2024-09-13T17:09:12.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.287+0000 7f56fe59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f570015ff90 0x7f57000cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.287+0000 7f56fed9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f570006c760 0x7f57000b24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32876/0 (socket says 172.21.15.123:32876) 2024-09-13T17:09:12.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.287+0000 7f56fed9d700 1 -- 172.21.15.123:0/1313497225 learned_addr learned my addr 172.21.15.123:0/1313497225 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.287+0000 7f56fdd9b700 1 -- 172.21.15.123:0/1313497225 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397052598 0 0) 0x7f57000acc00 con 0x7f570006c760 2024-09-13T17:09:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f56fdd9b700 1 -- 172.21.15.123:0/1313497225 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56e00035d0 con 0x7f570006c760 2024-09-13T17:09:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f56fe59c700 1 -- 172.21.15.123:0/1313497225 >> v1:172.21.15.153:6789/0 conn(0x7f57000cf1d0 legacy=0x7f570006c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f56fe59c700 1 -- 172.21.15.123:0/1313497225 >> v1:172.21.15.123:6789/0 conn(0x7f570006c760 legacy=0x7f57000b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f56fe59c700 1 -- 172.21.15.123:0/1313497225 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570006cf10 con 0x7f570015ff90 2024-09-13T17:09:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f56fe59c700 1 --2- 172.21.15.123:0/1313497225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570015ff90 0x7f57000cec90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009880 tx=0x7f56f0009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c78d517effb3c92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f56fdd9b700 1 -- 172.21.15.123:0/1313497225 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0011830 con 0x7f570015ff90 2024-09-13T17:09:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f56fdd9b700 1 -- 172.21.15.123:0/1313497225 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f0011990 con 0x7f570015ff90 2024-09-13T17:09:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f56fdd9b700 1 -- 172.21.15.123:0/1313497225 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0011d20 con 0x7f570015ff90 2024-09-13T17:09:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f57049d4700 1 -- 172.21.15.123:0/1313497225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570015ff90 msgr2=0x7f57000cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f57049d4700 1 --2- 172.21.15.123:0/1313497225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570015ff90 0x7f57000cec90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009880 tx=0x7f56f0009b90 comp rx=0 tx=0).stop 2024-09-13T17:09:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f57049d4700 1 -- 172.21.15.123:0/1313497225 shutdown_connections 2024-09-13T17:09:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f57049d4700 1 --2- 172.21.15.123:0/1313497225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570015ff90 0x7f57000cec90 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f57049d4700 1 -- 172.21.15.123:0/1313497225 >> 172.21.15.123:0/1313497225 conn(0x7f5700066570 msgr2=0x7f5700066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f57049d4700 1 -- 172.21.15.123:0/1313497225 shutdown_connections 2024-09-13T17:09:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.291+0000 7f57049d4700 1 -- 172.21.15.123:0/1313497225 wait complete. 2024-09-13T17:09:12.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f57049d4700 1 Processor -- start 2024-09-13T17:09:12.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f57049d4700 1 -- start start 2024-09-13T17:09:12.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f57049d4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f570006c760 0x7f57000c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:12.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f57049d4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57000cf1d0 0x7f57000cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:12.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f57049d4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570015ff90 0x7f5700148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:12.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f57049d4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57000cd620 con 0x7f570015ff90 2024-09-13T17:09:12.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f57049d4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57000c49f0 con 0x7f570006c760 2024-09-13T17:09:12.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f57049d4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57000c4cd0 con 0x7f57000cf1d0 2024-09-13T17:09:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f56fed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570015ff90 0x7f5700148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f56fed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570015ff90 0x7f5700148150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47200/0 (socket says 172.21.15.123:47200) 2024-09-13T17:09:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f56fed9d700 1 -- 172.21.15.123:0/1308182189 learned_addr learned my addr 172.21.15.123:0/1308182189 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f56fe59c700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f570006c760 0x7f57000c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f56f7fff700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57000cf1d0 0x7f57000cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f56fed9d700 1 -- 172.21.15.123:0/1308182189 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57000cf1d0 msgr2=0x7f57000cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f56fed9d700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57000cf1d0 0x7f57000cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f56fed9d700 1 -- 172.21.15.123:0/1308182189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f570006c760 msgr2=0x7f57000c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f56fed9d700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f570006c760 0x7f57000c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f56fed9d700 1 -- 172.21.15.123:0/1308182189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f00094b0 con 0x7f570015ff90 2024-09-13T17:09:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f56fe59c700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f570006c760 0x7f57000c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f56fed9d700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570015ff90 0x7f5700148150 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f56f800cb40 tx=0x7f56f800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:12.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.295+0000 7f56f6ffd700 1 -- 172.21.15.123:0/1308182189 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8007500 con 0x7f570015ff90 2024-09-13T17:09:12.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.299+0000 7f56f6ffd700 1 -- 172.21.15.123:0/1308182189 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f8007660 con 0x7f570015ff90 2024-09-13T17:09:12.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.299+0000 7f57049d4700 1 -- 172.21.15.123:0/1308182189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57000c4fb0 con 0x7f570015ff90 2024-09-13T17:09:12.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.299+0000 7f56f6ffd700 1 -- 172.21.15.123:0/1308182189 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80079f0 con 0x7f570015ff90 2024-09-13T17:09:12.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.299+0000 7f57049d4700 1 -- 172.21.15.123:0/1308182189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57000c5570 con 0x7f570015ff90 2024-09-13T17:09:12.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.299+0000 7f57049d4700 1 -- 172.21.15.123:0/1308182189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57000acd90 con 0x7f570015ff90 2024-09-13T17:09:12.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.299+0000 7f56f6ffd700 1 -- 172.21.15.123:0/1308182189 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56f801b3b0 con 0x7f570015ff90 2024-09-13T17:09:12.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.299+0000 7f56f6ffd700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f56e4066760 0x7f56e4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:12.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.299+0000 7f56f6ffd700 1 -- 172.21.15.123:0/1308182189 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f56f80837d0 con 0x7f570015ff90 2024-09-13T17:09:12.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.299+0000 7f56fe59c700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f56e4066760 0x7f56e4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:12.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.299+0000 7f56fe59c700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f56e4066760 0x7f56e4068c20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f56f00090b0 tx=0x7f56f0008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:12.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.307+0000 7f56f6ffd700 1 -- 172.21.15.123:0/1308182189 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56f8050ed0 con 0x7f570015ff90 2024-09-13T17:09:12.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:12.543+0000 7f57049d4700 1 -- 172.21.15.123:0/1308182189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]} v 0) v1 -- 0x7f57000c5760 con 0x7f570015ff90 2024-09-13T17:09:13.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.515+0000 7f56f6ffd700 1 -- 172.21.15.123:0/1308182189 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]}]=0 v158) v1 ==== 137+0+0 (secure 0 0 0) 0x7f56f8017020 con 0x7f570015ff90 2024-09-13T17:09:13.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.523+0000 7f57049d4700 1 -- 172.21.15.123:0/1308182189 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f56e4066760 msgr2=0x7f56e4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:13.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.523+0000 7f57049d4700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f56e4066760 0x7f56e4068c20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f56f00090b0 tx=0x7f56f0008030 comp rx=0 tx=0).stop 2024-09-13T17:09:13.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.523+0000 7f57049d4700 1 -- 172.21.15.123:0/1308182189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570015ff90 msgr2=0x7f5700148150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:13.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.523+0000 7f57049d4700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570015ff90 0x7f5700148150 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f56f800cb40 tx=0x7f56f800cb70 comp rx=0 tx=0).stop 2024-09-13T17:09:13.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.523+0000 7f57049d4700 1 -- 172.21.15.123:0/1308182189 shutdown_connections 2024-09-13T17:09:13.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.523+0000 7f57049d4700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f56e4066760 0x7f56e4068c20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.523+0000 7f57049d4700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f570015ff90 0x7f5700148150 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.523+0000 7f57049d4700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f57000cf1d0 0x7f57000cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.523+0000 7f57049d4700 1 --2- 172.21.15.123:0/1308182189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f570006c760 0x7f57000c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.523+0000 7f57049d4700 1 -- 172.21.15.123:0/1308182189 >> 172.21.15.123:0/1308182189 conn(0x7f5700066570 msgr2=0x7f57000b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:13.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.523+0000 7f57049d4700 1 -- 172.21.15.123:0/1308182189 shutdown_connections 2024-09-13T17:09:13.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.523+0000 7f57049d4700 1 -- 172.21.15.123:0/1308182189 wait complete. 2024-09-13T17:09:13.543 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T17:09:13.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b664b8700 1 Processor -- start 2024-09-13T17:09:13.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b664b8700 1 -- start start 2024-09-13T17:09:13.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b664b8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9b600aed70 0x7f9b600cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:13.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b664b8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b600af4f0 0x7f9b600cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:13.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b664b8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b600cdf70 0x7f9b600cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:13.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b664b8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b600c93e0 con 0x7f9b600cdf70 2024-09-13T17:09:13.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b664b8700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b600ce400 con 0x7f9b600aed70 2024-09-13T17:09:13.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b664b8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b60161760 con 0x7f9b600af4f0 2024-09-13T17:09:13.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b64a55700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b600cdf70 0x7f9b600cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:13.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b64a55700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b600cdf70 0x7f9b600cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47208/0 (socket says 172.21.15.123:47208) 2024-09-13T17:09:13.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b5ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9b600aed70 0x7f9b600cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:13.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b64a55700 1 -- 172.21.15.123:0/1761343476 learned_addr learned my addr 172.21.15.123:0/1761343476 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:13.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b5f7fe700 1 --2- 172.21.15.123:0/1761343476 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b600af4f0 0x7f9b600cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:13.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b64a55700 1 -- 172.21.15.123:0/1761343476 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b600af4f0 msgr2=0x7f9b600cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:13.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b64a55700 1 --2- 172.21.15.123:0/1761343476 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b600af4f0 0x7f9b600cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b64a55700 1 -- 172.21.15.123:0/1761343476 >> v2:172.21.15.153:3300/0 conn(0x7f9b600aed70 msgr2=0x7f9b600cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:13.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b64a55700 1 --2- 172.21.15.123:0/1761343476 >> v2:172.21.15.153:3300/0 conn(0x7f9b600aed70 0x7f9b600cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b64a55700 1 -- 172.21.15.123:0/1761343476 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b600cb890 con 0x7f9b600cdf70 2024-09-13T17:09:13.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b5ffff700 1 --2- 172.21.15.123:0/1761343476 >> v2:172.21.15.153:3300/0 conn(0x7f9b600aed70 0x7f9b600cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:13.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.663+0000 7f9b64a55700 1 --2- 172.21.15.123:0/1761343476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b600cdf70 0x7f9b600cc430 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9b60070530 tx=0x7f9b5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5e9938a5c5108 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:13.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b5effd700 1 -- 172.21.15.123:0/1761343476 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5800e070 con 0x7f9b600cdf70 2024-09-13T17:09:13.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b5effd700 1 -- 172.21.15.123:0/1761343476 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5800b910 con 0x7f9b600cdf70 2024-09-13T17:09:13.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b5effd700 1 -- 172.21.15.123:0/1761343476 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5800bcc0 con 0x7f9b600cdf70 2024-09-13T17:09:13.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 -- 172.21.15.123:0/1761343476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b600cdf70 msgr2=0x7f9b600cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:13.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 --2- 172.21.15.123:0/1761343476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b600cdf70 0x7f9b600cc430 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9b60070530 tx=0x7f9b5800b330 comp rx=0 tx=0).stop 2024-09-13T17:09:13.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 -- 172.21.15.123:0/1761343476 shutdown_connections 2024-09-13T17:09:13.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 --2- 172.21.15.123:0/1761343476 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b600af4f0 0x7f9b600cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 --2- 172.21.15.123:0/1761343476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b600cdf70 0x7f9b600cc430 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 --2- 172.21.15.123:0/1761343476 >> v2:172.21.15.153:3300/0 conn(0x7f9b600aed70 0x7f9b600cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 -- 172.21.15.123:0/1761343476 >> 172.21.15.123:0/1761343476 conn(0x7f9b600b0450 msgr2=0x7f9b600b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:13.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 -- 172.21.15.123:0/1761343476 shutdown_connections 2024-09-13T17:09:13.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 -- 172.21.15.123:0/1761343476 wait complete. 2024-09-13T17:09:13.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 Processor -- start 2024-09-13T17:09:13.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 -- start start 2024-09-13T17:09:13.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b600aed70 0x7f9b60160500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b600af4f0 0x7f9b60156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b600cdf70 0x7f9b60163100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b601fa500 con 0x7f9b600aed70 2024-09-13T17:09:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b601fada0 con 0x7f9b600af4f0 2024-09-13T17:09:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b664b8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b600c2330 con 0x7f9b600cdf70 2024-09-13T17:09:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b5ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b600aed70 0x7f9b60160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b5ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b600aed70 0x7f9b60160500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47222/0 (socket says 172.21.15.123:47222) 2024-09-13T17:09:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b5ffff700 1 -- 172.21.15.123:0/2984707034 learned_addr learned my addr 172.21.15.123:0/2984707034 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b5f7fe700 1 --2- 172.21.15.123:0/2984707034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b600af4f0 0x7f9b60156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.667+0000 7f9b64a55700 1 --2- 172.21.15.123:0/2984707034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b600cdf70 0x7f9b60163100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b5ffff700 1 -- 172.21.15.123:0/2984707034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b600cdf70 msgr2=0x7f9b60163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b5ffff700 1 --2- 172.21.15.123:0/2984707034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b600cdf70 0x7f9b60163100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b5ffff700 1 -- 172.21.15.123:0/2984707034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b600af4f0 msgr2=0x7f9b60156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:13.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b5ffff700 1 --2- 172.21.15.123:0/2984707034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b600af4f0 0x7f9b60156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b5ffff700 1 -- 172.21.15.123:0/2984707034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b500094b0 con 0x7f9b600aed70 2024-09-13T17:09:13.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b5ffff700 1 --2- 172.21.15.123:0/2984707034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b600aed70 0x7f9b60160500 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000ec10 tx=0x7f9b5000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:13.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b5cff9700 1 -- 172.21.15.123:0/2984707034 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b50009790 con 0x7f9b600aed70 2024-09-13T17:09:13.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b5cff9700 1 -- 172.21.15.123:0/2984707034 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5000c850 con 0x7f9b600aed70 2024-09-13T17:09:13.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b664b8700 1 -- 172.21.15.123:0/2984707034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b58009b30 con 0x7f9b600aed70 2024-09-13T17:09:13.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b5cff9700 1 -- 172.21.15.123:0/2984707034 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5000cbe0 con 0x7f9b600aed70 2024-09-13T17:09:13.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b664b8700 1 -- 172.21.15.123:0/2984707034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b601fa750 con 0x7f9b600aed70 2024-09-13T17:09:13.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b664b8700 1 -- 172.21.15.123:0/2984707034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b60067590 con 0x7f9b600aed70 2024-09-13T17:09:13.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b5cff9700 1 -- 172.21.15.123:0/2984707034 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9b5000cd40 con 0x7f9b600aed70 2024-09-13T17:09:13.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b5cff9700 1 --2- 172.21.15.123:0/2984707034 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9b4c066730 0x7f9b4c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:13.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b5cff9700 1 -- 172.21.15.123:0/2984707034 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9b50084540 con 0x7f9b600aed70 2024-09-13T17:09:13.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.671+0000 7f9b5f7fe700 1 --2- 172.21.15.123:0/2984707034 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9b4c066730 0x7f9b4c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:13.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.675+0000 7f9b5f7fe700 1 --2- 172.21.15.123:0/2984707034 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9b4c066730 0x7f9b4c068bf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9b600b0910 tx=0x7f9b54009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:13.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.679+0000 7f9b5cff9700 1 -- 172.21.15.123:0/2984707034 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9b50051c90 con 0x7f9b600aed70 2024-09-13T17:09:13.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.851+0000 7f9b664b8700 1 -- 172.21.15.123:0/2984707034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9b600af150 con 0x7f9b600aed70 2024-09-13T17:09:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.859+0000 7f9b5cff9700 1 -- 172.21.15.123:0/2984707034 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9b500552b0 con 0x7f9b600aed70 2024-09-13T17:09:13.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.859+0000 7f9b664b8700 1 -- 172.21.15.123:0/2984707034 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9b4c066730 msgr2=0x7f9b4c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:13.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.859+0000 7f9b664b8700 1 --2- 172.21.15.123:0/2984707034 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9b4c066730 0x7f9b4c068bf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9b600b0910 tx=0x7f9b54009240 comp rx=0 tx=0).stop 2024-09-13T17:09:13.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.859+0000 7f9b664b8700 1 -- 172.21.15.123:0/2984707034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b600aed70 msgr2=0x7f9b60160500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:13.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.859+0000 7f9b664b8700 1 --2- 172.21.15.123:0/2984707034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b600aed70 0x7f9b60160500 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000ec10 tx=0x7f9b5000ef20 comp rx=0 tx=0).stop 2024-09-13T17:09:13.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.859+0000 7f9b664b8700 1 -- 172.21.15.123:0/2984707034 shutdown_connections 2024-09-13T17:09:13.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.859+0000 7f9b664b8700 1 --2- 172.21.15.123:0/2984707034 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9b4c066730 0x7f9b4c068bf0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.859+0000 7f9b664b8700 1 --2- 172.21.15.123:0/2984707034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9b600cdf70 0x7f9b60163100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.859+0000 7f9b664b8700 1 --2- 172.21.15.123:0/2984707034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b600af4f0 0x7f9b60156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.859+0000 7f9b664b8700 1 --2- 172.21.15.123:0/2984707034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b600aed70 0x7f9b60160500 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:13.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.859+0000 7f9b664b8700 1 -- 172.21.15.123:0/2984707034 >> 172.21.15.123:0/2984707034 conn(0x7f9b600b0450 msgr2=0x7f9b600c8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:13.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.859+0000 7f9b664b8700 1 -- 172.21.15.123:0/2984707034 shutdown_connections 2024-09-13T17:09:13.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:13.859+0000 7f9b664b8700 1 -- 172.21.15.123:0/2984707034 wait complete. 2024-09-13T17:09:13.877 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:09:13.878 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:09:13.895 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:09:13.916 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:09:13.916 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:09:13.916 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:13.944 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:09:13.944 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:09:13.944 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:13.951 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:09:13.951 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:09:13.951 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:13.959 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:09:13.959 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:09:13.959 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:13.998 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:09:13.999 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T17:09:13.999 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:09:14.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f5696cde700 1 Processor -- start 2024-09-13T17:09:14.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f5696cde700 1 -- start start 2024-09-13T17:09:14.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f5696cde700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56900b2fb0 0x7f56900d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:14.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f5696cde700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f56900d08e0 0x7f56900d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:14.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f5696cde700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5690072480 con 0x7f56900afe00 2024-09-13T17:09:14.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f5696cde700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56900d12b0 con 0x7f56900d08e0 2024-09-13T17:09:14.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f5696cde700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56901619d0 con 0x7f56900b2fb0 2024-09-13T17:09:14.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f56964dd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f56900d08e0 0x7f56900d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:14.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f56954db700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56900b2fb0 0x7f56900d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:14.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f5695cdc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f56900afe00 0x7f56900ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:46726/0 (socket says 172.21.15.123:46726) 2024-09-13T17:09:14.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f5695cdc700 1 -- 172.21.15.123:0/226829825 learned_addr learned my addr 172.21.15.123:0/226829825 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:14.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f56964dd700 1 -- 172.21.15.123:0/226829825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56900b2fb0 msgr2=0x7f56900d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:14.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f56964dd700 1 --2- 172.21.15.123:0/226829825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56900b2fb0 0x7f56900d02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f56964dd700 1 -- 172.21.15.123:0/226829825 >> v1:172.21.15.153:6789/0 conn(0x7f56900afe00 legacy=0x7f56900ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:14.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f56964dd700 1 -- 172.21.15.123:0/226829825 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5690165c00 con 0x7f56900d08e0 2024-09-13T17:09:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f56964dd700 1 --2- 172.21.15.123:0/226829825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56900d08e0 0x7f56900d0d70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5688009dc0 tx=0x7f568800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5a31c9e18ce7ae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f5694cda700 1 -- 172.21.15.123:0/226829825 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800e070 con 0x7f56900d08e0 2024-09-13T17:09:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f5694cda700 1 -- 172.21.15.123:0/226829825 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568800bae0 con 0x7f56900d08e0 2024-09-13T17:09:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.119+0000 7f5694cda700 1 -- 172.21.15.123:0/226829825 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800be90 con 0x7f56900d08e0 2024-09-13T17:09:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 -- 172.21.15.123:0/226829825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56900d08e0 msgr2=0x7f56900d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 --2- 172.21.15.123:0/226829825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56900d08e0 0x7f56900d0d70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5688009dc0 tx=0x7f568800b330 comp rx=0 tx=0).stop 2024-09-13T17:09:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 -- 172.21.15.123:0/226829825 shutdown_connections 2024-09-13T17:09:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 --2- 172.21.15.123:0/226829825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56900d08e0 0x7f56900d0d70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 --2- 172.21.15.123:0/226829825 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56900b2fb0 0x7f56900d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 -- 172.21.15.123:0/226829825 >> 172.21.15.123:0/226829825 conn(0x7f56900b24c0 msgr2=0x7f56900b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 -- 172.21.15.123:0/226829825 shutdown_connections 2024-09-13T17:09:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 -- 172.21.15.123:0/226829825 wait complete. 2024-09-13T17:09:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 Processor -- start 2024-09-13T17:09:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 -- start start 2024-09-13T17:09:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56900afe00 0x7f56901f8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56900b2fb0 0x7f56901f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56900d08e0 0x7f56901f9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56900b66a0 con 0x7f56900d08e0 2024-09-13T17:09:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56901f8190 con 0x7f56900afe00 2024-09-13T17:09:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5696cde700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56901f8470 con 0x7f56900b2fb0 2024-09-13T17:09:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f56964dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56900d08e0 0x7f56901f9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f56964dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56900d08e0 0x7f56901f9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47228/0 (socket says 172.21.15.123:47228) 2024-09-13T17:09:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f56964dd700 1 -- 172.21.15.123:0/3202665554 learned_addr learned my addr 172.21.15.123:0/3202665554 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f56954db700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56900b2fb0 0x7f56901f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5695cdc700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56900afe00 0x7f56901f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f56964dd700 1 -- 172.21.15.123:0/3202665554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56900b2fb0 msgr2=0x7f56901f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f56964dd700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56900b2fb0 0x7f56901f76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f56964dd700 1 -- 172.21.15.123:0/3202665554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56900afe00 msgr2=0x7f56901f8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f56964dd700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56900afe00 0x7f56901f8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f56964dd700 1 -- 172.21.15.123:0/3202665554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5688009a70 con 0x7f56900d08e0 2024-09-13T17:09:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f56954db700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56900b2fb0 0x7f56901f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.123+0000 7f5695cdc700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56900afe00 0x7f56901f8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.127+0000 7f56964dd700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56900d08e0 0x7f56901f9da0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f568800b370 tx=0x7f5688004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.127+0000 7f56867fc700 1 -- 172.21.15.123:0/3202665554 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880045d0 con 0x7f56900d08e0 2024-09-13T17:09:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.127+0000 7f56867fc700 1 -- 172.21.15.123:0/3202665554 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5688020070 con 0x7f56900d08e0 2024-09-13T17:09:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.127+0000 7f5696cde700 1 -- 172.21.15.123:0/3202665554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56900b6330 con 0x7f56900d08e0 2024-09-13T17:09:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.127+0000 7f56867fc700 1 -- 172.21.15.123:0/3202665554 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688004990 con 0x7f56900d08e0 2024-09-13T17:09:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.127+0000 7f5696cde700 1 -- 172.21.15.123:0/3202665554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569015d0e0 con 0x7f56900d08e0 2024-09-13T17:09:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.127+0000 7f5696cde700 1 -- 172.21.15.123:0/3202665554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569015d3c0 con 0x7f56900d08e0 2024-09-13T17:09:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.127+0000 7f56867fc700 1 -- 172.21.15.123:0/3202665554 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5688012430 con 0x7f56900d08e0 2024-09-13T17:09:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.131+0000 7f56867fc700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5674066730 0x7f5674068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.131+0000 7f56867fc700 1 -- 172.21.15.123:0/3202665554 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5688022070 con 0x7f56900d08e0 2024-09-13T17:09:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.131+0000 7f5695cdc700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5674066730 0x7f5674068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:14.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.131+0000 7f5695cdc700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5674066730 0x7f5674068bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f568c005930 tx=0x7f568c009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:14.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.135+0000 7f56867fc700 1 -- 172.21.15.123:0/3202665554 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5688056c00 con 0x7f56900d08e0 2024-09-13T17:09:14.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.343+0000 7f5696cde700 1 -- 172.21.15.123:0/3202665554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5690162770 con 0x7f56900d08e0 2024-09-13T17:09:14.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.343+0000 7f56867fc700 1 -- 172.21.15.123:0/3202665554 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f5690162770 con 0x7f56900d08e0 2024-09-13T17:09:14.349 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:14.349 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2493352744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2493352744},{"type":"v1","addr":"172.21.15.153:6833","nonce":2493352744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3030199256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3030199256},{"type":"v1","addr":"172.21.15.153:6835","nonce":3030199256}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":6120,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2341008668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2341008668},{"type":"v1","addr":"172.21.15.123:6835","nonce":2341008668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":6447,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2936706261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2936706261},{"type":"v1","addr":"172.21.15.123:6837","nonce":2936706261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[]} 2024-09-13T17:09:14.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.347+0000 7f5696cde700 1 -- 172.21.15.123:0/3202665554 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5674066730 msgr2=0x7f5674068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:14.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.347+0000 7f5696cde700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5674066730 0x7f5674068bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f568c005930 tx=0x7f568c009040 comp rx=0 tx=0).stop 2024-09-13T17:09:14.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.347+0000 7f5696cde700 1 -- 172.21.15.123:0/3202665554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56900d08e0 msgr2=0x7f56901f9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:14.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.347+0000 7f5696cde700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56900d08e0 0x7f56901f9da0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f568800b370 tx=0x7f5688004af0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.347+0000 7f5696cde700 1 -- 172.21.15.123:0/3202665554 shutdown_connections 2024-09-13T17:09:14.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.347+0000 7f5696cde700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5674066730 0x7f5674068bf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.347+0000 7f5696cde700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56900d08e0 0x7f56901f9da0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.347+0000 7f5696cde700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56900b2fb0 0x7f56901f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.347+0000 7f5696cde700 1 --2- 172.21.15.123:0/3202665554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56900afe00 0x7f56901f8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.347+0000 7f5696cde700 1 -- 172.21.15.123:0/3202665554 >> 172.21.15.123:0/3202665554 conn(0x7f56900b24c0 msgr2=0x7f56900c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:14.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.347+0000 7f5696cde700 1 -- 172.21.15.123:0/3202665554 shutdown_connections 2024-09-13T17:09:14.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.347+0000 7f5696cde700 1 -- 172.21.15.123:0/3202665554 wait complete. 2024-09-13T17:09:14.353 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 30 2024-09-13T17:09:14.364 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:09:14.365 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:09:14.365 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:09:14.365 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:09:14.365 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:09:14.365 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:09:14.365 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:09:14.366 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:09:14.366 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:09:14.366 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:09:14.366 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:09:14.366 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:09:14.366 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:09:14.366 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:09:14.367 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:09:14.367 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:09:14.376 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:09:14.377 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:09:14.378 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:09:14.378 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:09:14.383 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:09:14.383 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:09:14.384 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:09:14.385 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:09:14.423 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:09:14.423 DEBUG:teuthology.parallel:result is None 2024-09-13T17:09:14.424 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:09:14.424 DEBUG:teuthology.parallel:result is None 2024-09-13T17:09:14.429 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:09:14.429 DEBUG:teuthology.parallel:result is None 2024-09-13T17:09:14.430 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:09:14.431 DEBUG:teuthology.parallel:result is None 2024-09-13T17:09:14.431 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T17:09:14.495 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-13T17:09:14.507 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-13T17:09:14.518 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-09-13T17:09:14.520 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-09-13T17:09:14.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.531+0000 7f20b1239700 1 Processor -- start 2024-09-13T17:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.531+0000 7f20b1239700 1 -- start start 2024-09-13T17:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20b1239700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f20ac0d0f40 0x7f20ac0d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20b1239700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0cd5e0 0x7f20ac0cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20b1239700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ac0d0cb0 con 0x7f20ac0b58b0 2024-09-13T17:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20b1239700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ac0b0060 con 0x7f20ac0d0f40 2024-09-13T17:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20b1239700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac0b0340 con 0x7f20ac0cd5e0 2024-09-13T17:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20abfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f20ac0d0f40 0x7f20ac0d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20abfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f20ac0d0f40 0x7f20ac0d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47260/0 (socket says 172.21.15.123:47260) 2024-09-13T17:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20abfff700 1 -- 172.21.15.123:0/2393288120 learned_addr learned my addr 172.21.15.123:0/2393288120 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20ab7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f20ac0b58b0 0x7f20ac0d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:46756/0 (socket says 172.21.15.123:46756) 2024-09-13T17:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20b0a38700 1 --2- 172.21.15.123:0/2393288120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0cd5e0 0x7f20ac0cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:14.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20abfff700 1 -- 172.21.15.123:0/2393288120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0cd5e0 msgr2=0x7f20ac0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:14.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20abfff700 1 --2- 172.21.15.123:0/2393288120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0cd5e0 0x7f20ac0cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20abfff700 1 -- 172.21.15.123:0/2393288120 >> v1:172.21.15.153:6789/0 conn(0x7f20ac0b58b0 legacy=0x7f20ac0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:14.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20abfff700 1 -- 172.21.15.123:0/2393288120 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac0b0620 con 0x7f20ac0d0f40 2024-09-13T17:09:14.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20abfff700 1 --2- 172.21.15.123:0/2393288120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ac0d0f40 0x7f20ac0d1320 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f209c009910 tx=0x7f209c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7472f6c97d863270 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:14.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20aaffd700 1 -- 172.21.15.123:0/2393288120 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c011830 con 0x7f20ac0d0f40 2024-09-13T17:09:14.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20aaffd700 1 -- 172.21.15.123:0/2393288120 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209c011990 con 0x7f20ac0d0f40 2024-09-13T17:09:14.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20aaffd700 1 -- 172.21.15.123:0/2393288120 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c011d40 con 0x7f20ac0d0f40 2024-09-13T17:09:14.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20b1239700 1 -- 172.21.15.123:0/2393288120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ac0d0f40 msgr2=0x7f20ac0d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:14.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20b1239700 1 --2- 172.21.15.123:0/2393288120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ac0d0f40 0x7f20ac0d1320 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f209c009910 tx=0x7f209c009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:14.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20b1239700 1 -- 172.21.15.123:0/2393288120 shutdown_connections 2024-09-13T17:09:14.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20b1239700 1 --2- 172.21.15.123:0/2393288120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0cd5e0 0x7f20ac0cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20b1239700 1 --2- 172.21.15.123:0/2393288120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ac0d0f40 0x7f20ac0d1320 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.535+0000 7f20b1239700 1 -- 172.21.15.123:0/2393288120 >> 172.21.15.123:0/2393288120 conn(0x7f20ac0d2a60 msgr2=0x7f20ac0d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:14.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b1239700 1 -- 172.21.15.123:0/2393288120 shutdown_connections 2024-09-13T17:09:14.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b1239700 1 -- 172.21.15.123:0/2393288120 wait complete. 2024-09-13T17:09:14.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b1239700 1 Processor -- start 2024-09-13T17:09:14.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b1239700 1 -- start start 2024-09-13T17:09:14.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b1239700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0b58b0 0x7f20ac0b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:14.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b1239700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac0cd5e0 0x7f20ac1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:14.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b1239700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ac0d0f40 0x7f20ac0b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:14.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b1239700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac0b3310 con 0x7f20ac0d0f40 2024-09-13T17:09:14.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b1239700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac159e10 con 0x7f20ac0cd5e0 2024-09-13T17:09:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b1239700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac0b3ac0 con 0x7f20ac0b58b0 2024-09-13T17:09:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b0a38700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ac0d0f40 0x7f20ac0b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20abfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0b58b0 0x7f20ac0b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b0a38700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ac0d0f40 0x7f20ac0b4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47276/0 (socket says 172.21.15.123:47276) 2024-09-13T17:09:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b0a38700 1 -- 172.21.15.123:0/3664652516 learned_addr learned my addr 172.21.15.123:0/3664652516 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20ab7fe700 1 --2- 172.21.15.123:0/3664652516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac0cd5e0 0x7f20ac1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20abfff700 1 -- 172.21.15.123:0/3664652516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac0cd5e0 msgr2=0x7f20ac1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20abfff700 1 --2- 172.21.15.123:0/3664652516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac0cd5e0 0x7f20ac1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20abfff700 1 -- 172.21.15.123:0/3664652516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ac0d0f40 msgr2=0x7f20ac0b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20abfff700 1 --2- 172.21.15.123:0/3664652516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ac0d0f40 0x7f20ac0b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20abfff700 1 -- 172.21.15.123:0/3664652516 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c009570 con 0x7f20ac0b58b0 2024-09-13T17:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b0a38700 1 --2- 172.21.15.123:0/3664652516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ac0d0f40 0x7f20ac0b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20abfff700 1 --2- 172.21.15.123:0/3664652516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0b58b0 0x7f20ac0b2dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f209c016000 tx=0x7f209c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20a8ff9700 1 -- 172.21.15.123:0/3664652516 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c004510 con 0x7f20ac0b58b0 2024-09-13T17:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20a8ff9700 1 -- 172.21.15.123:0/3664652516 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209c0036c0 con 0x7f20ac0b58b0 2024-09-13T17:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b1239700 1 -- 172.21.15.123:0/3664652516 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ac0b3da0 con 0x7f20ac0b58b0 2024-09-13T17:09:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20a8ff9700 1 -- 172.21.15.123:0/3664652516 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c003a70 con 0x7f20ac0b58b0 2024-09-13T17:09:14.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.539+0000 7f20b1239700 1 -- 172.21.15.123:0/3664652516 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ac0b4360 con 0x7f20ac0b58b0 2024-09-13T17:09:14.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.543+0000 7f20b1239700 1 -- 172.21.15.123:0/3664652516 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ac15ce70 con 0x7f20ac0b58b0 2024-09-13T17:09:14.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.543+0000 7f20a8ff9700 1 -- 172.21.15.123:0/3664652516 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f209c003bd0 con 0x7f20ac0b58b0 2024-09-13T17:09:14.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.543+0000 7f20a8ff9700 1 --2- 172.21.15.123:0/3664652516 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2098066730 0x7f2098068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:14.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.543+0000 7f20a8ff9700 1 -- 172.21.15.123:0/3664652516 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f209c021030 con 0x7f20ac0b58b0 2024-09-13T17:09:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.543+0000 7f20ab7fe700 1 --2- 172.21.15.123:0/3664652516 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2098066730 0x7f2098068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.543+0000 7f20ab7fe700 1 --2- 172.21.15.123:0/3664652516 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2098066730 0x7f2098068bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f20a0000f60 tx=0x7f20a0007ef0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:14.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.551+0000 7f20a8ff9700 1 -- 172.21.15.123:0/3664652516 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f209c052aa0 con 0x7f20ac0b58b0 2024-09-13T17:09:14.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:14.731+0000 7f20b1239700 1 -- 172.21.15.123:0/3664652516 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f20ac074770 con 0x7f20ac0b58b0 2024-09-13T17:09:15.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.543+0000 7f20a8ff9700 1 -- 172.21.15.123:0/3664652516 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v68) v1 ==== 97+0+0 (secure 0 0 0) 0x7f209c015080 con 0x7f20ac0b58b0 2024-09-13T17:09:15.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.547+0000 7f20b1239700 1 -- 172.21.15.123:0/3664652516 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2098066730 msgr2=0x7f2098068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:15.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.547+0000 7f20b1239700 1 --2- 172.21.15.123:0/3664652516 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2098066730 0x7f2098068bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f20a0000f60 tx=0x7f20a0007ef0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.551+0000 7f20b1239700 1 -- 172.21.15.123:0/3664652516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0b58b0 msgr2=0x7f20ac0b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:15.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.551+0000 7f20b1239700 1 --2- 172.21.15.123:0/3664652516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0b58b0 0x7f20ac0b2dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f209c016000 tx=0x7f209c004770 comp rx=0 tx=0).stop 2024-09-13T17:09:15.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.551+0000 7f20b1239700 1 -- 172.21.15.123:0/3664652516 shutdown_connections 2024-09-13T17:09:15.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.551+0000 7f20b1239700 1 --2- 172.21.15.123:0/3664652516 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2098066730 0x7f2098068bf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.551+0000 7f20b1239700 1 --2- 172.21.15.123:0/3664652516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20ac0d0f40 0x7f20ac0b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.551+0000 7f20b1239700 1 --2- 172.21.15.123:0/3664652516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac0cd5e0 0x7f20ac1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.551+0000 7f20b1239700 1 --2- 172.21.15.123:0/3664652516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20ac0b58b0 0x7f20ac0b2dd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.551+0000 7f20b1239700 1 -- 172.21.15.123:0/3664652516 >> 172.21.15.123:0/3664652516 conn(0x7f20ac0d2a60 msgr2=0x7f20ac071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:15.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.551+0000 7f20b1239700 1 -- 172.21.15.123:0/3664652516 shutdown_connections 2024-09-13T17:09:15.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.551+0000 7f20b1239700 1 -- 172.21.15.123:0/3664652516 wait complete. 2024-09-13T17:09:15.557 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-13T17:09:15.569 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T17:09:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2913e700 1 Processor -- start 2024-09-13T17:09:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2913e700 1 -- start start 2024-09-13T17:09:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2913e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a241598b0 0x7f9a24071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2913e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a240cedc0 0x7f9a24159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2913e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2415d360 con 0x7f9a240cdfd0 2024-09-13T17:09:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2913e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a240ce3d0 con 0x7f9a240cedc0 2024-09-13T17:09:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2913e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240724c0 con 0x7f9a241598b0 2024-09-13T17:09:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2893d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a240cedc0 0x7f9a24159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2893d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a240cedc0 0x7f9a24159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47280/0 (socket says 172.21.15.123:47280) 2024-09-13T17:09:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2893d700 1 -- 172.21.15.123:0/3425192674 learned_addr learned my addr 172.21.15.123:0/3425192674 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a23fff700 1 --2- 172.21.15.123:0/3425192674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a241598b0 0x7f9a24071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2893d700 1 -- 172.21.15.123:0/3425192674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a241598b0 msgr2=0x7f9a24071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2893d700 1 --2- 172.21.15.123:0/3425192674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a241598b0 0x7f9a24071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2893d700 1 -- 172.21.15.123:0/3425192674 >> v1:172.21.15.153:6789/0 conn(0x7f9a240cdfd0 legacy=0x7f9a240ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2893d700 1 -- 172.21.15.123:0/3425192674 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2415d5b0 con 0x7f9a240cedc0 2024-09-13T17:09:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a23fff700 1 --2- 172.21.15.123:0/3425192674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a241598b0 0x7f9a24071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a2893d700 1 --2- 172.21.15.123:0/3425192674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a240cedc0 0x7f9a24159c90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009e50 tx=0x7f9a1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ec9e17cd4ebfa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a22ffd700 1 -- 172.21.15.123:0/3425192674 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00e070 con 0x7f9a240cedc0 2024-09-13T17:09:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a22ffd700 1 -- 172.21.15.123:0/3425192674 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c00b9c0 con 0x7f9a240cedc0 2024-09-13T17:09:15.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.687+0000 7f9a22ffd700 1 -- 172.21.15.123:0/3425192674 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00bd70 con 0x7f9a240cedc0 2024-09-13T17:09:15.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.691+0000 7f9a2913e700 1 -- 172.21.15.123:0/3425192674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a240cedc0 msgr2=0x7f9a24159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:15.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.691+0000 7f9a2913e700 1 --2- 172.21.15.123:0/3425192674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a240cedc0 0x7f9a24159c90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009e50 tx=0x7f9a1c00b330 comp rx=0 tx=0).stop 2024-09-13T17:09:15.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.691+0000 7f9a2913e700 1 -- 172.21.15.123:0/3425192674 shutdown_connections 2024-09-13T17:09:15.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.691+0000 7f9a2913e700 1 --2- 172.21.15.123:0/3425192674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a240cedc0 0x7f9a24159c90 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.691+0000 7f9a2913e700 1 --2- 172.21.15.123:0/3425192674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a241598b0 0x7f9a24071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.691+0000 7f9a2913e700 1 -- 172.21.15.123:0/3425192674 >> 172.21.15.123:0/3425192674 conn(0x7f9a24066150 msgr2=0x7f9a24066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:15.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.691+0000 7f9a2913e700 1 -- 172.21.15.123:0/3425192674 shutdown_connections 2024-09-13T17:09:15.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.691+0000 7f9a2913e700 1 -- 172.21.15.123:0/3425192674 wait complete. 2024-09-13T17:09:15.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a2913e700 1 Processor -- start 2024-09-13T17:09:15.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a2913e700 1 -- start start 2024-09-13T17:09:15.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a2913e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a240cdfd0 0x7f9a240afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:15.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a2913e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a240cedc0 0x7f9a241ee810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:15.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a2913e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a241598b0 0x7f9a2415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:15.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a2913e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a24143bc0 con 0x7f9a240cedc0 2024-09-13T17:09:15.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a2913e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a24145cf0 con 0x7f9a241598b0 2024-09-13T17:09:15.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a2913e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a24145f60 con 0x7f9a240cdfd0 2024-09-13T17:09:15.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a237fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a240cedc0 0x7f9a241ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:15.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a237fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a240cedc0 0x7f9a241ee810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47296/0 (socket says 172.21.15.123:47296) 2024-09-13T17:09:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a237fe700 1 -- 172.21.15.123:0/4285123499 learned_addr learned my addr 172.21.15.123:0/4285123499 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a23fff700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a240cdfd0 0x7f9a240afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a2893d700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a241598b0 0x7f9a2415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a237fe700 1 -- 172.21.15.123:0/4285123499 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a240cdfd0 msgr2=0x7f9a240afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a237fe700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a240cdfd0 0x7f9a240afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a237fe700 1 -- 172.21.15.123:0/4285123499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a241598b0 msgr2=0x7f9a2415c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a237fe700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a241598b0 0x7f9a2415c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a237fe700 1 -- 172.21.15.123:0/4285123499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c009b30 con 0x7f9a240cedc0 2024-09-13T17:09:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a23fff700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a240cdfd0 0x7f9a240afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a237fe700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a240cedc0 0x7f9a241ee810 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c480 tx=0x7f9a1400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a20ff9700 1 -- 172.21.15.123:0/4285123499 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a140052d0 con 0x7f9a240cedc0 2024-09-13T17:09:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a20ff9700 1 -- 172.21.15.123:0/4285123499 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a14005430 con 0x7f9a240cedc0 2024-09-13T17:09:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a2913e700 1 -- 172.21.15.123:0/4285123499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a24146240 con 0x7f9a240cedc0 2024-09-13T17:09:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a20ff9700 1 -- 172.21.15.123:0/4285123499 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a140055a0 con 0x7f9a240cedc0 2024-09-13T17:09:15.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.695+0000 7f9a2913e700 1 -- 172.21.15.123:0/4285123499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a24146800 con 0x7f9a240cedc0 2024-09-13T17:09:15.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.699+0000 7f9a2913e700 1 -- 172.21.15.123:0/4285123499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a240677f0 con 0x7f9a240cedc0 2024-09-13T17:09:15.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.699+0000 7f9a20ff9700 1 -- 172.21.15.123:0/4285123499 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9a140036a0 con 0x7f9a240cedc0 2024-09-13T17:09:15.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.699+0000 7f9a20ff9700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9a10066730 0x7f9a10068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:15.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.699+0000 7f9a20ff9700 1 -- 172.21.15.123:0/4285123499 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9a14083140 con 0x7f9a240cedc0 2024-09-13T17:09:15.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.699+0000 7f9a23fff700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9a10066730 0x7f9a10068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:15.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.703+0000 7f9a23fff700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9a10066730 0x7f9a10068bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9a18006fd0 tx=0x7f9a18008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.707+0000 7f9a20ff9700 1 -- 172.21.15.123:0/4285123499 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9a14050890 con 0x7f9a240cedc0 2024-09-13T17:09:15.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.939+0000 7f9a2913e700 1 -- 172.21.15.123:0/4285123499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9a24071e60 con 0x7f9a240cedc0 2024-09-13T17:09:15.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.939+0000 7f9a20ff9700 1 -- 172.21.15.123:0/4285123499 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9a14053eb0 con 0x7f9a240cedc0 2024-09-13T17:09:15.946 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:15.946 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:09:15.946 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-13T17:09:15.946 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.946 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-13T17:09:15.946 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmcINWChAAjEdCM4Sk1OsLUQerqFqnGg==", 2024-09-13T17:09:15.946 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.946 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:15.946 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:09:15.946 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:09:15.946 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.947 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.947 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.947 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.947 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-13T17:09:15.947 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmesC1ERAA2ZS4r6KU9vqfDLLX+0kwwg==", 2024-09-13T17:09:15.947 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.947 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:15.947 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:09:15.947 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:09:15.947 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.947 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.947 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.947 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.948 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-13T17:09:15.948 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORm+dvcDRAA5o6AtNdAEM2RTXMTKTuwvA==", 2024-09-13T17:09:15.948 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.948 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:15.948 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:09:15.948 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:09:15.948 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.948 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.948 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.948 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.949 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-13T17:09:15.949 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmnFIgGBAAZbqUsdKOG1nN0iHsKRqyHA==", 2024-09-13T17:09:15.949 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.949 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:15.949 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:09:15.949 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:09:15.949 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.949 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.949 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.950 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.950 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-13T17:09:15.950 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDucORmpvNQEhAAg2TDxfqiCxv8rfzNXd8ghw==", 2024-09-13T17:09:15.950 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.950 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:15.950 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:15.950 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.950 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.950 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.951 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.951 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-13T17:09:15.951 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDxcORmnAU+FxAAxjWreGRwyuQT2RRMicHAXg==", 2024-09-13T17:09:15.951 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.951 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:15.951 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:15.951 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.951 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.951 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.951 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.951 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-13T17:09:15.951 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD0cORmMXQpGhAADjhpu3evLXhYS+YKeKf8WQ==", 2024-09-13T17:09:15.951 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.952 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:15.952 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:15.952 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.952 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.952 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.952 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.952 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-13T17:09:15.952 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD3cORmAo7hHxAA80EcAMAxPmMPuKxUg6RYhQ==", 2024-09-13T17:09:15.952 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.952 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:15.952 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-13T17:09:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD9cORm2j1KCxAA57ClQVuoJdhuk76L4nPHVQ==", 2024-09-13T17:09:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.954 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-13T17:09:15.954 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAAceRmu5IeExAAyUOWIVy5i703n829U0KSuw==", 2024-09-13T17:09:15.954 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.954 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:15.954 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:15.954 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.954 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.954 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.954 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.954 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-13T17:09:15.954 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQADceRmhiXfFhAAt6aAa3EUOvKclLyGEl84SA==", 2024-09-13T17:09:15.954 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.954 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:15.954 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:15.955 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.955 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.955 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.955 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.955 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-13T17:09:15.955 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAGceRmjYdfHBAAHn19wbVS72wMYHvMh+Cpyg==", 2024-09-13T17:09:15.955 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.955 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:15.955 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:15.955 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.955 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.955 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.955 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.955 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmieDjGxAA9C8qfFqgRul4Kzk+0+UMTA==", 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmJvUUJRAAQci63exaXrtjPfssFai1jw==", 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:09:15.956 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:09:15.957 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.957 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.957 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.957 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-13T17:09:15.957 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmgbzRIRAA8VlhYQpFRQUNOo6nplFySA==", 2024-09-13T17:09:15.957 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.957 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:15.957 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:09:15.957 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:09:15.957 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:09:15.957 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.957 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.957 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.957 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-13T17:09:15.958 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmwT+9KhAASidrLfvv55brtJ3Mk+qdxA==", 2024-09-13T17:09:15.958 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.958 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:15.958 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:09:15.958 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:09:15.958 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:09:15.958 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.958 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.958 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.958 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-13T17:09:15.958 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDqcORmn/ceNxAAxs8e7/yGRB9oykHDFVQ0lA==", 2024-09-13T17:09:15.958 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.958 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:09:15.958 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmFSRNBhAAbI1RASXCwIZPggcjMdXynw==", 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:15.959 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-13T17:09:15.960 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmLhAcAxAAHSNEbQ2dLEBPGDMMKc7dQQ==", 2024-09-13T17:09:15.960 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:15.960 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:09:15.960 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-13T17:09:15.960 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:15.960 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.960 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:15.960 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-13T17:09:15.961 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:09:15.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.943+0000 7f9a2913e700 1 -- 172.21.15.123:0/4285123499 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9a10066730 msgr2=0x7f9a10068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:15.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.943+0000 7f9a2913e700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9a10066730 0x7f9a10068bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9a18006fd0 tx=0x7f9a18008040 comp rx=0 tx=0).stop 2024-09-13T17:09:15.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.943+0000 7f9a2913e700 1 -- 172.21.15.123:0/4285123499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a240cedc0 msgr2=0x7f9a241ee810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:15.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.943+0000 7f9a2913e700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a240cedc0 0x7f9a241ee810 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c480 tx=0x7f9a1400c840 comp rx=0 tx=0).stop 2024-09-13T17:09:15.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.943+0000 7f9a2913e700 1 -- 172.21.15.123:0/4285123499 shutdown_connections 2024-09-13T17:09:15.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.943+0000 7f9a2913e700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9a10066730 0x7f9a10068bf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.943+0000 7f9a2913e700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a241598b0 0x7f9a2415c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.943+0000 7f9a2913e700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a240cedc0 0x7f9a241ee810 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.943+0000 7f9a2913e700 1 --2- 172.21.15.123:0/4285123499 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9a240cdfd0 0x7f9a240afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:15.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.943+0000 7f9a2913e700 1 -- 172.21.15.123:0/4285123499 >> 172.21.15.123:0/4285123499 conn(0x7f9a24066150 msgr2=0x7f9a24066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:15.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.943+0000 7f9a2913e700 1 -- 172.21.15.123:0/4285123499 shutdown_connections 2024-09-13T17:09:15.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:15.943+0000 7f9a2913e700 1 -- 172.21.15.123:0/4285123499 wait complete. 2024-09-13T17:09:15.964 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765f59e700 1 Processor -- start 2024-09-13T17:09:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765f59e700 1 -- start start 2024-09-13T17:09:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765f59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f76600ce1c0 0x7f76600d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765f59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76600cea60 con 0x7f766015cc00 2024-09-13T17:09:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765f59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76600ce780 con 0x7f76600d14f0 2024-09-13T17:09:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765f59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76600d1960 con 0x7f76600ce1c0 2024-09-13T17:09:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765dd9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f76600ce1c0 0x7f76600d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765dd9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f76600ce1c0 0x7f76600d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47300/0 (socket says 172.21.15.123:47300) 2024-09-13T17:09:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765e59c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f766015cc00 0x7f76600d0790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32904/0 (socket says 172.21.15.123:32904) 2024-09-13T17:09:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765dd9b700 1 -- 172.21.15.123:0/2389196883 learned_addr learned my addr 172.21.15.123:0/2389196883 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:16.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765dd9b700 1 -- 172.21.15.123:0/2389196883 >> v1:172.21.15.153:6789/0 conn(0x7f76600d14f0 legacy=0x7f76600b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765dd9b700 1 -- 172.21.15.123:0/2389196883 >> v1:172.21.15.123:6789/0 conn(0x7f766015cc00 legacy=0x7f76600d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765d59a700 1 -- 172.21.15.123:0/2389196883 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358977662 0 0) 0x7f76600cea60 con 0x7f766015cc00 2024-09-13T17:09:16.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765dd9b700 1 -- 172.21.15.123:0/2389196883 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600af710 con 0x7f76600ce1c0 2024-09-13T17:09:16.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765dd9b700 1 --2- 172.21.15.123:0/2389196883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76600ce1c0 0x7f76600d0fb0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7650009e50 tx=0x7f765000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09e60fd196d4915 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:16.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765d59a700 1 -- 172.21.15.123:0/2389196883 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000e070 con 0x7f76600ce1c0 2024-09-13T17:09:16.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765d59a700 1 -- 172.21.15.123:0/2389196883 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765000b9c0 con 0x7f76600ce1c0 2024-09-13T17:09:16.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.071+0000 7f765d59a700 1 -- 172.21.15.123:0/2389196883 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000bd70 con 0x7f76600ce1c0 2024-09-13T17:09:16.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.075+0000 7f765f59e700 1 -- 172.21.15.123:0/2389196883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76600ce1c0 msgr2=0x7f76600d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.075+0000 7f765f59e700 1 --2- 172.21.15.123:0/2389196883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76600ce1c0 0x7f76600d0fb0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7650009e50 tx=0x7f765000b330 comp rx=0 tx=0).stop 2024-09-13T17:09:16.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.075+0000 7f765f59e700 1 -- 172.21.15.123:0/2389196883 shutdown_connections 2024-09-13T17:09:16.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.075+0000 7f765f59e700 1 --2- 172.21.15.123:0/2389196883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76600ce1c0 0x7f76600d0fb0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.075+0000 7f765f59e700 1 -- 172.21.15.123:0/2389196883 >> 172.21.15.123:0/2389196883 conn(0x7f76600d2a80 msgr2=0x7f76600d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:16.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.075+0000 7f765f59e700 1 -- 172.21.15.123:0/2389196883 shutdown_connections 2024-09-13T17:09:16.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.075+0000 7f765f59e700 1 -- 172.21.15.123:0/2389196883 wait complete. 2024-09-13T17:09:16.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.075+0000 7f765f59e700 1 Processor -- start 2024-09-13T17:09:16.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.075+0000 7f765f59e700 1 -- start start 2024-09-13T17:09:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765f59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76600ce1c0 0x7f76601e7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76600d14f0 0x7f766014ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f766015cc00 0x7f766009fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765f59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76601e7bb0 con 0x7f766015cc00 2024-09-13T17:09:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766009e9f0 con 0x7f76600d14f0 2024-09-13T17:09:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765f59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766009ecd0 con 0x7f76600ce1c0 2024-09-13T17:09:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f766015cc00 0x7f766009fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76600d14f0 0x7f766014ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765e59c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76600ce1c0 0x7f76601e7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f766015cc00 0x7f766009fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47308/0 (socket says 172.21.15.123:47308) 2024-09-13T17:09:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765ed9d700 1 -- 172.21.15.123:0/118913606 learned_addr learned my addr 172.21.15.123:0/118913606 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765dd9b700 1 -- 172.21.15.123:0/118913606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76600ce1c0 msgr2=0x7f76601e7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765dd9b700 1 --2- 172.21.15.123:0/118913606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76600ce1c0 0x7f76601e7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765dd9b700 1 -- 172.21.15.123:0/118913606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f766015cc00 msgr2=0x7f766009fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765dd9b700 1 --2- 172.21.15.123:0/118913606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f766015cc00 0x7f766009fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765dd9b700 1 -- 172.21.15.123:0/118913606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7650009b30 con 0x7f76600d14f0 2024-09-13T17:09:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765ed9d700 1 --2- 172.21.15.123:0/118913606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f766015cc00 0x7f766009fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765dd9b700 1 --2- 172.21.15.123:0/118913606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76600d14f0 0x7f766014ede0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7650015000 tx=0x7f7650004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f7656ffd700 1 -- 172.21.15.123:0/118913606 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650004900 con 0x7f76600d14f0 2024-09-13T17:09:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f7656ffd700 1 -- 172.21.15.123:0/118913606 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76500099b0 con 0x7f76600d14f0 2024-09-13T17:09:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765f59e700 1 -- 172.21.15.123:0/118913606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766015d160 con 0x7f76600d14f0 2024-09-13T17:09:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f7656ffd700 1 -- 172.21.15.123:0/118913606 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765001b670 con 0x7f76600d14f0 2024-09-13T17:09:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.079+0000 7f765f59e700 1 -- 172.21.15.123:0/118913606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766009f290 con 0x7f76600d14f0 2024-09-13T17:09:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.083+0000 7f765f59e700 1 -- 172.21.15.123:0/118913606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76600d0fb0 con 0x7f76600d14f0 2024-09-13T17:09:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.083+0000 7f7656ffd700 1 -- 172.21.15.123:0/118913606 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f765001b7d0 con 0x7f76600d14f0 2024-09-13T17:09:16.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.083+0000 7f7656ffd700 1 --2- 172.21.15.123:0/118913606 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7640066730 0x7f7640068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.083+0000 7f765e59c700 1 --2- 172.21.15.123:0/118913606 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7640066730 0x7f7640068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.083+0000 7f7656ffd700 1 -- 172.21.15.123:0/118913606 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f76500856b0 con 0x7f76600d14f0 2024-09-13T17:09:16.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.083+0000 7f765e59c700 1 --2- 172.21.15.123:0/118913606 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7640066730 0x7f7640068bf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7648007b30 tx=0x7f7648007a80 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:16.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.095+0000 7f7656ffd700 1 -- 172.21.15.123:0/118913606 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7650052f00 con 0x7f76600d14f0 2024-09-13T17:09:16.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.267+0000 7f765f59e700 1 -- 172.21.15.123:0/118913606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f766008cb10 con 0x7f76600d14f0 2024-09-13T17:09:16.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.271+0000 7f7656ffd700 1 -- 172.21.15.123:0/118913606 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+12905 (secure 0 0 0) 0x7f7650056520 con 0x7f76600d14f0 2024-09-13T17:09:16.274 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:16.275 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":68,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:09:15.537718+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:16.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.275+0000 7f765f59e700 1 -- 172.21.15.123:0/118913606 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7640066730 msgr2=0x7f7640068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.275+0000 7f765f59e700 1 --2- 172.21.15.123:0/118913606 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7640066730 0x7f7640068bf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7648007b30 tx=0x7f7648007a80 comp rx=0 tx=0).stop 2024-09-13T17:09:16.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.275+0000 7f765f59e700 1 -- 172.21.15.123:0/118913606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76600d14f0 msgr2=0x7f766014ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.275+0000 7f765f59e700 1 --2- 172.21.15.123:0/118913606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76600d14f0 0x7f766014ede0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7650015000 tx=0x7f7650004af0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.275+0000 7f765f59e700 1 -- 172.21.15.123:0/118913606 shutdown_connections 2024-09-13T17:09:16.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.275+0000 7f765f59e700 1 --2- 172.21.15.123:0/118913606 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7640066730 0x7f7640068bf0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.275+0000 7f765f59e700 1 --2- 172.21.15.123:0/118913606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f766015cc00 0x7f766009fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.275+0000 7f765f59e700 1 --2- 172.21.15.123:0/118913606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76600d14f0 0x7f766014ede0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.275+0000 7f765f59e700 1 --2- 172.21.15.123:0/118913606 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76600ce1c0 0x7f76601e7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.275+0000 7f765f59e700 1 -- 172.21.15.123:0/118913606 >> 172.21.15.123:0/118913606 conn(0x7f76600d2a80 msgr2=0x7f76600b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:16.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.275+0000 7f765f59e700 1 -- 172.21.15.123:0/118913606 shutdown_connections 2024-09-13T17:09:16.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.275+0000 7f765f59e700 1 -- 172.21.15.123:0/118913606 wait complete. 2024-09-13T17:09:16.296 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:09:16.296 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:09:16.356 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:09:16.358 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:09:16.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.407+0000 7fa4d7fff700 1 Processor -- start 2024-09-13T17:09:16.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.407+0000 7fa4d7fff700 1 -- start start 2024-09-13T17:09:16.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d7fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4d80d0f40 0x7fa4d80d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d7fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d80d0cb0 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d7fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d80b0060 con 0x7fa4d80b58b0 2024-09-13T17:09:16.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d7fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80b0340 con 0x7fa4d80d0f40 2024-09-13T17:09:16.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d77fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa4d80cd5e0 0x7fa4d80cda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32906/0 (socket says 172.21.15.123:32906) 2024-09-13T17:09:16.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d77fe700 1 -- 172.21.15.123:0/4176338956 learned_addr learned my addr 172.21.15.123:0/4176338956 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:16.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d6ffd700 1 --2- 172.21.15.123:0/4176338956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4d80d0f40 0x7fa4d80d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d5ffb700 1 -- 172.21.15.123:0/4176338956 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559055219 0 0) 0x7fa4d80d0cb0 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d5ffb700 1 -- 172.21.15.123:0/4176338956 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4c00035d0 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d5ffb700 1 -- 172.21.15.123:0/4176338956 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142302523 0 0) 0x7fa4d80b0060 con 0x7fa4d80b58b0 2024-09-13T17:09:16.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d5ffb700 1 -- 172.21.15.123:0/4176338956 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4d80d0cb0 con 0x7fa4d80b58b0 2024-09-13T17:09:16.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d6ffd700 1 -- 172.21.15.123:0/4176338956 >> v1:172.21.15.153:6789/0 conn(0x7fa4d80b58b0 legacy=0x7fa4d80d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d6ffd700 1 -- 172.21.15.123:0/4176338956 >> v1:172.21.15.123:6789/0 conn(0x7fa4d80cd5e0 legacy=0x7fa4d80cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d5ffb700 1 -- 172.21.15.123:0/4176338956 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1737559561 0 0) 0x7fa4c00035d0 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d6ffd700 1 -- 172.21.15.123:0/4176338956 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d80b0620 con 0x7fa4d80d0f40 2024-09-13T17:09:16.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d6ffd700 1 --2- 172.21.15.123:0/4176338956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4d80d0f40 0x7fa4d80d1320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009880 tx=0x7fa4c8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d61db44697d99bff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:16.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d5ffb700 1 -- 172.21.15.123:0/4176338956 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00019f0 con 0x7fa4d80d0f40 2024-09-13T17:09:16.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d5ffb700 1 -- 172.21.15.123:0/4176338956 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c8004030 con 0x7fa4d80d0f40 2024-09-13T17:09:16.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d5ffb700 1 -- 172.21.15.123:0/4176338956 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c80043c0 con 0x7fa4d80d0f40 2024-09-13T17:09:16.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d7fff700 1 -- 172.21.15.123:0/4176338956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4d80d0f40 msgr2=0x7fa4d80d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d7fff700 1 --2- 172.21.15.123:0/4176338956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4d80d0f40 0x7fa4d80d1320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009880 tx=0x7fa4c8009b90 comp rx=0 tx=0).stop 2024-09-13T17:09:16.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d7fff700 1 -- 172.21.15.123:0/4176338956 shutdown_connections 2024-09-13T17:09:16.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d7fff700 1 --2- 172.21.15.123:0/4176338956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4d80d0f40 0x7fa4d80d1320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d7fff700 1 -- 172.21.15.123:0/4176338956 >> 172.21.15.123:0/4176338956 conn(0x7fa4d80d2a60 msgr2=0x7fa4d80d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:16.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d7fff700 1 -- 172.21.15.123:0/4176338956 shutdown_connections 2024-09-13T17:09:16.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.411+0000 7fa4d7fff700 1 -- 172.21.15.123:0/4176338956 wait complete. 2024-09-13T17:09:16.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.415+0000 7fa4d7fff700 1 Processor -- start 2024-09-13T17:09:16.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.415+0000 7fa4d7fff700 1 -- start start 2024-09-13T17:09:16.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d80b58b0 0x7fa4d815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4d80cd5e0 0x7fa4d8156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d7fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4d80d0f40 0x7fa4d80b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d7fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d815f1c0 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d7fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80c7450 con 0x7fa4d80b58b0 2024-09-13T17:09:16.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d7fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80c7730 con 0x7fa4d80d0f40 2024-09-13T17:09:16.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d67fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4d80cd5e0 0x7fa4d8156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d67fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4d80cd5e0 0x7fa4d8156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47314/0 (socket says 172.21.15.123:47314) 2024-09-13T17:09:16.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d67fc700 1 -- 172.21.15.123:0/2479938692 learned_addr learned my addr 172.21.15.123:0/2479938692 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:16.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d6ffd700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d80b58b0 0x7fa4d815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d77fe700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4d80d0f40 0x7fa4d80b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d67fc700 1 -- 172.21.15.123:0/2479938692 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4d80d0f40 msgr2=0x7fa4d80b6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d67fc700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4d80d0f40 0x7fa4d80b6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d67fc700 1 -- 172.21.15.123:0/2479938692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d80b58b0 msgr2=0x7fa4d815fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d67fc700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d80b58b0 0x7fa4d815fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d67fc700 1 -- 172.21.15.123:0/2479938692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c80094b0 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d6ffd700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d80b58b0 0x7fa4d815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:16.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d67fc700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4d80cd5e0 0x7fa4d8156ed0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c520 tx=0x7fa4cc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:16.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4bf7fe700 1 -- 172.21.15.123:0/2479938692 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc0052d0 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4bf7fe700 1 -- 172.21.15.123:0/2479938692 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc005430 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d7fff700 1 -- 172.21.15.123:0/2479938692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d80c7a10 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4bf7fe700 1 -- 172.21.15.123:0/2479938692 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc0055a0 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d7fff700 1 -- 172.21.15.123:0/2479938692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d80c7fd0 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.419+0000 7fa4d7fff700 1 -- 172.21.15.123:0/2479938692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d80c81f0 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.423+0000 7fa4bf7fe700 1 -- 172.21.15.123:0/2479938692 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa4cc0038e0 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.423+0000 7fa4bf7fe700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa4c4066730 0x7fa4c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.423+0000 7fa4bf7fe700 1 -- 172.21.15.123:0/2479938692 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa4cc083390 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.423+0000 7fa4d6ffd700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa4c4066730 0x7fa4c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.423+0000 7fa4d6ffd700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa4c4066730 0x7fa4c4068bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80090b0 tx=0x7fa4c8010000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:16.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.427+0000 7fa4bf7fe700 1 -- 172.21.15.123:0/2479938692 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa4cc0509d0 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.595+0000 7fa4d7fff700 1 -- 172.21.15.123:0/2479938692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa4d80672d0 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.595+0000 7fa4bf7fe700 1 -- 172.21.15.123:0/2479938692 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa4cc053ff0 con 0x7fa4d80cd5e0 2024-09-13T17:09:16.600 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:09:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.599+0000 7fa4d7fff700 1 -- 172.21.15.123:0/2479938692 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa4c4066730 msgr2=0x7fa4c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.599+0000 7fa4d7fff700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa4c4066730 0x7fa4c4068bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80090b0 tx=0x7fa4c8010000 comp rx=0 tx=0).stop 2024-09-13T17:09:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.599+0000 7fa4d7fff700 1 -- 172.21.15.123:0/2479938692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4d80cd5e0 msgr2=0x7fa4d8156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.599+0000 7fa4d7fff700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4d80cd5e0 0x7fa4d8156ed0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c520 tx=0x7fa4cc00c8e0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.599+0000 7fa4d7fff700 1 -- 172.21.15.123:0/2479938692 shutdown_connections 2024-09-13T17:09:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.599+0000 7fa4d7fff700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa4c4066730 0x7fa4c4068bf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.599+0000 7fa4d7fff700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4d80d0f40 0x7fa4d80b6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.599+0000 7fa4d7fff700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4d80cd5e0 0x7fa4d8156ed0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.599+0000 7fa4d7fff700 1 --2- 172.21.15.123:0/2479938692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d80b58b0 0x7fa4d815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.599+0000 7fa4d7fff700 1 -- 172.21.15.123:0/2479938692 >> 172.21.15.123:0/2479938692 conn(0x7fa4d80d2a60 msgr2=0x7fa4d8071280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.599+0000 7fa4d7fff700 1 -- 172.21.15.123:0/2479938692 shutdown_connections 2024-09-13T17:09:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.599+0000 7fa4d7fff700 1 -- 172.21.15.123:0/2479938692 wait complete. 2024-09-13T17:09:16.615 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:09:16.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcbfff700 1 Processor -- start 2024-09-13T17:09:16.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcbfff700 1 -- start start 2024-09-13T17:09:16.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcbfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bcc1602d0 0x7f4bcc0d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcbfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4bcc0d3680 0x7f4bcc0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcbfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4bcc0cf750 0x7f4bcc0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcbfff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc0ceab0 con 0x7f4bcc0cf750 2024-09-13T17:09:16.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcbfff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc0d0ea0 con 0x7f4bcc0d3680 2024-09-13T17:09:16.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcbfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0d0c70 con 0x7f4bcc1602d0 2024-09-13T17:09:16.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcb7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4bcc0cf750 0x7f4bcc0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcb7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4bcc0cf750 0x7f4bcc0cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47322/0 (socket says 172.21.15.123:47322) 2024-09-13T17:09:16.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bca7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4bcc0d3680 0x7f4bcc0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcb7fe700 1 -- 172.21.15.123:0/2533787481 learned_addr learned my addr 172.21.15.123:0/2533787481 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:16.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcaffd700 1 --2- 172.21.15.123:0/2533787481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bcc1602d0 0x7f4bcc0d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcb7fe700 1 -- 172.21.15.123:0/2533787481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bcc1602d0 msgr2=0x7f4bcc0d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:16.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcb7fe700 1 --2- 172.21.15.123:0/2533787481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bcc1602d0 0x7f4bcc0d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcb7fe700 1 -- 172.21.15.123:0/2533787481 >> v2:172.21.15.153:3300/0 conn(0x7f4bcc0d3680 msgr2=0x7f4bcc0cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:16.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcb7fe700 1 --2- 172.21.15.123:0/2533787481 >> v2:172.21.15.153:3300/0 conn(0x7f4bcc0d3680 0x7f4bcc0cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcb7fe700 1 -- 172.21.15.123:0/2533787481 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc0cff00 con 0x7f4bcc0cf750 2024-09-13T17:09:16.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.771+0000 7f4bcb7fe700 1 --2- 172.21.15.123:0/2533787481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bcc0cf750 0x7f4bcc0cd670 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc08b460 tx=0x7f4bb4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd2a8789f1b10af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:16.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bc9ffb700 1 -- 172.21.15.123:0/2533787481 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4011830 con 0x7f4bcc0cf750 2024-09-13T17:09:16.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bc9ffb700 1 -- 172.21.15.123:0/2533787481 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb4011990 con 0x7f4bcc0cf750 2024-09-13T17:09:16.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bc9ffb700 1 -- 172.21.15.123:0/2533787481 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4011d20 con 0x7f4bcc0cf750 2024-09-13T17:09:16.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 -- 172.21.15.123:0/2533787481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bcc0cf750 msgr2=0x7f4bcc0cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 --2- 172.21.15.123:0/2533787481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bcc0cf750 0x7f4bcc0cd670 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc08b460 tx=0x7f4bb4009bf0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 -- 172.21.15.123:0/2533787481 shutdown_connections 2024-09-13T17:09:16.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 --2- 172.21.15.123:0/2533787481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bcc0cf750 0x7f4bcc0cd670 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 --2- 172.21.15.123:0/2533787481 >> v2:172.21.15.153:3300/0 conn(0x7f4bcc0d3680 0x7f4bcc0cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 --2- 172.21.15.123:0/2533787481 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bcc1602d0 0x7f4bcc0d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 -- 172.21.15.123:0/2533787481 >> 172.21.15.123:0/2533787481 conn(0x7f4bcc0d2b60 msgr2=0x7f4bcc0d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:16.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 -- 172.21.15.123:0/2533787481 shutdown_connections 2024-09-13T17:09:16.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 -- 172.21.15.123:0/2533787481 wait complete. 2024-09-13T17:09:16.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 Processor -- start 2024-09-13T17:09:16.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 -- start start 2024-09-13T17:09:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bcc0cf750 0x7f4bcc15c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bcc0d3680 0x7f4bcc0c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bcc1602d0 0x7f4bcc0ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0cb420 con 0x7f4bcc1602d0 2024-09-13T17:09:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc15c960 con 0x7f4bcc0d3680 2024-09-13T17:09:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.775+0000 7f4bcbfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0cc120 con 0x7f4bcc0cf750 2024-09-13T17:09:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bcb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bcc1602d0 0x7f4bcc0ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bcaffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bcc0cf750 0x7f4bcc15c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bcb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bcc1602d0 0x7f4bcc0ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47336/0 (socket says 172.21.15.123:47336) 2024-09-13T17:09:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bcb7fe700 1 -- 172.21.15.123:0/3051820578 learned_addr learned my addr 172.21.15.123:0/3051820578 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bca7fc700 1 --2- 172.21.15.123:0/3051820578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bcc0d3680 0x7f4bcc0c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bcb7fe700 1 -- 172.21.15.123:0/3051820578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bcc0cf750 msgr2=0x7f4bcc15c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bcb7fe700 1 --2- 172.21.15.123:0/3051820578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bcc0cf750 0x7f4bcc15c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bcb7fe700 1 -- 172.21.15.123:0/3051820578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bcc0d3680 msgr2=0x7f4bcc0c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bcb7fe700 1 --2- 172.21.15.123:0/3051820578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bcc0d3680 0x7f4bcc0c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bcb7fe700 1 -- 172.21.15.123:0/3051820578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb4009570 con 0x7f4bcc1602d0 2024-09-13T17:09:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bcb7fe700 1 --2- 172.21.15.123:0/3051820578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bcc1602d0 0x7f4bcc0ca170 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc08b160 tx=0x7f4bb4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bc37fe700 1 -- 172.21.15.123:0/3051820578 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4004450 con 0x7f4bcc1602d0 2024-09-13T17:09:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bc37fe700 1 -- 172.21.15.123:0/3051820578 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb40045b0 con 0x7f4bcc1602d0 2024-09-13T17:09:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bc37fe700 1 -- 172.21.15.123:0/3051820578 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4003900 con 0x7f4bcc1602d0 2024-09-13T17:09:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bcbfff700 1 -- 172.21.15.123:0/3051820578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc0ca7a0 con 0x7f4bcc1602d0 2024-09-13T17:09:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bcbfff700 1 -- 172.21.15.123:0/3051820578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc0cad60 con 0x7f4bcc1602d0 2024-09-13T17:09:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.779+0000 7f4bcbfff700 1 -- 172.21.15.123:0/3051820578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bcc1606b0 con 0x7f4bcc1602d0 2024-09-13T17:09:16.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.783+0000 7f4bc37fe700 1 -- 172.21.15.123:0/3051820578 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4bb4021070 con 0x7f4bcc1602d0 2024-09-13T17:09:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.783+0000 7f4bc37fe700 1 --2- 172.21.15.123:0/3051820578 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4bb0066730 0x7f4bb0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.783+0000 7f4bcaffd700 1 --2- 172.21.15.123:0/3051820578 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4bb0066730 0x7f4bb0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.783+0000 7f4bc37fe700 1 -- 172.21.15.123:0/3051820578 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4bb4085120 con 0x7f4bcc1602d0 2024-09-13T17:09:16.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.783+0000 7f4bcaffd700 1 --2- 172.21.15.123:0/3051820578 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4bb0066730 0x7f4bb0068bf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4011340 tx=0x7f4bc400b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:16.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.787+0000 7f4bc37fe700 1 -- 172.21.15.123:0/3051820578 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4bb40527d0 con 0x7f4bcc1602d0 2024-09-13T17:09:16.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.959+0000 7f4bcbfff700 1 -- 172.21.15.123:0/3051820578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4bcc0d0960 con 0x7f4bcc1602d0 2024-09-13T17:09:16.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.963+0000 7f4bc37fe700 1 -- 172.21.15.123:0/3051820578 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4bb4055df0 con 0x7f4bcc1602d0 2024-09-13T17:09:16.966 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:16.966 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-13T17:09:16.966 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:16.966 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-13T17:09:16.966 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-13T17:09:16.966 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:16.966 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-13T17:09:16.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.963+0000 7f4bcbfff700 1 -- 172.21.15.123:0/3051820578 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4bb0066730 msgr2=0x7f4bb0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.963+0000 7f4bcbfff700 1 --2- 172.21.15.123:0/3051820578 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4bb0066730 0x7f4bb0068bf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4011340 tx=0x7f4bc400b040 comp rx=0 tx=0).stop 2024-09-13T17:09:16.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.963+0000 7f4bcbfff700 1 -- 172.21.15.123:0/3051820578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bcc1602d0 msgr2=0x7f4bcc0ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:16.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.963+0000 7f4bcbfff700 1 --2- 172.21.15.123:0/3051820578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bcc1602d0 0x7f4bcc0ca170 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc08b160 tx=0x7f4bb4004770 comp rx=0 tx=0).stop 2024-09-13T17:09:16.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.963+0000 7f4bcbfff700 1 -- 172.21.15.123:0/3051820578 shutdown_connections 2024-09-13T17:09:16.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.963+0000 7f4bcbfff700 1 --2- 172.21.15.123:0/3051820578 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4bb0066730 0x7f4bb0068bf0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.963+0000 7f4bcbfff700 1 --2- 172.21.15.123:0/3051820578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bcc1602d0 0x7f4bcc0ca170 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.963+0000 7f4bcbfff700 1 --2- 172.21.15.123:0/3051820578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bcc0d3680 0x7f4bcc0c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.963+0000 7f4bcbfff700 1 --2- 172.21.15.123:0/3051820578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bcc0cf750 0x7f4bcc15c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:16.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.963+0000 7f4bcbfff700 1 -- 172.21.15.123:0/3051820578 >> 172.21.15.123:0/3051820578 conn(0x7f4bcc0d2b60 msgr2=0x7f4bcc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:16.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.963+0000 7f4bcbfff700 1 -- 172.21.15.123:0/3051820578 shutdown_connections 2024-09-13T17:09:16.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:16.963+0000 7f4bcbfff700 1 -- 172.21.15.123:0/3051820578 wait complete. 2024-09-13T17:09:16.981 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:09:16.981 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:09:17.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa47fff700 1 Processor -- start 2024-09-13T17:09:17.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa47fff700 1 -- start start 2024-09-13T17:09:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa47fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa480d1790 0x7faa480d36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa47fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa481606f0 con 0x7faa48160310 2024-09-13T17:09:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa47fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa480ce7b0 con 0x7faa480d3220 2024-09-13T17:09:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa47fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa480cea90 con 0x7faa480d1790 2024-09-13T17:09:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa46ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7faa48160310 0x7faa480cf850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32908/0 (socket says 172.21.15.123:32908) 2024-09-13T17:09:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa46ffd700 1 -- 172.21.15.123:0/558838651 learned_addr learned my addr 172.21.15.123:0/558838651 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa477fe700 1 --2- 172.21.15.123:0/558838651 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa480d1790 0x7faa480d36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa45ffb700 1 -- 172.21.15.123:0/558838651 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367728654 0 0) 0x7faa481606f0 con 0x7faa48160310 2024-09-13T17:09:17.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa45ffb700 1 -- 172.21.15.123:0/558838651 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa300035d0 con 0x7faa48160310 2024-09-13T17:09:17.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa45ffb700 1 -- 172.21.15.123:0/558838651 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1050914498 0 0) 0x7faa300035d0 con 0x7faa48160310 2024-09-13T17:09:17.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa45ffb700 1 -- 172.21.15.123:0/558838651 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa480d1790 msgr2=0x7faa480d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:17.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa45ffb700 1 --2- 172.21.15.123:0/558838651 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa480d1790 0x7faa480d36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa45ffb700 1 -- 172.21.15.123:0/558838651 >> v1:172.21.15.153:6789/0 conn(0x7faa480d3220 legacy=0x7faa480d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:17.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa45ffb700 1 -- 172.21.15.123:0/558838651 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa480ced70 con 0x7faa48160310 2024-09-13T17:09:17.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa45ffb700 1 -- 172.21.15.123:0/558838651 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7faa38001670 con 0x7faa48160310 2024-09-13T17:09:17.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa45ffb700 1 -- 172.21.15.123:0/558838651 >> v1:172.21.15.123:6789/0 conn(0x7faa48160310 legacy=0x7faa480cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:17.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa45ffb700 1 --2- 172.21.15.123:0/558838651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa30003a50 0x7faa30003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa45ffb700 1 --2- 172.21.15.123:0/558838651 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa480d1790 0x7faa30004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa45ffb700 1 --2- 172.21.15.123:0/558838651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa30004db0 0x7faa30005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa45ffb700 1 -- 172.21.15.123:0/558838651 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa480cea90 con 0x7faa30004db0 2024-09-13T17:09:17.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.095+0000 7faa477fe700 1 --2- 172.21.15.123:0/558838651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa30004db0 0x7faa30005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa46ffd700 1 --2- 172.21.15.123:0/558838651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa30003a50 0x7faa30003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa45ffb700 1 -- 172.21.15.123:0/558838651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3000ba90 con 0x7faa30003a50 2024-09-13T17:09:17.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa45ffb700 1 -- 172.21.15.123:0/558838651 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3000bc50 con 0x7faa480d1790 2024-09-13T17:09:17.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa467fc700 1 --2- 172.21.15.123:0/558838651 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa480d1790 0x7faa30004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa477fe700 1 -- 172.21.15.123:0/558838651 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa480d1790 msgr2=0x7faa30004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:17.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa477fe700 1 --2- 172.21.15.123:0/558838651 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa480d1790 0x7faa30004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa477fe700 1 -- 172.21.15.123:0/558838651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa30003a50 msgr2=0x7faa30003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:17.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa477fe700 1 --2- 172.21.15.123:0/558838651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa30003a50 0x7faa30003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa477fe700 1 -- 172.21.15.123:0/558838651 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa300035d0 con 0x7faa30004db0 2024-09-13T17:09:17.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa477fe700 1 --2- 172.21.15.123:0/558838651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa30004db0 0x7faa30005230 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7faa480b41d0 tx=0x7faa300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98e8591f19013e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:17.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa45ffb700 1 -- 172.21.15.123:0/558838651 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4000ebd0 con 0x7faa30004db0 2024-09-13T17:09:17.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa45ffb700 1 -- 172.21.15.123:0/558838651 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4000f040 con 0x7faa30004db0 2024-09-13T17:09:17.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa45ffb700 1 -- 172.21.15.123:0/558838651 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40014480 con 0x7faa30004db0 2024-09-13T17:09:17.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa47fff700 1 -- 172.21.15.123:0/558838651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa30004db0 msgr2=0x7faa30005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa47fff700 1 --2- 172.21.15.123:0/558838651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa30004db0 0x7faa30005230 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7faa480b41d0 tx=0x7faa300058a0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa477fe700 1 -- 172.21.15.123:0/558838651 reap_dead start 2024-09-13T17:09:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa47fff700 1 -- 172.21.15.123:0/558838651 shutdown_connections 2024-09-13T17:09:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa47fff700 1 -- 172.21.15.123:0/558838651 >> 172.21.15.123:0/558838651 conn(0x7faa4809be50 msgr2=0x7faa480d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa47fff700 1 -- 172.21.15.123:0/558838651 shutdown_connections 2024-09-13T17:09:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.099+0000 7faa47fff700 1 -- 172.21.15.123:0/558838651 wait complete. 2024-09-13T17:09:17.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa47fff700 1 Processor -- start 2024-09-13T17:09:17.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa47fff700 1 -- start start 2024-09-13T17:09:17.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa47fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa4809dca0 0x7faa480cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa47fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa480b65c0 0x7faa480cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa47fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa481f61b0 0x7faa481f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa47fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa481f7180 con 0x7faa480b65c0 2024-09-13T17:09:17.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa47fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa481f6ea0 con 0x7faa481f61b0 2024-09-13T17:09:17.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa47fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa480b5ae0 con 0x7faa4809dca0 2024-09-13T17:09:17.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa467fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa480b65c0 0x7faa480cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa46ffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa4809dca0 0x7faa480cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa467fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa480b65c0 0x7faa480cbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47364/0 (socket says 172.21.15.123:47364) 2024-09-13T17:09:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa467fc700 1 -- 172.21.15.123:0/259896080 learned_addr learned my addr 172.21.15.123:0/259896080 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa477fe700 1 --2- 172.21.15.123:0/259896080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa481f61b0 0x7faa481f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa467fc700 1 -- 172.21.15.123:0/259896080 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa4809dca0 msgr2=0x7faa480cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa467fc700 1 --2- 172.21.15.123:0/259896080 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa4809dca0 0x7faa480cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa467fc700 1 -- 172.21.15.123:0/259896080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa481f61b0 msgr2=0x7faa481f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa467fc700 1 --2- 172.21.15.123:0/259896080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa481f61b0 0x7faa481f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa467fc700 1 -- 172.21.15.123:0/259896080 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa480b5dc0 con 0x7faa480b65c0 2024-09-13T17:09:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa467fc700 1 --2- 172.21.15.123:0/259896080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa480b65c0 0x7faa480cbbf0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00f860 tx=0x7faa3c00fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa2ffff700 1 -- 172.21.15.123:0/259896080 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0052e0 con 0x7faa480b65c0 2024-09-13T17:09:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa2ffff700 1 -- 172.21.15.123:0/259896080 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c005460 con 0x7faa480b65c0 2024-09-13T17:09:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa2ffff700 1 -- 172.21.15.123:0/259896080 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0038e0 con 0x7faa480b65c0 2024-09-13T17:09:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa47fff700 1 -- 172.21.15.123:0/259896080 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa480b60a0 con 0x7faa480b65c0 2024-09-13T17:09:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.103+0000 7faa47fff700 1 -- 172.21.15.123:0/259896080 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4809e080 con 0x7faa480b65c0 2024-09-13T17:09:17.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.107+0000 7faa47fff700 1 -- 172.21.15.123:0/259896080 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa480677f0 con 0x7faa480b65c0 2024-09-13T17:09:17.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.107+0000 7faa2ffff700 1 -- 172.21.15.123:0/259896080 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faa3c003a40 con 0x7faa480b65c0 2024-09-13T17:09:17.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.107+0000 7faa2ffff700 1 --2- 172.21.15.123:0/259896080 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faa34066760 0x7faa34068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.107+0000 7faa2ffff700 1 -- 172.21.15.123:0/259896080 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faa3c083ca0 con 0x7faa480b65c0 2024-09-13T17:09:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.107+0000 7faa46ffd700 1 --2- 172.21.15.123:0/259896080 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faa34066760 0x7faa34068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.107+0000 7faa46ffd700 1 --2- 172.21.15.123:0/259896080 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faa34066760 0x7faa34068c20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faa380048f0 tx=0x7faa38008d10 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:17.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.111+0000 7faa2ffff700 1 -- 172.21.15.123:0/259896080 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faa3c051370 con 0x7faa480b65c0 2024-09-13T17:09:17.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.283+0000 7faa47fff700 1 -- 172.21.15.123:0/259896080 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7faa480b5940 con 0x7faa480b65c0 2024-09-13T17:09:17.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.543+0000 7faa2ffff700 1 -- 172.21.15.123:0/259896080 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) v1 ==== 138+0+0 (secure 0 0 0) 0x7faa480b5940 con 0x7faa480b65c0 2024-09-13T17:09:17.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.547+0000 7faa47fff700 1 -- 172.21.15.123:0/259896080 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faa34066760 msgr2=0x7faa34068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:17.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.547+0000 7faa47fff700 1 --2- 172.21.15.123:0/259896080 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faa34066760 0x7faa34068c20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faa380048f0 tx=0x7faa38008d10 comp rx=0 tx=0).stop 2024-09-13T17:09:17.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.547+0000 7faa47fff700 1 -- 172.21.15.123:0/259896080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa480b65c0 msgr2=0x7faa480cbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:17.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.547+0000 7faa47fff700 1 --2- 172.21.15.123:0/259896080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa480b65c0 0x7faa480cbbf0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00f860 tx=0x7faa3c00fb70 comp rx=0 tx=0).stop 2024-09-13T17:09:17.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.547+0000 7faa47fff700 1 -- 172.21.15.123:0/259896080 shutdown_connections 2024-09-13T17:09:17.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.547+0000 7faa47fff700 1 --2- 172.21.15.123:0/259896080 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faa34066760 0x7faa34068c20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.547+0000 7faa47fff700 1 --2- 172.21.15.123:0/259896080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa481f61b0 0x7faa481f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.547+0000 7faa47fff700 1 --2- 172.21.15.123:0/259896080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa480b65c0 0x7faa480cbbf0 secure :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00f860 tx=0x7faa3c00fb70 comp rx=0 tx=0).stop 2024-09-13T17:09:17.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.547+0000 7faa47fff700 1 --2- 172.21.15.123:0/259896080 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faa4809dca0 0x7faa480cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.547+0000 7faa47fff700 1 -- 172.21.15.123:0/259896080 >> 172.21.15.123:0/259896080 conn(0x7faa4809be50 msgr2=0x7faa4815c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:17.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.551+0000 7faa47fff700 1 -- 172.21.15.123:0/259896080 shutdown_connections 2024-09-13T17:09:17.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.551+0000 7faa47fff700 1 -- 172.21.15.123:0/259896080 wait complete. 2024-09-13T17:09:17.555 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-13T17:09:17.568 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:09:17.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.683+0000 7fb345ee5700 1 Processor -- start 2024-09-13T17:09:17.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.683+0000 7fb345ee5700 1 -- start start 2024-09-13T17:09:17.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb345ee5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb3400d0f40 0x7fb3400d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb345ee5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3400cd5e0 0x7fb3400cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb345ee5700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3400d0cb0 con 0x7fb3400b58b0 2024-09-13T17:09:17.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb345ee5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3400b0060 con 0x7fb3400d0f40 2024-09-13T17:09:17.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb345ee5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400b0340 con 0x7fb3400cd5e0 2024-09-13T17:09:17.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb344ee3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb3400d0f40 0x7fb3400d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb344ee3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb3400d0f40 0x7fb3400d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47370/0 (socket says 172.21.15.123:47370) 2024-09-13T17:09:17.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb344ee3700 1 -- 172.21.15.123:0/4187549419 learned_addr learned my addr 172.21.15.123:0/4187549419 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:17.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb3456e4700 1 --2- 172.21.15.123:0/4187549419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3400cd5e0 0x7fb3400cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb344ee3700 1 -- 172.21.15.123:0/4187549419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3400cd5e0 msgr2=0x7fb3400cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:17.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb344ee3700 1 --2- 172.21.15.123:0/4187549419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3400cd5e0 0x7fb3400cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb344ee3700 1 -- 172.21.15.123:0/4187549419 >> v1:172.21.15.153:6789/0 conn(0x7fb3400b58b0 legacy=0x7fb3400d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:17.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb344ee3700 1 -- 172.21.15.123:0/4187549419 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3400b0620 con 0x7fb3400d0f40 2024-09-13T17:09:17.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb33f7fe700 1 -- 172.21.15.123:0/4187549419 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639587538 0 0) 0x7fb3400d0cb0 con 0x7fb3400b58b0 2024-09-13T17:09:17.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb344ee3700 1 --2- 172.21.15.123:0/4187549419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3400d0f40 0x7fb3400d1320 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb334009910 tx=0x7fb334009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28195d9c123c8f86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:17.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb33f7fe700 1 -- 172.21.15.123:0/4187549419 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334011830 con 0x7fb3400d0f40 2024-09-13T17:09:17.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb33f7fe700 1 -- 172.21.15.123:0/4187549419 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb334011990 con 0x7fb3400d0f40 2024-09-13T17:09:17.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb33f7fe700 1 -- 172.21.15.123:0/4187549419 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334011d40 con 0x7fb3400d0f40 2024-09-13T17:09:17.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb345ee5700 1 -- 172.21.15.123:0/4187549419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3400d0f40 msgr2=0x7fb3400d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:17.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb345ee5700 1 --2- 172.21.15.123:0/4187549419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3400d0f40 0x7fb3400d1320 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb334009910 tx=0x7fb334009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:17.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb345ee5700 1 -- 172.21.15.123:0/4187549419 shutdown_connections 2024-09-13T17:09:17.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb345ee5700 1 --2- 172.21.15.123:0/4187549419 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3400cd5e0 0x7fb3400cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb345ee5700 1 --2- 172.21.15.123:0/4187549419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3400d0f40 0x7fb3400d1320 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb345ee5700 1 -- 172.21.15.123:0/4187549419 >> 172.21.15.123:0/4187549419 conn(0x7fb3400d2a60 msgr2=0x7fb3400d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:17.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb345ee5700 1 -- 172.21.15.123:0/4187549419 shutdown_connections 2024-09-13T17:09:17.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.687+0000 7fb345ee5700 1 -- 172.21.15.123:0/4187549419 wait complete. 2024-09-13T17:09:17.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb345ee5700 1 Processor -- start 2024-09-13T17:09:17.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb345ee5700 1 -- start start 2024-09-13T17:09:17.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb345ee5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3400b58b0 0x7fb3401534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb345ee5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3400cd5e0 0x7fb34015d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb345ee5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3400d0f40 0x7fb3400b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb345ee5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400b3b40 con 0x7fb3400cd5e0 2024-09-13T17:09:17.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb345ee5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400b2f30 con 0x7fb3400d0f40 2024-09-13T17:09:17.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb345ee5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400b3210 con 0x7fb3400b58b0 2024-09-13T17:09:17.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb33ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3400cd5e0 0x7fb34015d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb33ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3400cd5e0 0x7fb34015d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47380/0 (socket says 172.21.15.123:47380) 2024-09-13T17:09:17.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb33ffff700 1 -- 172.21.15.123:0/3568864305 learned_addr learned my addr 172.21.15.123:0/3568864305 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:17.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb344ee3700 1 --2- 172.21.15.123:0/3568864305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3400b58b0 0x7fb3401534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb3456e4700 1 --2- 172.21.15.123:0/3568864305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3400d0f40 0x7fb3400b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb33ffff700 1 -- 172.21.15.123:0/3568864305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3400b58b0 msgr2=0x7fb3401534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:17.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb33ffff700 1 --2- 172.21.15.123:0/3568864305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3400b58b0 0x7fb3401534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb33ffff700 1 -- 172.21.15.123:0/3568864305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3400d0f40 msgr2=0x7fb3400b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:17.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb33ffff700 1 --2- 172.21.15.123:0/3568864305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3400d0f40 0x7fb3400b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:17.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb33ffff700 1 -- 172.21.15.123:0/3568864305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb334009570 con 0x7fb3400cd5e0 2024-09-13T17:09:17.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb33ffff700 1 --2- 172.21.15.123:0/3568864305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3400cd5e0 0x7fb34015d570 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c520 tx=0x7fb33000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:17.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb33d7fa700 1 -- 172.21.15.123:0/3568864305 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3300054e0 con 0x7fb3400cd5e0 2024-09-13T17:09:17.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb33d7fa700 1 -- 172.21.15.123:0/3568864305 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3300036a0 con 0x7fb3400cd5e0 2024-09-13T17:09:17.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb345ee5700 1 -- 172.21.15.123:0/3568864305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3400b34f0 con 0x7fb3400cd5e0 2024-09-13T17:09:17.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb33d7fa700 1 -- 172.21.15.123:0/3568864305 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330003a50 con 0x7fb3400cd5e0 2024-09-13T17:09:17.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.691+0000 7fb345ee5700 1 -- 172.21.15.123:0/3568864305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb340153a20 con 0x7fb3400cd5e0 2024-09-13T17:09:17.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.695+0000 7fb345ee5700 1 -- 172.21.15.123:0/3568864305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3400b3cf0 con 0x7fb3400cd5e0 2024-09-13T17:09:17.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.695+0000 7fb33d7fa700 1 -- 172.21.15.123:0/3568864305 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb330003bb0 con 0x7fb3400cd5e0 2024-09-13T17:09:17.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.699+0000 7fb33d7fa700 1 --2- 172.21.15.123:0/3568864305 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb32c066730 0x7fb32c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:17.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.699+0000 7fb33d7fa700 1 -- 172.21.15.123:0/3568864305 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fb3300834a0 con 0x7fb3400cd5e0 2024-09-13T17:09:17.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.699+0000 7fb344ee3700 1 --2- 172.21.15.123:0/3568864305 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb32c066730 0x7fb32c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:17.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.699+0000 7fb344ee3700 1 --2- 172.21.15.123:0/3568864305 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb32c066730 0x7fb32c068bf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb334000c00 tx=0x7fb334008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:17.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.707+0000 7fb33d7fa700 1 -- 172.21.15.123:0/3568864305 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb330050b60 con 0x7fb3400cd5e0 2024-09-13T17:09:17.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:17.875+0000 7fb345ee5700 1 -- 172.21.15.123:0/3568864305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb34015ce70 con 0x7fb3400cd5e0 2024-09-13T17:09:18.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.555+0000 7fb33d7fa700 1 -- 172.21.15.123:0/3568864305 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb330017020 con 0x7fb3400cd5e0 2024-09-13T17:09:18.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.571+0000 7fb345ee5700 1 -- 172.21.15.123:0/3568864305 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb32c066730 msgr2=0x7fb32c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:18.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.571+0000 7fb345ee5700 1 --2- 172.21.15.123:0/3568864305 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb32c066730 0x7fb32c068bf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb334000c00 tx=0x7fb334008030 comp rx=0 tx=0).stop 2024-09-13T17:09:18.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.571+0000 7fb345ee5700 1 -- 172.21.15.123:0/3568864305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3400cd5e0 msgr2=0x7fb34015d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:18.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.571+0000 7fb345ee5700 1 --2- 172.21.15.123:0/3568864305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3400cd5e0 0x7fb34015d570 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c520 tx=0x7fb33000c830 comp rx=0 tx=0).stop 2024-09-13T17:09:18.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.571+0000 7fb345ee5700 1 -- 172.21.15.123:0/3568864305 shutdown_connections 2024-09-13T17:09:18.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.571+0000 7fb345ee5700 1 --2- 172.21.15.123:0/3568864305 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb32c066730 0x7fb32c068bf0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.571+0000 7fb345ee5700 1 --2- 172.21.15.123:0/3568864305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3400d0f40 0x7fb3400b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.571+0000 7fb345ee5700 1 --2- 172.21.15.123:0/3568864305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3400cd5e0 0x7fb34015d570 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.571+0000 7fb345ee5700 1 --2- 172.21.15.123:0/3568864305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3400b58b0 0x7fb3401534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.571+0000 7fb345ee5700 1 -- 172.21.15.123:0/3568864305 >> 172.21.15.123:0/3568864305 conn(0x7fb3400d2a60 msgr2=0x7fb340074210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:18.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.571+0000 7fb345ee5700 1 -- 172.21.15.123:0/3568864305 shutdown_connections 2024-09-13T17:09:18.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.571+0000 7fb345ee5700 1 -- 172.21.15.123:0/3568864305 wait complete. 2024-09-13T17:09:18.576 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-13T17:09:18.589 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:09:18.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 Processor -- start 2024-09-13T17:09:18.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 -- start start 2024-09-13T17:09:18.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe52c0cb7e0 0x7fe52c0c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:18.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe52c06bdb0 0x7fe52c071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:18.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52c0ca750 con 0x7fe52c0c1480 2024-09-13T17:09:18.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c0c9210 con 0x7fe52c06bdb0 2024-09-13T17:09:18.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c1617b0 con 0x7fe52c0cb7e0 2024-09-13T17:09:18.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52affd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe52c0cb7e0 0x7fe52c0c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:18.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe523fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe52c06bdb0 0x7fe52c071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:18.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52affd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe52c0cb7e0 0x7fe52c0c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:56976/0 (socket says 172.21.15.123:56976) 2024-09-13T17:09:18.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52affd700 1 -- 172.21.15.123:0/2850725753 learned_addr learned my addr 172.21.15.123:0/2850725753 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:18.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe523fff700 1 -- 172.21.15.123:0/2850725753 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe52c0cb7e0 msgr2=0x7fe52c0c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:18.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe523fff700 1 --2- 172.21.15.123:0/2850725753 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe52c0cb7e0 0x7fe52c0c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe523fff700 1 -- 172.21.15.123:0/2850725753 >> v1:172.21.15.153:6789/0 conn(0x7fe52c0c1480 legacy=0x7fe52c0706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:18.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe523fff700 1 -- 172.21.15.123:0/2850725753 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c0cbbc0 con 0x7fe52c06bdb0 2024-09-13T17:09:18.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52affd700 1 --2- 172.21.15.123:0/2850725753 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe52c0cb7e0 0x7fe52c0c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:18.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe523fff700 1 --2- 172.21.15.123:0/2850725753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe52c06bdb0 0x7fe52c071b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe514009850 tx=0x7fe514009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f9f638b7404f3fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:18.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52a7fc700 1 -- 172.21.15.123:0/2850725753 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514011830 con 0x7fe52c06bdb0 2024-09-13T17:09:18.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52a7fc700 1 -- 172.21.15.123:0/2850725753 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe514011990 con 0x7fe52c06bdb0 2024-09-13T17:09:18.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52a7fc700 1 -- 172.21.15.123:0/2850725753 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514011d40 con 0x7fe52c06bdb0 2024-09-13T17:09:18.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 -- 172.21.15.123:0/2850725753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe52c06bdb0 msgr2=0x7fe52c071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:18.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 --2- 172.21.15.123:0/2850725753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe52c06bdb0 0x7fe52c071b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe514009850 tx=0x7fe514009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:18.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 -- 172.21.15.123:0/2850725753 shutdown_connections 2024-09-13T17:09:18.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 --2- 172.21.15.123:0/2850725753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe52c06bdb0 0x7fe52c071b50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 --2- 172.21.15.123:0/2850725753 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe52c0cb7e0 0x7fe52c0c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 -- 172.21.15.123:0/2850725753 >> 172.21.15.123:0/2850725753 conn(0x7fe52c0b01d0 msgr2=0x7fe52c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:18.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 -- 172.21.15.123:0/2850725753 shutdown_connections 2024-09-13T17:09:18.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.695+0000 7fe52bfff700 1 -- 172.21.15.123:0/2850725753 wait complete. 2024-09-13T17:09:18.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52bfff700 1 Processor -- start 2024-09-13T17:09:18.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52bfff700 1 -- start start 2024-09-13T17:09:18.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe52c06bdb0 0x7fe52c0b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:18.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe52c0c1480 0x7fe52c0c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:18.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe52c0cb7e0 0x7fe52c15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:18.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52bfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0c81b0 con 0x7fe52c0c1480 2024-09-13T17:09:18.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52bfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0c85d0 con 0x7fe52c0cb7e0 2024-09-13T17:09:18.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0c7530 con 0x7fe52c06bdb0 2024-09-13T17:09:18.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe523fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe52c0c1480 0x7fe52c0c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:18.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe523fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe52c0c1480 0x7fe52c0c6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47394/0 (socket says 172.21.15.123:47394) 2024-09-13T17:09:18.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe523fff700 1 -- 172.21.15.123:0/3235762230 learned_addr learned my addr 172.21.15.123:0/3235762230 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:18.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52b7fe700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe52c0cb7e0 0x7fe52c15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:18.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52affd700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe52c06bdb0 0x7fe52c0b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:18.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52b7fe700 1 -- 172.21.15.123:0/3235762230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe52c06bdb0 msgr2=0x7fe52c0b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:18.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52b7fe700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe52c06bdb0 0x7fe52c0b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52b7fe700 1 -- 172.21.15.123:0/3235762230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe52c0c1480 msgr2=0x7fe52c0c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:18.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52b7fe700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe52c0c1480 0x7fe52c0c6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52b7fe700 1 -- 172.21.15.123:0/3235762230 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51c009570 con 0x7fe52c0cb7e0 2024-09-13T17:09:18.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52affd700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe52c06bdb0 0x7fe52c0b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:18.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe523fff700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe52c0c1480 0x7fe52c0c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:18.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52b7fe700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe52c0cb7e0 0x7fe52c15d830 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe52400caa0 tx=0x7fe52400cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:18.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe5237fe700 1 -- 172.21.15.123:0/3235762230 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524003c20 con 0x7fe52c0cb7e0 2024-09-13T17:09:18.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe5237fe700 1 -- 172.21.15.123:0/3235762230 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe524003d80 con 0x7fe52c0cb7e0 2024-09-13T17:09:18.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52bfff700 1 -- 172.21.15.123:0/3235762230 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5140094b0 con 0x7fe52c0cb7e0 2024-09-13T17:09:18.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe5237fe700 1 -- 172.21.15.123:0/3235762230 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52400a980 con 0x7fe52c0cb7e0 2024-09-13T17:09:18.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.699+0000 7fe52bfff700 1 -- 172.21.15.123:0/3235762230 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c0c7af0 con 0x7fe52c0cb7e0 2024-09-13T17:09:18.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.703+0000 7fe52bfff700 1 -- 172.21.15.123:0/3235762230 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52c0c82f0 con 0x7fe52c0cb7e0 2024-09-13T17:09:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.703+0000 7fe5237fe700 1 -- 172.21.15.123:0/3235762230 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe52400aae0 con 0x7fe52c0cb7e0 2024-09-13T17:09:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.703+0000 7fe5237fe700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe50c066730 0x7fe50c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.707+0000 7fe52affd700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe50c066730 0x7fe50c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:18.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.707+0000 7fe5237fe700 1 -- 172.21.15.123:0/3235762230 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe5240845b0 con 0x7fe52c0cb7e0 2024-09-13T17:09:18.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.707+0000 7fe52affd700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe50c066730 0x7fe50c068bf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe51c006d50 tx=0x7fe51c0092e0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.711+0000 7fe5237fe700 1 -- 172.21.15.123:0/3235762230 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe5240519a0 con 0x7fe52c0cb7e0 2024-09-13T17:09:18.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.919+0000 7fe52bfff700 1 -- 172.21.15.123:0/3235762230 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe52c0c82f0 con 0x7fe52c0cb7e0 2024-09-13T17:09:18.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.935+0000 7fe5237fe700 1 -- 172.21.15.123:0/3235762230 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v32) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe52c0c82f0 con 0x7fe52c0cb7e0 2024-09-13T17:09:18.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.939+0000 7fe52bfff700 1 -- 172.21.15.123:0/3235762230 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe50c066730 msgr2=0x7fe50c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:18.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.939+0000 7fe52bfff700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe50c066730 0x7fe50c068bf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe51c006d50 tx=0x7fe51c0092e0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.939+0000 7fe52bfff700 1 -- 172.21.15.123:0/3235762230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe52c0cb7e0 msgr2=0x7fe52c15d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:18.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.939+0000 7fe52bfff700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe52c0cb7e0 0x7fe52c15d830 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe52400caa0 tx=0x7fe52400cdb0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.939+0000 7fe52bfff700 1 -- 172.21.15.123:0/3235762230 shutdown_connections 2024-09-13T17:09:18.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.939+0000 7fe52bfff700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe50c066730 0x7fe50c068bf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.939+0000 7fe52bfff700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe52c0cb7e0 0x7fe52c15d830 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.939+0000 7fe52bfff700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe52c0c1480 0x7fe52c0c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.939+0000 7fe52bfff700 1 --2- 172.21.15.123:0/3235762230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe52c06bdb0 0x7fe52c0b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:18.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.939+0000 7fe52bfff700 1 -- 172.21.15.123:0/3235762230 >> 172.21.15.123:0/3235762230 conn(0x7fe52c0b01d0 msgr2=0x7fe52c0706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:18.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.939+0000 7fe52bfff700 1 -- 172.21.15.123:0/3235762230 shutdown_connections 2024-09-13T17:09:18.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:18.939+0000 7fe52bfff700 1 -- 172.21.15.123:0/3235762230 wait complete. 2024-09-13T17:09:18.949 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 10 and data pool 11 2024-09-13T17:09:18.966 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:19.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f3fff700 1 Processor -- start 2024-09-13T17:09:19.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f3fff700 1 -- start start 2024-09-13T17:09:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f01f41602d0 0x7f01f40d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01f40cf920 0x7f01f40b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f3fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f40d0ea0 con 0x7f01f40d3680 2024-09-13T17:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f3fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f40ceab0 con 0x7f01f41602d0 2024-09-13T17:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40cff00 con 0x7f01f40cf920 2024-09-13T17:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f2ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f01f41602d0 0x7f01f40d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f2ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f01f41602d0 0x7f01f40d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47396/0 (socket says 172.21.15.123:47396) 2024-09-13T17:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f27fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f01f40d3680 0x7f01f40cf210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32920/0 (socket says 172.21.15.123:32920) 2024-09-13T17:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f2ffd700 1 -- 172.21.15.123:0/3541319588 learned_addr learned my addr 172.21.15.123:0/3541319588 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f37fe700 1 --2- 172.21.15.123:0/3541319588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01f40cf920 0x7f01f40b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f2ffd700 1 -- 172.21.15.123:0/3541319588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01f40cf920 msgr2=0x7f01f40b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f2ffd700 1 --2- 172.21.15.123:0/3541319588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01f40cf920 0x7f01f40b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f2ffd700 1 -- 172.21.15.123:0/3541319588 >> v1:172.21.15.123:6789/0 conn(0x7f01f40d3680 legacy=0x7f01f40cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f2ffd700 1 -- 172.21.15.123:0/3541319588 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f40d0c70 con 0x7f01f41602d0 2024-09-13T17:09:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f2ffd700 1 --2- 172.21.15.123:0/3541319588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f41602d0 0x7f01f40d0730 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009e80 tx=0x7f01e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f1a90e155e68da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:19.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f1ffb700 1 -- 172.21.15.123:0/3541319588 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e400e070 con 0x7f01f41602d0 2024-09-13T17:09:19.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f1ffb700 1 -- 172.21.15.123:0/3541319588 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e400b980 con 0x7f01f41602d0 2024-09-13T17:09:19.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.059+0000 7f01f1ffb700 1 -- 172.21.15.123:0/3541319588 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e400bd30 con 0x7f01f41602d0 2024-09-13T17:09:19.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.063+0000 7f01f3fff700 1 -- 172.21.15.123:0/3541319588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f41602d0 msgr2=0x7f01f40d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.063+0000 7f01f3fff700 1 --2- 172.21.15.123:0/3541319588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f41602d0 0x7f01f40d0730 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009e80 tx=0x7f01e400b330 comp rx=0 tx=0).stop 2024-09-13T17:09:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.063+0000 7f01f3fff700 1 -- 172.21.15.123:0/3541319588 shutdown_connections 2024-09-13T17:09:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.063+0000 7f01f3fff700 1 --2- 172.21.15.123:0/3541319588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01f40cf920 0x7f01f40b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.063+0000 7f01f3fff700 1 --2- 172.21.15.123:0/3541319588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f41602d0 0x7f01f40d0730 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.063+0000 7f01f3fff700 1 -- 172.21.15.123:0/3541319588 >> 172.21.15.123:0/3541319588 conn(0x7f01f40d2b60 msgr2=0x7f01f40d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.063+0000 7f01f3fff700 1 -- 172.21.15.123:0/3541319588 shutdown_connections 2024-09-13T17:09:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.063+0000 7f01f3fff700 1 -- 172.21.15.123:0/3541319588 wait complete. 2024-09-13T17:09:19.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.063+0000 7f01f3fff700 1 Processor -- start 2024-09-13T17:09:19.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.063+0000 7f01f3fff700 1 -- start start 2024-09-13T17:09:19.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01f40cf920 0x7f01f41f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01f40d3680 0x7f01f40c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f41602d0 0x7f01f40c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f3fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40cc640 con 0x7f01f41602d0 2024-09-13T17:09:19.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40cba30 con 0x7f01f40d3680 2024-09-13T17:09:19.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40cbd10 con 0x7f01f40cf920 2024-09-13T17:09:19.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f41602d0 0x7f01f40c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f41602d0 0x7f01f40c6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47400/0 (socket says 172.21.15.123:47400) 2024-09-13T17:09:19.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f37fe700 1 -- 172.21.15.123:0/4215490277 learned_addr learned my addr 172.21.15.123:0/4215490277 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:19.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f2ffd700 1 --2- 172.21.15.123:0/4215490277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01f40cf920 0x7f01f41f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f27fc700 1 --2- 172.21.15.123:0/4215490277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01f40d3680 0x7f01f40c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f37fe700 1 -- 172.21.15.123:0/4215490277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01f40cf920 msgr2=0x7f01f41f1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f37fe700 1 --2- 172.21.15.123:0/4215490277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01f40cf920 0x7f01f41f1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f37fe700 1 -- 172.21.15.123:0/4215490277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01f40d3680 msgr2=0x7f01f40c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f37fe700 1 --2- 172.21.15.123:0/4215490277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01f40d3680 0x7f01f40c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f37fe700 1 -- 172.21.15.123:0/4215490277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e4009b30 con 0x7f01f41602d0 2024-09-13T17:09:19.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f37fe700 1 --2- 172.21.15.123:0/4215490277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f41602d0 0x7f01f40c6bd0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00d800 tx=0x7f01ec00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:19.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01eb7fe700 1 -- 172.21.15.123:0/4215490277 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0125f0 con 0x7f01f41602d0 2024-09-13T17:09:19.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f3fff700 1 -- 172.21.15.123:0/4215490277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f40cbff0 con 0x7f01f41602d0 2024-09-13T17:09:19.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01eb7fe700 1 -- 172.21.15.123:0/4215490277 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec012790 con 0x7f01f41602d0 2024-09-13T17:09:19.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01eb7fe700 1 -- 172.21.15.123:0/4215490277 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec012b40 con 0x7f01f41602d0 2024-09-13T17:09:19.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f3fff700 1 -- 172.21.15.123:0/4215490277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f40c7930 con 0x7f01f41602d0 2024-09-13T17:09:19.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.067+0000 7f01f3fff700 1 -- 172.21.15.123:0/4215490277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f40cc7b0 con 0x7f01f41602d0 2024-09-13T17:09:19.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.071+0000 7f01eb7fe700 1 -- 172.21.15.123:0/4215490277 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f01ec012ca0 con 0x7f01f41602d0 2024-09-13T17:09:19.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.071+0000 7f01eb7fe700 1 --2- 172.21.15.123:0/4215490277 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f01d4066730 0x7f01d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.071+0000 7f01eb7fe700 1 -- 172.21.15.123:0/4215490277 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01ec084d90 con 0x7f01f41602d0 2024-09-13T17:09:19.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.071+0000 7f01f2ffd700 1 --2- 172.21.15.123:0/4215490277 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f01d4066730 0x7f01d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.071+0000 7f01f2ffd700 1 --2- 172.21.15.123:0/4215490277 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f01d4066730 0x7f01d4068bf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f01e400b370 tx=0x7f01e4009000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:19.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.079+0000 7f01eb7fe700 1 -- 172.21.15.123:0/4215490277 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f01ec052060 con 0x7f01f41602d0 2024-09-13T17:09:19.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.251+0000 7f01f3fff700 1 -- 172.21.15.123:0/4215490277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01f40d0370 con 0x7f01f41602d0 2024-09-13T17:09:19.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.255+0000 7f01eb7fe700 1 -- 172.21.15.123:0/4215490277 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f01ec055680 con 0x7f01f41602d0 2024-09-13T17:09:19.259 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:19.260 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":71,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:09:18.925481+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:17.328080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:17.920002+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:19.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.255+0000 7f01f3fff700 1 -- 172.21.15.123:0/4215490277 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f01d4066730 msgr2=0x7f01d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.255+0000 7f01f3fff700 1 --2- 172.21.15.123:0/4215490277 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f01d4066730 0x7f01d4068bf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f01e400b370 tx=0x7f01e4009000 comp rx=0 tx=0).stop 2024-09-13T17:09:19.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.255+0000 7f01f3fff700 1 -- 172.21.15.123:0/4215490277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f41602d0 msgr2=0x7f01f40c6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.255+0000 7f01f3fff700 1 --2- 172.21.15.123:0/4215490277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f41602d0 0x7f01f40c6bd0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00d800 tx=0x7f01ec00db10 comp rx=0 tx=0).stop 2024-09-13T17:09:19.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.259+0000 7f01f3fff700 1 -- 172.21.15.123:0/4215490277 shutdown_connections 2024-09-13T17:09:19.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.259+0000 7f01f3fff700 1 --2- 172.21.15.123:0/4215490277 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f01d4066730 0x7f01d4068bf0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.259+0000 7f01f3fff700 1 --2- 172.21.15.123:0/4215490277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f41602d0 0x7f01f40c6bd0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.259+0000 7f01f3fff700 1 --2- 172.21.15.123:0/4215490277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01f40d3680 0x7f01f40c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.259+0000 7f01f3fff700 1 --2- 172.21.15.123:0/4215490277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f01f40cf920 0x7f01f41f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.259+0000 7f01f3fff700 1 -- 172.21.15.123:0/4215490277 >> 172.21.15.123:0/4215490277 conn(0x7f01f40d2b60 msgr2=0x7f01f40702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:19.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.259+0000 7f01f3fff700 1 -- 172.21.15.123:0/4215490277 shutdown_connections 2024-09-13T17:09:19.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.259+0000 7f01f3fff700 1 -- 172.21.15.123:0/4215490277 wait complete. 2024-09-13T17:09:19.275 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:19.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.383+0000 7f739759e700 1 Processor -- start 2024-09-13T17:09:19.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.383+0000 7f739759e700 1 -- start start 2024-09-13T17:09:19.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.383+0000 7f739759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f73981598b0 0x7f7398071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.383+0000 7f739759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73980cdfd0 0x7f73980ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.383+0000 7f739759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739815d360 con 0x7f73980cebf0 2024-09-13T17:09:19.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.383+0000 7f739759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739815aca0 con 0x7f73981598b0 2024-09-13T17:09:19.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.383+0000 7f739759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73980cf060 con 0x7f73980cdfd0 2024-09-13T17:09:19.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.383+0000 7f7395d9b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73980cdfd0 0x7f73980ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.383+0000 7f7395d9b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73980cdfd0 0x7f73980ce6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:57004/0 (socket says 172.21.15.123:57004) 2024-09-13T17:09:19.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.383+0000 7f7395d9b700 1 -- 172.21.15.123:0/3936066643 learned_addr learned my addr 172.21.15.123:0/3936066643 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:19.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.383+0000 7f739659c700 1 --2- 172.21.15.123:0/3936066643 >> v2:172.21.15.153:3300/0 conn(0x7f73981598b0 0x7f7398071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.383+0000 7f739559a700 1 -- 172.21.15.123:0/3936066643 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081990663 0 0) 0x7f739815d360 con 0x7f73980cebf0 2024-09-13T17:09:19.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f7395d9b700 1 -- 172.21.15.123:0/3936066643 >> v2:172.21.15.153:3300/0 conn(0x7f73981598b0 msgr2=0x7f7398071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:19.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f7395d9b700 1 --2- 172.21.15.123:0/3936066643 >> v2:172.21.15.153:3300/0 conn(0x7f73981598b0 0x7f7398071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f7395d9b700 1 -- 172.21.15.123:0/3936066643 >> v1:172.21.15.153:6789/0 conn(0x7f73980cebf0 legacy=0x7f73980b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f7395d9b700 1 -- 172.21.15.123:0/3936066643 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73980ce3d0 con 0x7f73980cdfd0 2024-09-13T17:09:19.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f7395d9b700 1 --2- 172.21.15.123:0/3936066643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73980cdfd0 0x7f73980ce6b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7388009910 tx=0x7f7388009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=516536c9524c4cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:19.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f739559a700 1 -- 172.21.15.123:0/3936066643 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7388011830 con 0x7f73980cdfd0 2024-09-13T17:09:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f739559a700 1 -- 172.21.15.123:0/3936066643 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7388011990 con 0x7f73980cdfd0 2024-09-13T17:09:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f739559a700 1 -- 172.21.15.123:0/3936066643 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7388011d40 con 0x7f73980cdfd0 2024-09-13T17:09:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f739759e700 1 -- 172.21.15.123:0/3936066643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73980cdfd0 msgr2=0x7f73980ce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f739759e700 1 --2- 172.21.15.123:0/3936066643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73980cdfd0 0x7f73980ce6b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7388009910 tx=0x7f7388009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f739759e700 1 -- 172.21.15.123:0/3936066643 shutdown_connections 2024-09-13T17:09:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f739759e700 1 --2- 172.21.15.123:0/3936066643 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73980cdfd0 0x7f73980ce6b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f739759e700 1 --2- 172.21.15.123:0/3936066643 >> v2:172.21.15.153:3300/0 conn(0x7f73981598b0 0x7f7398071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f739759e700 1 -- 172.21.15.123:0/3936066643 >> 172.21.15.123:0/3936066643 conn(0x7f7398066150 msgr2=0x7f7398066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f739759e700 1 -- 172.21.15.123:0/3936066643 shutdown_connections 2024-09-13T17:09:19.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f739759e700 1 -- 172.21.15.123:0/3936066643 wait complete. 2024-09-13T17:09:19.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f739759e700 1 Processor -- start 2024-09-13T17:09:19.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.387+0000 7f739759e700 1 -- start start 2024-09-13T17:09:19.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f739759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73980cdfd0 0x7f7398150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f739759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73980cebf0 0x7f73981503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f739759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73981598b0 0x7f7398157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f739759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7398156cc0 con 0x7f73980cebf0 2024-09-13T17:09:19.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f739759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7398157040 con 0x7f73981598b0 2024-09-13T17:09:19.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f739759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7398156140 con 0x7f73980cdfd0 2024-09-13T17:09:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f7395d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73980cebf0 0x7f73981503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f7396d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73981598b0 0x7f7398157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f7395d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73980cebf0 0x7f73981503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47412/0 (socket says 172.21.15.123:47412) 2024-09-13T17:09:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f7396d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73981598b0 0x7f7398157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:55066/0 (socket says 172.21.15.123:55066) 2024-09-13T17:09:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f7395d9b700 1 -- 172.21.15.123:0/3550819732 learned_addr learned my addr 172.21.15.123:0/3550819732 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f739659c700 1 --2- 172.21.15.123:0/3550819732 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73980cdfd0 0x7f7398150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f7395d9b700 1 -- 172.21.15.123:0/3550819732 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73980cdfd0 msgr2=0x7f7398150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f7395d9b700 1 --2- 172.21.15.123:0/3550819732 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73980cdfd0 0x7f7398150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f7395d9b700 1 -- 172.21.15.123:0/3550819732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73981598b0 msgr2=0x7f7398157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f7395d9b700 1 --2- 172.21.15.123:0/3550819732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73981598b0 0x7f7398157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f7395d9b700 1 -- 172.21.15.123:0/3550819732 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388009570 con 0x7f73980cebf0 2024-09-13T17:09:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f7395d9b700 1 --2- 172.21.15.123:0/3550819732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73980cebf0 0x7f73981503f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7388009f70 tx=0x7f7388004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:19.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f738effd700 1 -- 172.21.15.123:0/3550819732 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738801a900 con 0x7f73980cebf0 2024-09-13T17:09:19.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f738effd700 1 -- 172.21.15.123:0/3550819732 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738801f070 con 0x7f73980cebf0 2024-09-13T17:09:19.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f739759e700 1 -- 172.21.15.123:0/3550819732 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7398156420 con 0x7f73980cebf0 2024-09-13T17:09:19.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f738effd700 1 -- 172.21.15.123:0/3550819732 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738801acc0 con 0x7f73980cebf0 2024-09-13T17:09:19.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f739759e700 1 -- 172.21.15.123:0/3550819732 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73981569e0 con 0x7f73980cebf0 2024-09-13T17:09:19.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.391+0000 7f739759e700 1 -- 172.21.15.123:0/3550819732 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73980677f0 con 0x7f73980cebf0 2024-09-13T17:09:19.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.395+0000 7f738effd700 1 -- 172.21.15.123:0/3550819732 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f738801b430 con 0x7f73980cebf0 2024-09-13T17:09:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.395+0000 7f738effd700 1 --2- 172.21.15.123:0/3550819732 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7378066730 0x7f7378068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.395+0000 7f738effd700 1 -- 172.21.15.123:0/3550819732 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7388021070 con 0x7f73980cebf0 2024-09-13T17:09:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.395+0000 7f739659c700 1 --2- 172.21.15.123:0/3550819732 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7378066730 0x7f7378068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.395+0000 7f739659c700 1 --2- 172.21.15.123:0/3550819732 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7378066730 0x7f7378068bf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f73980cbe80 tx=0x7f7380009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.403+0000 7f738effd700 1 -- 172.21.15.123:0/3550819732 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7388052da0 con 0x7f73980cebf0 2024-09-13T17:09:19.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.575+0000 7f739759e700 1 -- 172.21.15.123:0/3550819732 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7398156ea0 con 0x7f73980cebf0 2024-09-13T17:09:19.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.579+0000 7f738effd700 1 -- 172.21.15.123:0/3550819732 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f738807de60 con 0x7f73980cebf0 2024-09-13T17:09:19.584 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:19.584 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":71,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:09:18.925481+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:17.328080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:17.920002+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.583+0000 7f739759e700 1 -- 172.21.15.123:0/3550819732 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7378066730 msgr2=0x7f7378068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.583+0000 7f739759e700 1 --2- 172.21.15.123:0/3550819732 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7378066730 0x7f7378068bf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f73980cbe80 tx=0x7f7380009240 comp rx=0 tx=0).stop 2024-09-13T17:09:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.583+0000 7f739759e700 1 -- 172.21.15.123:0/3550819732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73980cebf0 msgr2=0x7f73981503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.583+0000 7f739759e700 1 --2- 172.21.15.123:0/3550819732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73980cebf0 0x7f73981503f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7388009f70 tx=0x7f7388004770 comp rx=0 tx=0).stop 2024-09-13T17:09:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.583+0000 7f739759e700 1 -- 172.21.15.123:0/3550819732 shutdown_connections 2024-09-13T17:09:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.583+0000 7f739759e700 1 --2- 172.21.15.123:0/3550819732 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7378066730 0x7f7378068bf0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.583+0000 7f739759e700 1 --2- 172.21.15.123:0/3550819732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73981598b0 0x7f7398157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.583+0000 7f739759e700 1 --2- 172.21.15.123:0/3550819732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73980cebf0 0x7f73981503f0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.583+0000 7f739759e700 1 --2- 172.21.15.123:0/3550819732 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73980cdfd0 0x7f7398150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.583+0000 7f739759e700 1 -- 172.21.15.123:0/3550819732 >> 172.21.15.123:0/3550819732 conn(0x7f7398066150 msgr2=0x7f739815a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:19.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.583+0000 7f739759e700 1 -- 172.21.15.123:0/3550819732 shutdown_connections 2024-09-13T17:09:19.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.583+0000 7f739759e700 1 -- 172.21.15.123:0/3550819732 wait complete. 2024-09-13T17:09:19.599 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:09:19.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac6149700 1 Processor -- start 2024-09-13T17:09:19.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac6149700 1 -- start start 2024-09-13T17:09:19.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac6149700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0ac00ce790 0x7f0ac006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac6149700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ac00ceb70 0x7f0ac00af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac6149700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac00cf740 con 0x7f0ac00cd2b0 2024-09-13T17:09:19.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac6149700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac00b61f0 con 0x7f0ac00ce790 2024-09-13T17:09:19.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac6149700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00cb2c0 con 0x7f0ac00ceb70 2024-09-13T17:09:19.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac4946700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0ac00cd2b0 0x7f0ac015a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32924/0 (socket says 172.21.15.123:32924) 2024-09-13T17:09:19.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac4946700 1 -- 172.21.15.123:0/507483120 learned_addr learned my addr 172.21.15.123:0/507483120 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:19.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac5147700 1 --2- 172.21.15.123:0/507483120 >> v2:172.21.15.153:3300/0 conn(0x7f0ac00ce790 0x7f0ac006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac5948700 1 --2- 172.21.15.123:0/507483120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ac00ceb70 0x7f0ac00af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 -- 172.21.15.123:0/507483120 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663905759 0 0) 0x7f0ac00cf740 con 0x7f0ac00cd2b0 2024-09-13T17:09:19.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 -- 172.21.15.123:0/507483120 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aac0035d0 con 0x7f0ac00cd2b0 2024-09-13T17:09:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 -- 172.21.15.123:0/507483120 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2639535647 0 0) 0x7f0aac0035d0 con 0x7f0ac00cd2b0 2024-09-13T17:09:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 -- 172.21.15.123:0/507483120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ac00ceb70 msgr2=0x7f0ac00af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 --2- 172.21.15.123:0/507483120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ac00ceb70 0x7f0ac00af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 -- 172.21.15.123:0/507483120 >> v2:172.21.15.153:3300/0 conn(0x7f0ac00ce790 msgr2=0x7f0ac006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 --2- 172.21.15.123:0/507483120 >> v2:172.21.15.153:3300/0 conn(0x7f0ac00ce790 0x7f0ac006bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 -- 172.21.15.123:0/507483120 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac006c1b0 con 0x7f0ac00cd2b0 2024-09-13T17:09:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 -- 172.21.15.123:0/507483120 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f0abc001670 con 0x7f0ac00cd2b0 2024-09-13T17:09:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 -- 172.21.15.123:0/507483120 >> v1:172.21.15.123:6789/0 conn(0x7f0ac00cd2b0 legacy=0x7f0ac015a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 --2- 172.21.15.123:0/507483120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0aac003a20 0x7f0aac003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 --2- 172.21.15.123:0/507483120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ac00ceb70 0x7f0aac004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 --2- 172.21.15.123:0/507483120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0aac004db0 0x7f0aac005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 -- 172.21.15.123:0/507483120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00b61f0 con 0x7f0aac003a20 2024-09-13T17:09:19.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 -- 172.21.15.123:0/507483120 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00cb2c0 con 0x7f0aac004db0 2024-09-13T17:09:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ab3fff700 1 -- 172.21.15.123:0/507483120 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac00ba30 con 0x7f0ac00ceb70 2024-09-13T17:09:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac5147700 1 --2- 172.21.15.123:0/507483120 >> v2:172.21.15.153:3300/0 conn(0x7f0ac00ce790 0x7f0ac006bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac5147700 1 --2- 172.21.15.123:0/507483120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0aac003a20 0x7f0aac003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac4946700 1 --2- 172.21.15.123:0/507483120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ac00ceb70 0x7f0aac004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac5948700 1 --2- 172.21.15.123:0/507483120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0aac004db0 0x7f0aac005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac5147700 1 -- 172.21.15.123:0/507483120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ac00ceb70 msgr2=0x7f0aac004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac5147700 1 --2- 172.21.15.123:0/507483120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ac00ceb70 0x7f0aac004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac5147700 1 -- 172.21.15.123:0/507483120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0aac004db0 msgr2=0x7f0aac005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac5147700 1 --2- 172.21.15.123:0/507483120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0aac004db0 0x7f0aac005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac5147700 1 -- 172.21.15.123:0/507483120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac0035d0 con 0x7f0aac003a20 2024-09-13T17:09:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac5948700 1 --2- 172.21.15.123:0/507483120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0aac004db0 0x7f0aac005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.707+0000 7f0ac5147700 1 --2- 172.21.15.123:0/507483120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0aac003a20 0x7f0aac003e40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009d50 tx=0x7f0aac0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f3d39109c0be38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:19.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.711+0000 7f0ab3fff700 1 -- 172.21.15.123:0/507483120 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4009ea0 con 0x7f0aac003a20 2024-09-13T17:09:19.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.711+0000 7f0ab3fff700 1 -- 172.21.15.123:0/507483120 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab400e9a0 con 0x7f0aac003a20 2024-09-13T17:09:19.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.711+0000 7f0ab3fff700 1 -- 172.21.15.123:0/507483120 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab400ed10 con 0x7f0aac003a20 2024-09-13T17:09:19.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.711+0000 7f0ac6149700 1 -- 172.21.15.123:0/507483120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0aac003a20 msgr2=0x7f0aac003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.711+0000 7f0ac6149700 1 --2- 172.21.15.123:0/507483120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0aac003a20 0x7f0aac003e40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009d50 tx=0x7f0aac0058a0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.711+0000 7f0ac5948700 1 -- 172.21.15.123:0/507483120 reap_dead start 2024-09-13T17:09:19.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.711+0000 7f0ac6149700 1 -- 172.21.15.123:0/507483120 shutdown_connections 2024-09-13T17:09:19.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.711+0000 7f0ac6149700 1 -- 172.21.15.123:0/507483120 >> 172.21.15.123:0/507483120 conn(0x7f0ac006e090 msgr2=0x7f0ac006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:19.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.711+0000 7f0ac6149700 1 -- 172.21.15.123:0/507483120 shutdown_connections 2024-09-13T17:09:19.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.711+0000 7f0ac6149700 1 -- 172.21.15.123:0/507483120 wait complete. 2024-09-13T17:09:19.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac6149700 1 Processor -- start 2024-09-13T17:09:19.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac6149700 1 -- start start 2024-09-13T17:09:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac6149700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac01f42e0 0x7f0ac014dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac6149700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ac00aa4c0 0x7f0ac01f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac6149700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ac01f4c00 0x7f0ac00af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac6149700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac014e160 con 0x7f0ac01f42e0 2024-09-13T17:09:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac6149700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac014e400 con 0x7f0ac01f4c00 2024-09-13T17:09:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac6149700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac014e6e0 con 0x7f0ac00aa4c0 2024-09-13T17:09:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac5147700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac01f42e0 0x7f0ac014dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac5147700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac01f42e0 0x7f0ac014dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47438/0 (socket says 172.21.15.123:47438) 2024-09-13T17:09:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac5147700 1 -- 172.21.15.123:0/1954340617 learned_addr learned my addr 172.21.15.123:0/1954340617 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac5948700 1 --2- 172.21.15.123:0/1954340617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ac01f4c00 0x7f0ac00af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac4946700 1 --2- 172.21.15.123:0/1954340617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ac00aa4c0 0x7f0ac01f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac5147700 1 -- 172.21.15.123:0/1954340617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ac00aa4c0 msgr2=0x7f0ac01f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac5147700 1 --2- 172.21.15.123:0/1954340617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ac00aa4c0 0x7f0ac01f46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac5147700 1 -- 172.21.15.123:0/1954340617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ac01f4c00 msgr2=0x7f0ac00af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac5147700 1 --2- 172.21.15.123:0/1954340617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ac01f4c00 0x7f0ac00af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac5147700 1 -- 172.21.15.123:0/1954340617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac014e9c0 con 0x7f0ac01f42e0 2024-09-13T17:09:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac5147700 1 --2- 172.21.15.123:0/1954340617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac01f42e0 0x7f0ac014dc20 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4004000 tx=0x7f0ab40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ab1ffb700 1 -- 172.21.15.123:0/1954340617 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4021070 con 0x7f0ac01f42e0 2024-09-13T17:09:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ab1ffb700 1 -- 172.21.15.123:0/1954340617 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab4009ea0 con 0x7f0ac01f42e0 2024-09-13T17:09:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac6149700 1 -- 172.21.15.123:0/1954340617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac00b13f0 con 0x7f0ac01f42e0 2024-09-13T17:09:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ab1ffb700 1 -- 172.21.15.123:0/1954340617 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4003af0 con 0x7f0ac01f42e0 2024-09-13T17:09:19.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.715+0000 7f0ac6149700 1 -- 172.21.15.123:0/1954340617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac00af5d0 con 0x7f0ac01f42e0 2024-09-13T17:09:19.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.719+0000 7f0ac6149700 1 -- 172.21.15.123:0/1954340617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac006bc70 con 0x7f0ac01f42e0 2024-09-13T17:09:19.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.719+0000 7f0ab1ffb700 1 -- 172.21.15.123:0/1954340617 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ab4003c50 con 0x7f0ac01f42e0 2024-09-13T17:09:19.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.719+0000 7f0ab1ffb700 1 --2- 172.21.15.123:0/1954340617 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0aa4066730 0x7f0aa4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:19.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.719+0000 7f0ab1ffb700 1 -- 172.21.15.123:0/1954340617 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ab4085550 con 0x7f0ac01f42e0 2024-09-13T17:09:19.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.719+0000 7f0ac4946700 1 --2- 172.21.15.123:0/1954340617 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0aa4066730 0x7f0aa4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:19.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.723+0000 7f0ac4946700 1 --2- 172.21.15.123:0/1954340617 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0aa4066730 0x7f0aa4068bf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0abc001eb0 tx=0x7f0abc009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:19.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.727+0000 7f0ab1ffb700 1 -- 172.21.15.123:0/1954340617 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0ab4052b90 con 0x7f0ac01f42e0 2024-09-13T17:09:19.874 INFO:tasks.ceph.mds.b.smithi153.stderr:2024-09-13T17:09:19.869+0000 7fb57a80d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:09:19.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:19.939+0000 7f0ac6149700 1 -- 172.21.15.123:0/1954340617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0ac014e160 con 0x7f0ac01f42e0 2024-09-13T17:09:20.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:20.935+0000 7f0ab1ffb700 1 -- 172.21.15.123:0/1954340617 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0ab4056170 con 0x7f0ac01f42e0 2024-09-13T17:09:20.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:20.943+0000 7f0ac6149700 1 -- 172.21.15.123:0/1954340617 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0aa4066730 msgr2=0x7f0aa4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:20.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:20.943+0000 7f0ac6149700 1 --2- 172.21.15.123:0/1954340617 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0aa4066730 0x7f0aa4068bf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0abc001eb0 tx=0x7f0abc009040 comp rx=0 tx=0).stop 2024-09-13T17:09:20.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:20.943+0000 7f0ac6149700 1 -- 172.21.15.123:0/1954340617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac01f42e0 msgr2=0x7f0ac014dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:20.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:20.943+0000 7f0ac6149700 1 --2- 172.21.15.123:0/1954340617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac01f42e0 0x7f0ac014dc20 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4004000 tx=0x7f0ab40047e0 comp rx=0 tx=0).stop 2024-09-13T17:09:20.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:20.943+0000 7f0ac6149700 1 -- 172.21.15.123:0/1954340617 shutdown_connections 2024-09-13T17:09:20.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:20.943+0000 7f0ac6149700 1 --2- 172.21.15.123:0/1954340617 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0aa4066730 0x7f0aa4068bf0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:20.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:20.943+0000 7f0ac6149700 1 --2- 172.21.15.123:0/1954340617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ac01f4c00 0x7f0ac00af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:20.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:20.943+0000 7f0ac6149700 1 --2- 172.21.15.123:0/1954340617 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0ac00aa4c0 0x7f0ac01f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:20.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:20.943+0000 7f0ac6149700 1 --2- 172.21.15.123:0/1954340617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac01f42e0 0x7f0ac014dc20 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:20.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:20.943+0000 7f0ac6149700 1 -- 172.21.15.123:0/1954340617 >> 172.21.15.123:0/1954340617 conn(0x7f0ac006e090 msgr2=0x7f0ac006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:20.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:20.943+0000 7f0ac6149700 1 -- 172.21.15.123:0/1954340617 shutdown_connections 2024-09-13T17:09:20.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:20.943+0000 7f0ac6149700 1 -- 172.21.15.123:0/1954340617 wait complete. 2024-09-13T17:09:20.965 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:09:20.965 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:09:21.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.087+0000 7f4956f18700 1 Processor -- start 2024-09-13T17:09:21.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.087+0000 7f4956f18700 1 -- start start 2024-09-13T17:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956f18700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49501592e0 0x7f495015d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956f18700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f495006dc90 0x7f4950070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956f18700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49500cd2e0 con 0x7f49501596c0 2024-09-13T17:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956f18700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49500cd5c0 con 0x7f495006dc90 2024-09-13T17:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956f18700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49500cd8a0 con 0x7f49501592e0 2024-09-13T17:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956717700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f495006dc90 0x7f4950070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4955715700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f49501596c0 0x7f495015d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:32938/0 (socket says 172.21.15.123:32938) 2024-09-13T17:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4955715700 1 -- 172.21.15.123:0/936820678 learned_addr learned my addr 172.21.15.123:0/936820678 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4955f16700 1 --2- 172.21.15.123:0/936820678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49501592e0 0x7f495015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956717700 1 -- 172.21.15.123:0/936820678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49501592e0 msgr2=0x7f495015d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956717700 1 --2- 172.21.15.123:0/936820678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49501592e0 0x7f495015d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956717700 1 -- 172.21.15.123:0/936820678 >> v1:172.21.15.123:6789/0 conn(0x7f49501596c0 legacy=0x7f495015d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956717700 1 -- 172.21.15.123:0/936820678 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49500cdb80 con 0x7f495006dc90 2024-09-13T17:09:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4954f14700 1 -- 172.21.15.123:0/936820678 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837791741 0 0) 0x7f49500cd2e0 con 0x7f49501596c0 2024-09-13T17:09:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956717700 1 --2- 172.21.15.123:0/936820678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f495006dc90 0x7f4950070e50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f494800aea0 tx=0x7f494800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e50f32c6fd7da2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4954f14700 1 -- 172.21.15.123:0/936820678 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494800f070 con 0x7f495006dc90 2024-09-13T17:09:21.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4954f14700 1 -- 172.21.15.123:0/936820678 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494800a2e0 con 0x7f495006dc90 2024-09-13T17:09:21.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4954f14700 1 -- 172.21.15.123:0/936820678 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494800cb50 con 0x7f495006dc90 2024-09-13T17:09:21.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956f18700 1 -- 172.21.15.123:0/936820678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f495006dc90 msgr2=0x7f4950070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:21.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956f18700 1 --2- 172.21.15.123:0/936820678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f495006dc90 0x7f4950070e50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f494800aea0 tx=0x7f494800c330 comp rx=0 tx=0).stop 2024-09-13T17:09:21.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956f18700 1 -- 172.21.15.123:0/936820678 shutdown_connections 2024-09-13T17:09:21.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956f18700 1 --2- 172.21.15.123:0/936820678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f495006dc90 0x7f4950070e50 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:21.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956f18700 1 --2- 172.21.15.123:0/936820678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49501592e0 0x7f495015d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:21.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956f18700 1 -- 172.21.15.123:0/936820678 >> 172.21.15.123:0/936820678 conn(0x7f49500b01d0 msgr2=0x7f49500b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:21.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956f18700 1 -- 172.21.15.123:0/936820678 shutdown_connections 2024-09-13T17:09:21.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.091+0000 7f4956f18700 1 -- 172.21.15.123:0/936820678 wait complete. 2024-09-13T17:09:21.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.095+0000 7f4956f18700 1 Processor -- start 2024-09-13T17:09:21.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.095+0000 7f4956f18700 1 -- start start 2024-09-13T17:09:21.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.095+0000 7f4956f18700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f495006dc90 0x7f49500c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:21.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.095+0000 7f4956f18700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49501592e0 0x7f49500c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:21.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.095+0000 7f4956f18700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49501596c0 0x7f49500c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:21.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.095+0000 7f4956f18700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49500c3800 con 0x7f49501596c0 2024-09-13T17:09:21.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.095+0000 7f4956f18700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49500c3ae0 con 0x7f495006dc90 2024-09-13T17:09:21.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.095+0000 7f4956f18700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49500c3dc0 con 0x7f49501592e0 2024-09-13T17:09:21.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.095+0000 7f4956717700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49501596c0 0x7f49500c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:21.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.095+0000 7f4956717700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49501596c0 0x7f49500c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47444/0 (socket says 172.21.15.123:47444) 2024-09-13T17:09:21.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.095+0000 7f4956717700 1 -- 172.21.15.123:0/3185908292 learned_addr learned my addr 172.21.15.123:0/3185908292 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:21.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.095+0000 7f4955f16700 1 --2- 172.21.15.123:0/3185908292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f495006dc90 0x7f49500c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:21.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.095+0000 7f4955715700 1 --2- 172.21.15.123:0/3185908292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49501592e0 0x7f49500c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:21.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f4956717700 1 -- 172.21.15.123:0/3185908292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49501592e0 msgr2=0x7f49500c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:21.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f4956717700 1 --2- 172.21.15.123:0/3185908292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49501592e0 0x7f49500c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:21.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f4956717700 1 -- 172.21.15.123:0/3185908292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f495006dc90 msgr2=0x7f49500c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:21.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f4956717700 1 --2- 172.21.15.123:0/3185908292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f495006dc90 0x7f49500c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:21.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f4956717700 1 -- 172.21.15.123:0/3185908292 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494800ab80 con 0x7f49501596c0 2024-09-13T17:09:21.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f4956717700 1 --2- 172.21.15.123:0/3185908292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49501596c0 0x7f49500c5750 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f494800a470 tx=0x7f4948004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:21.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f49467fc700 1 -- 172.21.15.123:0/3185908292 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948004450 con 0x7f49501596c0 2024-09-13T17:09:21.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f49467fc700 1 -- 172.21.15.123:0/3185908292 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49480045d0 con 0x7f49501596c0 2024-09-13T17:09:21.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f4956f18700 1 -- 172.21.15.123:0/3185908292 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49500c40a0 con 0x7f49501596c0 2024-09-13T17:09:21.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f49467fc700 1 -- 172.21.15.123:0/3185908292 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948004980 con 0x7f49501596c0 2024-09-13T17:09:21.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f4956f18700 1 -- 172.21.15.123:0/3185908292 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49500c7bb0 con 0x7f49501596c0 2024-09-13T17:09:21.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f4956f18700 1 -- 172.21.15.123:0/3185908292 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49500c4560 con 0x7f49501596c0 2024-09-13T17:09:21.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f49467fc700 1 -- 172.21.15.123:0/3185908292 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f494801c420 con 0x7f49501596c0 2024-09-13T17:09:21.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f49467fc700 1 --2- 172.21.15.123:0/3185908292 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4934066730 0x7f4934068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:21.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f49467fc700 1 -- 172.21.15.123:0/3185908292 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4948085880 con 0x7f49501596c0 2024-09-13T17:09:21.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.099+0000 7f4955f16700 1 --2- 172.21.15.123:0/3185908292 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4934066730 0x7f4934068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:21.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.103+0000 7f4955f16700 1 --2- 172.21.15.123:0/3185908292 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4934066730 0x7f4934068bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f494c009b50 tx=0x7f494c009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:21.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.107+0000 7f49467fc700 1 -- 172.21.15.123:0/3185908292 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4948052c80 con 0x7f49501596c0 2024-09-13T17:09:21.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.311+0000 7f4956f18700 1 -- 172.21.15.123:0/3185908292 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f49500cb100 con 0x7f49501596c0 2024-09-13T17:09:21.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.938+0000 7f49467fc700 1 -- 172.21.15.123:0/3185908292 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 122+0+0 (secure 0 0 0) 0x7f49480562a0 con 0x7f49501596c0 2024-09-13T17:09:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.942+0000 7f4956f18700 1 -- 172.21.15.123:0/3185908292 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4934066730 msgr2=0x7f4934068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.942+0000 7f4956f18700 1 --2- 172.21.15.123:0/3185908292 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4934066730 0x7f4934068bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f494c009b50 tx=0x7f494c009240 comp rx=0 tx=0).stop 2024-09-13T17:09:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.942+0000 7f4956f18700 1 -- 172.21.15.123:0/3185908292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49501596c0 msgr2=0x7f49500c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.942+0000 7f4956f18700 1 --2- 172.21.15.123:0/3185908292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49501596c0 0x7f49500c5750 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f494800a470 tx=0x7f4948004af0 comp rx=0 tx=0).stop 2024-09-13T17:09:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.942+0000 7f4956f18700 1 -- 172.21.15.123:0/3185908292 shutdown_connections 2024-09-13T17:09:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.942+0000 7f4956f18700 1 --2- 172.21.15.123:0/3185908292 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4934066730 0x7f4934068bf0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.942+0000 7f4956f18700 1 --2- 172.21.15.123:0/3185908292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49501596c0 0x7f49500c5750 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.942+0000 7f4956f18700 1 --2- 172.21.15.123:0/3185908292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49501592e0 0x7f49500c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.942+0000 7f4956f18700 1 --2- 172.21.15.123:0/3185908292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f495006dc90 0x7f49500c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.942+0000 7f4956f18700 1 -- 172.21.15.123:0/3185908292 >> 172.21.15.123:0/3185908292 conn(0x7f49500b01d0 msgr2=0x7f49500ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.942+0000 7f4956f18700 1 -- 172.21.15.123:0/3185908292 shutdown_connections 2024-09-13T17:09:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:21.942+0000 7f4956f18700 1 -- 172.21.15.123:0/3185908292 wait complete. 2024-09-13T17:09:21.968 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:09:21.969 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:09:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.082+0000 7f5dbd2a3700 1 Processor -- start 2024-09-13T17:09:22.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.082+0000 7f5dbd2a3700 1 -- start start 2024-09-13T17:09:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbd2a3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5db815ca90 0x7f5db806e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbd2a3700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5db80b3170 0x7f5db8071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbd2a3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db806ec70 con 0x7f5db815ce70 2024-09-13T17:09:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbd2a3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db815dae0 con 0x7f5db815ca90 2024-09-13T17:09:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbd2a3700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db80ce830 con 0x7f5db80b3170 2024-09-13T17:09:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5db7fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5db815ca90 0x7f5db806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbcaa2700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5db815ce70 0x7f5db80d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38118/0 (socket says 172.21.15.123:38118) 2024-09-13T17:09:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbcaa2700 1 -- 172.21.15.123:0/699338101 learned_addr learned my addr 172.21.15.123:0/699338101 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:22.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5db77fe700 1 --2- 172.21.15.123:0/699338101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5db80b3170 0x7f5db8071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5db6ffd700 1 -- 172.21.15.123:0/699338101 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390765313 0 0) 0x7f5db806ec70 con 0x7f5db815ce70 2024-09-13T17:09:22.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5db6ffd700 1 -- 172.21.15.123:0/699338101 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5da00035d0 con 0x7f5db815ce70 2024-09-13T17:09:22.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5db7fff700 1 -- 172.21.15.123:0/699338101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5db80b3170 msgr2=0x7f5db8071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:22.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5db6ffd700 1 -- 172.21.15.123:0/699338101 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 600257924 0 0) 0x7f5da00035d0 con 0x7f5db815ce70 2024-09-13T17:09:22.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5db7fff700 1 --2- 172.21.15.123:0/699338101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5db80b3170 0x7f5db8071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5db7fff700 1 -- 172.21.15.123:0/699338101 >> v1:172.21.15.123:6789/0 conn(0x7f5db815ce70 legacy=0x7f5db80d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5db7fff700 1 -- 172.21.15.123:0/699338101 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db815d420 con 0x7f5db815ca90 2024-09-13T17:09:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5db77fe700 1 --2- 172.21.15.123:0/699338101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5db80b3170 0x7f5db8071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5db7fff700 1 --2- 172.21.15.123:0/699338101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5db815ca90 0x7f5db806e440 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009850 tx=0x7f5dac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b51fea5db40b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5db6ffd700 1 -- 172.21.15.123:0/699338101 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db00019f0 con 0x7f5db815ca90 2024-09-13T17:09:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5db6ffd700 1 -- 172.21.15.123:0/699338101 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dac004030 con 0x7f5db815ca90 2024-09-13T17:09:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5db6ffd700 1 -- 172.21.15.123:0/699338101 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0043e0 con 0x7f5db815ca90 2024-09-13T17:09:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/699338101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5db815ca90 msgr2=0x7f5db806e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbd2a3700 1 --2- 172.21.15.123:0/699338101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5db815ca90 0x7f5db806e440 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009850 tx=0x7f5dac009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/699338101 shutdown_connections 2024-09-13T17:09:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbd2a3700 1 --2- 172.21.15.123:0/699338101 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5db80b3170 0x7f5db8071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbd2a3700 1 --2- 172.21.15.123:0/699338101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5db815ca90 0x7f5db806e440 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/699338101 >> 172.21.15.123:0/699338101 conn(0x7f5db806a650 msgr2=0x7f5db806aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/699338101 shutdown_connections 2024-09-13T17:09:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.086+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/699338101 wait complete. 2024-09-13T17:09:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5dbd2a3700 1 Processor -- start 2024-09-13T17:09:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5dbd2a3700 1 -- start start 2024-09-13T17:09:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5dbd2a3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db80b3170 0x7f5db814dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5dbd2a3700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5db815ca90 0x7f5db815fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5dbd2a3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5db815ce70 0x7f5db80c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5dbd2a3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db815f8b0 con 0x7f5db815ce70 2024-09-13T17:09:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5dbd2a3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db815ef80 con 0x7f5db80b3170 2024-09-13T17:09:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5dbd2a3700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db815f260 con 0x7f5db815ca90 2024-09-13T17:09:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5dbcaa2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5db815ce70 0x7f5db80c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5dbcaa2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5db815ce70 0x7f5db80c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52730/0 (socket says 172.21.15.123:52730) 2024-09-13T17:09:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5db77fe700 1 --2- 172.21.15.123:0/1327482147 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5db815ca90 0x7f5db815fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5dbcaa2700 1 -- 172.21.15.123:0/1327482147 learned_addr learned my addr 172.21.15.123:0/1327482147 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5db7fff700 1 --2- 172.21.15.123:0/1327482147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db80b3170 0x7f5db814dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5db77fe700 1 -- 172.21.15.123:0/1327482147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db80b3170 msgr2=0x7f5db814dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5db77fe700 1 --2- 172.21.15.123:0/1327482147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db80b3170 0x7f5db814dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5db77fe700 1 -- 172.21.15.123:0/1327482147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5db815ce70 msgr2=0x7f5db80c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5db77fe700 1 --2- 172.21.15.123:0/1327482147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5db815ce70 0x7f5db80c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.090+0000 7f5db77fe700 1 -- 172.21.15.123:0/1327482147 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da80094b0 con 0x7f5db815ca90 2024-09-13T17:09:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.094+0000 7f5db77fe700 1 --2- 172.21.15.123:0/1327482147 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5db815ca90 0x7f5db815fd40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5db80d08b0 tx=0x7f5da800ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.094+0000 7f5db4ff9700 1 -- 172.21.15.123:0/1327482147 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8013680 con 0x7f5db815ca90 2024-09-13T17:09:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.094+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/1327482147 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dac0094b0 con 0x7f5db815ca90 2024-09-13T17:09:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.094+0000 7f5db4ff9700 1 -- 172.21.15.123:0/1327482147 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da80137e0 con 0x7f5db815ca90 2024-09-13T17:09:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.094+0000 7f5db4ff9700 1 -- 172.21.15.123:0/1327482147 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8013b90 con 0x7f5db815ca90 2024-09-13T17:09:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.094+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/1327482147 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db815ec70 con 0x7f5db815ca90 2024-09-13T17:09:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.094+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/1327482147 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db80677f0 con 0x7f5db815ca90 2024-09-13T17:09:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.098+0000 7f5db4ff9700 1 -- 172.21.15.123:0/1327482147 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5da8013cf0 con 0x7f5db815ca90 2024-09-13T17:09:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.098+0000 7f5db4ff9700 1 --2- 172.21.15.123:0/1327482147 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5da4066730 0x7f5da4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.098+0000 7f5db4ff9700 1 -- 172.21.15.123:0/1327482147 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5da80848b0 con 0x7f5db815ca90 2024-09-13T17:09:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.098+0000 7f5db7fff700 1 --2- 172.21.15.123:0/1327482147 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5da4066730 0x7f5da4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.098+0000 7f5db7fff700 1 --2- 172.21.15.123:0/1327482147 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5da4066730 0x7f5da4068bf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0090b0 tx=0x7f5dac008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:22.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.106+0000 7f5db4ff9700 1 -- 172.21.15.123:0/1327482147 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5da8051c20 con 0x7f5db815ca90 2024-09-13T17:09:22.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.314+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/1327482147 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5db806e440 con 0x7f5db815ca90 2024-09-13T17:09:22.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.314+0000 7f5db4ff9700 1 -- 172.21.15.123:0/1327482147 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f5da8055240 con 0x7f5db815ca90 2024-09-13T17:09:22.320 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:22.321 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3155329877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3155329877},{"type":"v1","addr":"172.21.15.153:6835","nonce":3155329877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6522,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3484528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3484528665},{"type":"v1","addr":"172.21.15.123:6835","nonce":3484528665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6525,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/4217126083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":4217126083},{"type":"v1","addr":"172.21.15.123:6837","nonce":4217126083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:09:18.926234+0000","modified":"2024-09-13T17:09:21.936807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6534":{"gid":6534,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6833/1222139823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1222139823},{"type":"v1","addr":"172.21.15.153:6833","nonce":1222139823}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T17:09:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.318+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/1327482147 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5da4066730 msgr2=0x7f5da4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.318+0000 7f5dbd2a3700 1 --2- 172.21.15.123:0/1327482147 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5da4066730 0x7f5da4068bf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0090b0 tx=0x7f5dac008030 comp rx=0 tx=0).stop 2024-09-13T17:09:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.318+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/1327482147 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5db815ca90 msgr2=0x7f5db815fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.318+0000 7f5dbd2a3700 1 --2- 172.21.15.123:0/1327482147 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5db815ca90 0x7f5db815fd40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5db80d08b0 tx=0x7f5da800ec60 comp rx=0 tx=0).stop 2024-09-13T17:09:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.318+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/1327482147 shutdown_connections 2024-09-13T17:09:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.318+0000 7f5dbd2a3700 1 --2- 172.21.15.123:0/1327482147 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5da4066730 0x7f5da4068bf0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.318+0000 7f5dbd2a3700 1 --2- 172.21.15.123:0/1327482147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5db815ce70 0x7f5db80c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.318+0000 7f5dbd2a3700 1 --2- 172.21.15.123:0/1327482147 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5db815ca90 0x7f5db815fd40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.318+0000 7f5dbd2a3700 1 --2- 172.21.15.123:0/1327482147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db80b3170 0x7f5db814dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.318+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/1327482147 >> 172.21.15.123:0/1327482147 conn(0x7f5db806a650 msgr2=0x7f5db80d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:22.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.318+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/1327482147 shutdown_connections 2024-09-13T17:09:22.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.318+0000 7f5dbd2a3700 1 -- 172.21.15.123:0/1327482147 wait complete. 2024-09-13T17:09:22.324 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 35 2024-09-13T17:09:22.335 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:22.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f5765b3f700 1 Processor -- start 2024-09-13T17:09:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f5765b3f700 1 -- start start 2024-09-13T17:09:22.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f5765b3f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f576013e200 0x7f576006ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f5765b3f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5760159d80 0x7f5760156060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f5765b3f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576006d3e0 con 0x7f576006cfa0 2024-09-13T17:09:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f5765b3f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576013e5e0 con 0x7f5760159d80 2024-09-13T17:09:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f5765b3f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576015a3a0 con 0x7f576013e200 2024-09-13T17:09:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f576533e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5760159d80 0x7f5760156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f576533e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5760159d80 0x7f5760156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52736/0 (socket says 172.21.15.123:52736) 2024-09-13T17:09:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f576533e700 1 -- 172.21.15.123:0/3597532051 learned_addr learned my addr 172.21.15.123:0/3597532051 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f5764b3d700 1 --2- 172.21.15.123:0/3597532051 >> v2:172.21.15.153:3300/0 conn(0x7f576013e200 0x7f576006ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f576533e700 1 -- 172.21.15.123:0/3597532051 >> v2:172.21.15.153:3300/0 conn(0x7f576013e200 msgr2=0x7f576006ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f576533e700 1 --2- 172.21.15.123:0/3597532051 >> v2:172.21.15.153:3300/0 conn(0x7f576013e200 0x7f576006ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f576533e700 1 -- 172.21.15.123:0/3597532051 >> v1:172.21.15.153:6789/0 conn(0x7f576006cfa0 legacy=0x7f5760159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f576533e700 1 -- 172.21.15.123:0/3597532051 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576013e7d0 con 0x7f5760159d80 2024-09-13T17:09:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f576533e700 1 --2- 172.21.15.123:0/3597532051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5760159d80 0x7f5760156060 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5760072070 tx=0x7f575800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52398800353aaaf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.442+0000 7f575f7fe700 1 -- 172.21.15.123:0/3597532051 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575800e070 con 0x7f5760159d80 2024-09-13T17:09:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f575f7fe700 1 -- 172.21.15.123:0/3597532051 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575800b9c0 con 0x7f5760159d80 2024-09-13T17:09:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f575f7fe700 1 -- 172.21.15.123:0/3597532051 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575800bd70 con 0x7f5760159d80 2024-09-13T17:09:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 -- 172.21.15.123:0/3597532051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5760159d80 msgr2=0x7f5760156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 --2- 172.21.15.123:0/3597532051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5760159d80 0x7f5760156060 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5760072070 tx=0x7f575800b330 comp rx=0 tx=0).stop 2024-09-13T17:09:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 -- 172.21.15.123:0/3597532051 shutdown_connections 2024-09-13T17:09:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 --2- 172.21.15.123:0/3597532051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5760159d80 0x7f5760156060 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 --2- 172.21.15.123:0/3597532051 >> v2:172.21.15.153:3300/0 conn(0x7f576013e200 0x7f576006ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 -- 172.21.15.123:0/3597532051 >> 172.21.15.123:0/3597532051 conn(0x7f57600b4630 msgr2=0x7f57600b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 -- 172.21.15.123:0/3597532051 shutdown_connections 2024-09-13T17:09:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 -- 172.21.15.123:0/3597532051 wait complete. 2024-09-13T17:09:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 Processor -- start 2024-09-13T17:09:22.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 -- start start 2024-09-13T17:09:22.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f576006cfa0 0x7f576015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f576013e200 0x7f5760140850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5760159d80 0x7f5760133950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5760130600 con 0x7f5760159d80 2024-09-13T17:09:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57601308e0 con 0x7f576013e200 2024-09-13T17:09:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.446+0000 7f5765b3f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5760130bc0 con 0x7f576006cfa0 2024-09-13T17:09:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f576533e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5760159d80 0x7f5760133950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f575ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f576013e200 0x7f5760140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f5764b3d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f576006cfa0 0x7f576015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f576533e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5760159d80 0x7f5760133950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52742/0 (socket says 172.21.15.123:52742) 2024-09-13T17:09:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f576533e700 1 -- 172.21.15.123:0/2129451366 learned_addr learned my addr 172.21.15.123:0/2129451366 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f576533e700 1 -- 172.21.15.123:0/2129451366 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f576006cfa0 msgr2=0x7f576015adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f576533e700 1 --2- 172.21.15.123:0/2129451366 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f576006cfa0 0x7f576015adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f576533e700 1 -- 172.21.15.123:0/2129451366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f576013e200 msgr2=0x7f5760140850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f576533e700 1 --2- 172.21.15.123:0/2129451366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f576013e200 0x7f5760140850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f576533e700 1 -- 172.21.15.123:0/2129451366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5758009b30 con 0x7f5760159d80 2024-09-13T17:09:22.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f576533e700 1 --2- 172.21.15.123:0/2129451366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5760159d80 0x7f5760133950 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f576006ee00 tx=0x7f5758004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:22.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f575d7fa700 1 -- 172.21.15.123:0/2129451366 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758004880 con 0x7f5760159d80 2024-09-13T17:09:22.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f575d7fa700 1 -- 172.21.15.123:0/2129451366 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57580099b0 con 0x7f5760159d80 2024-09-13T17:09:22.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f5765b3f700 1 -- 172.21.15.123:0/2129451366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5760130ea0 con 0x7f5760159d80 2024-09-13T17:09:22.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f575d7fa700 1 -- 172.21.15.123:0/2129451366 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575801b670 con 0x7f5760159d80 2024-09-13T17:09:22.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f5765b3f700 1 -- 172.21.15.123:0/2129451366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57601346a0 con 0x7f5760159d80 2024-09-13T17:09:22.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f5765b3f700 1 -- 172.21.15.123:0/2129451366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5760134860 con 0x7f5760159d80 2024-09-13T17:09:22.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.450+0000 7f575d7fa700 1 -- 172.21.15.123:0/2129451366 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f575801b7d0 con 0x7f5760159d80 2024-09-13T17:09:22.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.454+0000 7f575d7fa700 1 --2- 172.21.15.123:0/2129451366 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5744066730 0x7f5744068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.454+0000 7f575d7fa700 1 -- 172.21.15.123:0/2129451366 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5758085940 con 0x7f5760159d80 2024-09-13T17:09:22.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.454+0000 7f5764b3d700 1 --2- 172.21.15.123:0/2129451366 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5744066730 0x7f5744068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.454+0000 7f5764b3d700 1 --2- 172.21.15.123:0/2129451366 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5744066730 0x7f5744068bf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5754006b40 tx=0x7f5754008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:22.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.462+0000 7f575d7fa700 1 -- 172.21.15.123:0/2129451366 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5758052d40 con 0x7f5760159d80 2024-09-13T17:09:22.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.634+0000 7f5765b3f700 1 -- 172.21.15.123:0/2129451366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f576006ca60 con 0x7f5760159d80 2024-09-13T17:09:22.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.634+0000 7f575d7fa700 1 -- 172.21.15.123:0/2129451366 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16616 (secure 0 0 0) 0x7f5758056360 con 0x7f5760159d80 2024-09-13T17:09:22.641 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:22.642 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":72,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:09:19.929124+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:17.328080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:17.920002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.638+0000 7f5765b3f700 1 -- 172.21.15.123:0/2129451366 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5744066730 msgr2=0x7f5744068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.638+0000 7f5765b3f700 1 --2- 172.21.15.123:0/2129451366 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5744066730 0x7f5744068bf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5754006b40 tx=0x7f5754008040 comp rx=0 tx=0).stop 2024-09-13T17:09:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.638+0000 7f5765b3f700 1 -- 172.21.15.123:0/2129451366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5760159d80 msgr2=0x7f5760133950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.638+0000 7f5765b3f700 1 --2- 172.21.15.123:0/2129451366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5760159d80 0x7f5760133950 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f576006ee00 tx=0x7f5758004af0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.638+0000 7f5765b3f700 1 -- 172.21.15.123:0/2129451366 shutdown_connections 2024-09-13T17:09:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.638+0000 7f5765b3f700 1 --2- 172.21.15.123:0/2129451366 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5744066730 0x7f5744068bf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.638+0000 7f5765b3f700 1 --2- 172.21.15.123:0/2129451366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5760159d80 0x7f5760133950 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.638+0000 7f5765b3f700 1 --2- 172.21.15.123:0/2129451366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f576013e200 0x7f5760140850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.638+0000 7f5765b3f700 1 --2- 172.21.15.123:0/2129451366 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f576006cfa0 0x7f576015adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.638+0000 7f5765b3f700 1 -- 172.21.15.123:0/2129451366 >> 172.21.15.123:0/2129451366 conn(0x7f57600b4630 msgr2=0x7f576015bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:22.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.638+0000 7f5765b3f700 1 -- 172.21.15.123:0/2129451366 shutdown_connections 2024-09-13T17:09:22.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.638+0000 7f5765b3f700 1 -- 172.21.15.123:0/2129451366 wait complete. 2024-09-13T17:09:22.657 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:09:22.657 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:09:22.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.762+0000 7f81140dc700 1 Processor -- start 2024-09-13T17:09:22.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.762+0000 7f81140dc700 1 -- start start 2024-09-13T17:09:22.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f81140dc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f810c0cf470 0x7f810c0b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f81140dc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c06c050 con 0x7f810c06a260 2024-09-13T17:09:22.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f81140dc700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c15d050 con 0x7f810c14fac0 2024-09-13T17:09:22.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f81140dc700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c15c740 con 0x7f810c0cf470 2024-09-13T17:09:22.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f8111677700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f810c0cf470 0x7f810c0b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f8111677700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f810c0cf470 0x7f810c0b17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52756/0 (socket says 172.21.15.123:52756) 2024-09-13T17:09:22.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f8111677700 1 -- 172.21.15.123:0/3259244014 learned_addr learned my addr 172.21.15.123:0/3259244014 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f8111677700 1 -- 172.21.15.123:0/3259244014 >> v1:172.21.15.153:6789/0 conn(0x7f810c14fac0 legacy=0x7f810c0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f8111677700 1 -- 172.21.15.123:0/3259244014 >> v1:172.21.15.123:6789/0 conn(0x7f810c06a260 legacy=0x7f810c0b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f8111677700 1 -- 172.21.15.123:0/3259244014 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c0b24d0 con 0x7f810c0cf470 2024-09-13T17:09:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f8111677700 1 --2- 172.21.15.123:0/3259244014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f810c0cf470 0x7f810c0b17e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f810000d180 tx=0x7f810000d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d7c1e53099f4fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f8110e76700 1 -- 172.21.15.123:0/3259244014 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100010070 con 0x7f810c0cf470 2024-09-13T17:09:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f8110e76700 1 -- 172.21.15.123:0/3259244014 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810000ddb0 con 0x7f810c0cf470 2024-09-13T17:09:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f8110e76700 1 -- 172.21.15.123:0/3259244014 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810000b310 con 0x7f810c0cf470 2024-09-13T17:09:22.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f81140dc700 1 -- 172.21.15.123:0/3259244014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f810c0cf470 msgr2=0x7f810c0b17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f81140dc700 1 --2- 172.21.15.123:0/3259244014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f810c0cf470 0x7f810c0b17e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f810000d180 tx=0x7f810000d490 comp rx=0 tx=0).stop 2024-09-13T17:09:22.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f81140dc700 1 -- 172.21.15.123:0/3259244014 shutdown_connections 2024-09-13T17:09:22.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f81140dc700 1 --2- 172.21.15.123:0/3259244014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f810c0cf470 0x7f810c0b17e0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f81140dc700 1 -- 172.21.15.123:0/3259244014 >> 172.21.15.123:0/3259244014 conn(0x7f810c066570 msgr2=0x7f810c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:22.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f81140dc700 1 -- 172.21.15.123:0/3259244014 shutdown_connections 2024-09-13T17:09:22.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.766+0000 7f81140dc700 1 -- 172.21.15.123:0/3259244014 wait complete. 2024-09-13T17:09:22.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.770+0000 7f81140dc700 1 Processor -- start 2024-09-13T17:09:22.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.770+0000 7f81140dc700 1 -- start start 2024-09-13T17:09:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f81140dc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f810c06a260 0x7f810c1ee090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f81140dc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f810c0cf470 0x7f810c158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f81140dc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f810c14fac0 0x7f810c151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f81140dc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c140e20 con 0x7f810c0cf470 2024-09-13T17:09:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f81140dc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c148430 con 0x7f810c14fac0 2024-09-13T17:09:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f81140dc700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c15bc80 con 0x7f810c06a260 2024-09-13T17:09:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f8111677700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f810c0cf470 0x7f810c158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f8111677700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f810c0cf470 0x7f810c158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52770/0 (socket says 172.21.15.123:52770) 2024-09-13T17:09:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f8111677700 1 -- 172.21.15.123:0/94247517 learned_addr learned my addr 172.21.15.123:0/94247517 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f8112679700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f810c14fac0 0x7f810c151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f8111e78700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f810c06a260 0x7f810c1ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f8111677700 1 -- 172.21.15.123:0/94247517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f810c06a260 msgr2=0x7f810c1ee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f8111677700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f810c06a260 0x7f810c1ee090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f8111677700 1 -- 172.21.15.123:0/94247517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f810c14fac0 msgr2=0x7f810c151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f8111677700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f810c14fac0 0x7f810c151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f8111677700 1 -- 172.21.15.123:0/94247517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810000bd40 con 0x7f810c0cf470 2024-09-13T17:09:22.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f8111e78700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f810c06a260 0x7f810c1ee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:22.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f8111677700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f810c0cf470 0x7f810c158fc0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f810000d890 tx=0x7f8100004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:22.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f80fe7fc700 1 -- 172.21.15.123:0/94247517 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810000bbc0 con 0x7f810c0cf470 2024-09-13T17:09:22.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f80fe7fc700 1 -- 172.21.15.123:0/94247517 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810000b4c0 con 0x7f810c0cf470 2024-09-13T17:09:22.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f80fe7fc700 1 -- 172.21.15.123:0/94247517 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100004040 con 0x7f810c0cf470 2024-09-13T17:09:22.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f81140dc700 1 -- 172.21.15.123:0/94247517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c15bf60 con 0x7f810c0cf470 2024-09-13T17:09:22.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f81140dc700 1 -- 172.21.15.123:0/94247517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c1486f0 con 0x7f810c0cf470 2024-09-13T17:09:22.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.774+0000 7f81140dc700 1 -- 172.21.15.123:0/94247517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c14fea0 con 0x7f810c0cf470 2024-09-13T17:09:22.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.778+0000 7f80fe7fc700 1 -- 172.21.15.123:0/94247517 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f81000041a0 con 0x7f810c0cf470 2024-09-13T17:09:22.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.778+0000 7f80fe7fc700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f80f0066730 0x7f80f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:22.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.778+0000 7f80fe7fc700 1 -- 172.21.15.123:0/94247517 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8100087a40 con 0x7f810c0cf470 2024-09-13T17:09:22.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.778+0000 7f8111e78700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f80f0066730 0x7f80f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:22.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.778+0000 7f8111e78700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f80f0066730 0x7f80f0068bf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8108000f60 tx=0x7f8108009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:22.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.782+0000 7f80fe7fc700 1 -- 172.21.15.123:0/94247517 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8100054da0 con 0x7f810c0cf470 2024-09-13T17:09:22.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.954+0000 7f81140dc700 1 -- 172.21.15.123:0/94247517 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f810c15cce0 con 0x7f80f0066730 2024-09-13T17:09:22.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.966+0000 7f80fe7fc700 1 -- 172.21.15.123:0/94247517 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288086 (secure 0 0 0) 0x7f81080050d0 con 0x7f80f0066730 2024-09-13T17:09:22.975 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.970+0000 7f81140dc700 1 -- 172.21.15.123:0/94247517 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f80f0066730 msgr2=0x7f80f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.970+0000 7f81140dc700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f80f0066730 0x7f80f0068bf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8108000f60 tx=0x7f8108009040 comp rx=0 tx=0).stop 2024-09-13T17:09:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.970+0000 7f81140dc700 1 -- 172.21.15.123:0/94247517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f810c0cf470 msgr2=0x7f810c158fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.970+0000 7f81140dc700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f810c0cf470 0x7f810c158fc0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f810000d890 tx=0x7f8100004af0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.970+0000 7f81140dc700 1 -- 172.21.15.123:0/94247517 shutdown_connections 2024-09-13T17:09:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.970+0000 7f81140dc700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f80f0066730 0x7f80f0068bf0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.970+0000 7f81140dc700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f810c14fac0 0x7f810c151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.970+0000 7f81140dc700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f810c0cf470 0x7f810c158fc0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.970+0000 7f81140dc700 1 --2- 172.21.15.123:0/94247517 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f810c06a260 0x7f810c1ee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:22.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.970+0000 7f81140dc700 1 -- 172.21.15.123:0/94247517 >> 172.21.15.123:0/94247517 conn(0x7f810c066570 msgr2=0x7f810c14e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:22.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.970+0000 7f81140dc700 1 -- 172.21.15.123:0/94247517 shutdown_connections 2024-09-13T17:09:22.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:22.970+0000 7f81140dc700 1 -- 172.21.15.123:0/94247517 wait complete. 2024-09-13T17:09:22.979 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:09:22.990 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-09-13T17:09:22.782214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232448,"kb_used_data":8072,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754742272,"statfs":{"total":773094113280,"available":772856086528,"internally_reserved":0,"allocated":8265728,"data_stored":4142052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":229625401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.241176"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937186+0000","last_change":"2024-09-13T17:09:18.964815+0000","last_active":"2024-09-13T17:09:19.937186+0000","last_peered":"2024-09-13T17:09:19.937186+0000","last_clean":"2024-09-13T17:09:19.937186+0000","last_became_active":"2024-09-13T17:09:18.964436+0000","last_became_peered":"2024-09-13T17:09:18.964436+0000","last_unstale":"2024-09-13T17:09:19.937186+0000","last_undegraded":"2024-09-13T17:09:19.937186+0000","last_fullsized":"2024-09-13T17:09:19.937186+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.590523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943497+0000","last_change":"2024-09-13T17:09:18.966158+0000","last_active":"2024-09-13T17:09:19.943497+0000","last_peered":"2024-09-13T17:09:19.943497+0000","last_clean":"2024-09-13T17:09:19.943497+0000","last_became_active":"2024-09-13T17:09:18.965787+0000","last_became_peered":"2024-09-13T17:09:18.965787+0000","last_unstale":"2024-09-13T17:09:19.943497+0000","last_undegraded":"2024-09-13T17:09:19.943497+0000","last_fullsized":"2024-09-13T17:09:19.943497+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:54.348245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.935944+0000","last_change":"2024-09-13T17:09:18.943136+0000","last_active":"2024-09-13T17:09:19.935944+0000","last_peered":"2024-09-13T17:09:19.935944+0000","last_clean":"2024-09-13T17:09:19.935944+0000","last_became_active":"2024-09-13T17:09:18.942859+0000","last_became_peered":"2024-09-13T17:09:18.942859+0000","last_unstale":"2024-09-13T17:09:19.935944+0000","last_undegraded":"2024-09-13T17:09:19.935944+0000","last_fullsized":"2024-09-13T17:09:19.935944+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:12.645054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941212+0000","last_change":"2024-09-13T17:09:18.961905+0000","last_active":"2024-09-13T17:09:19.941212+0000","last_peered":"2024-09-13T17:09:19.941212+0000","last_clean":"2024-09-13T17:09:19.941212+0000","last_became_active":"2024-09-13T17:09:18.961533+0000","last_became_peered":"2024-09-13T17:09:18.961533+0000","last_unstale":"2024-09-13T17:09:19.941212+0000","last_undegraded":"2024-09-13T17:09:19.941212+0000","last_fullsized":"2024-09-13T17:09:19.941212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:16.276086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937672+0000","last_change":"2024-09-13T17:09:18.959682+0000","last_active":"2024-09-13T17:09:19.937672+0000","last_peered":"2024-09-13T17:09:19.937672+0000","last_clean":"2024-09-13T17:09:19.937672+0000","last_became_active":"2024-09-13T17:09:18.959409+0000","last_became_peered":"2024-09-13T17:09:18.959409+0000","last_unstale":"2024-09-13T17:09:19.937672+0000","last_undegraded":"2024-09-13T17:09:19.937672+0000","last_fullsized":"2024-09-13T17:09:19.937672+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:42.748419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943010+0000","last_change":"2024-09-13T17:09:18.965970+0000","last_active":"2024-09-13T17:09:19.943010+0000","last_peered":"2024-09-13T17:09:19.943010+0000","last_clean":"2024-09-13T17:09:19.943010+0000","last_became_active":"2024-09-13T17:09:18.965675+0000","last_became_peered":"2024-09-13T17:09:18.965675+0000","last_unstale":"2024-09-13T17:09:19.943010+0000","last_undegraded":"2024-09-13T17:09:19.943010+0000","last_fullsized":"2024-09-13T17:09:19.943010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:59.867400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942203+0000","last_change":"2024-09-13T17:09:18.955798+0000","last_active":"2024-09-13T17:09:19.942203+0000","last_peered":"2024-09-13T17:09:19.942203+0000","last_clean":"2024-09-13T17:09:19.942203+0000","last_became_active":"2024-09-13T17:09:18.955466+0000","last_became_peered":"2024-09-13T17:09:18.955466+0000","last_unstale":"2024-09-13T17:09:19.942203+0000","last_undegraded":"2024-09-13T17:09:19.942203+0000","last_fullsized":"2024-09-13T17:09:19.942203+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:42.352345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942654+0000","last_change":"2024-09-13T17:09:18.960472+0000","last_active":"2024-09-13T17:09:19.942654+0000","last_peered":"2024-09-13T17:09:19.942654+0000","last_clean":"2024-09-13T17:09:19.942654+0000","last_became_active":"2024-09-13T17:09:18.959383+0000","last_became_peered":"2024-09-13T17:09:18.959383+0000","last_unstale":"2024-09-13T17:09:19.942654+0000","last_undegraded":"2024-09-13T17:09:19.942654+0000","last_fullsized":"2024-09-13T17:09:19.942654+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:30.424456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.938454+0000","last_change":"2024-09-13T17:09:18.959007+0000","last_active":"2024-09-13T17:09:19.938454+0000","last_peered":"2024-09-13T17:09:19.938454+0000","last_clean":"2024-09-13T17:09:19.938454+0000","last_became_active":"2024-09-13T17:09:18.958764+0000","last_became_peered":"2024-09-13T17:09:18.958764+0000","last_unstale":"2024-09-13T17:09:19.938454+0000","last_undegraded":"2024-09-13T17:09:19.938454+0000","last_fullsized":"2024-09-13T17:09:19.938454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:13.935947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943682+0000","last_change":"2024-09-13T17:09:18.954597+0000","last_active":"2024-09-13T17:09:19.943682+0000","last_peered":"2024-09-13T17:09:19.943682+0000","last_clean":"2024-09-13T17:09:19.943682+0000","last_became_active":"2024-09-13T17:09:18.952785+0000","last_became_peered":"2024-09-13T17:09:18.952785+0000","last_unstale":"2024-09-13T17:09:19.943682+0000","last_undegraded":"2024-09-13T17:09:19.943682+0000","last_fullsized":"2024-09-13T17:09:19.943682+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:50.801088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937024+0000","last_change":"2024-09-13T17:09:18.961551+0000","last_active":"2024-09-13T17:09:19.937024+0000","last_peered":"2024-09-13T17:09:19.937024+0000","last_clean":"2024-09-13T17:09:19.937024+0000","last_became_active":"2024-09-13T17:09:18.960770+0000","last_became_peered":"2024-09-13T17:09:18.960770+0000","last_unstale":"2024-09-13T17:09:19.937024+0000","last_undegraded":"2024-09-13T17:09:19.937024+0000","last_fullsized":"2024-09-13T17:09:19.937024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:10.380507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941206+0000","last_change":"2024-09-13T17:09:18.955316+0000","last_active":"2024-09-13T17:09:19.941206+0000","last_peered":"2024-09-13T17:09:19.941206+0000","last_clean":"2024-09-13T17:09:19.941206+0000","last_became_active":"2024-09-13T17:09:18.954892+0000","last_became_peered":"2024-09-13T17:09:18.954892+0000","last_unstale":"2024-09-13T17:09:19.941206+0000","last_undegraded":"2024-09-13T17:09:19.941206+0000","last_fullsized":"2024-09-13T17:09:19.941206+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:30.424456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940724+0000","last_change":"2024-09-13T17:09:18.961793+0000","last_active":"2024-09-13T17:09:19.940724+0000","last_peered":"2024-09-13T17:09:19.940724+0000","last_clean":"2024-09-13T17:09:19.940724+0000","last_became_active":"2024-09-13T17:09:18.961355+0000","last_became_peered":"2024-09-13T17:09:18.961355+0000","last_unstale":"2024-09-13T17:09:19.940724+0000","last_undegraded":"2024-09-13T17:09:19.940724+0000","last_fullsized":"2024-09-13T17:09:19.940724+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:16.836431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937680+0000","last_change":"2024-09-13T17:09:18.960794+0000","last_active":"2024-09-13T17:09:19.937680+0000","last_peered":"2024-09-13T17:09:19.937680+0000","last_clean":"2024-09-13T17:09:19.937680+0000","last_became_active":"2024-09-13T17:09:18.960538+0000","last_became_peered":"2024-09-13T17:09:18.960538+0000","last_unstale":"2024-09-13T17:09:19.937680+0000","last_undegraded":"2024-09-13T17:09:19.937680+0000","last_fullsized":"2024-09-13T17:09:19.937680+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:11.778942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940587+0000","last_change":"2024-09-13T17:09:18.953703+0000","last_active":"2024-09-13T17:09:19.940587+0000","last_peered":"2024-09-13T17:09:19.940587+0000","last_clean":"2024-09-13T17:09:19.940587+0000","last_became_active":"2024-09-13T17:09:18.953460+0000","last_became_peered":"2024-09-13T17:09:18.953460+0000","last_unstale":"2024-09-13T17:09:19.940587+0000","last_undegraded":"2024-09-13T17:09:19.940587+0000","last_fullsized":"2024-09-13T17:09:19.940587+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:42.352345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941796+0000","last_change":"2024-09-13T17:09:18.964059+0000","last_active":"2024-09-13T17:09:19.941796+0000","last_peered":"2024-09-13T17:09:19.941796+0000","last_clean":"2024-09-13T17:09:19.941796+0000","last_became_active":"2024-09-13T17:09:18.963162+0000","last_became_peered":"2024-09-13T17:09:18.963162+0000","last_unstale":"2024-09-13T17:09:19.941796+0000","last_undegraded":"2024-09-13T17:09:19.941796+0000","last_fullsized":"2024-09-13T17:09:19.941796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:33.754795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.938543+0000","last_change":"2024-09-13T17:09:18.958704+0000","last_active":"2024-09-13T17:09:19.938543+0000","last_peered":"2024-09-13T17:09:19.938543+0000","last_clean":"2024-09-13T17:09:19.938543+0000","last_became_active":"2024-09-13T17:09:18.958383+0000","last_became_peered":"2024-09-13T17:09:18.958383+0000","last_unstale":"2024-09-13T17:09:19.938543+0000","last_undegraded":"2024-09-13T17:09:19.938543+0000","last_fullsized":"2024-09-13T17:09:19.938543+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:50.621604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941549+0000","last_change":"2024-09-13T17:09:18.962444+0000","last_active":"2024-09-13T17:09:19.941549+0000","last_peered":"2024-09-13T17:09:19.941549+0000","last_clean":"2024-09-13T17:09:19.941549+0000","last_became_active":"2024-09-13T17:09:18.962143+0000","last_became_peered":"2024-09-13T17:09:18.962143+0000","last_unstale":"2024-09-13T17:09:19.941549+0000","last_undegraded":"2024-09-13T17:09:19.941549+0000","last_fullsized":"2024-09-13T17:09:19.941549+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:20.358572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943057+0000","last_change":"2024-09-13T17:09:18.960697+0000","last_active":"2024-09-13T17:09:19.943057+0000","last_peered":"2024-09-13T17:09:19.943057+0000","last_clean":"2024-09-13T17:09:19.943057+0000","last_became_active":"2024-09-13T17:09:18.960277+0000","last_became_peered":"2024-09-13T17:09:18.960277+0000","last_unstale":"2024-09-13T17:09:19.943057+0000","last_undegraded":"2024-09-13T17:09:19.943057+0000","last_fullsized":"2024-09-13T17:09:19.943057+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:21.816947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940667+0000","last_change":"2024-09-13T17:09:18.952802+0000","last_active":"2024-09-13T17:09:19.940667+0000","last_peered":"2024-09-13T17:09:19.940667+0000","last_clean":"2024-09-13T17:09:19.940667+0000","last_became_active":"2024-09-13T17:09:18.952549+0000","last_became_peered":"2024-09-13T17:09:18.952549+0000","last_unstale":"2024-09-13T17:09:19.940667+0000","last_undegraded":"2024-09-13T17:09:19.940667+0000","last_fullsized":"2024-09-13T17:09:19.940667+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:09.378119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943329+0000","last_change":"2024-09-13T17:09:18.944352+0000","last_active":"2024-09-13T17:09:19.943329+0000","last_peered":"2024-09-13T17:09:19.943329+0000","last_clean":"2024-09-13T17:09:19.943329+0000","last_became_active":"2024-09-13T17:09:18.943752+0000","last_became_peered":"2024-09-13T17:09:18.943752+0000","last_unstale":"2024-09-13T17:09:19.943329+0000","last_undegraded":"2024-09-13T17:09:19.943329+0000","last_fullsized":"2024-09-13T17:09:19.943329+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:18.556011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941844+0000","last_change":"2024-09-13T17:09:18.954442+0000","last_active":"2024-09-13T17:09:19.941844+0000","last_peered":"2024-09-13T17:09:19.941844+0000","last_clean":"2024-09-13T17:09:19.941844+0000","last_became_active":"2024-09-13T17:09:18.952640+0000","last_became_peered":"2024-09-13T17:09:18.952640+0000","last_unstale":"2024-09-13T17:09:19.941844+0000","last_undegraded":"2024-09-13T17:09:19.941844+0000","last_fullsized":"2024-09-13T17:09:19.941844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:38.971471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936519+0000","last_change":"2024-09-13T17:09:18.962536+0000","last_active":"2024-09-13T17:09:19.936519+0000","last_peered":"2024-09-13T17:09:19.936519+0000","last_clean":"2024-09-13T17:09:19.936519+0000","last_became_active":"2024-09-13T17:09:18.962249+0000","last_became_peered":"2024-09-13T17:09:18.962249+0000","last_unstale":"2024-09-13T17:09:19.936519+0000","last_undegraded":"2024-09-13T17:09:19.936519+0000","last_fullsized":"2024-09-13T17:09:19.936519+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:12.645054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936318+0000","last_change":"2024-09-13T17:09:18.965836+0000","last_active":"2024-09-13T17:09:19.936318+0000","last_peered":"2024-09-13T17:09:19.936318+0000","last_clean":"2024-09-13T17:09:19.936318+0000","last_became_active":"2024-09-13T17:09:18.965605+0000","last_became_peered":"2024-09-13T17:09:18.965605+0000","last_unstale":"2024-09-13T17:09:19.936318+0000","last_undegraded":"2024-09-13T17:09:19.936318+0000","last_fullsized":"2024-09-13T17:09:19.936318+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:22.264331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943638+0000","last_change":"2024-09-13T17:09:18.958961+0000","last_active":"2024-09-13T17:09:19.943638+0000","last_peered":"2024-09-13T17:09:19.943638+0000","last_clean":"2024-09-13T17:09:19.943638+0000","last_became_active":"2024-09-13T17:09:18.958704+0000","last_became_peered":"2024-09-13T17:09:18.958704+0000","last_unstale":"2024-09-13T17:09:19.943638+0000","last_undegraded":"2024-09-13T17:09:19.943638+0000","last_fullsized":"2024-09-13T17:09:19.943638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:42.308443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942265+0000","last_change":"2024-09-13T17:09:18.961703+0000","last_active":"2024-09-13T17:09:19.942265+0000","last_peered":"2024-09-13T17:09:19.942265+0000","last_clean":"2024-09-13T17:09:19.942265+0000","last_became_active":"2024-09-13T17:09:18.961329+0000","last_became_peered":"2024-09-13T17:09:18.961329+0000","last_unstale":"2024-09-13T17:09:19.942265+0000","last_undegraded":"2024-09-13T17:09:19.942265+0000","last_fullsized":"2024-09-13T17:09:19.942265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:39:28.270278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936157+0000","last_change":"2024-09-13T17:09:18.951208+0000","last_active":"2024-09-13T17:09:19.936157+0000","last_peered":"2024-09-13T17:09:19.936157+0000","last_clean":"2024-09-13T17:09:19.936157+0000","last_became_active":"2024-09-13T17:09:18.950947+0000","last_became_peered":"2024-09-13T17:09:18.950947+0000","last_unstale":"2024-09-13T17:09:19.936157+0000","last_undegraded":"2024-09-13T17:09:19.936157+0000","last_fullsized":"2024-09-13T17:09:19.936157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:08.639595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943411+0000","last_change":"2024-09-13T17:09:18.954792+0000","last_active":"2024-09-13T17:09:19.943411+0000","last_peered":"2024-09-13T17:09:19.943411+0000","last_clean":"2024-09-13T17:09:19.943411+0000","last_became_active":"2024-09-13T17:09:18.954500+0000","last_became_peered":"2024-09-13T17:09:18.954500+0000","last_unstale":"2024-09-13T17:09:19.943411+0000","last_undegraded":"2024-09-13T17:09:19.943411+0000","last_fullsized":"2024-09-13T17:09:19.943411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:35.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.935996+0000","last_change":"2024-09-13T17:09:18.953879+0000","last_active":"2024-09-13T17:09:19.935996+0000","last_peered":"2024-09-13T17:09:19.935996+0000","last_clean":"2024-09-13T17:09:19.935996+0000","last_became_active":"2024-09-13T17:09:18.953610+0000","last_became_peered":"2024-09-13T17:09:18.953610+0000","last_unstale":"2024-09-13T17:09:19.935996+0000","last_undegraded":"2024-09-13T17:09:19.935996+0000","last_fullsized":"2024-09-13T17:09:19.935996+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:06.821655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941953+0000","last_change":"2024-09-13T17:09:18.962731+0000","last_active":"2024-09-13T17:09:19.941953+0000","last_peered":"2024-09-13T17:09:19.941953+0000","last_clean":"2024-09-13T17:09:19.941953+0000","last_became_active":"2024-09-13T17:09:18.962465+0000","last_became_peered":"2024-09-13T17:09:18.962465+0000","last_unstale":"2024-09-13T17:09:19.941953+0000","last_undegraded":"2024-09-13T17:09:19.941953+0000","last_fullsized":"2024-09-13T17:09:19.941953+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:16.836431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942480+0000","last_change":"2024-09-13T17:09:18.956812+0000","last_active":"2024-09-13T17:09:19.942480+0000","last_peered":"2024-09-13T17:09:19.942480+0000","last_clean":"2024-09-13T17:09:19.942480+0000","last_became_active":"2024-09-13T17:09:18.956543+0000","last_became_peered":"2024-09-13T17:09:18.956543+0000","last_unstale":"2024-09-13T17:09:19.942480+0000","last_undegraded":"2024-09-13T17:09:19.942480+0000","last_fullsized":"2024-09-13T17:09:19.942480+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:33.093375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942705+0000","last_change":"2024-09-13T17:09:18.959675+0000","last_active":"2024-09-13T17:09:19.942705+0000","last_peered":"2024-09-13T17:09:19.942705+0000","last_clean":"2024-09-13T17:09:19.942705+0000","last_became_active":"2024-09-13T17:09:18.959053+0000","last_became_peered":"2024-09-13T17:09:18.959053+0000","last_unstale":"2024-09-13T17:09:19.942705+0000","last_undegraded":"2024-09-13T17:09:19.942705+0000","last_fullsized":"2024-09-13T17:09:19.942705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:13.609362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937039+0000","last_change":"2024-09-13T17:09:18.964295+0000","last_active":"2024-09-13T17:09:19.937039+0000","last_peered":"2024-09-13T17:09:19.937039+0000","last_clean":"2024-09-13T17:09:19.937039+0000","last_became_active":"2024-09-13T17:09:18.961637+0000","last_became_peered":"2024-09-13T17:09:18.961637+0000","last_unstale":"2024-09-13T17:09:19.937039+0000","last_undegraded":"2024-09-13T17:09:19.937039+0000","last_fullsized":"2024-09-13T17:09:19.937039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:08.639595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937438+0000","last_change":"2024-09-13T17:09:18.572453+0000","last_active":"2024-09-13T17:09:19.937438+0000","last_peered":"2024-09-13T17:09:19.937438+0000","last_clean":"2024-09-13T17:09:19.937438+0000","last_became_active":"2024-09-13T17:09:18.572134+0000","last_became_peered":"2024-09-13T17:09:18.572134+0000","last_unstale":"2024-09-13T17:09:19.937438+0000","last_undegraded":"2024-09-13T17:09:19.937438+0000","last_fullsized":"2024-09-13T17:09:19.937438+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:17.546280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.938630+0000","last_change":"2024-09-13T17:09:18.955287+0000","last_active":"2024-09-13T17:09:19.938630+0000","last_peered":"2024-09-13T17:09:19.938630+0000","last_clean":"2024-09-13T17:09:19.938630+0000","last_became_active":"2024-09-13T17:09:18.954952+0000","last_became_peered":"2024-09-13T17:09:18.954952+0000","last_unstale":"2024-09-13T17:09:19.938630+0000","last_undegraded":"2024-09-13T17:09:19.938630+0000","last_fullsized":"2024-09-13T17:09:19.938630+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:21.091492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940950+0000","last_change":"2024-09-13T17:09:18.579636+0000","last_active":"2024-09-13T17:09:19.940950+0000","last_peered":"2024-09-13T17:09:19.940950+0000","last_clean":"2024-09-13T17:09:19.940950+0000","last_became_active":"2024-09-13T17:09:18.579224+0000","last_became_peered":"2024-09-13T17:09:18.579224+0000","last_unstale":"2024-09-13T17:09:19.940950+0000","last_undegraded":"2024-09-13T17:09:19.940950+0000","last_fullsized":"2024-09-13T17:09:19.940950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:37.961740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943171+0000","last_change":"2024-09-13T17:09:18.960542+0000","last_active":"2024-09-13T17:09:19.943171+0000","last_peered":"2024-09-13T17:09:19.943171+0000","last_clean":"2024-09-13T17:09:19.943171+0000","last_became_active":"2024-09-13T17:09:18.959954+0000","last_became_peered":"2024-09-13T17:09:18.959954+0000","last_unstale":"2024-09-13T17:09:19.943171+0000","last_undegraded":"2024-09-13T17:09:19.943171+0000","last_fullsized":"2024-09-13T17:09:19.943171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:18.729890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943757+0000","last_change":"2024-09-13T17:09:18.574700+0000","last_active":"2024-09-13T17:09:19.943757+0000","last_peered":"2024-09-13T17:09:19.943757+0000","last_clean":"2024-09-13T17:09:19.943757+0000","last_became_active":"2024-09-13T17:09:18.574435+0000","last_became_peered":"2024-09-13T17:09:18.574435+0000","last_unstale":"2024-09-13T17:09:19.943757+0000","last_undegraded":"2024-09-13T17:09:19.943757+0000","last_fullsized":"2024-09-13T17:09:19.943757+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:19.348841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937222+0000","last_change":"2024-09-13T17:09:18.964323+0000","last_active":"2024-09-13T17:09:19.937222+0000","last_peered":"2024-09-13T17:09:19.937222+0000","last_clean":"2024-09-13T17:09:19.937222+0000","last_became_active":"2024-09-13T17:09:18.961450+0000","last_became_peered":"2024-09-13T17:09:18.961450+0000","last_unstale":"2024-09-13T17:09:19.937222+0000","last_undegraded":"2024-09-13T17:09:19.937222+0000","last_fullsized":"2024-09-13T17:09:19.937222+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:42.352345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943441+0000","last_change":"2024-09-13T17:09:18.567327+0000","last_active":"2024-09-13T17:09:19.943441+0000","last_peered":"2024-09-13T17:09:19.943441+0000","last_clean":"2024-09-13T17:09:19.943441+0000","last_became_active":"2024-09-13T17:09:18.566995+0000","last_became_peered":"2024-09-13T17:09:18.566995+0000","last_unstale":"2024-09-13T17:09:19.943441+0000","last_undegraded":"2024-09-13T17:09:19.943441+0000","last_fullsized":"2024-09-13T17:09:19.943441+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:43.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942033+0000","last_change":"2024-09-13T17:09:18.952089+0000","last_active":"2024-09-13T17:09:19.942033+0000","last_peered":"2024-09-13T17:09:19.942033+0000","last_clean":"2024-09-13T17:09:19.942033+0000","last_became_active":"2024-09-13T17:09:18.951692+0000","last_became_peered":"2024-09-13T17:09:18.951692+0000","last_unstale":"2024-09-13T17:09:19.942033+0000","last_undegraded":"2024-09-13T17:09:19.942033+0000","last_fullsized":"2024-09-13T17:09:19.942033+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:42.308443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936091+0000","last_change":"2024-09-13T17:09:18.570765+0000","last_active":"2024-09-13T17:09:19.936091+0000","last_peered":"2024-09-13T17:09:19.936091+0000","last_clean":"2024-09-13T17:09:19.936091+0000","last_became_active":"2024-09-13T17:09:18.570468+0000","last_became_peered":"2024-09-13T17:09:18.570468+0000","last_unstale":"2024-09-13T17:09:19.936091+0000","last_undegraded":"2024-09-13T17:09:19.936091+0000","last_fullsized":"2024-09-13T17:09:19.936091+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:41.298711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943420+0000","last_change":"2024-09-13T17:09:18.955247+0000","last_active":"2024-09-13T17:09:19.943420+0000","last_peered":"2024-09-13T17:09:19.943420+0000","last_clean":"2024-09-13T17:09:19.943420+0000","last_became_active":"2024-09-13T17:09:18.953269+0000","last_became_peered":"2024-09-13T17:09:18.953269+0000","last_unstale":"2024-09-13T17:09:19.943420+0000","last_undegraded":"2024-09-13T17:09:19.943420+0000","last_fullsized":"2024-09-13T17:09:19.943420+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:50.386334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943094+0000","last_change":"2024-09-13T17:09:18.576249+0000","last_active":"2024-09-13T17:09:19.943094+0000","last_peered":"2024-09-13T17:09:19.943094+0000","last_clean":"2024-09-13T17:09:19.943094+0000","last_became_active":"2024-09-13T17:09:18.575874+0000","last_became_peered":"2024-09-13T17:09:18.575874+0000","last_unstale":"2024-09-13T17:09:19.943094+0000","last_undegraded":"2024-09-13T17:09:19.943094+0000","last_fullsized":"2024-09-13T17:09:19.943094+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:44.778987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936747+0000","last_change":"2024-09-13T17:09:18.966228+0000","last_active":"2024-09-13T17:09:19.936747+0000","last_peered":"2024-09-13T17:09:19.936747+0000","last_clean":"2024-09-13T17:09:19.936747+0000","last_became_active":"2024-09-13T17:09:18.965921+0000","last_became_peered":"2024-09-13T17:09:18.965921+0000","last_unstale":"2024-09-13T17:09:19.936747+0000","last_undegraded":"2024-09-13T17:09:19.936747+0000","last_fullsized":"2024-09-13T17:09:19.936747+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:50.785710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941066+0000","last_change":"2024-09-13T17:09:18.570276+0000","last_active":"2024-09-13T17:09:19.941066+0000","last_peered":"2024-09-13T17:09:19.941066+0000","last_clean":"2024-09-13T17:09:19.941066+0000","last_became_active":"2024-09-13T17:09:18.569413+0000","last_became_peered":"2024-09-13T17:09:18.569413+0000","last_unstale":"2024-09-13T17:09:19.941066+0000","last_undegraded":"2024-09-13T17:09:19.941066+0000","last_fullsized":"2024-09-13T17:09:19.941066+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:43.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940706+0000","last_change":"2024-09-13T17:09:18.954502+0000","last_active":"2024-09-13T17:09:19.940706+0000","last_peered":"2024-09-13T17:09:19.940706+0000","last_clean":"2024-09-13T17:09:19.940706+0000","last_became_active":"2024-09-13T17:09:18.954241+0000","last_became_peered":"2024-09-13T17:09:18.954241+0000","last_unstale":"2024-09-13T17:09:19.940706+0000","last_undegraded":"2024-09-13T17:09:19.940706+0000","last_fullsized":"2024-09-13T17:09:19.940706+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:39:28.270278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936834+0000","last_change":"2024-09-13T17:09:18.574057+0000","last_active":"2024-09-13T17:09:19.936834+0000","last_peered":"2024-09-13T17:09:19.936834+0000","last_clean":"2024-09-13T17:09:19.936834+0000","last_became_active":"2024-09-13T17:09:18.573788+0000","last_became_peered":"2024-09-13T17:09:18.573788+0000","last_unstale":"2024-09-13T17:09:19.936834+0000","last_undegraded":"2024-09-13T17:09:19.936834+0000","last_fullsized":"2024-09-13T17:09:19.936834+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:11.604392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942363+0000","last_change":"2024-09-13T17:09:18.953151+0000","last_active":"2024-09-13T17:09:19.942363+0000","last_peered":"2024-09-13T17:09:19.942363+0000","last_clean":"2024-09-13T17:09:19.942363+0000","last_became_active":"2024-09-13T17:09:18.952808+0000","last_became_peered":"2024-09-13T17:09:18.952808+0000","last_unstale":"2024-09-13T17:09:19.942363+0000","last_undegraded":"2024-09-13T17:09:19.942363+0000","last_fullsized":"2024-09-13T17:09:19.942363+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:08.252615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943654+0000","last_change":"2024-09-13T17:09:18.568587+0000","last_active":"2024-09-13T17:09:19.943654+0000","last_peered":"2024-09-13T17:09:19.943654+0000","last_clean":"2024-09-13T17:09:19.943654+0000","last_became_active":"2024-09-13T17:09:18.568290+0000","last_became_peered":"2024-09-13T17:09:18.568290+0000","last_unstale":"2024-09-13T17:09:19.943654+0000","last_undegraded":"2024-09-13T17:09:19.943654+0000","last_fullsized":"2024-09-13T17:09:19.943654+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:52.910008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937327+0000","last_change":"2024-09-13T17:09:18.964461+0000","last_active":"2024-09-13T17:09:19.937327+0000","last_peered":"2024-09-13T17:09:19.937327+0000","last_clean":"2024-09-13T17:09:19.937327+0000","last_became_active":"2024-09-13T17:09:18.962310+0000","last_became_peered":"2024-09-13T17:09:18.962310+0000","last_unstale":"2024-09-13T17:09:19.937327+0000","last_undegraded":"2024-09-13T17:09:19.937327+0000","last_fullsized":"2024-09-13T17:09:19.937327+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:21.868206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943506+0000","last_change":"2024-09-13T17:09:18.572437+0000","last_active":"2024-09-13T17:09:19.943506+0000","last_peered":"2024-09-13T17:09:19.943506+0000","last_clean":"2024-09-13T17:09:19.943506+0000","last_became_active":"2024-09-13T17:09:18.569400+0000","last_became_peered":"2024-09-13T17:09:18.569400+0000","last_unstale":"2024-09-13T17:09:19.943506+0000","last_undegraded":"2024-09-13T17:09:19.943506+0000","last_fullsized":"2024-09-13T17:09:19.943506+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:09.453030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943325+0000","last_change":"2024-09-13T17:09:18.967736+0000","last_active":"2024-09-13T17:09:19.943325+0000","last_peered":"2024-09-13T17:09:19.943325+0000","last_clean":"2024-09-13T17:09:19.943325+0000","last_became_active":"2024-09-13T17:09:18.967053+0000","last_became_peered":"2024-09-13T17:09:18.967053+0000","last_unstale":"2024-09-13T17:09:19.943325+0000","last_undegraded":"2024-09-13T17:09:19.943325+0000","last_fullsized":"2024-09-13T17:09:19.943325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:04.472086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936352+0000","last_change":"2024-09-13T17:09:18.568473+0000","last_active":"2024-09-13T17:09:19.936352+0000","last_peered":"2024-09-13T17:09:19.936352+0000","last_clean":"2024-09-13T17:09:19.936352+0000","last_became_active":"2024-09-13T17:09:18.568222+0000","last_became_peered":"2024-09-13T17:09:18.568222+0000","last_unstale":"2024-09-13T17:09:19.936352+0000","last_undegraded":"2024-09-13T17:09:19.936352+0000","last_fullsized":"2024-09-13T17:09:19.936352+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:34.280380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937941+0000","last_change":"2024-09-13T17:09:18.956809+0000","last_active":"2024-09-13T17:09:19.937941+0000","last_peered":"2024-09-13T17:09:19.937941+0000","last_clean":"2024-09-13T17:09:19.937941+0000","last_became_active":"2024-09-13T17:09:18.956257+0000","last_became_peered":"2024-09-13T17:09:18.956257+0000","last_unstale":"2024-09-13T17:09:19.937941+0000","last_undegraded":"2024-09-13T17:09:19.937941+0000","last_fullsized":"2024-09-13T17:09:19.937941+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:13.420104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941314+0000","last_change":"2024-09-13T17:09:18.574633+0000","last_active":"2024-09-13T17:09:19.941314+0000","last_peered":"2024-09-13T17:09:19.941314+0000","last_clean":"2024-09-13T17:09:19.941314+0000","last_became_active":"2024-09-13T17:09:18.574396+0000","last_became_peered":"2024-09-13T17:09:18.574396+0000","last_unstale":"2024-09-13T17:09:19.941314+0000","last_undegraded":"2024-09-13T17:09:19.941314+0000","last_fullsized":"2024-09-13T17:09:19.941314+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:25.906140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936564+0000","last_change":"2024-09-13T17:09:18.961376+0000","last_active":"2024-09-13T17:09:19.936564+0000","last_peered":"2024-09-13T17:09:19.936564+0000","last_clean":"2024-09-13T17:09:19.936564+0000","last_became_active":"2024-09-13T17:09:18.957967+0000","last_became_peered":"2024-09-13T17:09:18.957967+0000","last_unstale":"2024-09-13T17:09:19.936564+0000","last_undegraded":"2024-09-13T17:09:19.936564+0000","last_fullsized":"2024-09-13T17:09:19.936564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:18.591891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941529+0000","last_change":"2024-09-13T17:09:18.561394+0000","last_active":"2024-09-13T17:09:19.941529+0000","last_peered":"2024-09-13T17:09:19.941529+0000","last_clean":"2024-09-13T17:09:19.941529+0000","last_became_active":"2024-09-13T17:09:18.561063+0000","last_became_peered":"2024-09-13T17:09:18.561063+0000","last_unstale":"2024-09-13T17:09:19.941529+0000","last_undegraded":"2024-09-13T17:09:19.941529+0000","last_fullsized":"2024-09-13T17:09:19.941529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:09.453030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942247+0000","last_change":"2024-09-13T17:09:18.957191+0000","last_active":"2024-09-13T17:09:19.942247+0000","last_peered":"2024-09-13T17:09:19.942247+0000","last_clean":"2024-09-13T17:09:19.942247+0000","last_became_active":"2024-09-13T17:09:18.956895+0000","last_became_peered":"2024-09-13T17:09:18.956895+0000","last_unstale":"2024-09-13T17:09:19.942247+0000","last_undegraded":"2024-09-13T17:09:19.942247+0000","last_fullsized":"2024-09-13T17:09:19.942247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:09.378119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943217+0000","last_change":"2024-09-13T17:09:18.578755+0000","last_active":"2024-09-13T17:09:19.943217+0000","last_peered":"2024-09-13T17:09:19.943217+0000","last_clean":"2024-09-13T17:09:19.943217+0000","last_became_active":"2024-09-13T17:09:18.578479+0000","last_became_peered":"2024-09-13T17:09:18.578479+0000","last_unstale":"2024-09-13T17:09:19.943217+0000","last_undegraded":"2024-09-13T17:09:19.943217+0000","last_fullsized":"2024-09-13T17:09:19.943217+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:37.548564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940502+0000","last_change":"2024-09-13T17:09:18.963057+0000","last_active":"2024-09-13T17:09:19.940502+0000","last_peered":"2024-09-13T17:09:19.940502+0000","last_clean":"2024-09-13T17:09:19.940502+0000","last_became_active":"2024-09-13T17:09:18.962780+0000","last_became_peered":"2024-09-13T17:09:18.962780+0000","last_unstale":"2024-09-13T17:09:19.940502+0000","last_undegraded":"2024-09-13T17:09:19.940502+0000","last_fullsized":"2024-09-13T17:09:19.940502+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:33.093375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942341+0000","last_change":"2024-09-13T17:09:18.573406+0000","last_active":"2024-09-13T17:09:19.942341+0000","last_peered":"2024-09-13T17:09:19.942341+0000","last_clean":"2024-09-13T17:09:19.942341+0000","last_became_active":"2024-09-13T17:09:18.573144+0000","last_became_peered":"2024-09-13T17:09:18.573144+0000","last_unstale":"2024-09-13T17:09:19.942341+0000","last_undegraded":"2024-09-13T17:09:19.942341+0000","last_fullsized":"2024-09-13T17:09:19.942341+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:03.462354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936897+0000","last_change":"2024-09-13T17:09:18.954079+0000","last_active":"2024-09-13T17:09:19.936897+0000","last_peered":"2024-09-13T17:09:19.936897+0000","last_clean":"2024-09-13T17:09:19.936897+0000","last_became_active":"2024-09-13T17:09:18.953709+0000","last_became_peered":"2024-09-13T17:09:18.953709+0000","last_unstale":"2024-09-13T17:09:19.936897+0000","last_undegraded":"2024-09-13T17:09:19.936897+0000","last_fullsized":"2024-09-13T17:09:19.936897+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:43.902762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941660+0000","last_change":"2024-09-13T17:09:18.571135+0000","last_active":"2024-09-13T17:09:19.941660+0000","last_peered":"2024-09-13T17:09:19.941660+0000","last_clean":"2024-09-13T17:09:19.941660+0000","last_became_active":"2024-09-13T17:09:18.570580+0000","last_became_peered":"2024-09-13T17:09:18.570580+0000","last_unstale":"2024-09-13T17:09:19.941660+0000","last_undegraded":"2024-09-13T17:09:19.941660+0000","last_fullsized":"2024-09-13T17:09:19.941660+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:42.000212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943767+0000","last_change":"2024-09-13T17:09:18.953447+0000","last_active":"2024-09-13T17:09:19.943767+0000","last_peered":"2024-09-13T17:09:19.943767+0000","last_clean":"2024-09-13T17:09:19.943767+0000","last_became_active":"2024-09-13T17:09:18.952366+0000","last_became_peered":"2024-09-13T17:09:18.952366+0000","last_unstale":"2024-09-13T17:09:19.943767+0000","last_undegraded":"2024-09-13T17:09:19.943767+0000","last_fullsized":"2024-09-13T17:09:19.943767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:59.867400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943172+0000","last_change":"2024-09-13T17:09:18.578388+0000","last_active":"2024-09-13T17:09:19.943172+0000","last_peered":"2024-09-13T17:09:19.943172+0000","last_clean":"2024-09-13T17:09:19.943172+0000","last_became_active":"2024-09-13T17:09:18.578079+0000","last_became_peered":"2024-09-13T17:09:18.578079+0000","last_unstale":"2024-09-13T17:09:19.943172+0000","last_undegraded":"2024-09-13T17:09:19.943172+0000","last_fullsized":"2024-09-13T17:09:19.943172+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:12.314225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937325+0000","last_change":"2024-09-13T17:09:18.964647+0000","last_active":"2024-09-13T17:09:19.937325+0000","last_peered":"2024-09-13T17:09:19.937325+0000","last_clean":"2024-09-13T17:09:19.937325+0000","last_became_active":"2024-09-13T17:09:18.962594+0000","last_became_peered":"2024-09-13T17:09:18.962594+0000","last_unstale":"2024-09-13T17:09:19.937325+0000","last_undegraded":"2024-09-13T17:09:19.937325+0000","last_fullsized":"2024-09-13T17:09:19.937325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:33.093375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943802+0000","last_change":"2024-09-13T17:09:18.574680+0000","last_active":"2024-09-13T17:09:19.943802+0000","last_peered":"2024-09-13T17:09:19.943802+0000","last_clean":"2024-09-13T17:09:19.943802+0000","last_became_active":"2024-09-13T17:09:18.574380+0000","last_became_peered":"2024-09-13T17:09:18.574380+0000","last_unstale":"2024-09-13T17:09:19.943802+0000","last_undegraded":"2024-09-13T17:09:19.943802+0000","last_fullsized":"2024-09-13T17:09:19.943802+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:15.266355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941267+0000","last_change":"2024-09-13T17:09:18.955140+0000","last_active":"2024-09-13T17:09:19.941267+0000","last_peered":"2024-09-13T17:09:19.941267+0000","last_clean":"2024-09-13T17:09:19.941267+0000","last_became_active":"2024-09-13T17:09:18.954560+0000","last_became_peered":"2024-09-13T17:09:18.954560+0000","last_unstale":"2024-09-13T17:09:19.941267+0000","last_undegraded":"2024-09-13T17:09:19.941267+0000","last_fullsized":"2024-09-13T17:09:19.941267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:21.816947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943080+0000","last_change":"2024-09-13T17:09:18.572911+0000","last_active":"2024-09-13T17:09:19.943080+0000","last_peered":"2024-09-13T17:09:19.943080+0000","last_clean":"2024-09-13T17:09:19.943080+0000","last_became_active":"2024-09-13T17:09:18.572655+0000","last_became_peered":"2024-09-13T17:09:18.572655+0000","last_unstale":"2024-09-13T17:09:19.943080+0000","last_undegraded":"2024-09-13T17:09:19.943080+0000","last_fullsized":"2024-09-13T17:09:19.943080+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:08.049835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.938064+0000","last_change":"2024-09-13T17:09:18.966216+0000","last_active":"2024-09-13T17:09:19.938064+0000","last_peered":"2024-09-13T17:09:19.938064+0000","last_clean":"2024-09-13T17:09:19.938064+0000","last_became_active":"2024-09-13T17:09:18.965930+0000","last_became_peered":"2024-09-13T17:09:18.965930+0000","last_unstale":"2024-09-13T17:09:19.938064+0000","last_undegraded":"2024-09-13T17:09:19.938064+0000","last_fullsized":"2024-09-13T17:09:19.938064+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:09.059566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936812+0000","last_change":"2024-09-13T17:09:18.574361+0000","last_active":"2024-09-13T17:09:19.936812+0000","last_peered":"2024-09-13T17:09:19.936812+0000","last_clean":"2024-09-13T17:09:19.936812+0000","last_became_active":"2024-09-13T17:09:18.574094+0000","last_became_peered":"2024-09-13T17:09:18.574094+0000","last_unstale":"2024-09-13T17:09:19.936812+0000","last_undegraded":"2024-09-13T17:09:19.936812+0000","last_fullsized":"2024-09-13T17:09:19.936812+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:58.857669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936093+0000","last_change":"2024-09-13T17:09:18.946132+0000","last_active":"2024-09-13T17:09:19.936093+0000","last_peered":"2024-09-13T17:09:19.936093+0000","last_clean":"2024-09-13T17:09:19.936093+0000","last_became_active":"2024-09-13T17:09:18.945851+0000","last_became_peered":"2024-09-13T17:09:18.945851+0000","last_unstale":"2024-09-13T17:09:19.936093+0000","last_undegraded":"2024-09-13T17:09:19.936093+0000","last_fullsized":"2024-09-13T17:09:19.936093+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:52.215517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943338+0000","last_change":"2024-09-13T17:09:18.576182+0000","last_active":"2024-09-13T17:09:19.943338+0000","last_peered":"2024-09-13T17:09:19.943338+0000","last_clean":"2024-09-13T17:09:19.943338+0000","last_became_active":"2024-09-13T17:09:18.575888+0000","last_became_peered":"2024-09-13T17:09:18.575888+0000","last_unstale":"2024-09-13T17:09:19.943338+0000","last_undegraded":"2024-09-13T17:09:19.943338+0000","last_fullsized":"2024-09-13T17:09:19.943338+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:02.019904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.935588+0000","last_change":"2024-09-13T17:09:18.965748+0000","last_active":"2024-09-13T17:09:19.935588+0000","last_peered":"2024-09-13T17:09:19.935588+0000","last_clean":"2024-09-13T17:09:19.935588+0000","last_became_active":"2024-09-13T17:09:18.965454+0000","last_became_peered":"2024-09-13T17:09:18.965454+0000","last_unstale":"2024-09-13T17:09:19.935588+0000","last_undegraded":"2024-09-13T17:09:19.935588+0000","last_fullsized":"2024-09-13T17:09:19.935588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:18.591891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942583+0000","last_change":"2024-09-13T17:09:18.578496+0000","last_active":"2024-09-13T17:09:19.942583+0000","last_peered":"2024-09-13T17:09:19.942583+0000","last_clean":"2024-09-13T17:09:19.942583+0000","last_became_active":"2024-09-13T17:09:18.578236+0000","last_became_peered":"2024-09-13T17:09:18.578236+0000","last_unstale":"2024-09-13T17:09:19.942583+0000","last_undegraded":"2024-09-13T17:09:19.942583+0000","last_fullsized":"2024-09-13T17:09:19.942583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:21.257542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.935768+0000","last_change":"2024-09-13T17:09:18.962220+0000","last_active":"2024-09-13T17:09:19.935768+0000","last_peered":"2024-09-13T17:09:19.935768+0000","last_clean":"2024-09-13T17:09:19.935768+0000","last_became_active":"2024-09-13T17:09:18.961919+0000","last_became_peered":"2024-09-13T17:09:18.961919+0000","last_unstale":"2024-09-13T17:09:19.935768+0000","last_undegraded":"2024-09-13T17:09:19.935768+0000","last_fullsized":"2024-09-13T17:09:19.935768+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:10.380507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940499+0000","last_change":"2024-09-13T17:09:18.579360+0000","last_active":"2024-09-13T17:09:19.940499+0000","last_peered":"2024-09-13T17:09:19.940499+0000","last_clean":"2024-09-13T17:09:19.940499+0000","last_became_active":"2024-09-13T17:09:18.579068+0000","last_became_peered":"2024-09-13T17:09:18.579068+0000","last_unstale":"2024-09-13T17:09:19.940499+0000","last_undegraded":"2024-09-13T17:09:19.940499+0000","last_fullsized":"2024-09-13T17:09:19.940499+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:58.857669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940895+0000","last_change":"2024-09-13T17:09:18.951069+0000","last_active":"2024-09-13T17:09:19.940895+0000","last_peered":"2024-09-13T17:09:19.940895+0000","last_clean":"2024-09-13T17:09:19.940895+0000","last_became_active":"2024-09-13T17:09:18.950839+0000","last_became_peered":"2024-09-13T17:09:18.950839+0000","last_unstale":"2024-09-13T17:09:19.940895+0000","last_undegraded":"2024-09-13T17:09:19.940895+0000","last_fullsized":"2024-09-13T17:09:19.940895+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:52.215517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943315+0000","last_change":"2024-09-13T17:09:18.574583+0000","last_active":"2024-09-13T17:09:19.943315+0000","last_peered":"2024-09-13T17:09:19.943315+0000","last_clean":"2024-09-13T17:09:19.943315+0000","last_became_active":"2024-09-13T17:09:18.573761+0000","last_became_peered":"2024-09-13T17:09:18.573761+0000","last_unstale":"2024-09-13T17:09:19.943315+0000","last_undegraded":"2024-09-13T17:09:19.943315+0000","last_fullsized":"2024-09-13T17:09:19.943315+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:42.893031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942215+0000","last_change":"2024-09-13T17:09:18.955870+0000","last_active":"2024-09-13T17:09:19.942215+0000","last_peered":"2024-09-13T17:09:19.942215+0000","last_clean":"2024-09-13T17:09:19.942215+0000","last_became_active":"2024-09-13T17:09:18.955619+0000","last_became_peered":"2024-09-13T17:09:18.955619+0000","last_unstale":"2024-09-13T17:09:19.942215+0000","last_undegraded":"2024-09-13T17:09:19.942215+0000","last_fullsized":"2024-09-13T17:09:19.942215+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:19.040493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942468+0000","last_change":"2024-09-13T17:09:18.576195+0000","last_active":"2024-09-13T17:09:19.942468+0000","last_peered":"2024-09-13T17:09:19.942468+0000","last_clean":"2024-09-13T17:09:19.942468+0000","last_became_active":"2024-09-13T17:09:18.575801+0000","last_became_peered":"2024-09-13T17:09:18.575801+0000","last_unstale":"2024-09-13T17:09:19.942468+0000","last_undegraded":"2024-09-13T17:09:19.942468+0000","last_fullsized":"2024-09-13T17:09:19.942468+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:17.720159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936637+0000","last_change":"2024-09-13T17:09:18.964805+0000","last_active":"2024-09-13T17:09:19.936637+0000","last_peered":"2024-09-13T17:09:19.936637+0000","last_clean":"2024-09-13T17:09:19.936637+0000","last_became_active":"2024-09-13T17:09:18.964551+0000","last_became_peered":"2024-09-13T17:09:18.964551+0000","last_unstale":"2024-09-13T17:09:19.936637+0000","last_undegraded":"2024-09-13T17:09:19.936637+0000","last_fullsized":"2024-09-13T17:09:19.936637+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:06.821655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.938287+0000","last_change":"2024-09-13T17:09:18.573784+0000","last_active":"2024-09-13T17:09:19.938287+0000","last_peered":"2024-09-13T17:09:19.938287+0000","last_clean":"2024-09-13T17:09:19.938287+0000","last_became_active":"2024-09-13T17:09:18.573498+0000","last_became_peered":"2024-09-13T17:09:18.573498+0000","last_unstale":"2024-09-13T17:09:19.938287+0000","last_undegraded":"2024-09-13T17:09:19.938287+0000","last_fullsized":"2024-09-13T17:09:19.938287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:58.658075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937325+0000","last_change":"2024-09-13T17:09:18.965371+0000","last_active":"2024-09-13T17:09:19.937325+0000","last_peered":"2024-09-13T17:09:19.937325+0000","last_clean":"2024-09-13T17:09:19.937325+0000","last_became_active":"2024-09-13T17:09:18.965019+0000","last_became_peered":"2024-09-13T17:09:18.965019+0000","last_unstale":"2024-09-13T17:09:19.937325+0000","last_undegraded":"2024-09-13T17:09:19.937325+0000","last_fullsized":"2024-09-13T17:09:19.937325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:52.215517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940785+0000","last_change":"2024-09-13T17:09:18.567360+0000","last_active":"2024-09-13T17:09:19.940785+0000","last_peered":"2024-09-13T17:09:19.940785+0000","last_clean":"2024-09-13T17:09:19.940785+0000","last_became_active":"2024-09-13T17:09:18.567073+0000","last_became_peered":"2024-09-13T17:09:18.567073+0000","last_unstale":"2024-09-13T17:09:19.940785+0000","last_undegraded":"2024-09-13T17:09:19.940785+0000","last_fullsized":"2024-09-13T17:09:19.940785+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:17.546280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937707+0000","last_change":"2024-09-13T17:09:18.952386+0000","last_active":"2024-09-13T17:09:19.937707+0000","last_peered":"2024-09-13T17:09:19.937707+0000","last_clean":"2024-09-13T17:09:19.937707+0000","last_became_active":"2024-09-13T17:09:18.952150+0000","last_became_peered":"2024-09-13T17:09:18.952150+0000","last_unstale":"2024-09-13T17:09:19.937707+0000","last_undegraded":"2024-09-13T17:09:19.937707+0000","last_fullsized":"2024-09-13T17:09:19.937707+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:58.644912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937291+0000","last_change":"2024-09-13T17:09:18.570962+0000","last_active":"2024-09-13T17:09:19.937291+0000","last_peered":"2024-09-13T17:09:19.937291+0000","last_clean":"2024-09-13T17:09:19.937291+0000","last_became_active":"2024-09-13T17:09:18.570738+0000","last_became_peered":"2024-09-13T17:09:18.570738+0000","last_unstale":"2024-09-13T17:09:19.937291+0000","last_undegraded":"2024-09-13T17:09:19.937291+0000","last_fullsized":"2024-09-13T17:09:19.937291+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:31.576457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942811+0000","last_change":"2024-09-13T17:09:18.961177+0000","last_active":"2024-09-13T17:09:19.942811+0000","last_peered":"2024-09-13T17:09:19.942811+0000","last_clean":"2024-09-13T17:09:19.942811+0000","last_became_active":"2024-09-13T17:09:18.960872+0000","last_became_peered":"2024-09-13T17:09:18.960872+0000","last_unstale":"2024-09-13T17:09:19.942811+0000","last_undegraded":"2024-09-13T17:09:19.942811+0000","last_fullsized":"2024-09-13T17:09:19.942811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:24.367806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941066+0000","last_change":"2024-09-13T17:09:18.570035+0000","last_active":"2024-09-13T17:09:19.941066+0000","last_peered":"2024-09-13T17:09:19.941066+0000","last_clean":"2024-09-13T17:09:19.941066+0000","last_became_active":"2024-09-13T17:09:18.569787+0000","last_became_peered":"2024-09-13T17:09:18.569787+0000","last_unstale":"2024-09-13T17:09:19.941066+0000","last_undegraded":"2024-09-13T17:09:19.941066+0000","last_fullsized":"2024-09-13T17:09:19.941066+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:01.281283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941303+0000","last_change":"2024-09-13T17:09:18.945787+0000","last_active":"2024-09-13T17:09:19.941303+0000","last_peered":"2024-09-13T17:09:19.941303+0000","last_clean":"2024-09-13T17:09:19.941303+0000","last_became_active":"2024-09-13T17:09:18.945485+0000","last_became_peered":"2024-09-13T17:09:18.945485+0000","last_unstale":"2024-09-13T17:09:19.941303+0000","last_undegraded":"2024-09-13T17:09:19.941303+0000","last_fullsized":"2024-09-13T17:09:19.941303+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:44.916986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941729+0000","last_change":"2024-09-13T17:09:18.571282+0000","last_active":"2024-09-13T17:09:19.941729+0000","last_peered":"2024-09-13T17:09:19.941729+0000","last_clean":"2024-09-13T17:09:19.941729+0000","last_became_active":"2024-09-13T17:09:18.570614+0000","last_became_peered":"2024-09-13T17:09:18.570614+0000","last_unstale":"2024-09-13T17:09:19.941729+0000","last_undegraded":"2024-09-13T17:09:19.941729+0000","last_fullsized":"2024-09-13T17:09:19.941729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:43.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942814+0000","last_change":"2024-09-13T17:09:18.960450+0000","last_active":"2024-09-13T17:09:19.942814+0000","last_peered":"2024-09-13T17:09:19.942814+0000","last_clean":"2024-09-13T17:09:19.942814+0000","last_became_active":"2024-09-13T17:09:18.960153+0000","last_became_peered":"2024-09-13T17:09:18.960153+0000","last_unstale":"2024-09-13T17:09:19.942814+0000","last_undegraded":"2024-09-13T17:09:19.942814+0000","last_fullsized":"2024-09-13T17:09:19.942814+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:25.491580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942926+0000","last_change":"2024-09-13T17:09:18.569812+0000","last_active":"2024-09-13T17:09:19.942926+0000","last_peered":"2024-09-13T17:09:19.942926+0000","last_clean":"2024-09-13T17:09:19.942926+0000","last_became_active":"2024-09-13T17:09:18.566802+0000","last_became_peered":"2024-09-13T17:09:18.566802+0000","last_unstale":"2024-09-13T17:09:19.942926+0000","last_undegraded":"2024-09-13T17:09:19.942926+0000","last_fullsized":"2024-09-13T17:09:19.942926+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:01.281283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936095+0000","last_change":"2024-09-13T17:09:18.964054+0000","last_active":"2024-09-13T17:09:19.936095+0000","last_peered":"2024-09-13T17:09:19.936095+0000","last_clean":"2024-09-13T17:09:19.936095+0000","last_became_active":"2024-09-13T17:09:18.963701+0000","last_became_peered":"2024-09-13T17:09:18.963701+0000","last_unstale":"2024-09-13T17:09:19.936095+0000","last_undegraded":"2024-09-13T17:09:19.936095+0000","last_fullsized":"2024-09-13T17:09:19.936095+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:21.868206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942813+0000","last_change":"2024-09-13T17:09:18.567005+0000","last_active":"2024-09-13T17:09:19.942813+0000","last_peered":"2024-09-13T17:09:19.942813+0000","last_clean":"2024-09-13T17:09:19.942813+0000","last_became_active":"2024-09-13T17:09:18.566720+0000","last_became_peered":"2024-09-13T17:09:18.566720+0000","last_unstale":"2024-09-13T17:09:19.942813+0000","last_undegraded":"2024-09-13T17:09:19.942813+0000","last_fullsized":"2024-09-13T17:09:19.942813+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:25.906140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":217,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T17:09:18.945720+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:09:18.945720+0000","last_peered":"2024-09-13T17:09:18.945720+0000","last_clean":"2024-09-13T17:09:18.945720+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:09:18.945720+0000","last_undegraded":"2024-09-13T17:09:18.945720+0000","last_fullsized":"2024-09-13T17:09:18.945720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1478656,"data_stored":960558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85299999999999998,"15min":0.85499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90300000000000002,"15min":0.91400000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.71699999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91900000000000004,"15min":0.92500000000000004},"min":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.415,"5min":1.456,"15min":1.456},"last":1.1839999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.84999999999999998,"15min":0.84399999999999997},"min":{"1min":0.58899999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.99399999999999999,"15min":1.0069999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.99299999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91900000000000004,"15min":0.91700000000000004},"min":{"1min":0.63100000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.208,"5min":1.288,"15min":1.288},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.98999999999999999,"15min":1},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.88}]},{"osd":4,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.90900000000000003,"15min":0.90400000000000003},"min":{"1min":0.65000000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.119,"15min":1.1240000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.071}]},{"osd":5,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0329999999999999,"15min":1.0389999999999999},"min":{"1min":0.69699999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.395,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.111},{"interface":"front","average":{"1min":1.044,"5min":1.022,"15min":1.018},"min":{"1min":0.77200000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0920000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.1140000000000001,"15min":1.1279999999999999},"min":{"1min":0.76600000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.405,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.1339999999999999,"15min":1.139},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.452,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.143}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":369666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.75600000000000001,"15min":0.754},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97799999999999998,"5min":1.024,"15min":1.024},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.872,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.27,"5min":1.431,"15min":1.431},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91600000000000004,"15min":0.92400000000000004},"min":{"1min":0.60399999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.161,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91400000000000003,"15min":0.91200000000000003},"min":{"1min":0.64300000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.179,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.84499999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.60799999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1459999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.96599999999999997,"15min":0.98199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1379999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.0649999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.96099999999999997,"15min":0.97799999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.0700000000000001,"5min":1.359,"15min":1.359},"last":1.01},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0509999999999999,"15min":1.054},"min":{"1min":0.79900000000000004,"5min":0.749,"15min":0.749},"max":{"1min":1.262,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.153}]},{"osd":4,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.90700000000000003,"15min":0.90900000000000003},"min":{"1min":0.626,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0209999999999999,"15min":1.024},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.2070000000000001,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0169999999999999,"15min":1.0189999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.087},{"interface":"front","average":{"1min":1.044,"5min":1.069,"15min":1.073},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.264,"5min":1.597,"15min":1.597},"last":0.90000000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1060000000000001,"15min":1.109},"min":{"1min":0.79900000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3360000000000001,"5min":1.728,"15min":1.728},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.131,"5min":1.1870000000000001,"15min":1.1970000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.518,"5min":2.194,"15min":2.194},"last":1.204}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":369664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.86399999999999999,"15min":0.872},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1339999999999999,"5min":1.395,"15min":1.395},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.879,"15min":0.88800000000000001},"min":{"1min":0.56999999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.65600000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.94999999999999996,"15min":0.95799999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.339,"5min":1.508,"15min":1.508},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.622,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.97099999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84899999999999998,"15min":0.85199999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.137,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.879},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.91200000000000003,"15min":0.92100000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2370000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.98599999999999999,"15min":1.004},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.377,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.147},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91700000000000004,"15min":0.93000000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.272,"5min":1.603,"15min":1.603},"last":0.83599999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.044,"15min":1.0660000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1180000000000001,"5min":1.466,"15min":1.466},"last":1.208},{"interface":"front","average":{"1min":0.90700000000000003,"5min":1.0189999999999999,"15min":1.038},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2090000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.0549999999999999,"15min":1.071},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.347,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.04,"5min":1.171,"15min":1.1930000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.248,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.1299999999999999,"15min":1.1479999999999999},"min":{"1min":0.78500000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5269999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.1930000000000001,"15min":1.2130000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.4530000000000001,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.0309999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":369644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.82299999999999995,"15min":0.83599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0589999999999999,"5min":1.306,"15min":1.306},"last":0.89600000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91000000000000003,"15min":0.90900000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.29,"5min":1.357,"15min":1.357},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88900000000000001,"15min":0.88300000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.92400000000000004,"15min":0.91000000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.024}]},{"osd":3,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.91200000000000003,"15min":0.92200000000000004},"min":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1990000000000001,"5min":1.464,"15min":1.464},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.89300000000000002,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.94999999999999996,"15min":0.94099999999999995},"min":{"1min":0.63600000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0640000000000001,"15min":1.0620000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.131}]},{"osd":6,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.96899999999999997,"15min":0.97299999999999998},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.208,"5min":1.26,"15min":1.26},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.048,"15min":1.044},"min":{"1min":0.77000000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.97599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.083,"15min":1.085},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.4119999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.129,"15min":1.127},"min":{"1min":0.93000000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":1.0449999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":369686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75800000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.33600000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.82799999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.32500000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83899999999999997,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.56399999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96599999999999997,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.38}]},{"osd":2,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.76200000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.505},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.51800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.96199999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91700000000000004,"15min":0.92400000000000004},"min":{"1min":0.66500000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1759999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.73699999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.0149999999999999,"5min":1.899,"15min":1.899},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.91700000000000004,"15min":0.92900000000000005},"min":{"1min":0.59499999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.94399999999999995,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.99399999999999999,"15min":0.996},"min":{"1min":0.72699999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.337,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.44800000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.018,"15min":1.024},"min":{"1min":0.754,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.157,"5min":1.635,"15min":1.635},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.028,"15min":1.044},"min":{"1min":0.71499999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1970000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.085,"15min":1.093},"min":{"1min":0.746,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.288,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.78700000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2549999999999999,"5min":1.756,"15min":1.756},"last":0.57299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":371138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.505},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.628,"15min":0.63500000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.81200000000000006}]},{"osd":1,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.86199999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.76600000000000001,"15min":0.77900000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.038,"5min":1.103,"15min":1.103},"last":0.84999999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.93600000000000005,"15min":0.94499999999999995},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2190000000000001,"5min":1.3,"15min":1.3},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92900000000000005,"15min":0.92700000000000005},"min":{"1min":0.748,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.93000000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.95499999999999996,"15min":0.95799999999999996},"min":{"1min":0.76300000000000001,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.92000000000000004,"15min":0.91600000000000004},"min":{"1min":0.70799999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.1950000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.67000000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.194,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.999,"15min":0.99199999999999999},"min":{"1min":0.82699999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.95799999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0529999999999999,"15min":1.0609999999999999},"min":{"1min":0.78600000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.998,"5min":1.03,"15min":1.0349999999999999},"min":{"1min":0.73599999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.268,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.3460000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":897024,"data_stored":371754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.48899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.873,"5min":1.151,"15min":1.151},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65900000000000003,"15min":0.66900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86699999999999999,"5min":1.306,"15min":1.306},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.752,"15min":0.755},"min":{"1min":0.38800000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.98399999999999999,"5min":1.28,"15min":1.28},"last":0.91100000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.437,"5min":0.308,"15min":0.308},"max":{"1min":1.0149999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0269999999999999,"5min":1.905,"15min":1.905},"last":0.99399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.96099999999999997,"15min":0.96599999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3580000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.073},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.026,"15min":1.0389999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.202,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.111}]},{"osd":5,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0669999999999999,"15min":1.0780000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3140000000000001,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.038,"5min":1.107,"15min":1.119},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.377,"5min":1.556,"15min":1.556},"last":1.034}]},{"osd":6,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0700000000000001,"15min":1.0820000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4530000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1339999999999999,"15min":1.1439999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4199999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.95499999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.1539999999999999,"15min":1.165},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3839999999999999,"5min":1.712,"15min":1.712},"last":1.21},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.095,"15min":1.101},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5720000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.179}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1470464,"data_stored":959942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.38400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.99399999999999999,"5min":3.25,"15min":3.25},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.80700000000000005,"15min":0.81999999999999995},"min":{"1min":0.53100000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95599999999999996,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.626}]},{"osd":2,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.91800000000000004,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.85999999999999999,"15min":0.89000000000000001},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.999,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.84599999999999997,"15min":0.874},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96299999999999997,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.439},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.94499999999999995,"15min":0.97099999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.333,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.012,"15min":1.0329999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5289999999999999,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0449999999999999,"15min":1.0620000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.4239999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.069,"15min":1.083},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.421,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.091,"15min":1.1180000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.222,"5min":5.399,"15min":5.399},"last":0.86199999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.143,"15min":1.161},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.482,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.032,"5min":1.111,"15min":1.1240000000000001},"min":{"1min":0.79100000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3720000000000001,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.879}]},{"osd":7,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.127,"15min":1.135},"min":{"1min":0.76200000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6379999999999999,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.202,"15min":1.23},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5760000000000001,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":0.94299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:09:22.996 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:09:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe437fff700 1 Processor -- start 2024-09-13T17:09:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe437fff700 1 -- start start 2024-09-13T17:09:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe437fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4380b1ac0 0x7fe4380b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe437fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe4380ce4a0 0x7fe4380ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe437fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4380b2460 con 0x7fe438160210 2024-09-13T17:09:23.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe437fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43806cfb0 con 0x7fe4380ce4a0 2024-09-13T17:09:23.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe437fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43806d290 con 0x7fe4380b1ac0 2024-09-13T17:09:23.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe4377fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe4380ce4a0 0x7fe4380ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe4377fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe4380ce4a0 0x7fe4380ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52780/0 (socket says 172.21.15.123:52780) 2024-09-13T17:09:23.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe4377fe700 1 -- 172.21.15.123:0/1973861121 learned_addr learned my addr 172.21.15.123:0/1973861121 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:23.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe436ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe438160210 0x7fe4380ccbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38128/0 (socket says 172.21.15.123:38128) 2024-09-13T17:09:23.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe4367fc700 1 --2- 172.21.15.123:0/1973861121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4380b1ac0 0x7fe4380b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe4377fe700 1 -- 172.21.15.123:0/1973861121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4380b1ac0 msgr2=0x7fe4380b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:23.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe4377fe700 1 --2- 172.21.15.123:0/1973861121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4380b1ac0 0x7fe4380b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe4377fe700 1 -- 172.21.15.123:0/1973861121 >> v1:172.21.15.123:6789/0 conn(0x7fe438160210 legacy=0x7fe4380ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe4377fe700 1 -- 172.21.15.123:0/1973861121 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43806d570 con 0x7fe4380ce4a0 2024-09-13T17:09:23.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe4377fe700 1 --2- 172.21.15.123:0/1973861121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4380ce4a0 0x7fe4380ce950 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe430009e50 tx=0x7fe43000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4fe45710f22d15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:23.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe435ffb700 1 -- 172.21.15.123:0/1973861121 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43000e070 con 0x7fe4380ce4a0 2024-09-13T17:09:23.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe435ffb700 1 -- 172.21.15.123:0/1973861121 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43000b9c0 con 0x7fe4380ce4a0 2024-09-13T17:09:23.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.102+0000 7fe435ffb700 1 -- 172.21.15.123:0/1973861121 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43000bd70 con 0x7fe4380ce4a0 2024-09-13T17:09:23.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.106+0000 7fe437fff700 1 -- 172.21.15.123:0/1973861121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4380ce4a0 msgr2=0x7fe4380ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.106+0000 7fe437fff700 1 --2- 172.21.15.123:0/1973861121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4380ce4a0 0x7fe4380ce950 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe430009e50 tx=0x7fe43000b330 comp rx=0 tx=0).stop 2024-09-13T17:09:23.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.106+0000 7fe437fff700 1 -- 172.21.15.123:0/1973861121 shutdown_connections 2024-09-13T17:09:23.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.106+0000 7fe437fff700 1 --2- 172.21.15.123:0/1973861121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4380ce4a0 0x7fe4380ce950 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.106+0000 7fe437fff700 1 --2- 172.21.15.123:0/1973861121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4380b1ac0 0x7fe4380b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.106+0000 7fe437fff700 1 -- 172.21.15.123:0/1973861121 >> 172.21.15.123:0/1973861121 conn(0x7fe438066570 msgr2=0x7fe438066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:23.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.106+0000 7fe437fff700 1 -- 172.21.15.123:0/1973861121 shutdown_connections 2024-09-13T17:09:23.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.106+0000 7fe437fff700 1 -- 172.21.15.123:0/1973861121 wait complete. 2024-09-13T17:09:23.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.106+0000 7fe437fff700 1 Processor -- start 2024-09-13T17:09:23.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.106+0000 7fe437fff700 1 -- start start 2024-09-13T17:09:23.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe437fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4380b1ac0 0x7fe43815e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe437fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4380ce4a0 0x7fe4380cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe437fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe438160210 0x7fe438148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe437fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380c4890 con 0x7fe438160210 2024-09-13T17:09:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe437fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43815e5b0 con 0x7fe4380ce4a0 2024-09-13T17:09:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe437fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380cc060 con 0x7fe4380b1ac0 2024-09-13T17:09:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe4377fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe438160210 0x7fe438148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe4377fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe438160210 0x7fe438148120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52796/0 (socket says 172.21.15.123:52796) 2024-09-13T17:09:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe4377fe700 1 -- 172.21.15.123:0/1697035700 learned_addr learned my addr 172.21.15.123:0/1697035700 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe4367fc700 1 --2- 172.21.15.123:0/1697035700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4380ce4a0 0x7fe4380cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe436ffd700 1 --2- 172.21.15.123:0/1697035700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4380b1ac0 0x7fe43815e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe4377fe700 1 -- 172.21.15.123:0/1697035700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4380b1ac0 msgr2=0x7fe43815e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe4377fe700 1 --2- 172.21.15.123:0/1697035700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4380b1ac0 0x7fe43815e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe4377fe700 1 -- 172.21.15.123:0/1697035700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4380ce4a0 msgr2=0x7fe4380cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe4377fe700 1 --2- 172.21.15.123:0/1697035700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4380ce4a0 0x7fe4380cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe4377fe700 1 -- 172.21.15.123:0/1697035700 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430009b30 con 0x7fe438160210 2024-09-13T17:09:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe4377fe700 1 --2- 172.21.15.123:0/1697035700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe438160210 0x7fe438148120 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe438070330 tx=0x7fe430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe42ffff700 1 -- 172.21.15.123:0/1697035700 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4300048c0 con 0x7fe438160210 2024-09-13T17:09:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe42ffff700 1 -- 172.21.15.123:0/1697035700 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4300099b0 con 0x7fe438160210 2024-09-13T17:09:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe437fff700 1 -- 172.21.15.123:0/1697035700 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4380c4ae0 con 0x7fe438160210 2024-09-13T17:09:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe42ffff700 1 -- 172.21.15.123:0/1697035700 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43001c680 con 0x7fe438160210 2024-09-13T17:09:23.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.110+0000 7fe437fff700 1 -- 172.21.15.123:0/1697035700 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43815d870 con 0x7fe438160210 2024-09-13T17:09:23.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.114+0000 7fe42ffff700 1 -- 172.21.15.123:0/1697035700 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe43001c7e0 con 0x7fe438160210 2024-09-13T17:09:23.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.114+0000 7fe437fff700 1 -- 172.21.15.123:0/1697035700 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4380677f0 con 0x7fe438160210 2024-09-13T17:09:23.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.114+0000 7fe42ffff700 1 --2- 172.21.15.123:0/1697035700 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe41c066730 0x7fe41c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.114+0000 7fe42ffff700 1 -- 172.21.15.123:0/1697035700 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe430085c00 con 0x7fe438160210 2024-09-13T17:09:23.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.114+0000 7fe436ffd700 1 --2- 172.21.15.123:0/1697035700 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe41c066730 0x7fe41c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.114+0000 7fe436ffd700 1 --2- 172.21.15.123:0/1697035700 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe41c066730 0x7fe41c068bf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe428000f60 tx=0x7fe428007f30 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.122+0000 7fe42ffff700 1 -- 172.21.15.123:0/1697035700 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe43008c080 con 0x7fe438160210 2024-09-13T17:09:23.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.290+0000 7fe437fff700 1 -- 172.21.15.123:0/1697035700 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe43806de10 con 0x7fe41c066730 2024-09-13T17:09:23.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.306+0000 7fe42ffff700 1 -- 172.21.15.123:0/1697035700 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288086 (secure 0 0 0) 0x7fe428004b30 con 0x7fe41c066730 2024-09-13T17:09:23.316 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:23.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.310+0000 7fe437fff700 1 -- 172.21.15.123:0/1697035700 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe41c066730 msgr2=0x7fe41c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.310+0000 7fe437fff700 1 --2- 172.21.15.123:0/1697035700 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe41c066730 0x7fe41c068bf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe428000f60 tx=0x7fe428007f30 comp rx=0 tx=0).stop 2024-09-13T17:09:23.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.310+0000 7fe437fff700 1 -- 172.21.15.123:0/1697035700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe438160210 msgr2=0x7fe438148120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.310+0000 7fe437fff700 1 --2- 172.21.15.123:0/1697035700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe438160210 0x7fe438148120 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe438070330 tx=0x7fe430004af0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.314+0000 7fe437fff700 1 -- 172.21.15.123:0/1697035700 shutdown_connections 2024-09-13T17:09:23.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.314+0000 7fe437fff700 1 --2- 172.21.15.123:0/1697035700 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe41c066730 0x7fe41c068bf0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.314+0000 7fe437fff700 1 --2- 172.21.15.123:0/1697035700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe438160210 0x7fe438148120 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.314+0000 7fe437fff700 1 --2- 172.21.15.123:0/1697035700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4380ce4a0 0x7fe4380cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.314+0000 7fe437fff700 1 --2- 172.21.15.123:0/1697035700 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe4380b1ac0 0x7fe43815e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.314+0000 7fe437fff700 1 -- 172.21.15.123:0/1697035700 >> 172.21.15.123:0/1697035700 conn(0x7fe438066570 msgr2=0x7fe4380b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:23.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.314+0000 7fe437fff700 1 -- 172.21.15.123:0/1697035700 shutdown_connections 2024-09-13T17:09:23.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.314+0000 7fe437fff700 1 -- 172.21.15.123:0/1697035700 wait complete. 2024-09-13T17:09:23.320 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:09:23.332 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-09-13T17:09:22.782214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232448,"kb_used_data":8072,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754742272,"statfs":{"total":773094113280,"available":772856086528,"internally_reserved":0,"allocated":8265728,"data_stored":4142052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":229625401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.241176"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937186+0000","last_change":"2024-09-13T17:09:18.964815+0000","last_active":"2024-09-13T17:09:19.937186+0000","last_peered":"2024-09-13T17:09:19.937186+0000","last_clean":"2024-09-13T17:09:19.937186+0000","last_became_active":"2024-09-13T17:09:18.964436+0000","last_became_peered":"2024-09-13T17:09:18.964436+0000","last_unstale":"2024-09-13T17:09:19.937186+0000","last_undegraded":"2024-09-13T17:09:19.937186+0000","last_fullsized":"2024-09-13T17:09:19.937186+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.590523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943497+0000","last_change":"2024-09-13T17:09:18.966158+0000","last_active":"2024-09-13T17:09:19.943497+0000","last_peered":"2024-09-13T17:09:19.943497+0000","last_clean":"2024-09-13T17:09:19.943497+0000","last_became_active":"2024-09-13T17:09:18.965787+0000","last_became_peered":"2024-09-13T17:09:18.965787+0000","last_unstale":"2024-09-13T17:09:19.943497+0000","last_undegraded":"2024-09-13T17:09:19.943497+0000","last_fullsized":"2024-09-13T17:09:19.943497+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:54.348245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.935944+0000","last_change":"2024-09-13T17:09:18.943136+0000","last_active":"2024-09-13T17:09:19.935944+0000","last_peered":"2024-09-13T17:09:19.935944+0000","last_clean":"2024-09-13T17:09:19.935944+0000","last_became_active":"2024-09-13T17:09:18.942859+0000","last_became_peered":"2024-09-13T17:09:18.942859+0000","last_unstale":"2024-09-13T17:09:19.935944+0000","last_undegraded":"2024-09-13T17:09:19.935944+0000","last_fullsized":"2024-09-13T17:09:19.935944+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:12.645054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941212+0000","last_change":"2024-09-13T17:09:18.961905+0000","last_active":"2024-09-13T17:09:19.941212+0000","last_peered":"2024-09-13T17:09:19.941212+0000","last_clean":"2024-09-13T17:09:19.941212+0000","last_became_active":"2024-09-13T17:09:18.961533+0000","last_became_peered":"2024-09-13T17:09:18.961533+0000","last_unstale":"2024-09-13T17:09:19.941212+0000","last_undegraded":"2024-09-13T17:09:19.941212+0000","last_fullsized":"2024-09-13T17:09:19.941212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:16.276086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937672+0000","last_change":"2024-09-13T17:09:18.959682+0000","last_active":"2024-09-13T17:09:19.937672+0000","last_peered":"2024-09-13T17:09:19.937672+0000","last_clean":"2024-09-13T17:09:19.937672+0000","last_became_active":"2024-09-13T17:09:18.959409+0000","last_became_peered":"2024-09-13T17:09:18.959409+0000","last_unstale":"2024-09-13T17:09:19.937672+0000","last_undegraded":"2024-09-13T17:09:19.937672+0000","last_fullsized":"2024-09-13T17:09:19.937672+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:42.748419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943010+0000","last_change":"2024-09-13T17:09:18.965970+0000","last_active":"2024-09-13T17:09:19.943010+0000","last_peered":"2024-09-13T17:09:19.943010+0000","last_clean":"2024-09-13T17:09:19.943010+0000","last_became_active":"2024-09-13T17:09:18.965675+0000","last_became_peered":"2024-09-13T17:09:18.965675+0000","last_unstale":"2024-09-13T17:09:19.943010+0000","last_undegraded":"2024-09-13T17:09:19.943010+0000","last_fullsized":"2024-09-13T17:09:19.943010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:59.867400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942203+0000","last_change":"2024-09-13T17:09:18.955798+0000","last_active":"2024-09-13T17:09:19.942203+0000","last_peered":"2024-09-13T17:09:19.942203+0000","last_clean":"2024-09-13T17:09:19.942203+0000","last_became_active":"2024-09-13T17:09:18.955466+0000","last_became_peered":"2024-09-13T17:09:18.955466+0000","last_unstale":"2024-09-13T17:09:19.942203+0000","last_undegraded":"2024-09-13T17:09:19.942203+0000","last_fullsized":"2024-09-13T17:09:19.942203+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:42.352345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942654+0000","last_change":"2024-09-13T17:09:18.960472+0000","last_active":"2024-09-13T17:09:19.942654+0000","last_peered":"2024-09-13T17:09:19.942654+0000","last_clean":"2024-09-13T17:09:19.942654+0000","last_became_active":"2024-09-13T17:09:18.959383+0000","last_became_peered":"2024-09-13T17:09:18.959383+0000","last_unstale":"2024-09-13T17:09:19.942654+0000","last_undegraded":"2024-09-13T17:09:19.942654+0000","last_fullsized":"2024-09-13T17:09:19.942654+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:30.424456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.938454+0000","last_change":"2024-09-13T17:09:18.959007+0000","last_active":"2024-09-13T17:09:19.938454+0000","last_peered":"2024-09-13T17:09:19.938454+0000","last_clean":"2024-09-13T17:09:19.938454+0000","last_became_active":"2024-09-13T17:09:18.958764+0000","last_became_peered":"2024-09-13T17:09:18.958764+0000","last_unstale":"2024-09-13T17:09:19.938454+0000","last_undegraded":"2024-09-13T17:09:19.938454+0000","last_fullsized":"2024-09-13T17:09:19.938454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:13.935947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943682+0000","last_change":"2024-09-13T17:09:18.954597+0000","last_active":"2024-09-13T17:09:19.943682+0000","last_peered":"2024-09-13T17:09:19.943682+0000","last_clean":"2024-09-13T17:09:19.943682+0000","last_became_active":"2024-09-13T17:09:18.952785+0000","last_became_peered":"2024-09-13T17:09:18.952785+0000","last_unstale":"2024-09-13T17:09:19.943682+0000","last_undegraded":"2024-09-13T17:09:19.943682+0000","last_fullsized":"2024-09-13T17:09:19.943682+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:50.801088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937024+0000","last_change":"2024-09-13T17:09:18.961551+0000","last_active":"2024-09-13T17:09:19.937024+0000","last_peered":"2024-09-13T17:09:19.937024+0000","last_clean":"2024-09-13T17:09:19.937024+0000","last_became_active":"2024-09-13T17:09:18.960770+0000","last_became_peered":"2024-09-13T17:09:18.960770+0000","last_unstale":"2024-09-13T17:09:19.937024+0000","last_undegraded":"2024-09-13T17:09:19.937024+0000","last_fullsized":"2024-09-13T17:09:19.937024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:10.380507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941206+0000","last_change":"2024-09-13T17:09:18.955316+0000","last_active":"2024-09-13T17:09:19.941206+0000","last_peered":"2024-09-13T17:09:19.941206+0000","last_clean":"2024-09-13T17:09:19.941206+0000","last_became_active":"2024-09-13T17:09:18.954892+0000","last_became_peered":"2024-09-13T17:09:18.954892+0000","last_unstale":"2024-09-13T17:09:19.941206+0000","last_undegraded":"2024-09-13T17:09:19.941206+0000","last_fullsized":"2024-09-13T17:09:19.941206+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:30.424456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940724+0000","last_change":"2024-09-13T17:09:18.961793+0000","last_active":"2024-09-13T17:09:19.940724+0000","last_peered":"2024-09-13T17:09:19.940724+0000","last_clean":"2024-09-13T17:09:19.940724+0000","last_became_active":"2024-09-13T17:09:18.961355+0000","last_became_peered":"2024-09-13T17:09:18.961355+0000","last_unstale":"2024-09-13T17:09:19.940724+0000","last_undegraded":"2024-09-13T17:09:19.940724+0000","last_fullsized":"2024-09-13T17:09:19.940724+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:16.836431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937680+0000","last_change":"2024-09-13T17:09:18.960794+0000","last_active":"2024-09-13T17:09:19.937680+0000","last_peered":"2024-09-13T17:09:19.937680+0000","last_clean":"2024-09-13T17:09:19.937680+0000","last_became_active":"2024-09-13T17:09:18.960538+0000","last_became_peered":"2024-09-13T17:09:18.960538+0000","last_unstale":"2024-09-13T17:09:19.937680+0000","last_undegraded":"2024-09-13T17:09:19.937680+0000","last_fullsized":"2024-09-13T17:09:19.937680+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:11.778942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940587+0000","last_change":"2024-09-13T17:09:18.953703+0000","last_active":"2024-09-13T17:09:19.940587+0000","last_peered":"2024-09-13T17:09:19.940587+0000","last_clean":"2024-09-13T17:09:19.940587+0000","last_became_active":"2024-09-13T17:09:18.953460+0000","last_became_peered":"2024-09-13T17:09:18.953460+0000","last_unstale":"2024-09-13T17:09:19.940587+0000","last_undegraded":"2024-09-13T17:09:19.940587+0000","last_fullsized":"2024-09-13T17:09:19.940587+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:42.352345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941796+0000","last_change":"2024-09-13T17:09:18.964059+0000","last_active":"2024-09-13T17:09:19.941796+0000","last_peered":"2024-09-13T17:09:19.941796+0000","last_clean":"2024-09-13T17:09:19.941796+0000","last_became_active":"2024-09-13T17:09:18.963162+0000","last_became_peered":"2024-09-13T17:09:18.963162+0000","last_unstale":"2024-09-13T17:09:19.941796+0000","last_undegraded":"2024-09-13T17:09:19.941796+0000","last_fullsized":"2024-09-13T17:09:19.941796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:33.754795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.938543+0000","last_change":"2024-09-13T17:09:18.958704+0000","last_active":"2024-09-13T17:09:19.938543+0000","last_peered":"2024-09-13T17:09:19.938543+0000","last_clean":"2024-09-13T17:09:19.938543+0000","last_became_active":"2024-09-13T17:09:18.958383+0000","last_became_peered":"2024-09-13T17:09:18.958383+0000","last_unstale":"2024-09-13T17:09:19.938543+0000","last_undegraded":"2024-09-13T17:09:19.938543+0000","last_fullsized":"2024-09-13T17:09:19.938543+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:50.621604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941549+0000","last_change":"2024-09-13T17:09:18.962444+0000","last_active":"2024-09-13T17:09:19.941549+0000","last_peered":"2024-09-13T17:09:19.941549+0000","last_clean":"2024-09-13T17:09:19.941549+0000","last_became_active":"2024-09-13T17:09:18.962143+0000","last_became_peered":"2024-09-13T17:09:18.962143+0000","last_unstale":"2024-09-13T17:09:19.941549+0000","last_undegraded":"2024-09-13T17:09:19.941549+0000","last_fullsized":"2024-09-13T17:09:19.941549+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:20.358572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943057+0000","last_change":"2024-09-13T17:09:18.960697+0000","last_active":"2024-09-13T17:09:19.943057+0000","last_peered":"2024-09-13T17:09:19.943057+0000","last_clean":"2024-09-13T17:09:19.943057+0000","last_became_active":"2024-09-13T17:09:18.960277+0000","last_became_peered":"2024-09-13T17:09:18.960277+0000","last_unstale":"2024-09-13T17:09:19.943057+0000","last_undegraded":"2024-09-13T17:09:19.943057+0000","last_fullsized":"2024-09-13T17:09:19.943057+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:21.816947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940667+0000","last_change":"2024-09-13T17:09:18.952802+0000","last_active":"2024-09-13T17:09:19.940667+0000","last_peered":"2024-09-13T17:09:19.940667+0000","last_clean":"2024-09-13T17:09:19.940667+0000","last_became_active":"2024-09-13T17:09:18.952549+0000","last_became_peered":"2024-09-13T17:09:18.952549+0000","last_unstale":"2024-09-13T17:09:19.940667+0000","last_undegraded":"2024-09-13T17:09:19.940667+0000","last_fullsized":"2024-09-13T17:09:19.940667+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:09.378119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943329+0000","last_change":"2024-09-13T17:09:18.944352+0000","last_active":"2024-09-13T17:09:19.943329+0000","last_peered":"2024-09-13T17:09:19.943329+0000","last_clean":"2024-09-13T17:09:19.943329+0000","last_became_active":"2024-09-13T17:09:18.943752+0000","last_became_peered":"2024-09-13T17:09:18.943752+0000","last_unstale":"2024-09-13T17:09:19.943329+0000","last_undegraded":"2024-09-13T17:09:19.943329+0000","last_fullsized":"2024-09-13T17:09:19.943329+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:18.556011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941844+0000","last_change":"2024-09-13T17:09:18.954442+0000","last_active":"2024-09-13T17:09:19.941844+0000","last_peered":"2024-09-13T17:09:19.941844+0000","last_clean":"2024-09-13T17:09:19.941844+0000","last_became_active":"2024-09-13T17:09:18.952640+0000","last_became_peered":"2024-09-13T17:09:18.952640+0000","last_unstale":"2024-09-13T17:09:19.941844+0000","last_undegraded":"2024-09-13T17:09:19.941844+0000","last_fullsized":"2024-09-13T17:09:19.941844+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:38.971471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936519+0000","last_change":"2024-09-13T17:09:18.962536+0000","last_active":"2024-09-13T17:09:19.936519+0000","last_peered":"2024-09-13T17:09:19.936519+0000","last_clean":"2024-09-13T17:09:19.936519+0000","last_became_active":"2024-09-13T17:09:18.962249+0000","last_became_peered":"2024-09-13T17:09:18.962249+0000","last_unstale":"2024-09-13T17:09:19.936519+0000","last_undegraded":"2024-09-13T17:09:19.936519+0000","last_fullsized":"2024-09-13T17:09:19.936519+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:12.645054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936318+0000","last_change":"2024-09-13T17:09:18.965836+0000","last_active":"2024-09-13T17:09:19.936318+0000","last_peered":"2024-09-13T17:09:19.936318+0000","last_clean":"2024-09-13T17:09:19.936318+0000","last_became_active":"2024-09-13T17:09:18.965605+0000","last_became_peered":"2024-09-13T17:09:18.965605+0000","last_unstale":"2024-09-13T17:09:19.936318+0000","last_undegraded":"2024-09-13T17:09:19.936318+0000","last_fullsized":"2024-09-13T17:09:19.936318+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:22.264331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943638+0000","last_change":"2024-09-13T17:09:18.958961+0000","last_active":"2024-09-13T17:09:19.943638+0000","last_peered":"2024-09-13T17:09:19.943638+0000","last_clean":"2024-09-13T17:09:19.943638+0000","last_became_active":"2024-09-13T17:09:18.958704+0000","last_became_peered":"2024-09-13T17:09:18.958704+0000","last_unstale":"2024-09-13T17:09:19.943638+0000","last_undegraded":"2024-09-13T17:09:19.943638+0000","last_fullsized":"2024-09-13T17:09:19.943638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:42.308443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942265+0000","last_change":"2024-09-13T17:09:18.961703+0000","last_active":"2024-09-13T17:09:19.942265+0000","last_peered":"2024-09-13T17:09:19.942265+0000","last_clean":"2024-09-13T17:09:19.942265+0000","last_became_active":"2024-09-13T17:09:18.961329+0000","last_became_peered":"2024-09-13T17:09:18.961329+0000","last_unstale":"2024-09-13T17:09:19.942265+0000","last_undegraded":"2024-09-13T17:09:19.942265+0000","last_fullsized":"2024-09-13T17:09:19.942265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:39:28.270278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936157+0000","last_change":"2024-09-13T17:09:18.951208+0000","last_active":"2024-09-13T17:09:19.936157+0000","last_peered":"2024-09-13T17:09:19.936157+0000","last_clean":"2024-09-13T17:09:19.936157+0000","last_became_active":"2024-09-13T17:09:18.950947+0000","last_became_peered":"2024-09-13T17:09:18.950947+0000","last_unstale":"2024-09-13T17:09:19.936157+0000","last_undegraded":"2024-09-13T17:09:19.936157+0000","last_fullsized":"2024-09-13T17:09:19.936157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:08.639595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943411+0000","last_change":"2024-09-13T17:09:18.954792+0000","last_active":"2024-09-13T17:09:19.943411+0000","last_peered":"2024-09-13T17:09:19.943411+0000","last_clean":"2024-09-13T17:09:19.943411+0000","last_became_active":"2024-09-13T17:09:18.954500+0000","last_became_peered":"2024-09-13T17:09:18.954500+0000","last_unstale":"2024-09-13T17:09:19.943411+0000","last_undegraded":"2024-09-13T17:09:19.943411+0000","last_fullsized":"2024-09-13T17:09:19.943411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:35.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.935996+0000","last_change":"2024-09-13T17:09:18.953879+0000","last_active":"2024-09-13T17:09:19.935996+0000","last_peered":"2024-09-13T17:09:19.935996+0000","last_clean":"2024-09-13T17:09:19.935996+0000","last_became_active":"2024-09-13T17:09:18.953610+0000","last_became_peered":"2024-09-13T17:09:18.953610+0000","last_unstale":"2024-09-13T17:09:19.935996+0000","last_undegraded":"2024-09-13T17:09:19.935996+0000","last_fullsized":"2024-09-13T17:09:19.935996+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:06.821655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941953+0000","last_change":"2024-09-13T17:09:18.962731+0000","last_active":"2024-09-13T17:09:19.941953+0000","last_peered":"2024-09-13T17:09:19.941953+0000","last_clean":"2024-09-13T17:09:19.941953+0000","last_became_active":"2024-09-13T17:09:18.962465+0000","last_became_peered":"2024-09-13T17:09:18.962465+0000","last_unstale":"2024-09-13T17:09:19.941953+0000","last_undegraded":"2024-09-13T17:09:19.941953+0000","last_fullsized":"2024-09-13T17:09:19.941953+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:16.836431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942480+0000","last_change":"2024-09-13T17:09:18.956812+0000","last_active":"2024-09-13T17:09:19.942480+0000","last_peered":"2024-09-13T17:09:19.942480+0000","last_clean":"2024-09-13T17:09:19.942480+0000","last_became_active":"2024-09-13T17:09:18.956543+0000","last_became_peered":"2024-09-13T17:09:18.956543+0000","last_unstale":"2024-09-13T17:09:19.942480+0000","last_undegraded":"2024-09-13T17:09:19.942480+0000","last_fullsized":"2024-09-13T17:09:19.942480+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:33.093375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942705+0000","last_change":"2024-09-13T17:09:18.959675+0000","last_active":"2024-09-13T17:09:19.942705+0000","last_peered":"2024-09-13T17:09:19.942705+0000","last_clean":"2024-09-13T17:09:19.942705+0000","last_became_active":"2024-09-13T17:09:18.959053+0000","last_became_peered":"2024-09-13T17:09:18.959053+0000","last_unstale":"2024-09-13T17:09:19.942705+0000","last_undegraded":"2024-09-13T17:09:19.942705+0000","last_fullsized":"2024-09-13T17:09:19.942705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:13.609362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937039+0000","last_change":"2024-09-13T17:09:18.964295+0000","last_active":"2024-09-13T17:09:19.937039+0000","last_peered":"2024-09-13T17:09:19.937039+0000","last_clean":"2024-09-13T17:09:19.937039+0000","last_became_active":"2024-09-13T17:09:18.961637+0000","last_became_peered":"2024-09-13T17:09:18.961637+0000","last_unstale":"2024-09-13T17:09:19.937039+0000","last_undegraded":"2024-09-13T17:09:19.937039+0000","last_fullsized":"2024-09-13T17:09:19.937039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:08.639595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937438+0000","last_change":"2024-09-13T17:09:18.572453+0000","last_active":"2024-09-13T17:09:19.937438+0000","last_peered":"2024-09-13T17:09:19.937438+0000","last_clean":"2024-09-13T17:09:19.937438+0000","last_became_active":"2024-09-13T17:09:18.572134+0000","last_became_peered":"2024-09-13T17:09:18.572134+0000","last_unstale":"2024-09-13T17:09:19.937438+0000","last_undegraded":"2024-09-13T17:09:19.937438+0000","last_fullsized":"2024-09-13T17:09:19.937438+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:17.546280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.938630+0000","last_change":"2024-09-13T17:09:18.955287+0000","last_active":"2024-09-13T17:09:19.938630+0000","last_peered":"2024-09-13T17:09:19.938630+0000","last_clean":"2024-09-13T17:09:19.938630+0000","last_became_active":"2024-09-13T17:09:18.954952+0000","last_became_peered":"2024-09-13T17:09:18.954952+0000","last_unstale":"2024-09-13T17:09:19.938630+0000","last_undegraded":"2024-09-13T17:09:19.938630+0000","last_fullsized":"2024-09-13T17:09:19.938630+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:21.091492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940950+0000","last_change":"2024-09-13T17:09:18.579636+0000","last_active":"2024-09-13T17:09:19.940950+0000","last_peered":"2024-09-13T17:09:19.940950+0000","last_clean":"2024-09-13T17:09:19.940950+0000","last_became_active":"2024-09-13T17:09:18.579224+0000","last_became_peered":"2024-09-13T17:09:18.579224+0000","last_unstale":"2024-09-13T17:09:19.940950+0000","last_undegraded":"2024-09-13T17:09:19.940950+0000","last_fullsized":"2024-09-13T17:09:19.940950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:37.961740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943171+0000","last_change":"2024-09-13T17:09:18.960542+0000","last_active":"2024-09-13T17:09:19.943171+0000","last_peered":"2024-09-13T17:09:19.943171+0000","last_clean":"2024-09-13T17:09:19.943171+0000","last_became_active":"2024-09-13T17:09:18.959954+0000","last_became_peered":"2024-09-13T17:09:18.959954+0000","last_unstale":"2024-09-13T17:09:19.943171+0000","last_undegraded":"2024-09-13T17:09:19.943171+0000","last_fullsized":"2024-09-13T17:09:19.943171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:18.729890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943757+0000","last_change":"2024-09-13T17:09:18.574700+0000","last_active":"2024-09-13T17:09:19.943757+0000","last_peered":"2024-09-13T17:09:19.943757+0000","last_clean":"2024-09-13T17:09:19.943757+0000","last_became_active":"2024-09-13T17:09:18.574435+0000","last_became_peered":"2024-09-13T17:09:18.574435+0000","last_unstale":"2024-09-13T17:09:19.943757+0000","last_undegraded":"2024-09-13T17:09:19.943757+0000","last_fullsized":"2024-09-13T17:09:19.943757+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:19.348841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937222+0000","last_change":"2024-09-13T17:09:18.964323+0000","last_active":"2024-09-13T17:09:19.937222+0000","last_peered":"2024-09-13T17:09:19.937222+0000","last_clean":"2024-09-13T17:09:19.937222+0000","last_became_active":"2024-09-13T17:09:18.961450+0000","last_became_peered":"2024-09-13T17:09:18.961450+0000","last_unstale":"2024-09-13T17:09:19.937222+0000","last_undegraded":"2024-09-13T17:09:19.937222+0000","last_fullsized":"2024-09-13T17:09:19.937222+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:42.352345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943441+0000","last_change":"2024-09-13T17:09:18.567327+0000","last_active":"2024-09-13T17:09:19.943441+0000","last_peered":"2024-09-13T17:09:19.943441+0000","last_clean":"2024-09-13T17:09:19.943441+0000","last_became_active":"2024-09-13T17:09:18.566995+0000","last_became_peered":"2024-09-13T17:09:18.566995+0000","last_unstale":"2024-09-13T17:09:19.943441+0000","last_undegraded":"2024-09-13T17:09:19.943441+0000","last_fullsized":"2024-09-13T17:09:19.943441+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:43.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942033+0000","last_change":"2024-09-13T17:09:18.952089+0000","last_active":"2024-09-13T17:09:19.942033+0000","last_peered":"2024-09-13T17:09:19.942033+0000","last_clean":"2024-09-13T17:09:19.942033+0000","last_became_active":"2024-09-13T17:09:18.951692+0000","last_became_peered":"2024-09-13T17:09:18.951692+0000","last_unstale":"2024-09-13T17:09:19.942033+0000","last_undegraded":"2024-09-13T17:09:19.942033+0000","last_fullsized":"2024-09-13T17:09:19.942033+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:42.308443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936091+0000","last_change":"2024-09-13T17:09:18.570765+0000","last_active":"2024-09-13T17:09:19.936091+0000","last_peered":"2024-09-13T17:09:19.936091+0000","last_clean":"2024-09-13T17:09:19.936091+0000","last_became_active":"2024-09-13T17:09:18.570468+0000","last_became_peered":"2024-09-13T17:09:18.570468+0000","last_unstale":"2024-09-13T17:09:19.936091+0000","last_undegraded":"2024-09-13T17:09:19.936091+0000","last_fullsized":"2024-09-13T17:09:19.936091+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:41.298711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943420+0000","last_change":"2024-09-13T17:09:18.955247+0000","last_active":"2024-09-13T17:09:19.943420+0000","last_peered":"2024-09-13T17:09:19.943420+0000","last_clean":"2024-09-13T17:09:19.943420+0000","last_became_active":"2024-09-13T17:09:18.953269+0000","last_became_peered":"2024-09-13T17:09:18.953269+0000","last_unstale":"2024-09-13T17:09:19.943420+0000","last_undegraded":"2024-09-13T17:09:19.943420+0000","last_fullsized":"2024-09-13T17:09:19.943420+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:50.386334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943094+0000","last_change":"2024-09-13T17:09:18.576249+0000","last_active":"2024-09-13T17:09:19.943094+0000","last_peered":"2024-09-13T17:09:19.943094+0000","last_clean":"2024-09-13T17:09:19.943094+0000","last_became_active":"2024-09-13T17:09:18.575874+0000","last_became_peered":"2024-09-13T17:09:18.575874+0000","last_unstale":"2024-09-13T17:09:19.943094+0000","last_undegraded":"2024-09-13T17:09:19.943094+0000","last_fullsized":"2024-09-13T17:09:19.943094+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:44.778987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936747+0000","last_change":"2024-09-13T17:09:18.966228+0000","last_active":"2024-09-13T17:09:19.936747+0000","last_peered":"2024-09-13T17:09:19.936747+0000","last_clean":"2024-09-13T17:09:19.936747+0000","last_became_active":"2024-09-13T17:09:18.965921+0000","last_became_peered":"2024-09-13T17:09:18.965921+0000","last_unstale":"2024-09-13T17:09:19.936747+0000","last_undegraded":"2024-09-13T17:09:19.936747+0000","last_fullsized":"2024-09-13T17:09:19.936747+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:50.785710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941066+0000","last_change":"2024-09-13T17:09:18.570276+0000","last_active":"2024-09-13T17:09:19.941066+0000","last_peered":"2024-09-13T17:09:19.941066+0000","last_clean":"2024-09-13T17:09:19.941066+0000","last_became_active":"2024-09-13T17:09:18.569413+0000","last_became_peered":"2024-09-13T17:09:18.569413+0000","last_unstale":"2024-09-13T17:09:19.941066+0000","last_undegraded":"2024-09-13T17:09:19.941066+0000","last_fullsized":"2024-09-13T17:09:19.941066+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:43.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940706+0000","last_change":"2024-09-13T17:09:18.954502+0000","last_active":"2024-09-13T17:09:19.940706+0000","last_peered":"2024-09-13T17:09:19.940706+0000","last_clean":"2024-09-13T17:09:19.940706+0000","last_became_active":"2024-09-13T17:09:18.954241+0000","last_became_peered":"2024-09-13T17:09:18.954241+0000","last_unstale":"2024-09-13T17:09:19.940706+0000","last_undegraded":"2024-09-13T17:09:19.940706+0000","last_fullsized":"2024-09-13T17:09:19.940706+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:39:28.270278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936834+0000","last_change":"2024-09-13T17:09:18.574057+0000","last_active":"2024-09-13T17:09:19.936834+0000","last_peered":"2024-09-13T17:09:19.936834+0000","last_clean":"2024-09-13T17:09:19.936834+0000","last_became_active":"2024-09-13T17:09:18.573788+0000","last_became_peered":"2024-09-13T17:09:18.573788+0000","last_unstale":"2024-09-13T17:09:19.936834+0000","last_undegraded":"2024-09-13T17:09:19.936834+0000","last_fullsized":"2024-09-13T17:09:19.936834+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:11.604392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942363+0000","last_change":"2024-09-13T17:09:18.953151+0000","last_active":"2024-09-13T17:09:19.942363+0000","last_peered":"2024-09-13T17:09:19.942363+0000","last_clean":"2024-09-13T17:09:19.942363+0000","last_became_active":"2024-09-13T17:09:18.952808+0000","last_became_peered":"2024-09-13T17:09:18.952808+0000","last_unstale":"2024-09-13T17:09:19.942363+0000","last_undegraded":"2024-09-13T17:09:19.942363+0000","last_fullsized":"2024-09-13T17:09:19.942363+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:08.252615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943654+0000","last_change":"2024-09-13T17:09:18.568587+0000","last_active":"2024-09-13T17:09:19.943654+0000","last_peered":"2024-09-13T17:09:19.943654+0000","last_clean":"2024-09-13T17:09:19.943654+0000","last_became_active":"2024-09-13T17:09:18.568290+0000","last_became_peered":"2024-09-13T17:09:18.568290+0000","last_unstale":"2024-09-13T17:09:19.943654+0000","last_undegraded":"2024-09-13T17:09:19.943654+0000","last_fullsized":"2024-09-13T17:09:19.943654+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:52.910008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937327+0000","last_change":"2024-09-13T17:09:18.964461+0000","last_active":"2024-09-13T17:09:19.937327+0000","last_peered":"2024-09-13T17:09:19.937327+0000","last_clean":"2024-09-13T17:09:19.937327+0000","last_became_active":"2024-09-13T17:09:18.962310+0000","last_became_peered":"2024-09-13T17:09:18.962310+0000","last_unstale":"2024-09-13T17:09:19.937327+0000","last_undegraded":"2024-09-13T17:09:19.937327+0000","last_fullsized":"2024-09-13T17:09:19.937327+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:21.868206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943506+0000","last_change":"2024-09-13T17:09:18.572437+0000","last_active":"2024-09-13T17:09:19.943506+0000","last_peered":"2024-09-13T17:09:19.943506+0000","last_clean":"2024-09-13T17:09:19.943506+0000","last_became_active":"2024-09-13T17:09:18.569400+0000","last_became_peered":"2024-09-13T17:09:18.569400+0000","last_unstale":"2024-09-13T17:09:19.943506+0000","last_undegraded":"2024-09-13T17:09:19.943506+0000","last_fullsized":"2024-09-13T17:09:19.943506+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:09.453030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943325+0000","last_change":"2024-09-13T17:09:18.967736+0000","last_active":"2024-09-13T17:09:19.943325+0000","last_peered":"2024-09-13T17:09:19.943325+0000","last_clean":"2024-09-13T17:09:19.943325+0000","last_became_active":"2024-09-13T17:09:18.967053+0000","last_became_peered":"2024-09-13T17:09:18.967053+0000","last_unstale":"2024-09-13T17:09:19.943325+0000","last_undegraded":"2024-09-13T17:09:19.943325+0000","last_fullsized":"2024-09-13T17:09:19.943325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:04.472086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936352+0000","last_change":"2024-09-13T17:09:18.568473+0000","last_active":"2024-09-13T17:09:19.936352+0000","last_peered":"2024-09-13T17:09:19.936352+0000","last_clean":"2024-09-13T17:09:19.936352+0000","last_became_active":"2024-09-13T17:09:18.568222+0000","last_became_peered":"2024-09-13T17:09:18.568222+0000","last_unstale":"2024-09-13T17:09:19.936352+0000","last_undegraded":"2024-09-13T17:09:19.936352+0000","last_fullsized":"2024-09-13T17:09:19.936352+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:34.280380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937941+0000","last_change":"2024-09-13T17:09:18.956809+0000","last_active":"2024-09-13T17:09:19.937941+0000","last_peered":"2024-09-13T17:09:19.937941+0000","last_clean":"2024-09-13T17:09:19.937941+0000","last_became_active":"2024-09-13T17:09:18.956257+0000","last_became_peered":"2024-09-13T17:09:18.956257+0000","last_unstale":"2024-09-13T17:09:19.937941+0000","last_undegraded":"2024-09-13T17:09:19.937941+0000","last_fullsized":"2024-09-13T17:09:19.937941+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:13.420104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941314+0000","last_change":"2024-09-13T17:09:18.574633+0000","last_active":"2024-09-13T17:09:19.941314+0000","last_peered":"2024-09-13T17:09:19.941314+0000","last_clean":"2024-09-13T17:09:19.941314+0000","last_became_active":"2024-09-13T17:09:18.574396+0000","last_became_peered":"2024-09-13T17:09:18.574396+0000","last_unstale":"2024-09-13T17:09:19.941314+0000","last_undegraded":"2024-09-13T17:09:19.941314+0000","last_fullsized":"2024-09-13T17:09:19.941314+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:25.906140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936564+0000","last_change":"2024-09-13T17:09:18.961376+0000","last_active":"2024-09-13T17:09:19.936564+0000","last_peered":"2024-09-13T17:09:19.936564+0000","last_clean":"2024-09-13T17:09:19.936564+0000","last_became_active":"2024-09-13T17:09:18.957967+0000","last_became_peered":"2024-09-13T17:09:18.957967+0000","last_unstale":"2024-09-13T17:09:19.936564+0000","last_undegraded":"2024-09-13T17:09:19.936564+0000","last_fullsized":"2024-09-13T17:09:19.936564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:18.591891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941529+0000","last_change":"2024-09-13T17:09:18.561394+0000","last_active":"2024-09-13T17:09:19.941529+0000","last_peered":"2024-09-13T17:09:19.941529+0000","last_clean":"2024-09-13T17:09:19.941529+0000","last_became_active":"2024-09-13T17:09:18.561063+0000","last_became_peered":"2024-09-13T17:09:18.561063+0000","last_unstale":"2024-09-13T17:09:19.941529+0000","last_undegraded":"2024-09-13T17:09:19.941529+0000","last_fullsized":"2024-09-13T17:09:19.941529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:09.453030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942247+0000","last_change":"2024-09-13T17:09:18.957191+0000","last_active":"2024-09-13T17:09:19.942247+0000","last_peered":"2024-09-13T17:09:19.942247+0000","last_clean":"2024-09-13T17:09:19.942247+0000","last_became_active":"2024-09-13T17:09:18.956895+0000","last_became_peered":"2024-09-13T17:09:18.956895+0000","last_unstale":"2024-09-13T17:09:19.942247+0000","last_undegraded":"2024-09-13T17:09:19.942247+0000","last_fullsized":"2024-09-13T17:09:19.942247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:09.378119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943217+0000","last_change":"2024-09-13T17:09:18.578755+0000","last_active":"2024-09-13T17:09:19.943217+0000","last_peered":"2024-09-13T17:09:19.943217+0000","last_clean":"2024-09-13T17:09:19.943217+0000","last_became_active":"2024-09-13T17:09:18.578479+0000","last_became_peered":"2024-09-13T17:09:18.578479+0000","last_unstale":"2024-09-13T17:09:19.943217+0000","last_undegraded":"2024-09-13T17:09:19.943217+0000","last_fullsized":"2024-09-13T17:09:19.943217+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:37.548564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940502+0000","last_change":"2024-09-13T17:09:18.963057+0000","last_active":"2024-09-13T17:09:19.940502+0000","last_peered":"2024-09-13T17:09:19.940502+0000","last_clean":"2024-09-13T17:09:19.940502+0000","last_became_active":"2024-09-13T17:09:18.962780+0000","last_became_peered":"2024-09-13T17:09:18.962780+0000","last_unstale":"2024-09-13T17:09:19.940502+0000","last_undegraded":"2024-09-13T17:09:19.940502+0000","last_fullsized":"2024-09-13T17:09:19.940502+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:33.093375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942341+0000","last_change":"2024-09-13T17:09:18.573406+0000","last_active":"2024-09-13T17:09:19.942341+0000","last_peered":"2024-09-13T17:09:19.942341+0000","last_clean":"2024-09-13T17:09:19.942341+0000","last_became_active":"2024-09-13T17:09:18.573144+0000","last_became_peered":"2024-09-13T17:09:18.573144+0000","last_unstale":"2024-09-13T17:09:19.942341+0000","last_undegraded":"2024-09-13T17:09:19.942341+0000","last_fullsized":"2024-09-13T17:09:19.942341+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:03.462354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936897+0000","last_change":"2024-09-13T17:09:18.954079+0000","last_active":"2024-09-13T17:09:19.936897+0000","last_peered":"2024-09-13T17:09:19.936897+0000","last_clean":"2024-09-13T17:09:19.936897+0000","last_became_active":"2024-09-13T17:09:18.953709+0000","last_became_peered":"2024-09-13T17:09:18.953709+0000","last_unstale":"2024-09-13T17:09:19.936897+0000","last_undegraded":"2024-09-13T17:09:19.936897+0000","last_fullsized":"2024-09-13T17:09:19.936897+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:43.902762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941660+0000","last_change":"2024-09-13T17:09:18.571135+0000","last_active":"2024-09-13T17:09:19.941660+0000","last_peered":"2024-09-13T17:09:19.941660+0000","last_clean":"2024-09-13T17:09:19.941660+0000","last_became_active":"2024-09-13T17:09:18.570580+0000","last_became_peered":"2024-09-13T17:09:18.570580+0000","last_unstale":"2024-09-13T17:09:19.941660+0000","last_undegraded":"2024-09-13T17:09:19.941660+0000","last_fullsized":"2024-09-13T17:09:19.941660+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:42.000212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943767+0000","last_change":"2024-09-13T17:09:18.953447+0000","last_active":"2024-09-13T17:09:19.943767+0000","last_peered":"2024-09-13T17:09:19.943767+0000","last_clean":"2024-09-13T17:09:19.943767+0000","last_became_active":"2024-09-13T17:09:18.952366+0000","last_became_peered":"2024-09-13T17:09:18.952366+0000","last_unstale":"2024-09-13T17:09:19.943767+0000","last_undegraded":"2024-09-13T17:09:19.943767+0000","last_fullsized":"2024-09-13T17:09:19.943767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:59.867400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943172+0000","last_change":"2024-09-13T17:09:18.578388+0000","last_active":"2024-09-13T17:09:19.943172+0000","last_peered":"2024-09-13T17:09:19.943172+0000","last_clean":"2024-09-13T17:09:19.943172+0000","last_became_active":"2024-09-13T17:09:18.578079+0000","last_became_peered":"2024-09-13T17:09:18.578079+0000","last_unstale":"2024-09-13T17:09:19.943172+0000","last_undegraded":"2024-09-13T17:09:19.943172+0000","last_fullsized":"2024-09-13T17:09:19.943172+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:12.314225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937325+0000","last_change":"2024-09-13T17:09:18.964647+0000","last_active":"2024-09-13T17:09:19.937325+0000","last_peered":"2024-09-13T17:09:19.937325+0000","last_clean":"2024-09-13T17:09:19.937325+0000","last_became_active":"2024-09-13T17:09:18.962594+0000","last_became_peered":"2024-09-13T17:09:18.962594+0000","last_unstale":"2024-09-13T17:09:19.937325+0000","last_undegraded":"2024-09-13T17:09:19.937325+0000","last_fullsized":"2024-09-13T17:09:19.937325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:33.093375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943802+0000","last_change":"2024-09-13T17:09:18.574680+0000","last_active":"2024-09-13T17:09:19.943802+0000","last_peered":"2024-09-13T17:09:19.943802+0000","last_clean":"2024-09-13T17:09:19.943802+0000","last_became_active":"2024-09-13T17:09:18.574380+0000","last_became_peered":"2024-09-13T17:09:18.574380+0000","last_unstale":"2024-09-13T17:09:19.943802+0000","last_undegraded":"2024-09-13T17:09:19.943802+0000","last_fullsized":"2024-09-13T17:09:19.943802+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:15.266355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941267+0000","last_change":"2024-09-13T17:09:18.955140+0000","last_active":"2024-09-13T17:09:19.941267+0000","last_peered":"2024-09-13T17:09:19.941267+0000","last_clean":"2024-09-13T17:09:19.941267+0000","last_became_active":"2024-09-13T17:09:18.954560+0000","last_became_peered":"2024-09-13T17:09:18.954560+0000","last_unstale":"2024-09-13T17:09:19.941267+0000","last_undegraded":"2024-09-13T17:09:19.941267+0000","last_fullsized":"2024-09-13T17:09:19.941267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:21.816947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943080+0000","last_change":"2024-09-13T17:09:18.572911+0000","last_active":"2024-09-13T17:09:19.943080+0000","last_peered":"2024-09-13T17:09:19.943080+0000","last_clean":"2024-09-13T17:09:19.943080+0000","last_became_active":"2024-09-13T17:09:18.572655+0000","last_became_peered":"2024-09-13T17:09:18.572655+0000","last_unstale":"2024-09-13T17:09:19.943080+0000","last_undegraded":"2024-09-13T17:09:19.943080+0000","last_fullsized":"2024-09-13T17:09:19.943080+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:08.049835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.938064+0000","last_change":"2024-09-13T17:09:18.966216+0000","last_active":"2024-09-13T17:09:19.938064+0000","last_peered":"2024-09-13T17:09:19.938064+0000","last_clean":"2024-09-13T17:09:19.938064+0000","last_became_active":"2024-09-13T17:09:18.965930+0000","last_became_peered":"2024-09-13T17:09:18.965930+0000","last_unstale":"2024-09-13T17:09:19.938064+0000","last_undegraded":"2024-09-13T17:09:19.938064+0000","last_fullsized":"2024-09-13T17:09:19.938064+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:09.059566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936812+0000","last_change":"2024-09-13T17:09:18.574361+0000","last_active":"2024-09-13T17:09:19.936812+0000","last_peered":"2024-09-13T17:09:19.936812+0000","last_clean":"2024-09-13T17:09:19.936812+0000","last_became_active":"2024-09-13T17:09:18.574094+0000","last_became_peered":"2024-09-13T17:09:18.574094+0000","last_unstale":"2024-09-13T17:09:19.936812+0000","last_undegraded":"2024-09-13T17:09:19.936812+0000","last_fullsized":"2024-09-13T17:09:19.936812+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:58.857669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936093+0000","last_change":"2024-09-13T17:09:18.946132+0000","last_active":"2024-09-13T17:09:19.936093+0000","last_peered":"2024-09-13T17:09:19.936093+0000","last_clean":"2024-09-13T17:09:19.936093+0000","last_became_active":"2024-09-13T17:09:18.945851+0000","last_became_peered":"2024-09-13T17:09:18.945851+0000","last_unstale":"2024-09-13T17:09:19.936093+0000","last_undegraded":"2024-09-13T17:09:19.936093+0000","last_fullsized":"2024-09-13T17:09:19.936093+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:52.215517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943338+0000","last_change":"2024-09-13T17:09:18.576182+0000","last_active":"2024-09-13T17:09:19.943338+0000","last_peered":"2024-09-13T17:09:19.943338+0000","last_clean":"2024-09-13T17:09:19.943338+0000","last_became_active":"2024-09-13T17:09:18.575888+0000","last_became_peered":"2024-09-13T17:09:18.575888+0000","last_unstale":"2024-09-13T17:09:19.943338+0000","last_undegraded":"2024-09-13T17:09:19.943338+0000","last_fullsized":"2024-09-13T17:09:19.943338+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:02.019904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.935588+0000","last_change":"2024-09-13T17:09:18.965748+0000","last_active":"2024-09-13T17:09:19.935588+0000","last_peered":"2024-09-13T17:09:19.935588+0000","last_clean":"2024-09-13T17:09:19.935588+0000","last_became_active":"2024-09-13T17:09:18.965454+0000","last_became_peered":"2024-09-13T17:09:18.965454+0000","last_unstale":"2024-09-13T17:09:19.935588+0000","last_undegraded":"2024-09-13T17:09:19.935588+0000","last_fullsized":"2024-09-13T17:09:19.935588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:18.591891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942583+0000","last_change":"2024-09-13T17:09:18.578496+0000","last_active":"2024-09-13T17:09:19.942583+0000","last_peered":"2024-09-13T17:09:19.942583+0000","last_clean":"2024-09-13T17:09:19.942583+0000","last_became_active":"2024-09-13T17:09:18.578236+0000","last_became_peered":"2024-09-13T17:09:18.578236+0000","last_unstale":"2024-09-13T17:09:19.942583+0000","last_undegraded":"2024-09-13T17:09:19.942583+0000","last_fullsized":"2024-09-13T17:09:19.942583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:21.257542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.935768+0000","last_change":"2024-09-13T17:09:18.962220+0000","last_active":"2024-09-13T17:09:19.935768+0000","last_peered":"2024-09-13T17:09:19.935768+0000","last_clean":"2024-09-13T17:09:19.935768+0000","last_became_active":"2024-09-13T17:09:18.961919+0000","last_became_peered":"2024-09-13T17:09:18.961919+0000","last_unstale":"2024-09-13T17:09:19.935768+0000","last_undegraded":"2024-09-13T17:09:19.935768+0000","last_fullsized":"2024-09-13T17:09:19.935768+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:10.380507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940499+0000","last_change":"2024-09-13T17:09:18.579360+0000","last_active":"2024-09-13T17:09:19.940499+0000","last_peered":"2024-09-13T17:09:19.940499+0000","last_clean":"2024-09-13T17:09:19.940499+0000","last_became_active":"2024-09-13T17:09:18.579068+0000","last_became_peered":"2024-09-13T17:09:18.579068+0000","last_unstale":"2024-09-13T17:09:19.940499+0000","last_undegraded":"2024-09-13T17:09:19.940499+0000","last_fullsized":"2024-09-13T17:09:19.940499+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:58.857669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940895+0000","last_change":"2024-09-13T17:09:18.951069+0000","last_active":"2024-09-13T17:09:19.940895+0000","last_peered":"2024-09-13T17:09:19.940895+0000","last_clean":"2024-09-13T17:09:19.940895+0000","last_became_active":"2024-09-13T17:09:18.950839+0000","last_became_peered":"2024-09-13T17:09:18.950839+0000","last_unstale":"2024-09-13T17:09:19.940895+0000","last_undegraded":"2024-09-13T17:09:19.940895+0000","last_fullsized":"2024-09-13T17:09:19.940895+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:52.215517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.943315+0000","last_change":"2024-09-13T17:09:18.574583+0000","last_active":"2024-09-13T17:09:19.943315+0000","last_peered":"2024-09-13T17:09:19.943315+0000","last_clean":"2024-09-13T17:09:19.943315+0000","last_became_active":"2024-09-13T17:09:18.573761+0000","last_became_peered":"2024-09-13T17:09:18.573761+0000","last_unstale":"2024-09-13T17:09:19.943315+0000","last_undegraded":"2024-09-13T17:09:19.943315+0000","last_fullsized":"2024-09-13T17:09:19.943315+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:42.893031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942215+0000","last_change":"2024-09-13T17:09:18.955870+0000","last_active":"2024-09-13T17:09:19.942215+0000","last_peered":"2024-09-13T17:09:19.942215+0000","last_clean":"2024-09-13T17:09:19.942215+0000","last_became_active":"2024-09-13T17:09:18.955619+0000","last_became_peered":"2024-09-13T17:09:18.955619+0000","last_unstale":"2024-09-13T17:09:19.942215+0000","last_undegraded":"2024-09-13T17:09:19.942215+0000","last_fullsized":"2024-09-13T17:09:19.942215+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:19.040493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942468+0000","last_change":"2024-09-13T17:09:18.576195+0000","last_active":"2024-09-13T17:09:19.942468+0000","last_peered":"2024-09-13T17:09:19.942468+0000","last_clean":"2024-09-13T17:09:19.942468+0000","last_became_active":"2024-09-13T17:09:18.575801+0000","last_became_peered":"2024-09-13T17:09:18.575801+0000","last_unstale":"2024-09-13T17:09:19.942468+0000","last_undegraded":"2024-09-13T17:09:19.942468+0000","last_fullsized":"2024-09-13T17:09:19.942468+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:17.720159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936637+0000","last_change":"2024-09-13T17:09:18.964805+0000","last_active":"2024-09-13T17:09:19.936637+0000","last_peered":"2024-09-13T17:09:19.936637+0000","last_clean":"2024-09-13T17:09:19.936637+0000","last_became_active":"2024-09-13T17:09:18.964551+0000","last_became_peered":"2024-09-13T17:09:18.964551+0000","last_unstale":"2024-09-13T17:09:19.936637+0000","last_undegraded":"2024-09-13T17:09:19.936637+0000","last_fullsized":"2024-09-13T17:09:19.936637+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:06.821655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.938287+0000","last_change":"2024-09-13T17:09:18.573784+0000","last_active":"2024-09-13T17:09:19.938287+0000","last_peered":"2024-09-13T17:09:19.938287+0000","last_clean":"2024-09-13T17:09:19.938287+0000","last_became_active":"2024-09-13T17:09:18.573498+0000","last_became_peered":"2024-09-13T17:09:18.573498+0000","last_unstale":"2024-09-13T17:09:19.938287+0000","last_undegraded":"2024-09-13T17:09:19.938287+0000","last_fullsized":"2024-09-13T17:09:19.938287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:58.658075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937325+0000","last_change":"2024-09-13T17:09:18.965371+0000","last_active":"2024-09-13T17:09:19.937325+0000","last_peered":"2024-09-13T17:09:19.937325+0000","last_clean":"2024-09-13T17:09:19.937325+0000","last_became_active":"2024-09-13T17:09:18.965019+0000","last_became_peered":"2024-09-13T17:09:18.965019+0000","last_unstale":"2024-09-13T17:09:19.937325+0000","last_undegraded":"2024-09-13T17:09:19.937325+0000","last_fullsized":"2024-09-13T17:09:19.937325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:52.215517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.940785+0000","last_change":"2024-09-13T17:09:18.567360+0000","last_active":"2024-09-13T17:09:19.940785+0000","last_peered":"2024-09-13T17:09:19.940785+0000","last_clean":"2024-09-13T17:09:19.940785+0000","last_became_active":"2024-09-13T17:09:18.567073+0000","last_became_peered":"2024-09-13T17:09:18.567073+0000","last_unstale":"2024-09-13T17:09:19.940785+0000","last_undegraded":"2024-09-13T17:09:19.940785+0000","last_fullsized":"2024-09-13T17:09:19.940785+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:17.546280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937707+0000","last_change":"2024-09-13T17:09:18.952386+0000","last_active":"2024-09-13T17:09:19.937707+0000","last_peered":"2024-09-13T17:09:19.937707+0000","last_clean":"2024-09-13T17:09:19.937707+0000","last_became_active":"2024-09-13T17:09:18.952150+0000","last_became_peered":"2024-09-13T17:09:18.952150+0000","last_unstale":"2024-09-13T17:09:19.937707+0000","last_undegraded":"2024-09-13T17:09:19.937707+0000","last_fullsized":"2024-09-13T17:09:19.937707+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:58.644912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.937291+0000","last_change":"2024-09-13T17:09:18.570962+0000","last_active":"2024-09-13T17:09:19.937291+0000","last_peered":"2024-09-13T17:09:19.937291+0000","last_clean":"2024-09-13T17:09:19.937291+0000","last_became_active":"2024-09-13T17:09:18.570738+0000","last_became_peered":"2024-09-13T17:09:18.570738+0000","last_unstale":"2024-09-13T17:09:19.937291+0000","last_undegraded":"2024-09-13T17:09:19.937291+0000","last_fullsized":"2024-09-13T17:09:19.937291+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:31.576457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942811+0000","last_change":"2024-09-13T17:09:18.961177+0000","last_active":"2024-09-13T17:09:19.942811+0000","last_peered":"2024-09-13T17:09:19.942811+0000","last_clean":"2024-09-13T17:09:19.942811+0000","last_became_active":"2024-09-13T17:09:18.960872+0000","last_became_peered":"2024-09-13T17:09:18.960872+0000","last_unstale":"2024-09-13T17:09:19.942811+0000","last_undegraded":"2024-09-13T17:09:19.942811+0000","last_fullsized":"2024-09-13T17:09:19.942811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:24.367806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941066+0000","last_change":"2024-09-13T17:09:18.570035+0000","last_active":"2024-09-13T17:09:19.941066+0000","last_peered":"2024-09-13T17:09:19.941066+0000","last_clean":"2024-09-13T17:09:19.941066+0000","last_became_active":"2024-09-13T17:09:18.569787+0000","last_became_peered":"2024-09-13T17:09:18.569787+0000","last_unstale":"2024-09-13T17:09:19.941066+0000","last_undegraded":"2024-09-13T17:09:19.941066+0000","last_fullsized":"2024-09-13T17:09:19.941066+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:01.281283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941303+0000","last_change":"2024-09-13T17:09:18.945787+0000","last_active":"2024-09-13T17:09:19.941303+0000","last_peered":"2024-09-13T17:09:19.941303+0000","last_clean":"2024-09-13T17:09:19.941303+0000","last_became_active":"2024-09-13T17:09:18.945485+0000","last_became_peered":"2024-09-13T17:09:18.945485+0000","last_unstale":"2024-09-13T17:09:19.941303+0000","last_undegraded":"2024-09-13T17:09:19.941303+0000","last_fullsized":"2024-09-13T17:09:19.941303+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:44.916986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.941729+0000","last_change":"2024-09-13T17:09:18.571282+0000","last_active":"2024-09-13T17:09:19.941729+0000","last_peered":"2024-09-13T17:09:19.941729+0000","last_clean":"2024-09-13T17:09:19.941729+0000","last_became_active":"2024-09-13T17:09:18.570614+0000","last_became_peered":"2024-09-13T17:09:18.570614+0000","last_unstale":"2024-09-13T17:09:19.941729+0000","last_undegraded":"2024-09-13T17:09:19.941729+0000","last_fullsized":"2024-09-13T17:09:19.941729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:43.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942814+0000","last_change":"2024-09-13T17:09:18.960450+0000","last_active":"2024-09-13T17:09:19.942814+0000","last_peered":"2024-09-13T17:09:19.942814+0000","last_clean":"2024-09-13T17:09:19.942814+0000","last_became_active":"2024-09-13T17:09:18.960153+0000","last_became_peered":"2024-09-13T17:09:18.960153+0000","last_unstale":"2024-09-13T17:09:19.942814+0000","last_undegraded":"2024-09-13T17:09:19.942814+0000","last_fullsized":"2024-09-13T17:09:19.942814+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:25.491580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942926+0000","last_change":"2024-09-13T17:09:18.569812+0000","last_active":"2024-09-13T17:09:19.942926+0000","last_peered":"2024-09-13T17:09:19.942926+0000","last_clean":"2024-09-13T17:09:19.942926+0000","last_became_active":"2024-09-13T17:09:18.566802+0000","last_became_peered":"2024-09-13T17:09:18.566802+0000","last_unstale":"2024-09-13T17:09:19.942926+0000","last_undegraded":"2024-09-13T17:09:19.942926+0000","last_fullsized":"2024-09-13T17:09:19.942926+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:01.281283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.936095+0000","last_change":"2024-09-13T17:09:18.964054+0000","last_active":"2024-09-13T17:09:19.936095+0000","last_peered":"2024-09-13T17:09:19.936095+0000","last_clean":"2024-09-13T17:09:19.936095+0000","last_became_active":"2024-09-13T17:09:18.963701+0000","last_became_peered":"2024-09-13T17:09:18.963701+0000","last_unstale":"2024-09-13T17:09:19.936095+0000","last_undegraded":"2024-09-13T17:09:19.936095+0000","last_fullsized":"2024-09-13T17:09:19.936095+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:18.540632+0000","last_clean_scrub_stamp":"2024-09-13T17:09:18.540632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:21.868206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T17:09:19.942813+0000","last_change":"2024-09-13T17:09:18.567005+0000","last_active":"2024-09-13T17:09:19.942813+0000","last_peered":"2024-09-13T17:09:19.942813+0000","last_clean":"2024-09-13T17:09:19.942813+0000","last_became_active":"2024-09-13T17:09:18.566720+0000","last_became_peered":"2024-09-13T17:09:18.566720+0000","last_unstale":"2024-09-13T17:09:19.942813+0000","last_undegraded":"2024-09-13T17:09:19.942813+0000","last_fullsized":"2024-09-13T17:09:19.942813+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:17.530901+0000","last_clean_scrub_stamp":"2024-09-13T17:09:17.530901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:25.906140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":217,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T17:09:18.945720+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:09:18.945720+0000","last_peered":"2024-09-13T17:09:18.945720+0000","last_clean":"2024-09-13T17:09:18.945720+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:09:18.945720+0000","last_undegraded":"2024-09-13T17:09:18.945720+0000","last_fullsized":"2024-09-13T17:09:18.945720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1478656,"data_stored":960558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85299999999999998,"15min":0.85499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90300000000000002,"15min":0.91400000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.71699999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91900000000000004,"15min":0.92500000000000004},"min":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.415,"5min":1.456,"15min":1.456},"last":1.1839999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.84999999999999998,"15min":0.84399999999999997},"min":{"1min":0.58899999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.99399999999999999,"15min":1.0069999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.99299999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91900000000000004,"15min":0.91700000000000004},"min":{"1min":0.63100000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.208,"5min":1.288,"15min":1.288},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.98999999999999999,"15min":1},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.88}]},{"osd":4,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.90900000000000003,"15min":0.90400000000000003},"min":{"1min":0.65000000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.119,"15min":1.1240000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.071}]},{"osd":5,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0329999999999999,"15min":1.0389999999999999},"min":{"1min":0.69699999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.395,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.111},{"interface":"front","average":{"1min":1.044,"5min":1.022,"15min":1.018},"min":{"1min":0.77200000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0920000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.1140000000000001,"15min":1.1279999999999999},"min":{"1min":0.76600000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.405,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.1339999999999999,"15min":1.139},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.452,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.143}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":369666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.75600000000000001,"15min":0.754},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97799999999999998,"5min":1.024,"15min":1.024},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.872,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.27,"5min":1.431,"15min":1.431},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91600000000000004,"15min":0.92400000000000004},"min":{"1min":0.60399999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.161,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91400000000000003,"15min":0.91200000000000003},"min":{"1min":0.64300000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.179,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.84499999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.60799999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1459999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.96599999999999997,"15min":0.98199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1379999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.0649999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.96099999999999997,"15min":0.97799999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.0700000000000001,"5min":1.359,"15min":1.359},"last":1.01},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0509999999999999,"15min":1.054},"min":{"1min":0.79900000000000004,"5min":0.749,"15min":0.749},"max":{"1min":1.262,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.153}]},{"osd":4,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.90700000000000003,"15min":0.90900000000000003},"min":{"1min":0.626,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0209999999999999,"15min":1.024},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.2070000000000001,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0169999999999999,"15min":1.0189999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.087},{"interface":"front","average":{"1min":1.044,"5min":1.069,"15min":1.073},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.264,"5min":1.597,"15min":1.597},"last":0.90000000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1060000000000001,"15min":1.109},"min":{"1min":0.79900000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3360000000000001,"5min":1.728,"15min":1.728},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.131,"5min":1.1870000000000001,"15min":1.1970000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.518,"5min":2.194,"15min":2.194},"last":1.204}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":369664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.86399999999999999,"15min":0.872},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1339999999999999,"5min":1.395,"15min":1.395},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.879,"15min":0.88800000000000001},"min":{"1min":0.56999999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.65600000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.94999999999999996,"15min":0.95799999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.339,"5min":1.508,"15min":1.508},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.622,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.97099999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84899999999999998,"15min":0.85199999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.137,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.879},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.91200000000000003,"15min":0.92100000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2370000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.98599999999999999,"15min":1.004},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.377,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.147},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91700000000000004,"15min":0.93000000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.272,"5min":1.603,"15min":1.603},"last":0.83599999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.044,"15min":1.0660000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1180000000000001,"5min":1.466,"15min":1.466},"last":1.208},{"interface":"front","average":{"1min":0.90700000000000003,"5min":1.0189999999999999,"15min":1.038},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2090000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.0549999999999999,"15min":1.071},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.347,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.04,"5min":1.171,"15min":1.1930000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.248,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:08:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.1299999999999999,"15min":1.1479999999999999},"min":{"1min":0.78500000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5269999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.1930000000000001,"15min":1.2130000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.4530000000000001,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.0309999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":369644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.82299999999999995,"15min":0.83599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0589999999999999,"5min":1.306,"15min":1.306},"last":0.89600000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91000000000000003,"15min":0.90900000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.29,"5min":1.357,"15min":1.357},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88900000000000001,"15min":0.88300000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.92400000000000004,"15min":0.91000000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.024}]},{"osd":3,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.91200000000000003,"15min":0.92200000000000004},"min":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1990000000000001,"5min":1.464,"15min":1.464},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.89300000000000002,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.94999999999999996,"15min":0.94099999999999995},"min":{"1min":0.63600000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0640000000000001,"15min":1.0620000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.131}]},{"osd":6,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.96899999999999997,"15min":0.97299999999999998},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.208,"5min":1.26,"15min":1.26},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.048,"15min":1.044},"min":{"1min":0.77000000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.97599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.083,"15min":1.085},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.4119999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.129,"15min":1.127},"min":{"1min":0.93000000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":1.0449999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":369686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75800000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.33600000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.82799999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.32500000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83899999999999997,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.56399999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96599999999999997,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.38}]},{"osd":2,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.76200000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.505},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.51800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.96199999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91700000000000004,"15min":0.92400000000000004},"min":{"1min":0.66500000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1759999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.73699999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.0149999999999999,"5min":1.899,"15min":1.899},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.91700000000000004,"15min":0.92900000000000005},"min":{"1min":0.59499999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.94399999999999995,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.99399999999999999,"15min":0.996},"min":{"1min":0.72699999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.337,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.44800000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.018,"15min":1.024},"min":{"1min":0.754,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.157,"5min":1.635,"15min":1.635},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.028,"15min":1.044},"min":{"1min":0.71499999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1970000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:08:38 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.085,"15min":1.093},"min":{"1min":0.746,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.288,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.78700000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2549999999999999,"5min":1.756,"15min":1.756},"last":0.57299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":371138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.432,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.505},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.628,"15min":0.63500000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.81200000000000006}]},{"osd":1,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.86199999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.76600000000000001,"15min":0.77900000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.038,"5min":1.103,"15min":1.103},"last":0.84999999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.93600000000000005,"15min":0.94499999999999995},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2190000000000001,"5min":1.3,"15min":1.3},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92900000000000005,"15min":0.92700000000000005},"min":{"1min":0.748,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.93000000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.95499999999999996,"15min":0.95799999999999996},"min":{"1min":0.76300000000000001,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.92000000000000004,"15min":0.91600000000000004},"min":{"1min":0.70799999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.1950000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.67000000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.194,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.999,"15min":0.99199999999999999},"min":{"1min":0.82699999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.95799999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0529999999999999,"15min":1.0609999999999999},"min":{"1min":0.78600000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.998,"5min":1.03,"15min":1.0349999999999999},"min":{"1min":0.73599999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.268,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.3460000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":897024,"data_stored":371754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.48899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.873,"5min":1.151,"15min":1.151},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65900000000000003,"15min":0.66900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86699999999999999,"5min":1.306,"15min":1.306},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.752,"15min":0.755},"min":{"1min":0.38800000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.98399999999999999,"5min":1.28,"15min":1.28},"last":0.91100000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.437,"5min":0.308,"15min":0.308},"max":{"1min":1.0149999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0269999999999999,"5min":1.905,"15min":1.905},"last":0.99399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.96099999999999997,"15min":0.96599999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3580000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.073},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.026,"15min":1.0389999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.202,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.111}]},{"osd":5,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0669999999999999,"15min":1.0780000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3140000000000001,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.038,"5min":1.107,"15min":1.119},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.377,"5min":1.556,"15min":1.556},"last":1.034}]},{"osd":6,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0700000000000001,"15min":1.0820000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4530000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1339999999999999,"15min":1.1439999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4199999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.95499999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:08:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.1539999999999999,"15min":1.165},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3839999999999999,"5min":1.712,"15min":1.712},"last":1.21},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.095,"15min":1.101},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5720000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.179}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1470464,"data_stored":959942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.38400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.99399999999999999,"5min":3.25,"15min":3.25},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.80700000000000005,"15min":0.81999999999999995},"min":{"1min":0.53100000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95599999999999996,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.626}]},{"osd":2,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.91800000000000004,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.85999999999999999,"15min":0.89000000000000001},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.999,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.84599999999999997,"15min":0.874},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96299999999999997,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.439},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.94499999999999995,"15min":0.97099999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.333,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.012,"15min":1.0329999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5289999999999999,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0449999999999999,"15min":1.0620000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.4239999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.069,"15min":1.083},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.421,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.091,"15min":1.1180000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.222,"5min":5.399,"15min":5.399},"last":0.86199999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.143,"15min":1.161},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.482,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.032,"5min":1.111,"15min":1.1240000000000001},"min":{"1min":0.79100000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3720000000000001,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.879}]},{"osd":7,"last update":"Fri Sep 13 17:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.127,"15min":1.135},"min":{"1min":0.76200000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6379999999999999,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.202,"15min":1.23},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5760000000000001,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":0.94299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:09:23.339 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:09:23.339 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T17:09:23.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.458+0000 7ffb6526b700 1 Processor -- start 2024-09-13T17:09:23.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.458+0000 7ffb6526b700 1 -- start start 2024-09-13T17:09:23.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.458+0000 7ffb6526b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb600d0f40 0x7ffb600d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.458+0000 7ffb6526b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb600b58b0 0x7ffb600d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.458+0000 7ffb6526b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb600b0060 con 0x7ffb600b1100 2024-09-13T17:09:23.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.458+0000 7ffb6526b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb600b0340 con 0x7ffb600d0f40 2024-09-13T17:09:23.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.458+0000 7ffb6526b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb600b0620 con 0x7ffb600b58b0 2024-09-13T17:09:23.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb5ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb600d0f40 0x7ffb600d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb5ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb600d0f40 0x7ffb600d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52802/0 (socket says 172.21.15.123:52802) 2024-09-13T17:09:23.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb5ffff700 1 -- 172.21.15.123:0/2636864545 learned_addr learned my addr 172.21.15.123:0/2636864545 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:23.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb5f7fe700 1 --2- 172.21.15.123:0/2636864545 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb600b58b0 0x7ffb600d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb5ffff700 1 -- 172.21.15.123:0/2636864545 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb600b58b0 msgr2=0x7ffb600d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:23.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb5ffff700 1 --2- 172.21.15.123:0/2636864545 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb600b58b0 0x7ffb600d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb5ffff700 1 -- 172.21.15.123:0/2636864545 >> v1:172.21.15.153:6789/0 conn(0x7ffb600b1100 legacy=0x7ffb600b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb5ffff700 1 -- 172.21.15.123:0/2636864545 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb600b0900 con 0x7ffb600d0f40 2024-09-13T17:09:23.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb5ffff700 1 --2- 172.21.15.123:0/2636864545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb600d0f40 0x7ffb600d1320 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009910 tx=0x7ffb50009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23260b63a0d3dc9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:23.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb5effd700 1 -- 172.21.15.123:0/2636864545 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50011830 con 0x7ffb600d0f40 2024-09-13T17:09:23.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb5effd700 1 -- 172.21.15.123:0/2636864545 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb50011990 con 0x7ffb600d0f40 2024-09-13T17:09:23.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb5effd700 1 -- 172.21.15.123:0/2636864545 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50011d40 con 0x7ffb600d0f40 2024-09-13T17:09:23.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb6526b700 1 -- 172.21.15.123:0/2636864545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb600d0f40 msgr2=0x7ffb600d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb6526b700 1 --2- 172.21.15.123:0/2636864545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb600d0f40 0x7ffb600d1320 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009910 tx=0x7ffb50009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:23.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb6526b700 1 -- 172.21.15.123:0/2636864545 shutdown_connections 2024-09-13T17:09:23.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb6526b700 1 --2- 172.21.15.123:0/2636864545 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb600b58b0 0x7ffb600d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb6526b700 1 --2- 172.21.15.123:0/2636864545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb600d0f40 0x7ffb600d1320 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb6526b700 1 -- 172.21.15.123:0/2636864545 >> 172.21.15.123:0/2636864545 conn(0x7ffb600d2a60 msgr2=0x7ffb600d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:23.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb6526b700 1 -- 172.21.15.123:0/2636864545 shutdown_connections 2024-09-13T17:09:23.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.462+0000 7ffb6526b700 1 -- 172.21.15.123:0/2636864545 wait complete. 2024-09-13T17:09:23.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.466+0000 7ffb6526b700 1 Processor -- start 2024-09-13T17:09:23.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.466+0000 7ffb6526b700 1 -- start start 2024-09-13T17:09:23.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.466+0000 7ffb6526b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb600b1100 0x7ffb6015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.466+0000 7ffb6526b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb600b58b0 0x7ffb6015fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.466+0000 7ffb6526b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb600d0f40 0x7ffb600c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.466+0000 7ffb6526b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6015c6b0 con 0x7ffb600d0f40 2024-09-13T17:09:23.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.466+0000 7ffb6526b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6015e8c0 con 0x7ffb600b1100 2024-09-13T17:09:23.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.466+0000 7ffb6526b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6015eba0 con 0x7ffb600b58b0 2024-09-13T17:09:23.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.466+0000 7ffb64a6a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb600d0f40 0x7ffb600c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.466+0000 7ffb5ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb600b1100 0x7ffb6015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.466+0000 7ffb5f7fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb600b58b0 0x7ffb6015fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.466+0000 7ffb64a6a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb600d0f40 0x7ffb600c64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52812/0 (socket says 172.21.15.123:52812) 2024-09-13T17:09:23.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.466+0000 7ffb64a6a700 1 -- 172.21.15.123:0/138603145 learned_addr learned my addr 172.21.15.123:0/138603145 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:23.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb64a6a700 1 -- 172.21.15.123:0/138603145 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb600b58b0 msgr2=0x7ffb6015fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb64a6a700 1 --2- 172.21.15.123:0/138603145 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb600b58b0 0x7ffb6015fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb64a6a700 1 -- 172.21.15.123:0/138603145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb600b1100 msgr2=0x7ffb6015bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb64a6a700 1 --2- 172.21.15.123:0/138603145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb600b1100 0x7ffb6015bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb64a6a700 1 -- 172.21.15.123:0/138603145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb50009570 con 0x7ffb600d0f40 2024-09-13T17:09:23.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb5ffff700 1 --2- 172.21.15.123:0/138603145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb600b1100 0x7ffb6015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:23.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb64a6a700 1 --2- 172.21.15.123:0/138603145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb600d0f40 0x7ffb600c64c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800caf0 tx=0x7ffb5800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:23.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb5cff9700 1 -- 172.21.15.123:0/138603145 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58003c20 con 0x7ffb600d0f40 2024-09-13T17:09:23.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb5cff9700 1 -- 172.21.15.123:0/138603145 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb58003d80 con 0x7ffb600d0f40 2024-09-13T17:09:23.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb6526b700 1 -- 172.21.15.123:0/138603145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6015ee80 con 0x7ffb600d0f40 2024-09-13T17:09:23.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb5cff9700 1 -- 172.21.15.123:0/138603145 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5800aa20 con 0x7ffb600d0f40 2024-09-13T17:09:23.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb6526b700 1 -- 172.21.15.123:0/138603145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6015f440 con 0x7ffb600d0f40 2024-09-13T17:09:23.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb6526b700 1 -- 172.21.15.123:0/138603145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb6015ce70 con 0x7ffb600d0f40 2024-09-13T17:09:23.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb5cff9700 1 -- 172.21.15.123:0/138603145 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb5800ab80 con 0x7ffb600d0f40 2024-09-13T17:09:23.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.470+0000 7ffb5cff9700 1 --2- 172.21.15.123:0/138603145 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb40066730 0x7ffb40068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.474+0000 7ffb5cff9700 1 -- 172.21.15.123:0/138603145 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb580840e0 con 0x7ffb600d0f40 2024-09-13T17:09:23.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.474+0000 7ffb5ffff700 1 --2- 172.21.15.123:0/138603145 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb40066730 0x7ffb40068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.474+0000 7ffb5ffff700 1 --2- 172.21.15.123:0/138603145 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb40066730 0x7ffb40068bf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009c60 tx=0x7ffb50008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:23.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.482+0000 7ffb5cff9700 1 -- 172.21.15.123:0/138603145 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffb58051330 con 0x7ffb600d0f40 2024-09-13T17:09:23.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.718+0000 7ffb6526b700 1 -- 172.21.15.123:0/138603145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ffb6008c250 con 0x7ffb600d0f40 2024-09-13T17:09:23.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.726+0000 7ffb5cff9700 1 -- 172.21.15.123:0/138603145 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7ffb58054950 con 0x7ffb600d0f40 2024-09-13T17:09:23.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.730+0000 7ffb6526b700 1 -- 172.21.15.123:0/138603145 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb40066730 msgr2=0x7ffb40068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.730+0000 7ffb6526b700 1 --2- 172.21.15.123:0/138603145 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb40066730 0x7ffb40068bf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009c60 tx=0x7ffb50008030 comp rx=0 tx=0).stop 2024-09-13T17:09:23.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.730+0000 7ffb6526b700 1 -- 172.21.15.123:0/138603145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb600d0f40 msgr2=0x7ffb600c64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.730+0000 7ffb6526b700 1 --2- 172.21.15.123:0/138603145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb600d0f40 0x7ffb600c64c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800caf0 tx=0x7ffb5800ce00 comp rx=0 tx=0).stop 2024-09-13T17:09:23.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.730+0000 7ffb6526b700 1 -- 172.21.15.123:0/138603145 shutdown_connections 2024-09-13T17:09:23.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.730+0000 7ffb6526b700 1 --2- 172.21.15.123:0/138603145 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb40066730 0x7ffb40068bf0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.730+0000 7ffb6526b700 1 --2- 172.21.15.123:0/138603145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb600d0f40 0x7ffb600c64c0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.730+0000 7ffb6526b700 1 --2- 172.21.15.123:0/138603145 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb600b58b0 0x7ffb6015fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.730+0000 7ffb6526b700 1 --2- 172.21.15.123:0/138603145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb600b1100 0x7ffb6015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.730+0000 7ffb6526b700 1 -- 172.21.15.123:0/138603145 >> 172.21.15.123:0/138603145 conn(0x7ffb600d2a60 msgr2=0x7ffb60070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:23.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.730+0000 7ffb6526b700 1 -- 172.21.15.123:0/138603145 shutdown_connections 2024-09-13T17:09:23.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.730+0000 7ffb6526b700 1 -- 172.21.15.123:0/138603145 wait complete. 2024-09-13T17:09:23.737 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-13T17:09:23.751 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:09:23.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.862+0000 7f2ea93ba700 1 Processor -- start 2024-09-13T17:09:23.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.862+0000 7f2ea93ba700 1 -- start start 2024-09-13T17:09:23.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.862+0000 7f2ea93ba700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2ea40d0c50 0x7f2ea415efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.862+0000 7f2ea93ba700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea40ce190 con 0x7f2ea415ac60 2024-09-13T17:09:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.862+0000 7f2ea93ba700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea40cd610 con 0x7f2ea40afc30 2024-09-13T17:09:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.862+0000 7f2ea93ba700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea40cd8f0 con 0x7f2ea40d0c50 2024-09-13T17:09:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.862+0000 7f2ea8bb9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2ea40d0c50 0x7f2ea415efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.862+0000 7f2ea8bb9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2ea40d0c50 0x7f2ea415efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52824/0 (socket says 172.21.15.123:52824) 2024-09-13T17:09:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.862+0000 7f2ea8bb9700 1 -- 172.21.15.123:0/232034791 learned_addr learned my addr 172.21.15.123:0/232034791 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.862+0000 7f2ea8bb9700 1 -- 172.21.15.123:0/232034791 >> v1:172.21.15.153:6789/0 conn(0x7f2ea40afc30 legacy=0x7f2ea415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.862+0000 7f2ea8bb9700 1 -- 172.21.15.123:0/232034791 >> v1:172.21.15.123:6789/0 conn(0x7f2ea415ac60 legacy=0x7f2ea40af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.862+0000 7f2ea8bb9700 1 -- 172.21.15.123:0/232034791 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea40cdbd0 con 0x7f2ea40d0c50 2024-09-13T17:09:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.866+0000 7f2ea8bb9700 1 --2- 172.21.15.123:0/232034791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ea40d0c50 0x7f2ea415efb0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c009e80 tx=0x7f2e9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7873f0ca25bcfdd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:23.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.866+0000 7f2ea37fe700 1 -- 172.21.15.123:0/232034791 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c00e070 con 0x7f2ea40d0c50 2024-09-13T17:09:23.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.866+0000 7f2ea37fe700 1 -- 172.21.15.123:0/232034791 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c003a40 con 0x7f2ea40d0c50 2024-09-13T17:09:23.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.866+0000 7f2ea37fe700 1 -- 172.21.15.123:0/232034791 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c003df0 con 0x7f2ea40d0c50 2024-09-13T17:09:23.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.866+0000 7f2ea93ba700 1 -- 172.21.15.123:0/232034791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ea40d0c50 msgr2=0x7f2ea415efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.866+0000 7f2ea93ba700 1 --2- 172.21.15.123:0/232034791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ea40d0c50 0x7f2ea415efb0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c009e80 tx=0x7f2e9c00b330 comp rx=0 tx=0).stop 2024-09-13T17:09:23.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.866+0000 7f2ea93ba700 1 -- 172.21.15.123:0/232034791 shutdown_connections 2024-09-13T17:09:23.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.866+0000 7f2ea93ba700 1 --2- 172.21.15.123:0/232034791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ea40d0c50 0x7f2ea415efb0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.866+0000 7f2ea93ba700 1 -- 172.21.15.123:0/232034791 >> 172.21.15.123:0/232034791 conn(0x7f2ea40b24c0 msgr2=0x7f2ea40b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:23.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.866+0000 7f2ea93ba700 1 -- 172.21.15.123:0/232034791 shutdown_connections 2024-09-13T17:09:23.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.866+0000 7f2ea93ba700 1 -- 172.21.15.123:0/232034791 wait complete. 2024-09-13T17:09:23.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2ea93ba700 1 Processor -- start 2024-09-13T17:09:23.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2ea93ba700 1 -- start start 2024-09-13T17:09:23.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2ea93ba700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ea40afc30 0x7f2ea41516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2ea93ba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ea40d0c50 0x7f2ea40ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2ea93ba700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ea415ac60 0x7f2ea415d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2ea93ba700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea40cadd0 con 0x7f2ea40d0c50 2024-09-13T17:09:23.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2ea93ba700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea4152970 con 0x7f2ea40afc30 2024-09-13T17:09:23.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2ea93ba700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea4152c50 con 0x7f2ea415ac60 2024-09-13T17:09:23.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2e9bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ea40d0c50 0x7f2ea40ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2e9bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ea40d0c50 0x7f2ea40ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52832/0 (socket says 172.21.15.123:52832) 2024-09-13T17:09:23.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2e9bfff700 1 -- 172.21.15.123:0/1031608773 learned_addr learned my addr 172.21.15.123:0/1031608773 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:23.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2ea8bb9700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ea415ac60 0x7f2ea415d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2ea3fff700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ea40afc30 0x7f2ea41516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2e9bfff700 1 -- 172.21.15.123:0/1031608773 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ea415ac60 msgr2=0x7f2ea415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2e9bfff700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ea415ac60 0x7f2ea415d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2e9bfff700 1 -- 172.21.15.123:0/1031608773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ea40afc30 msgr2=0x7f2ea41516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:23.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.870+0000 7f2e9bfff700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ea40afc30 0x7f2ea41516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:23.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.874+0000 7f2e9bfff700 1 -- 172.21.15.123:0/1031608773 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c009b30 con 0x7f2ea40d0c50 2024-09-13T17:09:23.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.874+0000 7f2ea8bb9700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ea415ac60 0x7f2ea415d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:23.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.874+0000 7f2e9bfff700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ea40d0c50 0x7f2ea40ca310 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00c4e0 tx=0x7f2e8c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:23.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.874+0000 7f2ea17fa700 1 -- 172.21.15.123:0/1031608773 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c011790 con 0x7f2ea40d0c50 2024-09-13T17:09:23.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.874+0000 7f2ea17fa700 1 -- 172.21.15.123:0/1031608773 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c011910 con 0x7f2ea40d0c50 2024-09-13T17:09:23.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.874+0000 7f2ea93ba700 1 -- 172.21.15.123:0/1031608773 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea4152f30 con 0x7f2ea40d0c50 2024-09-13T17:09:23.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.874+0000 7f2ea17fa700 1 -- 172.21.15.123:0/1031608773 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c011cc0 con 0x7f2ea40d0c50 2024-09-13T17:09:23.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.874+0000 7f2ea93ba700 1 -- 172.21.15.123:0/1031608773 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea40c7a90 con 0x7f2ea40d0c50 2024-09-13T17:09:23.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.874+0000 7f2ea93ba700 1 -- 172.21.15.123:0/1031608773 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea4153450 con 0x7f2ea40d0c50 2024-09-13T17:09:23.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.874+0000 7f2ea17fa700 1 -- 172.21.15.123:0/1031608773 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2e8c01c460 con 0x7f2ea40d0c50 2024-09-13T17:09:23.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.878+0000 7f2ea17fa700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e84066730 0x7f2e84068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:23.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.878+0000 7f2ea3fff700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e84066730 0x7f2e84068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:23.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.878+0000 7f2ea17fa700 1 -- 172.21.15.123:0/1031608773 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e8c083da0 con 0x7f2ea40d0c50 2024-09-13T17:09:23.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.878+0000 7f2ea3fff700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e84066730 0x7f2e84068bf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2e94001800 tx=0x7f2e94009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:23.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:23.886+0000 7f2ea17fa700 1 -- 172.21.15.123:0/1031608773 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2ea4153450 con 0x7f2ea40d0c50 2024-09-13T17:09:24.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.094+0000 7f2ea93ba700 1 -- 172.21.15.123:0/1031608773 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ea4153450 con 0x7f2ea40d0c50 2024-09-13T17:09:24.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.094+0000 7f2ea17fa700 1 -- 172.21.15.123:0/1031608773 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f2ea4153450 con 0x7f2ea40d0c50 2024-09-13T17:09:24.101 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:24.101 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3155329877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3155329877},{"type":"v1","addr":"172.21.15.153:6835","nonce":3155329877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6522,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3484528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3484528665},{"type":"v1","addr":"172.21.15.123:6835","nonce":3484528665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6525,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/4217126083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":4217126083},{"type":"v1","addr":"172.21.15.123:6837","nonce":4217126083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:09:18.926234+0000","modified":"2024-09-13T17:09:21.936807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6534":{"gid":6534,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6833/1222139823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1222139823},{"type":"v1","addr":"172.21.15.153:6833","nonce":1222139823}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T17:09:24.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.098+0000 7f2ea93ba700 1 -- 172.21.15.123:0/1031608773 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e84066730 msgr2=0x7f2e84068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.098+0000 7f2ea93ba700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e84066730 0x7f2e84068bf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2e94001800 tx=0x7f2e94009040 comp rx=0 tx=0).stop 2024-09-13T17:09:24.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.098+0000 7f2ea93ba700 1 -- 172.21.15.123:0/1031608773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ea40d0c50 msgr2=0x7f2ea40ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.098+0000 7f2ea93ba700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ea40d0c50 0x7f2ea40ca310 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00c4e0 tx=0x7f2e8c00c7f0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.098+0000 7f2ea93ba700 1 -- 172.21.15.123:0/1031608773 shutdown_connections 2024-09-13T17:09:24.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.098+0000 7f2ea93ba700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e84066730 0x7f2e84068bf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.098+0000 7f2ea93ba700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ea415ac60 0x7f2ea415d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.098+0000 7f2ea93ba700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ea40d0c50 0x7f2ea40ca310 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.098+0000 7f2ea93ba700 1 --2- 172.21.15.123:0/1031608773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ea40afc30 0x7f2ea41516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.098+0000 7f2ea93ba700 1 -- 172.21.15.123:0/1031608773 >> 172.21.15.123:0/1031608773 conn(0x7f2ea40b24c0 msgr2=0x7f2ea40b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:24.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.098+0000 7f2ea93ba700 1 -- 172.21.15.123:0/1031608773 shutdown_connections 2024-09-13T17:09:24.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.098+0000 7f2ea93ba700 1 -- 172.21.15.123:0/1031608773 wait complete. 2024-09-13T17:09:24.107 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 35 2024-09-13T17:09:24.524 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:09:18.926234+0000', 'modified': '2024-09-13T17:09:21.936807+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6534}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6534': {'gid': 6534, 'name': 'b', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6833/1222139823', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 1222139823}, {'type': 'v1', 'addr': '172.21.15.153:6833', 'nonce': 1222139823}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:09:24.524 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:09:24.524 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T17:09:24.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.642+0000 7ff5b24b3700 1 Processor -- start 2024-09-13T17:09:24.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.642+0000 7ff5b24b3700 1 -- start start 2024-09-13T17:09:24.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5b24b3700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5ac159750 0x7ff5ac0ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5b24b3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff5ac0afbe0 0x7ff5ac0c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5b24b3700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac06d6f0 con 0x7ff5ac0cd2a0 2024-09-13T17:09:24.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5b24b3700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac06d9d0 con 0x7ff5ac0afbe0 2024-09-13T17:09:24.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5b24b3700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0c8f70 con 0x7ff5ac159750 2024-09-13T17:09:24.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5abfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5ac159750 0x7ff5ac0ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5abfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5ac159750 0x7ff5ac0ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:49892/0 (socket says 172.21.15.123:49892) 2024-09-13T17:09:24.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5b0a50700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff5ac0afbe0 0x7ff5ac0c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5abfff700 1 -- 172.21.15.123:0/1703482996 learned_addr learned my addr 172.21.15.123:0/1703482996 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:24.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5b0a50700 1 -- 172.21.15.123:0/1703482996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5ac159750 msgr2=0x7ff5ac0ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:24.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5b0a50700 1 --2- 172.21.15.123:0/1703482996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5ac159750 0x7ff5ac0ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5b0a50700 1 -- 172.21.15.123:0/1703482996 >> v1:172.21.15.153:6789/0 conn(0x7ff5ac0cd2a0 legacy=0x7ff5ac0af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5b0a50700 1 -- 172.21.15.123:0/1703482996 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac0c9250 con 0x7ff5ac0afbe0 2024-09-13T17:09:24.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5abfff700 1 --2- 172.21.15.123:0/1703482996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5ac159750 0x7ff5ac0ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:24.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5b0a50700 1 --2- 172.21.15.123:0/1703482996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5ac0afbe0 0x7ff5ac0c9a50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009d90 tx=0x7ff5a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e030f6bbdc6cfccc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:24.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5aaffd700 1 -- 172.21.15.123:0/1703482996 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400e070 con 0x7ff5ac0afbe0 2024-09-13T17:09:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5aaffd700 1 -- 172.21.15.123:0/1703482996 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a400bb20 con 0x7ff5ac0afbe0 2024-09-13T17:09:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.646+0000 7ff5aaffd700 1 -- 172.21.15.123:0/1703482996 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4012430 con 0x7ff5ac0afbe0 2024-09-13T17:09:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 -- 172.21.15.123:0/1703482996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5ac0afbe0 msgr2=0x7ff5ac0c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 --2- 172.21.15.123:0/1703482996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5ac0afbe0 0x7ff5ac0c9a50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009d90 tx=0x7ff5a400b330 comp rx=0 tx=0).stop 2024-09-13T17:09:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 -- 172.21.15.123:0/1703482996 shutdown_connections 2024-09-13T17:09:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 --2- 172.21.15.123:0/1703482996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5ac0afbe0 0x7ff5ac0c9a50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 --2- 172.21.15.123:0/1703482996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5ac159750 0x7ff5ac0ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 -- 172.21.15.123:0/1703482996 >> 172.21.15.123:0/1703482996 conn(0x7ff5ac0b0450 msgr2=0x7ff5ac0b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:24.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 -- 172.21.15.123:0/1703482996 shutdown_connections 2024-09-13T17:09:24.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 -- 172.21.15.123:0/1703482996 wait complete. 2024-09-13T17:09:24.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 Processor -- start 2024-09-13T17:09:24.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 -- start start 2024-09-13T17:09:24.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5ac0afbe0 0x7ff5ac1f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5ac0cd2a0 0x7ff5ac156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5ac159750 0x7ff5ac157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0a88d0 con 0x7ff5ac159750 2024-09-13T17:09:24.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0c5950 con 0x7ff5ac0cd2a0 2024-09-13T17:09:24.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b24b3700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac1f2900 con 0x7ff5ac0afbe0 2024-09-13T17:09:24.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b0a50700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5ac159750 0x7ff5ac157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b0a50700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5ac159750 0x7ff5ac157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52836/0 (socket says 172.21.15.123:52836) 2024-09-13T17:09:24.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.650+0000 7ff5b0a50700 1 -- 172.21.15.123:0/3821499839 learned_addr learned my addr 172.21.15.123:0/3821499839 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:24.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.654+0000 7ff5ab7fe700 1 --2- 172.21.15.123:0/3821499839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5ac0cd2a0 0x7ff5ac156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.654+0000 7ff5abfff700 1 --2- 172.21.15.123:0/3821499839 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5ac0afbe0 0x7ff5ac1f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.654+0000 7ff5b0a50700 1 -- 172.21.15.123:0/3821499839 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5ac0afbe0 msgr2=0x7ff5ac1f2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.654+0000 7ff5b0a50700 1 --2- 172.21.15.123:0/3821499839 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5ac0afbe0 0x7ff5ac1f2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.654+0000 7ff5b0a50700 1 -- 172.21.15.123:0/3821499839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5ac0cd2a0 msgr2=0x7ff5ac156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.654+0000 7ff5b0a50700 1 --2- 172.21.15.123:0/3821499839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5ac0cd2a0 0x7ff5ac156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.654+0000 7ff5b0a50700 1 -- 172.21.15.123:0/3821499839 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a000b810 con 0x7ff5ac159750 2024-09-13T17:09:24.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.654+0000 7ff5b0a50700 1 --2- 172.21.15.123:0/3821499839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5ac159750 0x7ff5ac157b60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4014040 tx=0x7ff5a4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:24.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.654+0000 7ff5a8ff9700 1 -- 172.21.15.123:0/3821499839 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4012430 con 0x7ff5ac159750 2024-09-13T17:09:24.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.654+0000 7ff5a8ff9700 1 -- 172.21.15.123:0/3821499839 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4020070 con 0x7ff5ac159750 2024-09-13T17:09:24.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.654+0000 7ff5a8ff9700 1 -- 172.21.15.123:0/3821499839 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40098f0 con 0x7ff5ac159750 2024-09-13T17:09:24.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.654+0000 7ff5b24b3700 1 -- 172.21.15.123:0/3821499839 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a4009a70 con 0x7ff5ac159750 2024-09-13T17:09:24.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.654+0000 7ff5b24b3700 1 -- 172.21.15.123:0/3821499839 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac1f2590 con 0x7ff5ac159750 2024-09-13T17:09:24.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.654+0000 7ff5a8ff9700 1 -- 172.21.15.123:0/3821499839 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff5a4004040 con 0x7ff5ac159750 2024-09-13T17:09:24.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.658+0000 7ff5a8ff9700 1 --2- 172.21.15.123:0/3821499839 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff598066760 0x7ff598068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.658+0000 7ff5a8ff9700 1 -- 172.21.15.123:0/3821499839 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5a4022070 con 0x7ff5ac159750 2024-09-13T17:09:24.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.658+0000 7ff5abfff700 1 --2- 172.21.15.123:0/3821499839 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff598066760 0x7ff598068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.658+0000 7ff5abfff700 1 --2- 172.21.15.123:0/3821499839 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff598066760 0x7ff598068c20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0c8520 tx=0x7ff5a000b4f0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:24.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 Processor -- start 2024-09-13T17:09:24.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 -- start start 2024-09-13T17:09:24.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 0x1757180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1735d00 0x171f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x17576c0 0x171fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x167ed80 con 0x17576c0 2024-09-13T17:09:24.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x167c510 con 0x1735d00 2024-09-13T17:09:24.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x1677e00 con 0x1756da0 2024-09-13T17:09:24.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b0a50700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x17576c0 0x171fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b0a50700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x17576c0 0x171fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52852/0 (socket says 172.21.15.123:52852) 2024-09-13T17:09:24.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b0a50700 1 -- 172.21.15.123:0/1879834004 learned_addr learned my addr 172.21.15.123:0/1879834004 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:24.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5abfff700 1 --2- 172.21.15.123:0/1879834004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 0x1757180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5ab7fe700 1 --2- 172.21.15.123:0/1879834004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1735d00 0x171f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b0a50700 1 -- 172.21.15.123:0/1879834004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 msgr2=0x1757180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:24.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b0a50700 1 --2- 172.21.15.123:0/1879834004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 0x1757180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b0a50700 1 -- 172.21.15.123:0/1879834004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1735d00 msgr2=0x171f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:24.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b0a50700 1 --2- 172.21.15.123:0/1879834004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1735d00 0x171f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b0a50700 1 -- 172.21.15.123:0/1879834004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14ea960 con 0x17576c0 2024-09-13T17:09:24.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b0a50700 1 --2- 172.21.15.123:0/1879834004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x17576c0 0x171fdd0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4014010 tx=0x7ff5a4056610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519bd906d71cab55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:24.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5927fc700 1 -- 172.21.15.123:0/1879834004 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a406e070 con 0x17576c0 2024-09-13T17:09:24.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5927fc700 1 -- 172.21.15.123:0/1879834004 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4056cb0 con 0x17576c0 2024-09-13T17:09:24.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5927fc700 1 -- 172.21.15.123:0/1879834004 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a405aae0 con 0x17576c0 2024-09-13T17:09:24.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 -- 172.21.15.123:0/1879834004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x17576c0 msgr2=0x171fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 --2- 172.21.15.123:0/1879834004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x17576c0 0x171fdd0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4014010 tx=0x7ff5a4056610 comp rx=0 tx=0).stop 2024-09-13T17:09:24.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 -- 172.21.15.123:0/1879834004 shutdown_connections 2024-09-13T17:09:24.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 --2- 172.21.15.123:0/1879834004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x17576c0 0x171fdd0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 --2- 172.21.15.123:0/1879834004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1735d00 0x171f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 --2- 172.21.15.123:0/1879834004 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 0x1757180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 -- 172.21.15.123:0/1879834004 >> 172.21.15.123:0/1879834004 conn(0x149f4d0 msgr2=0x1738c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:24.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 -- 172.21.15.123:0/1879834004 shutdown_connections 2024-09-13T17:09:24.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.662+0000 7ff5b5764740 1 -- 172.21.15.123:0/1879834004 wait complete. 2024-09-13T17:09:24.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 1 -- start start 2024-09-13T17:09:24.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 1 Processor -- start 2024-09-13T17:09:24.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1735d00 0x1731d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 0x170ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17576c0 0x1710460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1635730 con 0x1735d00 2024-09-13T17:09:24.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x163b5b0 con 0x17576c0 2024-09-13T17:09:24.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x1523aa0 con 0x1756da0 2024-09-13T17:09:24.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 10 client.0 _ll_register_callbacks cb 0x1671610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:09:24.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5abfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1735d00 0x1731d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5abfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1735d00 0x1731d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52866/0 (socket says 172.21.15.123:52866) 2024-09-13T17:09:24.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5abfff700 1 -- 172.21.15.123:0/3671222431 learned_addr learned my addr 172.21.15.123:0/3671222431 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:24.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5ab7fe700 1 --2- 172.21.15.123:0/3671222431 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 0x170ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b0a50700 1 --2- 172.21.15.123:0/3671222431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17576c0 0x1710460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5abfff700 1 -- 172.21.15.123:0/3671222431 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 msgr2=0x170ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5abfff700 1 --2- 172.21.15.123:0/3671222431 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 0x170ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5abfff700 1 -- 172.21.15.123:0/3671222431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17576c0 msgr2=0x1710460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5abfff700 1 --2- 172.21.15.123:0/3671222431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17576c0 0x1710460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5abfff700 1 -- 172.21.15.123:0/3671222431 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac1f2590 con 0x1735d00 2024-09-13T17:09:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5abfff700 1 --2- 172.21.15.123:0/3671222431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1735d00 0x1731d30 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0010890 tx=0x7ff5a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef68b6b3c9fd52e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff58affd700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-13T17:09:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff58affd700 1 -- 172.21.15.123:0/3671222431 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0016070 con 0x1735d00 2024-09-13T17:09:24.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff58affd700 1 -- 172.21.15.123:0/3671222431 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5a001c620 con 0x1735d00 2024-09-13T17:09:24.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 1 -- 172.21.15.123:0/3671222431 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x14ac1e0 con 0x1735d00 2024-09-13T17:09:24.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff58affd700 1 -- 172.21.15.123:0/3671222431 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5a001c7e0 con 0x1735d00 2024-09-13T17:09:24.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 10 client.6666 fetch_fsmap learned FSMap version 35 2024-09-13T17:09:24.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 1 -- 172.21.15.123:0/3671222431 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x163e220 con 0x1735d00 2024-09-13T17:09:24.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff58affd700 1 -- 172.21.15.123:0/3671222431 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x14ac1e0 con 0x1735d00 2024-09-13T17:09:24.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff58affd700 1 -- 172.21.15.123:0/3671222431 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 35) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff5a0026070 con 0x1735d00 2024-09-13T17:09:24.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 10 client.6666 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:09:24.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 10 client.6666 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T17:09:24.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 20 client.6666 populate_metadata read hostname 'smithi123' 2024-09-13T17:09:24.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3671222431 >> [v2:172.21.15.153:6832/1222139823,v1:172.21.15.153:6833/1222139823] conn(0x170d990 0x176a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 4 client.6666 mds_command: new command op to 6534 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:09:24.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.666+0000 7ff5b5764740 1 -- 172.21.15.123:0/3671222431 --> [v2:172.21.15.153:6832/1222139823,v1:172.21.15.153:6833/1222139823] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x14f6460 con 0x170d990 2024-09-13T17:09:24.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff5ab7fe700 1 --2- 172.21.15.123:0/3671222431 >> [v2:172.21.15.153:6832/1222139823,v1:172.21.15.153:6833/1222139823] conn(0x170d990 0x176a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff58affd700 10 client.6666 ms_handle_connect on v2:172.21.15.153:6832/1222139823 2024-09-13T17:09:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff5ab7fe700 1 --2- 172.21.15.123:0/3671222431 >> [v2:172.21.15.153:6832/1222139823,v1:172.21.15.153:6833/1222139823] conn(0x170d990 0x176a870 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bc44eabdb021609 server_cookie=4cfc77af723abccc in_seq=0 out_seq=0 2024-09-13T17:09:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff58affd700 1 -- 172.21.15.123:0/3671222431 <== mds.0 v2:172.21.15.153:6832/1222139823 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x14f6460 con 0x170d990 2024-09-13T17:09:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff58affd700 10 client.6666 handle_command_reply: tid=0 2024-09-13T17:09:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff5b5764740 1 client.6666 shutdown 2024-09-13T17:09:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff5b5764740 1 -- 172.21.15.123:0/3671222431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1735d00 msgr2=0x1731d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3671222431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1735d00 0x1731d30 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0010890 tx=0x7ff5a0004770 comp rx=0 tx=0).stop 2024-09-13T17:09:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff5b5764740 1 -- 172.21.15.123:0/3671222431 shutdown_connections 2024-09-13T17:09:24.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3671222431 >> [v2:172.21.15.153:6832/1222139823,v1:172.21.15.153:6833/1222139823] conn(0x170d990 0x176a870 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3671222431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17576c0 0x1710460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff58affd700 0 client.6666 ms_handle_reset on v2:172.21.15.153:6832/1222139823 2024-09-13T17:09:24.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3671222431 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 0x170ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3671222431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1735d00 0x1731d30 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff5b5764740 1 -- 172.21.15.123:0/3671222431 >> 172.21.15.123:0/3671222431 conn(0x149f4d0 msgr2=0x1732570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:24.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff5b5764740 1 -- 172.21.15.123:0/3671222431 shutdown_connections 2024-09-13T17:09:24.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff5b5764740 1 -- 172.21.15.123:0/3671222431 wait complete. 2024-09-13T17:09:24.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.670+0000 7ff5b5764740 20 client.6666 trim_cache size 0 max 16384 2024-09-13T17:09:24.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.690+0000 7ff5b5764740 1 Processor -- start 2024-09-13T17:09:24.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 -- start start 2024-09-13T17:09:24.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1735d00 0x17548e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 0x1754e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17576c0 0x1755360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x16a6ec0 con 0x1735d00 2024-09-13T17:09:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x167ed80 con 0x17576c0 2024-09-13T17:09:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x1736470 con 0x1756da0 2024-09-13T17:09:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5abfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1735d00 0x17548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5abfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1735d00 0x17548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52878/0 (socket says 172.21.15.123:52878) 2024-09-13T17:09:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5abfff700 1 -- 172.21.15.123:0/3775543140 learned_addr learned my addr 172.21.15.123:0/3775543140 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5ab7fe700 1 --2- 172.21.15.123:0/3775543140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 0x1754e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b0a50700 1 --2- 172.21.15.123:0/3775543140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17576c0 0x1755360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5abfff700 1 -- 172.21.15.123:0/3775543140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 msgr2=0x1754e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:24.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5abfff700 1 --2- 172.21.15.123:0/3775543140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 0x1754e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5abfff700 1 -- 172.21.15.123:0/3775543140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17576c0 msgr2=0x1755360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:24.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5abfff700 1 --2- 172.21.15.123:0/3775543140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17576c0 0x1755360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5abfff700 1 -- 172.21.15.123:0/3775543140 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1624450 con 0x1735d00 2024-09-13T17:09:24.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5abfff700 1 --2- 172.21.15.123:0/3775543140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1735d00 0x17548e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000bd00 tx=0x7ff5a0024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea50775d685b1c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:24.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff592ffd700 1 -- 172.21.15.123:0/3775543140 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a00275f0 con 0x1735d00 2024-09-13T17:09:24.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff592ffd700 1 -- 172.21.15.123:0/3775543140 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a0023040 con 0x1735d00 2024-09-13T17:09:24.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff592ffd700 1 -- 172.21.15.123:0/3775543140 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a001cd90 con 0x1735d00 2024-09-13T17:09:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 -- 172.21.15.123:0/3775543140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1735d00 msgr2=0x17548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3775543140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1735d00 0x17548e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000bd00 tx=0x7ff5a0024000 comp rx=0 tx=0).stop 2024-09-13T17:09:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 -- 172.21.15.123:0/3775543140 shutdown_connections 2024-09-13T17:09:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3775543140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17576c0 0x1755360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3775543140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1756da0 0x1754e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3775543140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x1735d00 0x17548e0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 -- 172.21.15.123:0/3775543140 >> 172.21.15.123:0/3775543140 conn(0x149f4d0 msgr2=0x1766dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:24.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 -- 172.21.15.123:0/3775543140 shutdown_connections 2024-09-13T17:09:24.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.694+0000 7ff5b5764740 1 -- 172.21.15.123:0/3775543140 wait complete. 2024-09-13T17:09:24.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.698+0000 7ff5b5764740 1 -- start start 2024-09-13T17:09:24.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.698+0000 7ff5b5764740 1 Processor -- start 2024-09-13T17:09:24.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.698+0000 7ff5b5764740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1735d00 0x17b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.698+0000 7ff5b5764740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1756da0 0x17b8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.698+0000 7ff5b5764740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x17576c0 0x17b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.698+0000 7ff5b5764740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x1776180 con 0x17576c0 2024-09-13T17:09:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.698+0000 7ff5b5764740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x175d1a0 con 0x1756da0 2024-09-13T17:09:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.698+0000 7ff5b5764740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x17121e0 con 0x1735d00 2024-09-13T17:09:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.698+0000 7ff5b5764740 10 client.0 _ll_register_callbacks cb 0x16ce710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:09:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.698+0000 7ff5b0a50700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x17576c0 0x17b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.698+0000 7ff5b0a50700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x17576c0 0x17b8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52882/0 (socket says 172.21.15.123:52882) 2024-09-13T17:09:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.698+0000 7ff5abfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1735d00 0x17b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.698+0000 7ff5ab7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1756da0 0x17b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.698+0000 7ff5b0a50700 1 -- 172.21.15.123:0/3637157792 learned_addr learned my addr 172.21.15.123:0/3637157792 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b0a50700 1 -- 172.21.15.123:0/3637157792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1735d00 msgr2=0x17b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b0a50700 1 --2- 172.21.15.123:0/3637157792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1735d00 0x17b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b0a50700 1 -- 172.21.15.123:0/3637157792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1756da0 msgr2=0x17b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b0a50700 1 --2- 172.21.15.123:0/3637157792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1756da0 0x17b8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b0a50700 1 -- 172.21.15.123:0/3637157792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x163e220 con 0x17576c0 2024-09-13T17:09:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b0a50700 1 --2- 172.21.15.123:0/3637157792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x17576c0 0x17b8d60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40531b0 tx=0x7ff5a4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4de93636dc5f01a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff58affd700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-13T17:09:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff58affd700 1 -- 172.21.15.123:0/3637157792 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a406e040 con 0x17576c0 2024-09-13T17:09:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff58affd700 1 -- 172.21.15.123:0/3637157792 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5a4074030 con 0x17576c0 2024-09-13T17:09:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 1 -- 172.21.15.123:0/3637157792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5a4056cb0 con 0x17576c0 2024-09-13T17:09:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff58affd700 1 -- 172.21.15.123:0/3637157792 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5a405f0a0 con 0x17576c0 2024-09-13T17:09:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 10 client.6672 fetch_fsmap learned FSMap version 35 2024-09-13T17:09:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 1 -- 172.21.15.123:0/3637157792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x1618720 con 0x17576c0 2024-09-13T17:09:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff58affd700 1 -- 172.21.15.123:0/3637157792 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4056cb0 con 0x17576c0 2024-09-13T17:09:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff58affd700 1 -- 172.21.15.123:0/3637157792 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 35) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff5a406aaf0 con 0x17576c0 2024-09-13T17:09:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 10 client.6672 fetch_fsmap finished waiting for FSMap version 35 2024-09-13T17:09:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 10 client.6672 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T17:09:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 20 client.6672 populate_metadata read hostname 'smithi123' 2024-09-13T17:09:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3637157792 >> [v2:172.21.15.153:6832/1222139823,v1:172.21.15.153:6833/1222139823] conn(0x17b9680 0x175ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 4 client.6672 mds_command: new command op to 6534 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:09:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 1 -- 172.21.15.123:0/3637157792 --> [v2:172.21.15.153:6832/1222139823,v1:172.21.15.153:6833/1222139823] -- command(tid 0: {"prefix": "status"}) v1 -- 0x151b1e0 con 0x17b9680 2024-09-13T17:09:24.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5abfff700 1 --2- 172.21.15.123:0/3637157792 >> [v2:172.21.15.153:6832/1222139823,v1:172.21.15.153:6833/1222139823] conn(0x17b9680 0x175ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff58affd700 10 client.6672 ms_handle_connect on v2:172.21.15.153:6832/1222139823 2024-09-13T17:09:24.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5abfff700 1 --2- 172.21.15.123:0/3637157792 >> [v2:172.21.15.153:6832/1222139823,v1:172.21.15.153:6833/1222139823] conn(0x17b9680 0x175ab00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a827b9b56f8648a4 server_cookie=bc7b0a1e71c156d7 in_seq=0 out_seq=0 2024-09-13T17:09:24.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff58affd700 1 -- 172.21.15.123:0/3637157792 <== mds.0 v2:172.21.15.153:6832/1222139823 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x151b1e0 con 0x17b9680 2024-09-13T17:09:24.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff58affd700 10 client.6672 handle_command_reply: tid=0 2024-09-13T17:09:24.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 1 client.6672 shutdown 2024-09-13T17:09:24.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 1 -- 172.21.15.123:0/3637157792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x17576c0 msgr2=0x17b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3637157792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x17576c0 0x17b8d60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40531b0 tx=0x7ff5a4009750 comp rx=0 tx=0).stop 2024-09-13T17:09:24.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 1 -- 172.21.15.123:0/3637157792 shutdown_connections 2024-09-13T17:09:24.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3637157792 >> [v2:172.21.15.153:6832/1222139823,v1:172.21.15.153:6833/1222139823] conn(0x17b9680 0x175ab00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3637157792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x17576c0 0x17b8d60 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3637157792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1756da0 0x17b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff58affd700 0 client.6672 ms_handle_reset on v2:172.21.15.153:6832/1222139823 2024-09-13T17:09:24.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 1 --2- 172.21.15.123:0/3637157792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x1735d00 0x17b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 1 -- 172.21.15.123:0/3637157792 >> 172.21.15.123:0/3637157792 conn(0x149f4d0 msgr2=0x175fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:24.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.702+0000 7ff5b5764740 1 -- 172.21.15.123:0/3637157792 shutdown_connections 2024-09-13T17:09:24.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.706+0000 7ff5b5764740 1 -- 172.21.15.123:0/3637157792 wait complete. 2024-09-13T17:09:24.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.706+0000 7ff5b5764740 20 client.6672 trim_cache size 0 max 16384 2024-09-13T17:09:24.712 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:09:24.713 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "c45759e3-62b7-46ff-ad19-917097e4c126", 2024-09-13T17:09:24.713 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-13T17:09:24.713 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 6534, 2024-09-13T17:09:24.713 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-13T17:09:24.713 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-13T17:09:24.713 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-13T17:09:24.713 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 5.778462481, 2024-09-13T17:09:24.713 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 35, 2024-09-13T17:09:24.713 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 72, 2024-09-13T17:09:24.713 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 72, 2024-09-13T17:09:24.713 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 10.188964499000001 2024-09-13T17:09:24.713 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:09:24.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.706+0000 7ff5b24b3700 1 -- 172.21.15.123:0/3821499839 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff598066760 msgr2=0x7ff598068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.706+0000 7ff5b24b3700 1 --2- 172.21.15.123:0/3821499839 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff598066760 0x7ff598068c20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0c8520 tx=0x7ff5a000b4f0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.706+0000 7ff5b24b3700 1 -- 172.21.15.123:0/3821499839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5ac159750 msgr2=0x7ff5ac157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.706+0000 7ff5b24b3700 1 --2- 172.21.15.123:0/3821499839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5ac159750 0x7ff5ac157b60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4014040 tx=0x7ff5a4004af0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.706+0000 7ff5b24b3700 1 -- 172.21.15.123:0/3821499839 shutdown_connections 2024-09-13T17:09:24.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.706+0000 7ff5b24b3700 1 --2- 172.21.15.123:0/3821499839 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff598066760 0x7ff598068c20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.706+0000 7ff5b24b3700 1 --2- 172.21.15.123:0/3821499839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5ac159750 0x7ff5ac157b60 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.706+0000 7ff5b24b3700 1 --2- 172.21.15.123:0/3821499839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5ac0cd2a0 0x7ff5ac156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.706+0000 7ff5b24b3700 1 --2- 172.21.15.123:0/3821499839 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5ac0afbe0 0x7ff5ac1f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.706+0000 7ff5b24b3700 1 -- 172.21.15.123:0/3821499839 >> 172.21.15.123:0/3821499839 conn(0x7ff5ac0b0450 msgr2=0x7ff5ac071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:24.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.706+0000 7ff5b24b3700 1 -- 172.21.15.123:0/3821499839 shutdown_connections 2024-09-13T17:09:24.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.706+0000 7ff5b24b3700 1 -- 172.21.15.123:0/3821499839 wait complete. 2024-09-13T17:09:24.725 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:09:24.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5ce4825700 1 Processor -- start 2024-09-13T17:09:24.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5ce4825700 1 -- start start 2024-09-13T17:09:24.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5ce4825700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ce015a8c0 0x7f5ce00705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5ce4825700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5ce015b9b0 0x7f5ce0070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5ce4825700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5ce00713b0 0x7f5ce00cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5ce4825700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce0071860 con 0x7f5ce015b9b0 2024-09-13T17:09:24.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5ce4825700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce00cee80 con 0x7f5ce00713b0 2024-09-13T17:09:24.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5ce4825700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00ce270 con 0x7f5ce015a8c0 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5cdeffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5ce015b9b0 0x7f5ce0070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5cdeffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5ce015b9b0 0x7f5ce0070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52892/0 (socket says 172.21.15.123:52892) 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5cdeffd700 1 -- 172.21.15.123:0/3781450178 learned_addr learned my addr 172.21.15.123:0/3781450178 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5cdffff700 1 --2- 172.21.15.123:0/3781450178 >> v2:172.21.15.153:3300/0 conn(0x7f5ce00713b0 0x7f5ce00cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5cdf7fe700 1 --2- 172.21.15.123:0/3781450178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ce015a8c0 0x7f5ce00705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5cdeffd700 1 -- 172.21.15.123:0/3781450178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ce015a8c0 msgr2=0x7f5ce00705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5cdeffd700 1 --2- 172.21.15.123:0/3781450178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ce015a8c0 0x7f5ce00705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5cdeffd700 1 -- 172.21.15.123:0/3781450178 >> v2:172.21.15.153:3300/0 conn(0x7f5ce00713b0 msgr2=0x7f5ce00cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5cdeffd700 1 --2- 172.21.15.123:0/3781450178 >> v2:172.21.15.153:3300/0 conn(0x7f5ce00713b0 0x7f5ce00cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5cdeffd700 1 -- 172.21.15.123:0/3781450178 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce00ce550 con 0x7f5ce015b9b0 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5cdffff700 1 --2- 172.21.15.123:0/3781450178 >> v2:172.21.15.153:3300/0 conn(0x7f5ce00713b0 0x7f5ce00cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.838+0000 7f5cdeffd700 1 --2- 172.21.15.123:0/3781450178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ce015b9b0 0x7f5ce0070e70 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8009910 tx=0x7f5cc8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d635640e3da5c3e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:24.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.842+0000 7f5cde7fc700 1 -- 172.21.15.123:0/3781450178 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800ba20 con 0x7f5ce015b9b0 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.842+0000 7f5cde7fc700 1 -- 172.21.15.123:0/3781450178 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc800bb80 con 0x7f5ce015b9b0 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.842+0000 7f5cde7fc700 1 -- 172.21.15.123:0/3781450178 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8009e60 con 0x7f5ce015b9b0 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.842+0000 7f5ce4825700 1 -- 172.21.15.123:0/3781450178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ce015b9b0 msgr2=0x7f5ce0070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.842+0000 7f5ce4825700 1 --2- 172.21.15.123:0/3781450178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ce015b9b0 0x7f5ce0070e70 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8009910 tx=0x7f5cc8009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.842+0000 7f5ce4825700 1 -- 172.21.15.123:0/3781450178 shutdown_connections 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.842+0000 7f5ce4825700 1 --2- 172.21.15.123:0/3781450178 >> v2:172.21.15.153:3300/0 conn(0x7f5ce00713b0 0x7f5ce00cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.842+0000 7f5ce4825700 1 --2- 172.21.15.123:0/3781450178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ce015b9b0 0x7f5ce0070e70 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.842+0000 7f5ce4825700 1 --2- 172.21.15.123:0/3781450178 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ce015a8c0 0x7f5ce00705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.842+0000 7f5ce4825700 1 -- 172.21.15.123:0/3781450178 >> 172.21.15.123:0/3781450178 conn(0x7f5ce0066150 msgr2=0x7f5ce0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.842+0000 7f5ce4825700 1 -- 172.21.15.123:0/3781450178 shutdown_connections 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.842+0000 7f5ce4825700 1 -- 172.21.15.123:0/3781450178 wait complete. 2024-09-13T17:09:24.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5ce4825700 1 Processor -- start 2024-09-13T17:09:24.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5ce4825700 1 -- start start 2024-09-13T17:09:24.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5ce4825700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ce00713b0 0x7f5ce00ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5ce4825700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ce015a8c0 0x7f5ce0147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5ce4825700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce015b9b0 0x7f5ce00cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5ce4825700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce0146f40 con 0x7f5ce015a8c0 2024-09-13T17:09:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5ce4825700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce0148270 con 0x7f5ce015b9b0 2024-09-13T17:09:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5ce4825700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce0148550 con 0x7f5ce00713b0 2024-09-13T17:09:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5cdeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ce015a8c0 0x7f5ce0147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5cdf7fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ce00713b0 0x7f5ce00ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5cdeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ce015a8c0 0x7f5ce0147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52900/0 (socket says 172.21.15.123:52900) 2024-09-13T17:09:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5cdeffd700 1 -- 172.21.15.123:0/1815353367 learned_addr learned my addr 172.21.15.123:0/1815353367 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5cdffff700 1 --2- 172.21.15.123:0/1815353367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce015b9b0 0x7f5ce00cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5cdeffd700 1 -- 172.21.15.123:0/1815353367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ce00713b0 msgr2=0x7f5ce00ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5cdeffd700 1 --2- 172.21.15.123:0/1815353367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ce00713b0 0x7f5ce00ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5cdeffd700 1 -- 172.21.15.123:0/1815353367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce015b9b0 msgr2=0x7f5ce00cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5cdeffd700 1 --2- 172.21.15.123:0/1815353367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce015b9b0 0x7f5ce00cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5cdeffd700 1 -- 172.21.15.123:0/1815353367 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc8009570 con 0x7f5ce015a8c0 2024-09-13T17:09:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5cdeffd700 1 --2- 172.21.15.123:0/1815353367 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ce015a8c0 0x7f5ce0147be0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8014040 tx=0x7f5cc8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5cd7fff700 1 -- 172.21.15.123:0/1815353367 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8004300 con 0x7f5ce015a8c0 2024-09-13T17:09:24.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5cd7fff700 1 -- 172.21.15.123:0/1815353367 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc801e070 con 0x7f5ce015a8c0 2024-09-13T17:09:24.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5ce4825700 1 -- 172.21.15.123:0/1815353367 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce0148830 con 0x7f5ce015a8c0 2024-09-13T17:09:24.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5cd7fff700 1 -- 172.21.15.123:0/1815353367 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc80036c0 con 0x7f5ce015a8c0 2024-09-13T17:09:24.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.846+0000 7f5ce4825700 1 -- 172.21.15.123:0/1815353367 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce0148df0 con 0x7f5ce015a8c0 2024-09-13T17:09:24.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.850+0000 7f5ce4825700 1 -- 172.21.15.123:0/1815353367 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce00677f0 con 0x7f5ce015a8c0 2024-09-13T17:09:24.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.850+0000 7f5cd7fff700 1 -- 172.21.15.123:0/1815353367 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5cc8020030 con 0x7f5ce015a8c0 2024-09-13T17:09:24.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.850+0000 7f5cd7fff700 1 --2- 172.21.15.123:0/1815353367 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5cc0066730 0x7f5cc0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.854+0000 7f5cdf7fe700 1 --2- 172.21.15.123:0/1815353367 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5cc0066730 0x7f5cc0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.854+0000 7f5cd7fff700 1 -- 172.21.15.123:0/1815353367 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cc8084ef0 con 0x7f5ce015a8c0 2024-09-13T17:09:24.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.854+0000 7f5cdf7fe700 1 --2- 172.21.15.123:0/1815353367 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5cc0066730 0x7f5cc0068bf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8003b50 tx=0x7f5cd80098d0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:24.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:24.858+0000 7f5cd7fff700 1 -- 172.21.15.123:0/1815353367 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5cc8052260 con 0x7f5ce015a8c0 2024-09-13T17:09:25.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:25.066+0000 7f5ce4825700 1 -- 172.21.15.123:0/1815353367 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5ce00705b0 con 0x7f5ce015a8c0 2024-09-13T17:09:25.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:25.066+0000 7f5cd7fff700 1 -- 172.21.15.123:0/1815353367 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5cc8015070 con 0x7f5ce015a8c0 2024-09-13T17:09:25.074 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:09:25.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:25.070+0000 7f5ce4825700 1 -- 172.21.15.123:0/1815353367 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5cc0066730 msgr2=0x7f5cc0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:25.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:25.070+0000 7f5ce4825700 1 --2- 172.21.15.123:0/1815353367 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5cc0066730 0x7f5cc0068bf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8003b50 tx=0x7f5cd80098d0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:25.070+0000 7f5ce4825700 1 -- 172.21.15.123:0/1815353367 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ce015a8c0 msgr2=0x7f5ce0147be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:25.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:25.070+0000 7f5ce4825700 1 --2- 172.21.15.123:0/1815353367 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ce015a8c0 0x7f5ce0147be0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8014040 tx=0x7f5cc8004770 comp rx=0 tx=0).stop 2024-09-13T17:09:25.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:25.070+0000 7f5ce4825700 1 -- 172.21.15.123:0/1815353367 shutdown_connections 2024-09-13T17:09:25.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:25.070+0000 7f5ce4825700 1 --2- 172.21.15.123:0/1815353367 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5cc0066730 0x7f5cc0068bf0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:25.070+0000 7f5ce4825700 1 --2- 172.21.15.123:0/1815353367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ce015b9b0 0x7f5ce00cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:25.070+0000 7f5ce4825700 1 --2- 172.21.15.123:0/1815353367 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ce015a8c0 0x7f5ce0147be0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:25.070+0000 7f5ce4825700 1 --2- 172.21.15.123:0/1815353367 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ce00713b0 0x7f5ce00ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:25.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:25.070+0000 7f5ce4825700 1 -- 172.21.15.123:0/1815353367 >> 172.21.15.123:0/1815353367 conn(0x7f5ce0066150 msgr2=0x7f5ce006db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:25.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:25.070+0000 7f5ce4825700 1 -- 172.21.15.123:0/1815353367 shutdown_connections 2024-09-13T17:09:25.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:25.070+0000 7f5ce4825700 1 -- 172.21.15.123:0/1815353367 wait complete. 2024-09-13T17:09:25.089 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:09:25.089 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:09:25.089 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-13T17:09:25.089 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:09:25.089 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:09:25.090 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:09:25.090 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:09:25.090 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:09:25.090 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:09:25.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:25.090 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-13T17:09:25.098 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:09:25.098 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:09:25.098 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:09:25.098 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:25.098 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-13T17:09:25.099 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:25.099 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:09:25.099 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:25.099 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:09:25.099 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:25.099 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:09:25.099 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:25.099 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:09:25.099 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:25.100 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:09:25.100 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42443sec preferred_lft 42443sec 2024-09-13T17:09:25.100 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-09-13T17:09:25.100 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:25.100 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:09:25.100 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:b1:d7:75:e9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:25.100 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:09:25.100 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:25.100 INFO:teuthology.orchestra.run.smithi123.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:09:25.100 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether d6:8a:3c:97:49:a9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:25.100 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:09:25.100 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:25.101 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::a038:65ff:fec0:5513/64 scope link 2024-09-13T17:09:25.101 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:25.101 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:09:25.101 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether da:a9:95:cd:41:8c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:09:25.101 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::d8a9:95ff:fecd:418c/64 scope link 2024-09-13T17:09:25.101 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:25.101 INFO:teuthology.orchestra.run.smithi123.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:09:25.101 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether d6:8a:3c:97:49:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:09:25.101 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::d48a:3cff:fe97:49a9/64 scope link 2024-09-13T17:09:25.101 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:25.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:25.102 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:09:25.116 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-13T17:09:25.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:25.118 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-13T17:09:25.127 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-13T17:09:25.127 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:09:25.127 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:09:25.127 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:09:25.127 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:09:25.127 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:09:25.127 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:09:25.127 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:09:25.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:25.128 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:09:25.128 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:09:25.128 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:09:25.128 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:09:25.128 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:09:25.128 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:09:25.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:25.165 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-13T17:09:25.212 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:09:25.213 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:09:25.213 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:09:25.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:25.213 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-13T17:09:25.229 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:09:25.229 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:09:25.229 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:09:25.236 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:09:25.236 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:09:25.236 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:09:25.283 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:09:25.300 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:09:25.300 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:09:25.312 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:09:25.313 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:09:25.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:25.314 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:09:25.319 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:09:25.319 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:09:25.363 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:09:25.380 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:09:25.380 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:09:25.390 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:09:25.391 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:09:25.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:25.392 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:09:25.453 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:2024-09-13T17:09:25.446+0000 7fa6d4d72640 -1 init, newargv = 0x558e95abb6b0 newargc=15 2024-09-13T17:09:25.453 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[42459]: starting ceph client 2024-09-13T17:09:25.463 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[42459]: starting fuse 2024-09-13T17:09:26.546 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:09:26.563 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:09:26.563 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:09:26.581 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:09:26.581 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:09:26.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:26.582 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:09:26.632 INFO:teuthology.orchestra.run.smithi123.stdout:52 2024-09-13T17:09:26.632 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:09:26.633 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:09:26.633 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2024-09-13T17:09:26.633 DEBUG:teuthology.orchestra.run.smithi123:> import re 2024-09-13T17:09:26.633 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-13T17:09:26.633 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2024-09-13T17:09:26.633 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:09:26.633 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2024-09-13T17:09:26.633 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:09:26.633 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2024-09-13T17:09:26.633 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:09:26.633 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:09:26.633 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2024-09-13T17:09:26.634 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2024-09-13T17:09:26.634 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2024-09-13T17:09:26.634 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2024-09-13T17:09:26.634 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:09:26.634 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2024-09-13T17:09:26.634 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:09:26.634 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:09:26.634 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:09:26.634 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2024-09-13T17:09:26.634 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2024-09-13T17:09:26.634 DEBUG:teuthology.orchestra.run.smithi123:> return f 2024-09-13T17:09:26.634 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:09:26.634 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:09:26.634 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.0")) 2024-09-13T17:09:26.635 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-13T17:09:26.717 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.0.42459.asok 2024-09-13T17:09:26.902 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42459.asok 2024-09-13T17:09:26.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:26.903 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42459.asok status 2024-09-13T17:09:27.005 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:09:27.005 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2024-09-13T17:09:27.006 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:09:27.006 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:09:27.006 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "0", 2024-09-13T17:09:27.006 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2024-09-13T17:09:27.006 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:09:27.006 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "42459", 2024-09-13T17:09:27.006 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2024-09-13T17:09:27.006 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:27.006 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2024-09-13T17:09:27.006 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2024-09-13T17:09:27.006 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 6508, 2024-09-13T17:09:27.006 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2024-09-13T17:09:27.007 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2024-09-13T17:09:27.007 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2024-09-13T17:09:27.007 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 6508 2024-09-13T17:09:27.007 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:27.007 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:09:27.007 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:09:27.007 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:0", 2024-09-13T17:09:27.007 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 3920846881 2024-09-13T17:09:27.007 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:27.007 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:27.007 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:09:27.007 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:09:27.008 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:0", 2024-09-13T17:09:27.008 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 3920846881 2024-09-13T17:09:27.008 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:27.008 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.6508 172.21.15.123:0/3920846881", 2024-09-13T17:09:27.008 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "172.21.15.123:0/3920846881", 2024-09-13T17:09:27.008 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2024-09-13T17:09:27.008 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 35, 2024-09-13T17:09:27.008 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 72, 2024-09-13T17:09:27.008 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:09:27.008 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2024-09-13T17:09:27.008 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2024-09-13T17:09:27.008 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:09:27.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:27.017 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2024-09-13T17:09:27.017 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:09:27.024 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2024-09-13T17:09:27.024 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:09:27.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:27.024 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:09:27.083 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:09:27.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.198+0000 7f1624b71700 1 Processor -- start 2024-09-13T17:09:27.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.198+0000 7f1624b71700 1 -- start start 2024-09-13T17:09:27.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.198+0000 7f1624b71700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16201598b0 0x7f1620071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:27.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.198+0000 7f1624b71700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f16200cedc0 0x7f1620159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:27.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.198+0000 7f1624b71700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162015d360 con 0x7f16200cdfd0 2024-09-13T17:09:27.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.198+0000 7f1624b71700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16200ce3d0 con 0x7f16200cedc0 2024-09-13T17:09:27.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.198+0000 7f1624b71700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16200724c0 con 0x7f16201598b0 2024-09-13T17:09:27.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f161ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f16200cedc0 0x7f1620159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:27.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f161ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f16200cedc0 0x7f1620159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:58500/0 (socket says 172.21.15.123:58500) 2024-09-13T17:09:27.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f161ffff700 1 -- 172.21.15.123:0/3633493710 learned_addr learned my addr 172.21.15.123:0/3633493710 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:27.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f161f7fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16201598b0 0x7f1620071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:27.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f161f7fe700 1 -- 172.21.15.123:0/3633493710 >> v2:172.21.15.153:3300/0 conn(0x7f16200cedc0 msgr2=0x7f1620159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:27.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f161f7fe700 1 --2- 172.21.15.123:0/3633493710 >> v2:172.21.15.153:3300/0 conn(0x7f16200cedc0 0x7f1620159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f161f7fe700 1 -- 172.21.15.123:0/3633493710 >> v1:172.21.15.153:6789/0 conn(0x7f16200cdfd0 legacy=0x7f16200ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:27.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f161e7fc700 1 -- 172.21.15.123:0/3633493710 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403142176 0 0) 0x7f162015d360 con 0x7f16200cdfd0 2024-09-13T17:09:27.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f161f7fe700 1 -- 172.21.15.123:0/3633493710 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162015d5b0 con 0x7f16201598b0 2024-09-13T17:09:27.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f161ffff700 1 --2- 172.21.15.123:0/3633493710 >> v2:172.21.15.153:3300/0 conn(0x7f16200cedc0 0x7f1620159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:27.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f161f7fe700 1 --2- 172.21.15.123:0/3633493710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16201598b0 0x7f1620071e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1608009850 tx=0x7f1608009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c66147551fa2798c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f161e7fc700 1 -- 172.21.15.123:0/3633493710 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608011830 con 0x7f16201598b0 2024-09-13T17:09:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f161e7fc700 1 -- 172.21.15.123:0/3633493710 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1608011990 con 0x7f16201598b0 2024-09-13T17:09:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f161e7fc700 1 -- 172.21.15.123:0/3633493710 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608011d40 con 0x7f16201598b0 2024-09-13T17:09:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f1624b71700 1 -- 172.21.15.123:0/3633493710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16201598b0 msgr2=0x7f1620071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f1624b71700 1 --2- 172.21.15.123:0/3633493710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16201598b0 0x7f1620071e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1608009850 tx=0x7f1608009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f1624b71700 1 -- 172.21.15.123:0/3633493710 shutdown_connections 2024-09-13T17:09:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f1624b71700 1 --2- 172.21.15.123:0/3633493710 >> v2:172.21.15.153:3300/0 conn(0x7f16200cedc0 0x7f1620159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f1624b71700 1 --2- 172.21.15.123:0/3633493710 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16201598b0 0x7f1620071e60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f1624b71700 1 -- 172.21.15.123:0/3633493710 >> 172.21.15.123:0/3633493710 conn(0x7f1620066150 msgr2=0x7f1620066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:27.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f1624b71700 1 -- 172.21.15.123:0/3633493710 shutdown_connections 2024-09-13T17:09:27.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.202+0000 7f1624b71700 1 -- 172.21.15.123:0/3633493710 wait complete. 2024-09-13T17:09:27.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f1624b71700 1 Processor -- start 2024-09-13T17:09:27.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f1624b71700 1 -- start start 2024-09-13T17:09:27.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f1624b71700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16200cdfd0 0x7f1620155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:27.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f1624b71700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16200cedc0 0x7f16201398c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:27.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f1624b71700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16201598b0 0x7f1620157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:27.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f1624b71700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1620155760 con 0x7f16201598b0 2024-09-13T17:09:27.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f1624b71700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162013a2a0 con 0x7f16200cedc0 2024-09-13T17:09:27.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f1624b71700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1620139e00 con 0x7f16200cdfd0 2024-09-13T17:09:27.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f161ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16201598b0 0x7f1620157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:27.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f161ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16201598b0 0x7f1620157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52908/0 (socket says 172.21.15.123:52908) 2024-09-13T17:09:27.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f161ffff700 1 -- 172.21.15.123:0/4221220706 learned_addr learned my addr 172.21.15.123:0/4221220706 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:27.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f161f7fe700 1 --2- 172.21.15.123:0/4221220706 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16200cdfd0 0x7f1620155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:27.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f161effd700 1 --2- 172.21.15.123:0/4221220706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16200cedc0 0x7f16201398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:27.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f161ffff700 1 -- 172.21.15.123:0/4221220706 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16200cdfd0 msgr2=0x7f1620155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:27.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f161ffff700 1 --2- 172.21.15.123:0/4221220706 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16200cdfd0 0x7f1620155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f161ffff700 1 -- 172.21.15.123:0/4221220706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16200cedc0 msgr2=0x7f16201398c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:27.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f161ffff700 1 --2- 172.21.15.123:0/4221220706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16200cedc0 0x7f16201398c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f161ffff700 1 -- 172.21.15.123:0/4221220706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1618009b30 con 0x7f16201598b0 2024-09-13T17:09:27.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f161ffff700 1 --2- 172.21.15.123:0/4221220706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16201598b0 0x7f1620157990 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f161800ef90 tx=0x7f161800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:27.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f1617fff700 1 -- 172.21.15.123:0/4221220706 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618018070 con 0x7f16201598b0 2024-09-13T17:09:27.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f1617fff700 1 -- 172.21.15.123:0/4221220706 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161800f040 con 0x7f16201598b0 2024-09-13T17:09:27.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f1624b71700 1 -- 172.21.15.123:0/4221220706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16080094b0 con 0x7f16201598b0 2024-09-13T17:09:27.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f1617fff700 1 -- 172.21.15.123:0/4221220706 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618003c60 con 0x7f16201598b0 2024-09-13T17:09:27.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.206+0000 7f1624b71700 1 -- 172.21.15.123:0/4221220706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162013a820 con 0x7f16201598b0 2024-09-13T17:09:27.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.210+0000 7f1624b71700 1 -- 172.21.15.123:0/4221220706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16200677f0 con 0x7f16201598b0 2024-09-13T17:09:27.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.210+0000 7f1617fff700 1 -- 172.21.15.123:0/4221220706 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f161800c880 con 0x7f16201598b0 2024-09-13T17:09:27.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.210+0000 7f1617fff700 1 --2- 172.21.15.123:0/4221220706 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1604066730 0x7f1604068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:27.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.210+0000 7f1617fff700 1 -- 172.21.15.123:0/4221220706 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16180850d0 con 0x7f16201598b0 2024-09-13T17:09:27.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.210+0000 7f161f7fe700 1 --2- 172.21.15.123:0/4221220706 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1604066730 0x7f1604068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:27.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.214+0000 7f161f7fe700 1 --2- 172.21.15.123:0/4221220706 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1604066730 0x7f1604068bf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1608000c00 tx=0x7f160801c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:27.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.218+0000 7f1617fff700 1 -- 172.21.15.123:0/4221220706 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1618052310 con 0x7f16201598b0 2024-09-13T17:09:27.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.418+0000 7f1624b71700 1 -- 172.21.15.123:0/4221220706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1620071e60 con 0x7f16201598b0 2024-09-13T17:09:27.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.418+0000 7f1617fff700 1 -- 172.21.15.123:0/4221220706 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1618055930 con 0x7f16201598b0 2024-09-13T17:09:27.425 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:09:27.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.422+0000 7f1624b71700 1 -- 172.21.15.123:0/4221220706 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1604066730 msgr2=0x7f1604068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:27.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.422+0000 7f1624b71700 1 --2- 172.21.15.123:0/4221220706 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1604066730 0x7f1604068bf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1608000c00 tx=0x7f160801c040 comp rx=0 tx=0).stop 2024-09-13T17:09:27.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.422+0000 7f1624b71700 1 -- 172.21.15.123:0/4221220706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16201598b0 msgr2=0x7f1620157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:27.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.422+0000 7f1624b71700 1 --2- 172.21.15.123:0/4221220706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16201598b0 0x7f1620157990 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f161800ef90 tx=0x7f161800c3a0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.422+0000 7f1624b71700 1 -- 172.21.15.123:0/4221220706 shutdown_connections 2024-09-13T17:09:27.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.422+0000 7f1624b71700 1 --2- 172.21.15.123:0/4221220706 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1604066730 0x7f1604068bf0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.422+0000 7f1624b71700 1 --2- 172.21.15.123:0/4221220706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16201598b0 0x7f1620157990 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.422+0000 7f1624b71700 1 --2- 172.21.15.123:0/4221220706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16200cedc0 0x7f16201398c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.422+0000 7f1624b71700 1 --2- 172.21.15.123:0/4221220706 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16200cdfd0 0x7f1620155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:27.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.422+0000 7f1624b71700 1 -- 172.21.15.123:0/4221220706 >> 172.21.15.123:0/4221220706 conn(0x7f1620066150 msgr2=0x7f16200b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:27.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.422+0000 7f1624b71700 1 -- 172.21.15.123:0/4221220706 shutdown_connections 2024-09-13T17:09:27.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:27.422+0000 7f1624b71700 1 -- 172.21.15.123:0/4221220706 wait complete. 2024-09-13T17:09:27.439 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:09:27.439 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:09:27.439 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-13T17:09:27.440 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:09:27.440 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:27.440 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:09:27.440 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:09:27.440 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:09:27.440 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:09:27.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:27.440 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-13T17:09:27.448 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:09:27.449 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:09:27.449 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:09:27.449 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:27.449 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-13T17:09:27.449 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:27.449 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:09:27.449 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:27.449 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:09:27.449 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:27.449 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:09:27.449 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:27.450 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:09:27.450 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:27.450 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:09:27.450 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42443sec preferred_lft 42443sec 2024-09-13T17:09:27.450 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-09-13T17:09:27.450 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:27.450 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:09:27.450 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:73:6c:03:01 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:27.450 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:09:27.450 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:27.450 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:09:27.450 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:27.450 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:09:27.451 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:27.451 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::f82f:21ff:fe0c:65de/64 scope link 2024-09-13T17:09:27.451 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:27.451 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:09:27.451 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:09:27.451 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::346e:9ff:fe92:ffa0/64 scope link 2024-09-13T17:09:27.451 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:27.451 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:09:27.451 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether c6:e2:c1:7b:16:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:09:27.451 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::c4e2:c1ff:fe7b:1657/64 scope link 2024-09-13T17:09:27.451 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:27.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:27.452 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:09:27.468 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-13T17:09:27.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:27.469 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-13T17:09:27.477 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-13T17:09:27.478 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:09:27.478 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:09:27.478 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:09:27.478 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:09:27.478 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:09:27.478 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:09:27.478 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:09:27.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:27.478 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:09:27.479 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:09:27.479 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:09:27.479 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:09:27.479 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:09:27.479 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:09:27.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:27.560 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-13T17:09:27.567 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:09:27.567 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:09:27.568 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:09:27.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:27.568 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-09-13T17:09:27.580 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:09:27.580 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:09:27.580 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:27.630 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:09:27.630 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:09:27.630 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:27.637 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:09:27.654 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:09:27.654 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:09:27.668 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:09:27.669 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:09:27.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:27.670 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:09:27.719 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:09:27.719 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:09:27.721 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:09:27.737 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:09:27.738 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:09:27.746 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:09:27.747 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:09:27.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:27.747 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:09:27.806 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:2024-09-13T17:09:27.801+0000 7f1888988640 -1 init, newargv = 0x5571a2a1e7a0 newargc=15 2024-09-13T17:09:27.806 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33347]: starting ceph client 2024-09-13T17:09:27.815 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33347]: starting fuse 2024-09-13T17:09:28.855 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:09:28.873 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:09:28.873 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:09:28.889 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:09:28.890 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:09:28.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:28.890 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:09:28.938 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-09-13T17:09:28.938 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:09:28.939 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:09:28.939 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-09-13T17:09:28.939 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-09-13T17:09:28.939 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-13T17:09:28.939 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-09-13T17:09:28.939 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:09:28.939 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-09-13T17:09:28.939 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:09:28.939 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-09-13T17:09:28.939 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:09:28.939 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:09:28.939 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-09-13T17:09:28.940 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-09-13T17:09:28.940 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-09-13T17:09:28.940 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-09-13T17:09:28.940 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:09:28.940 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-09-13T17:09:28.940 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:09:28.940 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:09:28.940 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:09:28.940 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-09-13T17:09:28.940 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-09-13T17:09:28.941 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-09-13T17:09:28.941 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:09:28.941 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:09:28.941 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.1")) 2024-09-13T17:09:28.941 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-13T17:09:29.026 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.1.33347.asok 2024-09-13T17:09:29.210 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33347.asok 2024-09-13T17:09:29.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:29.210 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33347.asok status 2024-09-13T17:09:29.307 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-13T17:09:29.308 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-09-13T17:09:29.308 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:09:29.308 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:09:29.308 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "1", 2024-09-13T17:09:29.308 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-09-13T17:09:29.308 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:09:29.308 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "33347", 2024-09-13T17:09:29.308 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-09-13T17:09:29.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:09:29.309 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-09-13T17:09:29.309 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-09-13T17:09:29.309 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5939, 2024-09-13T17:09:29.309 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-09-13T17:09:29.309 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-09-13T17:09:29.309 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-09-13T17:09:29.309 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 5939 2024-09-13T17:09:29.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:09:29.309 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:09:29.309 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:09:29.309 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:09:29.309 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 828666476 2024-09-13T17:09:29.309 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-13T17:09:29.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:09:29.310 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:09:29.310 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:09:29.310 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:09:29.310 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 828666476 2024-09-13T17:09:29.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:09:29.310 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.5939 192.168.0.1:0/828666476", 2024-09-13T17:09:29.310 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.1:0/828666476", 2024-09-13T17:09:29.310 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-09-13T17:09:29.310 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 35, 2024-09-13T17:09:29.310 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 72, 2024-09-13T17:09:29.310 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:09:29.310 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-09-13T17:09:29.310 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-09-13T17:09:29.311 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-13T17:09:29.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:29.317 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-09-13T17:09:29.317 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:29.323 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-09-13T17:09:29.323 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:29.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:29.323 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:29.336 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:09:29.336 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:29.342 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:29.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fb3fff700 1 Processor -- start 2024-09-13T17:09:29.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fb3fff700 1 -- start start 2024-09-13T17:09:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fb3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6fb415a8c0 0x7f6fb40705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fb3fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fb415b9b0 0x7f6fb4070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fb3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fb40713b0 0x7f6fb40cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fb3fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb4071840 con 0x7f6fb415b9b0 2024-09-13T17:09:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fb3fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb40cee80 con 0x7f6fb415a8c0 2024-09-13T17:09:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fb3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40ce270 con 0x7f6fb40713b0 2024-09-13T17:09:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fabfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fb415b9b0 0x7f6fb4070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fabfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fb415b9b0 0x7f6fb4070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52910/0 (socket says 172.21.15.123:52910) 2024-09-13T17:09:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fabfff700 1 -- 172.21.15.123:0/4247313985 learned_addr learned my addr 172.21.15.123:0/4247313985 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fb37fe700 1 --2- 172.21.15.123:0/4247313985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fb40713b0 0x7f6fb40cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fb2ffd700 1 --2- 172.21.15.123:0/4247313985 >> v2:172.21.15.153:3300/0 conn(0x7f6fb415a8c0 0x7f6fb40705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:29.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fabfff700 1 -- 172.21.15.123:0/4247313985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fb40713b0 msgr2=0x7f6fb40cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:29.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fabfff700 1 --2- 172.21.15.123:0/4247313985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fb40713b0 0x7f6fb40cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fabfff700 1 -- 172.21.15.123:0/4247313985 >> v2:172.21.15.153:3300/0 conn(0x7f6fb415a8c0 msgr2=0x7f6fb40705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:29.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fabfff700 1 --2- 172.21.15.123:0/4247313985 >> v2:172.21.15.153:3300/0 conn(0x7f6fb415a8c0 0x7f6fb40705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fabfff700 1 -- 172.21.15.123:0/4247313985 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40ce550 con 0x7f6fb415b9b0 2024-09-13T17:09:29.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.454+0000 7f6fb2ffd700 1 --2- 172.21.15.123:0/4247313985 >> v2:172.21.15.153:3300/0 conn(0x7f6fb415a8c0 0x7f6fb40705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fabfff700 1 --2- 172.21.15.123:0/4247313985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fb415b9b0 0x7f6fb4070e70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40b39f0 tx=0x7f6f9c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859c05a97601b417 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fb27fc700 1 -- 172.21.15.123:0/4247313985 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00ba20 con 0x7f6fb415b9b0 2024-09-13T17:09:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fb27fc700 1 -- 172.21.15.123:0/4247313985 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c00bb80 con 0x7f6fb415b9b0 2024-09-13T17:09:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fb27fc700 1 -- 172.21.15.123:0/4247313985 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c009e60 con 0x7f6fb415b9b0 2024-09-13T17:09:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fb3fff700 1 -- 172.21.15.123:0/4247313985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fb415b9b0 msgr2=0x7f6fb4070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fb3fff700 1 --2- 172.21.15.123:0/4247313985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fb415b9b0 0x7f6fb4070e70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40b39f0 tx=0x7f6f9c009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fb3fff700 1 -- 172.21.15.123:0/4247313985 shutdown_connections 2024-09-13T17:09:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fb3fff700 1 --2- 172.21.15.123:0/4247313985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fb40713b0 0x7f6fb40cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fb3fff700 1 --2- 172.21.15.123:0/4247313985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fb415b9b0 0x7f6fb4070e70 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fb3fff700 1 --2- 172.21.15.123:0/4247313985 >> v2:172.21.15.153:3300/0 conn(0x7f6fb415a8c0 0x7f6fb40705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fb3fff700 1 -- 172.21.15.123:0/4247313985 >> 172.21.15.123:0/4247313985 conn(0x7f6fb4066150 msgr2=0x7f6fb4066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fb3fff700 1 -- 172.21.15.123:0/4247313985 shutdown_connections 2024-09-13T17:09:29.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fb3fff700 1 -- 172.21.15.123:0/4247313985 wait complete. 2024-09-13T17:09:29.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fb3fff700 1 Processor -- start 2024-09-13T17:09:29.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.458+0000 7f6fb3fff700 1 -- start start 2024-09-13T17:09:29.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fb40713b0 0x7f6fb414f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:29.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fb415a8c0 0x7f6fb4144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:29.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fb4145600 0x7f6fb41449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:29.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb3fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb41f3a50 con 0x7f6fb40713b0 2024-09-13T17:09:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb41f54c0 con 0x7f6fb415a8c0 2024-09-13T17:09:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb414fd30 con 0x7f6fb4145600 2024-09-13T17:09:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fb40713b0 0x7f6fb414f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fb40713b0 0x7f6fb414f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52922/0 (socket says 172.21.15.123:52922) 2024-09-13T17:09:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb2ffd700 1 -- 172.21.15.123:0/2318106788 learned_addr learned my addr 172.21.15.123:0/2318106788 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fabfff700 1 --2- 172.21.15.123:0/2318106788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fb415a8c0 0x7f6fb4144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb37fe700 1 --2- 172.21.15.123:0/2318106788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fb4145600 0x7f6fb41449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb2ffd700 1 -- 172.21.15.123:0/2318106788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fb4145600 msgr2=0x7f6fb41449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb2ffd700 1 --2- 172.21.15.123:0/2318106788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fb4145600 0x7f6fb41449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb2ffd700 1 -- 172.21.15.123:0/2318106788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fb415a8c0 msgr2=0x7f6fb4144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb2ffd700 1 --2- 172.21.15.123:0/2318106788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fb415a8c0 0x7f6fb4144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb2ffd700 1 -- 172.21.15.123:0/2318106788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c009570 con 0x7f6fb40713b0 2024-09-13T17:09:29.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb2ffd700 1 --2- 172.21.15.123:0/2318106788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fb40713b0 0x7f6fb414f350 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400e810 tx=0x7f6fa400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:29.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fab7fe700 1 -- 172.21.15.123:0/2318106788 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa400c070 con 0x7f6fb40713b0 2024-09-13T17:09:29.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fab7fe700 1 -- 172.21.15.123:0/2318106788 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa4013610 con 0x7f6fb40713b0 2024-09-13T17:09:29.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb3fff700 1 -- 172.21.15.123:0/2318106788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb4150010 con 0x7f6fb40713b0 2024-09-13T17:09:29.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fab7fe700 1 -- 172.21.15.123:0/2318106788 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa40139a0 con 0x7f6fb40713b0 2024-09-13T17:09:29.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb3fff700 1 -- 172.21.15.123:0/2318106788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb41f3cf0 con 0x7f6fb40713b0 2024-09-13T17:09:29.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.462+0000 7f6fb3fff700 1 -- 172.21.15.123:0/2318106788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb40677f0 con 0x7f6fb40713b0 2024-09-13T17:09:29.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.466+0000 7f6fab7fe700 1 -- 172.21.15.123:0/2318106788 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6fa4013b00 con 0x7f6fb40713b0 2024-09-13T17:09:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.466+0000 7f6fab7fe700 1 --2- 172.21.15.123:0/2318106788 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f94066730 0x7f6f94068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.466+0000 7f6fab7fe700 1 -- 172.21.15.123:0/2318106788 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fa4083f10 con 0x7f6fb40713b0 2024-09-13T17:09:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.466+0000 7f6fabfff700 1 --2- 172.21.15.123:0/2318106788 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f94066730 0x7f6f94068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.466+0000 7f6fabfff700 1 --2- 172.21.15.123:0/2318106788 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f94066730 0x7f6f94068bf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6fb406a4d0 tx=0x7f6f9c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:29.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.474+0000 7f6fab7fe700 1 -- 172.21.15.123:0/2318106788 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6fa4051290 con 0x7f6fb40713b0 2024-09-13T17:09:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.650+0000 7f6fb3fff700 1 -- 172.21.15.123:0/2318106788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fb4070e70 con 0x7f6fb40713b0 2024-09-13T17:09:29.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.650+0000 7f6fab7fe700 1 -- 172.21.15.123:0/2318106788 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16616 (secure 0 0 0) 0x7f6fa40548b0 con 0x7f6fb40713b0 2024-09-13T17:09:29.657 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:29.658 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":72,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:09:19.929124+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:17.328080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:17.920002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.654+0000 7f6fb3fff700 1 -- 172.21.15.123:0/2318106788 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f94066730 msgr2=0x7f6f94068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.654+0000 7f6fb3fff700 1 --2- 172.21.15.123:0/2318106788 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f94066730 0x7f6f94068bf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6fb406a4d0 tx=0x7f6f9c008030 comp rx=0 tx=0).stop 2024-09-13T17:09:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.654+0000 7f6fb3fff700 1 -- 172.21.15.123:0/2318106788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fb40713b0 msgr2=0x7f6fb414f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.654+0000 7f6fb3fff700 1 --2- 172.21.15.123:0/2318106788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fb40713b0 0x7f6fb414f350 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400e810 tx=0x7f6fa400eb20 comp rx=0 tx=0).stop 2024-09-13T17:09:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.654+0000 7f6fb3fff700 1 -- 172.21.15.123:0/2318106788 shutdown_connections 2024-09-13T17:09:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.654+0000 7f6fb3fff700 1 --2- 172.21.15.123:0/2318106788 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f94066730 0x7f6f94068bf0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.654+0000 7f6fb3fff700 1 --2- 172.21.15.123:0/2318106788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6fb4145600 0x7f6fb41449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.654+0000 7f6fb3fff700 1 --2- 172.21.15.123:0/2318106788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fb415a8c0 0x7f6fb4144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.654+0000 7f6fb3fff700 1 --2- 172.21.15.123:0/2318106788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fb40713b0 0x7f6fb414f350 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.654+0000 7f6fb3fff700 1 -- 172.21.15.123:0/2318106788 >> 172.21.15.123:0/2318106788 conn(0x7f6fb4066150 msgr2=0x7f6fb40ae220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:29.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.654+0000 7f6fb3fff700 1 -- 172.21.15.123:0/2318106788 shutdown_connections 2024-09-13T17:09:29.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.654+0000 7f6fb3fff700 1 -- 172.21.15.123:0/2318106788 wait complete. 2024-09-13T17:09:29.672 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:09:17.328080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:09:17.920002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:09:29.673 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:09:29.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.786+0000 7fe2263fb700 1 Processor -- start 2024-09-13T17:09:29.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.786+0000 7fe2263fb700 1 -- start start 2024-09-13T17:09:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe2263fb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe2200cc980 0x7fe22006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe2263fb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe22006f280 0x7fe22006f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe2263fb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22006d2e0 con 0x7fe2201443e0 2024-09-13T17:09:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe2263fb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22006fc50 con 0x7fe2200cc980 2024-09-13T17:09:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe2263fb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2200ccdd0 con 0x7fe22006f280 2024-09-13T17:09:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe224bf8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe2200cc980 0x7fe22006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe224bf8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe2200cc980 0x7fe22006d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:58546/0 (socket says 172.21.15.123:58546) 2024-09-13T17:09:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe224bf8700 1 -- 172.21.15.123:0/51696437 learned_addr learned my addr 172.21.15.123:0/51696437 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe225bfa700 1 --2- 172.21.15.123:0/51696437 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe22006f280 0x7fe22006f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe224bf8700 1 -- 172.21.15.123:0/51696437 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe22006f280 msgr2=0x7fe22006f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe224bf8700 1 --2- 172.21.15.123:0/51696437 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe22006f280 0x7fe22006f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe224bf8700 1 -- 172.21.15.123:0/51696437 >> v1:172.21.15.153:6789/0 conn(0x7fe2201443e0 legacy=0x7fe220072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe224bf8700 1 -- 172.21.15.123:0/51696437 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22006cfe0 con 0x7fe2200cc980 2024-09-13T17:09:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe224bf8700 1 --2- 172.21.15.123:0/51696437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2200cc980 0x7fe22006d770 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe210009940 tx=0x7fe210009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab026181a6983089 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe217fff700 1 -- 172.21.15.123:0/51696437 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe210011830 con 0x7fe2200cc980 2024-09-13T17:09:29.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe217fff700 1 -- 172.21.15.123:0/51696437 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe210011990 con 0x7fe2200cc980 2024-09-13T17:09:29.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.790+0000 7fe217fff700 1 -- 172.21.15.123:0/51696437 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe210011d20 con 0x7fe2200cc980 2024-09-13T17:09:29.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.794+0000 7fe2263fb700 1 -- 172.21.15.123:0/51696437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2200cc980 msgr2=0x7fe22006d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:29.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.794+0000 7fe2263fb700 1 --2- 172.21.15.123:0/51696437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2200cc980 0x7fe22006d770 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe210009940 tx=0x7fe210009c50 comp rx=0 tx=0).stop 2024-09-13T17:09:29.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.794+0000 7fe2263fb700 1 -- 172.21.15.123:0/51696437 shutdown_connections 2024-09-13T17:09:29.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.794+0000 7fe2263fb700 1 --2- 172.21.15.123:0/51696437 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe22006f280 0x7fe22006f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.794+0000 7fe2263fb700 1 --2- 172.21.15.123:0/51696437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2200cc980 0x7fe22006d770 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.794+0000 7fe2263fb700 1 -- 172.21.15.123:0/51696437 >> 172.21.15.123:0/51696437 conn(0x7fe220066780 msgr2=0x7fe2200719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:29.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.794+0000 7fe2263fb700 1 -- 172.21.15.123:0/51696437 shutdown_connections 2024-09-13T17:09:29.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.794+0000 7fe2263fb700 1 -- 172.21.15.123:0/51696437 wait complete. 2024-09-13T17:09:29.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.794+0000 7fe2263fb700 1 Processor -- start 2024-09-13T17:09:29.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.794+0000 7fe2263fb700 1 -- start start 2024-09-13T17:09:29.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe2263fb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe22006f280 0x7fe22013b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:29.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe2263fb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2200cc980 0x7fe2200b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:29.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe2263fb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2201443e0 0x7fe2200b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:29.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe2263fb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22013f010 con 0x7fe2200cc980 2024-09-13T17:09:29.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe2263fb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22013b800 con 0x7fe22006f280 2024-09-13T17:09:29.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe2263fb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22013e490 con 0x7fe2201443e0 2024-09-13T17:09:29.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe224bf8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2200cc980 0x7fe2200b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:29.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe224bf8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2200cc980 0x7fe2200b1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52926/0 (socket says 172.21.15.123:52926) 2024-09-13T17:09:29.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe2253f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe22006f280 0x7fe22013b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:29.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe224bf8700 1 -- 172.21.15.123:0/3059111061 learned_addr learned my addr 172.21.15.123:0/3059111061 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:29.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe225bfa700 1 --2- 172.21.15.123:0/3059111061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2201443e0 0x7fe2200b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:29.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe224bf8700 1 -- 172.21.15.123:0/3059111061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2201443e0 msgr2=0x7fe2200b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:29.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe224bf8700 1 --2- 172.21.15.123:0/3059111061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2201443e0 0x7fe2200b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe224bf8700 1 -- 172.21.15.123:0/3059111061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe22006f280 msgr2=0x7fe22013b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:29.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe224bf8700 1 --2- 172.21.15.123:0/3059111061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe22006f280 0x7fe22013b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe224bf8700 1 -- 172.21.15.123:0/3059111061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe210009570 con 0x7fe2200cc980 2024-09-13T17:09:29.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe224bf8700 1 --2- 172.21.15.123:0/3059111061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2200cc980 0x7fe2200b1390 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe22006fdd0 tx=0x7fe210004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:29.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe215ffb700 1 -- 172.21.15.123:0/3059111061 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe210004380 con 0x7fe2200cc980 2024-09-13T17:09:29.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe2263fb700 1 -- 172.21.15.123:0/3059111061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22013e770 con 0x7fe2200cc980 2024-09-13T17:09:29.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe215ffb700 1 -- 172.21.15.123:0/3059111061 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21001f070 con 0x7fe2200cc980 2024-09-13T17:09:29.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe215ffb700 1 -- 172.21.15.123:0/3059111061 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2100036c0 con 0x7fe2200cc980 2024-09-13T17:09:29.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.798+0000 7fe2263fb700 1 -- 172.21.15.123:0/3059111061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22013ed30 con 0x7fe2200cc980 2024-09-13T17:09:29.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.802+0000 7fe2263fb700 1 -- 172.21.15.123:0/3059111061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22006a5b0 con 0x7fe2200cc980 2024-09-13T17:09:29.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.802+0000 7fe215ffb700 1 -- 172.21.15.123:0/3059111061 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe210021030 con 0x7fe2200cc980 2024-09-13T17:09:29.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.802+0000 7fe215ffb700 1 --2- 172.21.15.123:0/3059111061 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe204066730 0x7fe204068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:29.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.802+0000 7fe215ffb700 1 -- 172.21.15.123:0/3059111061 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe210085510 con 0x7fe2200cc980 2024-09-13T17:09:29.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.802+0000 7fe2253f9700 1 --2- 172.21.15.123:0/3059111061 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe204066730 0x7fe204068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:29.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.802+0000 7fe2253f9700 1 --2- 172.21.15.123:0/3059111061 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe204066730 0x7fe204068bf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe21c000f60 tx=0x7fe21c009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:29.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.806+0000 7fe215ffb700 1 -- 172.21.15.123:0/3059111061 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe2100527f0 con 0x7fe2200cc980 2024-09-13T17:09:29.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.978+0000 7fe2263fb700 1 -- 172.21.15.123:0/3059111061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe22006f710 con 0x7fe2200cc980 2024-09-13T17:09:29.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.978+0000 7fe215ffb700 1 -- 172.21.15.123:0/3059111061 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe210055e10 con 0x7fe2200cc980 2024-09-13T17:09:29.984 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:09:29.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.982+0000 7fe2263fb700 1 -- 172.21.15.123:0/3059111061 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe204066730 msgr2=0x7fe204068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:29.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.982+0000 7fe2263fb700 1 --2- 172.21.15.123:0/3059111061 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe204066730 0x7fe204068bf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe21c000f60 tx=0x7fe21c009040 comp rx=0 tx=0).stop 2024-09-13T17:09:29.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.982+0000 7fe2263fb700 1 -- 172.21.15.123:0/3059111061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2200cc980 msgr2=0x7fe2200b1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:29.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.982+0000 7fe2263fb700 1 --2- 172.21.15.123:0/3059111061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2200cc980 0x7fe2200b1390 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe22006fdd0 tx=0x7fe210004770 comp rx=0 tx=0).stop 2024-09-13T17:09:29.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.982+0000 7fe2263fb700 1 -- 172.21.15.123:0/3059111061 shutdown_connections 2024-09-13T17:09:29.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.982+0000 7fe2263fb700 1 --2- 172.21.15.123:0/3059111061 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe204066730 0x7fe204068bf0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.982+0000 7fe2263fb700 1 --2- 172.21.15.123:0/3059111061 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2201443e0 0x7fe2200b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.982+0000 7fe2263fb700 1 --2- 172.21.15.123:0/3059111061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2200cc980 0x7fe2200b1390 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.982+0000 7fe2263fb700 1 --2- 172.21.15.123:0/3059111061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe22006f280 0x7fe22013b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:29.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.982+0000 7fe2263fb700 1 -- 172.21.15.123:0/3059111061 >> 172.21.15.123:0/3059111061 conn(0x7fe220066780 msgr2=0x7fe22015d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:29.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.982+0000 7fe2263fb700 1 -- 172.21.15.123:0/3059111061 shutdown_connections 2024-09-13T17:09:29.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:29.982+0000 7fe2263fb700 1 -- 172.21.15.123:0/3059111061 wait complete. 2024-09-13T17:09:29.999 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:09:30.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.098+0000 7f8e8ed38700 1 Processor -- start 2024-09-13T17:09:30.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.098+0000 7f8e8ed38700 1 -- start start 2024-09-13T17:09:30.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8ed38700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e881443e0 0x7f8e880cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8ed38700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8806d2e0 con 0x7f8e88072250 2024-09-13T17:09:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8ed38700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8806cfe0 con 0x7f8e8806f280 2024-09-13T17:09:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8ed38700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880ccff0 con 0x7f8e881443e0 2024-09-13T17:09:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8d535700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8e88072250 0x7f8e8806d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38148/0 (socket says 172.21.15.123:38148) 2024-09-13T17:09:30.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8d535700 1 -- 172.21.15.123:0/3820980505 learned_addr learned my addr 172.21.15.123:0/3820980505 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:30.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8dd36700 1 --2- 172.21.15.123:0/3820980505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e881443e0 0x7f8e880cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879717356 0 0) 0x7f8e8806d2e0 con 0x7f8e88072250 2024-09-13T17:09:30.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e740035d0 con 0x7f8e88072250 2024-09-13T17:09:30.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481494063 0 0) 0x7f8e8806cfe0 con 0x7f8e8806f280 2024-09-13T17:09:30.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e8806d2e0 con 0x7f8e8806f280 2024-09-13T17:09:30.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2266192743 0 0) 0x7f8e740035d0 con 0x7f8e88072250 2024-09-13T17:09:30.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e881443e0 msgr2=0x7f8e880cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:30.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 --2- 172.21.15.123:0/3820980505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e881443e0 0x7f8e880cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 >> v1:172.21.15.153:6789/0 conn(0x7f8e8806f280 legacy=0x7f8e8815adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e880cd2d0 con 0x7f8e88072250 2024-09-13T17:09:30.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7f8e78001670 con 0x7f8e88072250 2024-09-13T17:09:30.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 >> v1:172.21.15.123:6789/0 conn(0x7f8e88072250 legacy=0x7f8e8806d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 --2- 172.21.15.123:0/3820980505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e74003be0 0x7f8e74003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 --2- 172.21.15.123:0/3820980505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e74004870 0x7f8e74004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 --2- 172.21.15.123:0/3820980505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e74005280 0x7f8e7400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880ccff0 con 0x7f8e74005280 2024-09-13T17:09:30.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7400c1b0 con 0x7f8e74004870 2024-09-13T17:09:30.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7400c370 con 0x7f8e74003be0 2024-09-13T17:09:30.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8dd36700 1 --2- 172.21.15.123:0/3820980505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e881443e0 0x7f8e880cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:30.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8e537700 1 --2- 172.21.15.123:0/3820980505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e74005280 0x7f8e7400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8d535700 1 --2- 172.21.15.123:0/3820980505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e74004870 0x7f8e74004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.102+0000 7f8e8dd36700 1 --2- 172.21.15.123:0/3820980505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e74003be0 0x7f8e74003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8e537700 1 -- 172.21.15.123:0/3820980505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e74003be0 msgr2=0x7f8e74003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:30.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8e537700 1 --2- 172.21.15.123:0/3820980505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e74003be0 0x7f8e74003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8e537700 1 -- 172.21.15.123:0/3820980505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e74004870 msgr2=0x7f8e74004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:30.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8e537700 1 --2- 172.21.15.123:0/3820980505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e74004870 0x7f8e74004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8e537700 1 -- 172.21.15.123:0/3820980505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e740035d0 con 0x7f8e74005280 2024-09-13T17:09:30.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8e537700 1 --2- 172.21.15.123:0/3820980505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e74005280 0x7f8e7400ba30 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000c320 tx=0x7f8e740058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5147cfa63e05939a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:30.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80001f20 con 0x7f8e74005280 2024-09-13T17:09:30.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e80003a20 con 0x7f8e74005280 2024-09-13T17:09:30.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8cd34700 1 -- 172.21.15.123:0/3820980505 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8000cea0 con 0x7f8e74005280 2024-09-13T17:09:30.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3820980505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e74005280 msgr2=0x7f8e7400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8ed38700 1 --2- 172.21.15.123:0/3820980505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e74005280 0x7f8e7400ba30 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000c320 tx=0x7f8e740058a0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8e537700 1 -- 172.21.15.123:0/3820980505 reap_dead start 2024-09-13T17:09:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3820980505 shutdown_connections 2024-09-13T17:09:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3820980505 >> 172.21.15.123:0/3820980505 conn(0x7f8e88066780 msgr2=0x7f8e880719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3820980505 shutdown_connections 2024-09-13T17:09:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3820980505 wait complete. 2024-09-13T17:09:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8ed38700 1 Processor -- start 2024-09-13T17:09:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.106+0000 7f8e8ed38700 1 -- start start 2024-09-13T17:09:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8ed38700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e881599a0 0x7f8e880a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8ed38700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e88159d80 0x7f8e881f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8ed38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e880b0a10 0x7f8e88141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8ed38700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880a8a80 con 0x7f8e881599a0 2024-09-13T17:09:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8ed38700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880a8d60 con 0x7f8e880b0a10 2024-09-13T17:09:30.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8ed38700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e881f4230 con 0x7f8e88159d80 2024-09-13T17:09:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8dd36700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e881599a0 0x7f8e880a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8dd36700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e881599a0 0x7f8e880a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52944/0 (socket says 172.21.15.123:52944) 2024-09-13T17:09:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8dd36700 1 -- 172.21.15.123:0/3138329153 learned_addr learned my addr 172.21.15.123:0/3138329153 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8d535700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e88159d80 0x7f8e881f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8e537700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e880b0a10 0x7f8e88141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8dd36700 1 -- 172.21.15.123:0/3138329153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e88159d80 msgr2=0x7f8e881f4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8dd36700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e88159d80 0x7f8e881f4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8dd36700 1 -- 172.21.15.123:0/3138329153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e880b0a10 msgr2=0x7f8e88141cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8dd36700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e880b0a10 0x7f8e88141cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8dd36700 1 -- 172.21.15.123:0/3138329153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e881f4510 con 0x7f8e881599a0 2024-09-13T17:09:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8d535700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e88159d80 0x7f8e881f4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:30.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8e537700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e880b0a10 0x7f8e88141cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:30.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8dd36700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e881599a0 0x7f8e880a84a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8e84011c00 tx=0x7f8e84009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:30.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e7e7fc700 1 -- 172.21.15.123:0/3138329153 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8400fb20 con 0x7f8e881599a0 2024-09-13T17:09:30.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e7e7fc700 1 -- 172.21.15.123:0/3138329153 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8400fc80 con 0x7f8e881599a0 2024-09-13T17:09:30.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e7e7fc700 1 -- 172.21.15.123:0/3138329153 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84014440 con 0x7f8e881599a0 2024-09-13T17:09:30.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3138329153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e881f47f0 con 0x7f8e881599a0 2024-09-13T17:09:30.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3138329153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e881421f0 con 0x7f8e881599a0 2024-09-13T17:09:30.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.110+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3138329153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8806a5b0 con 0x7f8e881599a0 2024-09-13T17:09:30.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.114+0000 7f8e7e7fc700 1 -- 172.21.15.123:0/3138329153 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e840145a0 con 0x7f8e881599a0 2024-09-13T17:09:30.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.114+0000 7f8e7e7fc700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8e6c066730 0x7f8e6c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.114+0000 7f8e8d535700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8e6c066730 0x7f8e6c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.114+0000 7f8e7e7fc700 1 -- 172.21.15.123:0/3138329153 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e84084ab0 con 0x7f8e881599a0 2024-09-13T17:09:30.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.114+0000 7f8e8d535700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8e6c066730 0x7f8e6c068bf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8e8815a980 tx=0x7f8e78009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.122+0000 7f8e7e7fc700 1 -- 172.21.15.123:0/3138329153 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e84051d80 con 0x7f8e881599a0 2024-09-13T17:09:30.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.290+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3138329153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e8806f730 con 0x7f8e881599a0 2024-09-13T17:09:30.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.290+0000 7f8e7e7fc700 1 -- 172.21.15.123:0/3138329153 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e840220a0 con 0x7f8e881599a0 2024-09-13T17:09:30.295 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:09:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.290+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3138329153 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8e6c066730 msgr2=0x7f8e6c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.290+0000 7f8e8ed38700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8e6c066730 0x7f8e6c068bf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8e8815a980 tx=0x7f8e78009040 comp rx=0 tx=0).stop 2024-09-13T17:09:30.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.290+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3138329153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e881599a0 msgr2=0x7f8e880a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.290+0000 7f8e8ed38700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e881599a0 0x7f8e880a84a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8e84011c00 tx=0x7f8e84009ed0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.290+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3138329153 shutdown_connections 2024-09-13T17:09:30.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.290+0000 7f8e8ed38700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8e6c066730 0x7f8e6c068bf0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.290+0000 7f8e8ed38700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e880b0a10 0x7f8e88141cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.290+0000 7f8e8ed38700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e88159d80 0x7f8e881f4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.290+0000 7f8e8ed38700 1 --2- 172.21.15.123:0/3138329153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e881599a0 0x7f8e880a84a0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.290+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3138329153 >> 172.21.15.123:0/3138329153 conn(0x7f8e88066780 msgr2=0x7f8e880b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:30.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.290+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3138329153 shutdown_connections 2024-09-13T17:09:30.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.290+0000 7f8e8ed38700 1 -- 172.21.15.123:0/3138329153 wait complete. 2024-09-13T17:09:30.309 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:09:30.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.422+0000 7f49c0f5f700 1 Processor -- start 2024-09-13T17:09:30.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.422+0000 7f49c0f5f700 1 -- start start 2024-09-13T17:09:30.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49c0f5f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49bc0d19e0 0x7f49bc0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49c0f5f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49bc0cd890 con 0x7f49bc15cfb0 2024-09-13T17:09:30.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49c0f5f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49bc15d390 con 0x7f49bc0d3800 2024-09-13T17:09:30.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49c0f5f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc0d10c0 con 0x7f49bc0d19e0 2024-09-13T17:09:30.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49ba59c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f49bc15cfb0 0x7f49bc0d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38150/0 (socket says 172.21.15.123:38150) 2024-09-13T17:09:30.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49ba59c700 1 -- 172.21.15.123:0/2571950019 learned_addr learned my addr 172.21.15.123:0/2571950019 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:30.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49bad9d700 1 --2- 172.21.15.123:0/2571950019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49bc0d19e0 0x7f49bc0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49b959a700 1 -- 172.21.15.123:0/2571950019 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982500810 0 0) 0x7f49bc0cd890 con 0x7f49bc15cfb0 2024-09-13T17:09:30.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49b959a700 1 -- 172.21.15.123:0/2571950019 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49a40035d0 con 0x7f49bc15cfb0 2024-09-13T17:09:30.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49b959a700 1 -- 172.21.15.123:0/2571950019 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753931193 0 0) 0x7f49bc15d390 con 0x7f49bc0d3800 2024-09-13T17:09:30.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49bad9d700 1 -- 172.21.15.123:0/2571950019 >> v1:172.21.15.153:6789/0 conn(0x7f49bc0d3800 legacy=0x7f49bc0d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49bad9d700 1 -- 172.21.15.123:0/2571950019 >> v1:172.21.15.123:6789/0 conn(0x7f49bc15cfb0 legacy=0x7f49bc0d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49bad9d700 1 -- 172.21.15.123:0/2571950019 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc0cdac0 con 0x7f49bc0d19e0 2024-09-13T17:09:30.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49bad9d700 1 --2- 172.21.15.123:0/2571950019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49bc0d19e0 0x7f49bc0ce840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009dc0 tx=0x7f49b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6830e6caa43e0927 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:30.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49b959a700 1 -- 172.21.15.123:0/2571950019 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b400e070 con 0x7f49bc0d19e0 2024-09-13T17:09:30.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49b959a700 1 -- 172.21.15.123:0/2571950019 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b400bb20 con 0x7f49bc0d19e0 2024-09-13T17:09:30.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.426+0000 7f49b959a700 1 -- 172.21.15.123:0/2571950019 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b400be90 con 0x7f49bc0d19e0 2024-09-13T17:09:30.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.430+0000 7f49c0f5f700 1 -- 172.21.15.123:0/2571950019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49bc0d19e0 msgr2=0x7f49bc0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.430+0000 7f49c0f5f700 1 --2- 172.21.15.123:0/2571950019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49bc0d19e0 0x7f49bc0ce840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009dc0 tx=0x7f49b400b330 comp rx=0 tx=0).stop 2024-09-13T17:09:30.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.430+0000 7f49c0f5f700 1 -- 172.21.15.123:0/2571950019 shutdown_connections 2024-09-13T17:09:30.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.430+0000 7f49c0f5f700 1 --2- 172.21.15.123:0/2571950019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49bc0d19e0 0x7f49bc0ce840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.430+0000 7f49c0f5f700 1 -- 172.21.15.123:0/2571950019 >> 172.21.15.123:0/2571950019 conn(0x7f49bc0d2d10 msgr2=0x7f49bc0d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:30.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.430+0000 7f49c0f5f700 1 -- 172.21.15.123:0/2571950019 shutdown_connections 2024-09-13T17:09:30.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.430+0000 7f49c0f5f700 1 -- 172.21.15.123:0/2571950019 wait complete. 2024-09-13T17:09:30.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.430+0000 7f49c0f5f700 1 Processor -- start 2024-09-13T17:09:30.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.430+0000 7f49c0f5f700 1 -- start start 2024-09-13T17:09:30.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49c0f5f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49bc0d19e0 0x7f49bc09dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49c0f5f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49bc0d3800 0x7f49bc09ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49c0f5f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc15cfb0 0x7f49bc15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49c0f5f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc1f7050 con 0x7f49bc15cfb0 2024-09-13T17:09:30.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49c0f5f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc09e270 con 0x7f49bc0d19e0 2024-09-13T17:09:30.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49c0f5f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc1f63d0 con 0x7f49bc0d3800 2024-09-13T17:09:30.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49bad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc15cfb0 0x7f49bc15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49bad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc15cfb0 0x7f49bc15aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52948/0 (socket says 172.21.15.123:52948) 2024-09-13T17:09:30.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49bad9d700 1 -- 172.21.15.123:0/1045351183 learned_addr learned my addr 172.21.15.123:0/1045351183 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:30.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49ba59c700 1 --2- 172.21.15.123:0/1045351183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49bc0d19e0 0x7f49bc09dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49b9d9b700 1 --2- 172.21.15.123:0/1045351183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49bc0d3800 0x7f49bc09ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49bad9d700 1 -- 172.21.15.123:0/1045351183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49bc0d3800 msgr2=0x7f49bc09ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49bad9d700 1 --2- 172.21.15.123:0/1045351183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49bc0d3800 0x7f49bc09ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49bad9d700 1 -- 172.21.15.123:0/1045351183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49bc0d19e0 msgr2=0x7f49bc09dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49bad9d700 1 --2- 172.21.15.123:0/1045351183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49bc0d19e0 0x7f49bc09dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49bad9d700 1 -- 172.21.15.123:0/1045351183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b4009a70 con 0x7f49bc15cfb0 2024-09-13T17:09:30.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49bad9d700 1 --2- 172.21.15.123:0/1045351183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc15cfb0 0x7f49bc15aca0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f49b400b370 tx=0x7f49b4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:30.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49aaffd700 1 -- 172.21.15.123:0/1045351183 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4003c40 con 0x7f49bc15cfb0 2024-09-13T17:09:30.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49aaffd700 1 -- 172.21.15.123:0/1045351183 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4003dc0 con 0x7f49bc15cfb0 2024-09-13T17:09:30.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49c0f5f700 1 -- 172.21.15.123:0/1045351183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49bc1f66b0 con 0x7f49bc15cfb0 2024-09-13T17:09:30.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49aaffd700 1 -- 172.21.15.123:0/1045351183 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4012b50 con 0x7f49bc15cfb0 2024-09-13T17:09:30.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.434+0000 7f49c0f5f700 1 -- 172.21.15.123:0/1045351183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49bc1f6c70 con 0x7f49bc15cfb0 2024-09-13T17:09:30.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.438+0000 7f49c0f5f700 1 -- 172.21.15.123:0/1045351183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49bc1f7190 con 0x7f49bc15cfb0 2024-09-13T17:09:30.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.438+0000 7f49aaffd700 1 -- 172.21.15.123:0/1045351183 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f49b4023070 con 0x7f49bc15cfb0 2024-09-13T17:09:30.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.438+0000 7f49aaffd700 1 --2- 172.21.15.123:0/1045351183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f499c066730 0x7f499c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.438+0000 7f49aaffd700 1 -- 172.21.15.123:0/1045351183 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49b4085550 con 0x7f49bc15cfb0 2024-09-13T17:09:30.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.438+0000 7f49ba59c700 1 --2- 172.21.15.123:0/1045351183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f499c066730 0x7f499c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.438+0000 7f49ba59c700 1 --2- 172.21.15.123:0/1045351183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f499c066730 0x7f499c068bf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f49ac007fd0 tx=0x7f49ac009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:30.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.442+0000 7f49aaffd700 1 -- 172.21.15.123:0/1045351183 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f49b4052950 con 0x7f49bc15cfb0 2024-09-13T17:09:30.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.610+0000 7f49c0f5f700 1 -- 172.21.15.123:0/1045351183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49bc0ce840 con 0x7f49bc15cfb0 2024-09-13T17:09:30.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.610+0000 7f49aaffd700 1 -- 172.21.15.123:0/1045351183 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49b4055f70 con 0x7f49bc15cfb0 2024-09-13T17:09:30.616 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:09:30.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.614+0000 7f49c0f5f700 1 -- 172.21.15.123:0/1045351183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f499c066730 msgr2=0x7f499c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.614+0000 7f49c0f5f700 1 --2- 172.21.15.123:0/1045351183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f499c066730 0x7f499c068bf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f49ac007fd0 tx=0x7f49ac009040 comp rx=0 tx=0).stop 2024-09-13T17:09:30.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.614+0000 7f49c0f5f700 1 -- 172.21.15.123:0/1045351183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc15cfb0 msgr2=0x7f49bc15aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.614+0000 7f49c0f5f700 1 --2- 172.21.15.123:0/1045351183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc15cfb0 0x7f49bc15aca0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f49b400b370 tx=0x7f49b4004af0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.614+0000 7f49c0f5f700 1 -- 172.21.15.123:0/1045351183 shutdown_connections 2024-09-13T17:09:30.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.614+0000 7f49c0f5f700 1 --2- 172.21.15.123:0/1045351183 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f499c066730 0x7f499c068bf0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.614+0000 7f49c0f5f700 1 --2- 172.21.15.123:0/1045351183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49bc15cfb0 0x7f49bc15aca0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.614+0000 7f49c0f5f700 1 --2- 172.21.15.123:0/1045351183 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f49bc0d3800 0x7f49bc09ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.614+0000 7f49c0f5f700 1 --2- 172.21.15.123:0/1045351183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49bc0d19e0 0x7f49bc09dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.614+0000 7f49c0f5f700 1 -- 172.21.15.123:0/1045351183 >> 172.21.15.123:0/1045351183 conn(0x7f49bc0d2d10 msgr2=0x7f49bc0d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:30.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.614+0000 7f49c0f5f700 1 -- 172.21.15.123:0/1045351183 shutdown_connections 2024-09-13T17:09:30.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.614+0000 7f49c0f5f700 1 -- 172.21.15.123:0/1045351183 wait complete. 2024-09-13T17:09:30.637 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:09:30.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b99ded700 1 Processor -- start 2024-09-13T17:09:30.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b99ded700 1 -- start start 2024-09-13T17:09:30.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b99ded700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b9406a970 0x7f7b940b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b99ded700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b940b35d0 con 0x7f7b94159170 2024-09-13T17:09:30.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b99ded700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b940b38b0 con 0x7f7b94158d90 2024-09-13T17:09:30.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b99ded700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940b3b90 con 0x7f7b9406a970 2024-09-13T17:09:30.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b93fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7b94159170 0x7f7b940b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38166/0 (socket says 172.21.15.123:38166) 2024-09-13T17:09:30.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b93fff700 1 -- 172.21.15.123:0/3892328977 learned_addr learned my addr 172.21.15.123:0/3892328977 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:30.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b995ec700 1 --2- 172.21.15.123:0/3892328977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b9406a970 0x7f7b940b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b937fe700 1 -- 172.21.15.123:0/3892328977 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196210813 0 0) 0x7f7b940b35d0 con 0x7f7b94159170 2024-09-13T17:09:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b937fe700 1 -- 172.21.15.123:0/3892328977 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b7c0035d0 con 0x7f7b94159170 2024-09-13T17:09:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b995ec700 1 -- 172.21.15.123:0/3892328977 >> v1:172.21.15.153:6789/0 conn(0x7f7b94158d90 legacy=0x7f7b9406a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b937fe700 1 -- 172.21.15.123:0/3892328977 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29013970 0 0) 0x7f7b940b38b0 con 0x7f7b94158d90 2024-09-13T17:09:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b995ec700 1 -- 172.21.15.123:0/3892328977 >> v1:172.21.15.123:6789/0 conn(0x7f7b94159170 legacy=0x7f7b940b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b995ec700 1 -- 172.21.15.123:0/3892328977 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b94159610 con 0x7f7b9406a970 2024-09-13T17:09:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.750+0000 7f7b995ec700 1 --2- 172.21.15.123:0/3892328977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b9406a970 0x7f7b940b2fb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00aed0 tx=0x7f7b8c00c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=179f4db558d0b0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.754+0000 7f7b937fe700 1 -- 172.21.15.123:0/3892328977 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c00f070 con 0x7f7b9406a970 2024-09-13T17:09:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.754+0000 7f7b937fe700 1 -- 172.21.15.123:0/3892328977 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c00a2e0 con 0x7f7b9406a970 2024-09-13T17:09:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.754+0000 7f7b937fe700 1 -- 172.21.15.123:0/3892328977 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88001670 con 0x7f7b9406a970 2024-09-13T17:09:30.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.754+0000 7f7b99ded700 1 -- 172.21.15.123:0/3892328977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b9406a970 msgr2=0x7f7b940b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.754+0000 7f7b99ded700 1 --2- 172.21.15.123:0/3892328977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b9406a970 0x7f7b940b2fb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00aed0 tx=0x7f7b8c00c330 comp rx=0 tx=0).stop 2024-09-13T17:09:30.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.754+0000 7f7b99ded700 1 -- 172.21.15.123:0/3892328977 shutdown_connections 2024-09-13T17:09:30.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.754+0000 7f7b99ded700 1 --2- 172.21.15.123:0/3892328977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b9406a970 0x7f7b940b2fb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.754+0000 7f7b99ded700 1 -- 172.21.15.123:0/3892328977 >> 172.21.15.123:0/3892328977 conn(0x7f7b9406f940 msgr2=0x7f7b940b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:30.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.754+0000 7f7b99ded700 1 -- 172.21.15.123:0/3892328977 shutdown_connections 2024-09-13T17:09:30.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.754+0000 7f7b99ded700 1 -- 172.21.15.123:0/3892328977 wait complete. 2024-09-13T17:09:30.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b99ded700 1 Processor -- start 2024-09-13T17:09:30.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b99ded700 1 -- start start 2024-09-13T17:09:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b99ded700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9406a970 0x7f7b941f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b99ded700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b94158d90 0x7f7b940adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b99ded700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b94159170 0x7f7b940a9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b99ded700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b941f24a0 con 0x7f7b9406a970 2024-09-13T17:09:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b99ded700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940ae1e0 con 0x7f7b94158d90 2024-09-13T17:09:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b99ded700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940aeb80 con 0x7f7b94159170 2024-09-13T17:09:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b98deb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9406a970 0x7f7b941f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b98deb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9406a970 0x7f7b941f1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52958/0 (socket says 172.21.15.123:52958) 2024-09-13T17:09:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b98deb700 1 -- 172.21.15.123:0/1680229654 learned_addr learned my addr 172.21.15.123:0/1680229654 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b995ec700 1 --2- 172.21.15.123:0/1680229654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b94159170 0x7f7b940a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b93fff700 1 --2- 172.21.15.123:0/1680229654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b94158d90 0x7f7b940adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b98deb700 1 -- 172.21.15.123:0/1680229654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b94159170 msgr2=0x7f7b940a9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b98deb700 1 --2- 172.21.15.123:0/1680229654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b94159170 0x7f7b940a9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b98deb700 1 -- 172.21.15.123:0/1680229654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b94158d90 msgr2=0x7f7b940adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b98deb700 1 --2- 172.21.15.123:0/1680229654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b94158d90 0x7f7b940adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b98deb700 1 -- 172.21.15.123:0/1680229654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c00ab80 con 0x7f7b9406a970 2024-09-13T17:09:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b98deb700 1 --2- 172.21.15.123:0/1680229654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9406a970 0x7f7b941f1f60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7b840011e0 tx=0x7f7b8400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:30.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b917fa700 1 -- 172.21.15.123:0/1680229654 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b840054e0 con 0x7f7b9406a970 2024-09-13T17:09:30.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b917fa700 1 -- 172.21.15.123:0/1680229654 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b840036a0 con 0x7f7b9406a970 2024-09-13T17:09:30.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b99ded700 1 -- 172.21.15.123:0/1680229654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b940aedd0 con 0x7f7b9406a970 2024-09-13T17:09:30.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b917fa700 1 -- 172.21.15.123:0/1680229654 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84003a50 con 0x7f7b9406a970 2024-09-13T17:09:30.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.758+0000 7f7b99ded700 1 -- 172.21.15.123:0/1680229654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b940af390 con 0x7f7b9406a970 2024-09-13T17:09:30.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.762+0000 7f7b99ded700 1 -- 172.21.15.123:0/1680229654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9406a260 con 0x7f7b9406a970 2024-09-13T17:09:30.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.762+0000 7f7b917fa700 1 -- 172.21.15.123:0/1680229654 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7b84003bb0 con 0x7f7b9406a970 2024-09-13T17:09:30.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.762+0000 7f7b917fa700 1 --2- 172.21.15.123:0/1680229654 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7b80066730 0x7f7b80068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:30.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.762+0000 7f7b93fff700 1 --2- 172.21.15.123:0/1680229654 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7b80066730 0x7f7b80068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:30.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.762+0000 7f7b917fa700 1 -- 172.21.15.123:0/1680229654 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b84083650 con 0x7f7b9406a970 2024-09-13T17:09:30.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.762+0000 7f7b93fff700 1 --2- 172.21.15.123:0/1680229654 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7b80066730 0x7f7b80068bf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7b880017a0 tx=0x7f7b88001630 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:30.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.770+0000 7f7b917fa700 1 -- 172.21.15.123:0/1680229654 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7b840509d0 con 0x7f7b9406a970 2024-09-13T17:09:30.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.946+0000 7f7b99ded700 1 -- 172.21.15.123:0/1680229654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7b94157f10 con 0x7f7b9406a970 2024-09-13T17:09:30.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.946+0000 7f7b917fa700 1 -- 172.21.15.123:0/1680229654 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7b84003e60 con 0x7f7b9406a970 2024-09-13T17:09:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.950+0000 7f7b99ded700 1 -- 172.21.15.123:0/1680229654 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7b80066730 msgr2=0x7f7b80068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.950+0000 7f7b99ded700 1 --2- 172.21.15.123:0/1680229654 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7b80066730 0x7f7b80068bf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7b880017a0 tx=0x7f7b88001630 comp rx=0 tx=0).stop 2024-09-13T17:09:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.950+0000 7f7b99ded700 1 -- 172.21.15.123:0/1680229654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9406a970 msgr2=0x7f7b941f1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.950+0000 7f7b99ded700 1 --2- 172.21.15.123:0/1680229654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9406a970 0x7f7b941f1f60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7b840011e0 tx=0x7f7b8400ca30 comp rx=0 tx=0).stop 2024-09-13T17:09:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.950+0000 7f7b99ded700 1 -- 172.21.15.123:0/1680229654 shutdown_connections 2024-09-13T17:09:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.950+0000 7f7b99ded700 1 --2- 172.21.15.123:0/1680229654 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7b80066730 0x7f7b80068bf0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.950+0000 7f7b99ded700 1 --2- 172.21.15.123:0/1680229654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b94159170 0x7f7b940a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.950+0000 7f7b99ded700 1 --2- 172.21.15.123:0/1680229654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b94158d90 0x7f7b940adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.950+0000 7f7b99ded700 1 --2- 172.21.15.123:0/1680229654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9406a970 0x7f7b941f1f60 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.950+0000 7f7b99ded700 1 -- 172.21.15.123:0/1680229654 >> 172.21.15.123:0/1680229654 conn(0x7f7b9406f940 msgr2=0x7f7b94073f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.950+0000 7f7b99ded700 1 -- 172.21.15.123:0/1680229654 shutdown_connections 2024-09-13T17:09:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:30.950+0000 7f7b99ded700 1 -- 172.21.15.123:0/1680229654 wait complete. 2024-09-13T17:09:30.956 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:09:30.966 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:09:30.966 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:30.974 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:31.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.078+0000 7fb5e3fff700 1 Processor -- start 2024-09-13T17:09:31.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.078+0000 7fb5e3fff700 1 -- start start 2024-09-13T17:09:31.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.078+0000 7fb5e3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb5e40cb840 0x7fb5e4159580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.078+0000 7fb5e3fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e40cb1a0 con 0x7fb5e40b1b90 2024-09-13T17:09:31.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.078+0000 7fb5e3fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e4159bd0 con 0x7fb5e41534a0 2024-09-13T17:09:31.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.078+0000 7fb5e3fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e4159eb0 con 0x7fb5e40cb840 2024-09-13T17:09:31.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e37fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb5e40b1b90 0x7fb5e40b1f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38170/0 (socket says 172.21.15.123:38170) 2024-09-13T17:09:31.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e37fe700 1 -- 172.21.15.123:0/4090341630 learned_addr learned my addr 172.21.15.123:0/4090341630 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:31.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e27fc700 1 --2- 172.21.15.123:0/4090341630 >> v2:172.21.15.153:3300/0 conn(0x7fb5e40cb840 0x7fb5e4159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e1ffb700 1 -- 172.21.15.123:0/4090341630 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919364202 0 0) 0x7fb5e40cb1a0 con 0x7fb5e40b1b90 2024-09-13T17:09:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e1ffb700 1 -- 172.21.15.123:0/4090341630 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5d00035d0 con 0x7fb5e40b1b90 2024-09-13T17:09:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e27fc700 1 -- 172.21.15.123:0/4090341630 >> v1:172.21.15.153:6789/0 conn(0x7fb5e41534a0 legacy=0x7fb5e4071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e27fc700 1 -- 172.21.15.123:0/4090341630 >> v1:172.21.15.123:6789/0 conn(0x7fb5e40b1b90 legacy=0x7fb5e40b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e27fc700 1 -- 172.21.15.123:0/4090341630 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e415a190 con 0x7fb5e40cb840 2024-09-13T17:09:31.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e27fc700 1 --2- 172.21.15.123:0/4090341630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e40cb840 0x7fb5e4159580 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009d90 tx=0x7fb5d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcdb6d19e045ad05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e1ffb700 1 -- 172.21.15.123:0/4090341630 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400e070 con 0x7fb5e40cb840 2024-09-13T17:09:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e1ffb700 1 -- 172.21.15.123:0/4090341630 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d400bb20 con 0x7fb5e40cb840 2024-09-13T17:09:31.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e1ffb700 1 -- 172.21.15.123:0/4090341630 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400be90 con 0x7fb5e40cb840 2024-09-13T17:09:31.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e3fff700 1 -- 172.21.15.123:0/4090341630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e40cb840 msgr2=0x7fb5e4159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e3fff700 1 --2- 172.21.15.123:0/4090341630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e40cb840 0x7fb5e4159580 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009d90 tx=0x7fb5d400b330 comp rx=0 tx=0).stop 2024-09-13T17:09:31.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e3fff700 1 -- 172.21.15.123:0/4090341630 shutdown_connections 2024-09-13T17:09:31.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e3fff700 1 --2- 172.21.15.123:0/4090341630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e40cb840 0x7fb5e4159580 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e3fff700 1 -- 172.21.15.123:0/4090341630 >> 172.21.15.123:0/4090341630 conn(0x7fb5e4066150 msgr2=0x7fb5e4066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:31.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e3fff700 1 -- 172.21.15.123:0/4090341630 shutdown_connections 2024-09-13T17:09:31.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.082+0000 7fb5e3fff700 1 -- 172.21.15.123:0/4090341630 wait complete. 2024-09-13T17:09:31.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e3fff700 1 Processor -- start 2024-09-13T17:09:31.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e3fff700 1 -- start start 2024-09-13T17:09:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5e40b1b90 0x7fb5e4147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5e40cb840 0x7fb5e406be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e41534a0 0x7fb5e4158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e3fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e40b0c10 con 0x7fb5e40cb840 2024-09-13T17:09:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e4141270 con 0x7fb5e41534a0 2024-09-13T17:09:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e40b0e20 con 0x7fb5e40b1b90 2024-09-13T17:09:31.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e27fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5e40cb840 0x7fb5e406be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e27fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5e40cb840 0x7fb5e406be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52970/0 (socket says 172.21.15.123:52970) 2024-09-13T17:09:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e27fc700 1 -- 172.21.15.123:0/2007188840 learned_addr learned my addr 172.21.15.123:0/2007188840 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e37fe700 1 --2- 172.21.15.123:0/2007188840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e41534a0 0x7fb5e4158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e2ffd700 1 --2- 172.21.15.123:0/2007188840 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5e40b1b90 0x7fb5e4147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e27fc700 1 -- 172.21.15.123:0/2007188840 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5e40b1b90 msgr2=0x7fb5e4147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e27fc700 1 --2- 172.21.15.123:0/2007188840 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5e40b1b90 0x7fb5e4147660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e27fc700 1 -- 172.21.15.123:0/2007188840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e41534a0 msgr2=0x7fb5e4158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e27fc700 1 --2- 172.21.15.123:0/2007188840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e41534a0 0x7fb5e4158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e27fc700 1 -- 172.21.15.123:0/2007188840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d4009a70 con 0x7fb5e40cb840 2024-09-13T17:09:31.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e27fc700 1 --2- 172.21.15.123:0/2007188840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5e40cb840 0x7fb5e406be90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4014040 tx=0x7fb5d4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:31.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5db7fe700 1 -- 172.21.15.123:0/2007188840 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4007000 con 0x7fb5e40cb840 2024-09-13T17:09:31.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5db7fe700 1 -- 172.21.15.123:0/2007188840 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4004980 con 0x7fb5e40cb840 2024-09-13T17:09:31.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e3fff700 1 -- 172.21.15.123:0/2007188840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e40b1100 con 0x7fb5e40cb840 2024-09-13T17:09:31.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5db7fe700 1 -- 172.21.15.123:0/2007188840 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4012890 con 0x7fb5e40cb840 2024-09-13T17:09:31.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.086+0000 7fb5e3fff700 1 -- 172.21.15.123:0/2007188840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e413e0d0 con 0x7fb5e40cb840 2024-09-13T17:09:31.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.090+0000 7fb5e3fff700 1 -- 172.21.15.123:0/2007188840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e40677f0 con 0x7fb5e40cb840 2024-09-13T17:09:31.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.090+0000 7fb5db7fe700 1 -- 172.21.15.123:0/2007188840 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb5d40129f0 con 0x7fb5e40cb840 2024-09-13T17:09:31.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.090+0000 7fb5db7fe700 1 --2- 172.21.15.123:0/2007188840 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb5c4066730 0x7fb5c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.090+0000 7fb5db7fe700 1 -- 172.21.15.123:0/2007188840 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5d4085ee0 con 0x7fb5e40cb840 2024-09-13T17:09:31.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.090+0000 7fb5e2ffd700 1 --2- 172.21.15.123:0/2007188840 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb5c4066730 0x7fb5c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.090+0000 7fb5e2ffd700 1 --2- 172.21.15.123:0/2007188840 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb5c4066730 0x7fb5c4068bf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc001800 tx=0x7fb5cc009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:31.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.098+0000 7fb5db7fe700 1 -- 172.21.15.123:0/2007188840 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb5d4053390 con 0x7fb5e40cb840 2024-09-13T17:09:31.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.270+0000 7fb5e3fff700 1 -- 172.21.15.123:0/2007188840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5e4140d60 con 0x7fb5e40cb840 2024-09-13T17:09:31.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.270+0000 7fb5db7fe700 1 -- 172.21.15.123:0/2007188840 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16616 (secure 0 0 0) 0x7fb5e4140d60 con 0x7fb5e40cb840 2024-09-13T17:09:31.278 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:31.279 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":72,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:09:19.929124+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:17.328080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:17.920002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:31.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.274+0000 7fb5e3fff700 1 -- 172.21.15.123:0/2007188840 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb5c4066730 msgr2=0x7fb5c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.274+0000 7fb5e3fff700 1 --2- 172.21.15.123:0/2007188840 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb5c4066730 0x7fb5c4068bf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc001800 tx=0x7fb5cc009040 comp rx=0 tx=0).stop 2024-09-13T17:09:31.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.274+0000 7fb5e3fff700 1 -- 172.21.15.123:0/2007188840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5e40cb840 msgr2=0x7fb5e406be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.274+0000 7fb5e3fff700 1 --2- 172.21.15.123:0/2007188840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5e40cb840 0x7fb5e406be90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4014040 tx=0x7fb5d4004af0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.274+0000 7fb5e3fff700 1 -- 172.21.15.123:0/2007188840 shutdown_connections 2024-09-13T17:09:31.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.274+0000 7fb5e3fff700 1 --2- 172.21.15.123:0/2007188840 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb5c4066730 0x7fb5c4068bf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.274+0000 7fb5e3fff700 1 --2- 172.21.15.123:0/2007188840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5e41534a0 0x7fb5e4158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.274+0000 7fb5e3fff700 1 --2- 172.21.15.123:0/2007188840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5e40cb840 0x7fb5e406be90 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.274+0000 7fb5e3fff700 1 --2- 172.21.15.123:0/2007188840 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5e40b1b90 0x7fb5e4147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.274+0000 7fb5e3fff700 1 -- 172.21.15.123:0/2007188840 >> 172.21.15.123:0/2007188840 conn(0x7fb5e4066150 msgr2=0x7fb5e40715d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:31.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.274+0000 7fb5e3fff700 1 -- 172.21.15.123:0/2007188840 shutdown_connections 2024-09-13T17:09:31.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.274+0000 7fb5e3fff700 1 -- 172.21.15.123:0/2007188840 wait complete. 2024-09-13T17:09:31.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:09:17.328080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:09:17.920002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:09:31.297 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:09:31.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.410+0000 7f3945bdd700 1 Processor -- start 2024-09-13T17:09:31.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.410+0000 7f3945bdd700 1 -- start start 2024-09-13T17:09:31.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f3945bdd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39400d0f40 0x7f39400d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f3945bdd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39400b58b0 0x7f39400d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f3945bdd700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39400b0060 con 0x7f39400b1100 2024-09-13T17:09:31.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f3945bdd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39400b0340 con 0x7f39400b58b0 2024-09-13T17:09:31.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f3945bdd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39400b0620 con 0x7f39400d0f40 2024-09-13T17:09:31.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f3937fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39400b58b0 0x7f39400d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f3937fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39400b58b0 0x7f39400d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52984/0 (socket says 172.21.15.123:52984) 2024-09-13T17:09:31.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f3937fff700 1 -- 172.21.15.123:0/3746466090 learned_addr learned my addr 172.21.15.123:0/3746466090 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:31.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f3944bdb700 1 --2- 172.21.15.123:0/3746466090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39400d0f40 0x7f39400d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f3937fff700 1 -- 172.21.15.123:0/3746466090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39400d0f40 msgr2=0x7f39400d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:31.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f3937fff700 1 --2- 172.21.15.123:0/3746466090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39400d0f40 0x7f39400d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f3937fff700 1 -- 172.21.15.123:0/3746466090 >> v1:172.21.15.153:6789/0 conn(0x7f39400b1100 legacy=0x7f39400b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f3937fff700 1 -- 172.21.15.123:0/3746466090 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39400b0900 con 0x7f39400b58b0 2024-09-13T17:09:31.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f3937fff700 1 --2- 172.21.15.123:0/3746466090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39400b58b0 0x7f39400d05a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3930009910 tx=0x7f3930009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a924b55c2d6d3b48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:31.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f39377fe700 1 -- 172.21.15.123:0/3746466090 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000ba60 con 0x7f39400b58b0 2024-09-13T17:09:31.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f39377fe700 1 -- 172.21.15.123:0/3746466090 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393000bbc0 con 0x7f39400b58b0 2024-09-13T17:09:31.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.414+0000 7f39377fe700 1 -- 172.21.15.123:0/3746466090 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930009e60 con 0x7f39400b58b0 2024-09-13T17:09:31.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 -- 172.21.15.123:0/3746466090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39400b58b0 msgr2=0x7f39400d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 --2- 172.21.15.123:0/3746466090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39400b58b0 0x7f39400d05a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3930009910 tx=0x7f3930009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 -- 172.21.15.123:0/3746466090 shutdown_connections 2024-09-13T17:09:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 --2- 172.21.15.123:0/3746466090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39400b58b0 0x7f39400d05a0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 --2- 172.21.15.123:0/3746466090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39400d0f40 0x7f39400d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 -- 172.21.15.123:0/3746466090 >> 172.21.15.123:0/3746466090 conn(0x7f39400d2a60 msgr2=0x7f39400d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 -- 172.21.15.123:0/3746466090 shutdown_connections 2024-09-13T17:09:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 -- 172.21.15.123:0/3746466090 wait complete. 2024-09-13T17:09:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 Processor -- start 2024-09-13T17:09:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 -- start start 2024-09-13T17:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39400b1100 0x7f394015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39400b58b0 0x7f394014eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39400d0f40 0x7f39401f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394015e170 con 0x7f39400b1100 2024-09-13T17:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39401f3ff0 con 0x7f39400b58b0 2024-09-13T17:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3945bdd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394014f400 con 0x7f39400d0f40 2024-09-13T17:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3944bdb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39400b1100 0x7f394015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3944bdb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39400b1100 0x7f394015c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52998/0 (socket says 172.21.15.123:52998) 2024-09-13T17:09:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3944bdb700 1 -- 172.21.15.123:0/3732281693 learned_addr learned my addr 172.21.15.123:0/3732281693 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3937fff700 1 --2- 172.21.15.123:0/3732281693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39400b58b0 0x7f394014eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f39453dc700 1 --2- 172.21.15.123:0/3732281693 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39400d0f40 0x7f39401f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3944bdb700 1 -- 172.21.15.123:0/3732281693 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39400d0f40 msgr2=0x7f39401f2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3944bdb700 1 --2- 172.21.15.123:0/3732281693 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39400d0f40 0x7f39401f2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3944bdb700 1 -- 172.21.15.123:0/3732281693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39400b58b0 msgr2=0x7f394014eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3944bdb700 1 --2- 172.21.15.123:0/3732281693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39400b58b0 0x7f394014eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3944bdb700 1 -- 172.21.15.123:0/3732281693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3930009570 con 0x7f39400b1100 2024-09-13T17:09:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f3944bdb700 1 --2- 172.21.15.123:0/3732281693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39400b1100 0x7f394015c1c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f393c00d800 tx=0x7f393c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f39357fa700 1 -- 172.21.15.123:0/3732281693 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c0125f0 con 0x7f39400b1100 2024-09-13T17:09:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.418+0000 7f39357fa700 1 -- 172.21.15.123:0/3732281693 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c012750 con 0x7f39400b1100 2024-09-13T17:09:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.422+0000 7f3945bdd700 1 -- 172.21.15.123:0/3732281693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39400c8c40 con 0x7f39400b1100 2024-09-13T17:09:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.422+0000 7f39357fa700 1 -- 172.21.15.123:0/3732281693 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c012ac0 con 0x7f39400b1100 2024-09-13T17:09:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.422+0000 7f3945bdd700 1 -- 172.21.15.123:0/3732281693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39400c9200 con 0x7f39400b1100 2024-09-13T17:09:31.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.422+0000 7f3945bdd700 1 -- 172.21.15.123:0/3732281693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394015ce70 con 0x7f39400b1100 2024-09-13T17:09:31.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.422+0000 7f39357fa700 1 -- 172.21.15.123:0/3732281693 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f393c012c20 con 0x7f39400b1100 2024-09-13T17:09:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.422+0000 7f39357fa700 1 --2- 172.21.15.123:0/3732281693 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f392c066730 0x7f392c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.422+0000 7f3937fff700 1 --2- 172.21.15.123:0/3732281693 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f392c066730 0x7f392c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.426+0000 7f39357fa700 1 -- 172.21.15.123:0/3732281693 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f393c0841b0 con 0x7f39400b1100 2024-09-13T17:09:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.426+0000 7f3937fff700 1 --2- 172.21.15.123:0/3732281693 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f392c066730 0x7f392c068bf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f39400b5c90 tx=0x7f3930008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:31.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.434+0000 7f39357fa700 1 -- 172.21.15.123:0/3732281693 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f393c051510 con 0x7f39400b1100 2024-09-13T17:09:31.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.598+0000 7f3945bdd700 1 -- 172.21.15.123:0/3732281693 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f394015e2b0 con 0x7f39400b1100 2024-09-13T17:09:31.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.602+0000 7f39357fa700 1 -- 172.21.15.123:0/3732281693 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f394015e2b0 con 0x7f39400b1100 2024-09-13T17:09:31.606 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:09:31.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.602+0000 7f3945bdd700 1 -- 172.21.15.123:0/3732281693 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f392c066730 msgr2=0x7f392c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.602+0000 7f3945bdd700 1 --2- 172.21.15.123:0/3732281693 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f392c066730 0x7f392c068bf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f39400b5c90 tx=0x7f3930008030 comp rx=0 tx=0).stop 2024-09-13T17:09:31.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.602+0000 7f3945bdd700 1 -- 172.21.15.123:0/3732281693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39400b1100 msgr2=0x7f394015c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.602+0000 7f3945bdd700 1 --2- 172.21.15.123:0/3732281693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39400b1100 0x7f394015c1c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f393c00d800 tx=0x7f393c00db10 comp rx=0 tx=0).stop 2024-09-13T17:09:31.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.602+0000 7f3945bdd700 1 -- 172.21.15.123:0/3732281693 shutdown_connections 2024-09-13T17:09:31.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.602+0000 7f3945bdd700 1 --2- 172.21.15.123:0/3732281693 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f392c066730 0x7f392c068bf0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.602+0000 7f3945bdd700 1 --2- 172.21.15.123:0/3732281693 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39400d0f40 0x7f39401f2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.602+0000 7f3945bdd700 1 --2- 172.21.15.123:0/3732281693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39400b58b0 0x7f394014eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.602+0000 7f3945bdd700 1 --2- 172.21.15.123:0/3732281693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39400b1100 0x7f394015c1c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.602+0000 7f3945bdd700 1 -- 172.21.15.123:0/3732281693 >> 172.21.15.123:0/3732281693 conn(0x7f39400d2a60 msgr2=0x7f39400b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:31.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.602+0000 7f3945bdd700 1 -- 172.21.15.123:0/3732281693 shutdown_connections 2024-09-13T17:09:31.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.602+0000 7f3945bdd700 1 -- 172.21.15.123:0/3732281693 wait complete. 2024-09-13T17:09:31.621 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:09:31.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 Processor -- start 2024-09-13T17:09:31.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 -- start start 2024-09-13T17:09:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6f00072260 0x7f6f000c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f0006bdb0 0x7f6f000cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f000ca750 con 0x7f6f000cb7e0 2024-09-13T17:09:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f000c9210 con 0x7f6f00072260 2024-09-13T17:09:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001617b0 con 0x7f6f0006bdb0 2024-09-13T17:09:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6efeffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6f00072260 0x7f6f000c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6efeffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6f00072260 0x7f6f000c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53008/0 (socket says 172.21.15.123:53008) 2024-09-13T17:09:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6efeffd700 1 -- 172.21.15.123:0/3763260416 learned_addr learned my addr 172.21.15.123:0/3763260416 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6efffff700 1 --2- 172.21.15.123:0/3763260416 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f0006bdb0 0x7f6f000cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6efeffd700 1 -- 172.21.15.123:0/3763260416 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f0006bdb0 msgr2=0x7f6f000cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6efeffd700 1 --2- 172.21.15.123:0/3763260416 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f0006bdb0 0x7f6f000cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6efeffd700 1 -- 172.21.15.123:0/3763260416 >> v1:172.21.15.123:6789/0 conn(0x7f6f000cb7e0 legacy=0x7f6f00071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6efeffd700 1 -- 172.21.15.123:0/3763260416 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f000cbbc0 con 0x7f6f00072260 2024-09-13T17:09:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6efe7fc700 1 -- 172.21.15.123:0/3763260416 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872375588 0 0) 0x7f6f000ca750 con 0x7f6f000cb7e0 2024-09-13T17:09:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6efeffd700 1 --2- 172.21.15.123:0/3763260416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00072260 0x7f6f000c8cd0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009910 tx=0x7f6ef4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c6d601b4fffd51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6efe7fc700 1 -- 172.21.15.123:0/3763260416 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef400ba60 con 0x7f6f00072260 2024-09-13T17:09:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6efe7fc700 1 -- 172.21.15.123:0/3763260416 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef400bbc0 con 0x7f6f00072260 2024-09-13T17:09:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6efe7fc700 1 -- 172.21.15.123:0/3763260416 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4009e60 con 0x7f6f00072260 2024-09-13T17:09:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 -- 172.21.15.123:0/3763260416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00072260 msgr2=0x7f6f000c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 --2- 172.21.15.123:0/3763260416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00072260 0x7f6f000c8cd0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009910 tx=0x7f6ef4009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 -- 172.21.15.123:0/3763260416 shutdown_connections 2024-09-13T17:09:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 --2- 172.21.15.123:0/3763260416 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f0006bdb0 0x7f6f000cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 --2- 172.21.15.123:0/3763260416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00072260 0x7f6f000c8cd0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 -- 172.21.15.123:0/3763260416 >> 172.21.15.123:0/3763260416 conn(0x7f6f000b01d0 msgr2=0x7f6f000b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 -- 172.21.15.123:0/3763260416 shutdown_connections 2024-09-13T17:09:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.738+0000 7f6f04d99700 1 -- 172.21.15.123:0/3763260416 wait complete. 2024-09-13T17:09:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6f04d99700 1 Processor -- start 2024-09-13T17:09:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6f04d99700 1 -- start start 2024-09-13T17:09:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6f04d99700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f0006bdb0 0x7f6f00160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6f04d99700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f00072260 0x7f6f000c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6f04d99700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f000cb7e0 0x7f6f000c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6f04d99700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000c61b0 con 0x7f6f0006bdb0 2024-09-13T17:09:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6f04d99700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001f7d70 con 0x7f6f000cb7e0 2024-09-13T17:09:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6f04d99700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000c5880 con 0x7f6f00072260 2024-09-13T17:09:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6eff7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f0006bdb0 0x7f6f00160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6eff7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f0006bdb0 0x7f6f00160ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53020/0 (socket says 172.21.15.123:53020) 2024-09-13T17:09:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6eff7fe700 1 -- 172.21.15.123:0/1817324196 learned_addr learned my addr 172.21.15.123:0/1817324196 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6efeffd700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f00072260 0x7f6f000c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6efffff700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f000cb7e0 0x7f6f000c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6eff7fe700 1 -- 172.21.15.123:0/1817324196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f00072260 msgr2=0x7f6f000c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6eff7fe700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f00072260 0x7f6f000c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6eff7fe700 1 -- 172.21.15.123:0/1817324196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f000cb7e0 msgr2=0x7f6f000c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6eff7fe700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f000cb7e0 0x7f6f000c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6eff7fe700 1 -- 172.21.15.123:0/1817324196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef4009570 con 0x7f6f0006bdb0 2024-09-13T17:09:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6efffff700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f000cb7e0 0x7f6f000c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.742+0000 7f6eff7fe700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f0006bdb0 0x7f6f00160ef0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000c540 tx=0x7f6ef000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.746+0000 7f6ee7fff700 1 -- 172.21.15.123:0/1817324196 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef00052d0 con 0x7f6f0006bdb0 2024-09-13T17:09:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.746+0000 7f6ee7fff700 1 -- 172.21.15.123:0/1817324196 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef0005450 con 0x7f6f0006bdb0 2024-09-13T17:09:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.746+0000 7f6f04d99700 1 -- 172.21.15.123:0/1817324196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f000c5b60 con 0x7f6f0006bdb0 2024-09-13T17:09:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.746+0000 7f6ee7fff700 1 -- 172.21.15.123:0/1817324196 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0003900 con 0x7f6f0006bdb0 2024-09-13T17:09:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.746+0000 7f6f04d99700 1 -- 172.21.15.123:0/1817324196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f001f7f90 con 0x7f6f0006bdb0 2024-09-13T17:09:31.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.746+0000 7f6f04d99700 1 -- 172.21.15.123:0/1817324196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f000b05b0 con 0x7f6f0006bdb0 2024-09-13T17:09:31.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.746+0000 7f6ee7fff700 1 -- 172.21.15.123:0/1817324196 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6ef0003a60 con 0x7f6f0006bdb0 2024-09-13T17:09:31.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.746+0000 7f6ee7fff700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6eec066730 0x7f6eec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:31.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.750+0000 7f6efeffd700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6eec066730 0x7f6eec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:31.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.750+0000 7f6ee7fff700 1 -- 172.21.15.123:0/1817324196 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ef0083600 con 0x7f6f0006bdb0 2024-09-13T17:09:31.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.750+0000 7f6efeffd700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6eec066730 0x7f6eec068bf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4000c00 tx=0x7f6ef4008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:31.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.758+0000 7f6ee7fff700 1 -- 172.21.15.123:0/1817324196 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6ef0050a00 con 0x7f6f0006bdb0 2024-09-13T17:09:31.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.930+0000 7f6f04d99700 1 -- 172.21.15.123:0/1817324196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f000c1480 con 0x7f6f0006bdb0 2024-09-13T17:09:31.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.930+0000 7f6ee7fff700 1 -- 172.21.15.123:0/1817324196 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ef0054020 con 0x7f6f0006bdb0 2024-09-13T17:09:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:09:31.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.934+0000 7f6f04d99700 1 -- 172.21.15.123:0/1817324196 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6eec066730 msgr2=0x7f6eec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.934+0000 7f6f04d99700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6eec066730 0x7f6eec068bf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4000c00 tx=0x7f6ef4008030 comp rx=0 tx=0).stop 2024-09-13T17:09:31.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.934+0000 7f6f04d99700 1 -- 172.21.15.123:0/1817324196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f0006bdb0 msgr2=0x7f6f00160ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:31.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.934+0000 7f6f04d99700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f0006bdb0 0x7f6f00160ef0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000c540 tx=0x7f6ef000c900 comp rx=0 tx=0).stop 2024-09-13T17:09:31.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.934+0000 7f6f04d99700 1 -- 172.21.15.123:0/1817324196 shutdown_connections 2024-09-13T17:09:31.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.934+0000 7f6f04d99700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6eec066730 0x7f6eec068bf0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.934+0000 7f6f04d99700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f000cb7e0 0x7f6f000c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.934+0000 7f6f04d99700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f00072260 0x7f6f000c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.934+0000 7f6f04d99700 1 --2- 172.21.15.123:0/1817324196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f0006bdb0 0x7f6f00160ef0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:31.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.934+0000 7f6f04d99700 1 -- 172.21.15.123:0/1817324196 >> 172.21.15.123:0/1817324196 conn(0x7f6f000b01d0 msgr2=0x7f6f000b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:31.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.934+0000 7f6f04d99700 1 -- 172.21.15.123:0/1817324196 shutdown_connections 2024-09-13T17:09:31.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:31.934+0000 7f6f04d99700 1 -- 172.21.15.123:0/1817324196 wait complete. 2024-09-13T17:09:31.951 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:09:32.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a550e9700 1 Processor -- start 2024-09-13T17:09:32.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a550e9700 1 -- start start 2024-09-13T17:09:32.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a550e9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a500afd90 0x7f8a50071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:32.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a550e9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a500b23e0 0x7f8a500b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:32.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a550e9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5015d590 con 0x7f8a5015d1b0 2024-09-13T17:09:32.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a550e9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a500b0270 con 0x7f8a500afd90 2024-09-13T17:09:32.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a550e9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b2db0 con 0x7f8a500b23e0 2024-09-13T17:09:32.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a477fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a500afd90 0x7f8a50071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:32.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a477fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a500afd90 0x7f8a50071f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46312/0 (socket says 172.21.15.123:46312) 2024-09-13T17:09:32.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a477fe700 1 -- 172.21.15.123:0/3429544951 learned_addr learned my addr 172.21.15.123:0/3429544951 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:32.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a548e8700 1 --2- 172.21.15.123:0/3429544951 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a500b23e0 0x7f8a500b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:32.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a477fe700 1 -- 172.21.15.123:0/3429544951 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a500b23e0 msgr2=0x7f8a500b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:32.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a477fe700 1 --2- 172.21.15.123:0/3429544951 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a500b23e0 0x7f8a500b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a477fe700 1 -- 172.21.15.123:0/3429544951 >> v1:172.21.15.153:6789/0 conn(0x7f8a5015d1b0 legacy=0x7f8a5015e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:32.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a477fe700 1 -- 172.21.15.123:0/3429544951 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a500ce7c0 con 0x7f8a500afd90 2024-09-13T17:09:32.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a548e8700 1 --2- 172.21.15.123:0/3429544951 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a500b23e0 0x7f8a500b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:32.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.058+0000 7f8a477fe700 1 --2- 172.21.15.123:0/3429544951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a500afd90 0x7f8a50071f50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8a500cd6d0 tx=0x7f8a38009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61994e00a93c7a00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:32.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a4f7fe700 1 -- 172.21.15.123:0/3429544951 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38005e50 con 0x7f8a500afd90 2024-09-13T17:09:32.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a4f7fe700 1 -- 172.21.15.123:0/3429544951 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a38009e60 con 0x7f8a500afd90 2024-09-13T17:09:32.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a4f7fe700 1 -- 172.21.15.123:0/3429544951 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3800b7f0 con 0x7f8a500afd90 2024-09-13T17:09:32.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 -- 172.21.15.123:0/3429544951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a500afd90 msgr2=0x7f8a50071f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:32.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 --2- 172.21.15.123:0/3429544951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a500afd90 0x7f8a50071f50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8a500cd6d0 tx=0x7f8a38009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:32.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 -- 172.21.15.123:0/3429544951 shutdown_connections 2024-09-13T17:09:32.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 --2- 172.21.15.123:0/3429544951 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a500b23e0 0x7f8a500b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 --2- 172.21.15.123:0/3429544951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a500afd90 0x7f8a50071f50 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 -- 172.21.15.123:0/3429544951 >> 172.21.15.123:0/3429544951 conn(0x7f8a50066150 msgr2=0x7f8a50066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:32.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 -- 172.21.15.123:0/3429544951 shutdown_connections 2024-09-13T17:09:32.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 -- 172.21.15.123:0/3429544951 wait complete. 2024-09-13T17:09:32.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 Processor -- start 2024-09-13T17:09:32.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 -- start start 2024-09-13T17:09:32.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a500afd90 0x7f8a501f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:32.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a500b23e0 0x7f8a500ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:32.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a5015d1b0 0x7f8a5014cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:32.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5014d260 con 0x7f8a500afd90 2024-09-13T17:09:32.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500cac30 con 0x7f8a5015d1b0 2024-09-13T17:09:32.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a550e9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500ae040 con 0x7f8a500b23e0 2024-09-13T17:09:32.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a4ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a500afd90 0x7f8a501f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:32.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a4ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a500afd90 0x7f8a501f2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46328/0 (socket says 172.21.15.123:46328) 2024-09-13T17:09:32.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a548e8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a5015d1b0 0x7f8a5014cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:32.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a477fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a500b23e0 0x7f8a500ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:32.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a4ffff700 1 -- 172.21.15.123:0/3420982879 learned_addr learned my addr 172.21.15.123:0/3420982879 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:32.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a4ffff700 1 -- 172.21.15.123:0/3420982879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a500b23e0 msgr2=0x7f8a500ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:32.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a4ffff700 1 --2- 172.21.15.123:0/3420982879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a500b23e0 0x7f8a500ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a4ffff700 1 -- 172.21.15.123:0/3420982879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a5015d1b0 msgr2=0x7f8a5014cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:32.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.062+0000 7f8a4ffff700 1 --2- 172.21.15.123:0/3420982879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a5015d1b0 0x7f8a5014cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.066+0000 7f8a4ffff700 1 -- 172.21.15.123:0/3420982879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a38009520 con 0x7f8a500afd90 2024-09-13T17:09:32.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.066+0000 7f8a4ffff700 1 --2- 172.21.15.123:0/3420982879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a500afd90 0x7f8a501f2fa0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000b4a0 tx=0x7f8a4000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:32.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.066+0000 7f8a4d7fa700 1 -- 172.21.15.123:0/3420982879 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40011830 con 0x7f8a500afd90 2024-09-13T17:09:32.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.066+0000 7f8a4d7fa700 1 -- 172.21.15.123:0/3420982879 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a40011990 con 0x7f8a500afd90 2024-09-13T17:09:32.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.066+0000 7f8a4d7fa700 1 -- 172.21.15.123:0/3420982879 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40011d40 con 0x7f8a500afd90 2024-09-13T17:09:32.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.066+0000 7f8a550e9700 1 -- 172.21.15.123:0/3420982879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a500ae320 con 0x7f8a500afd90 2024-09-13T17:09:32.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.066+0000 7f8a550e9700 1 -- 172.21.15.123:0/3420982879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a500ae8e0 con 0x7f8a500afd90 2024-09-13T17:09:32.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.066+0000 7f8a550e9700 1 -- 172.21.15.123:0/3420982879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a500aead0 con 0x7f8a500afd90 2024-09-13T17:09:32.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.066+0000 7f8a4d7fa700 1 -- 172.21.15.123:0/3420982879 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8a4001a400 con 0x7f8a500afd90 2024-09-13T17:09:32.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.070+0000 7f8a4d7fa700 1 --2- 172.21.15.123:0/3420982879 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8a30066730 0x7f8a30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:32.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.070+0000 7f8a4d7fa700 1 -- 172.21.15.123:0/3420982879 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8a40083db0 con 0x7f8a500afd90 2024-09-13T17:09:32.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.070+0000 7f8a477fe700 1 --2- 172.21.15.123:0/3420982879 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8a30066730 0x7f8a30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:32.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.070+0000 7f8a477fe700 1 --2- 172.21.15.123:0/3420982879 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8a30066730 0x7f8a30068bf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8a500b01a0 tx=0x7f8a38008070 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:32.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.074+0000 7f8a4d7fa700 1 -- 172.21.15.123:0/3420982879 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8a400510a0 con 0x7f8a500afd90 2024-09-13T17:09:32.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.242+0000 7f8a550e9700 1 -- 172.21.15.123:0/3420982879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a500d0500 con 0x7f8a500afd90 2024-09-13T17:09:32.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.242+0000 7f8a4d7fa700 1 -- 172.21.15.123:0/3420982879 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8a400150a0 con 0x7f8a500afd90 2024-09-13T17:09:32.248 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:09:32.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.246+0000 7f8a550e9700 1 -- 172.21.15.123:0/3420982879 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8a30066730 msgr2=0x7f8a30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:32.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.246+0000 7f8a550e9700 1 --2- 172.21.15.123:0/3420982879 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8a30066730 0x7f8a30068bf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8a500b01a0 tx=0x7f8a38008070 comp rx=0 tx=0).stop 2024-09-13T17:09:32.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.246+0000 7f8a550e9700 1 -- 172.21.15.123:0/3420982879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a500afd90 msgr2=0x7f8a501f2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:32.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.246+0000 7f8a550e9700 1 --2- 172.21.15.123:0/3420982879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a500afd90 0x7f8a501f2fa0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000b4a0 tx=0x7f8a4000b7b0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.246+0000 7f8a550e9700 1 -- 172.21.15.123:0/3420982879 shutdown_connections 2024-09-13T17:09:32.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.246+0000 7f8a550e9700 1 --2- 172.21.15.123:0/3420982879 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8a30066730 0x7f8a30068bf0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.246+0000 7f8a550e9700 1 --2- 172.21.15.123:0/3420982879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a5015d1b0 0x7f8a5014cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.246+0000 7f8a550e9700 1 --2- 172.21.15.123:0/3420982879 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8a500b23e0 0x7f8a500ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.246+0000 7f8a550e9700 1 --2- 172.21.15.123:0/3420982879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a500afd90 0x7f8a501f2fa0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.246+0000 7f8a550e9700 1 -- 172.21.15.123:0/3420982879 >> 172.21.15.123:0/3420982879 conn(0x7f8a50066150 msgr2=0x7f8a5015c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:32.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.246+0000 7f8a550e9700 1 -- 172.21.15.123:0/3420982879 shutdown_connections 2024-09-13T17:09:32.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.246+0000 7f8a550e9700 1 -- 172.21.15.123:0/3420982879 wait complete. 2024-09-13T17:09:32.269 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:09:32.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed45931700 1 Processor -- start 2024-09-13T17:09:32.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed45931700 1 -- start start 2024-09-13T17:09:32.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed45931700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fed40072000 0x7fed400ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:32.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed45931700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed400cd140 0x7fed4006cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:32.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed45931700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4015ba60 con 0x7fed40144230 2024-09-13T17:09:32.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed45931700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4015b130 con 0x7fed400cd140 2024-09-13T17:09:32.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed45931700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4015b410 con 0x7fed40072000 2024-09-13T17:09:32.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed4492f700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fed40144230 0x7fed400718f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36422/0 (socket says 172.21.15.123:36422) 2024-09-13T17:09:32.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed4492f700 1 -- 172.21.15.123:0/3180484072 learned_addr learned my addr 172.21.15.123:0/3180484072 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:32.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed45130700 1 --2- 172.21.15.123:0/3180484072 >> v2:172.21.15.123:3300/0 conn(0x7fed400cd140 0x7fed4006cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:32.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed3ffff700 1 --2- 172.21.15.123:0/3180484072 >> v2:172.21.15.153:3300/0 conn(0x7fed40072000 0x7fed400ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:32.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed3f7fe700 1 -- 172.21.15.123:0/3180484072 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110137671 0 0) 0x7fed4015ba60 con 0x7fed40144230 2024-09-13T17:09:32.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed3f7fe700 1 -- 172.21.15.123:0/3180484072 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed2c0035d0 con 0x7fed40144230 2024-09-13T17:09:32.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed3ffff700 1 -- 172.21.15.123:0/3180484072 >> v2:172.21.15.123:3300/0 conn(0x7fed400cd140 msgr2=0x7fed4006cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:32.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed3ffff700 1 --2- 172.21.15.123:0/3180484072 >> v2:172.21.15.123:3300/0 conn(0x7fed400cd140 0x7fed4006cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed3ffff700 1 -- 172.21.15.123:0/3180484072 >> v1:172.21.15.123:6789/0 conn(0x7fed40144230 legacy=0x7fed400718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:32.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed3ffff700 1 -- 172.21.15.123:0/3180484072 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4015b6f0 con 0x7fed40072000 2024-09-13T17:09:32.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.378+0000 7fed45130700 1 --2- 172.21.15.123:0/3180484072 >> v2:172.21.15.123:3300/0 conn(0x7fed400cd140 0x7fed4006cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:32.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.382+0000 7fed3ffff700 1 --2- 172.21.15.123:0/3180484072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed40072000 0x7fed400ccc00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fed30009d90 tx=0x7fed3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=577272b3d7c8a454 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:32.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.382+0000 7fed3f7fe700 1 -- 172.21.15.123:0/3180484072 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3000e070 con 0x7fed40072000 2024-09-13T17:09:32.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.382+0000 7fed3f7fe700 1 -- 172.21.15.123:0/3180484072 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3000bae0 con 0x7fed40072000 2024-09-13T17:09:32.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.382+0000 7fed3f7fe700 1 -- 172.21.15.123:0/3180484072 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3000be90 con 0x7fed40072000 2024-09-13T17:09:32.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.382+0000 7fed45931700 1 -- 172.21.15.123:0/3180484072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed40072000 msgr2=0x7fed400ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:32.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.382+0000 7fed45931700 1 --2- 172.21.15.123:0/3180484072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed40072000 0x7fed400ccc00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fed30009d90 tx=0x7fed3000b330 comp rx=0 tx=0).stop 2024-09-13T17:09:32.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.382+0000 7fed45931700 1 -- 172.21.15.123:0/3180484072 shutdown_connections 2024-09-13T17:09:32.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.382+0000 7fed45931700 1 --2- 172.21.15.123:0/3180484072 >> v2:172.21.15.123:3300/0 conn(0x7fed400cd140 0x7fed4006cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.382+0000 7fed45931700 1 --2- 172.21.15.123:0/3180484072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed40072000 0x7fed400ccc00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.382+0000 7fed45931700 1 -- 172.21.15.123:0/3180484072 >> 172.21.15.123:0/3180484072 conn(0x7fed400735c0 msgr2=0x7fed4006a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:32.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.382+0000 7fed45931700 1 -- 172.21.15.123:0/3180484072 shutdown_connections 2024-09-13T17:09:32.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.382+0000 7fed45931700 1 -- 172.21.15.123:0/3180484072 wait complete. 2024-09-13T17:09:32.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.382+0000 7fed45931700 1 Processor -- start 2024-09-13T17:09:32.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.382+0000 7fed45931700 1 -- start start 2024-09-13T17:09:32.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed45931700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed40072000 0x7fed401efe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:32.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed45931700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed400cd140 0x7fed401554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:32.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed45931700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed40144230 0x7fed40155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:32.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed45931700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4015a880 con 0x7fed400cd140 2024-09-13T17:09:32.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed45931700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed401f03d0 con 0x7fed40144230 2024-09-13T17:09:32.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed45931700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed40159c70 con 0x7fed40072000 2024-09-13T17:09:32.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed3ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed400cd140 0x7fed401554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:32.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed3ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed400cd140 0x7fed401554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46340/0 (socket says 172.21.15.123:46340) 2024-09-13T17:09:32.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed3ffff700 1 -- 172.21.15.123:0/2012857834 learned_addr learned my addr 172.21.15.123:0/2012857834 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:32.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed45130700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed40144230 0x7fed40155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:32.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed4492f700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed40072000 0x7fed401efe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:32.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed3ffff700 1 -- 172.21.15.123:0/2012857834 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed40072000 msgr2=0x7fed401efe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:32.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed3ffff700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed40072000 0x7fed401efe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed3ffff700 1 -- 172.21.15.123:0/2012857834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed40144230 msgr2=0x7fed40155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:32.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed3ffff700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed40144230 0x7fed40155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed3ffff700 1 -- 172.21.15.123:0/2012857834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed380094b0 con 0x7fed400cd140 2024-09-13T17:09:32.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed4492f700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed40072000 0x7fed401efe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:32.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed3ffff700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed400cd140 0x7fed401554c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fed3000b370 tx=0x7fed30004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:32.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed3d7fa700 1 -- 172.21.15.123:0/2012857834 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed30004680 con 0x7fed400cd140 2024-09-13T17:09:32.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed45931700 1 -- 172.21.15.123:0/2012857834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed30009a70 con 0x7fed400cd140 2024-09-13T17:09:32.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed3d7fa700 1 -- 172.21.15.123:0/2012857834 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed30020070 con 0x7fed400cd140 2024-09-13T17:09:32.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed45931700 1 -- 172.21.15.123:0/2012857834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4015a230 con 0x7fed400cd140 2024-09-13T17:09:32.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed3d7fa700 1 -- 172.21.15.123:0/2012857834 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed30027480 con 0x7fed400cd140 2024-09-13T17:09:32.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.386+0000 7fed45931700 1 -- 172.21.15.123:0/2012857834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed401f05c0 con 0x7fed400cd140 2024-09-13T17:09:32.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.390+0000 7fed3d7fa700 1 -- 172.21.15.123:0/2012857834 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fed300275e0 con 0x7fed400cd140 2024-09-13T17:09:32.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.390+0000 7fed3d7fa700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed20066730 0x7fed20068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:32.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.390+0000 7fed3d7fa700 1 -- 172.21.15.123:0/2012857834 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fed30022070 con 0x7fed400cd140 2024-09-13T17:09:32.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.390+0000 7fed4492f700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed20066730 0x7fed20068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:32.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.390+0000 7fed4492f700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed20066730 0x7fed20068bf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fed280011e0 tx=0x7fed28009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:32.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.402+0000 7fed3d7fa700 1 -- 172.21.15.123:0/2012857834 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fed401f05c0 con 0x7fed400cd140 2024-09-13T17:09:32.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.582+0000 7fed45931700 1 -- 172.21.15.123:0/2012857834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fed401f05c0 con 0x7fed400cd140 2024-09-13T17:09:32.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.582+0000 7fed3d7fa700 1 -- 172.21.15.123:0/2012857834 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v73) v1 ==== 80+0+0 (secure 0 0 0) 0x7fed401f05c0 con 0x7fed400cd140 2024-09-13T17:09:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.582+0000 7fed45931700 1 -- 172.21.15.123:0/2012857834 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed20066730 msgr2=0x7fed20068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.582+0000 7fed45931700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed20066730 0x7fed20068bf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fed280011e0 tx=0x7fed28009040 comp rx=0 tx=0).stop 2024-09-13T17:09:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.582+0000 7fed45931700 1 -- 172.21.15.123:0/2012857834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed400cd140 msgr2=0x7fed401554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.582+0000 7fed45931700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed400cd140 0x7fed401554c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fed3000b370 tx=0x7fed30004af0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.582+0000 7fed45931700 1 -- 172.21.15.123:0/2012857834 shutdown_connections 2024-09-13T17:09:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.582+0000 7fed45931700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed20066730 0x7fed20068bf0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.582+0000 7fed45931700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed40144230 0x7fed40155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.582+0000 7fed45931700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed400cd140 0x7fed401554c0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.582+0000 7fed45931700 1 --2- 172.21.15.123:0/2012857834 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed40072000 0x7fed401efe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.582+0000 7fed45931700 1 -- 172.21.15.123:0/2012857834 >> 172.21.15.123:0/2012857834 conn(0x7fed400735c0 msgr2=0x7fed40066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.582+0000 7fed45931700 1 -- 172.21.15.123:0/2012857834 shutdown_connections 2024-09-13T17:09:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:32.582+0000 7fed45931700 1 -- 172.21.15.123:0/2012857834 wait complete. 2024-09-13T17:09:32.590 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:09:32.601 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-09-13T17:09:32.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:32.602 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:32.616 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33347]: fuse finished with error 0 and tester_r 0 2024-09-13T17:09:32.617 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:09:38.719 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:09:38.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:38.719 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:09:38.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:38.728 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-13T17:09:38.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:38.747 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 134217728 ./subdir) 2024-09-13T17:09:38.761 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:09:38.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e2779700 1 Processor -- start 2024-09-13T17:09:38.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e2779700 1 -- start start 2024-09-13T17:09:38.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e2779700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd5dc15a8c0 0x7fd5dc0705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:38.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e2779700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd5dc15b9b0 0x7fd5dc070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:38.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e2779700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5dc0cee80 con 0x7fd5dc0713b0 2024-09-13T17:09:38.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e2779700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5dc071820 con 0x7fd5dc15a8c0 2024-09-13T17:09:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e2779700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5dc0ce270 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e1f78700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd5dc0713b0 0x7fd5dc0cb130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36438/0 (socket says 172.21.15.123:36438) 2024-09-13T17:09:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e1f78700 1 -- 172.21.15.123:0/4160615726 learned_addr learned my addr 172.21.15.123:0/4160615726 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e1777700 1 --2- 172.21.15.123:0/4160615726 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc15a8c0 0x7fd5dc0705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e0f76700 1 --2- 172.21.15.123:0/4160615726 >> v2:172.21.15.153:3300/0 conn(0x7fd5dc15b9b0 0x7fd5dc070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5d3fff700 1 -- 172.21.15.123:0/4160615726 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853858090 0 0) 0x7fd5dc0cee80 con 0x7fd5dc0713b0 2024-09-13T17:09:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5d3fff700 1 -- 172.21.15.123:0/4160615726 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5c80035d0 con 0x7fd5dc0713b0 2024-09-13T17:09:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e0f76700 1 -- 172.21.15.123:0/4160615726 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc15a8c0 msgr2=0x7fd5dc0705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e0f76700 1 --2- 172.21.15.123:0/4160615726 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc15a8c0 0x7fd5dc0705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e0f76700 1 -- 172.21.15.123:0/4160615726 >> v1:172.21.15.123:6789/0 conn(0x7fd5dc0713b0 legacy=0x7fd5dc0cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:38.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.874+0000 7fd5e0f76700 1 -- 172.21.15.123:0/4160615726 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc0ce550 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e0f76700 1 --2- 172.21.15.123:0/4160615726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5dc15b9b0 0x7fd5dc070e70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0cdf90 tx=0x7fd5cc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c42f6433f5fcecc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:38.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5d3fff700 1 -- 172.21.15.123:0/4160615726 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc011830 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5d3fff700 1 -- 172.21.15.123:0/4160615726 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc011990 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5d3fff700 1 -- 172.21.15.123:0/4160615726 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc011d20 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 -- 172.21.15.123:0/4160615726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5dc15b9b0 msgr2=0x7fd5dc070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:38.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 --2- 172.21.15.123:0/4160615726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5dc15b9b0 0x7fd5dc070e70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0cdf90 tx=0x7fd5cc009b30 comp rx=0 tx=0).stop 2024-09-13T17:09:38.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 -- 172.21.15.123:0/4160615726 shutdown_connections 2024-09-13T17:09:38.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 --2- 172.21.15.123:0/4160615726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5dc15b9b0 0x7fd5dc070e70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 --2- 172.21.15.123:0/4160615726 >> v2:172.21.15.123:3300/0 conn(0x7fd5dc15a8c0 0x7fd5dc0705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 -- 172.21.15.123:0/4160615726 >> 172.21.15.123:0/4160615726 conn(0x7fd5dc066150 msgr2=0x7fd5dc066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 -- 172.21.15.123:0/4160615726 shutdown_connections 2024-09-13T17:09:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 -- 172.21.15.123:0/4160615726 wait complete. 2024-09-13T17:09:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 Processor -- start 2024-09-13T17:09:38.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 -- start start 2024-09-13T17:09:38.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5dc0713b0 0x7fd5dc143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:38.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5dc15a8c0 0x7fd5dc158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:38.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5dc15b9b0 0x7fd5dc158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0b2c20 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc143970 con 0x7fd5dc0713b0 2024-09-13T17:09:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e2779700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc15e2e0 con 0x7fd5dc15a8c0 2024-09-13T17:09:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e1f78700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5dc15b9b0 0x7fd5dc158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e1f78700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5dc15b9b0 0x7fd5dc158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46366/0 (socket says 172.21.15.123:46366) 2024-09-13T17:09:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e1f78700 1 -- 172.21.15.123:0/277260555 learned_addr learned my addr 172.21.15.123:0/277260555 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e1777700 1 --2- 172.21.15.123:0/277260555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5dc0713b0 0x7fd5dc143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:38.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.878+0000 7fd5e0f76700 1 --2- 172.21.15.123:0/277260555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5dc15a8c0 0x7fd5dc158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5e1f78700 1 -- 172.21.15.123:0/277260555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5dc15a8c0 msgr2=0x7fd5dc158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5e1f78700 1 --2- 172.21.15.123:0/277260555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5dc15a8c0 0x7fd5dc158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5e1f78700 1 -- 172.21.15.123:0/277260555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5dc0713b0 msgr2=0x7fd5dc143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5e1f78700 1 --2- 172.21.15.123:0/277260555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5dc0713b0 0x7fd5dc143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5e1f78700 1 -- 172.21.15.123:0/277260555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc0094b0 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5e1f78700 1 --2- 172.21.15.123:0/277260555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5dc15b9b0 0x7fd5dc158ea0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400cb40 tx=0x7fd5d400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5d1ffb700 1 -- 172.21.15.123:0/277260555 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4007500 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5d1ffb700 1 -- 172.21.15.123:0/277260555 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d4007660 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5e2779700 1 -- 172.21.15.123:0/277260555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5dc0b3040 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5d1ffb700 1 -- 172.21.15.123:0/277260555 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d40079f0 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5e2779700 1 -- 172.21.15.123:0/277260555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5dc0b2280 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5e2779700 1 -- 172.21.15.123:0/277260555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5dc0677f0 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5d1ffb700 1 -- 172.21.15.123:0/277260555 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd5d401b3b0 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5d1ffb700 1 --2- 172.21.15.123:0/277260555 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd5c0066730 0x7fd5c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:38.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.882+0000 7fd5d1ffb700 1 -- 172.21.15.123:0/277260555 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd5d4083b80 con 0x7fd5dc15b9b0 2024-09-13T17:09:38.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.886+0000 7fd5e1777700 1 --2- 172.21.15.123:0/277260555 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd5c0066730 0x7fd5c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:38.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.886+0000 7fd5e1777700 1 --2- 172.21.15.123:0/277260555 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd5c0066730 0x7fd5c0068bf0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009bf0 tx=0x7fd5d8009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:38.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:38.890+0000 7fd5d1ffb700 1 -- 172.21.15.123:0/277260555 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd5d4050f00 con 0x7fd5dc15b9b0 2024-09-13T17:09:39.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:39.098+0000 7fd5e2779700 1 -- 172.21.15.123:0/277260555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd5dc0b2d60 con 0x7fd5dc15b9b0 2024-09-13T17:09:39.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:39.098+0000 7fd5d1ffb700 1 -- 172.21.15.123:0/277260555 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd5d4017020 con 0x7fd5dc15b9b0 2024-09-13T17:09:39.106 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:09:39.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:39.102+0000 7fd5e2779700 1 -- 172.21.15.123:0/277260555 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd5c0066730 msgr2=0x7fd5c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:39.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:39.102+0000 7fd5e2779700 1 --2- 172.21.15.123:0/277260555 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd5c0066730 0x7fd5c0068bf0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009bf0 tx=0x7fd5d8009240 comp rx=0 tx=0).stop 2024-09-13T17:09:39.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:39.102+0000 7fd5e2779700 1 -- 172.21.15.123:0/277260555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5dc15b9b0 msgr2=0x7fd5dc158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:39.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:39.102+0000 7fd5e2779700 1 --2- 172.21.15.123:0/277260555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5dc15b9b0 0x7fd5dc158ea0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400cb40 tx=0x7fd5d400cb70 comp rx=0 tx=0).stop 2024-09-13T17:09:39.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:39.102+0000 7fd5e2779700 1 -- 172.21.15.123:0/277260555 shutdown_connections 2024-09-13T17:09:39.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:39.102+0000 7fd5e2779700 1 --2- 172.21.15.123:0/277260555 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd5c0066730 0x7fd5c0068bf0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:39.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:39.102+0000 7fd5e2779700 1 --2- 172.21.15.123:0/277260555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5dc15b9b0 0x7fd5dc158ea0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:39.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:39.102+0000 7fd5e2779700 1 --2- 172.21.15.123:0/277260555 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5dc15a8c0 0x7fd5dc158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:39.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:39.102+0000 7fd5e2779700 1 --2- 172.21.15.123:0/277260555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5dc0713b0 0x7fd5dc143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:39.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:39.102+0000 7fd5e2779700 1 -- 172.21.15.123:0/277260555 >> 172.21.15.123:0/277260555 conn(0x7fd5dc066150 msgr2=0x7fd5dc0ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:39.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:39.102+0000 7fd5e2779700 1 -- 172.21.15.123:0/277260555 shutdown_connections 2024-09-13T17:09:39.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:39.102+0000 7fd5e2779700 1 -- 172.21.15.123:0/277260555 wait complete. 2024-09-13T17:09:39.118 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:09:39.118 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:09:39.118 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-13T17:09:39.118 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:09:39.118 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:39.118 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:09:39.119 INFO:tasks.cephfs.mount:self.cephfs_mntpt = /subdir 2024-09-13T17:09:39.119 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:09:39.119 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:09:39.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:39.119 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-13T17:09:39.127 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:09:39.127 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:09:39.127 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:09:39.127 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:39.128 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-13T17:09:39.128 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:39.128 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:09:39.128 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:39.128 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:09:39.128 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:39.128 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:09:39.128 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:39.128 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:09:39.128 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:39.128 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:09:39.128 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42432sec preferred_lft 42432sec 2024-09-13T17:09:39.128 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-09-13T17:09:39.129 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:39.129 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:09:39.129 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:73:6c:03:01 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:39.129 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:09:39.129 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:39.129 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:09:39.129 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:09:39.129 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:09:39.129 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:39.129 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::f82f:21ff:fe0c:65de/64 scope link 2024-09-13T17:09:39.129 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:39.129 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:09:39.129 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:09:39.129 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::346e:9ff:fe92:ffa0/64 scope link 2024-09-13T17:09:39.130 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:39.130 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:09:39.130 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether c6:e2:c1:7b:16:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:09:39.130 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::c4e2:c1ff:fe7b:1657/64 scope link 2024-09-13T17:09:39.130 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:09:39.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:39.130 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:09:39.183 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-13T17:09:39.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:39.185 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-13T17:09:39.194 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-13T17:09:39.194 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:09:39.195 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:09:39.195 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:09:39.195 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:09:39.195 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:09:39.195 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:09:39.195 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:09:39.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:39.195 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:09:39.195 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:09:39.195 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:09:39.195 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:09:39.196 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:09:39.196 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:09:39.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:39.234 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-13T17:09:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:09:39.283 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:09:39.283 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:09:39.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:39.284 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-09-13T17:09:39.300 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:09:39.300 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:09:39.300 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:39.308 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:09:39.309 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:09:39.309 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:39.358 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:09:39.375 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:09:39.376 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:09:39.385 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:09:39.386 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:09:39.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:39.387 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:09:39.394 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:09:39.394 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_mountpoint=/subdir) 2024-09-13T17:09:39.438 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:09:39.455 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:09:39.456 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:09:39.464 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:09:39.466 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:09:39.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:39.466 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:09:39.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:2024-09-13T17:09:39.521+0000 7f44b88c0640 -1 init, newargv = 0x55ddce436740 newargc=15 2024-09-13T17:09:39.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33436]: starting ceph client 2024-09-13T17:09:39.537 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33436]: starting fuse 2024-09-13T17:09:40.620 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:09:40.639 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:09:40.639 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:09:40.649 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:09:40.650 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:09:40.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:40.651 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:09:40.698 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-09-13T17:09:40.699 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:09:40.699 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:09:40.699 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-09-13T17:09:40.699 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-09-13T17:09:40.699 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-13T17:09:40.699 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:09:40.700 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-09-13T17:09:40.701 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-09-13T17:09:40.701 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-09-13T17:09:40.701 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:09:40.701 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:09:40.701 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.1")) 2024-09-13T17:09:40.701 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-13T17:09:40.786 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.1.33436.asok 2024-09-13T17:09:40.970 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33436.asok 2024-09-13T17:09:40.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:40.970 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33436.asok status 2024-09-13T17:09:41.070 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-13T17:09:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-09-13T17:09:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:09:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:09:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "1", 2024-09-13T17:09:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-09-13T17:09:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:09:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "33436", 2024-09-13T17:09:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/subdir" 2024-09-13T17:09:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:09:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-09-13T17:09:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-09-13T17:09:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 6771, 2024-09-13T17:09:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-09-13T17:09:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-09-13T17:09:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-09-13T17:09:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 6771 2024-09-13T17:09:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:09:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:09:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:09:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:09:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 3335048470 2024-09-13T17:09:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-13T17:09:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:09:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:09:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:09:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:09:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 3335048470 2024-09-13T17:09:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:09:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.6771 192.168.0.1:0/3335048470", 2024-09-13T17:09:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.1:0/3335048470", 2024-09-13T17:09:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 2, 2024-09-13T17:09:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 35, 2024-09-13T17:09:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 74, 2024-09-13T17:09:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:09:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-09-13T17:09:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-09-13T17:09:41.074 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-13T17:09:41.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:41.085 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-09-13T17:09:41.085 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:41.092 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-09-13T17:09:41.092 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:41.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:41.092 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:41.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:41.111 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec df -B1 .) 2024-09-13T17:09:41.186 INFO:teuthology.orchestra.run.smithi153.stdout:Filesystem 1B-blocks Used Available Use% Mounted on 2024-09-13T17:09:41.186 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-fuse 134217728 0 134217728 0% /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:41.187 WARNING:tasks.cephfs.mount:['Filesystem 1B-blocks Used Available Use% Mounted on', 'ceph-fuse 134217728 0 134217728 0% /home/ubuntu/cephtest/mnt.1'] 2024-09-13T17:09:41.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:41.188 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 268435456 ./subdir) 2024-09-13T17:09:41.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:41.209 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec df -B1 .) 2024-09-13T17:09:41.221 INFO:teuthology.orchestra.run.smithi153.stdout:Filesystem 1B-blocks Used Available Use% Mounted on 2024-09-13T17:09:41.221 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-fuse 268435456 0 268435456 0% /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:41.222 WARNING:tasks.cephfs.mount:['Filesystem 1B-blocks Used Available Use% Mounted on', 'ceph-fuse 268435456 0 268435456 0% /home/ubuntu/cephtest/mnt.1'] 2024-09-13T17:09:41.222 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:09:41.222 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:09:41.271 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:09:41.292 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:09:41.292 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:09:41.292 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:41.300 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:41.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 Processor -- start 2024-09-13T17:09:41.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 -- start start 2024-09-13T17:09:41.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f096c15e920 0x7f096c0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:41.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f096c0cb020 0x7f096c161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:41.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f096c162550 con 0x7f096c15ed00 2024-09-13T17:09:41.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f096c0cd690 con 0x7f096c15e920 2024-09-13T17:09:41.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096c161f90 con 0x7f096c0cb020 2024-09-13T17:09:41.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096b7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f096c15ed00 0x7f096c0cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36452/0 (socket says 172.21.15.123:36452) 2024-09-13T17:09:41.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096b7fe700 1 -- 172.21.15.123:0/1426096095 learned_addr learned my addr 172.21.15.123:0/1426096095 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:41.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096a7fc700 1 --2- 172.21.15.123:0/1426096095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f096c0cb020 0x7f096c161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:41.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096affd700 1 --2- 172.21.15.123:0/1426096095 >> v2:172.21.15.153:3300/0 conn(0x7f096c15e920 0x7f096c0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:41.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f0969ffb700 1 -- 172.21.15.123:0/1426096095 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924486437 0 0) 0x7f096c162550 con 0x7f096c15ed00 2024-09-13T17:09:41.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f0969ffb700 1 -- 172.21.15.123:0/1426096095 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09540035d0 con 0x7f096c15ed00 2024-09-13T17:09:41.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096a7fc700 1 -- 172.21.15.123:0/1426096095 >> v2:172.21.15.153:3300/0 conn(0x7f096c15e920 msgr2=0x7f096c0caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:41.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096a7fc700 1 --2- 172.21.15.123:0/1426096095 >> v2:172.21.15.153:3300/0 conn(0x7f096c15e920 0x7f096c0caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096a7fc700 1 -- 172.21.15.123:0/1426096095 >> v1:172.21.15.123:6789/0 conn(0x7f096c15ed00 legacy=0x7f096c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:41.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096a7fc700 1 -- 172.21.15.123:0/1426096095 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c162270 con 0x7f096c0cb020 2024-09-13T17:09:41.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096affd700 1 --2- 172.21.15.123:0/1426096095 >> v2:172.21.15.153:3300/0 conn(0x7f096c15e920 0x7f096c0caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:41.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096a7fc700 1 --2- 172.21.15.123:0/1426096095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f096c0cb020 0x7f096c161540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0960009850 tx=0x7f0960009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faab7c4cb6312885 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:41.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f0969ffb700 1 -- 172.21.15.123:0/1426096095 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960011830 con 0x7f096c0cb020 2024-09-13T17:09:41.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f0969ffb700 1 -- 172.21.15.123:0/1426096095 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0960011990 con 0x7f096c0cb020 2024-09-13T17:09:41.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f0969ffb700 1 -- 172.21.15.123:0/1426096095 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960011d40 con 0x7f096c0cb020 2024-09-13T17:09:41.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 -- 172.21.15.123:0/1426096095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f096c0cb020 msgr2=0x7f096c161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:41.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 --2- 172.21.15.123:0/1426096095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f096c0cb020 0x7f096c161540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0960009850 tx=0x7f0960009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:41.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 -- 172.21.15.123:0/1426096095 shutdown_connections 2024-09-13T17:09:41.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 --2- 172.21.15.123:0/1426096095 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f096c0cb020 0x7f096c161540 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 --2- 172.21.15.123:0/1426096095 >> v2:172.21.15.153:3300/0 conn(0x7f096c15e920 0x7f096c0caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 -- 172.21.15.123:0/1426096095 >> 172.21.15.123:0/1426096095 conn(0x7f096c066150 msgr2=0x7f096c066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:41.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 -- 172.21.15.123:0/1426096095 shutdown_connections 2024-09-13T17:09:41.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.418+0000 7f096bfff700 1 -- 172.21.15.123:0/1426096095 wait complete. 2024-09-13T17:09:41.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096bfff700 1 Processor -- start 2024-09-13T17:09:41.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096bfff700 1 -- start start 2024-09-13T17:09:41.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f096c0cb020 0x7f096c0c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:41.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c15e920 0x7f096c157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:41.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f096c15ed00 0x7f096c159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:41.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096bfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096c1562a0 con 0x7f096c15e920 2024-09-13T17:09:41.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096bfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096c159760 con 0x7f096c15ed00 2024-09-13T17:09:41.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096c158180 con 0x7f096c0cb020 2024-09-13T17:09:41.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c15e920 0x7f096c157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:41.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c15e920 0x7f096c157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46376/0 (socket says 172.21.15.123:46376) 2024-09-13T17:09:41.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096a7fc700 1 -- 172.21.15.123:0/68494360 learned_addr learned my addr 172.21.15.123:0/68494360 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:41.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096affd700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f096c0cb020 0x7f096c0c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:41.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096b7fe700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f096c15ed00 0x7f096c159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:41.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096a7fc700 1 -- 172.21.15.123:0/68494360 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f096c0cb020 msgr2=0x7f096c0c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:41.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096a7fc700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f096c0cb020 0x7f096c0c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096a7fc700 1 -- 172.21.15.123:0/68494360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f096c15ed00 msgr2=0x7f096c159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:41.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096a7fc700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f096c15ed00 0x7f096c159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096a7fc700 1 -- 172.21.15.123:0/68494360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c009a70 con 0x7f096c15e920 2024-09-13T17:09:41.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096affd700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f096c0cb020 0x7f096c0c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:41.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096a7fc700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c15e920 0x7f096c157ac0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f09600090b0 tx=0x7f0960004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:41.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f09537fe700 1 -- 172.21.15.123:0/68494360 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960004480 con 0x7f096c15e920 2024-09-13T17:09:41.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f09537fe700 1 -- 172.21.15.123:0/68494360 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096001f070 con 0x7f096c15e920 2024-09-13T17:09:41.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f096bfff700 1 -- 172.21.15.123:0/68494360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09600094b0 con 0x7f096c15e920 2024-09-13T17:09:41.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.422+0000 7f09537fe700 1 -- 172.21.15.123:0/68494360 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960003900 con 0x7f096c15e920 2024-09-13T17:09:41.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.426+0000 7f096bfff700 1 -- 172.21.15.123:0/68494360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f096c158740 con 0x7f096c15e920 2024-09-13T17:09:41.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.426+0000 7f096bfff700 1 -- 172.21.15.123:0/68494360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f096c0677f0 con 0x7f096c15e920 2024-09-13T17:09:41.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.426+0000 7f09537fe700 1 -- 172.21.15.123:0/68494360 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0960021030 con 0x7f096c15e920 2024-09-13T17:09:41.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.426+0000 7f09537fe700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0958066730 0x7f0958068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:41.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.426+0000 7f096affd700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0958066730 0x7f0958068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:41.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.426+0000 7f09537fe700 1 -- 172.21.15.123:0/68494360 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0960085500 con 0x7f096c15e920 2024-09-13T17:09:41.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.430+0000 7f096affd700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0958066730 0x7f0958068bf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f096c071e50 tx=0x7f095c00b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:41.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.434+0000 7f09537fe700 1 -- 172.21.15.123:0/68494360 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0960052900 con 0x7f096c15e920 2024-09-13T17:09:41.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.610+0000 7f096bfff700 1 -- 172.21.15.123:0/68494360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f096c0caae0 con 0x7f096c15e920 2024-09-13T17:09:41.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.614+0000 7f09537fe700 1 -- 172.21.15.123:0/68494360 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16808 (secure 0 0 0) 0x7f0960006ce0 con 0x7f096c15e920 2024-09-13T17:09:41.619 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:41.619 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":74,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:09:32.997963+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:17.328080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:17.920002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1","mappings":[{"from":6,"to":0}]},{"pgid":"11.9","mappings":[{"from":6,"to":5}]},{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.33","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:41.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.614+0000 7f096bfff700 1 -- 172.21.15.123:0/68494360 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0958066730 msgr2=0x7f0958068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:41.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.614+0000 7f096bfff700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0958066730 0x7f0958068bf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f096c071e50 tx=0x7f095c00b040 comp rx=0 tx=0).stop 2024-09-13T17:09:41.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.614+0000 7f096bfff700 1 -- 172.21.15.123:0/68494360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c15e920 msgr2=0x7f096c157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.614+0000 7f096bfff700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c15e920 0x7f096c157ac0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f09600090b0 tx=0x7f0960004770 comp rx=0 tx=0).stop 2024-09-13T17:09:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.614+0000 7f096bfff700 1 -- 172.21.15.123:0/68494360 shutdown_connections 2024-09-13T17:09:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.614+0000 7f096bfff700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0958066730 0x7f0958068bf0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.614+0000 7f096bfff700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f096c15ed00 0x7f096c159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.614+0000 7f096bfff700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c15e920 0x7f096c157ac0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.614+0000 7f096bfff700 1 --2- 172.21.15.123:0/68494360 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f096c0cb020 0x7f096c0c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.614+0000 7f096bfff700 1 -- 172.21.15.123:0/68494360 >> 172.21.15.123:0/68494360 conn(0x7f096c066150 msgr2=0x7f096c06be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.614+0000 7f096bfff700 1 -- 172.21.15.123:0/68494360 shutdown_connections 2024-09-13T17:09:41.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.614+0000 7f096bfff700 1 -- 172.21.15.123:0/68494360 wait complete. 2024-09-13T17:09:41.636 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:09:17.328080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:09:17.920002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:09:41.637 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:09:41.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.750+0000 7f925a97c700 1 Processor -- start 2024-09-13T17:09:41.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.750+0000 7f925a97c700 1 -- start start 2024-09-13T17:09:41.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f925a97c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f92540cdda0 0x7f925415e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:41.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f925a97c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92540ada60 con 0x7f9254070f90 2024-09-13T17:09:41.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f925a97c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925415e680 con 0x7f9254159c60 2024-09-13T17:09:41.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f925a97c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92540720a0 con 0x7f92540cdda0 2024-09-13T17:09:41.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f9259179700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f92540cdda0 0x7f925415e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:41.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f925a17b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9254070f90 0x7f925406c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36468/0 (socket says 172.21.15.123:36468) 2024-09-13T17:09:41.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f925a17b700 1 -- 172.21.15.123:0/1877315386 learned_addr learned my addr 172.21.15.123:0/1877315386 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:41.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f9259179700 1 -- 172.21.15.123:0/1877315386 >> v1:172.21.15.153:6789/0 conn(0x7f9254159c60 legacy=0x7f92540cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:41.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f9259179700 1 -- 172.21.15.123:0/1877315386 >> v1:172.21.15.123:6789/0 conn(0x7f9254070f90 legacy=0x7f925406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:41.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f9259179700 1 -- 172.21.15.123:0/1877315386 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9254072530 con 0x7f92540cdda0 2024-09-13T17:09:41.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f9259179700 1 --2- 172.21.15.123:0/1877315386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540cdda0 0x7f925415e140 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9248009850 tx=0x7f9248009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16472138d6ba6e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:41.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f9258978700 1 -- 172.21.15.123:0/1877315386 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924800f8a0 con 0x7f92540cdda0 2024-09-13T17:09:41.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f9258978700 1 -- 172.21.15.123:0/1877315386 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924800fa00 con 0x7f92540cdda0 2024-09-13T17:09:41.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f9258978700 1 -- 172.21.15.123:0/1877315386 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924800fd90 con 0x7f92540cdda0 2024-09-13T17:09:41.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f925a97c700 1 -- 172.21.15.123:0/1877315386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540cdda0 msgr2=0x7f925415e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:41.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f925a97c700 1 --2- 172.21.15.123:0/1877315386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540cdda0 0x7f925415e140 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9248009850 tx=0x7f9248009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:41.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f925a97c700 1 -- 172.21.15.123:0/1877315386 shutdown_connections 2024-09-13T17:09:41.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f925a97c700 1 --2- 172.21.15.123:0/1877315386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92540cdda0 0x7f925415e140 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f925a97c700 1 -- 172.21.15.123:0/1877315386 >> 172.21.15.123:0/1877315386 conn(0x7f92540b01d0 msgr2=0x7f92540b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:41.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f925a97c700 1 -- 172.21.15.123:0/1877315386 shutdown_connections 2024-09-13T17:09:41.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.754+0000 7f925a97c700 1 -- 172.21.15.123:0/1877315386 wait complete. 2024-09-13T17:09:41.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.758+0000 7f925a97c700 1 Processor -- start 2024-09-13T17:09:41.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.758+0000 7f925a97c700 1 -- start start 2024-09-13T17:09:41.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.758+0000 7f925a97c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9254070f90 0x7f92541568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:41.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.758+0000 7f925a97c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92540cdda0 0x7f925415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:41.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.758+0000 7f925a97c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9254159c60 0x7f925406c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:41.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.758+0000 7f925a97c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92540b14d0 con 0x7f9254070f90 2024-09-13T17:09:41.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.758+0000 7f925a97c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925415c390 con 0x7f9254159c60 2024-09-13T17:09:41.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.758+0000 7f925a97c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925415c610 con 0x7f92540cdda0 2024-09-13T17:09:41.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.758+0000 7f925997a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9254070f90 0x7f92541568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:41.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f925997a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9254070f90 0x7f92541568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46390/0 (socket says 172.21.15.123:46390) 2024-09-13T17:09:41.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f925997a700 1 -- 172.21.15.123:0/1120446727 learned_addr learned my addr 172.21.15.123:0/1120446727 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:41.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f925a17b700 1 --2- 172.21.15.123:0/1120446727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9254159c60 0x7f925406c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:41.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f9259179700 1 --2- 172.21.15.123:0/1120446727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92540cdda0 0x7f925415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:41.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f925997a700 1 -- 172.21.15.123:0/1120446727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92540cdda0 msgr2=0x7f925415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:41.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f925997a700 1 --2- 172.21.15.123:0/1120446727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92540cdda0 0x7f925415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f925997a700 1 -- 172.21.15.123:0/1120446727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9254159c60 msgr2=0x7f925406c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:41.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f925997a700 1 --2- 172.21.15.123:0/1120446727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9254159c60 0x7f925406c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f925997a700 1 -- 172.21.15.123:0/1120446727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92480094b0 con 0x7f9254070f90 2024-09-13T17:09:41.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f925997a700 1 --2- 172.21.15.123:0/1120446727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9254070f90 0x7f92541568c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f925000c500 tx=0x7f925000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:41.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f92467fc700 1 -- 172.21.15.123:0/1120446727 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92500052d0 con 0x7f9254070f90 2024-09-13T17:09:41.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f92467fc700 1 -- 172.21.15.123:0/1120446727 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9250005430 con 0x7f9254070f90 2024-09-13T17:09:41.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f925a97c700 1 -- 172.21.15.123:0/1120446727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92540b16e0 con 0x7f9254070f90 2024-09-13T17:09:41.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f92467fc700 1 -- 172.21.15.123:0/1120446727 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92500055a0 con 0x7f9254070f90 2024-09-13T17:09:41.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f925a97c700 1 -- 172.21.15.123:0/1120446727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92540b1ca0 con 0x7f9254070f90 2024-09-13T17:09:41.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.762+0000 7f925a97c700 1 -- 172.21.15.123:0/1120446727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9254071d30 con 0x7f9254070f90 2024-09-13T17:09:41.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.766+0000 7f92467fc700 1 -- 172.21.15.123:0/1120446727 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f92500038e0 con 0x7f9254070f90 2024-09-13T17:09:41.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.766+0000 7f92467fc700 1 --2- 172.21.15.123:0/1120446727 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9238066730 0x7f9238068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:41.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.766+0000 7f92467fc700 1 -- 172.21.15.123:0/1120446727 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9250083380 con 0x7f9254070f90 2024-09-13T17:09:41.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.766+0000 7f9259179700 1 --2- 172.21.15.123:0/1120446727 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9238066730 0x7f9238068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:41.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.766+0000 7f9259179700 1 --2- 172.21.15.123:0/1120446727 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9238066730 0x7f9238068bf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9248009fd0 tx=0x7f924801b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:41.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.774+0000 7f92467fc700 1 -- 172.21.15.123:0/1120446727 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9250050670 con 0x7f9254070f90 2024-09-13T17:09:41.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.942+0000 7f925a97c700 1 -- 172.21.15.123:0/1120446727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f925415e680 con 0x7f9254070f90 2024-09-13T17:09:41.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.942+0000 7f92467fc700 1 -- 172.21.15.123:0/1120446727 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f925415e680 con 0x7f9254070f90 2024-09-13T17:09:41.949 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:09:41.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.946+0000 7f925a97c700 1 -- 172.21.15.123:0/1120446727 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9238066730 msgr2=0x7f9238068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:41.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.946+0000 7f925a97c700 1 --2- 172.21.15.123:0/1120446727 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9238066730 0x7f9238068bf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9248009fd0 tx=0x7f924801b040 comp rx=0 tx=0).stop 2024-09-13T17:09:41.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.946+0000 7f925a97c700 1 -- 172.21.15.123:0/1120446727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9254070f90 msgr2=0x7f92541568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:41.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.946+0000 7f925a97c700 1 --2- 172.21.15.123:0/1120446727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9254070f90 0x7f92541568c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f925000c500 tx=0x7f925000c810 comp rx=0 tx=0).stop 2024-09-13T17:09:41.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.950+0000 7f925a97c700 1 -- 172.21.15.123:0/1120446727 shutdown_connections 2024-09-13T17:09:41.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.950+0000 7f925a97c700 1 --2- 172.21.15.123:0/1120446727 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9238066730 0x7f9238068bf0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.950+0000 7f925a97c700 1 --2- 172.21.15.123:0/1120446727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9254159c60 0x7f925406c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.950+0000 7f925a97c700 1 --2- 172.21.15.123:0/1120446727 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f92540cdda0 0x7f925415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.950+0000 7f925a97c700 1 --2- 172.21.15.123:0/1120446727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9254070f90 0x7f92541568c0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:41.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.950+0000 7f925a97c700 1 -- 172.21.15.123:0/1120446727 >> 172.21.15.123:0/1120446727 conn(0x7f92540b01d0 msgr2=0x7f92540cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:41.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.950+0000 7f925a97c700 1 -- 172.21.15.123:0/1120446727 shutdown_connections 2024-09-13T17:09:41.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:41.950+0000 7f925a97c700 1 -- 172.21.15.123:0/1120446727 wait complete. 2024-09-13T17:09:41.970 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:09:42.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.086+0000 7f471ed10700 1 Processor -- start 2024-09-13T17:09:42.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.086+0000 7f471ed10700 1 -- start start 2024-09-13T17:09:42.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.086+0000 7f471ed10700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47180cfd10 0x7f47180cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.086+0000 7f471ed10700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4718160810 0x7f47180cde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.086+0000 7f471ed10700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47180b42c0 con 0x7f4718160430 2024-09-13T17:09:42.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.086+0000 7f471ed10700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47180c7890 con 0x7f47180cfd10 2024-09-13T17:09:42.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.086+0000 7f471ed10700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47180b3d00 con 0x7f4718160810 2024-09-13T17:09:42.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.086+0000 7f471caac700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4718160430 0x7f47180cf600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41578/0 (socket says 172.21.15.123:41578) 2024-09-13T17:09:42.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.086+0000 7f471caac700 1 -- 172.21.15.123:0/1414602167 learned_addr learned my addr 172.21.15.123:0/1414602167 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:42.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.086+0000 7f471d2ad700 1 --2- 172.21.15.123:0/1414602167 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4718160810 0x7f47180cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.086+0000 7f4717fff700 1 --2- 172.21.15.123:0/1414602167 >> v2:172.21.15.153:3300/0 conn(0x7f47180cfd10 0x7f47180cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.086+0000 7f47177fe700 1 -- 172.21.15.123:0/1414602167 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530587699 0 0) 0x7f47180b42c0 con 0x7f4718160430 2024-09-13T17:09:42.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.086+0000 7f47177fe700 1 -- 172.21.15.123:0/1414602167 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47000035d0 con 0x7f4718160430 2024-09-13T17:09:42.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.086+0000 7f471d2ad700 1 -- 172.21.15.123:0/1414602167 >> v2:172.21.15.153:3300/0 conn(0x7f47180cfd10 msgr2=0x7f47180cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:42.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f471d2ad700 1 --2- 172.21.15.123:0/1414602167 >> v2:172.21.15.153:3300/0 conn(0x7f47180cfd10 0x7f47180cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f471d2ad700 1 -- 172.21.15.123:0/1414602167 >> v1:172.21.15.123:6789/0 conn(0x7f4718160430 legacy=0x7f47180cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f471d2ad700 1 -- 172.21.15.123:0/1414602167 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47180b3fe0 con 0x7f4718160810 2024-09-13T17:09:42.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f4717fff700 1 --2- 172.21.15.123:0/1414602167 >> v2:172.21.15.153:3300/0 conn(0x7f47180cfd10 0x7f47180cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:42.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f471d2ad700 1 --2- 172.21.15.123:0/1414602167 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4718160810 0x7f47180cde10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4710009d90 tx=0x7f471000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=353e3e7a3df778d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:42.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f47177fe700 1 -- 172.21.15.123:0/1414602167 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471000e070 con 0x7f4718160810 2024-09-13T17:09:42.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f47177fe700 1 -- 172.21.15.123:0/1414602167 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471000bb20 con 0x7f4718160810 2024-09-13T17:09:42.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f47177fe700 1 -- 172.21.15.123:0/1414602167 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471000be90 con 0x7f4718160810 2024-09-13T17:09:42.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f471ed10700 1 -- 172.21.15.123:0/1414602167 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4718160810 msgr2=0x7f47180cde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f471ed10700 1 --2- 172.21.15.123:0/1414602167 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4718160810 0x7f47180cde10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4710009d90 tx=0x7f471000b330 comp rx=0 tx=0).stop 2024-09-13T17:09:42.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f471ed10700 1 -- 172.21.15.123:0/1414602167 shutdown_connections 2024-09-13T17:09:42.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f471ed10700 1 --2- 172.21.15.123:0/1414602167 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4718160810 0x7f47180cde10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f471ed10700 1 --2- 172.21.15.123:0/1414602167 >> v2:172.21.15.153:3300/0 conn(0x7f47180cfd10 0x7f47180cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f471ed10700 1 -- 172.21.15.123:0/1414602167 >> 172.21.15.123:0/1414602167 conn(0x7f47180d2d30 msgr2=0x7f47180d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:42.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f471ed10700 1 -- 172.21.15.123:0/1414602167 shutdown_connections 2024-09-13T17:09:42.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f471ed10700 1 -- 172.21.15.123:0/1414602167 wait complete. 2024-09-13T17:09:42.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f471ed10700 1 Processor -- start 2024-09-13T17:09:42.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.090+0000 7f471ed10700 1 -- start start 2024-09-13T17:09:42.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471ed10700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180cfd10 0x7f47181f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471ed10700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4718160430 0x7f47181f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471ed10700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4718160810 0x7f47180b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471ed10700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47180cb250 con 0x7f47180cfd10 2024-09-13T17:09:42.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471ed10700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47180b60a0 con 0x7f4718160430 2024-09-13T17:09:42.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471ed10700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47181f6a00 con 0x7f4718160810 2024-09-13T17:09:42.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471caac700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180cfd10 0x7f47181f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471caac700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180cfd10 0x7f47181f24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51524/0 (socket says 172.21.15.123:51524) 2024-09-13T17:09:42.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471caac700 1 -- 172.21.15.123:0/3425993821 learned_addr learned my addr 172.21.15.123:0/3425993821 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:42.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471d2ad700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4718160810 0x7f47180b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471caac700 1 -- 172.21.15.123:0/3425993821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4718160810 msgr2=0x7f47180b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f4717fff700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4718160430 0x7f47181f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471caac700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4718160810 0x7f47180b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471caac700 1 -- 172.21.15.123:0/3425993821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4718160430 msgr2=0x7f47181f5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471caac700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4718160430 0x7f47181f5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471caac700 1 -- 172.21.15.123:0/3425993821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47080094b0 con 0x7f47180cfd10 2024-09-13T17:09:42.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f4717fff700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4718160430 0x7f47181f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:42.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471caac700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180cfd10 0x7f47181f24d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f470c00c520 tx=0x7f470c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:42.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f47157fa700 1 -- 172.21.15.123:0/3425993821 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c005d90 con 0x7f47180cfd10 2024-09-13T17:09:42.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f47157fa700 1 -- 172.21.15.123:0/3425993821 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470c0070d0 con 0x7f47180cfd10 2024-09-13T17:09:42.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471ed10700 1 -- 172.21.15.123:0/3425993821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4710009a70 con 0x7f47180cfd10 2024-09-13T17:09:42.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f47157fa700 1 -- 172.21.15.123:0/3425993821 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c007440 con 0x7f47180cfd10 2024-09-13T17:09:42.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.094+0000 7f471ed10700 1 -- 172.21.15.123:0/3425993821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47181f6160 con 0x7f47180cfd10 2024-09-13T17:09:42.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.098+0000 7f471ed10700 1 -- 172.21.15.123:0/3425993821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47180cb390 con 0x7f47180cfd10 2024-09-13T17:09:42.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.098+0000 7f47157fa700 1 -- 172.21.15.123:0/3425993821 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f470c0075a0 con 0x7f47180cfd10 2024-09-13T17:09:42.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.098+0000 7f47157fa700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4704066730 0x7f4704068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.098+0000 7f47157fa700 1 -- 172.21.15.123:0/3425993821 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f470c083570 con 0x7f47180cfd10 2024-09-13T17:09:42.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.098+0000 7f4717fff700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4704066730 0x7f4704068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.098+0000 7f4717fff700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4704066730 0x7f4704068bf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f47181f3650 tx=0x7f4708008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:42.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.106+0000 7f47157fa700 1 -- 172.21.15.123:0/3425993821 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f470c0509a0 con 0x7f47180cfd10 2024-09-13T17:09:42.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.274+0000 7f471ed10700 1 -- 172.21.15.123:0/3425993821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47180d3820 con 0x7f47180cfd10 2024-09-13T17:09:42.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.274+0000 7f47157fa700 1 -- 172.21.15.123:0/3425993821 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7f470c053fc0 con 0x7f47180cfd10 2024-09-13T17:09:42.281 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:09:42.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.278+0000 7f471ed10700 1 -- 172.21.15.123:0/3425993821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4704066730 msgr2=0x7f4704068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.278+0000 7f471ed10700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4704066730 0x7f4704068bf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f47181f3650 tx=0x7f4708008040 comp rx=0 tx=0).stop 2024-09-13T17:09:42.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.278+0000 7f471ed10700 1 -- 172.21.15.123:0/3425993821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180cfd10 msgr2=0x7f47181f24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.278+0000 7f471ed10700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180cfd10 0x7f47181f24d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f470c00c520 tx=0x7f470c00c8e0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.278+0000 7f471ed10700 1 -- 172.21.15.123:0/3425993821 shutdown_connections 2024-09-13T17:09:42.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.278+0000 7f471ed10700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4704066730 0x7f4704068bf0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.278+0000 7f471ed10700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4718160810 0x7f47180b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.278+0000 7f471ed10700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4718160430 0x7f47181f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.278+0000 7f471ed10700 1 --2- 172.21.15.123:0/3425993821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47180cfd10 0x7f47181f24d0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.278+0000 7f471ed10700 1 -- 172.21.15.123:0/3425993821 >> 172.21.15.123:0/3425993821 conn(0x7f47180d2d30 msgr2=0x7f47180d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:42.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.278+0000 7f471ed10700 1 -- 172.21.15.123:0/3425993821 shutdown_connections 2024-09-13T17:09:42.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.278+0000 7f471ed10700 1 -- 172.21.15.123:0/3425993821 wait complete. 2024-09-13T17:09:42.296 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:09:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d49d69700 1 Processor -- start 2024-09-13T17:09:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d49d69700 1 -- start start 2024-09-13T17:09:42.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d49d69700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3d440b2af0 0x7f3d440d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d49d69700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d440d0df0 con 0x7f3d4415af00 2024-09-13T17:09:42.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d49d69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4415b2e0 con 0x7f3d440caf10 2024-09-13T17:09:42.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d49d69700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d440d01e0 con 0x7f3d440b2af0 2024-09-13T17:09:42.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d48d67700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3d4415af00 0x7f3d440cdd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41582/0 (socket says 172.21.15.123:41582) 2024-09-13T17:09:42.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d48d67700 1 -- 172.21.15.123:0/1027009924 learned_addr learned my addr 172.21.15.123:0/1027009924 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d49568700 1 --2- 172.21.15.123:0/1027009924 >> v2:172.21.15.123:3300/0 conn(0x7f3d440b2af0 0x7f3d440d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d437fe700 1 -- 172.21.15.123:0/1027009924 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984093754 0 0) 0x7f3d440d0df0 con 0x7f3d4415af00 2024-09-13T17:09:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d437fe700 1 -- 172.21.15.123:0/1027009924 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d300035d0 con 0x7f3d4415af00 2024-09-13T17:09:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d49568700 1 -- 172.21.15.123:0/1027009924 >> v1:172.21.15.153:6789/0 conn(0x7f3d440caf10 legacy=0x7f3d440b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d49568700 1 -- 172.21.15.123:0/1027009924 >> v1:172.21.15.123:6789/0 conn(0x7f3d4415af00 legacy=0x7f3d440cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d49568700 1 -- 172.21.15.123:0/1027009924 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d440d04c0 con 0x7f3d440b2af0 2024-09-13T17:09:42.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.402+0000 7f3d49568700 1 --2- 172.21.15.123:0/1027009924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440b2af0 0x7f3d440d1280 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009850 tx=0x7f3d3c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad28dde9f7793a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:42.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.406+0000 7f3d437fe700 1 -- 172.21.15.123:0/1027009924 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c011830 con 0x7f3d440b2af0 2024-09-13T17:09:42.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.406+0000 7f3d437fe700 1 -- 172.21.15.123:0/1027009924 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c011990 con 0x7f3d440b2af0 2024-09-13T17:09:42.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.406+0000 7f3d437fe700 1 -- 172.21.15.123:0/1027009924 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c011d00 con 0x7f3d440b2af0 2024-09-13T17:09:42.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.406+0000 7f3d49d69700 1 -- 172.21.15.123:0/1027009924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440b2af0 msgr2=0x7f3d440d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.406+0000 7f3d49d69700 1 --2- 172.21.15.123:0/1027009924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440b2af0 0x7f3d440d1280 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009850 tx=0x7f3d3c009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:42.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.406+0000 7f3d49d69700 1 -- 172.21.15.123:0/1027009924 shutdown_connections 2024-09-13T17:09:42.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.406+0000 7f3d49d69700 1 --2- 172.21.15.123:0/1027009924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440b2af0 0x7f3d440d1280 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.406+0000 7f3d49d69700 1 -- 172.21.15.123:0/1027009924 >> 172.21.15.123:0/1027009924 conn(0x7f3d44066150 msgr2=0x7f3d44066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:42.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.406+0000 7f3d49d69700 1 -- 172.21.15.123:0/1027009924 shutdown_connections 2024-09-13T17:09:42.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.406+0000 7f3d49d69700 1 -- 172.21.15.123:0/1027009924 wait complete. 2024-09-13T17:09:42.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.406+0000 7f3d49d69700 1 Processor -- start 2024-09-13T17:09:42.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.406+0000 7f3d49d69700 1 -- start start 2024-09-13T17:09:42.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d49d69700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d440b2af0 0x7f3d440ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d49d69700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440caf10 0x7f3d440b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d49d69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d4415af00 0x7f3d440b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d49d69700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4415e730 con 0x7f3d440caf10 2024-09-13T17:09:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d49d69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d44146be0 con 0x7f3d4415af00 2024-09-13T17:09:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d49d69700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4415d690 con 0x7f3d440b2af0 2024-09-13T17:09:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d43fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440caf10 0x7f3d440b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d48d67700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d440b2af0 0x7f3d440ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d48d67700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d440b2af0 0x7f3d440ca3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:42424/0 (socket says 172.21.15.123:42424) 2024-09-13T17:09:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d43fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440caf10 0x7f3d440b5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51536/0 (socket says 172.21.15.123:51536) 2024-09-13T17:09:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d48d67700 1 -- 172.21.15.123:0/2169615498 learned_addr learned my addr 172.21.15.123:0/2169615498 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d49568700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d4415af00 0x7f3d440b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d43fff700 1 -- 172.21.15.123:0/2169615498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d440b2af0 msgr2=0x7f3d440ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d43fff700 1 --2- 172.21.15.123:0/2169615498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d440b2af0 0x7f3d440ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d43fff700 1 -- 172.21.15.123:0/2169615498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d4415af00 msgr2=0x7f3d440b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d43fff700 1 --2- 172.21.15.123:0/2169615498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d4415af00 0x7f3d440b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d43fff700 1 -- 172.21.15.123:0/2169615498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c0094b0 con 0x7f3d440caf10 2024-09-13T17:09:42.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d43fff700 1 --2- 172.21.15.123:0/2169615498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440caf10 0x7f3d440b5730 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00c430 tx=0x7f3d2c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:42.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d417fa700 1 -- 172.21.15.123:0/2169615498 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c0052d0 con 0x7f3d440caf10 2024-09-13T17:09:42.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d417fa700 1 -- 172.21.15.123:0/2169615498 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c005450 con 0x7f3d440caf10 2024-09-13T17:09:42.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d49d69700 1 -- 172.21.15.123:0/2169615498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4415d970 con 0x7f3d440caf10 2024-09-13T17:09:42.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d417fa700 1 -- 172.21.15.123:0/2169615498 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c006b10 con 0x7f3d440caf10 2024-09-13T17:09:42.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d49d69700 1 -- 172.21.15.123:0/2169615498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4415df30 con 0x7f3d440caf10 2024-09-13T17:09:42.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.410+0000 7f3d49d69700 1 -- 172.21.15.123:0/2169615498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d440d1690 con 0x7f3d440caf10 2024-09-13T17:09:42.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.414+0000 7f3d417fa700 1 -- 172.21.15.123:0/2169615498 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3d2c0036f0 con 0x7f3d440caf10 2024-09-13T17:09:42.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.414+0000 7f3d417fa700 1 --2- 172.21.15.123:0/2169615498 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3d24066730 0x7f3d24068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.414+0000 7f3d417fa700 1 -- 172.21.15.123:0/2169615498 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3d2c083300 con 0x7f3d440caf10 2024-09-13T17:09:42.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.414+0000 7f3d48d67700 1 --2- 172.21.15.123:0/2169615498 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3d24066730 0x7f3d24068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.414+0000 7f3d48d67700 1 --2- 172.21.15.123:0/2169615498 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3d24066730 0x7f3d24068bf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3d34001560 tx=0x7f3d34009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:42.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.422+0000 7f3d417fa700 1 -- 172.21.15.123:0/2169615498 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3d2c0505e0 con 0x7f3d440caf10 2024-09-13T17:09:42.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.590+0000 7f3d49d69700 1 -- 172.21.15.123:0/2169615498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d440d1280 con 0x7f3d440caf10 2024-09-13T17:09:42.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.590+0000 7f3d417fa700 1 -- 172.21.15.123:0/2169615498 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d2c053c00 con 0x7f3d440caf10 2024-09-13T17:09:42.597 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:09:42.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.594+0000 7f3d49d69700 1 -- 172.21.15.123:0/2169615498 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3d24066730 msgr2=0x7f3d24068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.594+0000 7f3d49d69700 1 --2- 172.21.15.123:0/2169615498 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3d24066730 0x7f3d24068bf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3d34001560 tx=0x7f3d34009040 comp rx=0 tx=0).stop 2024-09-13T17:09:42.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.594+0000 7f3d49d69700 1 -- 172.21.15.123:0/2169615498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440caf10 msgr2=0x7f3d440b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.594+0000 7f3d49d69700 1 --2- 172.21.15.123:0/2169615498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440caf10 0x7f3d440b5730 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00c430 tx=0x7f3d2c00c740 comp rx=0 tx=0).stop 2024-09-13T17:09:42.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.594+0000 7f3d49d69700 1 -- 172.21.15.123:0/2169615498 shutdown_connections 2024-09-13T17:09:42.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.594+0000 7f3d49d69700 1 --2- 172.21.15.123:0/2169615498 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3d24066730 0x7f3d24068bf0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.594+0000 7f3d49d69700 1 --2- 172.21.15.123:0/2169615498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d4415af00 0x7f3d440b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.594+0000 7f3d49d69700 1 --2- 172.21.15.123:0/2169615498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440caf10 0x7f3d440b5730 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.594+0000 7f3d49d69700 1 --2- 172.21.15.123:0/2169615498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d440b2af0 0x7f3d440ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.594+0000 7f3d49d69700 1 -- 172.21.15.123:0/2169615498 >> 172.21.15.123:0/2169615498 conn(0x7f3d44066150 msgr2=0x7f3d44066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:42.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.598+0000 7f3d49d69700 1 -- 172.21.15.123:0/2169615498 shutdown_connections 2024-09-13T17:09:42.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.598+0000 7f3d49d69700 1 -- 172.21.15.123:0/2169615498 wait complete. 2024-09-13T17:09:42.618 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:09:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.726+0000 7f875538b700 1 Processor -- start 2024-09-13T17:09:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.726+0000 7f875538b700 1 -- start start 2024-09-13T17:09:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.726+0000 7f875538b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f87500c9020 0x7f87500af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.726+0000 7f875538b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87500cbb10 con 0x7f87500ce010 2024-09-13T17:09:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.726+0000 7f875538b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87500af2e0 con 0x7f87500aef00 2024-09-13T17:09:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.726+0000 7f875538b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87500cb2b0 con 0x7f87500c9020 2024-09-13T17:09:42.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.726+0000 7f8747fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f87500ce010 0x7f875006c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41584/0 (socket says 172.21.15.123:41584) 2024-09-13T17:09:42.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.726+0000 7f8747fff700 1 -- 172.21.15.123:0/2183224864 learned_addr learned my addr 172.21.15.123:0/2183224864 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:42.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.726+0000 7f874f7fe700 1 --2- 172.21.15.123:0/2183224864 >> v2:172.21.15.153:3300/0 conn(0x7f87500c9020 0x7f87500af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f874e7fc700 1 -- 172.21.15.123:0/2183224864 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001785140 0 0) 0x7f87500cbb10 con 0x7f87500ce010 2024-09-13T17:09:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f874e7fc700 1 -- 172.21.15.123:0/2183224864 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f873c0035d0 con 0x7f87500ce010 2024-09-13T17:09:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f874f7fe700 1 -- 172.21.15.123:0/2183224864 >> v1:172.21.15.153:6789/0 conn(0x7f87500aef00 legacy=0x7f87500cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f874f7fe700 1 -- 172.21.15.123:0/2183224864 >> v1:172.21.15.123:6789/0 conn(0x7f87500ce010 legacy=0x7f875006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f874f7fe700 1 -- 172.21.15.123:0/2183224864 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87500b00a0 con 0x7f87500c9020 2024-09-13T17:09:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f874f7fe700 1 --2- 172.21.15.123:0/2183224864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87500c9020 0x7f87500af4f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8748009d90 tx=0x7f874800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=700dcd6af41cdd1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f874e7fc700 1 -- 172.21.15.123:0/2183224864 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874800e070 con 0x7f87500c9020 2024-09-13T17:09:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f874e7fc700 1 -- 172.21.15.123:0/2183224864 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874800bb20 con 0x7f87500c9020 2024-09-13T17:09:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f874e7fc700 1 -- 172.21.15.123:0/2183224864 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874800be90 con 0x7f87500c9020 2024-09-13T17:09:42.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f875538b700 1 -- 172.21.15.123:0/2183224864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87500c9020 msgr2=0x7f87500af4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f875538b700 1 --2- 172.21.15.123:0/2183224864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87500c9020 0x7f87500af4f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8748009d90 tx=0x7f874800b330 comp rx=0 tx=0).stop 2024-09-13T17:09:42.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f875538b700 1 -- 172.21.15.123:0/2183224864 shutdown_connections 2024-09-13T17:09:42.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f875538b700 1 --2- 172.21.15.123:0/2183224864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87500c9020 0x7f87500af4f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f875538b700 1 -- 172.21.15.123:0/2183224864 >> 172.21.15.123:0/2183224864 conn(0x7f87500b0450 msgr2=0x7f87500b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:42.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f875538b700 1 -- 172.21.15.123:0/2183224864 shutdown_connections 2024-09-13T17:09:42.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.730+0000 7f875538b700 1 -- 172.21.15.123:0/2183224864 wait complete. 2024-09-13T17:09:42.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f875538b700 1 Processor -- start 2024-09-13T17:09:42.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f875538b700 1 -- start start 2024-09-13T17:09:42.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f875538b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87500aef00 0x7f87501f9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f875538b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87500c9020 0x7f8750160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f875538b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87500ce010 0x7f87500c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f875538b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87501fa770 con 0x7f87500c9020 2024-09-13T17:09:42.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f875538b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87501faa50 con 0x7f87500aef00 2024-09-13T17:09:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f875538b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87501fad30 con 0x7f87500ce010 2024-09-13T17:09:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f8747fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87500c9020 0x7f8750160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f8747fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87500c9020 0x7f8750160d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51552/0 (socket says 172.21.15.123:51552) 2024-09-13T17:09:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f8747fff700 1 -- 172.21.15.123:0/3168116173 learned_addr learned my addr 172.21.15.123:0/3168116173 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f874f7fe700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87500ce010 0x7f87500c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f874effd700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87500aef00 0x7f87501f9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f8747fff700 1 -- 172.21.15.123:0/3168116173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87500ce010 msgr2=0x7f87500c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f8747fff700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87500ce010 0x7f87500c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f8747fff700 1 -- 172.21.15.123:0/3168116173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87500aef00 msgr2=0x7f87501f9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f8747fff700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87500aef00 0x7f87501f9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f8747fff700 1 -- 172.21.15.123:0/3168116173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8748009a70 con 0x7f87500c9020 2024-09-13T17:09:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f874effd700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87500aef00 0x7f87501f9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:42.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f8747fff700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87500c9020 0x7f8750160d40 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f873800c4d0 tx=0x7f873800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:42.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f87477fe700 1 -- 172.21.15.123:0/3168116173 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738005d90 con 0x7f87500c9020 2024-09-13T17:09:42.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f87477fe700 1 -- 172.21.15.123:0/3168116173 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87380070d0 con 0x7f87500c9020 2024-09-13T17:09:42.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f875538b700 1 -- 172.21.15.123:0/3168116173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87500b1750 con 0x7f87500c9020 2024-09-13T17:09:42.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f87477fe700 1 -- 172.21.15.123:0/3168116173 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738007480 con 0x7f87500c9020 2024-09-13T17:09:42.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.734+0000 7f875538b700 1 -- 172.21.15.123:0/3168116173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87501fa440 con 0x7f87500c9020 2024-09-13T17:09:42.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.738+0000 7f875538b700 1 -- 172.21.15.123:0/3168116173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87501f6990 con 0x7f87500c9020 2024-09-13T17:09:42.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.738+0000 7f87477fe700 1 -- 172.21.15.123:0/3168116173 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f87380075e0 con 0x7f87500c9020 2024-09-13T17:09:42.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.738+0000 7f87477fe700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8730066730 0x7f8730068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:42.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.738+0000 7f874effd700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8730066730 0x7f8730068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:42.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.738+0000 7f87477fe700 1 -- 172.21.15.123:0/3168116173 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8738083750 con 0x7f87500c9020 2024-09-13T17:09:42.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.742+0000 7f874effd700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8730066730 0x7f8730068bf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f87400017a0 tx=0x7f8740009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:42.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.750+0000 7f87477fe700 1 -- 172.21.15.123:0/3168116173 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f87380509b0 con 0x7f87500c9020 2024-09-13T17:09:42.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.934+0000 7f875538b700 1 -- 172.21.15.123:0/3168116173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f87500b1c70 con 0x7f87500c9020 2024-09-13T17:09:42.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.934+0000 7f87477fe700 1 -- 172.21.15.123:0/3168116173 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) v1 ==== 80+0+0 (secure 0 0 0) 0x7f87500b1c70 con 0x7f87500c9020 2024-09-13T17:09:42.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.938+0000 7f875538b700 1 -- 172.21.15.123:0/3168116173 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8730066730 msgr2=0x7f8730068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.938+0000 7f875538b700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8730066730 0x7f8730068bf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f87400017a0 tx=0x7f8740009040 comp rx=0 tx=0).stop 2024-09-13T17:09:42.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.938+0000 7f875538b700 1 -- 172.21.15.123:0/3168116173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87500c9020 msgr2=0x7f8750160d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.938+0000 7f875538b700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87500c9020 0x7f8750160d40 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f873800c4d0 tx=0x7f873800c7e0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.938+0000 7f875538b700 1 -- 172.21.15.123:0/3168116173 shutdown_connections 2024-09-13T17:09:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.938+0000 7f875538b700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8730066730 0x7f8730068bf0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.938+0000 7f875538b700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87500ce010 0x7f87500c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.938+0000 7f875538b700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87500c9020 0x7f8750160d40 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.938+0000 7f875538b700 1 --2- 172.21.15.123:0/3168116173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87500aef00 0x7f87501f9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.938+0000 7f875538b700 1 -- 172.21.15.123:0/3168116173 >> 172.21.15.123:0/3168116173 conn(0x7f87500b0450 msgr2=0x7f87500709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.938+0000 7f875538b700 1 -- 172.21.15.123:0/3168116173 shutdown_connections 2024-09-13T17:09:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:42.938+0000 7f875538b700 1 -- 172.21.15.123:0/3168116173 wait complete. 2024-09-13T17:09:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:09:42.957 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2024-09-13T17:09:42.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:42.957 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:09:42.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[42459]: fuse finished with error 0 and tester_r 0 2024-09-13T17:09:42.968 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:09:42.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:42.968 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:09:43.061 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:09:43.061 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:43.069 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:43.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 Processor -- start 2024-09-13T17:09:43.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 -- start start 2024-09-13T17:09:43.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95a40cec90 0x7f95a40adef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95a40cbd00 0x7f95a40cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a406d220 con 0x7f95a40ad9a0 2024-09-13T17:09:43.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a406d500 con 0x7f95a40cec90 2024-09-13T17:09:43.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a406d7e0 con 0x7f95a40cbd00 2024-09-13T17:09:43.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95a8c39700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95a40cec90 0x7f95a40adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f959bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f95a40ad9a0 0x7f95a40cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41590/0 (socket says 172.21.15.123:41590) 2024-09-13T17:09:43.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f959bfff700 1 -- 172.21.15.123:0/2331587479 learned_addr learned my addr 172.21.15.123:0/2331587479 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:43.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95a943a700 1 --2- 172.21.15.123:0/2331587479 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95a40cbd00 0x7f95a40cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95a8c39700 1 -- 172.21.15.123:0/2331587479 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95a40cbd00 msgr2=0x7f95a40cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:43.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95a8c39700 1 --2- 172.21.15.123:0/2331587479 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95a40cbd00 0x7f95a40cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f959b7fe700 1 -- 172.21.15.123:0/2331587479 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357355362 0 0) 0x7f95a406d220 con 0x7f95a40ad9a0 2024-09-13T17:09:43.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95a8c39700 1 -- 172.21.15.123:0/2331587479 >> v1:172.21.15.123:6789/0 conn(0x7f95a40ad9a0 legacy=0x7f95a40cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95a8c39700 1 -- 172.21.15.123:0/2331587479 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a406dac0 con 0x7f95a40cec90 2024-09-13T17:09:43.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95a8c39700 1 --2- 172.21.15.123:0/2331587479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a40cec90 0x7f95a40adef0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009d90 tx=0x7f95a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f02d4e6c9eb4d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:43.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f959b7fe700 1 -- 172.21.15.123:0/2331587479 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a000e070 con 0x7f95a40cec90 2024-09-13T17:09:43.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f959b7fe700 1 -- 172.21.15.123:0/2331587479 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a000bbd0 con 0x7f95a40cec90 2024-09-13T17:09:43.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f959b7fe700 1 -- 172.21.15.123:0/2331587479 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0012430 con 0x7f95a40cec90 2024-09-13T17:09:43.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 -- 172.21.15.123:0/2331587479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a40cec90 msgr2=0x7f95a40adef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 --2- 172.21.15.123:0/2331587479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a40cec90 0x7f95a40adef0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009d90 tx=0x7f95a000b330 comp rx=0 tx=0).stop 2024-09-13T17:09:43.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 -- 172.21.15.123:0/2331587479 shutdown_connections 2024-09-13T17:09:43.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 --2- 172.21.15.123:0/2331587479 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95a40cbd00 0x7f95a40cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 --2- 172.21.15.123:0/2331587479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a40cec90 0x7f95a40adef0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 -- 172.21.15.123:0/2331587479 >> 172.21.15.123:0/2331587479 conn(0x7f95a4066570 msgr2=0x7f95a4066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:43.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 -- 172.21.15.123:0/2331587479 shutdown_connections 2024-09-13T17:09:43.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.186+0000 7f95aae9d700 1 -- 172.21.15.123:0/2331587479 wait complete. 2024-09-13T17:09:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95aae9d700 1 Processor -- start 2024-09-13T17:09:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95aae9d700 1 -- start start 2024-09-13T17:09:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95aae9d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95a40ad9a0 0x7f95a4150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95aae9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95a40cbd00 0x7f95a41f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95aae9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a40cec90 0x7f95a40ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95aae9d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40ab330 con 0x7f95a40cec90 2024-09-13T17:09:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95aae9d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40aa720 con 0x7f95a40cbd00 2024-09-13T17:09:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95aae9d700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40aaa00 con 0x7f95a40ad9a0 2024-09-13T17:09:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95a943a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a40cec90 0x7f95a40ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95a943a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a40cec90 0x7f95a40ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51562/0 (socket says 172.21.15.123:51562) 2024-09-13T17:09:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95a943a700 1 -- 172.21.15.123:0/3784012950 learned_addr learned my addr 172.21.15.123:0/3784012950 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f959bfff700 1 --2- 172.21.15.123:0/3784012950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95a40cbd00 0x7f95a41f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95a8c39700 1 --2- 172.21.15.123:0/3784012950 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95a40ad9a0 0x7f95a4150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95a943a700 1 -- 172.21.15.123:0/3784012950 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95a40ad9a0 msgr2=0x7f95a4150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95a943a700 1 --2- 172.21.15.123:0/3784012950 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95a40ad9a0 0x7f95a4150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95a943a700 1 -- 172.21.15.123:0/3784012950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95a40cbd00 msgr2=0x7f95a41f04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95a943a700 1 --2- 172.21.15.123:0/3784012950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95a40cbd00 0x7f95a41f04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95a943a700 1 -- 172.21.15.123:0/3784012950 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a0009a70 con 0x7f95a40cec90 2024-09-13T17:09:43.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95a943a700 1 --2- 172.21.15.123:0/3784012950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a40cec90 0x7f95a40ccc40 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f959c00e810 tx=0x7f959c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:43.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95997fa700 1 -- 172.21.15.123:0/3784012950 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c00c070 con 0x7f95a40cec90 2024-09-13T17:09:43.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95997fa700 1 -- 172.21.15.123:0/3784012950 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c013650 con 0x7f95a40cec90 2024-09-13T17:09:43.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95aae9d700 1 -- 172.21.15.123:0/3784012950 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a40aace0 con 0x7f95a40cec90 2024-09-13T17:09:43.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.190+0000 7f95997fa700 1 -- 172.21.15.123:0/3784012950 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c013a00 con 0x7f95a40cec90 2024-09-13T17:09:43.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.194+0000 7f95aae9d700 1 -- 172.21.15.123:0/3784012950 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a4150860 con 0x7f95a40cec90 2024-09-13T17:09:43.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.194+0000 7f95aae9d700 1 -- 172.21.15.123:0/3784012950 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a40ab4e0 con 0x7f95a40cec90 2024-09-13T17:09:43.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.194+0000 7f95997fa700 1 -- 172.21.15.123:0/3784012950 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f959c013b60 con 0x7f95a40cec90 2024-09-13T17:09:43.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.194+0000 7f95997fa700 1 --2- 172.21.15.123:0/3784012950 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9590066730 0x7f9590068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.194+0000 7f95997fa700 1 -- 172.21.15.123:0/3784012950 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f959c083e80 con 0x7f95a40cec90 2024-09-13T17:09:43.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.194+0000 7f95a8c39700 1 --2- 172.21.15.123:0/3784012950 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9590066730 0x7f9590068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.198+0000 7f95a8c39700 1 --2- 172.21.15.123:0/3784012950 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9590066730 0x7f9590068bf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f95a0014040 tx=0x7f95a0011000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:43.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.206+0000 7f95997fa700 1 -- 172.21.15.123:0/3784012950 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f95a40ab4e0 con 0x7f95a40cec90 2024-09-13T17:09:43.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.382+0000 7f95aae9d700 1 -- 172.21.15.123:0/3784012950 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95a40ab470 con 0x7f95a40cec90 2024-09-13T17:09:43.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.386+0000 7f95997fa700 1 -- 172.21.15.123:0/3784012950 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16808 (secure 0 0 0) 0x7f959c051180 con 0x7f95a40cec90 2024-09-13T17:09:43.392 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:43.392 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":74,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:09:32.997963+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:17.328080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:17.920002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1","mappings":[{"from":6,"to":0}]},{"pgid":"11.9","mappings":[{"from":6,"to":5}]},{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.33","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.386+0000 7f95aae9d700 1 -- 172.21.15.123:0/3784012950 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9590066730 msgr2=0x7f9590068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.386+0000 7f95aae9d700 1 --2- 172.21.15.123:0/3784012950 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9590066730 0x7f9590068bf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f95a0014040 tx=0x7f95a0011000 comp rx=0 tx=0).stop 2024-09-13T17:09:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.386+0000 7f95aae9d700 1 -- 172.21.15.123:0/3784012950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a40cec90 msgr2=0x7f95a40ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.386+0000 7f95aae9d700 1 --2- 172.21.15.123:0/3784012950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a40cec90 0x7f95a40ccc40 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f959c00e810 tx=0x7f959c00eb20 comp rx=0 tx=0).stop 2024-09-13T17:09:43.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.386+0000 7f95aae9d700 1 -- 172.21.15.123:0/3784012950 shutdown_connections 2024-09-13T17:09:43.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.386+0000 7f95aae9d700 1 --2- 172.21.15.123:0/3784012950 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9590066730 0x7f9590068bf0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.386+0000 7f95aae9d700 1 --2- 172.21.15.123:0/3784012950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a40cec90 0x7f95a40ccc40 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.386+0000 7f95aae9d700 1 --2- 172.21.15.123:0/3784012950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95a40cbd00 0x7f95a41f04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.386+0000 7f95aae9d700 1 --2- 172.21.15.123:0/3784012950 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95a40ad9a0 0x7f95a4150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.386+0000 7f95aae9d700 1 -- 172.21.15.123:0/3784012950 >> 172.21.15.123:0/3784012950 conn(0x7f95a4066570 msgr2=0x7f95a40b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:43.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.386+0000 7f95aae9d700 1 -- 172.21.15.123:0/3784012950 shutdown_connections 2024-09-13T17:09:43.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.386+0000 7f95aae9d700 1 -- 172.21.15.123:0/3784012950 wait complete. 2024-09-13T17:09:43.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:09:17.328080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:09:17.920002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:09:43.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:09:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8759e700 1 Processor -- start 2024-09-13T17:09:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8759e700 1 -- start start 2024-09-13T17:09:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2c88072260 0x7f2c880c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c8806bdb0 0x7f2c880cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c880ca750 con 0x7f2c880cb7e0 2024-09-13T17:09:43.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c880c9210 con 0x7f2c88072260 2024-09-13T17:09:43.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c881617b0 con 0x7f2c8806bdb0 2024-09-13T17:09:43.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c85d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2c88072260 0x7f2c880c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c86d9d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c8806bdb0 0x7f2c880cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8659c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2c880cb7e0 0x7f2c88071b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:59256/0 (socket says 172.21.15.123:59256) 2024-09-13T17:09:43.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8659c700 1 -- 172.21.15.123:0/2840440882 learned_addr learned my addr 172.21.15.123:0/2840440882 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:43.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c86d9d700 1 -- 172.21.15.123:0/2840440882 >> v2:172.21.15.153:3300/0 conn(0x7f2c88072260 msgr2=0x7f2c880c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:43.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c86d9d700 1 --2- 172.21.15.123:0/2840440882 >> v2:172.21.15.153:3300/0 conn(0x7f2c88072260 0x7f2c880c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c86d9d700 1 -- 172.21.15.123:0/2840440882 >> v1:172.21.15.153:6789/0 conn(0x7f2c880cb7e0 legacy=0x7f2c88071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8559a700 1 -- 172.21.15.123:0/2840440882 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343551102 0 0) 0x7f2c880ca750 con 0x7f2c880cb7e0 2024-09-13T17:09:43.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c86d9d700 1 -- 172.21.15.123:0/2840440882 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c880cbbc0 con 0x7f2c8806bdb0 2024-09-13T17:09:43.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c86d9d700 1 --2- 172.21.15.123:0/2840440882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c8806bdb0 0x7f2c880cc580 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009850 tx=0x7f2c80009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4712c80327fb6fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:43.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8559a700 1 -- 172.21.15.123:0/2840440882 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c80011830 con 0x7f2c8806bdb0 2024-09-13T17:09:43.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8559a700 1 -- 172.21.15.123:0/2840440882 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c80011990 con 0x7f2c8806bdb0 2024-09-13T17:09:43.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8559a700 1 -- 172.21.15.123:0/2840440882 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c80011d40 con 0x7f2c8806bdb0 2024-09-13T17:09:43.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8759e700 1 -- 172.21.15.123:0/2840440882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c8806bdb0 msgr2=0x7f2c880cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.522+0000 7f2c8759e700 1 --2- 172.21.15.123:0/2840440882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c8806bdb0 0x7f2c880cc580 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009850 tx=0x7f2c80009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:43.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8759e700 1 -- 172.21.15.123:0/2840440882 shutdown_connections 2024-09-13T17:09:43.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8759e700 1 --2- 172.21.15.123:0/2840440882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c8806bdb0 0x7f2c880cc580 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8759e700 1 --2- 172.21.15.123:0/2840440882 >> v2:172.21.15.153:3300/0 conn(0x7f2c88072260 0x7f2c880c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8759e700 1 -- 172.21.15.123:0/2840440882 >> 172.21.15.123:0/2840440882 conn(0x7f2c880b01d0 msgr2=0x7f2c880b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:43.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8759e700 1 -- 172.21.15.123:0/2840440882 shutdown_connections 2024-09-13T17:09:43.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8759e700 1 -- 172.21.15.123:0/2840440882 wait complete. 2024-09-13T17:09:43.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8759e700 1 Processor -- start 2024-09-13T17:09:43.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8759e700 1 -- start start 2024-09-13T17:09:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c8806bdb0 0x7f2c8815e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c88072260 0x7f2c8815ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c880cb7e0 0x7f2c880c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c88162fb0 con 0x7f2c88072260 2024-09-13T17:09:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c88163290 con 0x7f2c8806bdb0 2024-09-13T17:09:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c88163570 con 0x7f2c880cb7e0 2024-09-13T17:09:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c85d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c88072260 0x7f2c8815ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c85d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c88072260 0x7f2c8815ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51564/0 (socket says 172.21.15.123:51564) 2024-09-13T17:09:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c85d9b700 1 -- 172.21.15.123:0/2761497389 learned_addr learned my addr 172.21.15.123:0/2761497389 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c86d9d700 1 --2- 172.21.15.123:0/2761497389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c880cb7e0 0x7f2c880c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c8659c700 1 --2- 172.21.15.123:0/2761497389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c8806bdb0 0x7f2c8815e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c85d9b700 1 -- 172.21.15.123:0/2761497389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c880cb7e0 msgr2=0x7f2c880c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c85d9b700 1 --2- 172.21.15.123:0/2761497389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c880cb7e0 0x7f2c880c4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c85d9b700 1 -- 172.21.15.123:0/2761497389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c8806bdb0 msgr2=0x7f2c8815e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c85d9b700 1 --2- 172.21.15.123:0/2761497389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c8806bdb0 0x7f2c8815e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c85d9b700 1 -- 172.21.15.123:0/2761497389 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c800094b0 con 0x7f2c88072260 2024-09-13T17:09:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.526+0000 7f2c85d9b700 1 --2- 172.21.15.123:0/2761497389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c88072260 0x7f2c8815ed40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800efc0 tx=0x7f2c7800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.530+0000 7f2c76ffd700 1 -- 172.21.15.123:0/2761497389 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78009b80 con 0x7f2c88072260 2024-09-13T17:09:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.530+0000 7f2c76ffd700 1 -- 172.21.15.123:0/2761497389 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7800f040 con 0x7f2c88072260 2024-09-13T17:09:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.530+0000 7f2c8759e700 1 -- 172.21.15.123:0/2761497389 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c88163850 con 0x7f2c88072260 2024-09-13T17:09:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.530+0000 7f2c76ffd700 1 -- 172.21.15.123:0/2761497389 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78014480 con 0x7f2c88072260 2024-09-13T17:09:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.530+0000 7f2c8759e700 1 -- 172.21.15.123:0/2761497389 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8815f280 con 0x7f2c88072260 2024-09-13T17:09:43.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.530+0000 7f2c8759e700 1 -- 172.21.15.123:0/2761497389 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c880c1480 con 0x7f2c88072260 2024-09-13T17:09:43.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.530+0000 7f2c76ffd700 1 -- 172.21.15.123:0/2761497389 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c780145e0 con 0x7f2c88072260 2024-09-13T17:09:43.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.530+0000 7f2c76ffd700 1 --2- 172.21.15.123:0/2761497389 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2c68066760 0x7f2c68068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.530+0000 7f2c76ffd700 1 -- 172.21.15.123:0/2761497389 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2c780851e0 con 0x7f2c88072260 2024-09-13T17:09:43.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.530+0000 7f2c8659c700 1 --2- 172.21.15.123:0/2761497389 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2c68066760 0x7f2c68068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.534+0000 7f2c8659c700 1 --2- 172.21.15.123:0/2761497389 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2c68066760 0x7f2c68068c20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c000f60 tx=0x7f2c7c009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:43.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.534+0000 7f2c76ffd700 1 -- 172.21.15.123:0/2761497389 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2c78052640 con 0x7f2c88072260 2024-09-13T17:09:43.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.706+0000 7f2c8759e700 1 -- 172.21.15.123:0/2761497389 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c880cc970 con 0x7f2c88072260 2024-09-13T17:09:43.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.706+0000 7f2c76ffd700 1 -- 172.21.15.123:0/2761497389 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c78055c60 con 0x7f2c88072260 2024-09-13T17:09:43.714 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:09:43.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.710+0000 7f2c8759e700 1 -- 172.21.15.123:0/2761497389 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2c68066760 msgr2=0x7f2c68068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.710+0000 7f2c8759e700 1 --2- 172.21.15.123:0/2761497389 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2c68066760 0x7f2c68068c20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c000f60 tx=0x7f2c7c009040 comp rx=0 tx=0).stop 2024-09-13T17:09:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.710+0000 7f2c8759e700 1 -- 172.21.15.123:0/2761497389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c88072260 msgr2=0x7f2c8815ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.710+0000 7f2c8759e700 1 --2- 172.21.15.123:0/2761497389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c88072260 0x7f2c8815ed40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800efc0 tx=0x7f2c7800c3a0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.710+0000 7f2c8759e700 1 -- 172.21.15.123:0/2761497389 shutdown_connections 2024-09-13T17:09:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.710+0000 7f2c8759e700 1 --2- 172.21.15.123:0/2761497389 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2c68066760 0x7f2c68068c20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.710+0000 7f2c8759e700 1 --2- 172.21.15.123:0/2761497389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c880cb7e0 0x7f2c880c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.710+0000 7f2c8759e700 1 --2- 172.21.15.123:0/2761497389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c88072260 0x7f2c8815ed40 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.710+0000 7f2c8759e700 1 --2- 172.21.15.123:0/2761497389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c8806bdb0 0x7f2c8815e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.710+0000 7f2c8759e700 1 -- 172.21.15.123:0/2761497389 >> 172.21.15.123:0/2761497389 conn(0x7f2c880b01d0 msgr2=0x7f2c880af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.710+0000 7f2c8759e700 1 -- 172.21.15.123:0/2761497389 shutdown_connections 2024-09-13T17:09:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.710+0000 7f2c8759e700 1 -- 172.21.15.123:0/2761497389 wait complete. 2024-09-13T17:09:43.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:09:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.842+0000 7feb09360700 1 Processor -- start 2024-09-13T17:09:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.842+0000 7feb09360700 1 -- start start 2024-09-13T17:09:43.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.842+0000 7feb09360700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb040d0f40 0x7feb040d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb09360700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb040d0cb0 con 0x7feb040cd5e0 2024-09-13T17:09:43.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb09360700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb040b0060 con 0x7feb040b58b0 2024-09-13T17:09:43.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb09360700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb040b0340 con 0x7feb040d0f40 2024-09-13T17:09:43.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb08b5f700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7feb040cd5e0 0x7feb040cda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41602/0 (socket says 172.21.15.123:41602) 2024-09-13T17:09:43.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb08b5f700 1 -- 172.21.15.123:0/1370332601 learned_addr learned my addr 172.21.15.123:0/1370332601 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:43.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb03fff700 1 --2- 172.21.15.123:0/1370332601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb040d0f40 0x7feb040d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887475822 0 0) 0x7feb040d0cb0 con 0x7feb040cd5e0 2024-09-13T17:09:43.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaec0035d0 con 0x7feb040cd5e0 2024-09-13T17:09:43.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942387708 0 0) 0x7feb040b0060 con 0x7feb040b58b0 2024-09-13T17:09:43.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb040d0cb0 con 0x7feb040b58b0 2024-09-13T17:09:43.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3101657666 0 0) 0x7feaec0035d0 con 0x7feb040cd5e0 2024-09-13T17:09:43.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb040d0f40 msgr2=0x7feb040d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:43.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 --2- 172.21.15.123:0/1370332601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb040d0f40 0x7feb040d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 >> v1:172.21.15.153:6789/0 conn(0x7feb040b58b0 legacy=0x7feb040d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb040b0620 con 0x7feb040cd5e0 2024-09-13T17:09:43.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7feafc0019f0 con 0x7feb040cd5e0 2024-09-13T17:09:43.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 >> v1:172.21.15.123:6789/0 conn(0x7feb040cd5e0 legacy=0x7feb040cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 --2- 172.21.15.123:0/1370332601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaec003be0 0x7feaec003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 --2- 172.21.15.123:0/1370332601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb040d0f40 0x7feaec004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 --2- 172.21.15.123:0/1370332601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaec004db0 0x7feaec005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb040b0340 con 0x7feaec004db0 2024-09-13T17:09:43.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec00bbc0 con 0x7feaec003be0 2024-09-13T17:09:43.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec00bd50 con 0x7feb040d0f40 2024-09-13T17:09:43.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb08b5f700 1 --2- 172.21.15.123:0/1370332601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaec004db0 0x7feaec005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb037fe700 1 --2- 172.21.15.123:0/1370332601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb040d0f40 0x7feaec004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb03fff700 1 --2- 172.21.15.123:0/1370332601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaec003be0 0x7feaec003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb037fe700 1 -- 172.21.15.123:0/1370332601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaec003be0 msgr2=0x7feaec003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:43.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb037fe700 1 --2- 172.21.15.123:0/1370332601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaec003be0 0x7feaec003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb037fe700 1 -- 172.21.15.123:0/1370332601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaec004db0 msgr2=0x7feaec005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:43.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb037fe700 1 --2- 172.21.15.123:0/1370332601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaec004db0 0x7feaec005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb037fe700 1 -- 172.21.15.123:0/1370332601 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec0035d0 con 0x7feb040d0f40 2024-09-13T17:09:43.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb08b5f700 1 --2- 172.21.15.123:0/1370332601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaec004db0 0x7feaec005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:43.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb037fe700 1 --2- 172.21.15.123:0/1370332601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb040d0f40 0x7feaec004870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feaf8001960 tx=0x7feaec0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbe85100f29e5f59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:43.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8001450 con 0x7feb040d0f40 2024-09-13T17:09:43.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf80052f0 con 0x7feb040d0f40 2024-09-13T17:09:43.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb02ffd700 1 -- 172.21.15.123:0/1370332601 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80036a0 con 0x7feb040d0f40 2024-09-13T17:09:43.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb09360700 1 -- 172.21.15.123:0/1370332601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb040d0f40 msgr2=0x7feaec004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb09360700 1 --2- 172.21.15.123:0/1370332601 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb040d0f40 0x7feaec004870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feaf8001960 tx=0x7feaec0058a0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb08b5f700 1 -- 172.21.15.123:0/1370332601 reap_dead start 2024-09-13T17:09:43.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb09360700 1 -- 172.21.15.123:0/1370332601 shutdown_connections 2024-09-13T17:09:43.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb09360700 1 -- 172.21.15.123:0/1370332601 >> 172.21.15.123:0/1370332601 conn(0x7feb040d2a60 msgr2=0x7feb040d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:43.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb09360700 1 -- 172.21.15.123:0/1370332601 shutdown_connections 2024-09-13T17:09:43.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.846+0000 7feb09360700 1 -- 172.21.15.123:0/1370332601 wait complete. 2024-09-13T17:09:43.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.850+0000 7feb09360700 1 Processor -- start 2024-09-13T17:09:43.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.850+0000 7feb09360700 1 -- start start 2024-09-13T17:09:43.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.850+0000 7feb09360700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb040d0f40 0x7feb0414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.850+0000 7feb09360700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040b5170 0x7feb040c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.850+0000 7feb09360700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb040c88c0 0x7feb040c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.850+0000 7feb09360700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb04150480 con 0x7feb040b5170 2024-09-13T17:09:43.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.850+0000 7feb09360700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb040cb500 con 0x7feb040c88c0 2024-09-13T17:09:43.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.850+0000 7feb09360700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb040cb7e0 con 0x7feb040d0f40 2024-09-13T17:09:43.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.850+0000 7feb037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040b5170 0x7feb040c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.850+0000 7feb037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040b5170 0x7feb040c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51578/0 (socket says 172.21.15.123:51578) 2024-09-13T17:09:43.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.850+0000 7feb037fe700 1 -- 172.21.15.123:0/2108296954 learned_addr learned my addr 172.21.15.123:0/2108296954 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:43.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.850+0000 7feb08b5f700 1 --2- 172.21.15.123:0/2108296954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb040c88c0 0x7feb040c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.850+0000 7feb03fff700 1 --2- 172.21.15.123:0/2108296954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb040d0f40 0x7feb0414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.854+0000 7feb037fe700 1 -- 172.21.15.123:0/2108296954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb040d0f40 msgr2=0x7feb0414ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.854+0000 7feb037fe700 1 --2- 172.21.15.123:0/2108296954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb040d0f40 0x7feb0414ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.854+0000 7feb037fe700 1 -- 172.21.15.123:0/2108296954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb040c88c0 msgr2=0x7feb040c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.854+0000 7feb037fe700 1 --2- 172.21.15.123:0/2108296954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb040c88c0 0x7feb040c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.854+0000 7feb037fe700 1 -- 172.21.15.123:0/2108296954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb040cbac0 con 0x7feb040b5170 2024-09-13T17:09:43.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.854+0000 7feb037fe700 1 --2- 172.21.15.123:0/2108296954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040b5170 0x7feb040c6c40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7feaf8005040 tx=0x7feaf80012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:43.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.854+0000 7feb00ff9700 1 -- 172.21.15.123:0/2108296954 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80013d0 con 0x7feb040b5170 2024-09-13T17:09:43.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.854+0000 7feb00ff9700 1 -- 172.21.15.123:0/2108296954 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf8007040 con 0x7feb040b5170 2024-09-13T17:09:43.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.854+0000 7feb09360700 1 -- 172.21.15.123:0/2108296954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb040cbda0 con 0x7feb040b5170 2024-09-13T17:09:43.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.854+0000 7feb00ff9700 1 -- 172.21.15.123:0/2108296954 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80073f0 con 0x7feb040b5170 2024-09-13T17:09:43.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.854+0000 7feb09360700 1 -- 172.21.15.123:0/2108296954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb040c9280 con 0x7feb040b5170 2024-09-13T17:09:43.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.854+0000 7feb09360700 1 -- 172.21.15.123:0/2108296954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0408c250 con 0x7feb040b5170 2024-09-13T17:09:43.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.854+0000 7feb00ff9700 1 -- 172.21.15.123:0/2108296954 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feaf8007550 con 0x7feb040b5170 2024-09-13T17:09:43.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.858+0000 7feb00ff9700 1 --2- 172.21.15.123:0/2108296954 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feaf0066760 0x7feaf0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:43.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.858+0000 7feb00ff9700 1 -- 172.21.15.123:0/2108296954 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7feaf8084d70 con 0x7feb040b5170 2024-09-13T17:09:43.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.858+0000 7feb03fff700 1 --2- 172.21.15.123:0/2108296954 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feaf0066760 0x7feaf0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:43.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.858+0000 7feb03fff700 1 --2- 172.21.15.123:0/2108296954 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feaf0066760 0x7feaf0068c20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009b10 tx=0x7feaf4009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:43.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:43.862+0000 7feb00ff9700 1 -- 172.21.15.123:0/2108296954 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feaf8052210 con 0x7feb040b5170 2024-09-13T17:09:44.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.030+0000 7feb09360700 1 -- 172.21.15.123:0/2108296954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb040b21a0 con 0x7feb040b5170 2024-09-13T17:09:44.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.030+0000 7feb00ff9700 1 -- 172.21.15.123:0/2108296954 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7feaf8055830 con 0x7feb040b5170 2024-09-13T17:09:44.037 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:09:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.034+0000 7feb09360700 1 -- 172.21.15.123:0/2108296954 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feaf0066760 msgr2=0x7feaf0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.034+0000 7feb09360700 1 --2- 172.21.15.123:0/2108296954 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feaf0066760 0x7feaf0068c20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009b10 tx=0x7feaf4009240 comp rx=0 tx=0).stop 2024-09-13T17:09:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.034+0000 7feb09360700 1 -- 172.21.15.123:0/2108296954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040b5170 msgr2=0x7feb040c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.034+0000 7feb09360700 1 --2- 172.21.15.123:0/2108296954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040b5170 0x7feb040c6c40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7feaf8005040 tx=0x7feaf80012d0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.034+0000 7feb09360700 1 -- 172.21.15.123:0/2108296954 shutdown_connections 2024-09-13T17:09:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.034+0000 7feb09360700 1 --2- 172.21.15.123:0/2108296954 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feaf0066760 0x7feaf0068c20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.034+0000 7feb09360700 1 --2- 172.21.15.123:0/2108296954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb040c88c0 0x7feb040c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.034+0000 7feb09360700 1 --2- 172.21.15.123:0/2108296954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb040b5170 0x7feb040c6c40 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.034+0000 7feb09360700 1 --2- 172.21.15.123:0/2108296954 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7feb040d0f40 0x7feb0414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.034+0000 7feb09360700 1 -- 172.21.15.123:0/2108296954 >> 172.21.15.123:0/2108296954 conn(0x7feb040d2a60 msgr2=0x7feb0415c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.034+0000 7feb09360700 1 -- 172.21.15.123:0/2108296954 shutdown_connections 2024-09-13T17:09:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.034+0000 7feb09360700 1 -- 172.21.15.123:0/2108296954 wait complete. 2024-09-13T17:09:44.053 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:09:44.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf08e6e700 1 Processor -- start 2024-09-13T17:09:44.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf08e6e700 1 -- start start 2024-09-13T17:09:44.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf08e6e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0415cd90 0x7faf040ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:44.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf08e6e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faf040c8ff0 0x7faf040cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:44.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf08e6e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf040ca550 con 0x7faf040cb510 2024-09-13T17:09:44.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf08e6e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf040ca130 con 0x7faf040c8ff0 2024-09-13T17:09:44.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf08e6e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf040cb9a0 con 0x7faf0415cd90 2024-09-13T17:09:44.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf02ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faf040c8ff0 0x7faf040cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:44.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf02ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faf040c8ff0 0x7faf040cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51584/0 (socket says 172.21.15.123:51584) 2024-09-13T17:09:44.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf02ffd700 1 -- 172.21.15.123:0/3445235640 learned_addr learned my addr 172.21.15.123:0/3445235640 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:44.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf037fe700 1 --2- 172.21.15.123:0/3445235640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0415cd90 0x7faf040ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf02ffd700 1 -- 172.21.15.123:0/3445235640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0415cd90 msgr2=0x7faf040ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf02ffd700 1 --2- 172.21.15.123:0/3445235640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0415cd90 0x7faf040ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf02ffd700 1 -- 172.21.15.123:0/3445235640 >> v1:172.21.15.123:6789/0 conn(0x7faf040cb510 legacy=0x7faf040ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf02ffd700 1 -- 172.21.15.123:0/3445235640 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040c94b0 con 0x7faf040c8ff0 2024-09-13T17:09:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf02ffd700 1 --2- 172.21.15.123:0/3445235640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf040c8ff0 0x7faf040cafd0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7faef4009910 tx=0x7faef4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08bc668eef28c2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf027fc700 1 -- 172.21.15.123:0/3445235640 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef400ba60 con 0x7faf040c8ff0 2024-09-13T17:09:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf027fc700 1 -- 172.21.15.123:0/3445235640 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef400bbc0 con 0x7faf040c8ff0 2024-09-13T17:09:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.166+0000 7faf027fc700 1 -- 172.21.15.123:0/3445235640 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4009e60 con 0x7faf040c8ff0 2024-09-13T17:09:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.170+0000 7faf08e6e700 1 -- 172.21.15.123:0/3445235640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf040c8ff0 msgr2=0x7faf040cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.170+0000 7faf08e6e700 1 --2- 172.21.15.123:0/3445235640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf040c8ff0 0x7faf040cafd0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7faef4009910 tx=0x7faef4009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.170+0000 7faf08e6e700 1 -- 172.21.15.123:0/3445235640 shutdown_connections 2024-09-13T17:09:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.170+0000 7faf08e6e700 1 --2- 172.21.15.123:0/3445235640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf040c8ff0 0x7faf040cafd0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.170+0000 7faf08e6e700 1 --2- 172.21.15.123:0/3445235640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0415cd90 0x7faf040ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.170+0000 7faf08e6e700 1 -- 172.21.15.123:0/3445235640 >> 172.21.15.123:0/3445235640 conn(0x7faf040b01d0 msgr2=0x7faf040b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:44.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.170+0000 7faf08e6e700 1 -- 172.21.15.123:0/3445235640 shutdown_connections 2024-09-13T17:09:44.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.170+0000 7faf08e6e700 1 -- 172.21.15.123:0/3445235640 wait complete. 2024-09-13T17:09:44.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.170+0000 7faf08e6e700 1 Processor -- start 2024-09-13T17:09:44.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.170+0000 7faf08e6e700 1 -- start start 2024-09-13T17:09:44.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.170+0000 7faf08e6e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf040c8ff0 0x7faf040b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:44.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf08e6e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf040cb510 0x7faf0415d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:44.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf08e6e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0415cd90 0x7faf04150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:44.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf08e6e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0415d8c0 con 0x7faf040c8ff0 2024-09-13T17:09:44.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf08e6e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0415dad0 con 0x7faf040cb510 2024-09-13T17:09:44.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf08e6e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0415ddb0 con 0x7faf0415cd90 2024-09-13T17:09:44.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf040c8ff0 0x7faf040b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:44.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf040c8ff0 0x7faf040b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51596/0 (socket says 172.21.15.123:51596) 2024-09-13T17:09:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf037fe700 1 -- 172.21.15.123:0/1096879352 learned_addr learned my addr 172.21.15.123:0/1096879352 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf03fff700 1 --2- 172.21.15.123:0/1096879352 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0415cd90 0x7faf04150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf02ffd700 1 --2- 172.21.15.123:0/1096879352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf040cb510 0x7faf0415d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf037fe700 1 -- 172.21.15.123:0/1096879352 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0415cd90 msgr2=0x7faf04150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf037fe700 1 --2- 172.21.15.123:0/1096879352 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0415cd90 0x7faf04150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf037fe700 1 -- 172.21.15.123:0/1096879352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf040cb510 msgr2=0x7faf0415d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf037fe700 1 --2- 172.21.15.123:0/1096879352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf040cb510 0x7faf0415d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf037fe700 1 -- 172.21.15.123:0/1096879352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4009570 con 0x7faf040c8ff0 2024-09-13T17:09:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf037fe700 1 --2- 172.21.15.123:0/1096879352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf040c8ff0 0x7faf040b4120 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7faef800d800 tx=0x7faef800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faeebfff700 1 -- 172.21.15.123:0/1096879352 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef80125f0 con 0x7faf040c8ff0 2024-09-13T17:09:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faeebfff700 1 -- 172.21.15.123:0/1096879352 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef8012750 con 0x7faf040c8ff0 2024-09-13T17:09:44.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf08e6e700 1 -- 172.21.15.123:0/1096879352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0415e090 con 0x7faf040c8ff0 2024-09-13T17:09:44.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faeebfff700 1 -- 172.21.15.123:0/1096879352 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8012ac0 con 0x7faf040c8ff0 2024-09-13T17:09:44.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf08e6e700 1 -- 172.21.15.123:0/1096879352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0415e650 con 0x7faf040c8ff0 2024-09-13T17:09:44.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faf08e6e700 1 -- 172.21.15.123:0/1096879352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0415d170 con 0x7faf040c8ff0 2024-09-13T17:09:44.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.174+0000 7faeebfff700 1 -- 172.21.15.123:0/1096879352 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faef8012c20 con 0x7faf040c8ff0 2024-09-13T17:09:44.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.178+0000 7faeebfff700 1 --2- 172.21.15.123:0/1096879352 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faef0066730 0x7faef0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:44.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.178+0000 7faeebfff700 1 -- 172.21.15.123:0/1096879352 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7faef80841e0 con 0x7faf040c8ff0 2024-09-13T17:09:44.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.178+0000 7faf02ffd700 1 --2- 172.21.15.123:0/1096879352 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faef0066730 0x7faef0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:44.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.178+0000 7faf02ffd700 1 --2- 172.21.15.123:0/1096879352 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faef0066730 0x7faef0068bf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7faef4000c00 tx=0x7faef4008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.182+0000 7faeebfff700 1 -- 172.21.15.123:0/1096879352 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faef8051560 con 0x7faf040c8ff0 2024-09-13T17:09:44.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.350+0000 7faf08e6e700 1 -- 172.21.15.123:0/1096879352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf0406dd70 con 0x7faf040c8ff0 2024-09-13T17:09:44.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.354+0000 7faeebfff700 1 -- 172.21.15.123:0/1096879352 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7faef8054b80 con 0x7faf040c8ff0 2024-09-13T17:09:44.359 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:09:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.354+0000 7faf08e6e700 1 -- 172.21.15.123:0/1096879352 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faef0066730 msgr2=0x7faef0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.354+0000 7faf08e6e700 1 --2- 172.21.15.123:0/1096879352 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faef0066730 0x7faef0068bf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7faef4000c00 tx=0x7faef4008030 comp rx=0 tx=0).stop 2024-09-13T17:09:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.354+0000 7faf08e6e700 1 -- 172.21.15.123:0/1096879352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf040c8ff0 msgr2=0x7faf040b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.354+0000 7faf08e6e700 1 --2- 172.21.15.123:0/1096879352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf040c8ff0 0x7faf040b4120 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7faef800d800 tx=0x7faef800db10 comp rx=0 tx=0).stop 2024-09-13T17:09:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.354+0000 7faf08e6e700 1 -- 172.21.15.123:0/1096879352 shutdown_connections 2024-09-13T17:09:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.354+0000 7faf08e6e700 1 --2- 172.21.15.123:0/1096879352 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faef0066730 0x7faef0068bf0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.354+0000 7faf08e6e700 1 --2- 172.21.15.123:0/1096879352 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf0415cd90 0x7faf04150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.354+0000 7faf08e6e700 1 --2- 172.21.15.123:0/1096879352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf040cb510 0x7faf0415d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.354+0000 7faf08e6e700 1 --2- 172.21.15.123:0/1096879352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf040c8ff0 0x7faf040b4120 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.354+0000 7faf08e6e700 1 -- 172.21.15.123:0/1096879352 >> 172.21.15.123:0/1096879352 conn(0x7faf040b01d0 msgr2=0x7faf040ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.354+0000 7faf08e6e700 1 -- 172.21.15.123:0/1096879352 shutdown_connections 2024-09-13T17:09:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.354+0000 7faf08e6e700 1 -- 172.21.15.123:0/1096879352 wait complete. 2024-09-13T17:09:44.374 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:09:44.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb45448700 1 Processor -- start 2024-09-13T17:09:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb45448700 1 -- start start 2024-09-13T17:09:44.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb45448700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb4006f990 0x7fbb4006da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb45448700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbb4015d080 0x7fbb4015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb45448700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4015da30 con 0x7fbb401570a0 2024-09-13T17:09:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb45448700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb40072760 con 0x7fbb4015d080 2024-09-13T17:09:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb45448700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4006cf40 con 0x7fbb4006f990 2024-09-13T17:09:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb44c47700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbb4015d080 0x7fbb4015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb44c47700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbb4015d080 0x7fbb4015d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51604/0 (socket says 172.21.15.123:51604) 2024-09-13T17:09:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb44c47700 1 -- 172.21.15.123:0/506019179 learned_addr learned my addr 172.21.15.123:0/506019179 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb3ffff700 1 --1- 172.21.15.123:0/506019179 >> v1:172.21.15.153:6789/0 conn(0x7fbb401570a0 0x7fbb4006f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:59286/0 (socket says 172.21.15.123:59286) 2024-09-13T17:09:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb3f7fe700 1 --2- 172.21.15.123:0/506019179 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb4006f990 0x7fbb4006da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb44c47700 1 -- 172.21.15.123:0/506019179 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb4006f990 msgr2=0x7fbb4006da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb44c47700 1 --2- 172.21.15.123:0/506019179 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb4006f990 0x7fbb4006da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb44c47700 1 -- 172.21.15.123:0/506019179 >> v1:172.21.15.153:6789/0 conn(0x7fbb401570a0 legacy=0x7fbb4006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb3effd700 1 -- 172.21.15.123:0/506019179 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320855781 0 0) 0x7fbb4015da30 con 0x7fbb401570a0 2024-09-13T17:09:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb44c47700 1 -- 172.21.15.123:0/506019179 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4015dc90 con 0x7fbb4015d080 2024-09-13T17:09:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb44c47700 1 --2- 172.21.15.123:0/506019179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4015d080 0x7fbb4015d4f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009910 tx=0x7fbb30009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c3629859f0f0cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb3effd700 1 -- 172.21.15.123:0/506019179 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30011830 con 0x7fbb4015d080 2024-09-13T17:09:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb3effd700 1 -- 172.21.15.123:0/506019179 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb30011990 con 0x7fbb4015d080 2024-09-13T17:09:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb3effd700 1 -- 172.21.15.123:0/506019179 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30011d40 con 0x7fbb4015d080 2024-09-13T17:09:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb45448700 1 -- 172.21.15.123:0/506019179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4015d080 msgr2=0x7fbb4015d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.486+0000 7fbb45448700 1 --2- 172.21.15.123:0/506019179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4015d080 0x7fbb4015d4f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009910 tx=0x7fbb30009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.490+0000 7fbb45448700 1 -- 172.21.15.123:0/506019179 shutdown_connections 2024-09-13T17:09:44.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.490+0000 7fbb45448700 1 --2- 172.21.15.123:0/506019179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb4015d080 0x7fbb4015d4f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.490+0000 7fbb45448700 1 --2- 172.21.15.123:0/506019179 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb4006f990 0x7fbb4006da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.490+0000 7fbb45448700 1 -- 172.21.15.123:0/506019179 >> 172.21.15.123:0/506019179 conn(0x7fbb40066780 msgr2=0x7fbb400719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:44.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.490+0000 7fbb45448700 1 -- 172.21.15.123:0/506019179 shutdown_connections 2024-09-13T17:09:44.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.490+0000 7fbb45448700 1 -- 172.21.15.123:0/506019179 wait complete. 2024-09-13T17:09:44.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.490+0000 7fbb45448700 1 Processor -- start 2024-09-13T17:09:44.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.490+0000 7fbb45448700 1 -- start start 2024-09-13T17:09:44.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb45448700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb4006f990 0x7fbb40152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:44.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb45448700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb401570a0 0x7fbb401585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:44.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb45448700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb4015d080 0x7fbb401460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:44.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb45448700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40153b10 con 0x7fbb401570a0 2024-09-13T17:09:44.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb45448700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40158ae0 con 0x7fbb4015d080 2024-09-13T17:09:44.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb45448700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40152e90 con 0x7fbb4006f990 2024-09-13T17:09:44.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb401570a0 0x7fbb401585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb401570a0 0x7fbb401585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51608/0 (socket says 172.21.15.123:51608) 2024-09-13T17:09:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3f7fe700 1 -- 172.21.15.123:0/4262139342 learned_addr learned my addr 172.21.15.123:0/4262139342 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3ffff700 1 --2- 172.21.15.123:0/4262139342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb4006f990 0x7fbb40152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb44c47700 1 --2- 172.21.15.123:0/4262139342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb4015d080 0x7fbb401460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3f7fe700 1 -- 172.21.15.123:0/4262139342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb4006f990 msgr2=0x7fbb40152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3f7fe700 1 --2- 172.21.15.123:0/4262139342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb4006f990 0x7fbb40152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3f7fe700 1 -- 172.21.15.123:0/4262139342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb4015d080 msgr2=0x7fbb401460e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3f7fe700 1 --2- 172.21.15.123:0/4262139342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb4015d080 0x7fbb401460e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3f7fe700 1 -- 172.21.15.123:0/4262139342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb30009570 con 0x7fbb401570a0 2024-09-13T17:09:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3f7fe700 1 --2- 172.21.15.123:0/4262139342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb401570a0 0x7fbb401585a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800efc0 tx=0x7fbb3800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3cff9700 1 -- 172.21.15.123:0/4262139342 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3800caf0 con 0x7fbb401570a0 2024-09-13T17:09:44.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3cff9700 1 -- 172.21.15.123:0/4262139342 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3800f040 con 0x7fbb401570a0 2024-09-13T17:09:44.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3cff9700 1 -- 172.21.15.123:0/4262139342 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3800ce70 con 0x7fbb401570a0 2024-09-13T17:09:44.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb45448700 1 -- 172.21.15.123:0/4262139342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb40153170 con 0x7fbb401570a0 2024-09-13T17:09:44.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb45448700 1 -- 172.21.15.123:0/4262139342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb40153730 con 0x7fbb401570a0 2024-09-13T17:09:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb45448700 1 -- 172.21.15.123:0/4262139342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb40153c50 con 0x7fbb401570a0 2024-09-13T17:09:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3cff9700 1 -- 172.21.15.123:0/4262139342 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbb38014480 con 0x7fbb401570a0 2024-09-13T17:09:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3cff9700 1 --2- 172.21.15.123:0/4262139342 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb2c066730 0x7fbb2c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3cff9700 1 -- 172.21.15.123:0/4262139342 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbb38084c10 con 0x7fbb401570a0 2024-09-13T17:09:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.494+0000 7fbb3ffff700 1 --2- 172.21.15.123:0/4262139342 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb2c066730 0x7fbb2c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.498+0000 7fbb3ffff700 1 --2- 172.21.15.123:0/4262139342 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb2c066730 0x7fbb2c068bf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbb34000f60 tx=0x7fbb34007e00 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:44.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.502+0000 7fbb3cff9700 1 -- 172.21.15.123:0/4262139342 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbb40153c50 con 0x7fbb401570a0 2024-09-13T17:09:44.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.682+0000 7fbb45448700 1 -- 172.21.15.123:0/4262139342 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbb40153c50 con 0x7fbb401570a0 2024-09-13T17:09:44.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.682+0000 7fbb3cff9700 1 -- 172.21.15.123:0/4262139342 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbb40153c50 con 0x7fbb401570a0 2024-09-13T17:09:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.686+0000 7fbb45448700 1 -- 172.21.15.123:0/4262139342 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb2c066730 msgr2=0x7fbb2c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:44.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.686+0000 7fbb45448700 1 --2- 172.21.15.123:0/4262139342 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb2c066730 0x7fbb2c068bf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbb34000f60 tx=0x7fbb34007e00 comp rx=0 tx=0).stop 2024-09-13T17:09:44.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.686+0000 7fbb45448700 1 -- 172.21.15.123:0/4262139342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb401570a0 msgr2=0x7fbb401585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:44.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.686+0000 7fbb45448700 1 --2- 172.21.15.123:0/4262139342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb401570a0 0x7fbb401585a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800efc0 tx=0x7fbb3800c0c0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.686+0000 7fbb45448700 1 -- 172.21.15.123:0/4262139342 shutdown_connections 2024-09-13T17:09:44.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.686+0000 7fbb45448700 1 --2- 172.21.15.123:0/4262139342 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb2c066730 0x7fbb2c068bf0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.686+0000 7fbb45448700 1 --2- 172.21.15.123:0/4262139342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb4015d080 0x7fbb401460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.686+0000 7fbb45448700 1 --2- 172.21.15.123:0/4262139342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb401570a0 0x7fbb401585a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.686+0000 7fbb45448700 1 --2- 172.21.15.123:0/4262139342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb4006f990 0x7fbb40152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:44.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.686+0000 7fbb45448700 1 -- 172.21.15.123:0/4262139342 >> 172.21.15.123:0/4262139342 conn(0x7fbb40066780 msgr2=0x7fbb4015e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:44.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.686+0000 7fbb45448700 1 -- 172.21.15.123:0/4262139342 shutdown_connections 2024-09-13T17:09:44.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:44.686+0000 7fbb45448700 1 -- 172.21.15.123:0/4262139342 wait complete. 2024-09-13T17:09:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:09:44.706 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-09-13T17:09:44.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:44.706 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:09:44.720 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33436]: fuse finished with error 0 and tester_r 0 2024-09-13T17:09:44.722 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:09:44.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:44.722 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:09:44.889 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:09:44.889 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:44.897 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:09:44.897 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:09:44.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:44.897 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:09:44.904 INFO:teuthology.orchestra.run.smithi123.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T17:09:44.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:09:44.905 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:09:44.905 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:44.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:09:44.913 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:09:44.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:09:44.913 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:09:44.962 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T17:09:44.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:09:44.963 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:09:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.078+0000 7fcca5dd0700 1 Processor -- start 2024-09-13T17:09:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.078+0000 7fcca5dd0700 1 -- start start 2024-09-13T17:09:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.078+0000 7fcca5dd0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcca015e920 0x7fcca00caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.078+0000 7fcca5dd0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca0162550 con 0x7fcca00cb020 2024-09-13T17:09:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.078+0000 7fcca5dd0700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca00cd690 con 0x7fcca015ed00 2024-09-13T17:09:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.078+0000 7fcca5dd0700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca0161f90 con 0x7fcca015e920 2024-09-13T17:09:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcca4dce700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcca015e920 0x7fcca00caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcc9ffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcca00cb020 0x7fcca0161540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41632/0 (socket says 172.21.15.123:41632) 2024-09-13T17:09:45.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcc9ffff700 1 -- 172.21.15.123:0/855003406 learned_addr learned my addr 172.21.15.123:0/855003406 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcc9f7fe700 1 -- 172.21.15.123:0/855003406 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796974445 0 0) 0x7fcca0162550 con 0x7fcca00cb020 2024-09-13T17:09:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcc9f7fe700 1 -- 172.21.15.123:0/855003406 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc880035d0 con 0x7fcca00cb020 2024-09-13T17:09:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcca4dce700 1 -- 172.21.15.123:0/855003406 >> v1:172.21.15.153:6789/0 conn(0x7fcca015ed00 legacy=0x7fcca00cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcca4dce700 1 -- 172.21.15.123:0/855003406 >> v1:172.21.15.123:6789/0 conn(0x7fcca00cb020 legacy=0x7fcca0161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcca4dce700 1 -- 172.21.15.123:0/855003406 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca0162270 con 0x7fcca015e920 2024-09-13T17:09:45.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcca4dce700 1 --2- 172.21.15.123:0/855003406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcca015e920 0x7fcca00caae0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009850 tx=0x7fcc90009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794f109d065ce90f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:45.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcc9f7fe700 1 -- 172.21.15.123:0/855003406 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90011830 con 0x7fcca015e920 2024-09-13T17:09:45.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcc9f7fe700 1 -- 172.21.15.123:0/855003406 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc90011990 con 0x7fcca015e920 2024-09-13T17:09:45.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcc9f7fe700 1 -- 172.21.15.123:0/855003406 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90011d40 con 0x7fcca015e920 2024-09-13T17:09:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcca5dd0700 1 -- 172.21.15.123:0/855003406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcca015e920 msgr2=0x7fcca00caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcca5dd0700 1 --2- 172.21.15.123:0/855003406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcca015e920 0x7fcca00caae0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009850 tx=0x7fcc90009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcca5dd0700 1 -- 172.21.15.123:0/855003406 shutdown_connections 2024-09-13T17:09:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcca5dd0700 1 --2- 172.21.15.123:0/855003406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcca015e920 0x7fcca00caae0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcca5dd0700 1 -- 172.21.15.123:0/855003406 >> 172.21.15.123:0/855003406 conn(0x7fcca0066150 msgr2=0x7fcca0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcca5dd0700 1 -- 172.21.15.123:0/855003406 shutdown_connections 2024-09-13T17:09:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcca5dd0700 1 -- 172.21.15.123:0/855003406 wait complete. 2024-09-13T17:09:45.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcca5dd0700 1 Processor -- start 2024-09-13T17:09:45.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.082+0000 7fcca5dd0700 1 -- start start 2024-09-13T17:09:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca5dd0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcca00cb020 0x7fcca00aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca5dd0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcca015e920 0x7fcca0150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca5dd0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca015ed00 0x7fcca01eb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca5dd0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00a9fa0 con 0x7fcca00cb020 2024-09-13T17:09:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca5dd0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00a9320 con 0x7fcca015ed00 2024-09-13T17:09:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca5dd0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00a9600 con 0x7fcca015e920 2024-09-13T17:09:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca4dce700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcca00cb020 0x7fcca00aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca4dce700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcca00cb020 0x7fcca00aa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51628/0 (socket says 172.21.15.123:51628) 2024-09-13T17:09:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca4dce700 1 -- 172.21.15.123:0/671894997 learned_addr learned my addr 172.21.15.123:0/671894997 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcc9ffff700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcca015e920 0x7fcca0150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca55cf700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca015ed00 0x7fcca01eb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca4dce700 1 -- 172.21.15.123:0/671894997 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcca015e920 msgr2=0x7fcca0150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca4dce700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcca015e920 0x7fcca0150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca4dce700 1 -- 172.21.15.123:0/671894997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca015ed00 msgr2=0x7fcca01eb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca4dce700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca015ed00 0x7fcca01eb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca4dce700 1 -- 172.21.15.123:0/671894997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc900094b0 con 0x7fcca00cb020 2024-09-13T17:09:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca55cf700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca015ed00 0x7fcca01eb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca4dce700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcca00cb020 0x7fcca00aa3c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fcc90000c00 tx=0x7fcc90004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:45.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcc9d7fa700 1 -- 172.21.15.123:0/671894997 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9001aa10 con 0x7fcca00cb020 2024-09-13T17:09:45.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcc9d7fa700 1 -- 172.21.15.123:0/671894997 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9001f070 con 0x7fcca00cb020 2024-09-13T17:09:45.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca5dd0700 1 -- 172.21.15.123:0/671894997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca00a98e0 con 0x7fcca00cb020 2024-09-13T17:09:45.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcc9d7fa700 1 -- 172.21.15.123:0/671894997 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9001adb0 con 0x7fcca00cb020 2024-09-13T17:09:45.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.086+0000 7fcca5dd0700 1 -- 172.21.15.123:0/671894997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca01510d0 con 0x7fcca00cb020 2024-09-13T17:09:45.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.090+0000 7fcca5dd0700 1 -- 172.21.15.123:0/671894997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca00677f0 con 0x7fcca00cb020 2024-09-13T17:09:45.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.090+0000 7fcc9d7fa700 1 -- 172.21.15.123:0/671894997 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcc9001b430 con 0x7fcca00cb020 2024-09-13T17:09:45.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.090+0000 7fcc9d7fa700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcc8c066730 0x7fcc8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.090+0000 7fcc9d7fa700 1 -- 172.21.15.123:0/671894997 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcc90085340 con 0x7fcca00cb020 2024-09-13T17:09:45.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.090+0000 7fcc9ffff700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcc8c066730 0x7fcc8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.090+0000 7fcc9ffff700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcc8c066730 0x7fcc8c068bf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcca006d720 tx=0x7fcc94007de0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.098+0000 7fcc9d7fa700 1 -- 172.21.15.123:0/671894997 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcc90052620 con 0x7fcca00cb020 2024-09-13T17:09:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.290+0000 7fcca5dd0700 1 -- 172.21.15.123:0/671894997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcca00aa210 con 0x7fcca00cb020 2024-09-13T17:09:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.290+0000 7fcc9d7fa700 1 -- 172.21.15.123:0/671894997 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4748 (secure 0 0 0) 0x7fcc90021090 con 0x7fcca00cb020 2024-09-13T17:09:45.296 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:45.296 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3155329877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3155329877},{"type":"v1","addr":"172.21.15.153:6835","nonce":3155329877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6522,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3484528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3484528665},{"type":"v1","addr":"172.21.15.123:6835","nonce":3484528665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6525,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/4217126083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":4217126083},{"type":"v1","addr":"172.21.15.123:6837","nonce":4217126083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:09:18.926234+0000","modified":"2024-09-13T17:09:21.936807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6534":{"gid":6534,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6833/1222139823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1222139823},{"type":"v1","addr":"172.21.15.153:6833","nonce":1222139823}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T17:09:45.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.294+0000 7fcca5dd0700 1 -- 172.21.15.123:0/671894997 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcc8c066730 msgr2=0x7fcc8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.294+0000 7fcca5dd0700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcc8c066730 0x7fcc8c068bf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcca006d720 tx=0x7fcc94007de0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.294+0000 7fcca5dd0700 1 -- 172.21.15.123:0/671894997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcca00cb020 msgr2=0x7fcca00aa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.294+0000 7fcca5dd0700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcca00cb020 0x7fcca00aa3c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fcc90000c00 tx=0x7fcc90004770 comp rx=0 tx=0).stop 2024-09-13T17:09:45.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.294+0000 7fcca5dd0700 1 -- 172.21.15.123:0/671894997 shutdown_connections 2024-09-13T17:09:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.294+0000 7fcca5dd0700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcc8c066730 0x7fcc8c068bf0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.294+0000 7fcca5dd0700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca015ed00 0x7fcca01eb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.294+0000 7fcca5dd0700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcca015e920 0x7fcca0150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.294+0000 7fcca5dd0700 1 --2- 172.21.15.123:0/671894997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcca00cb020 0x7fcca00aa3c0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.294+0000 7fcca5dd0700 1 -- 172.21.15.123:0/671894997 >> 172.21.15.123:0/671894997 conn(0x7fcca0066150 msgr2=0x7fcca006d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.294+0000 7fcca5dd0700 1 -- 172.21.15.123:0/671894997 shutdown_connections 2024-09-13T17:09:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.294+0000 7fcca5dd0700 1 -- 172.21.15.123:0/671894997 wait complete. 2024-09-13T17:09:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 35 2024-09-13T17:09:45.310 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:45.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.406+0000 7f4702099700 1 Processor -- start 2024-09-13T17:09:45.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.406+0000 7f4702099700 1 -- start start 2024-09-13T17:09:45.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4702099700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46fc153390 0x7f46fc159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4702099700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46fc0cdb70 0x7f46fc0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4702099700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46fc15a4c0 con 0x7f46fc153770 2024-09-13T17:09:45.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4702099700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46fc1595a0 con 0x7f46fc153390 2024-09-13T17:09:45.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4702099700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc0cb730 con 0x7f46fc0cdb70 2024-09-13T17:09:45.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4701097700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46fc153390 0x7f46fc159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4700896700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46fc0cdb70 0x7f46fc0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4701898700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f46fc153770 0x7f46fc0ad700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:59316/0 (socket says 172.21.15.123:59316) 2024-09-13T17:09:45.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4701898700 1 -- 172.21.15.123:0/1707848347 learned_addr learned my addr 172.21.15.123:0/1707848347 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:45.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4701097700 1 -- 172.21.15.123:0/1707848347 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46fc0cdb70 msgr2=0x7f46fc0cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:45.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4701097700 1 --2- 172.21.15.123:0/1707848347 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46fc0cdb70 0x7f46fc0cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4701097700 1 -- 172.21.15.123:0/1707848347 >> v1:172.21.15.153:6789/0 conn(0x7f46fc153770 legacy=0x7f46fc0ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4701097700 1 -- 172.21.15.123:0/1707848347 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc0cba10 con 0x7f46fc153390 2024-09-13T17:09:45.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f46f3fff700 1 -- 172.21.15.123:0/1707848347 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951404354 0 0) 0x7f46fc15a4c0 con 0x7f46fc153770 2024-09-13T17:09:45.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4701097700 1 --2- 172.21.15.123:0/1707848347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc153390 0x7f46fc159f80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009850 tx=0x7f46f8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bb1417f35c29202 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:45.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f46f3fff700 1 -- 172.21.15.123:0/1707848347 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8011830 con 0x7f46fc153390 2024-09-13T17:09:45.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f46f3fff700 1 -- 172.21.15.123:0/1707848347 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f8011990 con 0x7f46fc153390 2024-09-13T17:09:45.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f46f3fff700 1 -- 172.21.15.123:0/1707848347 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8011d40 con 0x7f46fc153390 2024-09-13T17:09:45.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4702099700 1 -- 172.21.15.123:0/1707848347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc153390 msgr2=0x7f46fc159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4702099700 1 --2- 172.21.15.123:0/1707848347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc153390 0x7f46fc159f80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009850 tx=0x7f46f8009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:45.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4702099700 1 -- 172.21.15.123:0/1707848347 shutdown_connections 2024-09-13T17:09:45.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4702099700 1 --2- 172.21.15.123:0/1707848347 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46fc0cdb70 0x7f46fc0cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4702099700 1 --2- 172.21.15.123:0/1707848347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc153390 0x7f46fc159f80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4702099700 1 -- 172.21.15.123:0/1707848347 >> 172.21.15.123:0/1707848347 conn(0x7f46fc066150 msgr2=0x7f46fc066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:45.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4702099700 1 -- 172.21.15.123:0/1707848347 shutdown_connections 2024-09-13T17:09:45.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.410+0000 7f4702099700 1 -- 172.21.15.123:0/1707848347 wait complete. 2024-09-13T17:09:45.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4702099700 1 Processor -- start 2024-09-13T17:09:45.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4702099700 1 -- start start 2024-09-13T17:09:45.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4702099700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46fc0cdb70 0x7f46fc156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4702099700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc153390 0x7f46fc0a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4702099700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46fc153770 0x7f46fc14d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4702099700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc154400 con 0x7f46fc0cdb70 2024-09-13T17:09:45.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4702099700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc1546e0 con 0x7f46fc153390 2024-09-13T17:09:45.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4702099700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc1549c0 con 0x7f46fc153770 2024-09-13T17:09:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4701097700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46fc0cdb70 0x7f46fc156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4701097700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46fc0cdb70 0x7f46fc156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51636/0 (socket says 172.21.15.123:51636) 2024-09-13T17:09:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4701097700 1 -- 172.21.15.123:0/345981262 learned_addr learned my addr 172.21.15.123:0/345981262 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4701898700 1 --2- 172.21.15.123:0/345981262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46fc153770 0x7f46fc14d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4700896700 1 --2- 172.21.15.123:0/345981262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc153390 0x7f46fc0a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4701097700 1 -- 172.21.15.123:0/345981262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46fc153770 msgr2=0x7f46fc14d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4701097700 1 --2- 172.21.15.123:0/345981262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46fc153770 0x7f46fc14d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4701097700 1 -- 172.21.15.123:0/345981262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc153390 msgr2=0x7f46fc0a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4701097700 1 --2- 172.21.15.123:0/345981262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc153390 0x7f46fc0a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4701097700 1 -- 172.21.15.123:0/345981262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f80094b0 con 0x7f46fc0cdb70 2024-09-13T17:09:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4701097700 1 --2- 172.21.15.123:0/345981262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46fc0cdb70 0x7f46fc156cb0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f46f80090b0 tx=0x7f46f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f46f1ffb700 1 -- 172.21.15.123:0/345981262 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f801aac0 con 0x7f46fc0cdb70 2024-09-13T17:09:45.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4702099700 1 -- 172.21.15.123:0/345981262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc154ca0 con 0x7f46fc0cdb70 2024-09-13T17:09:45.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f4702099700 1 -- 172.21.15.123:0/345981262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc154090 con 0x7f46fc0cdb70 2024-09-13T17:09:45.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f46f1ffb700 1 -- 172.21.15.123:0/345981262 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f801f070 con 0x7f46fc0cdb70 2024-09-13T17:09:45.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.414+0000 7f46f1ffb700 1 -- 172.21.15.123:0/345981262 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f801ae60 con 0x7f46fc0cdb70 2024-09-13T17:09:45.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.418+0000 7f4702099700 1 -- 172.21.15.123:0/345981262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46fc0677f0 con 0x7f46fc0cdb70 2024-09-13T17:09:45.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.418+0000 7f46f1ffb700 1 -- 172.21.15.123:0/345981262 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f46f801b430 con 0x7f46fc0cdb70 2024-09-13T17:09:45.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.418+0000 7f46f1ffb700 1 --2- 172.21.15.123:0/345981262 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f46e0066760 0x7f46e0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.418+0000 7f46f1ffb700 1 -- 172.21.15.123:0/345981262 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f46f8085af0 con 0x7f46fc0cdb70 2024-09-13T17:09:45.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.418+0000 7f4700896700 1 --2- 172.21.15.123:0/345981262 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f46e0066760 0x7f46e0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.422+0000 7f4700896700 1 --2- 172.21.15.123:0/345981262 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f46e0066760 0x7f46e0068c20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f46fc152280 tx=0x7f46ec008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:45.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.426+0000 7f46f1ffb700 1 -- 172.21.15.123:0/345981262 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f46f8052f50 con 0x7f46fc0cdb70 2024-09-13T17:09:45.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.594+0000 7f4702099700 1 -- 172.21.15.123:0/345981262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46fc1551c0 con 0x7f46fc0cdb70 2024-09-13T17:09:45.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.598+0000 7f46f1ffb700 1 -- 172.21.15.123:0/345981262 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16808 (secure 0 0 0) 0x7f46fc1551c0 con 0x7f46fc0cdb70 2024-09-13T17:09:45.605 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:45.605 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":74,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:09:32.997963+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:17.328080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:17.920002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1","mappings":[{"from":6,"to":0}]},{"pgid":"11.9","mappings":[{"from":6,"to":5}]},{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.33","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.602+0000 7f4702099700 1 -- 172.21.15.123:0/345981262 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f46e0066760 msgr2=0x7f46e0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.602+0000 7f4702099700 1 --2- 172.21.15.123:0/345981262 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f46e0066760 0x7f46e0068c20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f46fc152280 tx=0x7f46ec008040 comp rx=0 tx=0).stop 2024-09-13T17:09:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.602+0000 7f4702099700 1 -- 172.21.15.123:0/345981262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46fc0cdb70 msgr2=0x7f46fc156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.602+0000 7f4702099700 1 --2- 172.21.15.123:0/345981262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46fc0cdb70 0x7f46fc156cb0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f46f80090b0 tx=0x7f46f8004770 comp rx=0 tx=0).stop 2024-09-13T17:09:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.602+0000 7f4702099700 1 -- 172.21.15.123:0/345981262 shutdown_connections 2024-09-13T17:09:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.602+0000 7f4702099700 1 --2- 172.21.15.123:0/345981262 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f46e0066760 0x7f46e0068c20 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.602+0000 7f4702099700 1 --2- 172.21.15.123:0/345981262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46fc153770 0x7f46fc14d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.602+0000 7f4702099700 1 --2- 172.21.15.123:0/345981262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc153390 0x7f46fc0a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.602+0000 7f4702099700 1 --2- 172.21.15.123:0/345981262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46fc0cdb70 0x7f46fc156cb0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.602+0000 7f4702099700 1 -- 172.21.15.123:0/345981262 >> 172.21.15.123:0/345981262 conn(0x7f46fc066150 msgr2=0x7f46fc0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.602+0000 7f4702099700 1 -- 172.21.15.123:0/345981262 shutdown_connections 2024-09-13T17:09:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.602+0000 7f4702099700 1 -- 172.21.15.123:0/345981262 wait complete. 2024-09-13T17:09:45.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:09:17.328080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:09:17.920002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:09:45.620 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:09:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff90a7d5700 1 Processor -- start 2024-09-13T17:09:45.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff90a7d5700 1 -- start start 2024-09-13T17:09:45.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff90a7d5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9040b3990 0x7ff9040cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff90a7d5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff9040ccac0 0x7ff9040cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff90a7d5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff9040cb5b0 0x7ff90415e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff90a7d5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9040ccf00 con 0x7ff9040ccac0 2024-09-13T17:09:45.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff90a7d5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9040cb9f0 con 0x7ff9040cb5b0 2024-09-13T17:09:45.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff90a7d5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9040ce180 con 0x7ff9040b3990 2024-09-13T17:09:45.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff908fd2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff9040ccac0 0x7ff9040cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff908fd2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff9040ccac0 0x7ff9040cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51652/0 (socket says 172.21.15.123:51652) 2024-09-13T17:09:45.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff908fd2700 1 -- 172.21.15.123:0/1989506902 learned_addr learned my addr 172.21.15.123:0/1989506902 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:45.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff909fd4700 1 --2- 172.21.15.123:0/1989506902 >> v2:172.21.15.153:3300/0 conn(0x7ff9040cb5b0 0x7ff90415e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff9097d3700 1 --2- 172.21.15.123:0/1989506902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9040b3990 0x7ff9040cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff908fd2700 1 -- 172.21.15.123:0/1989506902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9040b3990 msgr2=0x7ff9040cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:45.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff908fd2700 1 --2- 172.21.15.123:0/1989506902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9040b3990 0x7ff9040cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff908fd2700 1 -- 172.21.15.123:0/1989506902 >> v2:172.21.15.153:3300/0 conn(0x7ff9040cb5b0 msgr2=0x7ff90415e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:45.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff908fd2700 1 --2- 172.21.15.123:0/1989506902 >> v2:172.21.15.153:3300/0 conn(0x7ff9040cb5b0 0x7ff90415e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.734+0000 7ff908fd2700 1 -- 172.21.15.123:0/1989506902 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9040cd990 con 0x7ff9040ccac0 2024-09-13T17:09:45.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff908fd2700 1 --2- 172.21.15.123:0/1989506902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9040ccac0 0x7ff9040cb070 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff90406a590 tx=0x7ff8fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23aaacc925c174fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:45.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff8f7fff700 1 -- 172.21.15.123:0/1989506902 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc00e070 con 0x7ff9040ccac0 2024-09-13T17:09:45.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff8f7fff700 1 -- 172.21.15.123:0/1989506902 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc00b9c0 con 0x7ff9040ccac0 2024-09-13T17:09:45.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff8f7fff700 1 -- 172.21.15.123:0/1989506902 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc00bd70 con 0x7ff9040ccac0 2024-09-13T17:09:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 -- 172.21.15.123:0/1989506902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9040ccac0 msgr2=0x7ff9040cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 --2- 172.21.15.123:0/1989506902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9040ccac0 0x7ff9040cb070 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff90406a590 tx=0x7ff8fc00b330 comp rx=0 tx=0).stop 2024-09-13T17:09:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 -- 172.21.15.123:0/1989506902 shutdown_connections 2024-09-13T17:09:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 --2- 172.21.15.123:0/1989506902 >> v2:172.21.15.153:3300/0 conn(0x7ff9040cb5b0 0x7ff90415e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 --2- 172.21.15.123:0/1989506902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9040ccac0 0x7ff9040cb070 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 --2- 172.21.15.123:0/1989506902 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9040b3990 0x7ff9040cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 -- 172.21.15.123:0/1989506902 >> 172.21.15.123:0/1989506902 conn(0x7ff9040b01d0 msgr2=0x7ff9040b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 -- 172.21.15.123:0/1989506902 shutdown_connections 2024-09-13T17:09:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 -- 172.21.15.123:0/1989506902 wait complete. 2024-09-13T17:09:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 Processor -- start 2024-09-13T17:09:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 -- start start 2024-09-13T17:09:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9040b3990 0x7ff9040c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9040cb5b0 0x7ff9041e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9040ccac0 0x7ff90415d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9040c8330 con 0x7ff9040ccac0 2024-09-13T17:09:45.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9040c8ad0 con 0x7ff9040cb5b0 2024-09-13T17:09:45.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.738+0000 7ff90a7d5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9040c8510 con 0x7ff9040b3990 2024-09-13T17:09:45.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff909fd4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9040ccac0 0x7ff90415d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff909fd4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9040ccac0 0x7ff90415d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51654/0 (socket says 172.21.15.123:51654) 2024-09-13T17:09:45.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff909fd4700 1 -- 172.21.15.123:0/2542066067 learned_addr learned my addr 172.21.15.123:0/2542066067 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:45.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff908fd2700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9040cb5b0 0x7ff9041e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff9097d3700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9040b3990 0x7ff9040c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff909fd4700 1 -- 172.21.15.123:0/2542066067 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9040b3990 msgr2=0x7ff9040c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff909fd4700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9040b3990 0x7ff9040c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff909fd4700 1 -- 172.21.15.123:0/2542066067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9040cb5b0 msgr2=0x7ff9041e66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff909fd4700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9040cb5b0 0x7ff9041e66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff909fd4700 1 -- 172.21.15.123:0/2542066067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc009b30 con 0x7ff9040ccac0 2024-09-13T17:09:45.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff908fd2700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9040cb5b0 0x7ff9041e66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:45.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff909fd4700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9040ccac0 0x7ff90415d0f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ff90000e810 tx=0x7ff90000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:45.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff8f5ffb700 1 -- 172.21.15.123:0/2542066067 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff900013610 con 0x7ff9040ccac0 2024-09-13T17:09:45.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff8f5ffb700 1 -- 172.21.15.123:0/2542066067 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff900013770 con 0x7ff9040ccac0 2024-09-13T17:09:45.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff8f5ffb700 1 -- 172.21.15.123:0/2542066067 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff900013b20 con 0x7ff9040ccac0 2024-09-13T17:09:45.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff90a7d5700 1 -- 172.21.15.123:0/2542066067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9040c87f0 con 0x7ff9040ccac0 2024-09-13T17:09:45.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff90a7d5700 1 -- 172.21.15.123:0/2542066067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9040c6570 con 0x7ff9040ccac0 2024-09-13T17:09:45.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff90a7d5700 1 -- 172.21.15.123:0/2542066067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9041e59f0 con 0x7ff9040ccac0 2024-09-13T17:09:45.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.742+0000 7ff8f5ffb700 1 -- 172.21.15.123:0/2542066067 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff900013c80 con 0x7ff9040ccac0 2024-09-13T17:09:45.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.746+0000 7ff8f5ffb700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff8e8066730 0x7ff8e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:45.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.746+0000 7ff9097d3700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff8e8066730 0x7ff8e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:45.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.746+0000 7ff8f5ffb700 1 -- 172.21.15.123:0/2542066067 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff900083f10 con 0x7ff9040ccac0 2024-09-13T17:09:45.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.746+0000 7ff9097d3700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff8e8066730 0x7ff8e8068bf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800c920 tx=0x7ff8f8008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.750+0000 7ff8f5ffb700 1 -- 172.21.15.123:0/2542066067 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff900051170 con 0x7ff9040ccac0 2024-09-13T17:09:45.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.922+0000 7ff90a7d5700 1 -- 172.21.15.123:0/2542066067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9040b3d70 con 0x7ff9040ccac0 2024-09-13T17:09:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.922+0000 7ff8f5ffb700 1 -- 172.21.15.123:0/2542066067 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff900054790 con 0x7ff9040ccac0 2024-09-13T17:09:45.927 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:09:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.922+0000 7ff90a7d5700 1 -- 172.21.15.123:0/2542066067 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff8e8066730 msgr2=0x7ff8e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.922+0000 7ff90a7d5700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff8e8066730 0x7ff8e8068bf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800c920 tx=0x7ff8f8008040 comp rx=0 tx=0).stop 2024-09-13T17:09:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.922+0000 7ff90a7d5700 1 -- 172.21.15.123:0/2542066067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9040ccac0 msgr2=0x7ff90415d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.922+0000 7ff90a7d5700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9040ccac0 0x7ff90415d0f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ff90000e810 tx=0x7ff90000ebd0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.922+0000 7ff90a7d5700 1 -- 172.21.15.123:0/2542066067 shutdown_connections 2024-09-13T17:09:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.922+0000 7ff90a7d5700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff8e8066730 0x7ff8e8068bf0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.922+0000 7ff90a7d5700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9040ccac0 0x7ff90415d0f0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.922+0000 7ff90a7d5700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9040cb5b0 0x7ff9041e66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.922+0000 7ff90a7d5700 1 --2- 172.21.15.123:0/2542066067 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff9040b3990 0x7ff9040c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.926+0000 7ff90a7d5700 1 -- 172.21.15.123:0/2542066067 >> 172.21.15.123:0/2542066067 conn(0x7ff9040b01d0 msgr2=0x7ff9040af3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:45.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.926+0000 7ff90a7d5700 1 -- 172.21.15.123:0/2542066067 shutdown_connections 2024-09-13T17:09:45.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:45.926+0000 7ff90a7d5700 1 -- 172.21.15.123:0/2542066067 wait complete. 2024-09-13T17:09:45.941 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:09:46.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.054+0000 7f95f5eae700 1 Processor -- start 2024-09-13T17:09:46.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.054+0000 7f95f5eae700 1 -- start start 2024-09-13T17:09:46.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95f5eae700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95f015a000 0x7f95f00b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95f5eae700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f0143850 con 0x7f95f00b21e0 2024-09-13T17:09:46.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95f5eae700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f00b36f0 con 0x7f95f0143470 2024-09-13T17:09:46.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95f5eae700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f00b2650 con 0x7f95f015a000 2024-09-13T17:09:46.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95eeffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95f015a000 0x7f95f00b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95eeffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95f015a000 0x7f95f00b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51656/0 (socket says 172.21.15.123:51656) 2024-09-13T17:09:46.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95eeffd700 1 -- 172.21.15.123:0/3858881771 learned_addr learned my addr 172.21.15.123:0/3858881771 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:46.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95effff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f95f00b21e0 0x7f95f00b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41644/0 (socket says 172.21.15.123:41644) 2024-09-13T17:09:46.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95eeffd700 1 -- 172.21.15.123:0/3858881771 >> v1:172.21.15.153:6789/0 conn(0x7f95f0143470 legacy=0x7f95f006b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95eeffd700 1 -- 172.21.15.123:0/3858881771 >> v1:172.21.15.123:6789/0 conn(0x7f95f00b21e0 legacy=0x7f95f00b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95eeffd700 1 -- 172.21.15.123:0/3858881771 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f00b39d0 con 0x7f95f015a000 2024-09-13T17:09:46.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95eeffd700 1 --2- 172.21.15.123:0/3858881771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f015a000 0x7f95f00b1ca0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009910 tx=0x7f95e4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cefe236de1b514c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:46.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95ee7fc700 1 -- 172.21.15.123:0/3858881771 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400ba60 con 0x7f95f015a000 2024-09-13T17:09:46.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95ee7fc700 1 -- 172.21.15.123:0/3858881771 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e400bbc0 con 0x7f95f015a000 2024-09-13T17:09:46.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95ee7fc700 1 -- 172.21.15.123:0/3858881771 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4009e60 con 0x7f95f015a000 2024-09-13T17:09:46.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95f5eae700 1 -- 172.21.15.123:0/3858881771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f015a000 msgr2=0x7f95f00b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95f5eae700 1 --2- 172.21.15.123:0/3858881771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f015a000 0x7f95f00b1ca0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009910 tx=0x7f95e4009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:46.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95f5eae700 1 -- 172.21.15.123:0/3858881771 shutdown_connections 2024-09-13T17:09:46.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95f5eae700 1 --2- 172.21.15.123:0/3858881771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f015a000 0x7f95f00b1ca0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95f5eae700 1 -- 172.21.15.123:0/3858881771 >> 172.21.15.123:0/3858881771 conn(0x7f95f00cfde0 msgr2=0x7f95f00d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:46.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95f5eae700 1 -- 172.21.15.123:0/3858881771 shutdown_connections 2024-09-13T17:09:46.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.058+0000 7f95f5eae700 1 -- 172.21.15.123:0/3858881771 wait complete. 2024-09-13T17:09:46.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95f5eae700 1 Processor -- start 2024-09-13T17:09:46.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95f5eae700 1 -- start start 2024-09-13T17:09:46.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95f5eae700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95f00b21e0 0x7f95f013feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95f5eae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f0143470 0x7f95f0155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95f5eae700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95f015a000 0x7f95f0155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95f5eae700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f013f7a0 con 0x7f95f0143470 2024-09-13T17:09:46.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95f5eae700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00c4c80 con 0x7f95f00b21e0 2024-09-13T17:09:46.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95f5eae700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f013e700 con 0x7f95f015a000 2024-09-13T17:09:46.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95eeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f0143470 0x7f95f0155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95ef7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95f00b21e0 0x7f95f013feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95eeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f0143470 0x7f95f0155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51670/0 (socket says 172.21.15.123:51670) 2024-09-13T17:09:46.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95eeffd700 1 -- 172.21.15.123:0/1812804451 learned_addr learned my addr 172.21.15.123:0/1812804451 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:46.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95effff700 1 --2- 172.21.15.123:0/1812804451 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95f015a000 0x7f95f0155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95eeffd700 1 -- 172.21.15.123:0/1812804451 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95f015a000 msgr2=0x7f95f0155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95eeffd700 1 --2- 172.21.15.123:0/1812804451 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95f015a000 0x7f95f0155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95eeffd700 1 -- 172.21.15.123:0/1812804451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95f00b21e0 msgr2=0x7f95f013feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95eeffd700 1 --2- 172.21.15.123:0/1812804451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95f00b21e0 0x7f95f013feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.062+0000 7f95eeffd700 1 -- 172.21.15.123:0/1812804451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4009570 con 0x7f95f0143470 2024-09-13T17:09:46.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.066+0000 7f95eeffd700 1 --2- 172.21.15.123:0/1812804451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f0143470 0x7f95f0155a80 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f95e4000c00 tx=0x7f95e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:46.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.066+0000 7f95d7fff700 1 -- 172.21.15.123:0/1812804451 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40045d0 con 0x7f95f0143470 2024-09-13T17:09:46.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.066+0000 7f95d7fff700 1 -- 172.21.15.123:0/1812804451 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e401e070 con 0x7f95f0143470 2024-09-13T17:09:46.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.066+0000 7f95f5eae700 1 -- 172.21.15.123:0/1812804451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f013e9e0 con 0x7f95f0143470 2024-09-13T17:09:46.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.066+0000 7f95d7fff700 1 -- 172.21.15.123:0/1812804451 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4003900 con 0x7f95f0143470 2024-09-13T17:09:46.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.066+0000 7f95f5eae700 1 -- 172.21.15.123:0/1812804451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f013efa0 con 0x7f95f0143470 2024-09-13T17:09:46.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.066+0000 7f95f5eae700 1 -- 172.21.15.123:0/1812804451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f00b1ca0 con 0x7f95f0143470 2024-09-13T17:09:46.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.066+0000 7f95d7fff700 1 -- 172.21.15.123:0/1812804451 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95e4003a60 con 0x7f95f0143470 2024-09-13T17:09:46.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.066+0000 7f95d7fff700 1 --2- 172.21.15.123:0/1812804451 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f95dc066730 0x7f95dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.066+0000 7f95d7fff700 1 -- 172.21.15.123:0/1812804451 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f95e4020070 con 0x7f95f0143470 2024-09-13T17:09:46.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.066+0000 7f95ef7fe700 1 --2- 172.21.15.123:0/1812804451 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f95dc066730 0x7f95dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.070+0000 7f95ef7fe700 1 --2- 172.21.15.123:0/1812804451 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f95dc066730 0x7f95dc068bf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f95e00018a0 tx=0x7f95e0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:46.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.070+0000 7f95d7fff700 1 -- 172.21.15.123:0/1812804451 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f95e4052a10 con 0x7f95f0143470 2024-09-13T17:09:46.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.242+0000 7f95f5eae700 1 -- 172.21.15.123:0/1812804451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95f00b4b60 con 0x7f95f0143470 2024-09-13T17:09:46.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.242+0000 7f95d7fff700 1 -- 172.21.15.123:0/1812804451 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95e4056030 con 0x7f95f0143470 2024-09-13T17:09:46.247 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:09:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.242+0000 7f95f5eae700 1 -- 172.21.15.123:0/1812804451 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f95dc066730 msgr2=0x7f95dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.242+0000 7f95f5eae700 1 --2- 172.21.15.123:0/1812804451 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f95dc066730 0x7f95dc068bf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f95e00018a0 tx=0x7f95e0009040 comp rx=0 tx=0).stop 2024-09-13T17:09:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.242+0000 7f95f5eae700 1 -- 172.21.15.123:0/1812804451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f0143470 msgr2=0x7f95f0155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.242+0000 7f95f5eae700 1 --2- 172.21.15.123:0/1812804451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f0143470 0x7f95f0155a80 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f95e4000c00 tx=0x7f95e4004770 comp rx=0 tx=0).stop 2024-09-13T17:09:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.242+0000 7f95f5eae700 1 -- 172.21.15.123:0/1812804451 shutdown_connections 2024-09-13T17:09:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.242+0000 7f95f5eae700 1 --2- 172.21.15.123:0/1812804451 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f95dc066730 0x7f95dc068bf0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.242+0000 7f95f5eae700 1 --2- 172.21.15.123:0/1812804451 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f95f015a000 0x7f95f0155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.242+0000 7f95f5eae700 1 --2- 172.21.15.123:0/1812804451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f0143470 0x7f95f0155a80 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.242+0000 7f95f5eae700 1 --2- 172.21.15.123:0/1812804451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95f00b21e0 0x7f95f013feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.242+0000 7f95f5eae700 1 -- 172.21.15.123:0/1812804451 >> 172.21.15.123:0/1812804451 conn(0x7f95f00cfde0 msgr2=0x7f95f0140700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.242+0000 7f95f5eae700 1 -- 172.21.15.123:0/1812804451 shutdown_connections 2024-09-13T17:09:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.242+0000 7f95f5eae700 1 -- 172.21.15.123:0/1812804451 wait complete. 2024-09-13T17:09:46.262 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:09:46.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aed1be700 1 Processor -- start 2024-09-13T17:09:46.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aed1be700 1 -- start start 2024-09-13T17:09:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aed1be700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ae80cb7e0 0x7f8ae80c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aed1be700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ae806bdb0 0x7f8ae8071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aed1be700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8ae80c1480 0x7f8ae8072090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aed1be700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae80ca750 con 0x7f8ae80c1480 2024-09-13T17:09:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aed1be700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae80c9210 con 0x7f8ae80cb7e0 2024-09-13T17:09:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aed1be700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae81617b0 con 0x7f8ae806bdb0 2024-09-13T17:09:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aec9bd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8ae80c1480 0x7f8ae8072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aec9bd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8ae80c1480 0x7f8ae8072090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51676/0 (socket says 172.21.15.123:51676) 2024-09-13T17:09:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aec9bd700 1 -- 172.21.15.123:0/2615115146 learned_addr learned my addr 172.21.15.123:0/2615115146 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8ae7fff700 1 --2- 172.21.15.123:0/2615115146 >> v2:172.21.15.153:3300/0 conn(0x7f8ae80cb7e0 0x7f8ae80c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8ae77fe700 1 --2- 172.21.15.123:0/2615115146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ae806bdb0 0x7f8ae8071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aec9bd700 1 -- 172.21.15.123:0/2615115146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ae806bdb0 msgr2=0x7f8ae8071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:46.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aec9bd700 1 --2- 172.21.15.123:0/2615115146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ae806bdb0 0x7f8ae8071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aec9bd700 1 -- 172.21.15.123:0/2615115146 >> v2:172.21.15.153:3300/0 conn(0x7f8ae80cb7e0 msgr2=0x7f8ae80c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:46.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aec9bd700 1 --2- 172.21.15.123:0/2615115146 >> v2:172.21.15.153:3300/0 conn(0x7f8ae80cb7e0 0x7f8ae80c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aec9bd700 1 -- 172.21.15.123:0/2615115146 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae80cbbc0 con 0x7f8ae80c1480 2024-09-13T17:09:46.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8ae77fe700 1 --2- 172.21.15.123:0/2615115146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ae806bdb0 0x7f8ae8071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:46.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8aec9bd700 1 --2- 172.21.15.123:0/2615115146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ae80c1480 0x7f8ae8072090 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80cf690 tx=0x7f8ae000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c4b4c5a17c3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8ae6ffd700 1 -- 172.21.15.123:0/2615115146 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae000e070 con 0x7f8ae80c1480 2024-09-13T17:09:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8ae6ffd700 1 -- 172.21.15.123:0/2615115146 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae000b910 con 0x7f8ae80c1480 2024-09-13T17:09:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.378+0000 7f8ae6ffd700 1 -- 172.21.15.123:0/2615115146 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae000bcc0 con 0x7f8ae80c1480 2024-09-13T17:09:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.382+0000 7f8aed1be700 1 -- 172.21.15.123:0/2615115146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ae80c1480 msgr2=0x7f8ae8072090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.382+0000 7f8aed1be700 1 --2- 172.21.15.123:0/2615115146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ae80c1480 0x7f8ae8072090 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80cf690 tx=0x7f8ae000b330 comp rx=0 tx=0).stop 2024-09-13T17:09:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.382+0000 7f8aed1be700 1 -- 172.21.15.123:0/2615115146 shutdown_connections 2024-09-13T17:09:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.382+0000 7f8aed1be700 1 --2- 172.21.15.123:0/2615115146 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ae806bdb0 0x7f8ae8071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.382+0000 7f8aed1be700 1 --2- 172.21.15.123:0/2615115146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ae80c1480 0x7f8ae8072090 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.382+0000 7f8aed1be700 1 --2- 172.21.15.123:0/2615115146 >> v2:172.21.15.153:3300/0 conn(0x7f8ae80cb7e0 0x7f8ae80c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.382+0000 7f8aed1be700 1 -- 172.21.15.123:0/2615115146 >> 172.21.15.123:0/2615115146 conn(0x7f8ae80b01d0 msgr2=0x7f8ae80b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.382+0000 7f8aed1be700 1 -- 172.21.15.123:0/2615115146 shutdown_connections 2024-09-13T17:09:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.382+0000 7f8aed1be700 1 -- 172.21.15.123:0/2615115146 wait complete. 2024-09-13T17:09:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.382+0000 7f8aed1be700 1 Processor -- start 2024-09-13T17:09:46.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.382+0000 7f8aed1be700 1 -- start start 2024-09-13T17:09:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aed1be700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ae806bdb0 0x7f8ae8163f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aed1be700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ae80c1480 0x7f8ae815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aed1be700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ae80cb7e0 0x7f8ae80c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aed1be700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae815c6f0 con 0x7f8ae80cb7e0 2024-09-13T17:09:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aed1be700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae80c7d60 con 0x7f8ae80c1480 2024-09-13T17:09:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aed1be700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae8161a20 con 0x7f8ae806bdb0 2024-09-13T17:09:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aec9bd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ae80cb7e0 0x7f8ae80c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aec9bd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ae80cb7e0 0x7f8ae80c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51680/0 (socket says 172.21.15.123:51680) 2024-09-13T17:09:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aec9bd700 1 -- 172.21.15.123:0/2011782931 learned_addr learned my addr 172.21.15.123:0/2011782931 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8ae77fe700 1 --2- 172.21.15.123:0/2011782931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ae80c1480 0x7f8ae815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8ae7fff700 1 --2- 172.21.15.123:0/2011782931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ae806bdb0 0x7f8ae8163f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aec9bd700 1 -- 172.21.15.123:0/2011782931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ae806bdb0 msgr2=0x7f8ae8163f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aec9bd700 1 --2- 172.21.15.123:0/2011782931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ae806bdb0 0x7f8ae8163f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aec9bd700 1 -- 172.21.15.123:0/2011782931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ae80c1480 msgr2=0x7f8ae815c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aec9bd700 1 --2- 172.21.15.123:0/2011782931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ae80c1480 0x7f8ae815c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aec9bd700 1 -- 172.21.15.123:0/2011782931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0009b30 con 0x7f8ae80cb7e0 2024-09-13T17:09:46.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aec9bd700 1 --2- 172.21.15.123:0/2011782931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ae80cb7e0 0x7f8ae80c7530 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80cf750 tx=0x7f8ae0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:46.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8ae4ff9700 1 -- 172.21.15.123:0/2011782931 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00099b0 con 0x7f8ae80cb7e0 2024-09-13T17:09:46.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8ae4ff9700 1 -- 172.21.15.123:0/2011782931 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae00092e0 con 0x7f8ae80cb7e0 2024-09-13T17:09:46.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aed1be700 1 -- 172.21.15.123:0/2011782931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae8161d00 con 0x7f8ae80cb7e0 2024-09-13T17:09:46.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8ae4ff9700 1 -- 172.21.15.123:0/2011782931 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0004470 con 0x7f8ae80cb7e0 2024-09-13T17:09:46.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aed1be700 1 -- 172.21.15.123:0/2011782931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae80c7a70 con 0x7f8ae80cb7e0 2024-09-13T17:09:46.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.386+0000 7f8aed1be700 1 -- 172.21.15.123:0/2011782931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae8162220 con 0x7f8ae80cb7e0 2024-09-13T17:09:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.390+0000 7f8ae4ff9700 1 -- 172.21.15.123:0/2011782931 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8ae00045d0 con 0x7f8ae80cb7e0 2024-09-13T17:09:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.390+0000 7f8ae4ff9700 1 --2- 172.21.15.123:0/2011782931 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ac8066760 0x7f8ac8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.390+0000 7f8ae4ff9700 1 -- 172.21.15.123:0/2011782931 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8ae0085160 con 0x7f8ae80cb7e0 2024-09-13T17:09:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.390+0000 7f8ae7fff700 1 --2- 172.21.15.123:0/2011782931 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ac8066760 0x7f8ac8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.390+0000 7f8ae7fff700 1 --2- 172.21.15.123:0/2011782931 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ac8066760 0x7f8ac8068c20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8163b70 tx=0x7f8ad8009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:46.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.394+0000 7f8ae4ff9700 1 -- 172.21.15.123:0/2011782931 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8ae8162220 con 0x7f8ae80cb7e0 2024-09-13T17:09:46.403 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:09:46.405 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:09:46.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.562+0000 7f8aed1be700 1 -- 172.21.15.123:0/2011782931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ae8162220 con 0x7f8ae80cb7e0 2024-09-13T17:09:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.566+0000 7f8ae4ff9700 1 -- 172.21.15.123:0/2011782931 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ae8162220 con 0x7f8ae80cb7e0 2024-09-13T17:09:46.570 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:09:46.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.566+0000 7f8aed1be700 1 -- 172.21.15.123:0/2011782931 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ac8066760 msgr2=0x7f8ac8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.566+0000 7f8aed1be700 1 --2- 172.21.15.123:0/2011782931 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ac8066760 0x7f8ac8068c20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8163b70 tx=0x7f8ad8009240 comp rx=0 tx=0).stop 2024-09-13T17:09:46.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.566+0000 7f8aed1be700 1 -- 172.21.15.123:0/2011782931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ae80cb7e0 msgr2=0x7f8ae80c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.566+0000 7f8aed1be700 1 --2- 172.21.15.123:0/2011782931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ae80cb7e0 0x7f8ae80c7530 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80cf750 tx=0x7f8ae0004af0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.566+0000 7f8aed1be700 1 -- 172.21.15.123:0/2011782931 shutdown_connections 2024-09-13T17:09:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.566+0000 7f8aed1be700 1 --2- 172.21.15.123:0/2011782931 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8ac8066760 0x7f8ac8068c20 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.566+0000 7f8aed1be700 1 --2- 172.21.15.123:0/2011782931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ae80cb7e0 0x7f8ae80c7530 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.566+0000 7f8aed1be700 1 --2- 172.21.15.123:0/2011782931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ae80c1480 0x7f8ae815c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.566+0000 7f8aed1be700 1 --2- 172.21.15.123:0/2011782931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ae806bdb0 0x7f8ae8163f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.566+0000 7f8aed1be700 1 -- 172.21.15.123:0/2011782931 >> 172.21.15.123:0/2011782931 conn(0x7f8ae80b01d0 msgr2=0x7f8ae80ae0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.566+0000 7f8aed1be700 1 -- 172.21.15.123:0/2011782931 shutdown_connections 2024-09-13T17:09:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.566+0000 7f8aed1be700 1 -- 172.21.15.123:0/2011782931 wait complete. 2024-09-13T17:09:46.585 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:09:46.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.690+0000 7fcea73b7700 1 Processor -- start 2024-09-13T17:09:46.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.690+0000 7fcea73b7700 1 -- start start 2024-09-13T17:09:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.690+0000 7fcea73b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcea015cd60 0x7fcea00cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.690+0000 7fcea73b7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea00d1780 con 0x7fcea00b1fe0 2024-09-13T17:09:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.690+0000 7fcea73b7700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea00d1c10 con 0x7fcea00b1970 2024-09-13T17:09:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.690+0000 7fcea73b7700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea00d3670 con 0x7fcea015cd60 2024-09-13T17:09:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.690+0000 7fcea5bb4700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcea00b1fe0 0x7fcea00af750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41652/0 (socket says 172.21.15.123:41652) 2024-09-13T17:09:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.690+0000 7fcea5bb4700 1 -- 172.21.15.123:0/3544243830 learned_addr learned my addr 172.21.15.123:0/3544243830 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.690+0000 7fcea63b5700 1 --2- 172.21.15.123:0/3544243830 >> v2:172.21.15.153:3300/0 conn(0x7fcea015cd60 0x7fcea00cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea53b3700 1 -- 172.21.15.123:0/3544243830 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487234588 0 0) 0x7fcea00d1780 con 0x7fcea00b1fe0 2024-09-13T17:09:46.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea53b3700 1 -- 172.21.15.123:0/3544243830 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce8c0035d0 con 0x7fcea00b1fe0 2024-09-13T17:09:46.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea63b5700 1 -- 172.21.15.123:0/3544243830 >> v1:172.21.15.153:6789/0 conn(0x7fcea00b1970 legacy=0x7fcea00afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea63b5700 1 -- 172.21.15.123:0/3544243830 >> v1:172.21.15.123:6789/0 conn(0x7fcea00b1fe0 legacy=0x7fcea00af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea63b5700 1 -- 172.21.15.123:0/3544243830 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea00d3950 con 0x7fcea015cd60 2024-09-13T17:09:46.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea63b5700 1 --2- 172.21.15.123:0/3544243830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcea015cd60 0x7fcea00cf540 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009850 tx=0x7fce9c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74804148ce7cf9d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:46.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea53b3700 1 -- 172.21.15.123:0/3544243830 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c011830 con 0x7fcea015cd60 2024-09-13T17:09:46.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea53b3700 1 -- 172.21.15.123:0/3544243830 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c011990 con 0x7fcea015cd60 2024-09-13T17:09:46.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea53b3700 1 -- 172.21.15.123:0/3544243830 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c011d00 con 0x7fcea015cd60 2024-09-13T17:09:46.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea73b7700 1 -- 172.21.15.123:0/3544243830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcea015cd60 msgr2=0x7fcea00cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea73b7700 1 --2- 172.21.15.123:0/3544243830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcea015cd60 0x7fcea00cf540 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009850 tx=0x7fce9c009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:46.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea73b7700 1 -- 172.21.15.123:0/3544243830 shutdown_connections 2024-09-13T17:09:46.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea73b7700 1 --2- 172.21.15.123:0/3544243830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcea015cd60 0x7fcea00cf540 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea73b7700 1 -- 172.21.15.123:0/3544243830 >> 172.21.15.123:0/3544243830 conn(0x7fcea00d2b50 msgr2=0x7fcea00d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:46.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea73b7700 1 -- 172.21.15.123:0/3544243830 shutdown_connections 2024-09-13T17:09:46.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.694+0000 7fcea73b7700 1 -- 172.21.15.123:0/3544243830 wait complete. 2024-09-13T17:09:46.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.698+0000 7fcea73b7700 1 Processor -- start 2024-09-13T17:09:46.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.698+0000 7fcea73b7700 1 -- start start 2024-09-13T17:09:46.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.698+0000 7fcea73b7700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcea00b1970 0x7fcea0152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.698+0000 7fcea73b7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcea00b1fe0 0x7fcea00b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.698+0000 7fcea73b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcea015cd60 0x7fcea00b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.698+0000 7fcea73b7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea00c7f50 con 0x7fcea00b1fe0 2024-09-13T17:09:46.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.698+0000 7fcea73b7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea00cbe10 con 0x7fcea015cd60 2024-09-13T17:09:46.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.698+0000 7fcea73b7700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea0158af0 con 0x7fcea00b1970 2024-09-13T17:09:46.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.698+0000 7fcea5bb4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcea00b1fe0 0x7fcea00b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.698+0000 7fcea5bb4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcea00b1fe0 0x7fcea00b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51684/0 (socket says 172.21.15.123:51684) 2024-09-13T17:09:46.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.698+0000 7fcea5bb4700 1 -- 172.21.15.123:0/1655342126 learned_addr learned my addr 172.21.15.123:0/1655342126 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:46.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.698+0000 7fcea63b5700 1 --2- 172.21.15.123:0/1655342126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcea00b1970 0x7fcea0152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.698+0000 7fcea6bb6700 1 --2- 172.21.15.123:0/1655342126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcea015cd60 0x7fcea00b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fcea5bb4700 1 -- 172.21.15.123:0/1655342126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcea00b1970 msgr2=0x7fcea0152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fcea5bb4700 1 --2- 172.21.15.123:0/1655342126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcea00b1970 0x7fcea0152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fcea5bb4700 1 -- 172.21.15.123:0/1655342126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcea015cd60 msgr2=0x7fcea00b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fcea5bb4700 1 --2- 172.21.15.123:0/1655342126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcea015cd60 0x7fcea00b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fcea5bb4700 1 -- 172.21.15.123:0/1655342126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c0094b0 con 0x7fcea00b1fe0 2024-09-13T17:09:46.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fcea5bb4700 1 --2- 172.21.15.123:0/1655342126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcea00b1fe0 0x7fcea00b3850 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fce9000c700 tx=0x7fce9000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:46.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fce96ffd700 1 -- 172.21.15.123:0/1655342126 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90005d90 con 0x7fcea00b1fe0 2024-09-13T17:09:46.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fce96ffd700 1 -- 172.21.15.123:0/1655342126 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce900070d0 con 0x7fcea00b1fe0 2024-09-13T17:09:46.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fcea73b7700 1 -- 172.21.15.123:0/1655342126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea00c7910 con 0x7fcea00b1fe0 2024-09-13T17:09:46.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fce96ffd700 1 -- 172.21.15.123:0/1655342126 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90007480 con 0x7fcea00b1fe0 2024-09-13T17:09:46.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fcea73b7700 1 -- 172.21.15.123:0/1655342126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea014c9d0 con 0x7fcea00b1fe0 2024-09-13T17:09:46.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fcea73b7700 1 -- 172.21.15.123:0/1655342126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea00cf540 con 0x7fcea00b1fe0 2024-09-13T17:09:46.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fce96ffd700 1 -- 172.21.15.123:0/1655342126 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fce900075e0 con 0x7fcea00b1fe0 2024-09-13T17:09:46.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fce96ffd700 1 --2- 172.21.15.123:0/1655342126 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fce84066730 0x7fce84068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:46.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.702+0000 7fcea63b5700 1 --2- 172.21.15.123:0/1655342126 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fce84066730 0x7fce84068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:46.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.706+0000 7fce96ffd700 1 -- 172.21.15.123:0/1655342126 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fce900835c0 con 0x7fcea00b1fe0 2024-09-13T17:09:46.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.706+0000 7fcea63b5700 1 --2- 172.21.15.123:0/1655342126 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fce84066730 0x7fce84068bf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0090b0 tx=0x7fce9c01c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:46.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.710+0000 7fce96ffd700 1 -- 172.21.15.123:0/1655342126 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fce900508a0 con 0x7fcea00b1fe0 2024-09-13T17:09:46.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.914+0000 7fcea73b7700 1 -- 172.21.15.123:0/1655342126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcea00cb850 con 0x7fcea00b1fe0 2024-09-13T17:09:46.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.918+0000 7fce96ffd700 1 -- 172.21.15.123:0/1655342126 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4748 (secure 0 0 0) 0x7fce90053ec0 con 0x7fcea00b1fe0 2024-09-13T17:09:46.923 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:46.923 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3155329877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3155329877},{"type":"v1","addr":"172.21.15.153:6835","nonce":3155329877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6522,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3484528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3484528665},{"type":"v1","addr":"172.21.15.123:6835","nonce":3484528665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6525,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/4217126083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":4217126083},{"type":"v1","addr":"172.21.15.123:6837","nonce":4217126083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:09:18.926234+0000","modified":"2024-09-13T17:09:21.936807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6534":{"gid":6534,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6833/1222139823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1222139823},{"type":"v1","addr":"172.21.15.153:6833","nonce":1222139823}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T17:09:46.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.918+0000 7fcea73b7700 1 -- 172.21.15.123:0/1655342126 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fce84066730 msgr2=0x7fce84068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.918+0000 7fcea73b7700 1 --2- 172.21.15.123:0/1655342126 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fce84066730 0x7fce84068bf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0090b0 tx=0x7fce9c01c040 comp rx=0 tx=0).stop 2024-09-13T17:09:46.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.918+0000 7fcea73b7700 1 -- 172.21.15.123:0/1655342126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcea00b1fe0 msgr2=0x7fcea00b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:46.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.918+0000 7fcea73b7700 1 --2- 172.21.15.123:0/1655342126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcea00b1fe0 0x7fcea00b3850 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fce9000c700 tx=0x7fce9000ca10 comp rx=0 tx=0).stop 2024-09-13T17:09:46.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.918+0000 7fcea73b7700 1 -- 172.21.15.123:0/1655342126 shutdown_connections 2024-09-13T17:09:46.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.918+0000 7fcea73b7700 1 --2- 172.21.15.123:0/1655342126 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fce84066730 0x7fce84068bf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.918+0000 7fcea73b7700 1 --2- 172.21.15.123:0/1655342126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcea015cd60 0x7fcea00b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.918+0000 7fcea73b7700 1 --2- 172.21.15.123:0/1655342126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcea00b1fe0 0x7fcea00b3850 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.918+0000 7fcea73b7700 1 --2- 172.21.15.123:0/1655342126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcea00b1970 0x7fcea0152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:46.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.918+0000 7fcea73b7700 1 -- 172.21.15.123:0/1655342126 >> 172.21.15.123:0/1655342126 conn(0x7fcea00d2b50 msgr2=0x7fcea0158f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:46.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.918+0000 7fcea73b7700 1 -- 172.21.15.123:0/1655342126 shutdown_connections 2024-09-13T17:09:46.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:46.918+0000 7fcea73b7700 1 -- 172.21.15.123:0/1655342126 wait complete. 2024-09-13T17:09:46.926 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 35 2024-09-13T17:09:46.937 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:47.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5117fff700 1 Processor -- start 2024-09-13T17:09:47.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5117fff700 1 -- start start 2024-09-13T17:09:47.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5117fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5118160210 0x7f51180ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5117fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f51180b21d0 0x7f51180ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5117fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511806cfb0 con 0x7f51180cd100 2024-09-13T17:09:47.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5117fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511806d290 con 0x7f51180b21d0 2024-09-13T17:09:47.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5117fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511806d570 con 0x7f5118160210 2024-09-13T17:09:47.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f51167fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f51180cd100 0x7f51180b1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41656/0 (socket says 172.21.15.123:41656) 2024-09-13T17:09:47.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f51167fc700 1 -- 172.21.15.123:0/2782753919 learned_addr learned my addr 172.21.15.123:0/2782753919 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:47.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f51177fe700 1 --2- 172.21.15.123:0/2782753919 >> v2:172.21.15.123:3300/0 conn(0x7f51180b21d0 0x7f51180ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5116ffd700 1 --2- 172.21.15.123:0/2782753919 >> v2:172.21.15.153:3300/0 conn(0x7f5118160210 0x7f51180ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5115ffb700 1 -- 172.21.15.123:0/2782753919 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595231032 0 0) 0x7f511806cfb0 con 0x7f51180cd100 2024-09-13T17:09:47.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5115ffb700 1 -- 172.21.15.123:0/2782753919 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51000035d0 con 0x7f51180cd100 2024-09-13T17:09:47.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f51177fe700 1 -- 172.21.15.123:0/2782753919 >> v2:172.21.15.153:3300/0 conn(0x7f5118160210 msgr2=0x7f51180ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:47.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f51177fe700 1 --2- 172.21.15.123:0/2782753919 >> v2:172.21.15.153:3300/0 conn(0x7f5118160210 0x7f51180ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f51177fe700 1 -- 172.21.15.123:0/2782753919 >> v1:172.21.15.123:6789/0 conn(0x7f51180cd100 legacy=0x7f51180b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f51177fe700 1 -- 172.21.15.123:0/2782753919 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511806d850 con 0x7f51180b21d0 2024-09-13T17:09:47.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f51177fe700 1 --2- 172.21.15.123:0/2782753919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51180b21d0 0x7f51180ce4a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f51180721b0 tx=0x7f511000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82d0155a4b4e381 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:47.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5115ffb700 1 -- 172.21.15.123:0/2782753919 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000e070 con 0x7f51180b21d0 2024-09-13T17:09:47.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5115ffb700 1 -- 172.21.15.123:0/2782753919 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511000bb20 con 0x7f51180b21d0 2024-09-13T17:09:47.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5115ffb700 1 -- 172.21.15.123:0/2782753919 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110012430 con 0x7f51180b21d0 2024-09-13T17:09:47.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5117fff700 1 -- 172.21.15.123:0/2782753919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51180b21d0 msgr2=0x7f51180ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.038+0000 7f5117fff700 1 --2- 172.21.15.123:0/2782753919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51180b21d0 0x7f51180ce4a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f51180721b0 tx=0x7f511000b330 comp rx=0 tx=0).stop 2024-09-13T17:09:47.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.042+0000 7f5117fff700 1 -- 172.21.15.123:0/2782753919 shutdown_connections 2024-09-13T17:09:47.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.042+0000 7f5117fff700 1 --2- 172.21.15.123:0/2782753919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51180b21d0 0x7f51180ce4a0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.042+0000 7f5117fff700 1 --2- 172.21.15.123:0/2782753919 >> v2:172.21.15.153:3300/0 conn(0x7f5118160210 0x7f51180ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.042+0000 7f5117fff700 1 -- 172.21.15.123:0/2782753919 >> 172.21.15.123:0/2782753919 conn(0x7f5118066570 msgr2=0x7f5118066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:47.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.042+0000 7f5117fff700 1 -- 172.21.15.123:0/2782753919 shutdown_connections 2024-09-13T17:09:47.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.042+0000 7f5117fff700 1 -- 172.21.15.123:0/2782753919 wait complete. 2024-09-13T17:09:47.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.042+0000 7f5117fff700 1 Processor -- start 2024-09-13T17:09:47.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.042+0000 7f5117fff700 1 -- start start 2024-09-13T17:09:47.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f5117fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51180b21d0 0x7f51180b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f5117fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51180cd100 0x7f51180ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f5117fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5118160210 0x7f51180adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f5117fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51180c5780 con 0x7f5118160210 2024-09-13T17:09:47.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f5117fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51180c4890 con 0x7f51180b21d0 2024-09-13T17:09:47.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f5117fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51180c4b70 con 0x7f51180cd100 2024-09-13T17:09:47.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f51177fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5118160210 0x7f51180adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f51177fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5118160210 0x7f51180adf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51692/0 (socket says 172.21.15.123:51692) 2024-09-13T17:09:47.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f51177fe700 1 -- 172.21.15.123:0/2098117056 learned_addr learned my addr 172.21.15.123:0/2098117056 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:47.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f5116ffd700 1 --2- 172.21.15.123:0/2098117056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51180b21d0 0x7f51180b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f51167fc700 1 --2- 172.21.15.123:0/2098117056 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51180cd100 0x7f51180ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f5116ffd700 1 -- 172.21.15.123:0/2098117056 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51180cd100 msgr2=0x7f51180ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f5116ffd700 1 --2- 172.21.15.123:0/2098117056 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51180cd100 0x7f51180ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f5116ffd700 1 -- 172.21.15.123:0/2098117056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5118160210 msgr2=0x7f51180adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f5116ffd700 1 --2- 172.21.15.123:0/2098117056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5118160210 0x7f51180adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f5116ffd700 1 -- 172.21.15.123:0/2098117056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5110009a70 con 0x7f51180b21d0 2024-09-13T17:09:47.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.046+0000 7f5116ffd700 1 --2- 172.21.15.123:0/2098117056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51180b21d0 0x7f51180b0ca0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f510800e870 tx=0x7f510800eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:47.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.050+0000 7f50fffff700 1 -- 172.21.15.123:0/2098117056 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108013680 con 0x7f51180b21d0 2024-09-13T17:09:47.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.050+0000 7f50fffff700 1 -- 172.21.15.123:0/2098117056 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51080137e0 con 0x7f51180b21d0 2024-09-13T17:09:47.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.050+0000 7f5117fff700 1 -- 172.21.15.123:0/2098117056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51180c4e50 con 0x7f51180b21d0 2024-09-13T17:09:47.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.050+0000 7f50fffff700 1 -- 172.21.15.123:0/2098117056 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108013b70 con 0x7f51180b21d0 2024-09-13T17:09:47.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.050+0000 7f5117fff700 1 -- 172.21.15.123:0/2098117056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51180c5410 con 0x7f51180b21d0 2024-09-13T17:09:47.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.054+0000 7f5117fff700 1 -- 172.21.15.123:0/2098117056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51180677f0 con 0x7f51180b21d0 2024-09-13T17:09:47.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.054+0000 7f50fffff700 1 -- 172.21.15.123:0/2098117056 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5108013cd0 con 0x7f51180b21d0 2024-09-13T17:09:47.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.054+0000 7f50fffff700 1 --2- 172.21.15.123:0/2098117056 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5104066730 0x7f5104068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.054+0000 7f51167fc700 1 --2- 172.21.15.123:0/2098117056 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5104066730 0x7f5104068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.054+0000 7f51167fc700 1 --2- 172.21.15.123:0/2098117056 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5104066730 0x7f5104068bf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f51180af540 tx=0x7f510c007de0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:47.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.058+0000 7f50fffff700 1 -- 172.21.15.123:0/2098117056 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5108055690 con 0x7f51180b21d0 2024-09-13T17:09:47.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.066+0000 7f50fffff700 1 -- 172.21.15.123:0/2098117056 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f51080512d0 con 0x7f51180b21d0 2024-09-13T17:09:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.226+0000 7f5117fff700 1 -- 172.21.15.123:0/2098117056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5118072a10 con 0x7f51180b21d0 2024-09-13T17:09:47.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.230+0000 7f50fffff700 1 -- 172.21.15.123:0/2098117056 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16808 (secure 0 0 0) 0x7f5108017090 con 0x7f51180b21d0 2024-09-13T17:09:47.237 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:47.237 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":74,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:09:32.997963+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:17.328080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:17.920002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1","mappings":[{"from":6,"to":0}]},{"pgid":"11.9","mappings":[{"from":6,"to":5}]},{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.33","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.234+0000 7f5117fff700 1 -- 172.21.15.123:0/2098117056 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5104066730 msgr2=0x7f5104068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.234+0000 7f5117fff700 1 --2- 172.21.15.123:0/2098117056 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5104066730 0x7f5104068bf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f51180af540 tx=0x7f510c007de0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.234+0000 7f5117fff700 1 -- 172.21.15.123:0/2098117056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51180b21d0 msgr2=0x7f51180b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.234+0000 7f5117fff700 1 --2- 172.21.15.123:0/2098117056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51180b21d0 0x7f51180b0ca0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f510800e870 tx=0x7f510800eb80 comp rx=0 tx=0).stop 2024-09-13T17:09:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.234+0000 7f5117fff700 1 -- 172.21.15.123:0/2098117056 shutdown_connections 2024-09-13T17:09:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.234+0000 7f5117fff700 1 --2- 172.21.15.123:0/2098117056 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5104066730 0x7f5104068bf0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.234+0000 7f5117fff700 1 --2- 172.21.15.123:0/2098117056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5118160210 0x7f51180adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.234+0000 7f5117fff700 1 --2- 172.21.15.123:0/2098117056 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f51180cd100 0x7f51180ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.234+0000 7f5117fff700 1 --2- 172.21.15.123:0/2098117056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51180b21d0 0x7f51180b0ca0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.234+0000 7f5117fff700 1 -- 172.21.15.123:0/2098117056 >> 172.21.15.123:0/2098117056 conn(0x7f5118066570 msgr2=0x7f511815d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.234+0000 7f5117fff700 1 -- 172.21.15.123:0/2098117056 shutdown_connections 2024-09-13T17:09:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.234+0000 7f5117fff700 1 -- 172.21.15.123:0/2098117056 wait complete. 2024-09-13T17:09:47.251 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:09:47.251 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:09:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.354+0000 7ff786aca700 1 Processor -- start 2024-09-13T17:09:47.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.354+0000 7ff786aca700 1 -- start start 2024-09-13T17:09:47.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.354+0000 7ff786aca700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff780071580 0x7ff7800705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.354+0000 7ff786aca700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7800cee80 con 0x7ff78015a8c0 2024-09-13T17:09:47.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.354+0000 7ff786aca700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7800ce270 con 0x7ff78015b9b0 2024-09-13T17:09:47.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.354+0000 7ff786aca700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800ce550 con 0x7ff780071580 2024-09-13T17:09:47.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.354+0000 7ff785ac8700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff78015a8c0 0x7ff780070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41658/0 (socket says 172.21.15.123:41658) 2024-09-13T17:09:47.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.354+0000 7ff785ac8700 1 -- 172.21.15.123:0/3569260194 learned_addr learned my addr 172.21.15.123:0/3569260194 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:47.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff7852c7700 1 --2- 172.21.15.123:0/3569260194 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff780071580 0x7ff7800705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031724893 0 0) 0x7ff7800cee80 con 0x7ff78015a8c0 2024-09-13T17:09:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff76c0035d0 con 0x7ff78015a8c0 2024-09-13T17:09:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606647844 0 0) 0x7ff7800ce270 con 0x7ff78015b9b0 2024-09-13T17:09:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7800cee80 con 0x7ff78015b9b0 2024-09-13T17:09:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 69295919 0 0) 0x7ff76c0035d0 con 0x7ff78015a8c0 2024-09-13T17:09:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff780071580 msgr2=0x7ff7800705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 --2- 172.21.15.123:0/3569260194 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff780071580 0x7ff7800705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 >> v1:172.21.15.153:6789/0 conn(0x7ff78015b9b0 legacy=0x7ff7800cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7800ce830 con 0x7ff78015a8c0 2024-09-13T17:09:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7ff774001670 con 0x7ff78015a8c0 2024-09-13T17:09:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 >> v1:172.21.15.123:6789/0 conn(0x7ff78015a8c0 legacy=0x7ff780070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 --2- 172.21.15.123:0/3569260194 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff780071580 0x7ff76c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 --2- 172.21.15.123:0/3569260194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff76c004140 0x7ff76c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 --2- 172.21.15.123:0/3569260194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff76c004db0 0x7ff76c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800ce550 con 0x7ff76c004140 2024-09-13T17:09:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c00bb10 con 0x7ff76c004db0 2024-09-13T17:09:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c00bcd0 con 0x7ff780071580 2024-09-13T17:09:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff7852c7700 1 --2- 172.21.15.123:0/3569260194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff76c004140 0x7ff76c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff7862c9700 1 --2- 172.21.15.123:0/3569260194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff76c004db0 0x7ff76c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff785ac8700 1 --2- 172.21.15.123:0/3569260194 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff780071580 0x7ff76c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff7852c7700 1 -- 172.21.15.123:0/3569260194 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff780071580 msgr2=0x7ff76c003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff7852c7700 1 --2- 172.21.15.123:0/3569260194 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff780071580 0x7ff76c003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff7852c7700 1 -- 172.21.15.123:0/3569260194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff76c004db0 msgr2=0x7ff76c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff7852c7700 1 --2- 172.21.15.123:0/3569260194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff76c004db0 0x7ff76c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff7852c7700 1 -- 172.21.15.123:0/3569260194 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c0035d0 con 0x7ff76c004140 2024-09-13T17:09:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff7852c7700 1 --2- 172.21.15.123:0/3569260194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff76c004140 0x7ff76c004870 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff780072130 tx=0x7ff76c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657f5111fd4b558f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c00e690 con 0x7ff76c004140 2024-09-13T17:09:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77c00e7f0 con 0x7ff76c004140 2024-09-13T17:09:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff784ac6700 1 -- 172.21.15.123:0/3569260194 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c00eb80 con 0x7ff76c004140 2024-09-13T17:09:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff786aca700 1 -- 172.21.15.123:0/3569260194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff76c004140 msgr2=0x7ff76c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff786aca700 1 --2- 172.21.15.123:0/3569260194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff76c004140 0x7ff76c004870 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff780072130 tx=0x7ff76c0058a0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff7862c9700 1 -- 172.21.15.123:0/3569260194 reap_dead start 2024-09-13T17:09:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff786aca700 1 -- 172.21.15.123:0/3569260194 shutdown_connections 2024-09-13T17:09:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff786aca700 1 -- 172.21.15.123:0/3569260194 >> 172.21.15.123:0/3569260194 conn(0x7ff780066150 msgr2=0x7ff780066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff786aca700 1 -- 172.21.15.123:0/3569260194 shutdown_connections 2024-09-13T17:09:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.358+0000 7ff786aca700 1 -- 172.21.15.123:0/3569260194 wait complete. 2024-09-13T17:09:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff786aca700 1 Processor -- start 2024-09-13T17:09:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff786aca700 1 -- start start 2024-09-13T17:09:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff786aca700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff76c004140 0x7ff78014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff786aca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800cce80 0x7ff7800b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff786aca700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7800b3390 0x7ff78014bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff786aca700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800c3800 con 0x7ff7800b3390 2024-09-13T17:09:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff786aca700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800c3ff0 con 0x7ff7800cce80 2024-09-13T17:09:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff786aca700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800c42d0 con 0x7ff76c004140 2024-09-13T17:09:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff7862c9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7800b3390 0x7ff78014bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff7862c9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7800b3390 0x7ff78014bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51712/0 (socket says 172.21.15.123:51712) 2024-09-13T17:09:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff7862c9700 1 -- 172.21.15.123:0/3952302412 learned_addr learned my addr 172.21.15.123:0/3952302412 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff785ac8700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff76c004140 0x7ff78014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff7852c7700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800cce80 0x7ff7800b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff7862c9700 1 -- 172.21.15.123:0/3952302412 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff76c004140 msgr2=0x7ff78014b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff7862c9700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff76c004140 0x7ff78014b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff7862c9700 1 -- 172.21.15.123:0/3952302412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800cce80 msgr2=0x7ff7800b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff7862c9700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800cce80 0x7ff7800b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff7862c9700 1 -- 172.21.15.123:0/3952302412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7800c45b0 con 0x7ff7800b3390 2024-09-13T17:09:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff7852c7700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800cce80 0x7ff7800b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff7862c9700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7800b3390 0x7ff78014bc40 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff7800cedf0 tx=0x7ff77800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff7727fc700 1 -- 172.21.15.123:0/3952302412 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778003c30 con 0x7ff7800b3390 2024-09-13T17:09:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff7727fc700 1 -- 172.21.15.123:0/3952302412 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff778003d90 con 0x7ff7800b3390 2024-09-13T17:09:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff786aca700 1 -- 172.21.15.123:0/3952302412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7800b2930 con 0x7ff7800b3390 2024-09-13T17:09:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff7727fc700 1 -- 172.21.15.123:0/3952302412 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77800dbd0 con 0x7ff7800b3390 2024-09-13T17:09:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.362+0000 7ff786aca700 1 -- 172.21.15.123:0/3952302412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff780155760 con 0x7ff7800b3390 2024-09-13T17:09:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.366+0000 7ff7727fc700 1 -- 172.21.15.123:0/3952302412 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff77800dd30 con 0x7ff7800b3390 2024-09-13T17:09:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.366+0000 7ff786aca700 1 -- 172.21.15.123:0/3952302412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7800677f0 con 0x7ff7800b3390 2024-09-13T17:09:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.366+0000 7ff7727fc700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff764066730 0x7ff764068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.366+0000 7ff7727fc700 1 -- 172.21.15.123:0/3952302412 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff7780845c0 con 0x7ff7800b3390 2024-09-13T17:09:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.366+0000 7ff785ac8700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff764066730 0x7ff764068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.366+0000 7ff785ac8700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff764066730 0x7ff764068bf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff774001050 tx=0x7ff774009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:47.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.374+0000 7ff7727fc700 1 -- 172.21.15.123:0/3952302412 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff778051820 con 0x7ff7800b3390 2024-09-13T17:09:47.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.578+0000 7ff786aca700 1 -- 172.21.15.123:0/3952302412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7800705b0 con 0x7ff7800b3390 2024-09-13T17:09:47.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.578+0000 7ff7727fc700 1 -- 172.21.15.123:0/3952302412 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4748 (secure 0 0 0) 0x7ff778054e40 con 0x7ff7800b3390 2024-09-13T17:09:47.585 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:47.585 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3155329877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3155329877},{"type":"v1","addr":"172.21.15.153:6835","nonce":3155329877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6522,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3484528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3484528665},{"type":"v1","addr":"172.21.15.123:6835","nonce":3484528665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6525,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/4217126083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":4217126083},{"type":"v1","addr":"172.21.15.123:6837","nonce":4217126083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:09:18.926234+0000","modified":"2024-09-13T17:09:21.936807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6534":{"gid":6534,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6833/1222139823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1222139823},{"type":"v1","addr":"172.21.15.153:6833","nonce":1222139823}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T17:09:47.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.582+0000 7ff786aca700 1 -- 172.21.15.123:0/3952302412 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff764066730 msgr2=0x7ff764068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.582+0000 7ff786aca700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff764066730 0x7ff764068bf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff774001050 tx=0x7ff774009040 comp rx=0 tx=0).stop 2024-09-13T17:09:47.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.582+0000 7ff786aca700 1 -- 172.21.15.123:0/3952302412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7800b3390 msgr2=0x7ff78014bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.582+0000 7ff786aca700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7800b3390 0x7ff78014bc40 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff7800cedf0 tx=0x7ff77800d430 comp rx=0 tx=0).stop 2024-09-13T17:09:47.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.582+0000 7ff786aca700 1 -- 172.21.15.123:0/3952302412 shutdown_connections 2024-09-13T17:09:47.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.582+0000 7ff786aca700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff764066730 0x7ff764068bf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.582+0000 7ff786aca700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7800b3390 0x7ff78014bc40 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.582+0000 7ff786aca700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800cce80 0x7ff7800b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.582+0000 7ff786aca700 1 --2- 172.21.15.123:0/3952302412 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff76c004140 0x7ff78014b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.582+0000 7ff786aca700 1 -- 172.21.15.123:0/3952302412 >> 172.21.15.123:0/3952302412 conn(0x7ff780066150 msgr2=0x7ff7800ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:47.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.582+0000 7ff786aca700 1 -- 172.21.15.123:0/3952302412 shutdown_connections 2024-09-13T17:09:47.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.582+0000 7ff786aca700 1 -- 172.21.15.123:0/3952302412 wait complete. 2024-09-13T17:09:47.589 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 35 2024-09-13T17:09:47.600 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:09:47.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.706+0000 7f70fb59e700 1 Processor -- start 2024-09-13T17:09:47.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.706+0000 7f70fb59e700 1 -- start start 2024-09-13T17:09:47.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.706+0000 7f70fb59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f70fc15ed00 0x7f70fc161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.706+0000 7f70fb59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc162550 con 0x7f70fc161a80 2024-09-13T17:09:47.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.706+0000 7f70fb59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc0cd690 con 0x7f70fc15e920 2024-09-13T17:09:47.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.706+0000 7f70fb59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc161f90 con 0x7f70fc15ed00 2024-09-13T17:09:47.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.706+0000 7f70fad9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f70fc161a80 0x7f70fc0cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41666/0 (socket says 172.21.15.123:41666) 2024-09-13T17:09:47.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.706+0000 7f70fad9d700 1 -- 172.21.15.123:0/3533913491 learned_addr learned my addr 172.21.15.123:0/3533913491 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:47.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.706+0000 7f70f9d9b700 1 --2- 172.21.15.123:0/3533913491 >> v2:172.21.15.153:3300/0 conn(0x7f70fc15ed00 0x7f70fc161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.706+0000 7f70f959a700 1 -- 172.21.15.123:0/3533913491 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022049717 0 0) 0x7f70fc162550 con 0x7f70fc161a80 2024-09-13T17:09:47.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70f959a700 1 -- 172.21.15.123:0/3533913491 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e80035d0 con 0x7f70fc161a80 2024-09-13T17:09:47.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70f959a700 1 -- 172.21.15.123:0/3533913491 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260191691 0 0) 0x7f70fc0cd690 con 0x7f70fc15e920 2024-09-13T17:09:47.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70f959a700 1 -- 172.21.15.123:0/3533913491 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70fc162550 con 0x7f70fc15e920 2024-09-13T17:09:47.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70f9d9b700 1 -- 172.21.15.123:0/3533913491 >> v1:172.21.15.153:6789/0 conn(0x7f70fc15e920 legacy=0x7f70fc0caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70f9d9b700 1 -- 172.21.15.123:0/3533913491 >> v1:172.21.15.123:6789/0 conn(0x7f70fc161a80 legacy=0x7f70fc0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70f9d9b700 1 -- 172.21.15.123:0/3533913491 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc162270 con 0x7f70fc15ed00 2024-09-13T17:09:47.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70f9d9b700 1 --2- 172.21.15.123:0/3533913491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70fc15ed00 0x7f70fc161540 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009850 tx=0x7f70e4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=499d45c142293ee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70f959a700 1 -- 172.21.15.123:0/3533913491 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4011830 con 0x7f70fc15ed00 2024-09-13T17:09:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70f959a700 1 -- 172.21.15.123:0/3533913491 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e4011990 con 0x7f70fc15ed00 2024-09-13T17:09:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70f959a700 1 -- 172.21.15.123:0/3533913491 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4011d40 con 0x7f70fc15ed00 2024-09-13T17:09:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70fb59e700 1 -- 172.21.15.123:0/3533913491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70fc15ed00 msgr2=0x7f70fc161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70fb59e700 1 --2- 172.21.15.123:0/3533913491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70fc15ed00 0x7f70fc161540 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009850 tx=0x7f70e4009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70fb59e700 1 -- 172.21.15.123:0/3533913491 shutdown_connections 2024-09-13T17:09:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70fb59e700 1 --2- 172.21.15.123:0/3533913491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70fc15ed00 0x7f70fc161540 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70fb59e700 1 -- 172.21.15.123:0/3533913491 >> 172.21.15.123:0/3533913491 conn(0x7f70fc066150 msgr2=0x7f70fc066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70fb59e700 1 -- 172.21.15.123:0/3533913491 shutdown_connections 2024-09-13T17:09:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70fb59e700 1 -- 172.21.15.123:0/3533913491 wait complete. 2024-09-13T17:09:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70fb59e700 1 Processor -- start 2024-09-13T17:09:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.710+0000 7f70fb59e700 1 -- start start 2024-09-13T17:09:47.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70fb59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70fc15e920 0x7f70fc15c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70fb59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70fc161a80 0x7f70fc1fa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70fb59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70fc1fadd0 0x7f70fc156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70fb59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc1fb260 con 0x7f70fc161a80 2024-09-13T17:09:47.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70fb59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0afa70 con 0x7f70fc1fadd0 2024-09-13T17:09:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70fb59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc1fa660 con 0x7f70fc15e920 2024-09-13T17:09:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70f9d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70fc161a80 0x7f70fc1fa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70fa59c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70fc15e920 0x7f70fc15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70f9d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70fc161a80 0x7f70fc1fa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51720/0 (socket says 172.21.15.123:51720) 2024-09-13T17:09:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70f9d9b700 1 -- 172.21.15.123:0/3575068750 learned_addr learned my addr 172.21.15.123:0/3575068750 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70fad9d700 1 --2- 172.21.15.123:0/3575068750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70fc1fadd0 0x7f70fc156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70f9d9b700 1 -- 172.21.15.123:0/3575068750 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70fc15e920 msgr2=0x7f70fc15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70f9d9b700 1 --2- 172.21.15.123:0/3575068750 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70fc15e920 0x7f70fc15c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70f9d9b700 1 -- 172.21.15.123:0/3575068750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70fc1fadd0 msgr2=0x7f70fc156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70f9d9b700 1 --2- 172.21.15.123:0/3575068750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70fc1fadd0 0x7f70fc156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70f9d9b700 1 -- 172.21.15.123:0/3575068750 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e40094b0 con 0x7f70fc161a80 2024-09-13T17:09:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70f9d9b700 1 --2- 172.21.15.123:0/3575068750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70fc161a80 0x7f70fc1fa890 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f70e40090b0 tx=0x7f70e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:47.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70f2ffd700 1 -- 172.21.15.123:0/3575068750 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e401a8d0 con 0x7f70fc161a80 2024-09-13T17:09:47.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70f2ffd700 1 -- 172.21.15.123:0/3575068750 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e401f070 con 0x7f70fc161a80 2024-09-13T17:09:47.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70f2ffd700 1 -- 172.21.15.123:0/3575068750 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e401acb0 con 0x7f70fc161a80 2024-09-13T17:09:47.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70fb59e700 1 -- 172.21.15.123:0/3575068750 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc15b350 con 0x7f70fc161a80 2024-09-13T17:09:47.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.714+0000 7f70fb59e700 1 -- 172.21.15.123:0/3575068750 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc15b910 con 0x7f70fc161a80 2024-09-13T17:09:47.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.718+0000 7f70fb59e700 1 -- 172.21.15.123:0/3575068750 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc0677f0 con 0x7f70fc161a80 2024-09-13T17:09:47.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.718+0000 7f70f2ffd700 1 -- 172.21.15.123:0/3575068750 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f70e402e450 con 0x7f70fc161a80 2024-09-13T17:09:47.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.718+0000 7f70f2ffd700 1 --2- 172.21.15.123:0/3575068750 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70dc066730 0x7f70dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:47.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.718+0000 7f70fa59c700 1 --2- 172.21.15.123:0/3575068750 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70dc066730 0x7f70dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:47.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.718+0000 7f70f2ffd700 1 -- 172.21.15.123:0/3575068750 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f70e4085000 con 0x7f70fc161a80 2024-09-13T17:09:47.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.718+0000 7f70fa59c700 1 --2- 172.21.15.123:0/3575068750 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70dc066730 0x7f70dc068bf0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f70ec001560 tx=0x7f70ec009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:47.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.726+0000 7f70f2ffd700 1 -- 172.21.15.123:0/3575068750 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f70e4052380 con 0x7f70fc161a80 2024-09-13T17:09:47.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.926+0000 7f70fb59e700 1 -- 172.21.15.123:0/3575068750 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70fc161540 con 0x7f70fc161a80 2024-09-13T17:09:47.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.926+0000 7f70f2ffd700 1 -- 172.21.15.123:0/3575068750 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f70e40559a0 con 0x7f70fc161a80 2024-09-13T17:09:47.931 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:47.931 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3155329877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3155329877},{"type":"v1","addr":"172.21.15.153:6835","nonce":3155329877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6522,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3484528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3484528665},{"type":"v1","addr":"172.21.15.123:6835","nonce":3484528665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6525,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/4217126083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":4217126083},{"type":"v1","addr":"172.21.15.123:6837","nonce":4217126083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:09:18.926234+0000","modified":"2024-09-13T17:09:21.936807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6534":{"gid":6534,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6833/1222139823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1222139823},{"type":"v1","addr":"172.21.15.153:6833","nonce":1222139823}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T17:09:47.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.926+0000 7f70fb59e700 1 -- 172.21.15.123:0/3575068750 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70dc066730 msgr2=0x7f70dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.926+0000 7f70fb59e700 1 --2- 172.21.15.123:0/3575068750 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70dc066730 0x7f70dc068bf0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f70ec001560 tx=0x7f70ec009040 comp rx=0 tx=0).stop 2024-09-13T17:09:47.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.926+0000 7f70fb59e700 1 -- 172.21.15.123:0/3575068750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70fc161a80 msgr2=0x7f70fc1fa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:47.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.926+0000 7f70fb59e700 1 --2- 172.21.15.123:0/3575068750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70fc161a80 0x7f70fc1fa890 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f70e40090b0 tx=0x7f70e4004770 comp rx=0 tx=0).stop 2024-09-13T17:09:47.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.926+0000 7f70fb59e700 1 -- 172.21.15.123:0/3575068750 shutdown_connections 2024-09-13T17:09:47.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.926+0000 7f70fb59e700 1 --2- 172.21.15.123:0/3575068750 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70dc066730 0x7f70dc068bf0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.926+0000 7f70fb59e700 1 --2- 172.21.15.123:0/3575068750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70fc1fadd0 0x7f70fc156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.926+0000 7f70fb59e700 1 --2- 172.21.15.123:0/3575068750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70fc161a80 0x7f70fc1fa890 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.930+0000 7f70fb59e700 1 --2- 172.21.15.123:0/3575068750 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70fc15e920 0x7f70fc15c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:47.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.930+0000 7f70fb59e700 1 -- 172.21.15.123:0/3575068750 >> 172.21.15.123:0/3575068750 conn(0x7f70fc066150 msgr2=0x7f70fc070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:47.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.930+0000 7f70fb59e700 1 -- 172.21.15.123:0/3575068750 shutdown_connections 2024-09-13T17:09:47.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:47.930+0000 7f70fb59e700 1 -- 172.21.15.123:0/3575068750 wait complete. 2024-09-13T17:09:47.936 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 35 2024-09-13T17:09:47.946 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:48.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.046+0000 7f2c1cdde700 1 Processor -- start 2024-09-13T17:09:48.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.046+0000 7f2c1cdde700 1 -- start start 2024-09-13T17:09:48.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.046+0000 7f2c1cdde700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2c180cdb70 0x7f2c180cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.046+0000 7f2c1cdde700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c180cb730 con 0x7f2c18153770 2024-09-13T17:09:48.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.046+0000 7f2c1cdde700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c180cba10 con 0x7f2c18153390 2024-09-13T17:09:48.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.046+0000 7f2c1cdde700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c181595a0 con 0x7f2c180cdb70 2024-09-13T17:09:48.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.046+0000 7f2c16ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2c180cdb70 0x7f2c180cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.046+0000 7f2c17fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2c18153770 0x7f2c180ad700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41678/0 (socket says 172.21.15.123:41678) 2024-09-13T17:09:48.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.046+0000 7f2c17fff700 1 -- 172.21.15.123:0/3834134173 learned_addr learned my addr 172.21.15.123:0/3834134173 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:48.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c16ffd700 1 -- 172.21.15.123:0/3834134173 >> v1:172.21.15.153:6789/0 conn(0x7f2c18153390 legacy=0x7f2c18159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c16ffd700 1 -- 172.21.15.123:0/3834134173 >> v1:172.21.15.123:6789/0 conn(0x7f2c18153770 legacy=0x7f2c180ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c16ffd700 1 -- 172.21.15.123:0/3834134173 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c18159780 con 0x7f2c180cdb70 2024-09-13T17:09:48.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c16ffd700 1 --2- 172.21.15.123:0/3834134173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c180cdb70 0x7f2c180cae30 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009850 tx=0x7f2c0c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc86d8ecc008a99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c167fc700 1 -- 172.21.15.123:0/3834134173 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c00b830 con 0x7f2c180cdb70 2024-09-13T17:09:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c167fc700 1 -- 172.21.15.123:0/3834134173 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c00b990 con 0x7f2c180cdb70 2024-09-13T17:09:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c167fc700 1 -- 172.21.15.123:0/3834134173 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c00bd20 con 0x7f2c180cdb70 2024-09-13T17:09:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c1cdde700 1 -- 172.21.15.123:0/3834134173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c180cdb70 msgr2=0x7f2c180cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c1cdde700 1 --2- 172.21.15.123:0/3834134173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c180cdb70 0x7f2c180cae30 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009850 tx=0x7f2c0c009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c1cdde700 1 -- 172.21.15.123:0/3834134173 shutdown_connections 2024-09-13T17:09:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c1cdde700 1 --2- 172.21.15.123:0/3834134173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c180cdb70 0x7f2c180cae30 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c1cdde700 1 -- 172.21.15.123:0/3834134173 >> 172.21.15.123:0/3834134173 conn(0x7f2c18066150 msgr2=0x7f2c18066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c1cdde700 1 -- 172.21.15.123:0/3834134173 shutdown_connections 2024-09-13T17:09:48.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c1cdde700 1 -- 172.21.15.123:0/3834134173 wait complete. 2024-09-13T17:09:48.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c1cdde700 1 Processor -- start 2024-09-13T17:09:48.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.050+0000 7f2c1cdde700 1 -- start start 2024-09-13T17:09:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c1cdde700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c180cdb70 0x7f2c1806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c1cdde700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c18153390 0x7f2c181f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c1cdde700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c18153770 0x7f2c181f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c1cdde700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18154d50 con 0x7f2c180cdb70 2024-09-13T17:09:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c1cdde700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18154140 con 0x7f2c18153390 2024-09-13T17:09:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c1cdde700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18154420 con 0x7f2c18153770 2024-09-13T17:09:48.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c177fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c180cdb70 0x7f2c1806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c177fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c180cdb70 0x7f2c1806d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51744/0 (socket says 172.21.15.123:51744) 2024-09-13T17:09:48.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c16ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c18153390 0x7f2c181f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c177fe700 1 -- 172.21.15.123:0/2912766262 learned_addr learned my addr 172.21.15.123:0/2912766262 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:48.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c17fff700 1 --2- 172.21.15.123:0/2912766262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c18153770 0x7f2c181f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c177fe700 1 -- 172.21.15.123:0/2912766262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c18153770 msgr2=0x7f2c181f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c177fe700 1 --2- 172.21.15.123:0/2912766262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c18153770 0x7f2c181f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c177fe700 1 -- 172.21.15.123:0/2912766262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c18153390 msgr2=0x7f2c181f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c177fe700 1 --2- 172.21.15.123:0/2912766262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c18153390 0x7f2c181f6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c177fe700 1 -- 172.21.15.123:0/2912766262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c0094b0 con 0x7f2c180cdb70 2024-09-13T17:09:48.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.054+0000 7f2c177fe700 1 --2- 172.21.15.123:0/2912766262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c180cdb70 0x7f2c1806d150 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800c500 tx=0x7f2c0800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:48.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.058+0000 7f2bfffff700 1 -- 172.21.15.123:0/2912766262 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080052d0 con 0x7f2c180cdb70 2024-09-13T17:09:48.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.058+0000 7f2c1cdde700 1 -- 172.21.15.123:0/2912766262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c18154700 con 0x7f2c180cdb70 2024-09-13T17:09:48.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.058+0000 7f2bfffff700 1 -- 172.21.15.123:0/2912766262 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c08005430 con 0x7f2c180cdb70 2024-09-13T17:09:48.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.058+0000 7f2c1cdde700 1 -- 172.21.15.123:0/2912766262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c18151b10 con 0x7f2c180cdb70 2024-09-13T17:09:48.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.058+0000 7f2bfffff700 1 -- 172.21.15.123:0/2912766262 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080055a0 con 0x7f2c180cdb70 2024-09-13T17:09:48.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.058+0000 7f2c1cdde700 1 -- 172.21.15.123:0/2912766262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c180677f0 con 0x7f2c180cdb70 2024-09-13T17:09:48.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.058+0000 7f2bfffff700 1 -- 172.21.15.123:0/2912766262 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c080038a0 con 0x7f2c180cdb70 2024-09-13T17:09:48.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.058+0000 7f2bfffff700 1 --2- 172.21.15.123:0/2912766262 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2c04066730 0x7f2c04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.058+0000 7f2bfffff700 1 -- 172.21.15.123:0/2912766262 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2c080835d0 con 0x7f2c180cdb70 2024-09-13T17:09:48.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.058+0000 7f2c16ffd700 1 --2- 172.21.15.123:0/2912766262 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2c04066730 0x7f2c04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.062+0000 7f2c16ffd700 1 --2- 172.21.15.123:0/2912766262 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2c04066730 0x7f2c04068bf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009fd0 tx=0x7f2c0c01b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:48.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.066+0000 7f2bfffff700 1 -- 172.21.15.123:0/2912766262 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2c080507c0 con 0x7f2c180cdb70 2024-09-13T17:09:48.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.230+0000 7f2c1cdde700 1 -- 172.21.15.123:0/2912766262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c180cae30 con 0x7f2c180cdb70 2024-09-13T17:09:48.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.234+0000 7f2bfffff700 1 -- 172.21.15.123:0/2912766262 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16808 (secure 0 0 0) 0x7f2c08053de0 con 0x7f2c180cdb70 2024-09-13T17:09:48.239 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:48.239 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":74,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:09:32.997963+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:17.328080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:17.920002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1","mappings":[{"from":6,"to":0}]},{"pgid":"11.9","mappings":[{"from":6,"to":5}]},{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.33","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.234+0000 7f2c1cdde700 1 -- 172.21.15.123:0/2912766262 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2c04066730 msgr2=0x7f2c04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.234+0000 7f2c1cdde700 1 --2- 172.21.15.123:0/2912766262 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2c04066730 0x7f2c04068bf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009fd0 tx=0x7f2c0c01b040 comp rx=0 tx=0).stop 2024-09-13T17:09:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.234+0000 7f2c1cdde700 1 -- 172.21.15.123:0/2912766262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c180cdb70 msgr2=0x7f2c1806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.234+0000 7f2c1cdde700 1 --2- 172.21.15.123:0/2912766262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c180cdb70 0x7f2c1806d150 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800c500 tx=0x7f2c0800c810 comp rx=0 tx=0).stop 2024-09-13T17:09:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.234+0000 7f2c1cdde700 1 -- 172.21.15.123:0/2912766262 shutdown_connections 2024-09-13T17:09:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.234+0000 7f2c1cdde700 1 --2- 172.21.15.123:0/2912766262 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2c04066730 0x7f2c04068bf0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.234+0000 7f2c1cdde700 1 --2- 172.21.15.123:0/2912766262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2c18153770 0x7f2c181f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.234+0000 7f2c1cdde700 1 --2- 172.21.15.123:0/2912766262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c18153390 0x7f2c181f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.234+0000 7f2c1cdde700 1 --2- 172.21.15.123:0/2912766262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c180cdb70 0x7f2c1806d150 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.234+0000 7f2c1cdde700 1 -- 172.21.15.123:0/2912766262 >> 172.21.15.123:0/2912766262 conn(0x7f2c18066150 msgr2=0x7f2c180ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.234+0000 7f2c1cdde700 1 -- 172.21.15.123:0/2912766262 shutdown_connections 2024-09-13T17:09:48.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.234+0000 7f2c1cdde700 1 -- 172.21.15.123:0/2912766262 wait complete. 2024-09-13T17:09:48.253 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:09:48.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.366+0000 7f7e52e47700 1 Processor -- start 2024-09-13T17:09:48.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.366+0000 7f7e52e47700 1 -- start start 2024-09-13T17:09:48.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.366+0000 7f7e52e47700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c0cb040 0x7f7e4c0cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.366+0000 7f7e52e47700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7e4c0c9330 0x7f7e4c0c9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.366+0000 7f7e52e47700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4c0cb9c0 con 0x7f7e4c15ceb0 2024-09-13T17:09:48.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.366+0000 7f7e52e47700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4c160a70 con 0x7f7e4c0c9330 2024-09-13T17:09:48.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.366+0000 7f7e52e47700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c160d10 con 0x7f7e4c0cb040 2024-09-13T17:09:48.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.366+0000 7f7e51e45700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7e4c15ceb0 0x7f7e4c0ad980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41692/0 (socket says 172.21.15.123:41692) 2024-09-13T17:09:48.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.366+0000 7f7e51e45700 1 -- 172.21.15.123:0/2565719637 learned_addr learned my addr 172.21.15.123:0/2565719637 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:48.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.366+0000 7f7e52646700 1 --2- 172.21.15.123:0/2565719637 >> v2:172.21.15.153:3300/0 conn(0x7f7e4c0c9330 0x7f7e4c0c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.366+0000 7f7e51644700 1 --2- 172.21.15.123:0/2565719637 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c0cb040 0x7f7e4c0cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e50e43700 1 -- 172.21.15.123:0/2565719637 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136487339 0 0) 0x7f7e4c0cb9c0 con 0x7f7e4c15ceb0 2024-09-13T17:09:48.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e50e43700 1 -- 172.21.15.123:0/2565719637 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e340035d0 con 0x7f7e4c15ceb0 2024-09-13T17:09:48.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e51644700 1 -- 172.21.15.123:0/2565719637 >> v2:172.21.15.153:3300/0 conn(0x7f7e4c0c9330 msgr2=0x7f7e4c0c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:48.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e51644700 1 --2- 172.21.15.123:0/2565719637 >> v2:172.21.15.153:3300/0 conn(0x7f7e4c0c9330 0x7f7e4c0c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e51644700 1 -- 172.21.15.123:0/2565719637 >> v1:172.21.15.123:6789/0 conn(0x7f7e4c15ceb0 legacy=0x7f7e4c0ad980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e51644700 1 -- 172.21.15.123:0/2565719637 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c160ff0 con 0x7f7e4c0cb040 2024-09-13T17:09:48.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e51644700 1 --2- 172.21.15.123:0/2565719637 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c0cb040 0x7f7e4c0cb480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009d90 tx=0x7f7e4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1fbac395be44af1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:48.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e50e43700 1 -- 172.21.15.123:0/2565719637 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4800e070 con 0x7f7e4c0cb040 2024-09-13T17:09:48.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e50e43700 1 -- 172.21.15.123:0/2565719637 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4800bb20 con 0x7f7e4c0cb040 2024-09-13T17:09:48.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e50e43700 1 -- 172.21.15.123:0/2565719637 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4800be90 con 0x7f7e4c0cb040 2024-09-13T17:09:48.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e52e47700 1 -- 172.21.15.123:0/2565719637 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c0cb040 msgr2=0x7f7e4c0cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e52e47700 1 --2- 172.21.15.123:0/2565719637 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c0cb040 0x7f7e4c0cb480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009d90 tx=0x7f7e4800b330 comp rx=0 tx=0).stop 2024-09-13T17:09:48.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e52e47700 1 -- 172.21.15.123:0/2565719637 shutdown_connections 2024-09-13T17:09:48.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e52e47700 1 --2- 172.21.15.123:0/2565719637 >> v2:172.21.15.153:3300/0 conn(0x7f7e4c0c9330 0x7f7e4c0c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e52e47700 1 --2- 172.21.15.123:0/2565719637 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c0cb040 0x7f7e4c0cb480 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e52e47700 1 -- 172.21.15.123:0/2565719637 >> 172.21.15.123:0/2565719637 conn(0x7f7e4c0b01d0 msgr2=0x7f7e4c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:48.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e52e47700 1 -- 172.21.15.123:0/2565719637 shutdown_connections 2024-09-13T17:09:48.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e52e47700 1 -- 172.21.15.123:0/2565719637 wait complete. 2024-09-13T17:09:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e52e47700 1 Processor -- start 2024-09-13T17:09:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.370+0000 7f7e52e47700 1 -- start start 2024-09-13T17:09:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e52e47700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e4c0c9330 0x7f7e4c154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e52e47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e4c0cb040 0x7f7e4c154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e52e47700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c15ceb0 0x7f7e4c156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e52e47700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c0c7e10 con 0x7f7e4c0c9330 2024-09-13T17:09:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e52e47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c0c5750 con 0x7f7e4c0cb040 2024-09-13T17:09:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e52e47700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c156dc0 con 0x7f7e4c15ceb0 2024-09-13T17:09:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e51e45700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e4c0c9330 0x7f7e4c154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e51e45700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e4c0c9330 0x7f7e4c154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51752/0 (socket says 172.21.15.123:51752) 2024-09-13T17:09:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e51e45700 1 -- 172.21.15.123:0/1478051671 learned_addr learned my addr 172.21.15.123:0/1478051671 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e51644700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e4c0cb040 0x7f7e4c154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e52646700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c15ceb0 0x7f7e4c156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e51e45700 1 -- 172.21.15.123:0/1478051671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c15ceb0 msgr2=0x7f7e4c156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e51e45700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c15ceb0 0x7f7e4c156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e51e45700 1 -- 172.21.15.123:0/1478051671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e4c0cb040 msgr2=0x7f7e4c154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e51e45700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e4c0cb040 0x7f7e4c154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e51e45700 1 -- 172.21.15.123:0/1478051671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e48009a70 con 0x7f7e4c0c9330 2024-09-13T17:09:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e52646700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c15ceb0 0x7f7e4c156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e51e45700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e4c0c9330 0x7f7e4c154870 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400c4d0 tx=0x7f7e4400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e427fc700 1 -- 172.21.15.123:0/1478051671 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44005d90 con 0x7f7e4c0c9330 2024-09-13T17:09:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e52e47700 1 -- 172.21.15.123:0/1478051671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4c157040 con 0x7f7e4c0c9330 2024-09-13T17:09:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e427fc700 1 -- 172.21.15.123:0/1478051671 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e440070d0 con 0x7f7e4c0c9330 2024-09-13T17:09:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e52e47700 1 -- 172.21.15.123:0/1478051671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4c157600 con 0x7f7e4c0c9330 2024-09-13T17:09:48.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e427fc700 1 -- 172.21.15.123:0/1478051671 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44007440 con 0x7f7e4c0c9330 2024-09-13T17:09:48.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.374+0000 7f7e52e47700 1 -- 172.21.15.123:0/1478051671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4c0ce210 con 0x7f7e4c0c9330 2024-09-13T17:09:48.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.378+0000 7f7e427fc700 1 -- 172.21.15.123:0/1478051671 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7e440075a0 con 0x7f7e4c0c9330 2024-09-13T17:09:48.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.378+0000 7f7e427fc700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7e38066760 0x7f7e38068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.378+0000 7f7e427fc700 1 -- 172.21.15.123:0/1478051671 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7e440834e0 con 0x7f7e4c0c9330 2024-09-13T17:09:48.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.378+0000 7f7e51644700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7e38066760 0x7f7e38068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.378+0000 7f7e51644700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7e38066760 0x7f7e38068c20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7e48014040 tx=0x7f7e48011000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:48.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.386+0000 7f7e427fc700 1 -- 172.21.15.123:0/1478051671 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7e44050800 con 0x7f7e4c0c9330 2024-09-13T17:09:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.590+0000 7f7e52e47700 1 -- 172.21.15.123:0/1478051671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7e4c0b4600 con 0x7f7e4c0c9330 2024-09-13T17:09:48.596 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-13T17:09:48.590+0000 7f1c63ac9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:09:48.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.602+0000 7f7e427fc700 1 -- 172.21.15.123:0/1478051671 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7e44053e20 con 0x7f7e4c0c9330 2024-09-13T17:09:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.606+0000 7f7e52e47700 1 -- 172.21.15.123:0/1478051671 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7e38066760 msgr2=0x7f7e38068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.606+0000 7f7e52e47700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7e38066760 0x7f7e38068c20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7e48014040 tx=0x7f7e48011000 comp rx=0 tx=0).stop 2024-09-13T17:09:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.606+0000 7f7e52e47700 1 -- 172.21.15.123:0/1478051671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e4c0c9330 msgr2=0x7f7e4c154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.606+0000 7f7e52e47700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e4c0c9330 0x7f7e4c154870 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400c4d0 tx=0x7f7e4400c7e0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.606+0000 7f7e52e47700 1 -- 172.21.15.123:0/1478051671 shutdown_connections 2024-09-13T17:09:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.606+0000 7f7e52e47700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7e38066760 0x7f7e38068c20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.606+0000 7f7e52e47700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7e4c15ceb0 0x7f7e4c156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.606+0000 7f7e52e47700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e4c0cb040 0x7f7e4c154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.606+0000 7f7e52e47700 1 --2- 172.21.15.123:0/1478051671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e4c0c9330 0x7f7e4c154870 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.606+0000 7f7e52e47700 1 -- 172.21.15.123:0/1478051671 >> 172.21.15.123:0/1478051671 conn(0x7f7e4c0b01d0 msgr2=0x7f7e4c0ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.606+0000 7f7e52e47700 1 -- 172.21.15.123:0/1478051671 shutdown_connections 2024-09-13T17:09:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.606+0000 7f7e52e47700 1 -- 172.21.15.123:0/1478051671 wait complete. 2024-09-13T17:09:48.614 INFO:tasks.ceph.mds.b.smithi153.stderr: -3247> 2024-09-13T17:09:19.869+0000 7fb57a80d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:09:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:09:48.627 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:09:48.647 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-09-13T17:09:48.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.742+0000 7fe7f89bc700 1 Processor -- start 2024-09-13T17:09:48.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.742+0000 7fe7f89bc700 1 -- start start 2024-09-13T17:09:48.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f89bc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7f40d0f40 0x7fe7f40d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f89bc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe7f40b58b0 0x7fe7f40d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f89bc700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f40b0060 con 0x7fe7f40b1100 2024-09-13T17:09:48.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f89bc700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f40b0340 con 0x7fe7f40d0f40 2024-09-13T17:09:48.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f89bc700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f40b0620 con 0x7fe7f40b58b0 2024-09-13T17:09:48.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f2d9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7f40d0f40 0x7fe7f40d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f2d9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7f40d0f40 0x7fe7f40d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51760/0 (socket says 172.21.15.123:51760) 2024-09-13T17:09:48.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f2d9d700 1 -- 172.21.15.123:0/561224903 learned_addr learned my addr 172.21.15.123:0/561224903 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:48.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7ebfff700 1 --2- 172.21.15.123:0/561224903 >> v2:172.21.15.153:3300/0 conn(0x7fe7f40b58b0 0x7fe7f40d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f2d9d700 1 -- 172.21.15.123:0/561224903 >> v2:172.21.15.153:3300/0 conn(0x7fe7f40b58b0 msgr2=0x7fe7f40d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:48.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f2d9d700 1 --2- 172.21.15.123:0/561224903 >> v2:172.21.15.153:3300/0 conn(0x7fe7f40b58b0 0x7fe7f40d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f2d9d700 1 -- 172.21.15.123:0/561224903 >> v1:172.21.15.153:6789/0 conn(0x7fe7f40b1100 legacy=0x7fe7f40b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f2d9d700 1 -- 172.21.15.123:0/561224903 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f40b0900 con 0x7fe7f40d0f40 2024-09-13T17:09:48.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7ebfff700 1 --2- 172.21.15.123:0/561224903 >> v2:172.21.15.153:3300/0 conn(0x7fe7f40b58b0 0x7fe7f40d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:48.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f2d9d700 1 --2- 172.21.15.123:0/561224903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40d0f40 0x7fe7f40d1320 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4067070 tx=0x7fe7e4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2d7902a013ee96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:48.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f259c700 1 -- 172.21.15.123:0/561224903 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4011830 con 0x7fe7f40d0f40 2024-09-13T17:09:48.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f259c700 1 -- 172.21.15.123:0/561224903 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e4011990 con 0x7fe7f40d0f40 2024-09-13T17:09:48.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f259c700 1 -- 172.21.15.123:0/561224903 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4011d20 con 0x7fe7f40d0f40 2024-09-13T17:09:48.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f89bc700 1 -- 172.21.15.123:0/561224903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40d0f40 msgr2=0x7fe7f40d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f89bc700 1 --2- 172.21.15.123:0/561224903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40d0f40 0x7fe7f40d1320 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4067070 tx=0x7fe7e4009bf0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f89bc700 1 -- 172.21.15.123:0/561224903 shutdown_connections 2024-09-13T17:09:48.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f89bc700 1 --2- 172.21.15.123:0/561224903 >> v2:172.21.15.153:3300/0 conn(0x7fe7f40b58b0 0x7fe7f40d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f89bc700 1 --2- 172.21.15.123:0/561224903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40d0f40 0x7fe7f40d1320 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f89bc700 1 -- 172.21.15.123:0/561224903 >> 172.21.15.123:0/561224903 conn(0x7fe7f40d2a60 msgr2=0x7fe7f40d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:48.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f89bc700 1 -- 172.21.15.123:0/561224903 shutdown_connections 2024-09-13T17:09:48.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.746+0000 7fe7f89bc700 1 -- 172.21.15.123:0/561224903 wait complete. 2024-09-13T17:09:48.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f89bc700 1 Processor -- start 2024-09-13T17:09:48.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f89bc700 1 -- start start 2024-09-13T17:09:48.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f89bc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40b1100 0x7fe7f40cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f89bc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7f40b58b0 0x7fe7f40cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f89bc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7f40d0f40 0x7fe7f40b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f89bc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f41e8400 con 0x7fe7f40b1100 2024-09-13T17:09:48.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f89bc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f40cc190 con 0x7fe7f40d0f40 2024-09-13T17:09:48.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f89bc700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f40cb2e0 con 0x7fe7f40b58b0 2024-09-13T17:09:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f2d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40b1100 0x7fe7f40cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f2d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40b1100 0x7fe7f40cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51762/0 (socket says 172.21.15.123:51762) 2024-09-13T17:09:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f2d9d700 1 -- 172.21.15.123:0/309196053 learned_addr learned my addr 172.21.15.123:0/309196053 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7ebfff700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7f40b58b0 0x7fe7f40cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f359e700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7f40d0f40 0x7fe7f40b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f2d9d700 1 -- 172.21.15.123:0/309196053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7f40b58b0 msgr2=0x7fe7f40cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f2d9d700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7f40b58b0 0x7fe7f40cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f2d9d700 1 -- 172.21.15.123:0/309196053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7f40d0f40 msgr2=0x7fe7f40b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f2d9d700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7f40d0f40 0x7fe7f40b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f2d9d700 1 -- 172.21.15.123:0/309196053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc0094b0 con 0x7fe7f40b1100 2024-09-13T17:09:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7ebfff700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7f40b58b0 0x7fe7f40cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f2d9d700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40b1100 0x7fe7f40cc5b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40d29c0 tx=0x7fe7e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7eb7fe700 1 -- 172.21.15.123:0/309196053 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4004610 con 0x7fe7f40b1100 2024-09-13T17:09:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7eb7fe700 1 -- 172.21.15.123:0/309196053 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e401e070 con 0x7fe7f40b1100 2024-09-13T17:09:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7eb7fe700 1 -- 172.21.15.123:0/309196053 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e40038e0 con 0x7fe7f40b1100 2024-09-13T17:09:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f89bc700 1 -- 172.21.15.123:0/309196053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e4009570 con 0x7fe7f40b1100 2024-09-13T17:09:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.750+0000 7fe7f89bc700 1 -- 172.21.15.123:0/309196053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f40cb7f0 con 0x7fe7f40b1100 2024-09-13T17:09:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.754+0000 7fe7f89bc700 1 -- 172.21.15.123:0/309196053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f40cc2d0 con 0x7fe7f40b1100 2024-09-13T17:09:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.754+0000 7fe7eb7fe700 1 -- 172.21.15.123:0/309196053 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe7e4003a40 con 0x7fe7f40b1100 2024-09-13T17:09:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.754+0000 7fe7eb7fe700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7d4066730 0x7fe7d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.754+0000 7fe7ebfff700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7d4066730 0x7fe7d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.754+0000 7fe7eb7fe700 1 -- 172.21.15.123:0/309196053 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fe7e40852a0 con 0x7fe7f40b1100 2024-09-13T17:09:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.754+0000 7fe7ebfff700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7d4066730 0x7fe7d4068bf0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40b55c0 tx=0x7fe7dc008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.762+0000 7fe7eb7fe700 1 -- 172.21.15.123:0/309196053 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe7e40526f0 con 0x7fe7f40b1100 2024-09-13T17:09:48.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:48.970+0000 7fe7f89bc700 1 -- 172.21.15.123:0/309196053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe7f415ce70 con 0x7fe7f40b1100 2024-09-13T17:09:49.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.614+0000 7fe7eb7fe700 1 -- 172.21.15.123:0/309196053 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe7e4055d10 con 0x7fe7f40b1100 2024-09-13T17:09:49.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.618+0000 7fe7f89bc700 1 -- 172.21.15.123:0/309196053 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7d4066730 msgr2=0x7fe7d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:49.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.618+0000 7fe7f89bc700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7d4066730 0x7fe7d4068bf0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40b55c0 tx=0x7fe7dc008040 comp rx=0 tx=0).stop 2024-09-13T17:09:49.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.618+0000 7fe7f89bc700 1 -- 172.21.15.123:0/309196053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40b1100 msgr2=0x7fe7f40cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:49.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.618+0000 7fe7f89bc700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40b1100 0x7fe7f40cc5b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40d29c0 tx=0x7fe7e4004770 comp rx=0 tx=0).stop 2024-09-13T17:09:49.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.618+0000 7fe7f89bc700 1 -- 172.21.15.123:0/309196053 shutdown_connections 2024-09-13T17:09:49.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.618+0000 7fe7f89bc700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe7d4066730 0x7fe7d4068bf0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:49.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.618+0000 7fe7f89bc700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7f40d0f40 0x7fe7f40b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:49.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.618+0000 7fe7f89bc700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7f40b58b0 0x7fe7f40cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:49.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.618+0000 7fe7f89bc700 1 --2- 172.21.15.123:0/309196053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40b1100 0x7fe7f40cc5b0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:49.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.618+0000 7fe7f89bc700 1 -- 172.21.15.123:0/309196053 >> 172.21.15.123:0/309196053 conn(0x7fe7f40d2a60 msgr2=0x7fe7f40b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:49.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.618+0000 7fe7f89bc700 1 -- 172.21.15.123:0/309196053 shutdown_connections 2024-09-13T17:09:49.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.618+0000 7fe7f89bc700 1 -- 172.21.15.123:0/309196053 wait complete. 2024-09-13T17:09:49.639 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:09:49.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.754+0000 7f440e171700 1 Processor -- start 2024-09-13T17:09:49.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.754+0000 7f440e171700 1 -- start start 2024-09-13T17:09:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.754+0000 7f440e171700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44080ced40 0x7f440806d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.754+0000 7f440e171700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4408156590 0x7f4408159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.754+0000 7f440e171700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440806dc60 con 0x7f440806a260 2024-09-13T17:09:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.754+0000 7f440e171700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f440806d870 con 0x7f4408156590 2024-09-13T17:09:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.754+0000 7f440e171700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4408159cd0 con 0x7f44080ced40 2024-09-13T17:09:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.754+0000 7f440d970700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4408156590 0x7f4408159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.754+0000 7f440d970700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4408156590 0x7f4408159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51766/0 (socket says 172.21.15.123:51766) 2024-09-13T17:09:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.754+0000 7f440d970700 1 -- 172.21.15.123:0/4021268848 learned_addr learned my addr 172.21.15.123:0/4021268848 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f440c96e700 1 --2- 172.21.15.123:0/4021268848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44080ced40 0x7f440806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f440d970700 1 -- 172.21.15.123:0/4021268848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44080ced40 msgr2=0x7f440806d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f440d970700 1 --2- 172.21.15.123:0/4021268848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44080ced40 0x7f440806d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f440d970700 1 -- 172.21.15.123:0/4021268848 >> v1:172.21.15.153:6789/0 conn(0x7f440806a260 legacy=0x7f44080ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f440d970700 1 -- 172.21.15.123:0/4021268848 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4408156a00 con 0x7f4408156590 2024-09-13T17:09:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f440d970700 1 --2- 172.21.15.123:0/4021268848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4408156590 0x7f4408159790 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4400009e80 tx=0x7f440000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74f31d8836a01e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f43fffff700 1 -- 172.21.15.123:0/4021268848 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440000e070 con 0x7f4408156590 2024-09-13T17:09:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f43fffff700 1 -- 172.21.15.123:0/4021268848 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440000b980 con 0x7f4408156590 2024-09-13T17:09:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f43fffff700 1 -- 172.21.15.123:0/4021268848 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440000bd30 con 0x7f4408156590 2024-09-13T17:09:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f440e171700 1 -- 172.21.15.123:0/4021268848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4408156590 msgr2=0x7f4408159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f440e171700 1 --2- 172.21.15.123:0/4021268848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4408156590 0x7f4408159790 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4400009e80 tx=0x7f440000b330 comp rx=0 tx=0).stop 2024-09-13T17:09:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f440e171700 1 -- 172.21.15.123:0/4021268848 shutdown_connections 2024-09-13T17:09:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f440e171700 1 --2- 172.21.15.123:0/4021268848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4408156590 0x7f4408159790 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f440e171700 1 --2- 172.21.15.123:0/4021268848 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f44080ced40 0x7f440806d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f440e171700 1 -- 172.21.15.123:0/4021268848 >> 172.21.15.123:0/4021268848 conn(0x7f4408072730 msgr2=0x7f4408066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f440e171700 1 -- 172.21.15.123:0/4021268848 shutdown_connections 2024-09-13T17:09:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.758+0000 7f440e171700 1 -- 172.21.15.123:0/4021268848 wait complete. 2024-09-13T17:09:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440e171700 1 Processor -- start 2024-09-13T17:09:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440e171700 1 -- start start 2024-09-13T17:09:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440e171700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f440806a260 0x7f440814c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440e171700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44080ced40 0x7f440814d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440e171700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4408156590 0x7f440814d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440e171700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440814d200 con 0x7f4408156590 2024-09-13T17:09:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440e171700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44081494b0 con 0x7f44080ced40 2024-09-13T17:09:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440e171700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4408149790 con 0x7f440806a260 2024-09-13T17:09:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440d970700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4408156590 0x7f440814d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440d970700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4408156590 0x7f440814d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51768/0 (socket says 172.21.15.123:51768) 2024-09-13T17:09:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440d970700 1 -- 172.21.15.123:0/1033041695 learned_addr learned my addr 172.21.15.123:0/1033041695 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440c96e700 1 --2- 172.21.15.123:0/1033041695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44080ced40 0x7f440814d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440d16f700 1 --2- 172.21.15.123:0/1033041695 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f440806a260 0x7f440814c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440d970700 1 -- 172.21.15.123:0/1033041695 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f440806a260 msgr2=0x7f440814c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440d970700 1 --2- 172.21.15.123:0/1033041695 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f440806a260 0x7f440814c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440d970700 1 -- 172.21.15.123:0/1033041695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44080ced40 msgr2=0x7f440814d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.762+0000 7f440d970700 1 --2- 172.21.15.123:0/1033041695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44080ced40 0x7f440814d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.766+0000 7f440d970700 1 -- 172.21.15.123:0/1033041695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4400009b30 con 0x7f4408156590 2024-09-13T17:09:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.766+0000 7f440d970700 1 --2- 172.21.15.123:0/1033041695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4408156590 0x7f440814d8d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f44080b03b0 tx=0x7f4400004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.766+0000 7f43fdffb700 1 -- 172.21.15.123:0/1033041695 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400004800 con 0x7f4408156590 2024-09-13T17:09:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.766+0000 7f43fdffb700 1 -- 172.21.15.123:0/1033041695 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44000099b0 con 0x7f4408156590 2024-09-13T17:09:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.766+0000 7f43fdffb700 1 -- 172.21.15.123:0/1033041695 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440001c680 con 0x7f4408156590 2024-09-13T17:09:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.766+0000 7f440e171700 1 -- 172.21.15.123:0/1033041695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4408149a70 con 0x7f4408156590 2024-09-13T17:09:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.766+0000 7f440e171700 1 -- 172.21.15.123:0/1033041695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440814bd30 con 0x7f4408156590 2024-09-13T17:09:49.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.766+0000 7f440e171700 1 -- 172.21.15.123:0/1033041695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44080677f0 con 0x7f4408156590 2024-09-13T17:09:49.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.766+0000 7f43fdffb700 1 -- 172.21.15.123:0/1033041695 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f440001c7e0 con 0x7f4408156590 2024-09-13T17:09:49.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.766+0000 7f43fdffb700 1 --2- 172.21.15.123:0/1033041695 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f43ec066730 0x7f43ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:49.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.766+0000 7f43fdffb700 1 -- 172.21.15.123:0/1033041695 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f44000859a0 con 0x7f4408156590 2024-09-13T17:09:49.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.766+0000 7f440d16f700 1 --2- 172.21.15.123:0/1033041695 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f43ec066730 0x7f43ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:49.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.770+0000 7f440d16f700 1 --2- 172.21.15.123:0/1033041695 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f43ec066730 0x7f43ec068bf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f44080afc40 tx=0x7f43f8009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:49.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.774+0000 7f43fdffb700 1 -- 172.21.15.123:0/1033041695 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4400052c30 con 0x7f4408156590 2024-09-13T17:09:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:49.942+0000 7f440e171700 1 -- 172.21.15.123:0/1033041695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4408149f90 con 0x7f4408156590 2024-09-13T17:09:50.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.618+0000 7f43fdffb700 1 -- 172.21.15.123:0/1033041695 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v76) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4408149f90 con 0x7f4408156590 2024-09-13T17:09:50.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.622+0000 7f440e171700 1 -- 172.21.15.123:0/1033041695 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f43ec066730 msgr2=0x7f43ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:50.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.622+0000 7f440e171700 1 --2- 172.21.15.123:0/1033041695 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f43ec066730 0x7f43ec068bf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f44080afc40 tx=0x7f43f8009040 comp rx=0 tx=0).stop 2024-09-13T17:09:50.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.622+0000 7f440e171700 1 -- 172.21.15.123:0/1033041695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4408156590 msgr2=0x7f440814d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:50.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.622+0000 7f440e171700 1 --2- 172.21.15.123:0/1033041695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4408156590 0x7f440814d8d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f44080b03b0 tx=0x7f4400004af0 comp rx=0 tx=0).stop 2024-09-13T17:09:50.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.622+0000 7f440e171700 1 -- 172.21.15.123:0/1033041695 shutdown_connections 2024-09-13T17:09:50.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.622+0000 7f440e171700 1 --2- 172.21.15.123:0/1033041695 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f43ec066730 0x7f43ec068bf0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:50.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.622+0000 7f440e171700 1 --2- 172.21.15.123:0/1033041695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4408156590 0x7f440814d8d0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:50.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.622+0000 7f440e171700 1 --2- 172.21.15.123:0/1033041695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44080ced40 0x7f440814d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:50.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.622+0000 7f440e171700 1 --2- 172.21.15.123:0/1033041695 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f440806a260 0x7f440814c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:50.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.622+0000 7f440e171700 1 -- 172.21.15.123:0/1033041695 >> 172.21.15.123:0/1033041695 conn(0x7f4408072730 msgr2=0x7f44080b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:50.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.622+0000 7f440e171700 1 -- 172.21.15.123:0/1033041695 shutdown_connections 2024-09-13T17:09:50.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.622+0000 7f440e171700 1 -- 172.21.15.123:0/1033041695 wait complete. 2024-09-13T17:09:50.630 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:09:50.643 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:09:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.754+0000 7f2ad8a3f700 1 Processor -- start 2024-09-13T17:09:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.754+0000 7f2ad8a3f700 1 -- start start 2024-09-13T17:09:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad8a3f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ad4155010 0x7f2ad4158a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad8a3f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ad415b870 0x7f2ad406dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad8a3f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad406e950 con 0x7f2ad406e500 2024-09-13T17:09:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad8a3f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad415c3f0 con 0x7f2ad415b870 2024-09-13T17:09:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad8a3f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad415c6d0 con 0x7f2ad4155010 2024-09-13T17:09:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad37fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ad4155010 0x7f2ad4158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad2ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ad415b870 0x7f2ad406dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:50.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad3fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2ad406e500 0x7f2ad415d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:59396/0 (socket says 172.21.15.123:59396) 2024-09-13T17:09:50.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad3fff700 1 -- 172.21.15.123:0/2841121802 learned_addr learned my addr 172.21.15.123:0/2841121802 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad2ffd700 1 -- 172.21.15.123:0/2841121802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ad4155010 msgr2=0x7f2ad4158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad2ffd700 1 --2- 172.21.15.123:0/2841121802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ad4155010 0x7f2ad4158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad27fc700 1 -- 172.21.15.123:0/2841121802 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901927187 0 0) 0x7f2acc001490 con 0x7f2ad406e500 2024-09-13T17:09:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad2ffd700 1 -- 172.21.15.123:0/2841121802 >> v1:172.21.15.153:6789/0 conn(0x7f2ad406e500 legacy=0x7f2ad415d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad2ffd700 1 -- 172.21.15.123:0/2841121802 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad415c9b0 con 0x7f2ad415b870 2024-09-13T17:09:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad37fe700 1 --2- 172.21.15.123:0/2841121802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ad4155010 0x7f2ad4158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad2ffd700 1 --2- 172.21.15.123:0/2841121802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad415b870 0x7f2ad406dfc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009850 tx=0x7f2ac4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3bf1afd60109d68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad27fc700 1 -- 172.21.15.123:0/2841121802 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4011830 con 0x7f2ad415b870 2024-09-13T17:09:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad27fc700 1 -- 172.21.15.123:0/2841121802 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac4011990 con 0x7f2ad415b870 2024-09-13T17:09:50.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.758+0000 7f2ad27fc700 1 -- 172.21.15.123:0/2841121802 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4011d40 con 0x7f2ad415b870 2024-09-13T17:09:50.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.762+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2841121802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad415b870 msgr2=0x7f2ad406dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:50.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.762+0000 7f2ad8a3f700 1 --2- 172.21.15.123:0/2841121802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad415b870 0x7f2ad406dfc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009850 tx=0x7f2ac4009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.762+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2841121802 shutdown_connections 2024-09-13T17:09:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.762+0000 7f2ad8a3f700 1 --2- 172.21.15.123:0/2841121802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad415b870 0x7f2ad406dfc0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.762+0000 7f2ad8a3f700 1 --2- 172.21.15.123:0/2841121802 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ad4155010 0x7f2ad4158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.762+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2841121802 >> 172.21.15.123:0/2841121802 conn(0x7f2ad4072730 msgr2=0x7f2ad4066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.762+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2841121802 shutdown_connections 2024-09-13T17:09:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.762+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2841121802 wait complete. 2024-09-13T17:09:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.762+0000 7f2ad8a3f700 1 Processor -- start 2024-09-13T17:09:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.762+0000 7f2ad8a3f700 1 -- start start 2024-09-13T17:09:50.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad8a3f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad406e500 0x7f2ad4156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:50.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad8a3f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ad4155010 0x7f2ad4157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:50.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad8a3f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad415b870 0x7f2ad41f24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:50.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad8a3f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40acd80 con 0x7f2ad415b870 2024-09-13T17:09:50.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad8a3f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad41f2060 con 0x7f2ad406e500 2024-09-13T17:09:50.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad8a3f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4157ad0 con 0x7f2ad4155010 2024-09-13T17:09:50.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad415b870 0x7f2ad41f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:50.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad2ffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ad4155010 0x7f2ad4157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:50.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad415b870 0x7f2ad41f24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51776/0 (socket says 172.21.15.123:51776) 2024-09-13T17:09:50.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad3fff700 1 -- 172.21.15.123:0/2328586866 learned_addr learned my addr 172.21.15.123:0/2328586866 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:50.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad37fe700 1 --2- 172.21.15.123:0/2328586866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad406e500 0x7f2ad4156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:50.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad2ffd700 1 -- 172.21.15.123:0/2328586866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad406e500 msgr2=0x7f2ad4156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:50.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad2ffd700 1 --2- 172.21.15.123:0/2328586866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad406e500 0x7f2ad4156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:50.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad2ffd700 1 -- 172.21.15.123:0/2328586866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad415b870 msgr2=0x7f2ad41f24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:50.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad2ffd700 1 --2- 172.21.15.123:0/2328586866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad415b870 0x7f2ad41f24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:50.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad2ffd700 1 -- 172.21.15.123:0/2328586866 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac80094b0 con 0x7f2ad4155010 2024-09-13T17:09:50.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad3fff700 1 --2- 172.21.15.123:0/2328586866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad415b870 0x7f2ad41f24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad2ffd700 1 --2- 172.21.15.123:0/2328586866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ad4155010 0x7f2ad4157220 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4016000 tx=0x7f2ac4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2abbfff700 1 -- 172.21.15.123:0/2328586866 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4019980 con 0x7f2ad4155010 2024-09-13T17:09:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2abbfff700 1 -- 172.21.15.123:0/2328586866 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac401e070 con 0x7f2ad4155010 2024-09-13T17:09:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2328586866 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac40094b0 con 0x7f2ad4155010 2024-09-13T17:09:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2abbfff700 1 -- 172.21.15.123:0/2328586866 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4019d20 con 0x7f2ad4155010 2024-09-13T17:09:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2328586866 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad4158090 con 0x7f2ad4155010 2024-09-13T17:09:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.766+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2328586866 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad40677f0 con 0x7f2ad4155010 2024-09-13T17:09:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.770+0000 7f2abbfff700 1 -- 172.21.15.123:0/2328586866 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2ac402d430 con 0x7f2ad4155010 2024-09-13T17:09:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.770+0000 7f2abbfff700 1 --2- 172.21.15.123:0/2328586866 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2ac0066760 0x7f2ac0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:50.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.770+0000 7f2ad37fe700 1 --2- 172.21.15.123:0/2328586866 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2ac0066760 0x7f2ac0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:50.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.770+0000 7f2abbfff700 1 -- 172.21.15.123:0/2328586866 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f2ac4084ea0 con 0x7f2ad4155010 2024-09-13T17:09:50.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.770+0000 7f2ad37fe700 1 --2- 172.21.15.123:0/2328586866 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2ac0066760 0x7f2ac0068c20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2ad41548f0 tx=0x7f2ac8009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:50.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.782+0000 7f2abbfff700 1 -- 172.21.15.123:0/2328586866 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2ac4052380 con 0x7f2ad4155010 2024-09-13T17:09:50.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:50.954+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2328586866 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ad415c010 con 0x7f2ad4155010 2024-09-13T17:09:51.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.622+0000 7f2abbfff700 1 -- 172.21.15.123:0/2328586866 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v77) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2ac40559a0 con 0x7f2ad4155010 2024-09-13T17:09:51.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.626+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2328586866 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2ac0066760 msgr2=0x7f2ac0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:51.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.626+0000 7f2ad8a3f700 1 --2- 172.21.15.123:0/2328586866 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2ac0066760 0x7f2ac0068c20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2ad41548f0 tx=0x7f2ac8009240 comp rx=0 tx=0).stop 2024-09-13T17:09:51.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.626+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2328586866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ad4155010 msgr2=0x7f2ad4157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.626+0000 7f2ad8a3f700 1 --2- 172.21.15.123:0/2328586866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ad4155010 0x7f2ad4157220 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4016000 tx=0x7f2ac4004770 comp rx=0 tx=0).stop 2024-09-13T17:09:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.626+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2328586866 shutdown_connections 2024-09-13T17:09:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.626+0000 7f2ad8a3f700 1 --2- 172.21.15.123:0/2328586866 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2ac0066760 0x7f2ac0068c20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.626+0000 7f2ad8a3f700 1 --2- 172.21.15.123:0/2328586866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad415b870 0x7f2ad41f24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.626+0000 7f2ad8a3f700 1 --2- 172.21.15.123:0/2328586866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2ad4155010 0x7f2ad4157220 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.626+0000 7f2ad8a3f700 1 --2- 172.21.15.123:0/2328586866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ad406e500 0x7f2ad4156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.626+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2328586866 >> 172.21.15.123:0/2328586866 conn(0x7f2ad4072730 msgr2=0x7f2ad4159080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.626+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2328586866 shutdown_connections 2024-09-13T17:09:51.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.626+0000 7f2ad8a3f700 1 -- 172.21.15.123:0/2328586866 wait complete. 2024-09-13T17:09:51.635 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-13T17:09:51.647 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T17:09:51.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.754+0000 7f6b9cc1a700 1 Processor -- start 2024-09-13T17:09:51.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.754+0000 7f6b9cc1a700 1 -- start start 2024-09-13T17:09:51.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.754+0000 7f6b9cc1a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b980af4d0 0x7f6b980af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:51.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.754+0000 7f6b9cc1a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6b980ccb20 0x7f6b980ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:51.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.754+0000 7f6b9cc1a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b980cc690 con 0x7f6b981599f0 2024-09-13T17:09:51.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.754+0000 7f6b9cc1a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b980afe30 con 0x7f6b980ccb20 2024-09-13T17:09:51.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.754+0000 7f6b9cc1a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b980c9970 con 0x7f6b980af4d0 2024-09-13T17:09:51.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9659c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6b981599f0 0x7f6b980c8eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41704/0 (socket says 172.21.15.123:41704) 2024-09-13T17:09:51.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9659c700 1 -- 172.21.15.123:0/977839932 learned_addr learned my addr 172.21.15.123:0/977839932 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:51.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b95d9b700 1 --2- 172.21.15.123:0/977839932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b980af4d0 0x7f6b980af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:51.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b96d9d700 1 --2- 172.21.15.123:0/977839932 >> v2:172.21.15.153:3300/0 conn(0x7f6b980ccb20 0x7f6b980ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:51.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9559a700 1 -- 172.21.15.123:0/977839932 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385793041 0 0) 0x7f6b980cc690 con 0x7f6b981599f0 2024-09-13T17:09:51.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9559a700 1 -- 172.21.15.123:0/977839932 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b800035d0 con 0x7f6b981599f0 2024-09-13T17:09:51.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b95d9b700 1 -- 172.21.15.123:0/977839932 >> v2:172.21.15.153:3300/0 conn(0x7f6b980ccb20 msgr2=0x7f6b980ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:51.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b95d9b700 1 --2- 172.21.15.123:0/977839932 >> v2:172.21.15.153:3300/0 conn(0x7f6b980ccb20 0x7f6b980ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:51.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b95d9b700 1 -- 172.21.15.123:0/977839932 >> v1:172.21.15.123:6789/0 conn(0x7f6b981599f0 legacy=0x7f6b980c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:51.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9559a700 1 -- 172.21.15.123:0/977839932 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2568672368 0 0) 0x7f6b800035d0 con 0x7f6b981599f0 2024-09-13T17:09:51.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b95d9b700 1 -- 172.21.15.123:0/977839932 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b980c9c50 con 0x7f6b980af4d0 2024-09-13T17:09:51.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b96d9d700 1 --2- 172.21.15.123:0/977839932 >> v2:172.21.15.153:3300/0 conn(0x7f6b980ccb20 0x7f6b980ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:51.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b95d9b700 1 --2- 172.21.15.123:0/977839932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b980af4d0 0x7f6b980af8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009850 tx=0x7f6b8c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e219e70a9cc62b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:51.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9559a700 1 -- 172.21.15.123:0/977839932 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b88001670 con 0x7f6b980af4d0 2024-09-13T17:09:51.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9559a700 1 -- 172.21.15.123:0/977839932 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c004030 con 0x7f6b980af4d0 2024-09-13T17:09:51.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9559a700 1 -- 172.21.15.123:0/977839932 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0043a0 con 0x7f6b980af4d0 2024-09-13T17:09:51.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/977839932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b980af4d0 msgr2=0x7f6b980af8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:51.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9cc1a700 1 --2- 172.21.15.123:0/977839932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b980af4d0 0x7f6b980af8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009850 tx=0x7f6b8c009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:51.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/977839932 shutdown_connections 2024-09-13T17:09:51.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9cc1a700 1 --2- 172.21.15.123:0/977839932 >> v2:172.21.15.153:3300/0 conn(0x7f6b980ccb20 0x7f6b980ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:51.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9cc1a700 1 --2- 172.21.15.123:0/977839932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b980af4d0 0x7f6b980af8f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:51.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/977839932 >> 172.21.15.123:0/977839932 conn(0x7f6b980b0450 msgr2=0x7f6b980b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:51.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/977839932 shutdown_connections 2024-09-13T17:09:51.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.758+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/977839932 wait complete. 2024-09-13T17:09:51.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b9cc1a700 1 Processor -- start 2024-09-13T17:09:51.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b9cc1a700 1 -- start start 2024-09-13T17:09:51.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b9cc1a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b980af4d0 0x7f6b981510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:51.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b9cc1a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b980ccb20 0x7f6b980ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:51.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b9cc1a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b981599f0 0x7f6b980ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:51.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b9cc1a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b980c6620 con 0x7f6b980ccb20 2024-09-13T17:09:51.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b9cc1a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b980c6900 con 0x7f6b981599f0 2024-09-13T17:09:51.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b9cc1a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b980c6be0 con 0x7f6b980af4d0 2024-09-13T17:09:51.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b95d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b980ccb20 0x7f6b980ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:51.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b95d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b980ccb20 0x7f6b980ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51782/0 (socket says 172.21.15.123:51782) 2024-09-13T17:09:51.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b95d9b700 1 -- 172.21.15.123:0/634699258 learned_addr learned my addr 172.21.15.123:0/634699258 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:51.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b9659c700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b980af4d0 0x7f6b981510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:51.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b96d9d700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b981599f0 0x7f6b980ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:51.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b95d9b700 1 -- 172.21.15.123:0/634699258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b980af4d0 msgr2=0x7f6b981510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:51.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b95d9b700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b980af4d0 0x7f6b981510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:51.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b95d9b700 1 -- 172.21.15.123:0/634699258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b981599f0 msgr2=0x7f6b980ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:51.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b95d9b700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b981599f0 0x7f6b980ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:51.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b95d9b700 1 -- 172.21.15.123:0/634699258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b90009a70 con 0x7f6b980ccb20 2024-09-13T17:09:51.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b96d9d700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b981599f0 0x7f6b980ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:51.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b95d9b700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b980ccb20 0x7f6b980ac8c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0090b0 tx=0x7f6b8c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:51.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b86ffd700 1 -- 172.21.15.123:0/634699258 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c003de0 con 0x7f6b980ccb20 2024-09-13T17:09:51.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b86ffd700 1 -- 172.21.15.123:0/634699258 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c01f070 con 0x7f6b980ccb20 2024-09-13T17:09:51.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/634699258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8c0094b0 con 0x7f6b980ccb20 2024-09-13T17:09:51.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b86ffd700 1 -- 172.21.15.123:0/634699258 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c011870 con 0x7f6b980ccb20 2024-09-13T17:09:51.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.762+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/634699258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b980c71a0 con 0x7f6b980ccb20 2024-09-13T17:09:51.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.766+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/634699258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b98072740 con 0x7f6b980ccb20 2024-09-13T17:09:51.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.766+0000 7f6b86ffd700 1 -- 172.21.15.123:0/634699258 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6b8c0119d0 con 0x7f6b980ccb20 2024-09-13T17:09:51.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.766+0000 7f6b86ffd700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6b78066730 0x7f6b78068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:51.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.766+0000 7f6b86ffd700 1 -- 172.21.15.123:0/634699258 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6b8c021070 con 0x7f6b980ccb20 2024-09-13T17:09:51.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.770+0000 7f6b9659c700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6b78066730 0x7f6b78068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:51.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.770+0000 7f6b9659c700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6b78066730 0x7f6b78068bf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6b980ad410 tx=0x7f6b88001bc0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:51.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.774+0000 7f6b86ffd700 1 -- 172.21.15.123:0/634699258 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6b8c0530b0 con 0x7f6b980ccb20 2024-09-13T17:09:51.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.950+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/634699258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6b980af8f0 con 0x7f6b980ccb20 2024-09-13T17:09:51.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.958+0000 7f6b86ffd700 1 -- 172.21.15.123:0/634699258 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6b8c0566d0 con 0x7f6b980ccb20 2024-09-13T17:09:51.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.962+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/634699258 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6b78066730 msgr2=0x7f6b78068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:51.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.962+0000 7f6b9cc1a700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6b78066730 0x7f6b78068bf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6b980ad410 tx=0x7f6b88001bc0 comp rx=0 tx=0).stop 2024-09-13T17:09:51.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.962+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/634699258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b980ccb20 msgr2=0x7f6b980ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:51.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.962+0000 7f6b9cc1a700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b980ccb20 0x7f6b980ac8c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0090b0 tx=0x7f6b8c004770 comp rx=0 tx=0).stop 2024-09-13T17:09:51.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.962+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/634699258 shutdown_connections 2024-09-13T17:09:51.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.962+0000 7f6b9cc1a700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6b78066730 0x7f6b78068bf0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:51.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.962+0000 7f6b9cc1a700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b981599f0 0x7f6b980ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:51.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.962+0000 7f6b9cc1a700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b980ccb20 0x7f6b980ac8c0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:51.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.962+0000 7f6b9cc1a700 1 --2- 172.21.15.123:0/634699258 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6b980af4d0 0x7f6b981510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:51.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.962+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/634699258 >> 172.21.15.123:0/634699258 conn(0x7f6b980b0450 msgr2=0x7f6b980b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:51.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.962+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/634699258 shutdown_connections 2024-09-13T17:09:51.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:51.962+0000 7f6b9cc1a700 1 -- 172.21.15.123:0/634699258 wait complete. 2024-09-13T17:09:51.982 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_df' 2024-09-13T17:09:52.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.086+0000 7ff28cda1700 1 Processor -- start 2024-09-13T17:09:52.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.086+0000 7ff28cda1700 1 -- start start 2024-09-13T17:09:52.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.086+0000 7ff28cda1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff288071580 0x7ff2880705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:52.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.086+0000 7ff28cda1700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff28815b9b0 0x7ff2880cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:52.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.086+0000 7ff28cda1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2880cee80 con 0x7ff28815a8c0 2024-09-13T17:09:52.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.086+0000 7ff28cda1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28815be60 con 0x7ff288071580 2024-09-13T17:09:52.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.086+0000 7ff28cda1700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2880ce270 con 0x7ff28815b9b0 2024-09-13T17:09:52.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff286ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff288071580 0x7ff2880705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:52.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff286ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff288071580 0x7ff2880705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60612/0 (socket says 172.21.15.123:60612) 2024-09-13T17:09:52.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff286ffd700 1 -- 172.21.15.123:0/2546013107 learned_addr learned my addr 172.21.15.123:0/2546013107 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:52.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff287fff700 1 --2- 172.21.15.123:0/2546013107 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff28815b9b0 0x7ff2880cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:52.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff286ffd700 1 -- 172.21.15.123:0/2546013107 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff28815b9b0 msgr2=0x7ff2880cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:52.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff286ffd700 1 --2- 172.21.15.123:0/2546013107 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff28815b9b0 0x7ff2880cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff286ffd700 1 -- 172.21.15.123:0/2546013107 >> v1:172.21.15.153:6789/0 conn(0x7ff28815a8c0 legacy=0x7ff288070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:52.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff286ffd700 1 -- 172.21.15.123:0/2546013107 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2880ce550 con 0x7ff288071580 2024-09-13T17:09:52.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff287fff700 1 --2- 172.21.15.123:0/2546013107 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff28815b9b0 0x7ff2880cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:52.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff286ffd700 1 --2- 172.21.15.123:0/2546013107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff288071580 0x7ff2880705b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ff270009e50 tx=0x7ff27000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7743c490272e85da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:52.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff2867fc700 1 -- 172.21.15.123:0/2546013107 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27000e070 con 0x7ff288071580 2024-09-13T17:09:52.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff2867fc700 1 -- 172.21.15.123:0/2546013107 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27000b9c0 con 0x7ff288071580 2024-09-13T17:09:52.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff2867fc700 1 -- 172.21.15.123:0/2546013107 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27000bd70 con 0x7ff288071580 2024-09-13T17:09:52.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff28cda1700 1 -- 172.21.15.123:0/2546013107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff288071580 msgr2=0x7ff2880705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:52.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff28cda1700 1 --2- 172.21.15.123:0/2546013107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff288071580 0x7ff2880705b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ff270009e50 tx=0x7ff27000b330 comp rx=0 tx=0).stop 2024-09-13T17:09:52.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff28cda1700 1 -- 172.21.15.123:0/2546013107 shutdown_connections 2024-09-13T17:09:52.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff28cda1700 1 --2- 172.21.15.123:0/2546013107 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff28815b9b0 0x7ff2880cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff28cda1700 1 --2- 172.21.15.123:0/2546013107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff288071580 0x7ff2880705b0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff28cda1700 1 -- 172.21.15.123:0/2546013107 >> 172.21.15.123:0/2546013107 conn(0x7ff288066150 msgr2=0x7ff288066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:52.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff28cda1700 1 -- 172.21.15.123:0/2546013107 shutdown_connections 2024-09-13T17:09:52.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff28cda1700 1 -- 172.21.15.123:0/2546013107 wait complete. 2024-09-13T17:09:52.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.090+0000 7ff28cda1700 1 Processor -- start 2024-09-13T17:09:52.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff28cda1700 1 -- start start 2024-09-13T17:09:52.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff28cda1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff288071580 0x7ff2881546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:52.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff28cda1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff28815a8c0 0x7ff2881f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:52.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff28cda1700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff28815b9b0 0x7ff2881f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:52.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff28cda1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2881f1340 con 0x7ff288071580 2024-09-13T17:09:52.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff28cda1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2880a85a0 con 0x7ff28815a8c0 2024-09-13T17:09:52.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff28cda1700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2881f0820 con 0x7ff28815b9b0 2024-09-13T17:09:52.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff2877fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff288071580 0x7ff2881546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:52.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff2877fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff288071580 0x7ff2881546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60614/0 (socket says 172.21.15.123:60614) 2024-09-13T17:09:52.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff2877fe700 1 -- 172.21.15.123:0/1633583610 learned_addr learned my addr 172.21.15.123:0/1633583610 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:52.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff286ffd700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff28815a8c0 0x7ff2881f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:52.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff287fff700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff28815b9b0 0x7ff2881f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:52.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff2877fe700 1 -- 172.21.15.123:0/1633583610 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff28815b9b0 msgr2=0x7ff2881f02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:52.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff2877fe700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff28815b9b0 0x7ff2881f02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff2877fe700 1 -- 172.21.15.123:0/1633583610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff28815a8c0 msgr2=0x7ff2881f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:52.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff2877fe700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff28815a8c0 0x7ff2881f14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff2877fe700 1 -- 172.21.15.123:0/1633583610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270009b30 con 0x7ff288071580 2024-09-13T17:09:52.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff286ffd700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff28815a8c0 0x7ff2881f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:52.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff2877fe700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff288071580 0x7ff2881546e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff27800c500 tx=0x7ff27800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:52.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff27ffff700 1 -- 172.21.15.123:0/1633583610 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780052d0 con 0x7ff288071580 2024-09-13T17:09:52.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff27ffff700 1 -- 172.21.15.123:0/1633583610 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff278005430 con 0x7ff288071580 2024-09-13T17:09:52.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff28cda1700 1 -- 172.21.15.123:0/1633583610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2881f0aa0 con 0x7ff288071580 2024-09-13T17:09:52.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff27ffff700 1 -- 172.21.15.123:0/1633583610 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780055a0 con 0x7ff288071580 2024-09-13T17:09:52.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff28cda1700 1 -- 172.21.15.123:0/1633583610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2881f1060 con 0x7ff288071580 2024-09-13T17:09:52.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.094+0000 7ff28cda1700 1 -- 172.21.15.123:0/1633583610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2880677f0 con 0x7ff288071580 2024-09-13T17:09:52.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.098+0000 7ff27ffff700 1 -- 172.21.15.123:0/1633583610 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2780038e0 con 0x7ff288071580 2024-09-13T17:09:52.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.098+0000 7ff27ffff700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff268066730 0x7ff268068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:52.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.098+0000 7ff27ffff700 1 -- 172.21.15.123:0/1633583610 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff2780833f0 con 0x7ff288071580 2024-09-13T17:09:52.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.098+0000 7ff286ffd700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff268066730 0x7ff268068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:52.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.098+0000 7ff286ffd700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff268066730 0x7ff268068bf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff27000b370 tx=0x7ff270009000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:52.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.106+0000 7ff27ffff700 1 -- 172.21.15.123:0/1633583610 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff2780509d0 con 0x7ff288071580 2024-09-13T17:09:52.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.334+0000 7ff28cda1700 1 -- 172.21.15.123:0/1633583610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]} v 0) v1 -- 0x7ff28806d7f0 con 0x7ff288071580 2024-09-13T17:09:52.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.634+0000 7ff27ffff700 1 -- 172.21.15.123:0/1633583610 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]}]=0 v190) v1 ==== 134+0+0 (secure 0 0 0) 0x7ff278053ff0 con 0x7ff288071580 2024-09-13T17:09:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.642+0000 7ff28cda1700 1 -- 172.21.15.123:0/1633583610 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff268066730 msgr2=0x7ff268068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.642+0000 7ff28cda1700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff268066730 0x7ff268068bf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff27000b370 tx=0x7ff270009000 comp rx=0 tx=0).stop 2024-09-13T17:09:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.642+0000 7ff28cda1700 1 -- 172.21.15.123:0/1633583610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff288071580 msgr2=0x7ff2881546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.642+0000 7ff28cda1700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff288071580 0x7ff2881546e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff27800c500 tx=0x7ff27800c8c0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.642+0000 7ff28cda1700 1 -- 172.21.15.123:0/1633583610 shutdown_connections 2024-09-13T17:09:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.642+0000 7ff28cda1700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff268066730 0x7ff268068bf0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.642+0000 7ff28cda1700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff28815b9b0 0x7ff2881f02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.642+0000 7ff28cda1700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff28815a8c0 0x7ff2881f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.642+0000 7ff28cda1700 1 --2- 172.21.15.123:0/1633583610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff288071580 0x7ff2881546e0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.642+0000 7ff28cda1700 1 -- 172.21.15.123:0/1633583610 >> 172.21.15.123:0/1633583610 conn(0x7ff288066150 msgr2=0x7ff28806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.642+0000 7ff28cda1700 1 -- 172.21.15.123:0/1633583610 shutdown_connections 2024-09-13T17:09:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.642+0000 7ff28cda1700 1 -- 172.21.15.123:0/1633583610 wait complete. 2024-09-13T17:09:52.663 INFO:tasks.cephfs_test_runner:That when a client modifies the quota on a directory used ... ok 2024-09-13T17:09:52.663 INFO:tasks.cephfs_test_runner:Starting test: test_remote_update_getfattr (tasks.cephfs.test_quota.TestQuota) That quota changes made from one client are visible to another 2024-09-13T17:09:52.663 INFO:tasks.cephfs_test_runner:test_remote_update_getfattr (tasks.cephfs.test_quota.TestQuota) 2024-09-13T17:09:52.664 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:52.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.770+0000 7faf24d81700 1 Processor -- start 2024-09-13T17:09:52.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.770+0000 7faf24d81700 1 -- start start 2024-09-13T17:09:52.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf24d81700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faf20153f00 0x7faf200ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:52.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf24d81700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faf2015e0d0 0x7faf200cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:52.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf24d81700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2015ab30 0x7faf200cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:52.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf24d81700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf200ced30 con 0x7faf20153f00 2024-09-13T17:09:52.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf24d81700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf201542e0 con 0x7faf2015e0d0 2024-09-13T17:09:52.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf24d81700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf20159df0 con 0x7faf2015ab30 2024-09-13T17:09:52.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf1f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faf20153f00 0x7faf200ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:52.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf1ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2015ab30 0x7faf200cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:52.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf1f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faf20153f00 0x7faf200ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60624/0 (socket says 172.21.15.123:60624) 2024-09-13T17:09:52.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf16ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faf2015e0d0 0x7faf200cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:52.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf1f7fe700 1 -- 172.21.15.123:0/3399210120 learned_addr learned my addr 172.21.15.123:0/3399210120 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:52.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf1f7fe700 1 -- 172.21.15.123:0/3399210120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2015ab30 msgr2=0x7faf200cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:52.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf1f7fe700 1 --2- 172.21.15.123:0/3399210120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2015ab30 0x7faf200cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf1f7fe700 1 -- 172.21.15.123:0/3399210120 >> v2:172.21.15.153:3300/0 conn(0x7faf2015e0d0 msgr2=0x7faf200cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:52.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf1f7fe700 1 --2- 172.21.15.123:0/3399210120 >> v2:172.21.15.153:3300/0 conn(0x7faf2015e0d0 0x7faf200cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf1f7fe700 1 -- 172.21.15.123:0/3399210120 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf200cea50 con 0x7faf20153f00 2024-09-13T17:09:52.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf1f7fe700 1 --2- 172.21.15.123:0/3399210120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf20153f00 0x7faf200ce0e0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7faf200cde80 tx=0x7faf10009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8903f08c9f3dc633 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:52.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf1effd700 1 -- 172.21.15.123:0/3399210120 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf10011830 con 0x7faf20153f00 2024-09-13T17:09:52.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf1effd700 1 -- 172.21.15.123:0/3399210120 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf10011990 con 0x7faf20153f00 2024-09-13T17:09:52.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.774+0000 7faf1effd700 1 -- 172.21.15.123:0/3399210120 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf10011d20 con 0x7faf20153f00 2024-09-13T17:09:52.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 -- 172.21.15.123:0/3399210120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf20153f00 msgr2=0x7faf200ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:52.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 --2- 172.21.15.123:0/3399210120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf20153f00 0x7faf200ce0e0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7faf200cde80 tx=0x7faf10009bf0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 -- 172.21.15.123:0/3399210120 shutdown_connections 2024-09-13T17:09:52.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 --2- 172.21.15.123:0/3399210120 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2015ab30 0x7faf200cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 --2- 172.21.15.123:0/3399210120 >> v2:172.21.15.153:3300/0 conn(0x7faf2015e0d0 0x7faf200cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 --2- 172.21.15.123:0/3399210120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf20153f00 0x7faf200ce0e0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 -- 172.21.15.123:0/3399210120 >> 172.21.15.123:0/3399210120 conn(0x7faf20066780 msgr2=0x7faf200719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:52.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 -- 172.21.15.123:0/3399210120 shutdown_connections 2024-09-13T17:09:52.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 -- 172.21.15.123:0/3399210120 wait complete. 2024-09-13T17:09:52.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 Processor -- start 2024-09-13T17:09:52.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 -- start start 2024-09-13T17:09:52.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf20153f00 0x7faf2015c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2015ab30 0x7faf2014beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2015e0d0 0x7faf20144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2014c3f0 con 0x7faf20153f00 2024-09-13T17:09:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2015ce80 con 0x7faf2015e0d0 2024-09-13T17:09:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.778+0000 7faf24d81700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2014e490 con 0x7faf2015ab30 2024-09-13T17:09:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf1f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf20153f00 0x7faf2015c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf1f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf20153f00 0x7faf2015c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60628/0 (socket says 172.21.15.123:60628) 2024-09-13T17:09:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf1ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2015e0d0 0x7faf20144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf1f7fe700 1 -- 172.21.15.123:0/2953142930 learned_addr learned my addr 172.21.15.123:0/2953142930 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:52.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf16ffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2015ab30 0x7faf2014beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:52.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf1f7fe700 1 -- 172.21.15.123:0/2953142930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2015ab30 msgr2=0x7faf2014beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:52.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf1f7fe700 1 --2- 172.21.15.123:0/2953142930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2015ab30 0x7faf2014beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf1f7fe700 1 -- 172.21.15.123:0/2953142930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2015e0d0 msgr2=0x7faf20144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:52.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf1f7fe700 1 --2- 172.21.15.123:0/2953142930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2015e0d0 0x7faf20144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf1f7fe700 1 -- 172.21.15.123:0/2953142930 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf10009570 con 0x7faf20153f00 2024-09-13T17:09:52.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf16ffd700 1 --2- 172.21.15.123:0/2953142930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2015ab30 0x7faf2014beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:52.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf1f7fe700 1 --2- 172.21.15.123:0/2953142930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf20153f00 0x7faf2015c7a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7faf10000c00 tx=0x7faf10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:52.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf1cff9700 1 -- 172.21.15.123:0/2953142930 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf10004450 con 0x7faf20153f00 2024-09-13T17:09:52.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf1cff9700 1 -- 172.21.15.123:0/2953142930 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1001e070 con 0x7faf20153f00 2024-09-13T17:09:52.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf24d81700 1 -- 172.21.15.123:0/2953142930 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2014e770 con 0x7faf20153f00 2024-09-13T17:09:52.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf1cff9700 1 -- 172.21.15.123:0/2953142930 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf100038c0 con 0x7faf20153f00 2024-09-13T17:09:52.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf24d81700 1 -- 172.21.15.123:0/2953142930 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2014ed30 con 0x7faf20153f00 2024-09-13T17:09:52.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.782+0000 7faf24d81700 1 -- 172.21.15.123:0/2953142930 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf20072640 con 0x7faf20153f00 2024-09-13T17:09:52.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.786+0000 7faf1cff9700 1 -- 172.21.15.123:0/2953142930 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf10003a20 con 0x7faf20153f00 2024-09-13T17:09:52.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.786+0000 7faf1cff9700 1 --2- 172.21.15.123:0/2953142930 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faf00066760 0x7faf00068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:52.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.786+0000 7faf1cff9700 1 -- 172.21.15.123:0/2953142930 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faf10020070 con 0x7faf20153f00 2024-09-13T17:09:52.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.786+0000 7faf16ffd700 1 --2- 172.21.15.123:0/2953142930 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faf00066760 0x7faf00068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:52.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.786+0000 7faf16ffd700 1 --2- 172.21.15.123:0/2953142930 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faf00066760 0x7faf00068c20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faf200ccbb0 tx=0x7faf08009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:52.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.794+0000 7faf1cff9700 1 -- 172.21.15.123:0/2953142930 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faf100b6db0 con 0x7faf20153f00 2024-09-13T17:09:52.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.974+0000 7faf24d81700 1 -- 172.21.15.123:0/2953142930 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf2006f5c0 con 0x7faf20153f00 2024-09-13T17:09:52.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.974+0000 7faf1cff9700 1 -- 172.21.15.123:0/2953142930 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+13037 (secure 0 0 0) 0x7faf10015090 con 0x7faf20153f00 2024-09-13T17:09:52.980 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:52.981 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":77,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:09:51.616338+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6833/1222139823":"2024-09-14T17:09:48.595054+0000","172.21.15.153:6832/1222139823":"2024-09-14T17:09:48.595054+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.978+0000 7faf24d81700 1 -- 172.21.15.123:0/2953142930 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faf00066760 msgr2=0x7faf00068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.978+0000 7faf24d81700 1 --2- 172.21.15.123:0/2953142930 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faf00066760 0x7faf00068c20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faf200ccbb0 tx=0x7faf08009240 comp rx=0 tx=0).stop 2024-09-13T17:09:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.978+0000 7faf24d81700 1 -- 172.21.15.123:0/2953142930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf20153f00 msgr2=0x7faf2015c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.978+0000 7faf24d81700 1 --2- 172.21.15.123:0/2953142930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf20153f00 0x7faf2015c7a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7faf10000c00 tx=0x7faf10004770 comp rx=0 tx=0).stop 2024-09-13T17:09:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.978+0000 7faf24d81700 1 -- 172.21.15.123:0/2953142930 shutdown_connections 2024-09-13T17:09:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.978+0000 7faf24d81700 1 --2- 172.21.15.123:0/2953142930 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faf00066760 0x7faf00068c20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.978+0000 7faf24d81700 1 --2- 172.21.15.123:0/2953142930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2015e0d0 0x7faf20144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.978+0000 7faf24d81700 1 --2- 172.21.15.123:0/2953142930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2015ab30 0x7faf2014beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.978+0000 7faf24d81700 1 --2- 172.21.15.123:0/2953142930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf20153f00 0x7faf2015c7a0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.978+0000 7faf24d81700 1 -- 172.21.15.123:0/2953142930 >> 172.21.15.123:0/2953142930 conn(0x7faf20066780 msgr2=0x7faf200b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.978+0000 7faf24d81700 1 -- 172.21.15.123:0/2953142930 shutdown_connections 2024-09-13T17:09:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:52.978+0000 7faf24d81700 1 -- 172.21.15.123:0/2953142930 wait complete. 2024-09-13T17:09:52.999 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:09:52.999 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:09:53.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.118+0000 7f67849c4700 1 Processor -- start 2024-09-13T17:09:53.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.118+0000 7f67849c4700 1 -- start start 2024-09-13T17:09:53.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f67849c4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67800d0f40 0x7f67800d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:53.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f67849c4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800b58b0 0x7f67800d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:53.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f67849c4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67800b0060 con 0x7f67800b1100 2024-09-13T17:09:53.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f67849c4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67800b0340 con 0x7f67800d0f40 2024-09-13T17:09:53.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f67849c4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67800b0620 con 0x7f67800b58b0 2024-09-13T17:09:53.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f677ed9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67800d0f40 0x7f67800d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:53.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f677ed9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67800d0f40 0x7f67800d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60634/0 (socket says 172.21.15.123:60634) 2024-09-13T17:09:53.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f677ed9d700 1 -- 172.21.15.123:0/3665714709 learned_addr learned my addr 172.21.15.123:0/3665714709 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:53.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f6777fff700 1 --2- 172.21.15.123:0/3665714709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800b58b0 0x7f67800d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:53.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f677ed9d700 1 -- 172.21.15.123:0/3665714709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800b58b0 msgr2=0x7f67800d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:53.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f677ed9d700 1 --2- 172.21.15.123:0/3665714709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800b58b0 0x7f67800d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f677ed9d700 1 -- 172.21.15.123:0/3665714709 >> v1:172.21.15.153:6789/0 conn(0x7f67800b1100 legacy=0x7f67800b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:53.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f677ed9d700 1 -- 172.21.15.123:0/3665714709 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800b0900 con 0x7f67800d0f40 2024-09-13T17:09:53.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f6777fff700 1 --2- 172.21.15.123:0/3665714709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800b58b0 0x7f67800d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:53.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f677ed9d700 1 --2- 172.21.15.123:0/3665714709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800d0f40 0x7f67800d1320 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f6770009910 tx=0x7f6770009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98e501a56243738 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:53.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f677e59c700 1 -- 172.21.15.123:0/3665714709 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770011830 con 0x7f67800d0f40 2024-09-13T17:09:53.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f677e59c700 1 -- 172.21.15.123:0/3665714709 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6770011990 con 0x7f67800d0f40 2024-09-13T17:09:53.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f677e59c700 1 -- 172.21.15.123:0/3665714709 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770011d40 con 0x7f67800d0f40 2024-09-13T17:09:53.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f67849c4700 1 -- 172.21.15.123:0/3665714709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800d0f40 msgr2=0x7f67800d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:53.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f67849c4700 1 --2- 172.21.15.123:0/3665714709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800d0f40 0x7f67800d1320 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f6770009910 tx=0x7f6770009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:53.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f67849c4700 1 -- 172.21.15.123:0/3665714709 shutdown_connections 2024-09-13T17:09:53.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f67849c4700 1 --2- 172.21.15.123:0/3665714709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800b58b0 0x7f67800d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f67849c4700 1 --2- 172.21.15.123:0/3665714709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800d0f40 0x7f67800d1320 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f67849c4700 1 -- 172.21.15.123:0/3665714709 >> 172.21.15.123:0/3665714709 conn(0x7f67800d2a60 msgr2=0x7f67800d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:53.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f67849c4700 1 -- 172.21.15.123:0/3665714709 shutdown_connections 2024-09-13T17:09:53.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.122+0000 7f67849c4700 1 -- 172.21.15.123:0/3665714709 wait complete. 2024-09-13T17:09:53.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f67849c4700 1 Processor -- start 2024-09-13T17:09:53.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f67849c4700 1 -- start start 2024-09-13T17:09:53.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f67849c4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67800b1100 0x7f67800cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:53.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f67849c4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800b58b0 0x7f67800c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:53.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f67849c4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800d0f40 0x7f678015b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:53.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f67849c4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800c75d0 con 0x7f67800b58b0 2024-09-13T17:09:53.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f67849c4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800c6950 con 0x7f67800b1100 2024-09-13T17:09:53.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f67849c4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67800c6c30 con 0x7f67800d0f40 2024-09-13T17:09:53.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f6777fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800b58b0 0x7f67800c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:53.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f6777fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800b58b0 0x7f67800c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60642/0 (socket says 172.21.15.123:60642) 2024-09-13T17:09:53.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f6777fff700 1 -- 172.21.15.123:0/3654488038 learned_addr learned my addr 172.21.15.123:0/3654488038 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:53.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f677f59e700 1 --2- 172.21.15.123:0/3654488038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800d0f40 0x7f678015b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:53.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f677ed9d700 1 --2- 172.21.15.123:0/3654488038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67800b1100 0x7f67800cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:53.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f6777fff700 1 -- 172.21.15.123:0/3654488038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800d0f40 msgr2=0x7f678015b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:53.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f6777fff700 1 --2- 172.21.15.123:0/3654488038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800d0f40 0x7f678015b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f6777fff700 1 -- 172.21.15.123:0/3654488038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67800b1100 msgr2=0x7f67800cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:53.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f6777fff700 1 --2- 172.21.15.123:0/3654488038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67800b1100 0x7f67800cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f6777fff700 1 -- 172.21.15.123:0/3654488038 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67680094b0 con 0x7f67800b58b0 2024-09-13T17:09:53.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f6777fff700 1 --2- 172.21.15.123:0/3654488038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800b58b0 0x7f67800c8c00 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f676800ebe0 tx=0x7f676800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:53.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.126+0000 7f67777fe700 1 -- 172.21.15.123:0/3654488038 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67680097b0 con 0x7f67800b58b0 2024-09-13T17:09:53.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.130+0000 7f67777fe700 1 -- 172.21.15.123:0/3654488038 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676800c850 con 0x7f67800b58b0 2024-09-13T17:09:53.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.130+0000 7f67849c4700 1 -- 172.21.15.123:0/3654488038 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6770009570 con 0x7f67800b58b0 2024-09-13T17:09:53.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.130+0000 7f67777fe700 1 -- 172.21.15.123:0/3654488038 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800cc00 con 0x7f67800b58b0 2024-09-13T17:09:53.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.130+0000 7f67849c4700 1 -- 172.21.15.123:0/3654488038 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67800c71f0 con 0x7f67800b58b0 2024-09-13T17:09:53.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.130+0000 7f67849c4700 1 -- 172.21.15.123:0/3654488038 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678015ce70 con 0x7f67800b58b0 2024-09-13T17:09:53.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.130+0000 7f67777fe700 1 -- 172.21.15.123:0/3654488038 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6768013470 con 0x7f67800b58b0 2024-09-13T17:09:53.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.130+0000 7f67777fe700 1 --2- 172.21.15.123:0/3654488038 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6760066730 0x7f6760068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:53.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.130+0000 7f67777fe700 1 -- 172.21.15.123:0/3654488038 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6768083bf0 con 0x7f67800b58b0 2024-09-13T17:09:53.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.134+0000 7f677ed9d700 1 --2- 172.21.15.123:0/3654488038 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6760066730 0x7f6760068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:53.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.134+0000 7f677ed9d700 1 --2- 172.21.15.123:0/3654488038 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6760066730 0x7f6760068bf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6770000c00 tx=0x7f6770008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:53.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.138+0000 7f67777fe700 1 -- 172.21.15.123:0/3654488038 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6768051250 con 0x7f67800b58b0 2024-09-13T17:09:53.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.306+0000 7f67849c4700 1 -- 172.21.15.123:0/3654488038 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f678008c250 con 0x7f67800b58b0 2024-09-13T17:09:53.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.306+0000 7f67777fe700 1 -- 172.21.15.123:0/3654488038 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6768054870 con 0x7f67800b58b0 2024-09-13T17:09:53.313 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:09:53.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.310+0000 7f67849c4700 1 -- 172.21.15.123:0/3654488038 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6760066730 msgr2=0x7f6760068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:53.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.310+0000 7f67849c4700 1 --2- 172.21.15.123:0/3654488038 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6760066730 0x7f6760068bf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6770000c00 tx=0x7f6770008030 comp rx=0 tx=0).stop 2024-09-13T17:09:53.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.310+0000 7f67849c4700 1 -- 172.21.15.123:0/3654488038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800b58b0 msgr2=0x7f67800c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:53.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.310+0000 7f67849c4700 1 --2- 172.21.15.123:0/3654488038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800b58b0 0x7f67800c8c00 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f676800ebe0 tx=0x7f676800eef0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.310+0000 7f67849c4700 1 -- 172.21.15.123:0/3654488038 shutdown_connections 2024-09-13T17:09:53.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.310+0000 7f67849c4700 1 --2- 172.21.15.123:0/3654488038 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6760066730 0x7f6760068bf0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.310+0000 7f67849c4700 1 --2- 172.21.15.123:0/3654488038 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67800d0f40 0x7f678015b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.310+0000 7f67849c4700 1 --2- 172.21.15.123:0/3654488038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67800b58b0 0x7f67800c8c00 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.310+0000 7f67849c4700 1 --2- 172.21.15.123:0/3654488038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67800b1100 0x7f67800cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.310+0000 7f67849c4700 1 -- 172.21.15.123:0/3654488038 >> 172.21.15.123:0/3654488038 conn(0x7f67800d2a60 msgr2=0x7f67800af650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:53.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.310+0000 7f67849c4700 1 -- 172.21.15.123:0/3654488038 shutdown_connections 2024-09-13T17:09:53.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.310+0000 7f67849c4700 1 -- 172.21.15.123:0/3654488038 wait complete. 2024-09-13T17:09:53.328 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr' 2024-09-13T17:09:53.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.434+0000 7f6e1b4f0700 1 Processor -- start 2024-09-13T17:09:53.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.434+0000 7f6e1b4f0700 1 -- start start 2024-09-13T17:09:53.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6e140d3670 0x7f6e141614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:53.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e140ce850 0x7f6e140c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:53.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e140d1130 con 0x7f6e140cf600 2024-09-13T17:09:53.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e140c9aa0 con 0x7f6e140d3670 2024-09-13T17:09:53.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140d1c20 con 0x7f6e140ce850 2024-09-13T17:09:53.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e19ced700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6e140d3670 0x7f6e141614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:53.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1a4ee700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6e140cf600 0x7f6e14160d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39994/0 (socket says 172.21.15.123:39994) 2024-09-13T17:09:53.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1a4ee700 1 -- 172.21.15.123:0/579352152 learned_addr learned my addr 172.21.15.123:0/579352152 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1acef700 1 --2- 172.21.15.123:0/579352152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e140ce850 0x7f6e140c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e19ced700 1 -- 172.21.15.123:0/579352152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e140ce850 msgr2=0x7f6e140c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e19ced700 1 --2- 172.21.15.123:0/579352152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e140ce850 0x7f6e140c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e19ced700 1 -- 172.21.15.123:0/579352152 >> v1:172.21.15.123:6789/0 conn(0x7f6e140cf600 legacy=0x7f6e14160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e19ced700 1 -- 172.21.15.123:0/579352152 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e140d1380 con 0x7f6e140d3670 2024-09-13T17:09:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e19ced700 1 --2- 172.21.15.123:0/579352152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e140d3670 0x7f6e141614a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009850 tx=0x7f6e04009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6ba96e2ed398c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e194ec700 1 -- 172.21.15.123:0/579352152 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04004230 con 0x7f6e140d3670 2024-09-13T17:09:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e194ec700 1 -- 172.21.15.123:0/579352152 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e04004390 con 0x7f6e140d3670 2024-09-13T17:09:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e194ec700 1 -- 172.21.15.123:0/579352152 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e040036c0 con 0x7f6e140d3670 2024-09-13T17:09:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/579352152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e140d3670 msgr2=0x7f6e141614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 --2- 172.21.15.123:0/579352152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e140d3670 0x7f6e141614a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009850 tx=0x7f6e04009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/579352152 shutdown_connections 2024-09-13T17:09:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 --2- 172.21.15.123:0/579352152 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e140ce850 0x7f6e140c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 --2- 172.21.15.123:0/579352152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e140d3670 0x7f6e141614a0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/579352152 >> 172.21.15.123:0/579352152 conn(0x7f6e140d2b50 msgr2=0x7f6e140d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:53.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/579352152 shutdown_connections 2024-09-13T17:09:53.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/579352152 wait complete. 2024-09-13T17:09:53.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 Processor -- start 2024-09-13T17:09:53.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.438+0000 7f6e1b4f0700 1 -- start start 2024-09-13T17:09:53.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1b4f0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e140ce850 0x7f6e14152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:53.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1b4f0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e140cf600 0x7f6e140cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:53.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1b4f0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e140b2480 0x7f6e140cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:53.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1b4f0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140b3570 con 0x7f6e140ce850 2024-09-13T17:09:53.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1b4f0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140b2960 con 0x7f6e140b2480 2024-09-13T17:09:53.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1b4f0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140b2c40 con 0x7f6e140cf600 2024-09-13T17:09:53.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1a4ee700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e140ce850 0x7f6e14152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:53.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1a4ee700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e140ce850 0x7f6e14152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60654/0 (socket says 172.21.15.123:60654) 2024-09-13T17:09:53.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1a4ee700 1 -- 172.21.15.123:0/2549296338 learned_addr learned my addr 172.21.15.123:0/2549296338 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:53.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e19ced700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e140cf600 0x7f6e140cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:53.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1acef700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e140b2480 0x7f6e140cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:53.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1a4ee700 1 -- 172.21.15.123:0/2549296338 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e140cf600 msgr2=0x7f6e140cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:53.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1a4ee700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e140cf600 0x7f6e140cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1a4ee700 1 -- 172.21.15.123:0/2549296338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e140b2480 msgr2=0x7f6e140cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:53.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1a4ee700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e140b2480 0x7f6e140cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:53.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1a4ee700 1 -- 172.21.15.123:0/2549296338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e040094b0 con 0x7f6e140ce850 2024-09-13T17:09:53.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e19ced700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e140cf600 0x7f6e140cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:53.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1acef700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e140b2480 0x7f6e140cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:53.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1a4ee700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e140ce850 0x7f6e14152ec0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c780 tx=0x7f6e1000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:53.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e0affd700 1 -- 172.21.15.123:0/2549296338 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10004ca0 con 0x7f6e140ce850 2024-09-13T17:09:53.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e0affd700 1 -- 172.21.15.123:0/2549296338 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e10004e00 con 0x7f6e140ce850 2024-09-13T17:09:53.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/2549296338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e140b2f20 con 0x7f6e140ce850 2024-09-13T17:09:53.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e0affd700 1 -- 172.21.15.123:0/2549296338 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e100072f0 con 0x7f6e140ce850 2024-09-13T17:09:53.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/2549296338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e14153400 con 0x7f6e140ce850 2024-09-13T17:09:53.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.442+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/2549296338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e140c8fd0 con 0x7f6e140ce850 2024-09-13T17:09:53.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.446+0000 7f6e0affd700 1 -- 172.21.15.123:0/2549296338 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e10007450 con 0x7f6e140ce850 2024-09-13T17:09:53.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.446+0000 7f6e0affd700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6df8066730 0x7f6df8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:53.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.446+0000 7f6e0affd700 1 -- 172.21.15.123:0/2549296338 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6e10082fb0 con 0x7f6e140ce850 2024-09-13T17:09:53.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.446+0000 7f6e19ced700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6df8066730 0x7f6df8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:53.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.446+0000 7f6e19ced700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6df8066730 0x7f6df8068bf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009850 tx=0x7f6e04013040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.454+0000 7f6e0affd700 1 -- 172.21.15.123:0/2549296338 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6e100b4db0 con 0x7f6e140ce850 2024-09-13T17:09:53.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:53.682+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/2549296338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]} v 0) v1 -- 0x7f6e140cf9e0 con 0x7f6e140ce850 2024-09-13T17:09:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.646+0000 7f6e0affd700 1 -- 172.21.15.123:0/2549296338 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]}]=0 v192) v1 ==== 143+0+0 (secure 0 0 0) 0x7f6e10018020 con 0x7f6e140ce850 2024-09-13T17:09:54.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.650+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/2549296338 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6df8066730 msgr2=0x7f6df8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:54.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.650+0000 7f6e1b4f0700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6df8066730 0x7f6df8068bf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009850 tx=0x7f6e04013040 comp rx=0 tx=0).stop 2024-09-13T17:09:54.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.650+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/2549296338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e140ce850 msgr2=0x7f6e14152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:54.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.650+0000 7f6e1b4f0700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e140ce850 0x7f6e14152ec0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c780 tx=0x7f6e1000cb40 comp rx=0 tx=0).stop 2024-09-13T17:09:54.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.650+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/2549296338 shutdown_connections 2024-09-13T17:09:54.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.650+0000 7f6e1b4f0700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6df8066730 0x7f6df8068bf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:54.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.650+0000 7f6e1b4f0700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e140b2480 0x7f6e140cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:54.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.650+0000 7f6e1b4f0700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e140cf600 0x7f6e140cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:54.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.650+0000 7f6e1b4f0700 1 --2- 172.21.15.123:0/2549296338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e140ce850 0x7f6e14152ec0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:54.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.650+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/2549296338 >> 172.21.15.123:0/2549296338 conn(0x7f6e140d2b50 msgr2=0x7f6e1415c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:54.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.650+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/2549296338 shutdown_connections 2024-09-13T17:09:54.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.650+0000 7f6e1b4f0700 1 -- 172.21.15.123:0/2549296338 wait complete. 2024-09-13T17:09:54.676 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T17:09:54.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.798+0000 7fe05b59e700 1 Processor -- start 2024-09-13T17:09:54.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.798+0000 7fe05b59e700 1 -- start start 2024-09-13T17:09:54.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe05b59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe05c1506b0 0x7fe05c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:54.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe05b59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe05c0b37a0 0x7fe05c0b4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:54.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe05b59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05c0b3310 con 0x7fe05c15d4c0 2024-09-13T17:09:54.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe05b59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05c15e080 con 0x7fe05c0b37a0 2024-09-13T17:09:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe05b59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c15e280 con 0x7fe05c1506b0 2024-09-13T17:09:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe051d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe05c0b37a0 0x7fe05c0b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe05ad9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe05c15d4c0 0x7fe05c15d970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40008/0 (socket says 172.21.15.123:40008) 2024-09-13T17:09:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe05ad9d700 1 -- 172.21.15.123:0/2112161741 learned_addr learned my addr 172.21.15.123:0/2112161741 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe05a59c700 1 --2- 172.21.15.123:0/2112161741 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe05c1506b0 0x7fe05c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:54.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe051d9b700 1 -- 172.21.15.123:0/2112161741 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe05c1506b0 msgr2=0x7fe05c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe051d9b700 1 --2- 172.21.15.123:0/2112161741 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe05c1506b0 0x7fe05c0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe051d9b700 1 -- 172.21.15.123:0/2112161741 >> v1:172.21.15.123:6789/0 conn(0x7fe05c15d4c0 legacy=0x7fe05c15d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe059d9b700 1 -- 172.21.15.123:0/2112161741 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884666731 0 0) 0x7fe05c0b3310 con 0x7fe05c15d4c0 2024-09-13T17:09:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe051d9b700 1 -- 172.21.15.123:0/2112161741 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c0b29e0 con 0x7fe05c0b37a0 2024-09-13T17:09:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe05a59c700 1 --2- 172.21.15.123:0/2112161741 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe05c1506b0 0x7fe05c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe051d9b700 1 --2- 172.21.15.123:0/2112161741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe05c0b37a0 0x7fe05c0b4990 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fe044009850 tx=0x7fe044009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145ae755e6a83764 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe059d9b700 1 -- 172.21.15.123:0/2112161741 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044011830 con 0x7fe05c0b37a0 2024-09-13T17:09:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe059d9b700 1 -- 172.21.15.123:0/2112161741 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe044011990 con 0x7fe05c0b37a0 2024-09-13T17:09:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe059d9b700 1 -- 172.21.15.123:0/2112161741 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044011d20 con 0x7fe05c0b37a0 2024-09-13T17:09:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe05b59e700 1 -- 172.21.15.123:0/2112161741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe05c0b37a0 msgr2=0x7fe05c0b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.802+0000 7fe05b59e700 1 --2- 172.21.15.123:0/2112161741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe05c0b37a0 0x7fe05c0b4990 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fe044009850 tx=0x7fe044009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.806+0000 7fe05b59e700 1 -- 172.21.15.123:0/2112161741 shutdown_connections 2024-09-13T17:09:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.806+0000 7fe05b59e700 1 --2- 172.21.15.123:0/2112161741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe05c0b37a0 0x7fe05c0b4990 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:54.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.806+0000 7fe05b59e700 1 --2- 172.21.15.123:0/2112161741 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe05c1506b0 0x7fe05c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:54.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.806+0000 7fe05b59e700 1 -- 172.21.15.123:0/2112161741 >> 172.21.15.123:0/2112161741 conn(0x7fe05c066780 msgr2=0x7fe05c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:54.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.806+0000 7fe05b59e700 1 -- 172.21.15.123:0/2112161741 shutdown_connections 2024-09-13T17:09:54.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.806+0000 7fe05b59e700 1 -- 172.21.15.123:0/2112161741 wait complete. 2024-09-13T17:09:54.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.806+0000 7fe05b59e700 1 Processor -- start 2024-09-13T17:09:54.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.806+0000 7fe05b59e700 1 -- start start 2024-09-13T17:09:54.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe05c0b37a0 0x7fe05c1efc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:54.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05b59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe05c1506b0 0x7fe05c14b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:54.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe05c15d4c0 0x7fe05c14f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:54.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05b59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c156420 con 0x7fe05c15d4c0 2024-09-13T17:09:54.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c14fe90 con 0x7fe05c0b37a0 2024-09-13T17:09:54.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05b59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c155a80 con 0x7fe05c1506b0 2024-09-13T17:09:54.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe05c15d4c0 0x7fe05c14f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:54.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe051d9b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe05c1506b0 0x7fe05c14b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:54.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe05c15d4c0 0x7fe05c14f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60672/0 (socket says 172.21.15.123:60672) 2024-09-13T17:09:54.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05ad9d700 1 -- 172.21.15.123:0/1078568277 learned_addr learned my addr 172.21.15.123:0/1078568277 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:54.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05a59c700 1 --2- 172.21.15.123:0/1078568277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe05c0b37a0 0x7fe05c1efc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:54.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05ad9d700 1 -- 172.21.15.123:0/1078568277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe05c1506b0 msgr2=0x7fe05c14b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:54.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05ad9d700 1 --2- 172.21.15.123:0/1078568277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe05c1506b0 0x7fe05c14b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:54.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05ad9d700 1 -- 172.21.15.123:0/1078568277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe05c0b37a0 msgr2=0x7fe05c1efc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:54.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05ad9d700 1 --2- 172.21.15.123:0/1078568277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe05c0b37a0 0x7fe05c1efc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:54.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05ad9d700 1 -- 172.21.15.123:0/1078568277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0440094b0 con 0x7fe05c15d4c0 2024-09-13T17:09:54.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05ad9d700 1 --2- 172.21.15.123:0/1078568277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe05c15d4c0 0x7fe05c14f540 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fe05400cbc0 tx=0x7fe05400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:54.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe0537fe700 1 -- 172.21.15.123:0/1078568277 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05400aa00 con 0x7fe05c15d4c0 2024-09-13T17:09:54.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe0537fe700 1 -- 172.21.15.123:0/1078568277 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05400ab80 con 0x7fe05c15d4c0 2024-09-13T17:09:54.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05b59e700 1 -- 172.21.15.123:0/1078568277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05c155d60 con 0x7fe05c15d4c0 2024-09-13T17:09:54.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe0537fe700 1 -- 172.21.15.123:0/1078568277 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0540070d0 con 0x7fe05c15d4c0 2024-09-13T17:09:54.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.810+0000 7fe05b59e700 1 -- 172.21.15.123:0/1078568277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c14fa80 con 0x7fe05c15d4c0 2024-09-13T17:09:54.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.814+0000 7fe05b59e700 1 -- 172.21.15.123:0/1078568277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe040005310 con 0x7fe05c15d4c0 2024-09-13T17:09:54.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.814+0000 7fe0537fe700 1 -- 172.21.15.123:0/1078568277 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe054007230 con 0x7fe05c15d4c0 2024-09-13T17:09:54.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.814+0000 7fe0537fe700 1 --2- 172.21.15.123:0/1078568277 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe03c066730 0x7fe03c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:54.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.814+0000 7fe05a59c700 1 --2- 172.21.15.123:0/1078568277 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe03c066730 0x7fe03c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:54.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.814+0000 7fe0537fe700 1 -- 172.21.15.123:0/1078568277 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe0540839f0 con 0x7fe05c15d4c0 2024-09-13T17:09:54.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.814+0000 7fe05a59c700 1 --2- 172.21.15.123:0/1078568277 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe03c066730 0x7fe03c068bf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00c960 tx=0x7fe04c008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:54.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.818+0000 7fe0537fe700 1 -- 172.21.15.123:0/1078568277 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe0540510f0 con 0x7fe05c15d4c0 2024-09-13T17:09:54.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:54.994+0000 7fe05b59e700 1 -- 172.21.15.123:0/1078568277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe040005890 con 0x7fe05c15d4c0 2024-09-13T17:09:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.002+0000 7fe0537fe700 1 -- 172.21.15.123:0/1078568277 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe054018020 con 0x7fe05c15d4c0 2024-09-13T17:09:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.002+0000 7fe05b59e700 1 -- 172.21.15.123:0/1078568277 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe03c066730 msgr2=0x7fe03c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.002+0000 7fe05b59e700 1 --2- 172.21.15.123:0/1078568277 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe03c066730 0x7fe03c068bf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00c960 tx=0x7fe04c008040 comp rx=0 tx=0).stop 2024-09-13T17:09:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.002+0000 7fe05b59e700 1 -- 172.21.15.123:0/1078568277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe05c15d4c0 msgr2=0x7fe05c14f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.002+0000 7fe05b59e700 1 --2- 172.21.15.123:0/1078568277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe05c15d4c0 0x7fe05c14f540 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fe05400cbc0 tx=0x7fe05400ced0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.002+0000 7fe05b59e700 1 -- 172.21.15.123:0/1078568277 shutdown_connections 2024-09-13T17:09:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.002+0000 7fe05b59e700 1 --2- 172.21.15.123:0/1078568277 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe03c066730 0x7fe03c068bf0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.002+0000 7fe05b59e700 1 --2- 172.21.15.123:0/1078568277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe05c15d4c0 0x7fe05c14f540 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.002+0000 7fe05b59e700 1 --2- 172.21.15.123:0/1078568277 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe05c1506b0 0x7fe05c14b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.002+0000 7fe05b59e700 1 --2- 172.21.15.123:0/1078568277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe05c0b37a0 0x7fe05c1efc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.002+0000 7fe05b59e700 1 -- 172.21.15.123:0/1078568277 >> 172.21.15.123:0/1078568277 conn(0x7fe05c066780 msgr2=0x7fe05c0b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:55.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.002+0000 7fe05b59e700 1 -- 172.21.15.123:0/1078568277 shutdown_connections 2024-09-13T17:09:55.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.002+0000 7fe05b59e700 1 -- 172.21.15.123:0/1078568277 wait complete. 2024-09-13T17:09:55.022 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:09:55.022 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:09:55.040 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:09:55.061 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:09:55.062 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:09:55.062 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:55.069 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:09:55.069 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:09:55.069 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:55.115 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:09:55.115 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:09:55.115 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:55.122 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:09:55.122 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:09:55.122 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:09:55.128 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:09:55.128 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T17:09:55.129 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:09:55.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed699bd700 1 Processor -- start 2024-09-13T17:09:55.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed699bd700 1 -- start start 2024-09-13T17:09:55.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed699bd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed641598b0 0x7fed64071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:55.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed699bd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640cedc0 0x7fed64159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:55.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed699bd700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6415d360 con 0x7fed640cdfd0 2024-09-13T17:09:55.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed699bd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed640ce400 con 0x7fed641598b0 2024-09-13T17:09:55.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed699bd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed640724c0 con 0x7fed640cedc0 2024-09-13T17:09:55.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed63fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fed640cdfd0 0x7fed640ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40012/0 (socket says 172.21.15.123:40012) 2024-09-13T17:09:55.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed63fff700 1 -- 172.21.15.123:0/4174169027 learned_addr learned my addr 172.21.15.123:0/4174169027 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:55.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed689bb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed641598b0 0x7fed64071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:55.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed691bc700 1 --2- 172.21.15.123:0/4174169027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640cedc0 0x7fed64159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:55.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed637fe700 1 -- 172.21.15.123:0/4174169027 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682565830 0 0) 0x7fed6415d360 con 0x7fed640cdfd0 2024-09-13T17:09:55.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed637fe700 1 -- 172.21.15.123:0/4174169027 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed4c0057e0 con 0x7fed640cdfd0 2024-09-13T17:09:55.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed689bb700 1 -- 172.21.15.123:0/4174169027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640cedc0 msgr2=0x7fed64159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:55.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed689bb700 1 --2- 172.21.15.123:0/4174169027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640cedc0 0x7fed64159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed689bb700 1 -- 172.21.15.123:0/4174169027 >> v1:172.21.15.123:6789/0 conn(0x7fed640cdfd0 legacy=0x7fed640ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:55.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.278+0000 7fed689bb700 1 -- 172.21.15.123:0/4174169027 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6415d5b0 con 0x7fed641598b0 2024-09-13T17:09:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.282+0000 7fed689bb700 1 --2- 172.21.15.123:0/4174169027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed641598b0 0x7fed64071e60 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fed58009850 tx=0x7fed58009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bab063c83a2279d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.282+0000 7fed637fe700 1 -- 172.21.15.123:0/4174169027 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58011830 con 0x7fed641598b0 2024-09-13T17:09:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.282+0000 7fed637fe700 1 -- 172.21.15.123:0/4174169027 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed58011990 con 0x7fed641598b0 2024-09-13T17:09:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.282+0000 7fed637fe700 1 -- 172.21.15.123:0/4174169027 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58011d40 con 0x7fed641598b0 2024-09-13T17:09:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.282+0000 7fed699bd700 1 -- 172.21.15.123:0/4174169027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed641598b0 msgr2=0x7fed64071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.282+0000 7fed699bd700 1 --2- 172.21.15.123:0/4174169027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed641598b0 0x7fed64071e60 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fed58009850 tx=0x7fed58009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.282+0000 7fed699bd700 1 -- 172.21.15.123:0/4174169027 shutdown_connections 2024-09-13T17:09:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.282+0000 7fed699bd700 1 --2- 172.21.15.123:0/4174169027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640cedc0 0x7fed64159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.282+0000 7fed699bd700 1 --2- 172.21.15.123:0/4174169027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed641598b0 0x7fed64071e60 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.282+0000 7fed699bd700 1 -- 172.21.15.123:0/4174169027 >> 172.21.15.123:0/4174169027 conn(0x7fed64066150 msgr2=0x7fed64066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.282+0000 7fed699bd700 1 -- 172.21.15.123:0/4174169027 shutdown_connections 2024-09-13T17:09:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.282+0000 7fed699bd700 1 -- 172.21.15.123:0/4174169027 wait complete. 2024-09-13T17:09:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed699bd700 1 Processor -- start 2024-09-13T17:09:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed699bd700 1 -- start start 2024-09-13T17:09:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed699bd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640cdfd0 0x7fed64145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed699bd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed640cedc0 0x7fed640b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed699bd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed641598b0 0x7fed640b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed699bd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed640b0e90 con 0x7fed641598b0 2024-09-13T17:09:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed699bd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed64151ed0 con 0x7fed640cedc0 2024-09-13T17:09:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed699bd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed641521b0 con 0x7fed640cdfd0 2024-09-13T17:09:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed691bc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed641598b0 0x7fed640b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed691bc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed641598b0 0x7fed640b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60704/0 (socket says 172.21.15.123:60704) 2024-09-13T17:09:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed691bc700 1 -- 172.21.15.123:0/1879399191 learned_addr learned my addr 172.21.15.123:0/1879399191 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed63fff700 1 --2- 172.21.15.123:0/1879399191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed640cedc0 0x7fed640b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed689bb700 1 --2- 172.21.15.123:0/1879399191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640cdfd0 0x7fed64145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed691bc700 1 -- 172.21.15.123:0/1879399191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640cdfd0 msgr2=0x7fed64145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed691bc700 1 --2- 172.21.15.123:0/1879399191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640cdfd0 0x7fed64145d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed691bc700 1 -- 172.21.15.123:0/1879399191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed640cedc0 msgr2=0x7fed640b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed691bc700 1 --2- 172.21.15.123:0/1879399191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed640cedc0 0x7fed640b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed691bc700 1 -- 172.21.15.123:0/1879399191 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed580094b0 con 0x7fed641598b0 2024-09-13T17:09:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed691bc700 1 --2- 172.21.15.123:0/1879399191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed641598b0 0x7fed640b0950 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00baf0 tx=0x7fed5c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed617fa700 1 -- 172.21.15.123:0/1879399191 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c011a60 con 0x7fed641598b0 2024-09-13T17:09:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed617fa700 1 -- 172.21.15.123:0/1879399191 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c013040 con 0x7fed641598b0 2024-09-13T17:09:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed699bd700 1 -- 172.21.15.123:0/1879399191 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed64152490 con 0x7fed641598b0 2024-09-13T17:09:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed617fa700 1 -- 172.21.15.123:0/1879399191 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c011e00 con 0x7fed641598b0 2024-09-13T17:09:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.286+0000 7fed699bd700 1 -- 172.21.15.123:0/1879399191 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed64152a50 con 0x7fed641598b0 2024-09-13T17:09:55.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.290+0000 7fed699bd700 1 -- 172.21.15.123:0/1879399191 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed640677f0 con 0x7fed641598b0 2024-09-13T17:09:55.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.290+0000 7fed617fa700 1 -- 172.21.15.123:0/1879399191 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fed5c019400 con 0x7fed641598b0 2024-09-13T17:09:55.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.290+0000 7fed617fa700 1 --2- 172.21.15.123:0/1879399191 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed50066730 0x7fed50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:55.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.290+0000 7fed617fa700 1 -- 172.21.15.123:0/1879399191 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fed5c087b00 con 0x7fed641598b0 2024-09-13T17:09:55.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.290+0000 7fed689bb700 1 --2- 172.21.15.123:0/1879399191 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed50066730 0x7fed50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:55.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.294+0000 7fed689bb700 1 --2- 172.21.15.123:0/1879399191 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed50066730 0x7fed50068bf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fed580090b0 tx=0x7fed58008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:55.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.298+0000 7fed617fa700 1 -- 172.21.15.123:0/1879399191 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fed5c055200 con 0x7fed641598b0 2024-09-13T17:09:55.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.506+0000 7fed699bd700 1 -- 172.21.15.123:0/1879399191 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed64152c70 con 0x7fed641598b0 2024-09-13T17:09:55.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.506+0000 7fed617fa700 1 -- 172.21.15.123:0/1879399191 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+3541 (secure 0 0 0) 0x7fed5c058820 con 0x7fed641598b0 2024-09-13T17:09:55.511 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:55.511 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3155329877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3155329877},{"type":"v1","addr":"172.21.15.153:6835","nonce":3155329877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6522,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3484528665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3484528665},{"type":"v1","addr":"172.21.15.123:6835","nonce":3484528665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6525,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/4217126083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":4217126083},{"type":"v1","addr":"172.21.15.123:6837","nonce":4217126083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":6724,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/4068307646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4068307646},{"type":"v1","addr":"172.21.15.153:6833","nonce":4068307646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[]} 2024-09-13T17:09:55.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.506+0000 7fed699bd700 1 -- 172.21.15.123:0/1879399191 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed50066730 msgr2=0x7fed50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:55.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.506+0000 7fed699bd700 1 --2- 172.21.15.123:0/1879399191 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed50066730 0x7fed50068bf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fed580090b0 tx=0x7fed58008030 comp rx=0 tx=0).stop 2024-09-13T17:09:55.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.506+0000 7fed699bd700 1 -- 172.21.15.123:0/1879399191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed641598b0 msgr2=0x7fed640b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:55.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.506+0000 7fed699bd700 1 --2- 172.21.15.123:0/1879399191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed641598b0 0x7fed640b0950 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00baf0 tx=0x7fed5c00beb0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.506+0000 7fed699bd700 1 -- 172.21.15.123:0/1879399191 shutdown_connections 2024-09-13T17:09:55.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.506+0000 7fed699bd700 1 --2- 172.21.15.123:0/1879399191 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fed50066730 0x7fed50068bf0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.506+0000 7fed699bd700 1 --2- 172.21.15.123:0/1879399191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed641598b0 0x7fed640b0950 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.506+0000 7fed699bd700 1 --2- 172.21.15.123:0/1879399191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed640cedc0 0x7fed640b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.506+0000 7fed699bd700 1 --2- 172.21.15.123:0/1879399191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fed640cdfd0 0x7fed64145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.506+0000 7fed699bd700 1 -- 172.21.15.123:0/1879399191 >> 172.21.15.123:0/1879399191 conn(0x7fed64066150 msgr2=0x7fed64159c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:55.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.506+0000 7fed699bd700 1 -- 172.21.15.123:0/1879399191 shutdown_connections 2024-09-13T17:09:55.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.506+0000 7fed699bd700 1 -- 172.21.15.123:0/1879399191 wait complete. 2024-09-13T17:09:55.515 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 37 2024-09-13T17:09:55.526 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:09:55.526 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:09:55.526 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:09:55.526 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:09:55.526 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:09:55.527 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:09:55.527 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:09:55.527 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:09:55.527 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:09:55.527 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:09:55.527 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:09:55.528 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:09:55.528 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:09:55.528 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:09:55.528 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:09:55.528 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:09:55.536 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:09:55.536 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:09:55.538 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:09:55.539 DEBUG:teuthology.parallel:result is None 2024-09-13T17:09:55.541 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:09:55.542 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:09:55.544 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:09:55.544 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:09:55.545 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:09:55.545 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:09:55.587 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:09:55.588 DEBUG:teuthology.parallel:result is None 2024-09-13T17:09:55.590 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:09:55.590 DEBUG:teuthology.parallel:result is None 2024-09-13T17:09:55.591 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:09:55.591 DEBUG:teuthology.parallel:result is None 2024-09-13T17:09:55.591 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T17:09:55.614 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-13T17:09:55.665 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-13T17:09:55.681 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-09-13T17:09:55.681 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-09-13T17:09:55.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 Processor -- start 2024-09-13T17:09:55.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 -- start start 2024-09-13T17:09:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f33340aef00 0x7f33340af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33340c9020 0x7f33340cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33340cde40 0x7f33340cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33340ce2d0 con 0x7f33340c9020 2024-09-13T17:09:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33340cb2b0 con 0x7f33340aef00 2024-09-13T17:09:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33340cbb10 con 0x7f33340cde40 2024-09-13T17:09:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f33327fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33340c9020 0x7f33340cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3332ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f33340aef00 0x7f33340af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3332ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f33340aef00 0x7f33340af4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:36886/0 (socket says 172.21.15.123:36886) 2024-09-13T17:09:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3332ffd700 1 -- 172.21.15.123:0/306538967 learned_addr learned my addr 172.21.15.123:0/306538967 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f33337fe700 1 --2- 172.21.15.123:0/306538967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33340cde40 0x7f33340cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3332ffd700 1 -- 172.21.15.123:0/306538967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33340cde40 msgr2=0x7f33340cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3332ffd700 1 --2- 172.21.15.123:0/306538967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33340cde40 0x7f33340cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3332ffd700 1 -- 172.21.15.123:0/306538967 >> v2:172.21.15.123:3300/0 conn(0x7f33340c9020 msgr2=0x7f33340cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3332ffd700 1 --2- 172.21.15.123:0/306538967 >> v2:172.21.15.123:3300/0 conn(0x7f33340c9020 0x7f33340cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3332ffd700 1 -- 172.21.15.123:0/306538967 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33340af2e0 con 0x7f33340aef00 2024-09-13T17:09:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3332ffd700 1 --2- 172.21.15.123:0/306538967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33340aef00 0x7f33340af4f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f333406b5f0 tx=0x7f332c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f205f3eb018d8d52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:55.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3331ffb700 1 -- 172.21.15.123:0/306538967 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c00e070 con 0x7f33340aef00 2024-09-13T17:09:55.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3331ffb700 1 -- 172.21.15.123:0/306538967 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c00b910 con 0x7f33340aef00 2024-09-13T17:09:55.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3331ffb700 1 -- 172.21.15.123:0/306538967 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c00bcc0 con 0x7f33340aef00 2024-09-13T17:09:55.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 -- 172.21.15.123:0/306538967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33340aef00 msgr2=0x7f33340af4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:55.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 --2- 172.21.15.123:0/306538967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33340aef00 0x7f33340af4f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f333406b5f0 tx=0x7f332c00b330 comp rx=0 tx=0).stop 2024-09-13T17:09:55.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 -- 172.21.15.123:0/306538967 shutdown_connections 2024-09-13T17:09:55.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 --2- 172.21.15.123:0/306538967 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33340cde40 0x7f33340cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 --2- 172.21.15.123:0/306538967 >> v2:172.21.15.123:3300/0 conn(0x7f33340c9020 0x7f33340cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 --2- 172.21.15.123:0/306538967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33340aef00 0x7f33340af4f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 -- 172.21.15.123:0/306538967 >> 172.21.15.123:0/306538967 conn(0x7f33340b0450 msgr2=0x7f33340b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.694+0000 7f3339430700 1 -- 172.21.15.123:0/306538967 shutdown_connections 2024-09-13T17:09:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f3339430700 1 -- 172.21.15.123:0/306538967 wait complete. 2024-09-13T17:09:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f3339430700 1 Processor -- start 2024-09-13T17:09:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f3339430700 1 -- start start 2024-09-13T17:09:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f3339430700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33340aef00 0x7f3334156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f3339430700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33340c9020 0x7f33340c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f3339430700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33340cde40 0x7f3334161780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f3339430700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33340c6f80 con 0x7f33340cde40 2024-09-13T17:09:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f3339430700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33340c7260 con 0x7f33340c9020 2024-09-13T17:09:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f3339430700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33340c7540 con 0x7f33340aef00 2024-09-13T17:09:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f33337fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33340cde40 0x7f3334161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f33327fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33340c9020 0x7f33340c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f3332ffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33340aef00 0x7f3334156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f33337fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33340cde40 0x7f3334161780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60740/0 (socket says 172.21.15.123:60740) 2024-09-13T17:09:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f33337fe700 1 -- 172.21.15.123:0/2367597436 learned_addr learned my addr 172.21.15.123:0/2367597436 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f33327fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33340c9020 0x7f33340c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:36888/0 (socket says 172.21.15.123:36888) 2024-09-13T17:09:55.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f33337fe700 1 -- 172.21.15.123:0/2367597436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33340aef00 msgr2=0x7f3334156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:55.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f33337fe700 1 --2- 172.21.15.123:0/2367597436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33340aef00 0x7f3334156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f33337fe700 1 -- 172.21.15.123:0/2367597436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33340c9020 msgr2=0x7f33340c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:55.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f33337fe700 1 --2- 172.21.15.123:0/2367597436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33340c9020 0x7f33340c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:55.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f33337fe700 1 -- 172.21.15.123:0/2367597436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c009b30 con 0x7f33340cde40 2024-09-13T17:09:55.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f33337fe700 1 --2- 172.21.15.123:0/2367597436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33340cde40 0x7f3334161780 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f332400eb60 tx=0x7f332400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:55.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f331b7fe700 1 -- 172.21.15.123:0/2367597436 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324009740 con 0x7f33340cde40 2024-09-13T17:09:55.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f331b7fe700 1 -- 172.21.15.123:0/2367597436 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3324009e00 con 0x7f33340cde40 2024-09-13T17:09:55.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f3339430700 1 -- 172.21.15.123:0/2367597436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33340c7820 con 0x7f33340cde40 2024-09-13T17:09:55.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f331b7fe700 1 -- 172.21.15.123:0/2367597436 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400ca70 con 0x7f33340cde40 2024-09-13T17:09:55.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.698+0000 7f3339430700 1 -- 172.21.15.123:0/2367597436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33340c4b10 con 0x7f33340cde40 2024-09-13T17:09:55.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.702+0000 7f3339430700 1 -- 172.21.15.123:0/2367597436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33340c7d40 con 0x7f33340cde40 2024-09-13T17:09:55.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.702+0000 7f331b7fe700 1 -- 172.21.15.123:0/2367597436 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f332400cbd0 con 0x7f33340cde40 2024-09-13T17:09:55.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.702+0000 7f331b7fe700 1 --2- 172.21.15.123:0/2367597436 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3320066730 0x7f3320068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:55.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.702+0000 7f331b7fe700 1 -- 172.21.15.123:0/2367597436 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3324083e60 con 0x7f33340cde40 2024-09-13T17:09:55.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.702+0000 7f3332ffd700 1 --2- 172.21.15.123:0/2367597436 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3320066730 0x7f3320068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:55.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.702+0000 7f3332ffd700 1 --2- 172.21.15.123:0/2367597436 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3320066730 0x7f3320068bf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f332c00b370 tx=0x7f332c009000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:55.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.710+0000 7f331b7fe700 1 -- 172.21.15.123:0/2367597436 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f33340c7d40 con 0x7f33340cde40 2024-09-13T17:09:55.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-13T17:09:55.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:55.894+0000 7f3339430700 1 -- 172.21.15.123:0/2367597436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f33340c7d40 con 0x7f33340cde40 2024-09-13T17:09:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.718+0000 7f331b7fe700 1 -- 172.21.15.123:0/2367597436 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v82) v1 ==== 97+0+0 (secure 0 0 0) 0x7f33340c7d40 con 0x7f33340cde40 2024-09-13T17:09:56.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.722+0000 7f3339430700 1 -- 172.21.15.123:0/2367597436 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3320066730 msgr2=0x7f3320068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:56.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.722+0000 7f3339430700 1 --2- 172.21.15.123:0/2367597436 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3320066730 0x7f3320068bf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f332c00b370 tx=0x7f332c009000 comp rx=0 tx=0).stop 2024-09-13T17:09:56.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.722+0000 7f3339430700 1 -- 172.21.15.123:0/2367597436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33340cde40 msgr2=0x7f3334161780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:56.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.722+0000 7f3339430700 1 --2- 172.21.15.123:0/2367597436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33340cde40 0x7f3334161780 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f332400eb60 tx=0x7f332400ee70 comp rx=0 tx=0).stop 2024-09-13T17:09:56.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.722+0000 7f3339430700 1 -- 172.21.15.123:0/2367597436 shutdown_connections 2024-09-13T17:09:56.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.722+0000 7f3339430700 1 --2- 172.21.15.123:0/2367597436 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3320066730 0x7f3320068bf0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:56.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.722+0000 7f3339430700 1 --2- 172.21.15.123:0/2367597436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33340cde40 0x7f3334161780 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:56.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.722+0000 7f3339430700 1 --2- 172.21.15.123:0/2367597436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33340c9020 0x7f33340c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:56.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.722+0000 7f3339430700 1 --2- 172.21.15.123:0/2367597436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f33340aef00 0x7f3334156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:56.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.722+0000 7f3339430700 1 -- 172.21.15.123:0/2367597436 >> 172.21.15.123:0/2367597436 conn(0x7f33340b0450 msgr2=0x7f333406c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:56.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.722+0000 7f3339430700 1 -- 172.21.15.123:0/2367597436 shutdown_connections 2024-09-13T17:09:56.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.722+0000 7f3339430700 1 -- 172.21.15.123:0/2367597436 wait complete. 2024-09-13T17:09:56.729 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-13T17:09:56.744 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T17:09:56.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.854+0000 7f8ffaa4c700 1 Processor -- start 2024-09-13T17:09:56.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.854+0000 7f8ffaa4c700 1 -- start start 2024-09-13T17:09:56.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.854+0000 7f8ffaa4c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff41598b0 0x7f8ff4071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:56.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.854+0000 7f8ffaa4c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff415d360 con 0x7f8ff40cedc0 2024-09-13T17:09:56.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.854+0000 7f8ffaa4c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff40ce3d0 con 0x7f8ff40cdfd0 2024-09-13T17:09:56.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.854+0000 7f8ffaa4c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40724c0 con 0x7f8ff41598b0 2024-09-13T17:09:56.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ffa24b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8ff40cedc0 0x7f8ff4159c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40044/0 (socket says 172.21.15.123:40044) 2024-09-13T17:09:56.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ffa24b700 1 -- 172.21.15.123:0/3197070371 learned_addr learned my addr 172.21.15.123:0/3197070371 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:56.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ff9a4a700 1 --2- 172.21.15.123:0/3197070371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff41598b0 0x7f8ff4071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:56.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ff8a48700 1 -- 172.21.15.123:0/3197070371 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780265450 0 0) 0x7f8ff415d360 con 0x7f8ff40cedc0 2024-09-13T17:09:56.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ff8a48700 1 -- 172.21.15.123:0/3197070371 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fe00035d0 con 0x7f8ff40cedc0 2024-09-13T17:09:56.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ff8a48700 1 -- 172.21.15.123:0/3197070371 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294277495 0 0) 0x7f8ff40ce3d0 con 0x7f8ff40cdfd0 2024-09-13T17:09:56.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ff8a48700 1 -- 172.21.15.123:0/3197070371 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ff415d360 con 0x7f8ff40cdfd0 2024-09-13T17:09:56.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ff9a4a700 1 -- 172.21.15.123:0/3197070371 >> v1:172.21.15.153:6789/0 conn(0x7f8ff40cdfd0 legacy=0x7f8ff40ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:56.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ff9a4a700 1 -- 172.21.15.123:0/3197070371 >> v1:172.21.15.123:6789/0 conn(0x7f8ff40cedc0 legacy=0x7f8ff4159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:56.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ff9a4a700 1 -- 172.21.15.123:0/3197070371 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff415d5b0 con 0x7f8ff41598b0 2024-09-13T17:09:56.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ff9a4a700 1 --2- 172.21.15.123:0/3197070371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff41598b0 0x7f8ff4071e60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009880 tx=0x7f8fe4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a030de4a4fe2d0e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:56.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ff8a48700 1 -- 172.21.15.123:0/3197070371 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4011830 con 0x7f8ff41598b0 2024-09-13T17:09:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ff8a48700 1 -- 172.21.15.123:0/3197070371 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe4011990 con 0x7f8ff41598b0 2024-09-13T17:09:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ff8a48700 1 -- 172.21.15.123:0/3197070371 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4011d00 con 0x7f8ff41598b0 2024-09-13T17:09:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/3197070371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff41598b0 msgr2=0x7f8ff4071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ffaa4c700 1 --2- 172.21.15.123:0/3197070371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff41598b0 0x7f8ff4071e60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009880 tx=0x7f8fe4009b90 comp rx=0 tx=0).stop 2024-09-13T17:09:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/3197070371 shutdown_connections 2024-09-13T17:09:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ffaa4c700 1 --2- 172.21.15.123:0/3197070371 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff41598b0 0x7f8ff4071e60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/3197070371 >> 172.21.15.123:0/3197070371 conn(0x7f8ff4066150 msgr2=0x7f8ff4066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:56.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/3197070371 shutdown_connections 2024-09-13T17:09:56.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.858+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/3197070371 wait complete. 2024-09-13T17:09:56.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffaa4c700 1 Processor -- start 2024-09-13T17:09:56.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffaa4c700 1 -- start start 2024-09-13T17:09:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffaa4c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff40cdfd0 0x7f8ff40aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffaa4c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff40cedc0 0x7f8ff4154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffaa4c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff41598b0 0x7f8ff415aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffaa4c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40c3540 con 0x7f8ff41598b0 2024-09-13T17:09:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffaa4c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40af120 con 0x7f8ff40cdfd0 2024-09-13T17:09:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffaa4c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40af400 con 0x7f8ff40cedc0 2024-09-13T17:09:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffa24b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff41598b0 0x7f8ff415aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffa24b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff41598b0 0x7f8ff415aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60754/0 (socket says 172.21.15.123:60754) 2024-09-13T17:09:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffa24b700 1 -- 172.21.15.123:0/437219494 learned_addr learned my addr 172.21.15.123:0/437219494 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ff9a4a700 1 --2- 172.21.15.123:0/437219494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff40cdfd0 0x7f8ff40aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ff9249700 1 --2- 172.21.15.123:0/437219494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff40cedc0 0x7f8ff4154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffa24b700 1 -- 172.21.15.123:0/437219494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff40cedc0 msgr2=0x7f8ff4154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffa24b700 1 --2- 172.21.15.123:0/437219494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff40cedc0 0x7f8ff4154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffa24b700 1 -- 172.21.15.123:0/437219494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff40cdfd0 msgr2=0x7f8ff40aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffa24b700 1 --2- 172.21.15.123:0/437219494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff40cdfd0 0x7f8ff40aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffa24b700 1 -- 172.21.15.123:0/437219494 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe40094b0 con 0x7f8ff41598b0 2024-09-13T17:09:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8ffa24b700 1 --2- 172.21.15.123:0/437219494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff41598b0 0x7f8ff415aea0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c490 tx=0x7f8fec00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:56.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.862+0000 7f8fea7fc700 1 -- 172.21.15.123:0/437219494 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec00cea0 con 0x7f8ff41598b0 2024-09-13T17:09:56.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.866+0000 7f8fea7fc700 1 -- 172.21.15.123:0/437219494 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec005d90 con 0x7f8ff41598b0 2024-09-13T17:09:56.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.866+0000 7f8fea7fc700 1 -- 172.21.15.123:0/437219494 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0072f0 con 0x7f8ff41598b0 2024-09-13T17:09:56.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.866+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/437219494 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff40c37e0 con 0x7f8ff41598b0 2024-09-13T17:09:56.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.866+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/437219494 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff41583c0 con 0x7f8ff41598b0 2024-09-13T17:09:56.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.866+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/437219494 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff40677f0 con 0x7f8ff41598b0 2024-09-13T17:09:56.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.866+0000 7f8fea7fc700 1 -- 172.21.15.123:0/437219494 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8fec007450 con 0x7f8ff41598b0 2024-09-13T17:09:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.866+0000 7f8fea7fc700 1 --2- 172.21.15.123:0/437219494 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8fd8066760 0x7f8fd8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.866+0000 7f8ff9a4a700 1 --2- 172.21.15.123:0/437219494 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8fd8066760 0x7f8fd8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.866+0000 7f8fea7fc700 1 -- 172.21.15.123:0/437219494 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8fec083120 con 0x7f8ff41598b0 2024-09-13T17:09:56.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.870+0000 7f8ff9a4a700 1 --2- 172.21.15.123:0/437219494 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8fd8066760 0x7f8fd8068c20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40090b0 tx=0x7f8fe4010000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:56.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:56.874+0000 7f8fea7fc700 1 -- 172.21.15.123:0/437219494 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8fec050870 con 0x7f8ff41598b0 2024-09-13T17:09:57.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.102+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/437219494 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8ff40c3d00 con 0x7f8ff41598b0 2024-09-13T17:09:57.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.102+0000 7f8fea7fc700 1 -- 172.21.15.123:0/437219494 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8ff40c3d00 con 0x7f8ff41598b0 2024-09-13T17:09:57.108 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:57.108 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:09:57.108 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-13T17:09:57.109 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.109 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-13T17:09:57.109 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmcINWChAAjEdCM4Sk1OsLUQerqFqnGg==", 2024-09-13T17:09:57.109 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.109 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:57.109 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:09:57.109 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:09:57.109 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.109 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.109 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.109 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.109 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-13T17:09:57.110 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmesC1ERAA2ZS4r6KU9vqfDLLX+0kwwg==", 2024-09-13T17:09:57.110 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.110 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:57.110 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:09:57.110 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:09:57.110 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.110 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.110 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.110 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.110 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-13T17:09:57.110 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORm+dvcDRAA5o6AtNdAEM2RTXMTKTuwvA==", 2024-09-13T17:09:57.110 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.110 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:57.110 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:09:57.111 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:09:57.111 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.111 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.111 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.111 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.111 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-13T17:09:57.111 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmnFIgGBAAZbqUsdKOG1nN0iHsKRqyHA==", 2024-09-13T17:09:57.111 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.111 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:57.111 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:09:57.111 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:09:57.111 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.111 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.112 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.112 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.112 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-13T17:09:57.112 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDucORmpvNQEhAAg2TDxfqiCxv8rfzNXd8ghw==", 2024-09-13T17:09:57.112 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.112 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:57.112 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:57.112 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.112 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.112 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.112 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.112 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-13T17:09:57.112 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDxcORmnAU+FxAAxjWreGRwyuQT2RRMicHAXg==", 2024-09-13T17:09:57.113 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.113 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:57.113 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:57.113 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.113 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.113 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.113 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.113 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-13T17:09:57.113 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD0cORmMXQpGhAADjhpu3evLXhYS+YKeKf8WQ==", 2024-09-13T17:09:57.113 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.113 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:57.113 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:57.114 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.114 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.114 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.114 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.114 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-13T17:09:57.114 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD3cORmAo7hHxAA80EcAMAxPmMPuKxUg6RYhQ==", 2024-09-13T17:09:57.114 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.114 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:57.114 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:57.114 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.114 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.114 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.114 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.115 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-13T17:09:57.115 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD9cORm2j1KCxAA57ClQVuoJdhuk76L4nPHVQ==", 2024-09-13T17:09:57.115 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.115 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:57.115 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:57.115 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.115 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.115 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.115 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.115 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-13T17:09:57.115 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAAceRmu5IeExAAyUOWIVy5i703n829U0KSuw==", 2024-09-13T17:09:57.115 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.115 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:57.115 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:57.116 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.116 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.116 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.116 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.116 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-13T17:09:57.116 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQADceRmhiXfFhAAt6aAa3EUOvKclLyGEl84SA==", 2024-09-13T17:09:57.116 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.116 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:57.116 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:57.116 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.116 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.116 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.116 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.117 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-13T17:09:57.117 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAGceRmjYdfHBAAHn19wbVS72wMYHvMh+Cpyg==", 2024-09-13T17:09:57.117 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.117 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:09:57.117 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:09:57.117 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.117 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.117 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.117 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.117 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-13T17:09:57.117 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmieDjGxAA9C8qfFqgRul4Kzk+0+UMTA==", 2024-09-13T17:09:57.118 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.118 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:57.118 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-13T17:09:57.118 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T17:09:57.118 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.118 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.118 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.118 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-13T17:09:57.118 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmJvUUJRAAQci63exaXrtjPfssFai1jw==", 2024-09-13T17:09:57.118 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.118 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:57.118 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:09:57.118 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:09:57.118 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:09:57.119 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.119 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.119 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.119 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-13T17:09:57.119 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmgbzRIRAA8VlhYQpFRQUNOo6nplFySA==", 2024-09-13T17:09:57.119 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.119 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:57.119 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:09:57.119 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:09:57.119 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:09:57.119 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.119 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.119 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.120 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-13T17:09:57.120 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmwT+9KhAASidrLfvv55brtJ3Mk+qdxA==", 2024-09-13T17:09:57.120 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.120 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:09:57.120 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:09:57.120 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:09:57.120 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:09:57.120 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.120 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.120 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.120 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-13T17:09:57.120 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDqcORmn/ceNxAAxs8e7/yGRB9oykHDFVQ0lA==", 2024-09-13T17:09:57.121 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.121 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:09:57.121 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:09:57.121 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:09:57.121 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.121 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.121 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.121 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.121 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-13T17:09:57.121 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmFSRNBhAAbI1RASXCwIZPggcjMdXynw==", 2024-09-13T17:09:57.121 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.121 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:09:57.121 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-13T17:09:57.121 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.122 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.122 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:09:57.122 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:57.122 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-13T17:09:57.122 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmLhAcAxAAHSNEbQ2dLEBPGDMMKc7dQQ==", 2024-09-13T17:09:57.122 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:09:57.122 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:09:57.122 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-13T17:09:57.122 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:09:57.122 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.122 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:57.122 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-13T17:09:57.122 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:09:57.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.106+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/437219494 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8fd8066760 msgr2=0x7f8fd8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.106+0000 7f8ffaa4c700 1 --2- 172.21.15.123:0/437219494 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8fd8066760 0x7f8fd8068c20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40090b0 tx=0x7f8fe4010000 comp rx=0 tx=0).stop 2024-09-13T17:09:57.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.106+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/437219494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff41598b0 msgr2=0x7f8ff415aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.106+0000 7f8ffaa4c700 1 --2- 172.21.15.123:0/437219494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff41598b0 0x7f8ff415aea0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c490 tx=0x7f8fec00c7a0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.106+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/437219494 shutdown_connections 2024-09-13T17:09:57.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.106+0000 7f8ffaa4c700 1 --2- 172.21.15.123:0/437219494 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8fd8066760 0x7f8fd8068c20 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.106+0000 7f8ffaa4c700 1 --2- 172.21.15.123:0/437219494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ff41598b0 0x7f8ff415aea0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.106+0000 7f8ffaa4c700 1 --2- 172.21.15.123:0/437219494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ff40cedc0 0x7f8ff4154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.106+0000 7f8ffaa4c700 1 --2- 172.21.15.123:0/437219494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff40cdfd0 0x7f8ff40aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.106+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/437219494 >> 172.21.15.123:0/437219494 conn(0x7f8ff4066150 msgr2=0x7f8ff40b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:57.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.106+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/437219494 shutdown_connections 2024-09-13T17:09:57.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.106+0000 7f8ffaa4c700 1 -- 172.21.15.123:0/437219494 wait complete. 2024-09-13T17:09:57.125 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:09:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f565e3fb700 1 Processor -- start 2024-09-13T17:09:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f565e3fb700 1 -- start start 2024-09-13T17:09:57.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f565e3fb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5658160fb0 0x7f565806de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f565e3fb700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565806e340 con 0x7f565806c760 2024-09-13T17:09:57.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f565e3fb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565806cd60 con 0x7f56580cec90 2024-09-13T17:09:57.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f565e3fb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565806d040 con 0x7f5658160fb0 2024-09-13T17:09:57.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f565c998700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f565806c760 0x7f5658161390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40052/0 (socket says 172.21.15.123:40052) 2024-09-13T17:09:57.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f565c998700 1 -- 172.21.15.123:0/1644132428 learned_addr learned my addr 172.21.15.123:0/1644132428 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:57.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f5657fff700 1 --2- 172.21.15.123:0/1644132428 >> v2:172.21.15.153:3300/0 conn(0x7f5658160fb0 0x7f565806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f5656ffd700 1 -- 172.21.15.123:0/1644132428 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042986639 0 0) 0x7f565806e340 con 0x7f565806c760 2024-09-13T17:09:57.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f5656ffd700 1 -- 172.21.15.123:0/1644132428 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56380035d0 con 0x7f565806c760 2024-09-13T17:09:57.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f5657fff700 1 -- 172.21.15.123:0/1644132428 >> v1:172.21.15.153:6789/0 conn(0x7f56580cec90 legacy=0x7f565806c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f5657fff700 1 -- 172.21.15.123:0/1644132428 >> v1:172.21.15.123:6789/0 conn(0x7f565806c760 legacy=0x7f5658161390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f5657fff700 1 -- 172.21.15.123:0/1644132428 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565806d320 con 0x7f5658160fb0 2024-09-13T17:09:57.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f5657fff700 1 --2- 172.21.15.123:0/1644132428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5658160fb0 0x7f565806de00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5648009d90 tx=0x7f564800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33afaf165761d852 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f5656ffd700 1 -- 172.21.15.123:0/1644132428 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564800e070 con 0x7f5658160fb0 2024-09-13T17:09:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f5656ffd700 1 -- 172.21.15.123:0/1644132428 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564800bb20 con 0x7f5658160fb0 2024-09-13T17:09:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.230+0000 7f5656ffd700 1 -- 172.21.15.123:0/1644132428 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648012430 con 0x7f5658160fb0 2024-09-13T17:09:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 -- 172.21.15.123:0/1644132428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5658160fb0 msgr2=0x7f565806de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 --2- 172.21.15.123:0/1644132428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5658160fb0 0x7f565806de00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5648009d90 tx=0x7f564800b330 comp rx=0 tx=0).stop 2024-09-13T17:09:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 -- 172.21.15.123:0/1644132428 shutdown_connections 2024-09-13T17:09:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 --2- 172.21.15.123:0/1644132428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5658160fb0 0x7f565806de00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 -- 172.21.15.123:0/1644132428 >> 172.21.15.123:0/1644132428 conn(0x7f5658066570 msgr2=0x7f5658066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 -- 172.21.15.123:0/1644132428 shutdown_connections 2024-09-13T17:09:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 -- 172.21.15.123:0/1644132428 wait complete. 2024-09-13T17:09:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 Processor -- start 2024-09-13T17:09:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 -- start start 2024-09-13T17:09:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f565806c760 0x7f56580b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56580cec90 0x7f5658158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5658160fb0 0x7f565813ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5658158ff0 con 0x7f5658160fb0 2024-09-13T17:09:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5658159200 con 0x7f565806c760 2024-09-13T17:09:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565e3fb700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5658155090 con 0x7f56580cec90 2024-09-13T17:09:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565c998700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5658160fb0 0x7f565813ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565c998700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5658160fb0 0x7f565813ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60768/0 (socket says 172.21.15.123:60768) 2024-09-13T17:09:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f565c998700 1 -- 172.21.15.123:0/1028712582 learned_addr learned my addr 172.21.15.123:0/1028712582 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.234+0000 7f5657fff700 1 --2- 172.21.15.123:0/1028712582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f565806c760 0x7f56580b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.238+0000 7f56577fe700 1 --2- 172.21.15.123:0/1028712582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56580cec90 0x7f5658158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.238+0000 7f565c998700 1 -- 172.21.15.123:0/1028712582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56580cec90 msgr2=0x7f5658158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.238+0000 7f565c998700 1 --2- 172.21.15.123:0/1028712582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56580cec90 0x7f5658158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.238+0000 7f565c998700 1 -- 172.21.15.123:0/1028712582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f565806c760 msgr2=0x7f56580b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.238+0000 7f565c998700 1 --2- 172.21.15.123:0/1028712582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f565806c760 0x7f56580b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.238+0000 7f565c998700 1 -- 172.21.15.123:0/1028712582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5648009a70 con 0x7f5658160fb0 2024-09-13T17:09:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.238+0000 7f565c998700 1 --2- 172.21.15.123:0/1028712582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5658160fb0 0x7f565813ea20 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f564000c4f0 tx=0x7f564000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.238+0000 7f5654ff9700 1 -- 172.21.15.123:0/1028712582 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640005d90 con 0x7f5658160fb0 2024-09-13T17:09:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.238+0000 7f5654ff9700 1 -- 172.21.15.123:0/1028712582 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56400070d0 con 0x7f5658160fb0 2024-09-13T17:09:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.238+0000 7f5654ff9700 1 -- 172.21.15.123:0/1028712582 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640007460 con 0x7f5658160fb0 2024-09-13T17:09:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.238+0000 7f565e3fb700 1 -- 172.21.15.123:0/1028712582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565813ef60 con 0x7f5658160fb0 2024-09-13T17:09:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.238+0000 7f565e3fb700 1 -- 172.21.15.123:0/1028712582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5658154a40 con 0x7f5658160fb0 2024-09-13T17:09:57.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.238+0000 7f5654ff9700 1 -- 172.21.15.123:0/1028712582 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56400075c0 con 0x7f5658160fb0 2024-09-13T17:09:57.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.238+0000 7f565e3fb700 1 -- 172.21.15.123:0/1028712582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5658155200 con 0x7f5658160fb0 2024-09-13T17:09:57.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.242+0000 7f5654ff9700 1 --2- 172.21.15.123:0/1028712582 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f563c066760 0x7f563c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.242+0000 7f5657fff700 1 --2- 172.21.15.123:0/1028712582 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f563c066760 0x7f563c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.242+0000 7f5654ff9700 1 -- 172.21.15.123:0/1028712582 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f56400831f0 con 0x7f5658160fb0 2024-09-13T17:09:57.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.242+0000 7f5657fff700 1 --2- 172.21.15.123:0/1028712582 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f563c066760 0x7f563c068c20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5648014040 tx=0x7f5648011000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.246+0000 7f5654ff9700 1 -- 172.21.15.123:0/1028712582 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56400508a0 con 0x7f5658160fb0 2024-09-13T17:09:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.418+0000 7f565e3fb700 1 -- 172.21.15.123:0/1028712582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f565806de00 con 0x7f5658160fb0 2024-09-13T17:09:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.422+0000 7f5654ff9700 1 -- 172.21.15.123:0/1028712582 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+12906 (secure 0 0 0) 0x7f5640053ec0 con 0x7f5658160fb0 2024-09-13T17:09:57.427 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:57.427 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":82,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:09:56.715909+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:09:57.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.422+0000 7f565e3fb700 1 -- 172.21.15.123:0/1028712582 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f563c066760 msgr2=0x7f563c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.422+0000 7f565e3fb700 1 --2- 172.21.15.123:0/1028712582 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f563c066760 0x7f563c068c20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5648014040 tx=0x7f5648011000 comp rx=0 tx=0).stop 2024-09-13T17:09:57.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.422+0000 7f565e3fb700 1 -- 172.21.15.123:0/1028712582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5658160fb0 msgr2=0x7f565813ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.422+0000 7f565e3fb700 1 --2- 172.21.15.123:0/1028712582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5658160fb0 0x7f565813ea20 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f564000c4f0 tx=0x7f564000c800 comp rx=0 tx=0).stop 2024-09-13T17:09:57.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.422+0000 7f565e3fb700 1 -- 172.21.15.123:0/1028712582 shutdown_connections 2024-09-13T17:09:57.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.422+0000 7f565e3fb700 1 --2- 172.21.15.123:0/1028712582 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f563c066760 0x7f563c068c20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.422+0000 7f565e3fb700 1 --2- 172.21.15.123:0/1028712582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5658160fb0 0x7f565813ea20 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.422+0000 7f565e3fb700 1 --2- 172.21.15.123:0/1028712582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56580cec90 0x7f5658158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.422+0000 7f565e3fb700 1 --2- 172.21.15.123:0/1028712582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f565806c760 0x7f56580b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.422+0000 7f565e3fb700 1 -- 172.21.15.123:0/1028712582 >> 172.21.15.123:0/1028712582 conn(0x7f5658066570 msgr2=0x7f5658156040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:57.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.422+0000 7f565e3fb700 1 -- 172.21.15.123:0/1028712582 shutdown_connections 2024-09-13T17:09:57.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.422+0000 7f565e3fb700 1 -- 172.21.15.123:0/1028712582 wait complete. 2024-09-13T17:09:57.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:09:57.442 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:09:57.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f379a855700 1 Processor -- start 2024-09-13T17:09:57.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f379a855700 1 -- start start 2024-09-13T17:09:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f379a855700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37941604b0 0x7f37940cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f379a855700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f37940c98c0 0x7f37940cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f379a855700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37940ceec0 con 0x7f3794160890 2024-09-13T17:09:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f379a855700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37940ce430 con 0x7f37940c98c0 2024-09-13T17:09:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f379a855700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37940d1ec0 con 0x7f37941604b0 2024-09-13T17:09:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f378bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f37940c98c0 0x7f37940cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f3798df2700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3794160890 0x7f37940d0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40062/0 (socket says 172.21.15.123:40062) 2024-09-13T17:09:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f3798df2700 1 -- 172.21.15.123:0/1748768444 learned_addr learned my addr 172.21.15.123:0/1748768444 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f3793fff700 1 --2- 172.21.15.123:0/1748768444 >> v2:172.21.15.153:3300/0 conn(0x7f37941604b0 0x7f37940cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f37937fe700 1 -- 172.21.15.123:0/1748768444 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160706653 0 0) 0x7f37940ceec0 con 0x7f3794160890 2024-09-13T17:09:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f37937fe700 1 -- 172.21.15.123:0/1748768444 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37800035d0 con 0x7f3794160890 2024-09-13T17:09:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f378bfff700 1 -- 172.21.15.123:0/1748768444 >> v2:172.21.15.153:3300/0 conn(0x7f37941604b0 msgr2=0x7f37940cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:57.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f378bfff700 1 --2- 172.21.15.123:0/1748768444 >> v2:172.21.15.153:3300/0 conn(0x7f37941604b0 0x7f37940cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f37937fe700 1 -- 172.21.15.123:0/1748768444 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3261562218 0 0) 0x7f37800035d0 con 0x7f3794160890 2024-09-13T17:09:57.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f378bfff700 1 -- 172.21.15.123:0/1748768444 >> v1:172.21.15.123:6789/0 conn(0x7f3794160890 legacy=0x7f37940d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f378bfff700 1 -- 172.21.15.123:0/1748768444 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37940ce620 con 0x7f37940c98c0 2024-09-13T17:09:57.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.558+0000 7f378bfff700 1 --2- 172.21.15.123:0/1748768444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37940c98c0 0x7f37940cf820 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f3794072280 tx=0x7f377c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c07455d329aff0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.562+0000 7f37937fe700 1 -- 172.21.15.123:0/1748768444 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c011830 con 0x7f37940c98c0 2024-09-13T17:09:57.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.562+0000 7f37937fe700 1 -- 172.21.15.123:0/1748768444 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c011990 con 0x7f37940c98c0 2024-09-13T17:09:57.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.562+0000 7f37937fe700 1 -- 172.21.15.123:0/1748768444 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c011d20 con 0x7f37940c98c0 2024-09-13T17:09:57.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.562+0000 7f379a855700 1 -- 172.21.15.123:0/1748768444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37940c98c0 msgr2=0x7f37940cf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.562+0000 7f379a855700 1 --2- 172.21.15.123:0/1748768444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37940c98c0 0x7f37940cf820 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f3794072280 tx=0x7f377c009b30 comp rx=0 tx=0).stop 2024-09-13T17:09:57.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.562+0000 7f379a855700 1 -- 172.21.15.123:0/1748768444 shutdown_connections 2024-09-13T17:09:57.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.562+0000 7f379a855700 1 --2- 172.21.15.123:0/1748768444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37940c98c0 0x7f37940cf820 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.562+0000 7f379a855700 1 --2- 172.21.15.123:0/1748768444 >> v2:172.21.15.153:3300/0 conn(0x7f37941604b0 0x7f37940cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.562+0000 7f379a855700 1 -- 172.21.15.123:0/1748768444 >> 172.21.15.123:0/1748768444 conn(0x7f37940d2cb0 msgr2=0x7f37940d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:57.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.562+0000 7f379a855700 1 -- 172.21.15.123:0/1748768444 shutdown_connections 2024-09-13T17:09:57.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.562+0000 7f379a855700 1 -- 172.21.15.123:0/1748768444 wait complete. 2024-09-13T17:09:57.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f379a855700 1 Processor -- start 2024-09-13T17:09:57.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f379a855700 1 -- start start 2024-09-13T17:09:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f379a855700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37940c98c0 0x7f3794153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f379a855700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37941604b0 0x7f3794150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f379a855700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3794160890 0x7f37941f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f379a855700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37941561b0 con 0x7f37941604b0 2024-09-13T17:09:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f379a855700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3794156ca0 con 0x7f37940c98c0 2024-09-13T17:09:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f379a855700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3794150760 con 0x7f3794160890 2024-09-13T17:09:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f378bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37941604b0 0x7f3794150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f378bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37941604b0 0x7f3794150220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60778/0 (socket says 172.21.15.123:60778) 2024-09-13T17:09:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f378bfff700 1 -- 172.21.15.123:0/657797779 learned_addr learned my addr 172.21.15.123:0/657797779 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:57.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f3798df2700 1 --2- 172.21.15.123:0/657797779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3794160890 0x7f37941f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f3793fff700 1 --2- 172.21.15.123:0/657797779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37940c98c0 0x7f3794153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f378bfff700 1 -- 172.21.15.123:0/657797779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3794160890 msgr2=0x7f37941f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f378bfff700 1 --2- 172.21.15.123:0/657797779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3794160890 0x7f37941f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f378bfff700 1 -- 172.21.15.123:0/657797779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37940c98c0 msgr2=0x7f3794153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f378bfff700 1 --2- 172.21.15.123:0/657797779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37940c98c0 0x7f3794153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f378bfff700 1 -- 172.21.15.123:0/657797779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0094b0 con 0x7f37941604b0 2024-09-13T17:09:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.566+0000 7f378bfff700 1 --2- 172.21.15.123:0/657797779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37941604b0 0x7f3794150220 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f377c0090b0 tx=0x7f377c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.570+0000 7f37917fa700 1 -- 172.21.15.123:0/657797779 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c01a910 con 0x7f37941604b0 2024-09-13T17:09:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.570+0000 7f37917fa700 1 -- 172.21.15.123:0/657797779 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c01f070 con 0x7f37941604b0 2024-09-13T17:09:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.570+0000 7f379a855700 1 -- 172.21.15.123:0/657797779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3794156400 con 0x7f37941604b0 2024-09-13T17:09:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.570+0000 7f37917fa700 1 -- 172.21.15.123:0/657797779 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c01acd0 con 0x7f37941604b0 2024-09-13T17:09:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.570+0000 7f379a855700 1 -- 172.21.15.123:0/657797779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37941569c0 con 0x7f37941604b0 2024-09-13T17:09:57.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.570+0000 7f379a855700 1 -- 172.21.15.123:0/657797779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37940cf2e0 con 0x7f37941604b0 2024-09-13T17:09:57.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.570+0000 7f37917fa700 1 -- 172.21.15.123:0/657797779 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f377c02e450 con 0x7f37941604b0 2024-09-13T17:09:57.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.570+0000 7f37917fa700 1 --2- 172.21.15.123:0/657797779 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3774066760 0x7f3774068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.570+0000 7f37917fa700 1 -- 172.21.15.123:0/657797779 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f377c084cb0 con 0x7f37941604b0 2024-09-13T17:09:57.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.570+0000 7f3793fff700 1 --2- 172.21.15.123:0/657797779 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3774066760 0x7f3774068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.570+0000 7f3793fff700 1 --2- 172.21.15.123:0/657797779 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3774066760 0x7f3774068c20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3784009bf0 tx=0x7f3784009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.578+0000 7f37917fa700 1 -- 172.21.15.123:0/657797779 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f377c052400 con 0x7f37941604b0 2024-09-13T17:09:57.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.750+0000 7f379a855700 1 -- 172.21.15.123:0/657797779 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37940b41b0 con 0x7f37941604b0 2024-09-13T17:09:57.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.750+0000 7f37917fa700 1 -- 172.21.15.123:0/657797779 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f377c0150a0 con 0x7f37941604b0 2024-09-13T17:09:57.758 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:09:57.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.754+0000 7f379a855700 1 -- 172.21.15.123:0/657797779 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3774066760 msgr2=0x7f3774068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.754+0000 7f379a855700 1 --2- 172.21.15.123:0/657797779 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3774066760 0x7f3774068c20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3784009bf0 tx=0x7f3784009240 comp rx=0 tx=0).stop 2024-09-13T17:09:57.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.754+0000 7f379a855700 1 -- 172.21.15.123:0/657797779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37941604b0 msgr2=0x7f3794150220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.754+0000 7f379a855700 1 --2- 172.21.15.123:0/657797779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37941604b0 0x7f3794150220 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f377c0090b0 tx=0x7f377c004770 comp rx=0 tx=0).stop 2024-09-13T17:09:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.754+0000 7f379a855700 1 -- 172.21.15.123:0/657797779 shutdown_connections 2024-09-13T17:09:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.754+0000 7f379a855700 1 --2- 172.21.15.123:0/657797779 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3774066760 0x7f3774068c20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.754+0000 7f379a855700 1 --2- 172.21.15.123:0/657797779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3794160890 0x7f37941f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.754+0000 7f379a855700 1 --2- 172.21.15.123:0/657797779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37941604b0 0x7f3794150220 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.754+0000 7f379a855700 1 --2- 172.21.15.123:0/657797779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37940c98c0 0x7f3794153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.754+0000 7f379a855700 1 -- 172.21.15.123:0/657797779 >> 172.21.15.123:0/657797779 conn(0x7f37940d2cb0 msgr2=0x7f37940b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.754+0000 7f379a855700 1 -- 172.21.15.123:0/657797779 shutdown_connections 2024-09-13T17:09:57.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.754+0000 7f379a855700 1 -- 172.21.15.123:0/657797779 wait complete. 2024-09-13T17:09:57.773 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:09:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.874+0000 7f267ec00700 1 Processor -- start 2024-09-13T17:09:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.874+0000 7f267ec00700 1 -- start start 2024-09-13T17:09:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.874+0000 7f267ec00700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26780b2400 0x7f26780ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.874+0000 7f267ec00700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26780cd4b0 0x7f26780b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.874+0000 7f267ec00700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26780b2d20 0x7f26780b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.874+0000 7f267ec00700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26780cde30 con 0x7f26780b2400 2024-09-13T17:09:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.874+0000 7f267ec00700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26780b3fc0 con 0x7f26780cd4b0 2024-09-13T17:09:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.874+0000 7f267ec00700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26780cd8f0 con 0x7f26780b2d20 2024-09-13T17:09:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.874+0000 7f267dbfe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26780b2400 0x7f26780ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.874+0000 7f267dbfe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26780b2400 0x7f26780ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60786/0 (socket says 172.21.15.123:60786) 2024-09-13T17:09:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.874+0000 7f267dbfe700 1 -- 172.21.15.123:0/2440260995 learned_addr learned my addr 172.21.15.123:0/2440260995 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.874+0000 7f267e3ff700 1 --2- 172.21.15.123:0/2440260995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26780b2d20 0x7f26780b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.874+0000 7f267d3fd700 1 --2- 172.21.15.123:0/2440260995 >> v2:172.21.15.153:3300/0 conn(0x7f26780cd4b0 0x7f26780b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267dbfe700 1 -- 172.21.15.123:0/2440260995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26780b2d20 msgr2=0x7f26780b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267dbfe700 1 --2- 172.21.15.123:0/2440260995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26780b2d20 0x7f26780b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267dbfe700 1 -- 172.21.15.123:0/2440260995 >> v2:172.21.15.153:3300/0 conn(0x7f26780cd4b0 msgr2=0x7f26780b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267dbfe700 1 --2- 172.21.15.123:0/2440260995 >> v2:172.21.15.153:3300/0 conn(0x7f26780cd4b0 0x7f26780b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267dbfe700 1 -- 172.21.15.123:0/2440260995 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26780afa30 con 0x7f26780b2400 2024-09-13T17:09:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267dbfe700 1 --2- 172.21.15.123:0/2440260995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26780b2400 0x7f26780ccf70 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f26780c4480 tx=0x7f2674009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860401de4a1f792e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267cbfc700 1 -- 172.21.15.123:0/2440260995 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674011830 con 0x7f26780b2400 2024-09-13T17:09:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267cbfc700 1 -- 172.21.15.123:0/2440260995 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2674011990 con 0x7f26780b2400 2024-09-13T17:09:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267cbfc700 1 -- 172.21.15.123:0/2440260995 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674011d20 con 0x7f26780b2400 2024-09-13T17:09:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267ec00700 1 -- 172.21.15.123:0/2440260995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26780b2400 msgr2=0x7f26780ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267ec00700 1 --2- 172.21.15.123:0/2440260995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26780b2400 0x7f26780ccf70 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f26780c4480 tx=0x7f2674009bf0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267ec00700 1 -- 172.21.15.123:0/2440260995 shutdown_connections 2024-09-13T17:09:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267ec00700 1 --2- 172.21.15.123:0/2440260995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26780b2d20 0x7f26780b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267ec00700 1 --2- 172.21.15.123:0/2440260995 >> v2:172.21.15.153:3300/0 conn(0x7f26780cd4b0 0x7f26780b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267ec00700 1 --2- 172.21.15.123:0/2440260995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26780b2400 0x7f26780ccf70 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267ec00700 1 -- 172.21.15.123:0/2440260995 >> 172.21.15.123:0/2440260995 conn(0x7f267806a650 msgr2=0x7f267806aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267ec00700 1 -- 172.21.15.123:0/2440260995 shutdown_connections 2024-09-13T17:09:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.878+0000 7f267ec00700 1 -- 172.21.15.123:0/2440260995 wait complete. 2024-09-13T17:09:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267ec00700 1 Processor -- start 2024-09-13T17:09:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267ec00700 1 -- start start 2024-09-13T17:09:57.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267ec00700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26780b2400 0x7f2678150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267ec00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26780b2d20 0x7f267815da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267ec00700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26780cd4b0 0x7f2678153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267ec00700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26780c5e10 con 0x7f26780b2400 2024-09-13T17:09:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267ec00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26781513f0 con 0x7f26780b2d20 2024-09-13T17:09:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267ec00700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267815df80 con 0x7f26780cd4b0 2024-09-13T17:09:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267dbfe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26780b2400 0x7f2678150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267dbfe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26780b2400 0x7f2678150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60802/0 (socket says 172.21.15.123:60802) 2024-09-13T17:09:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267dbfe700 1 -- 172.21.15.123:0/118731852 learned_addr learned my addr 172.21.15.123:0/118731852 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267e3ff700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26780cd4b0 0x7f2678153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267d3fd700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26780b2d20 0x7f267815da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267dbfe700 1 -- 172.21.15.123:0/118731852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26780cd4b0 msgr2=0x7f2678153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267dbfe700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26780cd4b0 0x7f2678153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267dbfe700 1 -- 172.21.15.123:0/118731852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26780b2d20 msgr2=0x7f267815da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267dbfe700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26780b2d20 0x7f267815da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267dbfe700 1 -- 172.21.15.123:0/118731852 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2674009570 con 0x7f26780b2400 2024-09-13T17:09:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267d3fd700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26780b2d20 0x7f267815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.882+0000 7f267e3ff700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26780cd4b0 0x7f2678153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.886+0000 7f267dbfe700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26780b2400 0x7f2678150eb0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f26780ce0e0 tx=0x7f2674004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.886+0000 7f266e7fc700 1 -- 172.21.15.123:0/118731852 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674004510 con 0x7f26780b2400 2024-09-13T17:09:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.886+0000 7f266e7fc700 1 -- 172.21.15.123:0/118731852 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267401e070 con 0x7f26780b2400 2024-09-13T17:09:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.886+0000 7f267ec00700 1 -- 172.21.15.123:0/118731852 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2678152310 con 0x7f26780b2400 2024-09-13T17:09:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.886+0000 7f266e7fc700 1 -- 172.21.15.123:0/118731852 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674003900 con 0x7f26780b2400 2024-09-13T17:09:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.886+0000 7f267ec00700 1 -- 172.21.15.123:0/118731852 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26781528d0 con 0x7f26780b2400 2024-09-13T17:09:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.886+0000 7f267ec00700 1 -- 172.21.15.123:0/118731852 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26780677f0 con 0x7f26780b2400 2024-09-13T17:09:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.886+0000 7f266e7fc700 1 -- 172.21.15.123:0/118731852 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2674003a60 con 0x7f26780b2400 2024-09-13T17:09:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.886+0000 7f266e7fc700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f265c066730 0x7f265c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.886+0000 7f266e7fc700 1 -- 172.21.15.123:0/118731852 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2674084f90 con 0x7f26780b2400 2024-09-13T17:09:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.886+0000 7f267d3fd700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f265c066730 0x7f265c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.886+0000 7f267d3fd700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f265c066730 0x7f265c068bf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f26780c3f40 tx=0x7f2668008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:57.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:57.894+0000 7f266e7fc700 1 -- 172.21.15.123:0/118731852 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f26740b6db0 con 0x7f26780b2400 2024-09-13T17:09:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.066+0000 7f267ec00700 1 -- 172.21.15.123:0/118731852 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f26780cba40 con 0x7f26780b2400 2024-09-13T17:09:58.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.070+0000 7f266e7fc700 1 -- 172.21.15.123:0/118731852 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2674052660 con 0x7f26780b2400 2024-09-13T17:09:58.074 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:09:58.074 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-13T17:09:58.074 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:09:58.074 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-13T17:09:58.074 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-13T17:09:58.074 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:09:58.074 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-13T17:09:58.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.070+0000 7f267ec00700 1 -- 172.21.15.123:0/118731852 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f265c066730 msgr2=0x7f265c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.070+0000 7f267ec00700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f265c066730 0x7f265c068bf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f26780c3f40 tx=0x7f2668008040 comp rx=0 tx=0).stop 2024-09-13T17:09:58.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.070+0000 7f267ec00700 1 -- 172.21.15.123:0/118731852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26780b2400 msgr2=0x7f2678150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.070+0000 7f267ec00700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26780b2400 0x7f2678150eb0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f26780ce0e0 tx=0x7f2674004770 comp rx=0 tx=0).stop 2024-09-13T17:09:58.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.070+0000 7f267ec00700 1 -- 172.21.15.123:0/118731852 shutdown_connections 2024-09-13T17:09:58.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.070+0000 7f267ec00700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f265c066730 0x7f265c068bf0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.070+0000 7f267ec00700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26780cd4b0 0x7f2678153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.070+0000 7f267ec00700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26780b2d20 0x7f267815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.070+0000 7f267ec00700 1 --2- 172.21.15.123:0/118731852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26780b2400 0x7f2678150eb0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.070+0000 7f267ec00700 1 -- 172.21.15.123:0/118731852 >> 172.21.15.123:0/118731852 conn(0x7f267806a650 msgr2=0x7f26780b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:58.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.070+0000 7f267ec00700 1 -- 172.21.15.123:0/118731852 shutdown_connections 2024-09-13T17:09:58.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.070+0000 7f267ec00700 1 -- 172.21.15.123:0/118731852 wait complete. 2024-09-13T17:09:58.089 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:09:58.089 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:09:58.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.206+0000 7f91ee316700 1 Processor -- start 2024-09-13T17:09:58.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.206+0000 7f91ee316700 1 -- start start 2024-09-13T17:09:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ee316700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91e8160310 0x7f91e80d36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ee316700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f91e80d3220 0x7f91e80cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ee316700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e81606f0 con 0x7f91e80cfd90 2024-09-13T17:09:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ee316700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e80ce7b0 con 0x7f91e8160310 2024-09-13T17:09:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ee316700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e80cea90 con 0x7f91e80d3220 2024-09-13T17:09:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ed314700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91e8160310 0x7f91e80d36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ed314700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91e8160310 0x7f91e80d36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60818/0 (socket says 172.21.15.123:60818) 2024-09-13T17:09:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ed314700 1 -- 172.21.15.123:0/323364289 learned_addr learned my addr 172.21.15.123:0/323364289 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ecb13700 1 --2- 172.21.15.123:0/323364289 >> v2:172.21.15.153:3300/0 conn(0x7f91e80d3220 0x7f91e80cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ed314700 1 -- 172.21.15.123:0/323364289 >> v2:172.21.15.153:3300/0 conn(0x7f91e80d3220 msgr2=0x7f91e80cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ed314700 1 --2- 172.21.15.123:0/323364289 >> v2:172.21.15.153:3300/0 conn(0x7f91e80d3220 0x7f91e80cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ed314700 1 -- 172.21.15.123:0/323364289 >> v1:172.21.15.153:6789/0 conn(0x7f91e80cfd90 legacy=0x7f91e80d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ed314700 1 -- 172.21.15.123:0/323364289 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e80ced70 con 0x7f91e8160310 2024-09-13T17:09:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ed314700 1 --2- 172.21.15.123:0/323364289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91e8160310 0x7f91e80d36e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009910 tx=0x7f91d8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54f391f5326a74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91dffff700 1 -- 172.21.15.123:0/323364289 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d800ba20 con 0x7f91e8160310 2024-09-13T17:09:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91dffff700 1 -- 172.21.15.123:0/323364289 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d800bb80 con 0x7f91e8160310 2024-09-13T17:09:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91dffff700 1 -- 172.21.15.123:0/323364289 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8009e60 con 0x7f91e8160310 2024-09-13T17:09:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ee316700 1 -- 172.21.15.123:0/323364289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91e8160310 msgr2=0x7f91e80d36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ee316700 1 --2- 172.21.15.123:0/323364289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91e8160310 0x7f91e80d36e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009910 tx=0x7f91d8009c20 comp rx=0 tx=0).stop 2024-09-13T17:09:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ee316700 1 -- 172.21.15.123:0/323364289 shutdown_connections 2024-09-13T17:09:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ee316700 1 --2- 172.21.15.123:0/323364289 >> v2:172.21.15.153:3300/0 conn(0x7f91e80d3220 0x7f91e80cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ee316700 1 --2- 172.21.15.123:0/323364289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91e8160310 0x7f91e80d36e0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ee316700 1 -- 172.21.15.123:0/323364289 >> 172.21.15.123:0/323364289 conn(0x7f91e809be50 msgr2=0x7f91e80d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ee316700 1 -- 172.21.15.123:0/323364289 shutdown_connections 2024-09-13T17:09:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.210+0000 7f91ee316700 1 -- 172.21.15.123:0/323364289 wait complete. 2024-09-13T17:09:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ee316700 1 Processor -- start 2024-09-13T17:09:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ee316700 1 -- start start 2024-09-13T17:09:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ee316700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91e80cfd90 0x7f91e81f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ee316700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91e80d3220 0x7f91e8158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ee316700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91e8160310 0x7f91e80cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ee316700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80cacc0 con 0x7f91e80d3220 2024-09-13T17:09:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ee316700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e81f3080 con 0x7f91e8160310 2024-09-13T17:09:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ee316700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e81f3360 con 0x7f91e80cfd90 2024-09-13T17:09:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ecb13700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91e80d3220 0x7f91e8158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ecb13700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91e80d3220 0x7f91e8158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60820/0 (socket says 172.21.15.123:60820) 2024-09-13T17:09:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ecb13700 1 -- 172.21.15.123:0/424639828 learned_addr learned my addr 172.21.15.123:0/424639828 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91edb15700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91e8160310 0x7f91e80cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ed314700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91e80cfd90 0x7f91e81f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ecb13700 1 -- 172.21.15.123:0/424639828 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91e80cfd90 msgr2=0x7f91e81f2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ecb13700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91e80cfd90 0x7f91e81f2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ecb13700 1 -- 172.21.15.123:0/424639828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91e8160310 msgr2=0x7f91e80cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ecb13700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91e8160310 0x7f91e80cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ecb13700 1 -- 172.21.15.123:0/424639828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d8009570 con 0x7f91e80d3220 2024-09-13T17:09:58.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91edb15700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91e8160310 0x7f91e80cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:58.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ecb13700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91e80d3220 0x7f91e8158090 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f91e400e760 tx=0x7f91e400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:58.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ddffb700 1 -- 172.21.15.123:0/424639828 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4013610 con 0x7f91e80d3220 2024-09-13T17:09:58.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ddffb700 1 -- 172.21.15.123:0/424639828 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e4013770 con 0x7f91e80d3220 2024-09-13T17:09:58.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ee316700 1 -- 172.21.15.123:0/424639828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e81f3640 con 0x7f91e80d3220 2024-09-13T17:09:58.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ddffb700 1 -- 172.21.15.123:0/424639828 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4013ae0 con 0x7f91e80d3220 2024-09-13T17:09:58.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ee316700 1 -- 172.21.15.123:0/424639828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e80cc0d0 con 0x7f91e80d3220 2024-09-13T17:09:58.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.214+0000 7f91ee316700 1 -- 172.21.15.123:0/424639828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e80677f0 con 0x7f91e80d3220 2024-09-13T17:09:58.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.218+0000 7f91ddffb700 1 -- 172.21.15.123:0/424639828 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f91e4013c40 con 0x7f91e80d3220 2024-09-13T17:09:58.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.218+0000 7f91ddffb700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91cc066730 0x7f91cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.218+0000 7f91ed314700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91cc066730 0x7f91cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.218+0000 7f91ddffb700 1 -- 172.21.15.123:0/424639828 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f91e4083ef0 con 0x7f91e80d3220 2024-09-13T17:09:58.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.218+0000 7f91ed314700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91cc066730 0x7f91cc068bf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f91d8000c00 tx=0x7f91d8008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:58.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.222+0000 7f91ddffb700 1 -- 172.21.15.123:0/424639828 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f91e4051690 con 0x7f91e80d3220 2024-09-13T17:09:58.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.390+0000 7f91ee316700 1 -- 172.21.15.123:0/424639828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f91e80cf850 con 0x7f91e80d3220 2024-09-13T17:09:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.734+0000 7f91ddffb700 1 -- 172.21.15.123:0/424639828 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7f91e40210b0 con 0x7f91e80d3220 2024-09-13T17:09:58.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.742+0000 7f91ee316700 1 -- 172.21.15.123:0/424639828 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91cc066730 msgr2=0x7f91cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.742+0000 7f91ee316700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91cc066730 0x7f91cc068bf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f91d8000c00 tx=0x7f91d8008030 comp rx=0 tx=0).stop 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.742+0000 7f91ee316700 1 -- 172.21.15.123:0/424639828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91e80d3220 msgr2=0x7f91e8158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.742+0000 7f91ee316700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91e80d3220 0x7f91e8158090 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f91e400e760 tx=0x7f91e400eb20 comp rx=0 tx=0).stop 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.742+0000 7f91ee316700 1 -- 172.21.15.123:0/424639828 shutdown_connections 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.742+0000 7f91ee316700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f91cc066730 0x7f91cc068bf0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.742+0000 7f91ee316700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91e8160310 0x7f91e80cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.742+0000 7f91ee316700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91e80d3220 0x7f91e8158090 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.742+0000 7f91ee316700 1 --2- 172.21.15.123:0/424639828 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f91e80cfd90 0x7f91e81f2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.742+0000 7f91ee316700 1 -- 172.21.15.123:0/424639828 >> 172.21.15.123:0/424639828 conn(0x7f91e809be50 msgr2=0x7f91e80740a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.742+0000 7f91ee316700 1 -- 172.21.15.123:0/424639828 shutdown_connections 2024-09-13T17:09:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.742+0000 7f91ee316700 1 -- 172.21.15.123:0/424639828 wait complete. 2024-09-13T17:09:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-13T17:09:58.763 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:09:58.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f76575fa700 1 Processor -- start 2024-09-13T17:09:58.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f76575fa700 1 -- start start 2024-09-13T17:09:58.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f76575fa700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f76500cb670 0x7f76500cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f76575fa700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765015d090 0x7f76500ae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f76575fa700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76500aca60 con 0x7f765015ccb0 2024-09-13T17:09:58.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f76575fa700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76500ad9f0 con 0x7f76500cb670 2024-09-13T17:09:58.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f76575fa700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76500adee0 con 0x7f765015d090 2024-09-13T17:09:58.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7655396700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f765015ccb0 0x7f76500caf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40066/0 (socket says 172.21.15.123:40066) 2024-09-13T17:09:58.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7655396700 1 -- 172.21.15.123:0/2820869305 learned_addr learned my addr 172.21.15.123:0/2820869305 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7655b97700 1 --2- 172.21.15.123:0/2820869305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765015d090 0x7f76500ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7654b95700 1 --2- 172.21.15.123:0/2820869305 >> v2:172.21.15.153:3300/0 conn(0x7f76500cb670 0x7f76500cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7643fff700 1 -- 172.21.15.123:0/2820869305 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524393395 0 0) 0x7f76500aca60 con 0x7f765015ccb0 2024-09-13T17:09:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7643fff700 1 -- 172.21.15.123:0/2820869305 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f763c0035d0 con 0x7f765015ccb0 2024-09-13T17:09:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7655b97700 1 -- 172.21.15.123:0/2820869305 >> v2:172.21.15.153:3300/0 conn(0x7f76500cb670 msgr2=0x7f76500cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:09:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7655b97700 1 --2- 172.21.15.123:0/2820869305 >> v2:172.21.15.153:3300/0 conn(0x7f76500cb670 0x7f76500cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7655b97700 1 -- 172.21.15.123:0/2820869305 >> v1:172.21.15.123:6789/0 conn(0x7f765015ccb0 legacy=0x7f76500caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7655b97700 1 -- 172.21.15.123:0/2820869305 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500adc00 con 0x7f765015d090 2024-09-13T17:09:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7654b95700 1 --2- 172.21.15.123:0/2820869305 >> v2:172.21.15.153:3300/0 conn(0x7f76500cb670 0x7f76500cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:09:58.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7655b97700 1 --2- 172.21.15.123:0/2820869305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765015d090 0x7f76500ae270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7648009850 tx=0x7f7648009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4877a4c22be8444 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:58.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7643fff700 1 -- 172.21.15.123:0/2820869305 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648011830 con 0x7f765015d090 2024-09-13T17:09:58.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7643fff700 1 -- 172.21.15.123:0/2820869305 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7648011990 con 0x7f765015d090 2024-09-13T17:09:58.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.882+0000 7f7643fff700 1 -- 172.21.15.123:0/2820869305 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648011d00 con 0x7f765015d090 2024-09-13T17:09:58.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.886+0000 7f76575fa700 1 -- 172.21.15.123:0/2820869305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765015d090 msgr2=0x7f76500ae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.886+0000 7f76575fa700 1 --2- 172.21.15.123:0/2820869305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765015d090 0x7f76500ae270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7648009850 tx=0x7f7648009b60 comp rx=0 tx=0).stop 2024-09-13T17:09:58.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.886+0000 7f76575fa700 1 -- 172.21.15.123:0/2820869305 shutdown_connections 2024-09-13T17:09:58.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.886+0000 7f76575fa700 1 --2- 172.21.15.123:0/2820869305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765015d090 0x7f76500ae270 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.886+0000 7f76575fa700 1 --2- 172.21.15.123:0/2820869305 >> v2:172.21.15.153:3300/0 conn(0x7f76500cb670 0x7f76500cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.886+0000 7f76575fa700 1 -- 172.21.15.123:0/2820869305 >> 172.21.15.123:0/2820869305 conn(0x7f76500b0450 msgr2=0x7f76500b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:58.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.886+0000 7f76575fa700 1 -- 172.21.15.123:0/2820869305 shutdown_connections 2024-09-13T17:09:58.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.886+0000 7f76575fa700 1 -- 172.21.15.123:0/2820869305 wait complete. 2024-09-13T17:09:58.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.886+0000 7f76575fa700 1 Processor -- start 2024-09-13T17:09:58.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.886+0000 7f76575fa700 1 -- start start 2024-09-13T17:09:58.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f76575fa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76500cb670 0x7f765014ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f76575fa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f765015ccb0 0x7f76500b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f76575fa700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765015d090 0x7f76500b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f76575fa700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765015b6c0 con 0x7f76500cb670 2024-09-13T17:09:58.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f76575fa700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765014c300 con 0x7f765015ccb0 2024-09-13T17:09:58.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f76575fa700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76500c5ef0 con 0x7f765015d090 2024-09-13T17:09:58.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f7655396700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76500cb670 0x7f765014ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f7654b95700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f765015ccb0 0x7f76500b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f7655b97700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765015d090 0x7f76500b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f7655396700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76500cb670 0x7f765014ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60826/0 (socket says 172.21.15.123:60826) 2024-09-13T17:09:58.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f7655396700 1 -- 172.21.15.123:0/4286946725 learned_addr learned my addr 172.21.15.123:0/4286946725 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:58.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f7655396700 1 -- 172.21.15.123:0/4286946725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765015d090 msgr2=0x7f76500b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f7655396700 1 --2- 172.21.15.123:0/4286946725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765015d090 0x7f76500b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f7655396700 1 -- 172.21.15.123:0/4286946725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f765015ccb0 msgr2=0x7f76500b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:58.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f7655396700 1 --2- 172.21.15.123:0/4286946725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f765015ccb0 0x7f76500b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:58.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f7655396700 1 -- 172.21.15.123:0/4286946725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c009a70 con 0x7f76500cb670 2024-09-13T17:09:58.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f7655396700 1 --2- 172.21.15.123:0/4286946725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76500cb670 0x7f765014ba10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f764400c4f0 tx=0x7f764400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:58.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f7641ffb700 1 -- 172.21.15.123:0/4286946725 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644005d90 con 0x7f76500cb670 2024-09-13T17:09:58.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f7641ffb700 1 -- 172.21.15.123:0/4286946725 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76440070d0 con 0x7f76500cb670 2024-09-13T17:09:58.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f76575fa700 1 -- 172.21.15.123:0/4286946725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76480094b0 con 0x7f76500cb670 2024-09-13T17:09:58.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f7641ffb700 1 -- 172.21.15.123:0/4286946725 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644007440 con 0x7f76500cb670 2024-09-13T17:09:58.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.890+0000 7f76575fa700 1 -- 172.21.15.123:0/4286946725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765014c880 con 0x7f76500cb670 2024-09-13T17:09:58.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.894+0000 7f76575fa700 1 -- 172.21.15.123:0/4286946725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76500cce40 con 0x7f76500cb670 2024-09-13T17:09:58.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.894+0000 7f7641ffb700 1 -- 172.21.15.123:0/4286946725 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f76440075a0 con 0x7f76500cb670 2024-09-13T17:09:58.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.894+0000 7f7641ffb700 1 --2- 172.21.15.123:0/4286946725 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7634066730 0x7f7634068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:58.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.894+0000 7f7641ffb700 1 -- 172.21.15.123:0/4286946725 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f7644083230 con 0x7f76500cb670 2024-09-13T17:09:58.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.894+0000 7f7654b95700 1 --2- 172.21.15.123:0/4286946725 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7634066730 0x7f7634068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:58.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.894+0000 7f7654b95700 1 --2- 172.21.15.123:0/4286946725 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7634066730 0x7f7634068bf0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f764c009fd0 tx=0x7f764c00b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:58.902+0000 7f7641ffb700 1 -- 172.21.15.123:0/4286946725 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7644050830 con 0x7f76500cb670 2024-09-13T17:09:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.074+0000 7f76575fa700 1 -- 172.21.15.123:0/4286946725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7650160330 con 0x7f76500cb670 2024-09-13T17:09:59.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.746+0000 7f7641ffb700 1 -- 172.21.15.123:0/4286946725 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7644053e50 con 0x7f76500cb670 2024-09-13T17:09:59.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.758+0000 7f76575fa700 1 -- 172.21.15.123:0/4286946725 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7634066730 msgr2=0x7f7634068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:59.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.758+0000 7f76575fa700 1 --2- 172.21.15.123:0/4286946725 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7634066730 0x7f7634068bf0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f764c009fd0 tx=0x7f764c00b040 comp rx=0 tx=0).stop 2024-09-13T17:09:59.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.758+0000 7f76575fa700 1 -- 172.21.15.123:0/4286946725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76500cb670 msgr2=0x7f765014ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:59.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.758+0000 7f76575fa700 1 --2- 172.21.15.123:0/4286946725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76500cb670 0x7f765014ba10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f764400c4f0 tx=0x7f764400c800 comp rx=0 tx=0).stop 2024-09-13T17:09:59.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.758+0000 7f76575fa700 1 -- 172.21.15.123:0/4286946725 shutdown_connections 2024-09-13T17:09:59.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.758+0000 7f76575fa700 1 --2- 172.21.15.123:0/4286946725 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7634066730 0x7f7634068bf0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.758+0000 7f76575fa700 1 --2- 172.21.15.123:0/4286946725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f765015d090 0x7f76500b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.758+0000 7f76575fa700 1 --2- 172.21.15.123:0/4286946725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f765015ccb0 0x7f76500b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.758+0000 7f76575fa700 1 --2- 172.21.15.123:0/4286946725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76500cb670 0x7f765014ba10 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.758+0000 7f76575fa700 1 -- 172.21.15.123:0/4286946725 >> 172.21.15.123:0/4286946725 conn(0x7f76500b0450 msgr2=0x7f765006c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:59.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.758+0000 7f76575fa700 1 -- 172.21.15.123:0/4286946725 shutdown_connections 2024-09-13T17:09:59.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.758+0000 7f76575fa700 1 -- 172.21.15.123:0/4286946725 wait complete. 2024-09-13T17:09:59.765 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-13T17:09:59.777 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:09:59.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.882+0000 7f9e50867700 1 Processor -- start 2024-09-13T17:09:59.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.882+0000 7f9e50867700 1 -- start start 2024-09-13T17:09:59.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e50867700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e4c1592e0 0x7f9e4c15d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:59.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e50867700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4c0cd2e0 con 0x7f9e4c1596c0 2024-09-13T17:09:59.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e50867700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4c0cd5c0 con 0x7f9e4c06dc90 2024-09-13T17:09:59.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e50867700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c0cd8a0 con 0x7f9e4c1592e0 2024-09-13T17:09:59.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e4a59c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9e4c1596c0 0x7f9e4c15d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40072/0 (socket says 172.21.15.123:40072) 2024-09-13T17:09:59.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e4a59c700 1 -- 172.21.15.123:0/1497354656 learned_addr learned my addr 172.21.15.123:0/1497354656 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:09:59.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e4ad9d700 1 --2- 172.21.15.123:0/1497354656 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e4c1592e0 0x7f9e4c15d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:59.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e49d9b700 1 -- 172.21.15.123:0/1497354656 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335924395 0 0) 0x7f9e4c0cd2e0 con 0x7f9e4c1596c0 2024-09-13T17:09:59.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e49d9b700 1 -- 172.21.15.123:0/1497354656 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e340046e0 con 0x7f9e4c1596c0 2024-09-13T17:09:59.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e4ad9d700 1 -- 172.21.15.123:0/1497354656 >> v1:172.21.15.153:6789/0 conn(0x7f9e4c06dc90 legacy=0x7f9e4c070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:59.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e49d9b700 1 -- 172.21.15.123:0/1497354656 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031544188 0 0) 0x7f9e4c0cd5c0 con 0x7f9e4c06dc90 2024-09-13T17:09:59.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e4ad9d700 1 -- 172.21.15.123:0/1497354656 >> v1:172.21.15.123:6789/0 conn(0x7f9e4c1596c0 legacy=0x7f9e4c15d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:59.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e4ad9d700 1 -- 172.21.15.123:0/1497354656 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c0cdb80 con 0x7f9e4c1592e0 2024-09-13T17:09:59.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e4ad9d700 1 --2- 172.21.15.123:0/1497354656 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e4c1592e0 0x7f9e4c15d030 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009880 tx=0x7f9e40009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1054941a003c6feb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:59.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e49d9b700 1 -- 172.21.15.123:0/1497354656 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e40011830 con 0x7f9e4c1592e0 2024-09-13T17:09:59.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e49d9b700 1 -- 172.21.15.123:0/1497354656 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e40011990 con 0x7f9e4c1592e0 2024-09-13T17:09:59.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e49d9b700 1 -- 172.21.15.123:0/1497354656 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e40011d00 con 0x7f9e4c1592e0 2024-09-13T17:09:59.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.886+0000 7f9e50867700 1 -- 172.21.15.123:0/1497354656 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e4c1592e0 msgr2=0x7f9e4c15d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:59.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.890+0000 7f9e50867700 1 --2- 172.21.15.123:0/1497354656 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e4c1592e0 0x7f9e4c15d030 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009880 tx=0x7f9e40009b90 comp rx=0 tx=0).stop 2024-09-13T17:09:59.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.890+0000 7f9e50867700 1 -- 172.21.15.123:0/1497354656 shutdown_connections 2024-09-13T17:09:59.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.890+0000 7f9e50867700 1 --2- 172.21.15.123:0/1497354656 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e4c1592e0 0x7f9e4c15d030 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.890+0000 7f9e50867700 1 -- 172.21.15.123:0/1497354656 >> 172.21.15.123:0/1497354656 conn(0x7f9e4c0b01d0 msgr2=0x7f9e4c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:59.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.890+0000 7f9e50867700 1 -- 172.21.15.123:0/1497354656 shutdown_connections 2024-09-13T17:09:59.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.890+0000 7f9e50867700 1 -- 172.21.15.123:0/1497354656 wait complete. 2024-09-13T17:09:59.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.890+0000 7f9e50867700 1 Processor -- start 2024-09-13T17:09:59.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.890+0000 7f9e50867700 1 -- start start 2024-09-13T17:09:59.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e50867700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e4c06dc90 0x7f9e4c156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:59.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e50867700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c1592e0 0x7f9e4c0c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:59.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e50867700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e4c1596c0 0x7f9e4c071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:59.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e50867700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c1f2760 con 0x7f9e4c1592e0 2024-09-13T17:09:59.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e50867700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c156670 con 0x7f9e4c1596c0 2024-09-13T17:09:59.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e50867700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c1f22d0 con 0x7f9e4c06dc90 2024-09-13T17:09:59.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e4a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c1592e0 0x7f9e4c0c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:59.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e4a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c1592e0 0x7f9e4c0c6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60834/0 (socket says 172.21.15.123:60834) 2024-09-13T17:09:59.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e4a59c700 1 -- 172.21.15.123:0/43587860 learned_addr learned my addr 172.21.15.123:0/43587860 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:09:59.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e4ad9d700 1 --2- 172.21.15.123:0/43587860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e4c06dc90 0x7f9e4c156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:59.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e4b59e700 1 --2- 172.21.15.123:0/43587860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e4c1596c0 0x7f9e4c071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:59.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e4a59c700 1 -- 172.21.15.123:0/43587860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e4c06dc90 msgr2=0x7f9e4c156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:59.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e4a59c700 1 --2- 172.21.15.123:0/43587860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e4c06dc90 0x7f9e4c156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e4a59c700 1 -- 172.21.15.123:0/43587860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e4c1596c0 msgr2=0x7f9e4c071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:59.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e4a59c700 1 --2- 172.21.15.123:0/43587860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e4c1596c0 0x7f9e4c071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:59.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e4a59c700 1 -- 172.21.15.123:0/43587860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e400094b0 con 0x7f9e4c1592e0 2024-09-13T17:09:59.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e4a59c700 1 --2- 172.21.15.123:0/43587860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c1592e0 0x7f9e4c0c6e20 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00caa0 tx=0x7f9e3c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:59.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e337fe700 1 -- 172.21.15.123:0/43587860 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c007480 con 0x7f9e4c1592e0 2024-09-13T17:09:59.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e50867700 1 -- 172.21.15.123:0/43587860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4c1ef190 con 0x7f9e4c1592e0 2024-09-13T17:09:59.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e337fe700 1 -- 172.21.15.123:0/43587860 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c007600 con 0x7f9e4c1592e0 2024-09-13T17:09:59.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e50867700 1 -- 172.21.15.123:0/43587860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c1f1c80 con 0x7f9e4c1592e0 2024-09-13T17:09:59.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.894+0000 7f9e337fe700 1 -- 172.21.15.123:0/43587860 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c007970 con 0x7f9e4c1592e0 2024-09-13T17:09:59.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.898+0000 7f9e50867700 1 -- 172.21.15.123:0/43587860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4c0cb100 con 0x7f9e4c1592e0 2024-09-13T17:09:59.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.898+0000 7f9e337fe700 1 -- 172.21.15.123:0/43587860 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9e3c01b3b0 con 0x7f9e4c1592e0 2024-09-13T17:09:59.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.898+0000 7f9e337fe700 1 --2- 172.21.15.123:0/43587860 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e38066730 0x7f9e38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:59.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.898+0000 7f9e4ad9d700 1 --2- 172.21.15.123:0/43587860 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e38066730 0x7f9e38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:59.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.898+0000 7f9e337fe700 1 -- 172.21.15.123:0/43587860 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f9e3c0838e0 con 0x7f9e4c1592e0 2024-09-13T17:09:59.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.898+0000 7f9e4ad9d700 1 --2- 172.21.15.123:0/43587860 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e38066730 0x7f9e38068bf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9e400097d0 tx=0x7f9e40010000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:59.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:09:59.906+0000 7f9e337fe700 1 -- 172.21.15.123:0/43587860 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9e3c050cd0 con 0x7f9e4c1592e0 2024-09-13T17:10:00.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.110+0000 7f9e50867700 1 -- 172.21.15.123:0/43587860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9e4c0b4600 con 0x7f9e4c1592e0 2024-09-13T17:10:00.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.122+0000 7f9e337fe700 1 -- 172.21.15.123:0/43587860 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v39) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9e3c0542f0 con 0x7f9e4c1592e0 2024-09-13T17:10:00.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.126+0000 7f9e50867700 1 -- 172.21.15.123:0/43587860 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e38066730 msgr2=0x7f9e38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.126+0000 7f9e50867700 1 --2- 172.21.15.123:0/43587860 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e38066730 0x7f9e38068bf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9e400097d0 tx=0x7f9e40010000 comp rx=0 tx=0).stop 2024-09-13T17:10:00.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.126+0000 7f9e50867700 1 -- 172.21.15.123:0/43587860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c1592e0 msgr2=0x7f9e4c0c6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.126+0000 7f9e50867700 1 --2- 172.21.15.123:0/43587860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c1592e0 0x7f9e4c0c6e20 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00caa0 tx=0x7f9e3c00cad0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.130+0000 7f9e50867700 1 -- 172.21.15.123:0/43587860 shutdown_connections 2024-09-13T17:10:00.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.130+0000 7f9e50867700 1 --2- 172.21.15.123:0/43587860 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9e38066730 0x7f9e38068bf0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.130+0000 7f9e50867700 1 --2- 172.21.15.123:0/43587860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e4c1596c0 0x7f9e4c071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.130+0000 7f9e50867700 1 --2- 172.21.15.123:0/43587860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c1592e0 0x7f9e4c0c6e20 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.130+0000 7f9e50867700 1 --2- 172.21.15.123:0/43587860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9e4c06dc90 0x7f9e4c156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.130+0000 7f9e50867700 1 -- 172.21.15.123:0/43587860 >> 172.21.15.123:0/43587860 conn(0x7f9e4c0b01d0 msgr2=0x7f9e4c157a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:00.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.130+0000 7f9e50867700 1 -- 172.21.15.123:0/43587860 shutdown_connections 2024-09-13T17:10:00.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.130+0000 7f9e50867700 1 -- 172.21.15.123:0/43587860 wait complete. 2024-09-13T17:10:00.144 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 12 and data pool 13 2024-09-13T17:10:00.161 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:00.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.254+0000 7fe8a3fff700 1 Processor -- start 2024-09-13T17:10:00.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.254+0000 7fe8a3fff700 1 -- start start 2024-09-13T17:10:00.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8a415ac60 0x7fe8a40af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8a40afea0 0x7fe8a40cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a3fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a40ce190 con 0x7fe8a40afa60 2024-09-13T17:10:00.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a3fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a40cd610 con 0x7fe8a40afea0 2024-09-13T17:10:00.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40cd8f0 con 0x7fe8a415ac60 2024-09-13T17:10:00.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a27fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe8a40afa60 0x7fe8a40ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40082/0 (socket says 172.21.15.123:40082) 2024-09-13T17:10:00.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a27fc700 1 -- 172.21.15.123:0/1416112246 learned_addr learned my addr 172.21.15.123:0/1416112246 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:00.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a2ffd700 1 --2- 172.21.15.123:0/1416112246 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8a415ac60 0x7fe8a40af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a37fe700 1 --2- 172.21.15.123:0/1416112246 >> v2:172.21.15.153:3300/0 conn(0x7fe8a40afea0 0x7fe8a40cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a1ffb700 1 -- 172.21.15.123:0/1416112246 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417220044 0 0) 0x7fe8a40ce190 con 0x7fe8a40afa60 2024-09-13T17:10:00.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a1ffb700 1 -- 172.21.15.123:0/1416112246 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe88c0035d0 con 0x7fe8a40afa60 2024-09-13T17:10:00.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a2ffd700 1 -- 172.21.15.123:0/1416112246 >> v2:172.21.15.153:3300/0 conn(0x7fe8a40afea0 msgr2=0x7fe8a40cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:00.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a2ffd700 1 --2- 172.21.15.123:0/1416112246 >> v2:172.21.15.153:3300/0 conn(0x7fe8a40afea0 0x7fe8a40cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a2ffd700 1 -- 172.21.15.123:0/1416112246 >> v1:172.21.15.123:6789/0 conn(0x7fe8a40afa60 legacy=0x7fe8a40ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a2ffd700 1 -- 172.21.15.123:0/1416112246 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40cdbd0 con 0x7fe8a415ac60 2024-09-13T17:10:00.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a37fe700 1 --2- 172.21.15.123:0/1416112246 >> v2:172.21.15.153:3300/0 conn(0x7fe8a40afea0 0x7fe8a40cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:00.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a2ffd700 1 --2- 172.21.15.123:0/1416112246 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8a415ac60 0x7fe8a40af520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe894009880 tx=0x7fe894009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6e638cdada1a4f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:00.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a1ffb700 1 -- 172.21.15.123:0/1416112246 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894011830 con 0x7fe8a415ac60 2024-09-13T17:10:00.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a1ffb700 1 -- 172.21.15.123:0/1416112246 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe894011990 con 0x7fe8a415ac60 2024-09-13T17:10:00.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a1ffb700 1 -- 172.21.15.123:0/1416112246 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894011d00 con 0x7fe8a415ac60 2024-09-13T17:10:00.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a3fff700 1 -- 172.21.15.123:0/1416112246 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8a415ac60 msgr2=0x7fe8a40af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a3fff700 1 --2- 172.21.15.123:0/1416112246 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8a415ac60 0x7fe8a40af520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe894009880 tx=0x7fe894009b90 comp rx=0 tx=0).stop 2024-09-13T17:10:00.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a3fff700 1 -- 172.21.15.123:0/1416112246 shutdown_connections 2024-09-13T17:10:00.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a3fff700 1 --2- 172.21.15.123:0/1416112246 >> v2:172.21.15.153:3300/0 conn(0x7fe8a40afea0 0x7fe8a40cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a3fff700 1 --2- 172.21.15.123:0/1416112246 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8a415ac60 0x7fe8a40af520 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a3fff700 1 -- 172.21.15.123:0/1416112246 >> 172.21.15.123:0/1416112246 conn(0x7fe8a40b24c0 msgr2=0x7fe8a40b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:00.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a3fff700 1 -- 172.21.15.123:0/1416112246 shutdown_connections 2024-09-13T17:10:00.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.258+0000 7fe8a3fff700 1 -- 172.21.15.123:0/1416112246 wait complete. 2024-09-13T17:10:00.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a3fff700 1 Processor -- start 2024-09-13T17:10:00.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a3fff700 1 -- start start 2024-09-13T17:10:00.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a40afa60 0x7fe8a4158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8a40afea0 0x7fe8a40c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8a415ac60 0x7fe8a40c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a3fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40c5520 con 0x7fe8a40afa60 2024-09-13T17:10:00.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40c4480 con 0x7fe8a415ac60 2024-09-13T17:10:00.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40c4760 con 0x7fe8a40afea0 2024-09-13T17:10:00.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a40afa60 0x7fe8a4158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a40afa60 0x7fe8a4158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60838/0 (socket says 172.21.15.123:60838) 2024-09-13T17:10:00.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a2ffd700 1 -- 172.21.15.123:0/745410755 learned_addr learned my addr 172.21.15.123:0/745410755 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:00.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a27fc700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8a40afea0 0x7fe8a40c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a37fe700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8a415ac60 0x7fe8a40c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a2ffd700 1 -- 172.21.15.123:0/745410755 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8a40afea0 msgr2=0x7fe8a40c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a2ffd700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8a40afea0 0x7fe8a40c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a2ffd700 1 -- 172.21.15.123:0/745410755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8a415ac60 msgr2=0x7fe8a40c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a2ffd700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8a415ac60 0x7fe8a40c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a2ffd700 1 -- 172.21.15.123:0/745410755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c009a70 con 0x7fe8a40afa60 2024-09-13T17:10:00.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a37fe700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8a415ac60 0x7fe8a40c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:00.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a2ffd700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a40afa60 0x7fe8a4158b20 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fe894014040 tx=0x7fe894004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:00.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe88b7fe700 1 -- 172.21.15.123:0/745410755 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894004550 con 0x7fe8a40afa60 2024-09-13T17:10:00.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe88b7fe700 1 -- 172.21.15.123:0/745410755 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89401e070 con 0x7fe8a40afa60 2024-09-13T17:10:00.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe88b7fe700 1 -- 172.21.15.123:0/745410755 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8940038c0 con 0x7fe8a40afa60 2024-09-13T17:10:00.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a3fff700 1 -- 172.21.15.123:0/745410755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8940094b0 con 0x7fe8a40afa60 2024-09-13T17:10:00.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a3fff700 1 -- 172.21.15.123:0/745410755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a40c4d20 con 0x7fe8a40afa60 2024-09-13T17:10:00.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.262+0000 7fe8a3fff700 1 -- 172.21.15.123:0/745410755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a40b3100 con 0x7fe8a40afa60 2024-09-13T17:10:00.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.266+0000 7fe88b7fe700 1 -- 172.21.15.123:0/745410755 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe894003a20 con 0x7fe8a40afa60 2024-09-13T17:10:00.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.266+0000 7fe88b7fe700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe890066730 0x7fe890068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.266+0000 7fe88b7fe700 1 -- 172.21.15.123:0/745410755 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe894085270 con 0x7fe8a40afa60 2024-09-13T17:10:00.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.266+0000 7fe8a27fc700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe890066730 0x7fe890068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.266+0000 7fe8a27fc700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe890066730 0x7fe890068bf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4159990 tx=0x7fe898009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:00.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.270+0000 7fe88b7fe700 1 -- 172.21.15.123:0/745410755 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe894052750 con 0x7fe8a40afa60 2024-09-13T17:10:00.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.442+0000 7fe8a3fff700 1 -- 172.21.15.123:0/745410755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8a40d1630 con 0x7fe8a40afa60 2024-09-13T17:10:00.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.446+0000 7fe88b7fe700 1 -- 172.21.15.123:0/745410755 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16621 (secure 0 0 0) 0x7fe894055d70 con 0x7fe8a40afa60 2024-09-13T17:10:00.450 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:00.450 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":85,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:00.115349+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:58.436099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:59.120652+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:00.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.446+0000 7fe8a3fff700 1 -- 172.21.15.123:0/745410755 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe890066730 msgr2=0x7fe890068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.446+0000 7fe8a3fff700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe890066730 0x7fe890068bf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4159990 tx=0x7fe898009040 comp rx=0 tx=0).stop 2024-09-13T17:10:00.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.446+0000 7fe8a3fff700 1 -- 172.21.15.123:0/745410755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a40afa60 msgr2=0x7fe8a4158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.446+0000 7fe8a3fff700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a40afa60 0x7fe8a4158b20 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fe894014040 tx=0x7fe894004770 comp rx=0 tx=0).stop 2024-09-13T17:10:00.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.446+0000 7fe8a3fff700 1 -- 172.21.15.123:0/745410755 shutdown_connections 2024-09-13T17:10:00.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.446+0000 7fe8a3fff700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe890066730 0x7fe890068bf0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.446+0000 7fe8a3fff700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8a415ac60 0x7fe8a40c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.446+0000 7fe8a3fff700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe8a40afea0 0x7fe8a40c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.446+0000 7fe8a3fff700 1 --2- 172.21.15.123:0/745410755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8a40afa60 0x7fe8a4158b20 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.446+0000 7fe8a3fff700 1 -- 172.21.15.123:0/745410755 >> 172.21.15.123:0/745410755 conn(0x7fe8a40b24c0 msgr2=0x7fe8a40b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:00.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.446+0000 7fe8a3fff700 1 -- 172.21.15.123:0/745410755 shutdown_connections 2024-09-13T17:10:00.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.446+0000 7fe8a3fff700 1 -- 172.21.15.123:0/745410755 wait complete. 2024-09-13T17:10:00.467 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.558+0000 7f2e70864700 1 Processor -- start 2024-09-13T17:10:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.558+0000 7f2e70864700 1 -- start start 2024-09-13T17:10:00.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e70864700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6c15ca10 0x7f2e6c06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e70864700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2e6c06a970 0x7f2e6c0b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e70864700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6c0ae7a0 con 0x7f2e6c0b1580 2024-09-13T17:10:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e70864700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6c0711f0 con 0x7f2e6c06a970 2024-09-13T17:10:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e70864700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c0714d0 con 0x7f2e6c15ca10 2024-09-13T17:10:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e6bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2e6c06a970 0x7f2e6c0b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e6bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2e6c06a970 0x7f2e6c0b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60854/0 (socket says 172.21.15.123:60854) 2024-09-13T17:10:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e6bfff700 1 -- 172.21.15.123:0/831154019 learned_addr learned my addr 172.21.15.123:0/831154019 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e6b7fe700 1 --2- 172.21.15.123:0/831154019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6c15ca10 0x7f2e6c06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e6bfff700 1 -- 172.21.15.123:0/831154019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6c15ca10 msgr2=0x7f2e6c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e6bfff700 1 --2- 172.21.15.123:0/831154019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6c15ca10 0x7f2e6c06c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e6bfff700 1 -- 172.21.15.123:0/831154019 >> v1:172.21.15.153:6789/0 conn(0x7f2e6c0b1580 legacy=0x7f2e6c06a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e6bfff700 1 -- 172.21.15.123:0/831154019 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c0717b0 con 0x7f2e6c06a970 2024-09-13T17:10:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e6b7fe700 1 --2- 172.21.15.123:0/831154019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6c15ca10 0x7f2e6c06c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e6bfff700 1 --2- 172.21.15.123:0/831154019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6c06a970 0x7f2e6c0b2970 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009e50 tx=0x7f2e6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5253eadac0526 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:00.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e6affd700 1 -- 172.21.15.123:0/831154019 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6400e070 con 0x7f2e6c06a970 2024-09-13T17:10:00.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e6affd700 1 -- 172.21.15.123:0/831154019 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6400b9c0 con 0x7f2e6c06a970 2024-09-13T17:10:00.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e6affd700 1 -- 172.21.15.123:0/831154019 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6400bd70 con 0x7f2e6c06a970 2024-09-13T17:10:00.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e70864700 1 -- 172.21.15.123:0/831154019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6c06a970 msgr2=0x7f2e6c0b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e70864700 1 --2- 172.21.15.123:0/831154019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6c06a970 0x7f2e6c0b2970 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009e50 tx=0x7f2e6400b330 comp rx=0 tx=0).stop 2024-09-13T17:10:00.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e70864700 1 -- 172.21.15.123:0/831154019 shutdown_connections 2024-09-13T17:10:00.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e70864700 1 --2- 172.21.15.123:0/831154019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6c06a970 0x7f2e6c0b2970 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e70864700 1 --2- 172.21.15.123:0/831154019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6c15ca10 0x7f2e6c06c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e70864700 1 -- 172.21.15.123:0/831154019 >> 172.21.15.123:0/831154019 conn(0x7f2e6c06fa10 msgr2=0x7f2e6c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:00.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e70864700 1 -- 172.21.15.123:0/831154019 shutdown_connections 2024-09-13T17:10:00.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.562+0000 7f2e70864700 1 -- 172.21.15.123:0/831154019 wait complete. 2024-09-13T17:10:00.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e70864700 1 Processor -- start 2024-09-13T17:10:00.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e70864700 1 -- start start 2024-09-13T17:10:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e70864700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e6c06a970 0x7f2e6c151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e70864700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6c0b1580 0x7f2e6c153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e70864700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6c15ca10 0x7f2e6c1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e70864700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c153ee0 con 0x7f2e6c15ca10 2024-09-13T17:10:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e70864700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c1541c0 con 0x7f2e6c06a970 2024-09-13T17:10:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e70864700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c1544a0 con 0x7f2e6c0b1580 2024-09-13T17:10:00.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e6bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6c15ca10 0x7f2e6c1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e6bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6c15ca10 0x7f2e6c1559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60856/0 (socket says 172.21.15.123:60856) 2024-09-13T17:10:00.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e6bfff700 1 -- 172.21.15.123:0/1657312940 learned_addr learned my addr 172.21.15.123:0/1657312940 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:00.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e6b7fe700 1 --2- 172.21.15.123:0/1657312940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e6c06a970 0x7f2e6c151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e63fff700 1 --2- 172.21.15.123:0/1657312940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6c0b1580 0x7f2e6c153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e6bfff700 1 -- 172.21.15.123:0/1657312940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6c0b1580 msgr2=0x7f2e6c153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e6bfff700 1 --2- 172.21.15.123:0/1657312940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6c0b1580 0x7f2e6c153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e6bfff700 1 -- 172.21.15.123:0/1657312940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e6c06a970 msgr2=0x7f2e6c151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e6bfff700 1 --2- 172.21.15.123:0/1657312940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e6c06a970 0x7f2e6c151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.566+0000 7f2e6bfff700 1 -- 172.21.15.123:0/1657312940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64009b30 con 0x7f2e6c15ca10 2024-09-13T17:10:00.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.570+0000 7f2e6bfff700 1 --2- 172.21.15.123:0/1657312940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6c15ca10 0x7f2e6c1559f0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c072210 tx=0x7f2e64004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:00.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.570+0000 7f2e68ff9700 1 -- 172.21.15.123:0/1657312940 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640048c0 con 0x7f2e6c15ca10 2024-09-13T17:10:00.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.570+0000 7f2e68ff9700 1 -- 172.21.15.123:0/1657312940 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e640099b0 con 0x7f2e6c15ca10 2024-09-13T17:10:00.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.570+0000 7f2e70864700 1 -- 172.21.15.123:0/1657312940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6c154780 con 0x7f2e6c15ca10 2024-09-13T17:10:00.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.570+0000 7f2e68ff9700 1 -- 172.21.15.123:0/1657312940 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6401c680 con 0x7f2e6c15ca10 2024-09-13T17:10:00.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.570+0000 7f2e70864700 1 -- 172.21.15.123:0/1657312940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6c1521f0 con 0x7f2e6c15ca10 2024-09-13T17:10:00.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.570+0000 7f2e70864700 1 -- 172.21.15.123:0/1657312940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6c0b32d0 con 0x7f2e6c15ca10 2024-09-13T17:10:00.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.570+0000 7f2e68ff9700 1 -- 172.21.15.123:0/1657312940 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2e6401c7e0 con 0x7f2e6c15ca10 2024-09-13T17:10:00.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.574+0000 7f2e68ff9700 1 --2- 172.21.15.123:0/1657312940 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e4c066730 0x7f2e4c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.574+0000 7f2e6b7fe700 1 --2- 172.21.15.123:0/1657312940 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e4c066730 0x7f2e4c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.574+0000 7f2e68ff9700 1 -- 172.21.15.123:0/1657312940 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e64085cc0 con 0x7f2e6c15ca10 2024-09-13T17:10:00.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.574+0000 7f2e6b7fe700 1 --2- 172.21.15.123:0/1657312940 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e4c066730 0x7f2e4c068bf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00c960 tx=0x7f2e5c008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.578+0000 7f2e68ff9700 1 -- 172.21.15.123:0/1657312940 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2e640531c0 con 0x7f2e6c15ca10 2024-09-13T17:10:00.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.750+0000 7f2e70864700 1 -- 172.21.15.123:0/1657312940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e6c154c40 con 0x7f2e6c15ca10 2024-09-13T17:10:00.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.750+0000 7f2e68ff9700 1 -- 172.21.15.123:0/1657312940 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16621 (secure 0 0 0) 0x7f2e640567e0 con 0x7f2e6c15ca10 2024-09-13T17:10:00.758 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:00.758 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":85,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:00.115349+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:58.436099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:59.120652+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:00.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.754+0000 7f2e70864700 1 -- 172.21.15.123:0/1657312940 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e4c066730 msgr2=0x7f2e4c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.754+0000 7f2e70864700 1 --2- 172.21.15.123:0/1657312940 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e4c066730 0x7f2e4c068bf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00c960 tx=0x7f2e5c008040 comp rx=0 tx=0).stop 2024-09-13T17:10:00.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.754+0000 7f2e70864700 1 -- 172.21.15.123:0/1657312940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6c15ca10 msgr2=0x7f2e6c1559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.754+0000 7f2e70864700 1 --2- 172.21.15.123:0/1657312940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6c15ca10 0x7f2e6c1559f0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c072210 tx=0x7f2e64004af0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.754+0000 7f2e70864700 1 -- 172.21.15.123:0/1657312940 shutdown_connections 2024-09-13T17:10:00.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.754+0000 7f2e70864700 1 --2- 172.21.15.123:0/1657312940 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e4c066730 0x7f2e4c068bf0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.754+0000 7f2e70864700 1 --2- 172.21.15.123:0/1657312940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6c15ca10 0x7f2e6c1559f0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.754+0000 7f2e70864700 1 --2- 172.21.15.123:0/1657312940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e6c0b1580 0x7f2e6c153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.754+0000 7f2e70864700 1 --2- 172.21.15.123:0/1657312940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e6c06a970 0x7f2e6c151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.754+0000 7f2e70864700 1 -- 172.21.15.123:0/1657312940 >> 172.21.15.123:0/1657312940 conn(0x7f2e6c06fa10 msgr2=0x7f2e6c0ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:00.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.754+0000 7f2e70864700 1 -- 172.21.15.123:0/1657312940 shutdown_connections 2024-09-13T17:10:00.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.754+0000 7f2e70864700 1 -- 172.21.15.123:0/1657312940 wait complete. 2024-09-13T17:10:00.773 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:10:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.882+0000 7f96e7003700 1 Processor -- start 2024-09-13T17:10:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.882+0000 7f96e7003700 1 -- start start 2024-09-13T17:10:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e7003700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96e006dc70 0x7f96e00b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e7003700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e00cc030 con 0x7f96e0071760 2024-09-13T17:10:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e7003700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e00b2e60 con 0x7f96e01597c0 2024-09-13T17:10:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e7003700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00b17d0 con 0x7f96e006dc70 2024-09-13T17:10:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e5800700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f96e0071760 0x7f96e00cc780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40084/0 (socket says 172.21.15.123:40084) 2024-09-13T17:10:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e5800700 1 -- 172.21.15.123:0/3367108192 learned_addr learned my addr 172.21.15.123:0/3367108192 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e6802700 1 --2- 172.21.15.123:0/3367108192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96e006dc70 0x7f96e00b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e4fff700 1 -- 172.21.15.123:0/3367108192 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440031595 0 0) 0x7f96e00cc030 con 0x7f96e0071760 2024-09-13T17:10:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e4fff700 1 -- 172.21.15.123:0/3367108192 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96cc0035d0 con 0x7f96e0071760 2024-09-13T17:10:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e4fff700 1 -- 172.21.15.123:0/3367108192 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906792265 0 0) 0x7f96e00b2e60 con 0x7f96e01597c0 2024-09-13T17:10:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e4fff700 1 -- 172.21.15.123:0/3367108192 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96e00cc030 con 0x7f96e01597c0 2024-09-13T17:10:00.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e4fff700 1 -- 172.21.15.123:0/3367108192 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3315294008 0 0) 0x7f96cc0035d0 con 0x7f96e0071760 2024-09-13T17:10:00.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e6802700 1 -- 172.21.15.123:0/3367108192 >> v1:172.21.15.153:6789/0 conn(0x7f96e01597c0 legacy=0x7f96e0071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e6802700 1 -- 172.21.15.123:0/3367108192 >> v1:172.21.15.123:6789/0 conn(0x7f96e0071760 legacy=0x7f96e00cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e6802700 1 -- 172.21.15.123:0/3367108192 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00b25c0 con 0x7f96e006dc70 2024-09-13T17:10:00.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e6802700 1 --2- 172.21.15.123:0/3367108192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96e006dc70 0x7f96e00b1f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009dc0 tx=0x7f96d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=657ab3be1f73df42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:00.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e4fff700 1 -- 172.21.15.123:0/3367108192 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d800e070 con 0x7f96e006dc70 2024-09-13T17:10:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e4fff700 1 -- 172.21.15.123:0/3367108192 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d8003a40 con 0x7f96e006dc70 2024-09-13T17:10:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e4fff700 1 -- 172.21.15.123:0/3367108192 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0001670 con 0x7f96e006dc70 2024-09-13T17:10:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e7003700 1 -- 172.21.15.123:0/3367108192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96e006dc70 msgr2=0x7f96e00b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e7003700 1 --2- 172.21.15.123:0/3367108192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96e006dc70 0x7f96e00b1f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009dc0 tx=0x7f96d800b330 comp rx=0 tx=0).stop 2024-09-13T17:10:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e7003700 1 -- 172.21.15.123:0/3367108192 shutdown_connections 2024-09-13T17:10:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e7003700 1 --2- 172.21.15.123:0/3367108192 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96e006dc70 0x7f96e00b1f30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e7003700 1 -- 172.21.15.123:0/3367108192 >> 172.21.15.123:0/3367108192 conn(0x7f96e006f940 msgr2=0x7f96e00b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e7003700 1 -- 172.21.15.123:0/3367108192 shutdown_connections 2024-09-13T17:10:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.886+0000 7f96e7003700 1 -- 172.21.15.123:0/3367108192 wait complete. 2024-09-13T17:10:00.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e7003700 1 Processor -- start 2024-09-13T17:10:00.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e7003700 1 -- start start 2024-09-13T17:10:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e7003700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e006dc70 0x7f96e014add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e7003700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96e0071760 0x7f96e01e3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e7003700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96e01597c0 0x7f96e01e3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e7003700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01f5f50 con 0x7f96e006dc70 2024-09-13T17:10:00.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e7003700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01f6230 con 0x7f96e01597c0 2024-09-13T17:10:00.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e7003700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01f6510 con 0x7f96e0071760 2024-09-13T17:10:00.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e6001700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e006dc70 0x7f96e014add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e6001700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e006dc70 0x7f96e014add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60872/0 (socket says 172.21.15.123:60872) 2024-09-13T17:10:00.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e6001700 1 -- 172.21.15.123:0/1558305573 learned_addr learned my addr 172.21.15.123:0/1558305573 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:00.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e5800700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96e0071760 0x7f96e01e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e6802700 1 --2- 172.21.15.123:0/1558305573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96e01597c0 0x7f96e01e3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e6001700 1 -- 172.21.15.123:0/1558305573 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96e0071760 msgr2=0x7f96e01e3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e6001700 1 --2- 172.21.15.123:0/1558305573 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96e0071760 0x7f96e01e3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e6001700 1 -- 172.21.15.123:0/1558305573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96e01597c0 msgr2=0x7f96e01e3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e6001700 1 --2- 172.21.15.123:0/1558305573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96e01597c0 0x7f96e01e3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e6001700 1 -- 172.21.15.123:0/1558305573 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d8009a70 con 0x7f96e006dc70 2024-09-13T17:10:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e6001700 1 --2- 172.21.15.123:0/1558305573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e006dc70 0x7f96e014add0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c730 tx=0x7f96dc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96d67fc700 1 -- 172.21.15.123:0/1558305573 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0052d0 con 0x7f96e006dc70 2024-09-13T17:10:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96d67fc700 1 -- 172.21.15.123:0/1558305573 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc005450 con 0x7f96e006dc70 2024-09-13T17:10:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96d67fc700 1 -- 172.21.15.123:0/1558305573 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0038e0 con 0x7f96e006dc70 2024-09-13T17:10:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e7003700 1 -- 172.21.15.123:0/1558305573 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e01f67f0 con 0x7f96e006dc70 2024-09-13T17:10:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.890+0000 7f96e7003700 1 -- 172.21.15.123:0/1558305573 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e014bd60 con 0x7f96e006dc70 2024-09-13T17:10:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.894+0000 7f96d67fc700 1 -- 172.21.15.123:0/1558305573 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f96dc003a40 con 0x7f96e006dc70 2024-09-13T17:10:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.894+0000 7f96e7003700 1 -- 172.21.15.123:0/1558305573 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e014bef0 con 0x7f96e006dc70 2024-09-13T17:10:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.894+0000 7f96d67fc700 1 --2- 172.21.15.123:0/1558305573 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f96c4066730 0x7f96c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:00.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.894+0000 7f96d67fc700 1 -- 172.21.15.123:0/1558305573 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96dc0835a0 con 0x7f96e006dc70 2024-09-13T17:10:00.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.894+0000 7f96e5800700 1 --2- 172.21.15.123:0/1558305573 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f96c4066730 0x7f96c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:00.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.894+0000 7f96e5800700 1 --2- 172.21.15.123:0/1558305573 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f96c4066730 0x7f96c4068bf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f96e0074960 tx=0x7f96d0001d60 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:00.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:00.902+0000 7f96d67fc700 1 -- 172.21.15.123:0/1558305573 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f96dc050910 con 0x7f96e006dc70 2024-09-13T17:10:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.110+0000 7f96e7003700 1 -- 172.21.15.123:0/1558305573 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f96e01f6090 con 0x7f96e006dc70 2024-09-13T17:10:01.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.134+0000 7f96d67fc700 1 -- 172.21.15.123:0/1558305573 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v40) v1 ==== 118+0+0 (secure 0 0 0) 0x7f96e01f6090 con 0x7f96e006dc70 2024-09-13T17:10:01.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.138+0000 7f96e7003700 1 -- 172.21.15.123:0/1558305573 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f96c4066730 msgr2=0x7f96c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:01.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.138+0000 7f96e7003700 1 --2- 172.21.15.123:0/1558305573 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f96c4066730 0x7f96c4068bf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f96e0074960 tx=0x7f96d0001d60 comp rx=0 tx=0).stop 2024-09-13T17:10:01.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.138+0000 7f96e7003700 1 -- 172.21.15.123:0/1558305573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e006dc70 msgr2=0x7f96e014add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:01.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.138+0000 7f96e7003700 1 --2- 172.21.15.123:0/1558305573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e006dc70 0x7f96e014add0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c730 tx=0x7f96dc00ca40 comp rx=0 tx=0).stop 2024-09-13T17:10:01.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.138+0000 7f96e7003700 1 -- 172.21.15.123:0/1558305573 shutdown_connections 2024-09-13T17:10:01.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.138+0000 7f96e7003700 1 --2- 172.21.15.123:0/1558305573 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f96c4066730 0x7f96c4068bf0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:01.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.138+0000 7f96e7003700 1 --2- 172.21.15.123:0/1558305573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96e01597c0 0x7f96e01e3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:01.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.138+0000 7f96e7003700 1 --2- 172.21.15.123:0/1558305573 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f96e0071760 0x7f96e01e3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:01.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.138+0000 7f96e7003700 1 --2- 172.21.15.123:0/1558305573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e006dc70 0x7f96e014add0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:01.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.138+0000 7f96e7003700 1 -- 172.21.15.123:0/1558305573 >> 172.21.15.123:0/1558305573 conn(0x7f96e006f940 msgr2=0x7f96e01e6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:01.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.138+0000 7f96e7003700 1 -- 172.21.15.123:0/1558305573 shutdown_connections 2024-09-13T17:10:01.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.138+0000 7f96e7003700 1 -- 172.21.15.123:0/1558305573 wait complete. 2024-09-13T17:10:01.160 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:10:01.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:10:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 Processor -- start 2024-09-13T17:10:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 -- start start 2024-09-13T17:10:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20080cb7e0 0x7f20080c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f200806bdb0 0x7f2008071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f20080c1480 0x7f2008072090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20080ca750 con 0x7f20080c1480 2024-09-13T17:10:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20080c9210 con 0x7f200806bdb0 2024-09-13T17:10:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20081617b0 con 0x7f20080cb7e0 2024-09-13T17:10:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f2006d9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f20080c1480 0x7f2008072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f2006d9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f20080c1480 0x7f2008072090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60884/0 (socket says 172.21.15.123:60884) 2024-09-13T17:10:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f2006d9d700 1 -- 172.21.15.123:0/1211799794 learned_addr learned my addr 172.21.15.123:0/1211799794 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200659c700 1 --2- 172.21.15.123:0/1211799794 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20080cb7e0 0x7f20080c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f2005d9b700 1 --2- 172.21.15.123:0/1211799794 >> v2:172.21.15.153:3300/0 conn(0x7f200806bdb0 0x7f2008071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f2006d9d700 1 -- 172.21.15.123:0/1211799794 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20080cb7e0 msgr2=0x7f20080c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f2006d9d700 1 --2- 172.21.15.123:0/1211799794 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20080cb7e0 0x7f20080c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f2006d9d700 1 -- 172.21.15.123:0/1211799794 >> v2:172.21.15.153:3300/0 conn(0x7f200806bdb0 msgr2=0x7f2008071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f2006d9d700 1 --2- 172.21.15.123:0/1211799794 >> v2:172.21.15.153:3300/0 conn(0x7f200806bdb0 0x7f2008071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f2006d9d700 1 -- 172.21.15.123:0/1211799794 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20080cbbc0 con 0x7f20080c1480 2024-09-13T17:10:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200659c700 1 --2- 172.21.15.123:0/1211799794 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20080cb7e0 0x7f20080c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f2005d9b700 1 --2- 172.21.15.123:0/1211799794 >> v2:172.21.15.153:3300/0 conn(0x7f200806bdb0 0x7f2008071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f2006d9d700 1 --2- 172.21.15.123:0/1211799794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20080c1480 0x7f2008072090 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f20080b1160 tx=0x7f200000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2c435b7f460acc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200559a700 1 -- 172.21.15.123:0/1211799794 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200000e070 con 0x7f20080c1480 2024-09-13T17:10:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200559a700 1 -- 172.21.15.123:0/1211799794 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200000b9c0 con 0x7f20080c1480 2024-09-13T17:10:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200559a700 1 -- 172.21.15.123:0/1211799794 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200000bd70 con 0x7f20080c1480 2024-09-13T17:10:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 -- 172.21.15.123:0/1211799794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20080c1480 msgr2=0x7f2008072090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 --2- 172.21.15.123:0/1211799794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20080c1480 0x7f2008072090 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f20080b1160 tx=0x7f200000b330 comp rx=0 tx=0).stop 2024-09-13T17:10:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 -- 172.21.15.123:0/1211799794 shutdown_connections 2024-09-13T17:10:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 --2- 172.21.15.123:0/1211799794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20080c1480 0x7f2008072090 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 --2- 172.21.15.123:0/1211799794 >> v2:172.21.15.153:3300/0 conn(0x7f200806bdb0 0x7f2008071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 --2- 172.21.15.123:0/1211799794 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20080cb7e0 0x7f20080c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 -- 172.21.15.123:0/1211799794 >> 172.21.15.123:0/1211799794 conn(0x7f20080b01d0 msgr2=0x7f20080b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 -- 172.21.15.123:0/1211799794 shutdown_connections 2024-09-13T17:10:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.274+0000 7f200759e700 1 -- 172.21.15.123:0/1211799794 wait complete. 2024-09-13T17:10:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200759e700 1 Processor -- start 2024-09-13T17:10:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200759e700 1 -- start start 2024-09-13T17:10:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f200806bdb0 0x7f2008163890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20080c1480 0x7f2008163dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20080cb7e0 0x7f20080b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20080b2600 con 0x7f200806bdb0 2024-09-13T17:10:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2008163470 con 0x7f20080c1480 2024-09-13T17:10:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20081581d0 con 0x7f20080cb7e0 2024-09-13T17:10:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f200806bdb0 0x7f2008163890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f200806bdb0 0x7f2008163890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60900/0 (socket says 172.21.15.123:60900) 2024-09-13T17:10:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200659c700 1 -- 172.21.15.123:0/2582929737 learned_addr learned my addr 172.21.15.123:0/2582929737 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f2006d9d700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20080cb7e0 0x7f20080b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f2005d9b700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20080c1480 0x7f2008163dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200659c700 1 -- 172.21.15.123:0/2582929737 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20080cb7e0 msgr2=0x7f20080b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200659c700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20080cb7e0 0x7f20080b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200659c700 1 -- 172.21.15.123:0/2582929737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20080c1480 msgr2=0x7f2008163dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200659c700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20080c1480 0x7f2008163dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200659c700 1 -- 172.21.15.123:0/2582929737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2000009b30 con 0x7f200806bdb0 2024-09-13T17:10:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f2006d9d700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20080cb7e0 0x7f20080b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f2005d9b700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20080c1480 0x7f2008163dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f200659c700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f200806bdb0 0x7f2008163890 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00e880 tx=0x7f1ffc00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.278+0000 7f1ff6ffd700 1 -- 172.21.15.123:0/2582929737 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00c780 con 0x7f200806bdb0 2024-09-13T17:10:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.282+0000 7f1ff6ffd700 1 -- 172.21.15.123:0/2582929737 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc00c8e0 con 0x7f200806bdb0 2024-09-13T17:10:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.282+0000 7f200759e700 1 -- 172.21.15.123:0/2582929737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20080b20a0 con 0x7f200806bdb0 2024-09-13T17:10:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.282+0000 7f1ff6ffd700 1 -- 172.21.15.123:0/2582929737 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00cc70 con 0x7f200806bdb0 2024-09-13T17:10:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.282+0000 7f200759e700 1 -- 172.21.15.123:0/2582929737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20080b1a10 con 0x7f200806bdb0 2024-09-13T17:10:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.282+0000 7f200759e700 1 -- 172.21.15.123:0/2582929737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20080c8cd0 con 0x7f200806bdb0 2024-09-13T17:10:01.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.282+0000 7f1ff6ffd700 1 -- 172.21.15.123:0/2582929737 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1ffc013410 con 0x7f200806bdb0 2024-09-13T17:10:01.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.282+0000 7f1ff6ffd700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1fe8066730 0x7f1fe8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:01.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.282+0000 7f1ff6ffd700 1 -- 172.21.15.123:0/2582929737 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ffc083dd0 con 0x7f200806bdb0 2024-09-13T17:10:01.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.282+0000 7f2005d9b700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1fe8066730 0x7f1fe8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:01.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.282+0000 7f2005d9b700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1fe8066730 0x7f1fe8068bf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f20080c4c90 tx=0x7f1ff8008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.290+0000 7f1ff6ffd700 1 -- 172.21.15.123:0/2582929737 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1ffc0511d0 con 0x7f200806bdb0 2024-09-13T17:10:01.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:01.494+0000 7f200759e700 1 -- 172.21.15.123:0/2582929737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f20080ada30 con 0x7f200806bdb0 2024-09-13T17:10:02.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.138+0000 7f1ff6ffd700 1 -- 172.21.15.123:0/2582929737 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v41) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1ffc0547f0 con 0x7f200806bdb0 2024-09-13T17:10:02.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.142+0000 7f200759e700 1 -- 172.21.15.123:0/2582929737 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1fe8066730 msgr2=0x7f1fe8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.142+0000 7f200759e700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1fe8066730 0x7f1fe8068bf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f20080c4c90 tx=0x7f1ff8008040 comp rx=0 tx=0).stop 2024-09-13T17:10:02.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.142+0000 7f200759e700 1 -- 172.21.15.123:0/2582929737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f200806bdb0 msgr2=0x7f2008163890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.142+0000 7f200759e700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f200806bdb0 0x7f2008163890 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00e880 tx=0x7f1ffc00ec40 comp rx=0 tx=0).stop 2024-09-13T17:10:02.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.142+0000 7f200759e700 1 -- 172.21.15.123:0/2582929737 shutdown_connections 2024-09-13T17:10:02.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.142+0000 7f200759e700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1fe8066730 0x7f1fe8068bf0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.142+0000 7f200759e700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f20080cb7e0 0x7f20080b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.142+0000 7f200759e700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20080c1480 0x7f2008163dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.142+0000 7f200759e700 1 --2- 172.21.15.123:0/2582929737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f200806bdb0 0x7f2008163890 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.142+0000 7f200759e700 1 -- 172.21.15.123:0/2582929737 >> 172.21.15.123:0/2582929737 conn(0x7f20080b01d0 msgr2=0x7f20080cc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:02.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.142+0000 7f200759e700 1 -- 172.21.15.123:0/2582929737 shutdown_connections 2024-09-13T17:10:02.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.142+0000 7f200759e700 1 -- 172.21.15.123:0/2582929737 wait complete. 2024-09-13T17:10:02.165 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:10:02.165 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:02.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.278+0000 7fa473fff700 1 Processor -- start 2024-09-13T17:10:02.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.278+0000 7fa473fff700 1 -- start start 2024-09-13T17:10:02.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.278+0000 7fa473fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa47406fa70 0x7fa474161060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.278+0000 7fa473fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4741623f0 con 0x7fa4741615a0 2024-09-13T17:10:02.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.278+0000 7fa473fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa474161b50 con 0x7fa4740b3350 2024-09-13T17:10:02.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.278+0000 7fa473fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa474161e30 con 0x7fa47406fa70 2024-09-13T17:10:02.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.278+0000 7fa4737fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa4741615a0 0x7fa47406d500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48524/0 (socket says 172.21.15.123:48524) 2024-09-13T17:10:02.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.278+0000 7fa4737fe700 1 -- 172.21.15.123:0/3701347392 learned_addr learned my addr 172.21.15.123:0/3701347392 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:02.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.278+0000 7fa4727fc700 1 --2- 172.21.15.123:0/3701347392 >> v2:172.21.15.153:3300/0 conn(0x7fa47406fa70 0x7fa474161060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.278+0000 7fa471ffb700 1 -- 172.21.15.123:0/3701347392 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763907721 0 0) 0x7fa4741623f0 con 0x7fa4741615a0 2024-09-13T17:10:02.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.278+0000 7fa471ffb700 1 -- 172.21.15.123:0/3701347392 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa45c0035d0 con 0x7fa4741615a0 2024-09-13T17:10:02.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.278+0000 7fa4727fc700 1 -- 172.21.15.123:0/3701347392 >> v1:172.21.15.153:6789/0 conn(0x7fa4740b3350 legacy=0x7fa4740b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.278+0000 7fa4727fc700 1 -- 172.21.15.123:0/3701347392 >> v1:172.21.15.123:6789/0 conn(0x7fa4741615a0 legacy=0x7fa47406d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.278+0000 7fa4727fc700 1 -- 172.21.15.123:0/3701347392 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa474162110 con 0x7fa47406fa70 2024-09-13T17:10:02.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.282+0000 7fa4727fc700 1 --2- 172.21.15.123:0/3701347392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa47406fa70 0x7fa474161060 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa464009850 tx=0x7fa464009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5953a0cc9d76c47c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.282+0000 7fa471ffb700 1 -- 172.21.15.123:0/3701347392 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464011830 con 0x7fa47406fa70 2024-09-13T17:10:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.282+0000 7fa471ffb700 1 -- 172.21.15.123:0/3701347392 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa464011990 con 0x7fa47406fa70 2024-09-13T17:10:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.282+0000 7fa471ffb700 1 -- 172.21.15.123:0/3701347392 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464011d40 con 0x7fa47406fa70 2024-09-13T17:10:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.282+0000 7fa473fff700 1 -- 172.21.15.123:0/3701347392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa47406fa70 msgr2=0x7fa474161060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.282+0000 7fa473fff700 1 --2- 172.21.15.123:0/3701347392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa47406fa70 0x7fa474161060 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa464009850 tx=0x7fa464009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.282+0000 7fa473fff700 1 -- 172.21.15.123:0/3701347392 shutdown_connections 2024-09-13T17:10:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.282+0000 7fa473fff700 1 --2- 172.21.15.123:0/3701347392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa47406fa70 0x7fa474161060 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.282+0000 7fa473fff700 1 -- 172.21.15.123:0/3701347392 >> 172.21.15.123:0/3701347392 conn(0x7fa474066150 msgr2=0x7fa474066560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.282+0000 7fa473fff700 1 -- 172.21.15.123:0/3701347392 shutdown_connections 2024-09-13T17:10:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.282+0000 7fa473fff700 1 -- 172.21.15.123:0/3701347392 wait complete. 2024-09-13T17:10:02.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.282+0000 7fa473fff700 1 Processor -- start 2024-09-13T17:10:02.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.282+0000 7fa473fff700 1 -- start start 2024-09-13T17:10:02.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa473fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa47406fa70 0x7fa474153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa473fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4740b3350 0x7fa4740c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa473fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4741615a0 0x7fa47406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa473fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4740c67a0 con 0x7fa4740b3350 2024-09-13T17:10:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa473fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4740c4cf0 con 0x7fa4741615a0 2024-09-13T17:10:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa473fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4741f6de0 con 0x7fa47406fa70 2024-09-13T17:10:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa4727fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4740b3350 0x7fa4740c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa4727fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4740b3350 0x7fa4740c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54436/0 (socket says 172.21.15.123:54436) 2024-09-13T17:10:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa4727fc700 1 -- 172.21.15.123:0/3751801712 learned_addr learned my addr 172.21.15.123:0/3751801712 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa472ffd700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa47406fa70 0x7fa474153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa4737fe700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4741615a0 0x7fa47406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa4727fc700 1 -- 172.21.15.123:0/3751801712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa47406fa70 msgr2=0x7fa474153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa4727fc700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa47406fa70 0x7fa474153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa4727fc700 1 -- 172.21.15.123:0/3751801712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4741615a0 msgr2=0x7fa47406dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa4727fc700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4741615a0 0x7fa47406dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa4727fc700 1 -- 172.21.15.123:0/3751801712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4640094b0 con 0x7fa4740b3350 2024-09-13T17:10:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa4737fe700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4741615a0 0x7fa47406dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa4727fc700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4740b3350 0x7fa4740c47b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fa464000c00 tx=0x7fa464004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa45b7fe700 1 -- 172.21.15.123:0/3751801712 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46401aa10 con 0x7fa4740b3350 2024-09-13T17:10:02.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa45b7fe700 1 -- 172.21.15.123:0/3751801712 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46401f070 con 0x7fa4740b3350 2024-09-13T17:10:02.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa45b7fe700 1 -- 172.21.15.123:0/3751801712 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46401adb0 con 0x7fa4740b3350 2024-09-13T17:10:02.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa473fff700 1 -- 172.21.15.123:0/3751801712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4741f70c0 con 0x7fa4740b3350 2024-09-13T17:10:02.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa473fff700 1 -- 172.21.15.123:0/3751801712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4741f7680 con 0x7fa4740b3350 2024-09-13T17:10:02.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.286+0000 7fa473fff700 1 -- 172.21.15.123:0/3751801712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4741607f0 con 0x7fa4740b3350 2024-09-13T17:10:02.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.290+0000 7fa45b7fe700 1 -- 172.21.15.123:0/3751801712 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa46401b430 con 0x7fa4740b3350 2024-09-13T17:10:02.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.290+0000 7fa45b7fe700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa460066730 0x7fa460068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.290+0000 7fa45b7fe700 1 -- 172.21.15.123:0/3751801712 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4640852e0 con 0x7fa4740b3350 2024-09-13T17:10:02.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.290+0000 7fa472ffd700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa460066730 0x7fa460068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.290+0000 7fa472ffd700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa460066730 0x7fa460068bf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa4741eb720 tx=0x7fa468009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:02.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.302+0000 7fa45b7fe700 1 -- 172.21.15.123:0/3751801712 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa4640525c0 con 0x7fa4740b3350 2024-09-13T17:10:02.456 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-13T17:10:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.510+0000 7fa473fff700 1 -- 172.21.15.123:0/3751801712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4740b53d0 con 0x7fa4740b3350 2024-09-13T17:10:02.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.510+0000 7fa45b7fe700 1 -- 172.21.15.123:0/3751801712 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4748 (secure 0 0 0) 0x7fa464055be0 con 0x7fa4740b3350 2024-09-13T17:10:02.518 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:02.518 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":41,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6173,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3730345323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3730345323},{"type":"v1","addr":"172.21.15.153:6835","nonce":3730345323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1181784822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1181784822},{"type":"v1","addr":"172.21.15.153:6834","nonce":1181784822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1969180357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1969180357},{"type":"v1","addr":"172.21.15.123:6835","nonce":1969180357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:10:00.116252+0000","modified":"2024-09-13T17:10:02.136736+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2288571456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2288571456},{"type":"v1","addr":"172.21.15.123:6837","nonce":2288571456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T17:10:02.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.514+0000 7fa473fff700 1 -- 172.21.15.123:0/3751801712 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa460066730 msgr2=0x7fa460068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.514+0000 7fa473fff700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa460066730 0x7fa460068bf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa4741eb720 tx=0x7fa468009040 comp rx=0 tx=0).stop 2024-09-13T17:10:02.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.514+0000 7fa473fff700 1 -- 172.21.15.123:0/3751801712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4740b3350 msgr2=0x7fa4740c47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.514+0000 7fa473fff700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4740b3350 0x7fa4740c47b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fa464000c00 tx=0x7fa464004770 comp rx=0 tx=0).stop 2024-09-13T17:10:02.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.514+0000 7fa473fff700 1 -- 172.21.15.123:0/3751801712 shutdown_connections 2024-09-13T17:10:02.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.514+0000 7fa473fff700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa460066730 0x7fa460068bf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.514+0000 7fa473fff700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4741615a0 0x7fa47406dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.514+0000 7fa473fff700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4740b3350 0x7fa4740c47b0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.514+0000 7fa473fff700 1 --2- 172.21.15.123:0/3751801712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa47406fa70 0x7fa474153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.514+0000 7fa473fff700 1 -- 172.21.15.123:0/3751801712 >> 172.21.15.123:0/3751801712 conn(0x7fa474066150 msgr2=0x7fa4740cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.514+0000 7fa473fff700 1 -- 172.21.15.123:0/3751801712 shutdown_connections 2024-09-13T17:10:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.514+0000 7fa473fff700 1 -- 172.21.15.123:0/3751801712 wait complete. 2024-09-13T17:10:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 41 2024-09-13T17:10:02.532 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:02.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b8bd2700 1 Processor -- start 2024-09-13T17:10:02.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b8bd2700 1 -- start start 2024-09-13T17:10:02.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b8bd2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd8b40cec90 0x7fd8b40cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b8bd2700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8b406c050 0x7fd8b406c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b8bd2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b40cf600 con 0x7fd8b4160fb0 2024-09-13T17:10:02.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b8bd2700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b406cd60 con 0x7fd8b40cec90 2024-09-13T17:10:02.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b8bd2700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b406d040 con 0x7fd8b406c050 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b259c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd8b4160fb0 0x7fd8b406de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48538/0 (socket says 172.21.15.123:48538) 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b259c700 1 -- 172.21.15.123:0/4047367963 learned_addr learned my addr 172.21.15.123:0/4047367963 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8a9d9b700 1 --2- 172.21.15.123:0/4047367963 >> v2:172.21.15.153:3300/0 conn(0x7fd8b40cec90 0x7fd8b40cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b2d9d700 1 --2- 172.21.15.123:0/4047367963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8b406c050 0x7fd8b406c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 -- 172.21.15.123:0/4047367963 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406739897 0 0) 0x7fd8b40cf600 con 0x7fd8b4160fb0 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 -- 172.21.15.123:0/4047367963 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8a00035d0 con 0x7fd8b4160fb0 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 -- 172.21.15.123:0/4047367963 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3127435300 0 0) 0x7fd8a00035d0 con 0x7fd8b4160fb0 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 -- 172.21.15.123:0/4047367963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8b406c050 msgr2=0x7fd8b406c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 --2- 172.21.15.123:0/4047367963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8b406c050 0x7fd8b406c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 -- 172.21.15.123:0/4047367963 >> v2:172.21.15.153:3300/0 conn(0x7fd8b40cec90 msgr2=0x7fd8b40cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 --2- 172.21.15.123:0/4047367963 >> v2:172.21.15.153:3300/0 conn(0x7fd8b40cec90 0x7fd8b40cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 -- 172.21.15.123:0/4047367963 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b406d320 con 0x7fd8b4160fb0 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 -- 172.21.15.123:0/4047367963 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3578338462 0 0) 0x7fd8a4001670 con 0x7fd8b4160fb0 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 -- 172.21.15.123:0/4047367963 >> v1:172.21.15.123:6789/0 conn(0x7fd8b4160fb0 legacy=0x7fd8b406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 --2- 172.21.15.123:0/4047367963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8a0003a20 0x7fd8a0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 --2- 172.21.15.123:0/4047367963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8b406c050 0x7fd8a0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 --2- 172.21.15.123:0/4047367963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8a0004db0 0x7fd8a0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 -- 172.21.15.123:0/4047367963 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b406cd60 con 0x7fd8a0003a20 2024-09-13T17:10:02.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 -- 172.21.15.123:0/4047367963 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b406d040 con 0x7fd8a0004db0 2024-09-13T17:10:02.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 -- 172.21.15.123:0/4047367963 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a000ba30 con 0x7fd8b406c050 2024-09-13T17:10:02.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b259c700 1 --2- 172.21.15.123:0/4047367963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8a0003a20 0x7fd8a0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b2d9d700 1 --2- 172.21.15.123:0/4047367963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8a0004db0 0x7fd8a0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8a9d9b700 1 --2- 172.21.15.123:0/4047367963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8b406c050 0x7fd8a0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b259c700 1 -- 172.21.15.123:0/4047367963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8b406c050 msgr2=0x7fd8a0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:02.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b259c700 1 --2- 172.21.15.123:0/4047367963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8b406c050 0x7fd8a0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b259c700 1 -- 172.21.15.123:0/4047367963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8a0004db0 msgr2=0x7fd8a0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:02.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b259c700 1 --2- 172.21.15.123:0/4047367963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8a0004db0 0x7fd8a0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b259c700 1 -- 172.21.15.123:0/4047367963 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a00035d0 con 0x7fd8a0003a20 2024-09-13T17:10:02.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8a9d9b700 1 --2- 172.21.15.123:0/4047367963 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8b406c050 0x7fd8a0004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:02.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b259c700 1 --2- 172.21.15.123:0/4047367963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8a0003a20 0x7fd8a0003e40 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400c2f0 tx=0x7fd8a00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93047f14cc56dd6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:02.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 -- 172.21.15.123:0/4047367963 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a400ce30 con 0x7fd8a0003a20 2024-09-13T17:10:02.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 -- 172.21.15.123:0/4047367963 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a4005980 con 0x7fd8a0003a20 2024-09-13T17:10:02.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.642+0000 7fd8b1d9b700 1 -- 172.21.15.123:0/4047367963 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4005d30 con 0x7fd8a0003a20 2024-09-13T17:10:02.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.646+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/4047367963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8a0003a20 msgr2=0x7fd8a0003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.646+0000 7fd8b8bd2700 1 --2- 172.21.15.123:0/4047367963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8a0003a20 0x7fd8a0003e40 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400c2f0 tx=0x7fd8a00058a0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.646+0000 7fd8b2d9d700 1 -- 172.21.15.123:0/4047367963 reap_dead start 2024-09-13T17:10:02.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.646+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/4047367963 shutdown_connections 2024-09-13T17:10:02.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.646+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/4047367963 >> 172.21.15.123:0/4047367963 conn(0x7fd8b4066570 msgr2=0x7fd8b4066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:02.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.646+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/4047367963 shutdown_connections 2024-09-13T17:10:02.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.646+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/4047367963 wait complete. 2024-09-13T17:10:02.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.646+0000 7fd8b8bd2700 1 Processor -- start 2024-09-13T17:10:02.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.646+0000 7fd8b8bd2700 1 -- start start 2024-09-13T17:10:02.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8b8bd2700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8a0003a20 0x7fd8b4157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8b8bd2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8b40abb40 0x7fd8b40abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8b8bd2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8b414e890 0x7fd8b414ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8b8bd2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40ac500 con 0x7fd8b40abb40 2024-09-13T17:10:02.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8b8bd2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b414f280 con 0x7fd8b414e890 2024-09-13T17:10:02.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8b8bd2700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b4150ff0 con 0x7fd8a0003a20 2024-09-13T17:10:02.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8a9d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8b40abb40 0x7fd8b40abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8b259c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8a0003a20 0x7fd8b4157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8b259c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8a0003a20 0x7fd8b4157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:45060/0 (socket says 172.21.15.123:45060) 2024-09-13T17:10:02.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8b259c700 1 -- 172.21.15.123:0/1307979663 learned_addr learned my addr 172.21.15.123:0/1307979663 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:02.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8b2d9d700 1 --2- 172.21.15.123:0/1307979663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8b414e890 0x7fd8b414ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8a9d9b700 1 -- 172.21.15.123:0/1307979663 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8a0003a20 msgr2=0x7fd8b4157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8a9d9b700 1 --2- 172.21.15.123:0/1307979663 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8a0003a20 0x7fd8b4157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8a9d9b700 1 -- 172.21.15.123:0/1307979663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8b414e890 msgr2=0x7fd8b414ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8a9d9b700 1 --2- 172.21.15.123:0/1307979663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8b414e890 0x7fd8b414ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8a9d9b700 1 -- 172.21.15.123:0/1307979663 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b41512d0 con 0x7fd8b40abb40 2024-09-13T17:10:02.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8a9d9b700 1 --2- 172.21.15.123:0/1307979663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8b40abb40 0x7fd8b40abfc0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0108f0 tx=0x7fd89c010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:02.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8ab7fe700 1 -- 172.21.15.123:0/1307979663 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c004020 con 0x7fd8b40abb40 2024-09-13T17:10:02.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8ab7fe700 1 -- 172.21.15.123:0/1307979663 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c004180 con 0x7fd8b40abb40 2024-09-13T17:10:02.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/1307979663 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b41515b0 con 0x7fd8b40abb40 2024-09-13T17:10:02.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8ab7fe700 1 -- 172.21.15.123:0/1307979663 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c004510 con 0x7fd8b40abb40 2024-09-13T17:10:02.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.650+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/1307979663 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b4152120 con 0x7fd8b40abb40 2024-09-13T17:10:02.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.654+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/1307979663 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b406ca20 con 0x7fd8b40abb40 2024-09-13T17:10:02.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.654+0000 7fd8ab7fe700 1 -- 172.21.15.123:0/1307979663 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd89c016730 con 0x7fd8b40abb40 2024-09-13T17:10:02.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.654+0000 7fd8ab7fe700 1 --2- 172.21.15.123:0/1307979663 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd894066730 0x7fd894068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.654+0000 7fd8ab7fe700 1 -- 172.21.15.123:0/1307979663 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd89c083f10 con 0x7fd8b40abb40 2024-09-13T17:10:02.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.654+0000 7fd8b259c700 1 --2- 172.21.15.123:0/1307979663 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd894066730 0x7fd894068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.654+0000 7fd8b259c700 1 --2- 172.21.15.123:0/1307979663 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd894066730 0x7fd894068bf0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4001050 tx=0x7fd8a400a000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:02.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.658+0000 7fd8ab7fe700 1 -- 172.21.15.123:0/1307979663 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd89c0511e0 con 0x7fd8b40abb40 2024-09-13T17:10:02.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.826+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/1307979663 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8b415f800 con 0x7fd8b40abb40 2024-09-13T17:10:02.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.830+0000 7fd8ab7fe700 1 -- 172.21.15.123:0/1307979663 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16608 (secure 0 0 0) 0x7fd89c054800 con 0x7fd8b40abb40 2024-09-13T17:10:02.836 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:02.836 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:01.118924+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:58.436099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:59.120652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.830+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/1307979663 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd894066730 msgr2=0x7fd894068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.830+0000 7fd8b8bd2700 1 --2- 172.21.15.123:0/1307979663 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd894066730 0x7fd894068bf0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4001050 tx=0x7fd8a400a000 comp rx=0 tx=0).stop 2024-09-13T17:10:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.830+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/1307979663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8b40abb40 msgr2=0x7fd8b40abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.830+0000 7fd8b8bd2700 1 --2- 172.21.15.123:0/1307979663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8b40abb40 0x7fd8b40abfc0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0108f0 tx=0x7fd89c010c00 comp rx=0 tx=0).stop 2024-09-13T17:10:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.830+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/1307979663 shutdown_connections 2024-09-13T17:10:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.830+0000 7fd8b8bd2700 1 --2- 172.21.15.123:0/1307979663 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd894066730 0x7fd894068bf0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.830+0000 7fd8b8bd2700 1 --2- 172.21.15.123:0/1307979663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8b414e890 0x7fd8b414ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.830+0000 7fd8b8bd2700 1 --2- 172.21.15.123:0/1307979663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8b40abb40 0x7fd8b40abfc0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.830+0000 7fd8b8bd2700 1 --2- 172.21.15.123:0/1307979663 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8a0003a20 0x7fd8b4157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.830+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/1307979663 >> 172.21.15.123:0/1307979663 conn(0x7fd8b4066570 msgr2=0x7fd8b415ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.830+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/1307979663 shutdown_connections 2024-09-13T17:10:02.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.830+0000 7fd8b8bd2700 1 -- 172.21.15.123:0/1307979663 wait complete. 2024-09-13T17:10:02.850 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:10:02.850 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:10:02.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f66754d7700 1 Processor -- start 2024-09-13T17:10:02.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f66754d7700 1 -- start start 2024-09-13T17:10:02.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f66754d7700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6670071ac0 0x7f66700b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f66754d7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6670142f20 con 0x7f66700b2470 2024-09-13T17:10:02.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f66754d7700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6670159de0 con 0x7f6670142b40 2024-09-13T17:10:02.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f66754d7700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66700b2c40 con 0x7f6670071ac0 2024-09-13T17:10:02.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f6674cd6700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f66700b2470 0x7f667015a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48550/0 (socket says 172.21.15.123:48550) 2024-09-13T17:10:02.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f6674cd6700 1 -- 172.21.15.123:0/2176663494 learned_addr learned my addr 172.21.15.123:0/2176663494 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f666f7fe700 1 --2- 172.21.15.123:0/2176663494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6670071ac0 0x7f66700b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f666effd700 1 -- 172.21.15.123:0/2176663494 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829210565 0 0) 0x7f6668001490 con 0x7f66700b2470 2024-09-13T17:10:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f666effd700 1 -- 172.21.15.123:0/2176663494 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66580035d0 con 0x7f66700b2470 2024-09-13T17:10:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f666effd700 1 -- 172.21.15.123:0/2176663494 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810176709 0 0) 0x7f6670159de0 con 0x7f6670142b40 2024-09-13T17:10:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f666effd700 1 -- 172.21.15.123:0/2176663494 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6668001490 con 0x7f6670142b40 2024-09-13T17:10:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f666effd700 1 -- 172.21.15.123:0/2176663494 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2157842897 0 0) 0x7f66580035d0 con 0x7f66700b2470 2024-09-13T17:10:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f666f7fe700 1 -- 172.21.15.123:0/2176663494 >> v1:172.21.15.153:6789/0 conn(0x7f6670142b40 legacy=0x7f66700713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f666f7fe700 1 -- 172.21.15.123:0/2176663494 >> v1:172.21.15.123:6789/0 conn(0x7f66700b2470 legacy=0x7f667015a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f666f7fe700 1 -- 172.21.15.123:0/2176663494 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66700b2f20 con 0x7f6670071ac0 2024-09-13T17:10:02.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.958+0000 7f666f7fe700 1 --2- 172.21.15.123:0/2176663494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6670071ac0 0x7f66700b1f30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6664009880 tx=0x7f6664009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=247332be7c44cf41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:02.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.962+0000 7f666effd700 1 -- 172.21.15.123:0/2176663494 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668001b80 con 0x7f6670071ac0 2024-09-13T17:10:02.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.962+0000 7f666effd700 1 -- 172.21.15.123:0/2176663494 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6664004030 con 0x7f6670071ac0 2024-09-13T17:10:02.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.962+0000 7f666effd700 1 -- 172.21.15.123:0/2176663494 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66640043c0 con 0x7f6670071ac0 2024-09-13T17:10:02.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.962+0000 7f66754d7700 1 -- 172.21.15.123:0/2176663494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6670071ac0 msgr2=0x7f66700b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.962+0000 7f66754d7700 1 --2- 172.21.15.123:0/2176663494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6670071ac0 0x7f66700b1f30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6664009880 tx=0x7f6664009b90 comp rx=0 tx=0).stop 2024-09-13T17:10:02.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.962+0000 7f66754d7700 1 -- 172.21.15.123:0/2176663494 shutdown_connections 2024-09-13T17:10:02.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.962+0000 7f66754d7700 1 --2- 172.21.15.123:0/2176663494 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6670071ac0 0x7f66700b1f30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.962+0000 7f66754d7700 1 -- 172.21.15.123:0/2176663494 >> 172.21.15.123:0/2176663494 conn(0x7f667006f460 msgr2=0x7f667006f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:02.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.962+0000 7f66754d7700 1 -- 172.21.15.123:0/2176663494 shutdown_connections 2024-09-13T17:10:02.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.962+0000 7f66754d7700 1 -- 172.21.15.123:0/2176663494 wait complete. 2024-09-13T17:10:02.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f66754d7700 1 Processor -- start 2024-09-13T17:10:02.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f66754d7700 1 -- start start 2024-09-13T17:10:02.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f66754d7700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6670071ac0 0x7f667013f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f66754d7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66700b2470 0x7f6670141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f66754d7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6670142b40 0x7f667013b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f66754d7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6670158de0 con 0x7f6670142b40 2024-09-13T17:10:02.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f66754d7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667013fab0 con 0x7f66700b2470 2024-09-13T17:10:02.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f66754d7700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667013fd90 con 0x7f6670071ac0 2024-09-13T17:10:02.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f6674cd6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6670142b40 0x7f667013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f6674cd6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6670142b40 0x7f667013b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54464/0 (socket says 172.21.15.123:54464) 2024-09-13T17:10:02.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f6674cd6700 1 -- 172.21.15.123:0/3016783999 learned_addr learned my addr 172.21.15.123:0/3016783999 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:02.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f666ffff700 1 --2- 172.21.15.123:0/3016783999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6670071ac0 0x7f667013f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f666f7fe700 1 --2- 172.21.15.123:0/3016783999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66700b2470 0x7f6670141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f6674cd6700 1 -- 172.21.15.123:0/3016783999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6670071ac0 msgr2=0x7f667013f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f6674cd6700 1 --2- 172.21.15.123:0/3016783999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6670071ac0 0x7f667013f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f6674cd6700 1 -- 172.21.15.123:0/3016783999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66700b2470 msgr2=0x7f6670141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:02.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f6674cd6700 1 --2- 172.21.15.123:0/3016783999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66700b2470 0x7f6670141fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:02.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f6674cd6700 1 -- 172.21.15.123:0/3016783999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66640094b0 con 0x7f6670142b40 2024-09-13T17:10:02.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.966+0000 7f6674cd6700 1 --2- 172.21.15.123:0/3016783999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6670142b40 0x7f667013b740 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f6668001b60 tx=0x7f666800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:02.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.970+0000 7f666cff9700 1 -- 172.21.15.123:0/3016783999 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666800acf0 con 0x7f6670142b40 2024-09-13T17:10:02.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.970+0000 7f66754d7700 1 -- 172.21.15.123:0/3016783999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6670140070 con 0x7f6670142b40 2024-09-13T17:10:02.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.970+0000 7f666cff9700 1 -- 172.21.15.123:0/3016783999 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666800ae50 con 0x7f6670142b40 2024-09-13T17:10:02.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.970+0000 7f666cff9700 1 -- 172.21.15.123:0/3016783999 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668007310 con 0x7f6670142b40 2024-09-13T17:10:02.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.970+0000 7f66754d7700 1 -- 172.21.15.123:0/3016783999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6670140630 con 0x7f6670142b40 2024-09-13T17:10:02.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.970+0000 7f66754d7700 1 -- 172.21.15.123:0/3016783999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6670074370 con 0x7f6670142b40 2024-09-13T17:10:02.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.970+0000 7f666cff9700 1 -- 172.21.15.123:0/3016783999 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6668007470 con 0x7f6670142b40 2024-09-13T17:10:02.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.970+0000 7f666cff9700 1 --2- 172.21.15.123:0/3016783999 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f665c066730 0x7f665c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:02.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.970+0000 7f666ffff700 1 --2- 172.21.15.123:0/3016783999 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f665c066730 0x7f665c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:02.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.970+0000 7f666cff9700 1 -- 172.21.15.123:0/3016783999 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6668083db0 con 0x7f6670142b40 2024-09-13T17:10:02.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.974+0000 7f666ffff700 1 --2- 172.21.15.123:0/3016783999 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f665c066730 0x7f665c068bf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f66600011e0 tx=0x7f6660009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:02.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:02.978+0000 7f666cff9700 1 -- 172.21.15.123:0/3016783999 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6668088070 con 0x7f6670142b40 2024-09-13T17:10:03.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.146+0000 7f66754d7700 1 -- 172.21.15.123:0/3016783999 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f667013ff00 con 0x7f665c066730 2024-09-13T17:10:03.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.162+0000 7f666cff9700 1 -- 172.21.15.123:0/3016783999 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288217 (secure 0 0 0) 0x7f667013ff00 con 0x7f665c066730 2024-09-13T17:10:03.172 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:03.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.170+0000 7f66754d7700 1 -- 172.21.15.123:0/3016783999 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f665c066730 msgr2=0x7f665c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.170+0000 7f66754d7700 1 --2- 172.21.15.123:0/3016783999 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f665c066730 0x7f665c068bf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f66600011e0 tx=0x7f6660009040 comp rx=0 tx=0).stop 2024-09-13T17:10:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.170+0000 7f66754d7700 1 -- 172.21.15.123:0/3016783999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6670142b40 msgr2=0x7f667013b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.170+0000 7f66754d7700 1 --2- 172.21.15.123:0/3016783999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6670142b40 0x7f667013b740 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f6668001b60 tx=0x7f666800a340 comp rx=0 tx=0).stop 2024-09-13T17:10:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.170+0000 7f66754d7700 1 -- 172.21.15.123:0/3016783999 shutdown_connections 2024-09-13T17:10:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.170+0000 7f66754d7700 1 --2- 172.21.15.123:0/3016783999 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f665c066730 0x7f665c068bf0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.170+0000 7f66754d7700 1 --2- 172.21.15.123:0/3016783999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6670142b40 0x7f667013b740 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.170+0000 7f66754d7700 1 --2- 172.21.15.123:0/3016783999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66700b2470 0x7f6670141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.170+0000 7f66754d7700 1 --2- 172.21.15.123:0/3016783999 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6670071ac0 0x7f667013f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.170+0000 7f66754d7700 1 -- 172.21.15.123:0/3016783999 >> 172.21.15.123:0/3016783999 conn(0x7f667006f460 msgr2=0x7f66700731a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.170+0000 7f66754d7700 1 -- 172.21.15.123:0/3016783999 shutdown_connections 2024-09-13T17:10:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.170+0000 7f66754d7700 1 -- 172.21.15.123:0/3016783999 wait complete. 2024-09-13T17:10:03.177 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:10:03.190 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-13T17:10:02.793872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246136,"kb_used_data":9432,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754728584,"statfs":{"total":773094113280,"available":772842070016,"internally_reserved":0,"allocated":9658368,"data_stored":4764892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":242208313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.060081"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459871+0000","last_change":"2024-09-13T17:10:00.142668+0000","last_active":"2024-09-13T17:10:01.459871+0000","last_peered":"2024-09-13T17:10:01.459871+0000","last_clean":"2024-09-13T17:10:01.459871+0000","last_became_active":"2024-09-13T17:10:00.142439+0000","last_became_peered":"2024-09-13T17:10:00.142439+0000","last_unstale":"2024-09-13T17:10:01.459871+0000","last_undegraded":"2024-09-13T17:10:01.459871+0000","last_fullsized":"2024-09-13T17:10:01.459871+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:07.003447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.462020+0000","last_change":"2024-09-13T17:10:00.150926+0000","last_active":"2024-09-13T17:10:01.462020+0000","last_peered":"2024-09-13T17:10:01.462020+0000","last_clean":"2024-09-13T17:10:01.462020+0000","last_became_active":"2024-09-13T17:10:00.149190+0000","last_became_peered":"2024-09-13T17:10:00.149190+0000","last_unstale":"2024-09-13T17:10:01.462020+0000","last_undegraded":"2024-09-13T17:10:01.462020+0000","last_fullsized":"2024-09-13T17:10:01.462020+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:11.094128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.132485+0000","last_change":"2024-09-13T17:10:00.137889+0000","last_active":"2024-09-13T17:10:01.132485+0000","last_peered":"2024-09-13T17:10:01.132485+0000","last_clean":"2024-09-13T17:10:01.132485+0000","last_became_active":"2024-09-13T17:10:00.137581+0000","last_became_peered":"2024-09-13T17:10:00.137581+0000","last_unstale":"2024-09-13T17:10:01.132485+0000","last_undegraded":"2024-09-13T17:10:01.132485+0000","last_fullsized":"2024-09-13T17:10:01.132485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:27.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460761+0000","last_change":"2024-09-13T17:10:00.152886+0000","last_active":"2024-09-13T17:10:01.460761+0000","last_peered":"2024-09-13T17:10:01.460761+0000","last_clean":"2024-09-13T17:10:01.460761+0000","last_became_active":"2024-09-13T17:10:00.152589+0000","last_became_peered":"2024-09-13T17:10:00.152589+0000","last_unstale":"2024-09-13T17:10:01.460761+0000","last_undegraded":"2024-09-13T17:10:01.460761+0000","last_fullsized":"2024-09-13T17:10:01.460761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:33.390574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130946+0000","last_change":"2024-09-13T17:10:00.151293+0000","last_active":"2024-09-13T17:10:01.130946+0000","last_peered":"2024-09-13T17:10:01.130946+0000","last_clean":"2024-09-13T17:10:01.130946+0000","last_became_active":"2024-09-13T17:10:00.151053+0000","last_became_peered":"2024-09-13T17:10:00.151053+0000","last_unstale":"2024-09-13T17:10:01.130946+0000","last_undegraded":"2024-09-13T17:10:01.130946+0000","last_fullsized":"2024-09-13T17:10:01.130946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:18.217013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459491+0000","last_change":"2024-09-13T17:10:00.134418+0000","last_active":"2024-09-13T17:10:01.459491+0000","last_peered":"2024-09-13T17:10:01.459491+0000","last_clean":"2024-09-13T17:10:01.459491+0000","last_became_active":"2024-09-13T17:10:00.134033+0000","last_became_peered":"2024-09-13T17:10:00.134033+0000","last_unstale":"2024-09-13T17:10:01.459491+0000","last_undegraded":"2024-09-13T17:10:01.459491+0000","last_fullsized":"2024-09-13T17:10:01.459491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:39.811382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461041+0000","last_change":"2024-09-13T17:10:00.135108+0000","last_active":"2024-09-13T17:10:01.461041+0000","last_peered":"2024-09-13T17:10:01.461041+0000","last_clean":"2024-09-13T17:10:01.461041+0000","last_became_active":"2024-09-13T17:10:00.134866+0000","last_became_peered":"2024-09-13T17:10:00.134866+0000","last_unstale":"2024-09-13T17:10:01.461041+0000","last_undegraded":"2024-09-13T17:10:01.461041+0000","last_fullsized":"2024-09-13T17:10:01.461041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:00.983442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.458942+0000","last_change":"2024-09-13T17:10:00.152869+0000","last_active":"2024-09-13T17:10:01.458942+0000","last_peered":"2024-09-13T17:10:01.458942+0000","last_clean":"2024-09-13T17:10:01.458942+0000","last_became_active":"2024-09-13T17:10:00.152602+0000","last_became_peered":"2024-09-13T17:10:00.152602+0000","last_unstale":"2024-09-13T17:10:01.458942+0000","last_undegraded":"2024-09-13T17:10:01.458942+0000","last_fullsized":"2024-09-13T17:10:01.458942+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:45.284692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459832+0000","last_change":"2024-09-13T17:10:00.146869+0000","last_active":"2024-09-13T17:10:01.459832+0000","last_peered":"2024-09-13T17:10:01.459832+0000","last_clean":"2024-09-13T17:10:01.459832+0000","last_became_active":"2024-09-13T17:10:00.146607+0000","last_became_peered":"2024-09-13T17:10:00.146607+0000","last_unstale":"2024-09-13T17:10:01.459832+0000","last_undegraded":"2024-09-13T17:10:01.459832+0000","last_fullsized":"2024-09-13T17:10:01.459832+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:34.509041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460309+0000","last_change":"2024-09-13T17:10:00.145577+0000","last_active":"2024-09-13T17:10:01.460309+0000","last_peered":"2024-09-13T17:10:01.460309+0000","last_clean":"2024-09-13T17:10:01.460309+0000","last_became_active":"2024-09-13T17:10:00.145232+0000","last_became_peered":"2024-09-13T17:10:00.145232+0000","last_unstale":"2024-09-13T17:10:01.460309+0000","last_undegraded":"2024-09-13T17:10:01.460309+0000","last_fullsized":"2024-09-13T17:10:01.460309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:05.218655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461379+0000","last_change":"2024-09-13T17:10:00.142445+0000","last_active":"2024-09-13T17:10:01.461379+0000","last_peered":"2024-09-13T17:10:01.461379+0000","last_clean":"2024-09-13T17:10:01.461379+0000","last_became_active":"2024-09-13T17:10:00.141728+0000","last_became_peered":"2024-09-13T17:10:00.141728+0000","last_unstale":"2024-09-13T17:10:01.461379+0000","last_undegraded":"2024-09-13T17:10:01.461379+0000","last_fullsized":"2024-09-13T17:10:01.461379+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:50.540753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459899+0000","last_change":"2024-09-13T17:10:00.145124+0000","last_active":"2024-09-13T17:10:01.459899+0000","last_peered":"2024-09-13T17:10:01.459899+0000","last_clean":"2024-09-13T17:10:01.459899+0000","last_became_active":"2024-09-13T17:10:00.144862+0000","last_became_peered":"2024-09-13T17:10:00.144862+0000","last_unstale":"2024-09-13T17:10:01.459899+0000","last_undegraded":"2024-09-13T17:10:01.459899+0000","last_fullsized":"2024-09-13T17:10:01.459899+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:05.843507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130864+0000","last_change":"2024-09-13T17:10:00.135041+0000","last_active":"2024-09-13T17:10:01.130864+0000","last_peered":"2024-09-13T17:10:01.130864+0000","last_clean":"2024-09-13T17:10:01.130864+0000","last_became_active":"2024-09-13T17:10:00.134796+0000","last_became_peered":"2024-09-13T17:10:00.134796+0000","last_unstale":"2024-09-13T17:10:01.130864+0000","last_undegraded":"2024-09-13T17:10:01.130864+0000","last_fullsized":"2024-09-13T17:10:01.130864+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:56.160489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460356+0000","last_change":"2024-09-13T17:10:00.153684+0000","last_active":"2024-09-13T17:10:01.460356+0000","last_peered":"2024-09-13T17:10:01.460356+0000","last_clean":"2024-09-13T17:10:01.460356+0000","last_became_active":"2024-09-13T17:10:00.152607+0000","last_became_peered":"2024-09-13T17:10:00.152607+0000","last_unstale":"2024-09-13T17:10:01.460356+0000","last_undegraded":"2024-09-13T17:10:01.460356+0000","last_fullsized":"2024-09-13T17:10:01.460356+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:01.480482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.127755+0000","last_change":"2024-09-13T17:10:00.142095+0000","last_active":"2024-09-13T17:10:01.127755+0000","last_peered":"2024-09-13T17:10:01.127755+0000","last_clean":"2024-09-13T17:10:01.127755+0000","last_became_active":"2024-09-13T17:10:00.141780+0000","last_became_peered":"2024-09-13T17:10:00.141780+0000","last_unstale":"2024-09-13T17:10:01.127755+0000","last_undegraded":"2024-09-13T17:10:01.127755+0000","last_fullsized":"2024-09-13T17:10:01.127755+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:26.419350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130371+0000","last_change":"2024-09-13T17:10:00.142601+0000","last_active":"2024-09-13T17:10:01.130371+0000","last_peered":"2024-09-13T17:10:01.130371+0000","last_clean":"2024-09-13T17:10:01.130371+0000","last_became_active":"2024-09-13T17:10:00.142342+0000","last_became_peered":"2024-09-13T17:10:00.142342+0000","last_unstale":"2024-09-13T17:10:01.130371+0000","last_undegraded":"2024-09-13T17:10:01.130371+0000","last_fullsized":"2024-09-13T17:10:01.130371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:35.618573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131482+0000","last_change":"2024-09-13T17:10:00.133749+0000","last_active":"2024-09-13T17:10:01.131482+0000","last_peered":"2024-09-13T17:10:01.131482+0000","last_clean":"2024-09-13T17:10:01.131482+0000","last_became_active":"2024-09-13T17:10:00.133194+0000","last_became_peered":"2024-09-13T17:10:00.133194+0000","last_unstale":"2024-09-13T17:10:01.131482+0000","last_undegraded":"2024-09-13T17:10:01.131482+0000","last_fullsized":"2024-09-13T17:10:01.131482+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:58.208341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460510+0000","last_change":"2024-09-13T17:10:00.143625+0000","last_active":"2024-09-13T17:10:01.460510+0000","last_peered":"2024-09-13T17:10:01.460510+0000","last_clean":"2024-09-13T17:10:01.460510+0000","last_became_active":"2024-09-13T17:10:00.143443+0000","last_became_peered":"2024-09-13T17:10:00.143443+0000","last_unstale":"2024-09-13T17:10:01.460510+0000","last_undegraded":"2024-09-13T17:10:01.460510+0000","last_fullsized":"2024-09-13T17:10:01.460510+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:09.640587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360608+0000","last_change":"2024-09-13T17:10:00.150108+0000","last_active":"2024-09-13T17:10:01.360608+0000","last_peered":"2024-09-13T17:10:01.360608+0000","last_clean":"2024-09-13T17:10:01.360608+0000","last_became_active":"2024-09-13T17:10:00.149729+0000","last_became_peered":"2024-09-13T17:10:00.149729+0000","last_unstale":"2024-09-13T17:10:01.360608+0000","last_undegraded":"2024-09-13T17:10:01.360608+0000","last_fullsized":"2024-09-13T17:10:01.360608+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:56.105440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460851+0000","last_change":"2024-09-13T17:10:00.148067+0000","last_active":"2024-09-13T17:10:01.460851+0000","last_peered":"2024-09-13T17:10:01.460851+0000","last_clean":"2024-09-13T17:10:01.460851+0000","last_became_active":"2024-09-13T17:10:00.147474+0000","last_became_peered":"2024-09-13T17:10:00.147474+0000","last_unstale":"2024-09-13T17:10:01.460851+0000","last_undegraded":"2024-09-13T17:10:01.460851+0000","last_fullsized":"2024-09-13T17:10:01.460851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:43.291632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460800+0000","last_change":"2024-09-13T17:10:00.151717+0000","last_active":"2024-09-13T17:10:01.460800+0000","last_peered":"2024-09-13T17:10:01.460800+0000","last_clean":"2024-09-13T17:10:01.460800+0000","last_became_active":"2024-09-13T17:10:00.151390+0000","last_became_peered":"2024-09-13T17:10:00.151390+0000","last_unstale":"2024-09-13T17:10:01.460800+0000","last_undegraded":"2024-09-13T17:10:01.460800+0000","last_fullsized":"2024-09-13T17:10:01.460800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:55.010609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461942+0000","last_change":"2024-09-13T17:10:00.153185+0000","last_active":"2024-09-13T17:10:01.461942+0000","last_peered":"2024-09-13T17:10:01.461942+0000","last_clean":"2024-09-13T17:10:01.461942+0000","last_became_active":"2024-09-13T17:10:00.152966+0000","last_became_peered":"2024-09-13T17:10:00.152966+0000","last_unstale":"2024-09-13T17:10:01.461942+0000","last_undegraded":"2024-09-13T17:10:01.461942+0000","last_fullsized":"2024-09-13T17:10:01.461942+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:28.802332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459288+0000","last_change":"2024-09-13T17:10:00.150346+0000","last_active":"2024-09-13T17:10:01.459288+0000","last_peered":"2024-09-13T17:10:01.459288+0000","last_clean":"2024-09-13T17:10:01.459288+0000","last_became_active":"2024-09-13T17:10:00.150117+0000","last_became_peered":"2024-09-13T17:10:00.150117+0000","last_unstale":"2024-09-13T17:10:01.459288+0000","last_undegraded":"2024-09-13T17:10:01.459288+0000","last_fullsized":"2024-09-13T17:10:01.459288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:58.208341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459985+0000","last_change":"2024-09-13T17:10:00.138985+0000","last_active":"2024-09-13T17:10:01.459985+0000","last_peered":"2024-09-13T17:10:01.459985+0000","last_clean":"2024-09-13T17:10:01.459985+0000","last_became_active":"2024-09-13T17:10:00.138637+0000","last_became_peered":"2024-09-13T17:10:00.138637+0000","last_unstale":"2024-09-13T17:10:01.459985+0000","last_undegraded":"2024-09-13T17:10:01.459985+0000","last_fullsized":"2024-09-13T17:10:01.459985+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.536185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461503+0000","last_change":"2024-09-13T17:10:00.148945+0000","last_active":"2024-09-13T17:10:01.461503+0000","last_peered":"2024-09-13T17:10:01.461503+0000","last_clean":"2024-09-13T17:10:01.461503+0000","last_became_active":"2024-09-13T17:10:00.148699+0000","last_became_peered":"2024-09-13T17:10:00.148699+0000","last_unstale":"2024-09-13T17:10:01.461503+0000","last_undegraded":"2024-09-13T17:10:01.461503+0000","last_fullsized":"2024-09-13T17:10:01.461503+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:54.719530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.132214+0000","last_change":"2024-09-13T17:10:00.138758+0000","last_active":"2024-09-13T17:10:01.132214+0000","last_peered":"2024-09-13T17:10:01.132214+0000","last_clean":"2024-09-13T17:10:01.132214+0000","last_became_active":"2024-09-13T17:10:00.138474+0000","last_became_peered":"2024-09-13T17:10:00.138474+0000","last_unstale":"2024-09-13T17:10:01.132214+0000","last_undegraded":"2024-09-13T17:10:01.132214+0000","last_fullsized":"2024-09-13T17:10:01.132214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:51.346670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130836+0000","last_change":"2024-09-13T17:10:00.144089+0000","last_active":"2024-09-13T17:10:01.130836+0000","last_peered":"2024-09-13T17:10:01.130836+0000","last_clean":"2024-09-13T17:10:01.130836+0000","last_became_active":"2024-09-13T17:10:00.143838+0000","last_became_peered":"2024-09-13T17:10:00.143838+0000","last_unstale":"2024-09-13T17:10:01.130836+0000","last_undegraded":"2024-09-13T17:10:01.130836+0000","last_fullsized":"2024-09-13T17:10:01.130836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:48.556200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459308+0000","last_change":"2024-09-13T17:10:00.143242+0000","last_active":"2024-09-13T17:10:01.459308+0000","last_peered":"2024-09-13T17:10:01.459308+0000","last_clean":"2024-09-13T17:10:01.459308+0000","last_became_active":"2024-09-13T17:10:00.142778+0000","last_became_peered":"2024-09-13T17:10:00.142778+0000","last_unstale":"2024-09-13T17:10:01.459308+0000","last_undegraded":"2024-09-13T17:10:01.459308+0000","last_fullsized":"2024-09-13T17:10:01.459308+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:18.217013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461734+0000","last_change":"2024-09-13T17:10:00.149053+0000","last_active":"2024-09-13T17:10:01.461734+0000","last_peered":"2024-09-13T17:10:01.461734+0000","last_clean":"2024-09-13T17:10:01.461734+0000","last_became_active":"2024-09-13T17:10:00.148823+0000","last_became_peered":"2024-09-13T17:10:00.148823+0000","last_unstale":"2024-09-13T17:10:01.461734+0000","last_undegraded":"2024-09-13T17:10:01.461734+0000","last_fullsized":"2024-09-13T17:10:01.461734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:00.679023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461972+0000","last_change":"2024-09-13T17:10:00.148132+0000","last_active":"2024-09-13T17:10:01.461972+0000","last_peered":"2024-09-13T17:10:01.461972+0000","last_clean":"2024-09-13T17:10:01.461972+0000","last_became_active":"2024-09-13T17:10:00.146758+0000","last_became_peered":"2024-09-13T17:10:00.146758+0000","last_unstale":"2024-09-13T17:10:01.461972+0000","last_undegraded":"2024-09-13T17:10:01.461972+0000","last_fullsized":"2024-09-13T17:10:01.461972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:22.008799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130324+0000","last_change":"2024-09-13T17:10:00.146744+0000","last_active":"2024-09-13T17:10:01.130324+0000","last_peered":"2024-09-13T17:10:01.130324+0000","last_clean":"2024-09-13T17:10:01.130324+0000","last_became_active":"2024-09-13T17:10:00.146473+0000","last_became_peered":"2024-09-13T17:10:00.146473+0000","last_unstale":"2024-09-13T17:10:01.130324+0000","last_undegraded":"2024-09-13T17:10:01.130324+0000","last_fullsized":"2024-09-13T17:10:01.130324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:33.167397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459034+0000","last_change":"2024-09-13T17:10:00.154478+0000","last_active":"2024-09-13T17:10:01.459034+0000","last_peered":"2024-09-13T17:10:01.459034+0000","last_clean":"2024-09-13T17:10:01.459034+0000","last_became_active":"2024-09-13T17:10:00.154154+0000","last_became_peered":"2024-09-13T17:10:00.154154+0000","last_unstale":"2024-09-13T17:10:01.459034+0000","last_undegraded":"2024-09-13T17:10:01.459034+0000","last_fullsized":"2024-09-13T17:10:01.459034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:53.424016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130795+0000","last_change":"2024-09-13T17:10:00.142625+0000","last_active":"2024-09-13T17:10:01.130795+0000","last_peered":"2024-09-13T17:10:01.130795+0000","last_clean":"2024-09-13T17:10:01.130795+0000","last_became_active":"2024-09-13T17:10:00.142373+0000","last_became_peered":"2024-09-13T17:10:00.142373+0000","last_unstale":"2024-09-13T17:10:01.130795+0000","last_undegraded":"2024-09-13T17:10:01.130795+0000","last_fullsized":"2024-09-13T17:10:01.130795+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:45.284692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"85'4","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460558+0000","last_change":"2024-09-13T17:09:59.756290+0000","last_active":"2024-09-13T17:10:01.460558+0000","last_peered":"2024-09-13T17:10:01.460558+0000","last_clean":"2024-09-13T17:10:01.460558+0000","last_became_active":"2024-09-13T17:09:59.756002+0000","last_became_peered":"2024-09-13T17:09:59.756002+0000","last_unstale":"2024-09-13T17:10:01.460558+0000","last_undegraded":"2024-09-13T17:10:01.460558+0000","last_fullsized":"2024-09-13T17:10:01.460558+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:25.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460110+0000","last_change":"2024-09-13T17:10:00.150309+0000","last_active":"2024-09-13T17:10:01.460110+0000","last_peered":"2024-09-13T17:10:01.460110+0000","last_clean":"2024-09-13T17:10:01.460110+0000","last_became_active":"2024-09-13T17:10:00.150040+0000","last_became_peered":"2024-09-13T17:10:00.150040+0000","last_unstale":"2024-09-13T17:10:01.460110+0000","last_undegraded":"2024-09-13T17:10:01.460110+0000","last_fullsized":"2024-09-13T17:10:01.460110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:33.167397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"85'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131649+0000","last_change":"2024-09-13T17:09:59.763147+0000","last_active":"2024-09-13T17:10:01.131649+0000","last_peered":"2024-09-13T17:10:01.131649+0000","last_clean":"2024-09-13T17:10:01.131649+0000","last_became_active":"2024-09-13T17:09:59.762449+0000","last_became_peered":"2024-09-13T17:09:59.762449+0000","last_unstale":"2024-09-13T17:10:01.131649+0000","last_undegraded":"2024-09-13T17:10:01.131649+0000","last_fullsized":"2024-09-13T17:10:01.131649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:55.772560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459541+0000","last_change":"2024-09-13T17:10:00.151962+0000","last_active":"2024-09-13T17:10:01.459541+0000","last_peered":"2024-09-13T17:10:01.459541+0000","last_clean":"2024-09-13T17:10:01.459541+0000","last_became_active":"2024-09-13T17:10:00.151701+0000","last_became_peered":"2024-09-13T17:10:00.151701+0000","last_unstale":"2024-09-13T17:10:01.459541+0000","last_undegraded":"2024-09-13T17:10:01.459541+0000","last_fullsized":"2024-09-13T17:10:01.459541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:54.389943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"85'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360758+0000","last_change":"2024-09-13T17:09:59.757280+0000","last_active":"2024-09-13T17:10:01.360758+0000","last_peered":"2024-09-13T17:10:01.360758+0000","last_clean":"2024-09-13T17:10:01.360758+0000","last_became_active":"2024-09-13T17:09:59.757020+0000","last_became_peered":"2024-09-13T17:09:59.757020+0000","last_unstale":"2024-09-13T17:10:01.360758+0000","last_undegraded":"2024-09-13T17:10:01.360758+0000","last_fullsized":"2024-09-13T17:10:01.360758+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:52.420683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.132241+0000","last_change":"2024-09-13T17:10:00.133991+0000","last_active":"2024-09-13T17:10:01.132241+0000","last_peered":"2024-09-13T17:10:01.132241+0000","last_clean":"2024-09-13T17:10:01.132241+0000","last_became_active":"2024-09-13T17:10:00.133743+0000","last_became_peered":"2024-09-13T17:10:00.133743+0000","last_unstale":"2024-09-13T17:10:01.132241+0000","last_undegraded":"2024-09-13T17:10:01.132241+0000","last_fullsized":"2024-09-13T17:10:01.132241+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:56.105440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"85'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360379+0000","last_change":"2024-09-13T17:09:59.758435+0000","last_active":"2024-09-13T17:10:01.360379+0000","last_peered":"2024-09-13T17:10:01.360379+0000","last_clean":"2024-09-13T17:10:01.360379+0000","last_became_active":"2024-09-13T17:09:59.758153+0000","last_became_peered":"2024-09-13T17:09:59.758153+0000","last_unstale":"2024-09-13T17:10:01.360379+0000","last_undegraded":"2024-09-13T17:10:01.360379+0000","last_fullsized":"2024-09-13T17:10:01.360379+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:06.000114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.462144+0000","last_change":"2024-09-13T17:10:00.147882+0000","last_active":"2024-09-13T17:10:01.462144+0000","last_peered":"2024-09-13T17:10:01.462144+0000","last_clean":"2024-09-13T17:10:01.462144+0000","last_became_active":"2024-09-13T17:10:00.143030+0000","last_became_peered":"2024-09-13T17:10:00.143030+0000","last_unstale":"2024-09-13T17:10:01.462144+0000","last_undegraded":"2024-09-13T17:10:01.462144+0000","last_fullsized":"2024-09-13T17:10:01.462144+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:12.346720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"85'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131568+0000","last_change":"2024-09-13T17:09:59.763138+0000","last_active":"2024-09-13T17:10:01.131568+0000","last_peered":"2024-09-13T17:10:01.131568+0000","last_clean":"2024-09-13T17:10:01.131568+0000","last_became_active":"2024-09-13T17:09:59.761156+0000","last_became_peered":"2024-09-13T17:09:59.761156+0000","last_unstale":"2024-09-13T17:10:01.131568+0000","last_undegraded":"2024-09-13T17:10:01.131568+0000","last_fullsized":"2024-09-13T17:10:01.131568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:25.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131178+0000","last_change":"2024-09-13T17:10:00.134608+0000","last_active":"2024-09-13T17:10:01.131178+0000","last_peered":"2024-09-13T17:10:01.131178+0000","last_clean":"2024-09-13T17:10:01.131178+0000","last_became_active":"2024-09-13T17:10:00.134127+0000","last_became_peered":"2024-09-13T17:10:00.134127+0000","last_unstale":"2024-09-13T17:10:01.131178+0000","last_undegraded":"2024-09-13T17:10:01.131178+0000","last_fullsized":"2024-09-13T17:10:01.131178+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:05.843507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"85'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131867+0000","last_change":"2024-09-13T17:09:59.763003+0000","last_active":"2024-09-13T17:10:01.131867+0000","last_peered":"2024-09-13T17:10:01.131867+0000","last_clean":"2024-09-13T17:10:01.131867+0000","last_became_active":"2024-09-13T17:09:59.761197+0000","last_became_peered":"2024-09-13T17:09:59.761197+0000","last_unstale":"2024-09-13T17:10:01.131867+0000","last_undegraded":"2024-09-13T17:10:01.131867+0000","last_fullsized":"2024-09-13T17:10:01.131867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:59.675690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130883+0000","last_change":"2024-09-13T17:10:00.137965+0000","last_active":"2024-09-13T17:10:01.130883+0000","last_peered":"2024-09-13T17:10:01.130883+0000","last_clean":"2024-09-13T17:10:01.130883+0000","last_became_active":"2024-09-13T17:10:00.137698+0000","last_became_peered":"2024-09-13T17:10:00.137698+0000","last_unstale":"2024-09-13T17:10:01.130883+0000","last_undegraded":"2024-09-13T17:10:01.130883+0000","last_fullsized":"2024-09-13T17:10:01.130883+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:23.929852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.359709+0000","last_change":"2024-09-13T17:09:59.760602+0000","last_active":"2024-09-13T17:10:01.359709+0000","last_peered":"2024-09-13T17:10:01.359709+0000","last_clean":"2024-09-13T17:10:01.359709+0000","last_became_active":"2024-09-13T17:09:59.760304+0000","last_became_peered":"2024-09-13T17:09:59.760304+0000","last_unstale":"2024-09-13T17:10:01.359709+0000","last_undegraded":"2024-09-13T17:10:01.359709+0000","last_fullsized":"2024-09-13T17:10:01.359709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:04.840174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.127912+0000","last_change":"2024-09-13T17:10:00.142553+0000","last_active":"2024-09-13T17:10:01.127912+0000","last_peered":"2024-09-13T17:10:01.127912+0000","last_clean":"2024-09-13T17:10:01.127912+0000","last_became_active":"2024-09-13T17:10:00.142322+0000","last_became_peered":"2024-09-13T17:10:00.142322+0000","last_unstale":"2024-09-13T17:10:01.127912+0000","last_undegraded":"2024-09-13T17:10:01.127912+0000","last_fullsized":"2024-09-13T17:10:01.127912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:33.844836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461575+0000","last_change":"2024-09-13T17:09:59.762962+0000","last_active":"2024-09-13T17:10:01.461575+0000","last_peered":"2024-09-13T17:10:01.461575+0000","last_clean":"2024-09-13T17:10:01.461575+0000","last_became_active":"2024-09-13T17:09:59.762646+0000","last_became_peered":"2024-09-13T17:09:59.762646+0000","last_unstale":"2024-09-13T17:10:01.461575+0000","last_undegraded":"2024-09-13T17:10:01.461575+0000","last_fullsized":"2024-09-13T17:10:01.461575+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:42.288299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.128314+0000","last_change":"2024-09-13T17:10:00.141947+0000","last_active":"2024-09-13T17:10:01.128314+0000","last_peered":"2024-09-13T17:10:01.128314+0000","last_clean":"2024-09-13T17:10:01.128314+0000","last_became_active":"2024-09-13T17:10:00.141715+0000","last_became_peered":"2024-09-13T17:10:00.141715+0000","last_unstale":"2024-09-13T17:10:01.128314+0000","last_undegraded":"2024-09-13T17:10:01.128314+0000","last_fullsized":"2024-09-13T17:10:01.128314+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:04.048489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460649+0000","last_change":"2024-09-13T17:09:59.757028+0000","last_active":"2024-09-13T17:10:01.460649+0000","last_peered":"2024-09-13T17:10:01.460649+0000","last_clean":"2024-09-13T17:10:01.460649+0000","last_became_active":"2024-09-13T17:09:59.756695+0000","last_became_peered":"2024-09-13T17:09:59.756695+0000","last_unstale":"2024-09-13T17:10:01.460649+0000","last_undegraded":"2024-09-13T17:10:01.460649+0000","last_fullsized":"2024-09-13T17:10:01.460649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:38.182431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459851+0000","last_change":"2024-09-13T17:10:00.132823+0000","last_active":"2024-09-13T17:10:01.459851+0000","last_peered":"2024-09-13T17:10:01.459851+0000","last_clean":"2024-09-13T17:10:01.459851+0000","last_became_active":"2024-09-13T17:10:00.132579+0000","last_became_peered":"2024-09-13T17:10:00.132579+0000","last_unstale":"2024-09-13T17:10:01.459851+0000","last_undegraded":"2024-09-13T17:10:01.459851+0000","last_fullsized":"2024-09-13T17:10:01.459851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:15:40.423580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460442+0000","last_change":"2024-09-13T17:09:59.763067+0000","last_active":"2024-09-13T17:10:01.460442+0000","last_peered":"2024-09-13T17:10:01.460442+0000","last_clean":"2024-09-13T17:10:01.460442+0000","last_became_active":"2024-09-13T17:09:59.762793+0000","last_became_peered":"2024-09-13T17:09:59.762793+0000","last_unstale":"2024-09-13T17:10:01.460442+0000","last_undegraded":"2024-09-13T17:10:01.460442+0000","last_fullsized":"2024-09-13T17:10:01.460442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:18.984157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360273+0000","last_change":"2024-09-13T17:10:00.149781+0000","last_active":"2024-09-13T17:10:01.360273+0000","last_peered":"2024-09-13T17:10:01.360273+0000","last_clean":"2024-09-13T17:10:01.360273+0000","last_became_active":"2024-09-13T17:10:00.148381+0000","last_became_peered":"2024-09-13T17:10:00.148381+0000","last_unstale":"2024-09-13T17:10:01.360273+0000","last_undegraded":"2024-09-13T17:10:01.360273+0000","last_fullsized":"2024-09-13T17:10:01.360273+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:38.730800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"85'3","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459301+0000","last_change":"2024-09-13T17:09:59.755947+0000","last_active":"2024-09-13T17:10:01.459301+0000","last_peered":"2024-09-13T17:10:01.459301+0000","last_clean":"2024-09-13T17:10:01.459301+0000","last_became_active":"2024-09-13T17:09:59.755637+0000","last_became_peered":"2024-09-13T17:09:59.755637+0000","last_unstale":"2024-09-13T17:10:01.459301+0000","last_undegraded":"2024-09-13T17:10:01.459301+0000","last_fullsized":"2024-09-13T17:10:01.459301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:31.722853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131154+0000","last_change":"2024-09-13T17:10:00.152661+0000","last_active":"2024-09-13T17:10:01.131154+0000","last_peered":"2024-09-13T17:10:01.131154+0000","last_clean":"2024-09-13T17:10:01.131154+0000","last_became_active":"2024-09-13T17:10:00.152449+0000","last_became_peered":"2024-09-13T17:10:00.152449+0000","last_unstale":"2024-09-13T17:10:01.131154+0000","last_undegraded":"2024-09-13T17:10:01.131154+0000","last_fullsized":"2024-09-13T17:10:01.131154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:54.389943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"85'6","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460213+0000","last_change":"2024-09-13T17:09:59.757281+0000","last_active":"2024-09-13T17:10:01.460213+0000","last_peered":"2024-09-13T17:10:01.460213+0000","last_clean":"2024-09-13T17:10:01.460213+0000","last_became_active":"2024-09-13T17:09:59.757002+0000","last_became_peered":"2024-09-13T17:09:59.757002+0000","last_unstale":"2024-09-13T17:10:01.460213+0000","last_undegraded":"2024-09-13T17:10:01.460213+0000","last_fullsized":"2024-09-13T17:10:01.460213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:10.090796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.359860+0000","last_change":"2024-09-13T17:10:00.150544+0000","last_active":"2024-09-13T17:10:01.359860+0000","last_peered":"2024-09-13T17:10:01.359860+0000","last_clean":"2024-09-13T17:10:01.359860+0000","last_became_active":"2024-09-13T17:10:00.148458+0000","last_became_peered":"2024-09-13T17:10:00.148458+0000","last_unstale":"2024-09-13T17:10:01.359860+0000","last_undegraded":"2024-09-13T17:10:01.359860+0000","last_fullsized":"2024-09-13T17:10:01.359860+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:23.929852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"85'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461725+0000","last_change":"2024-09-13T17:09:59.756977+0000","last_active":"2024-09-13T17:10:01.461725+0000","last_peered":"2024-09-13T17:10:01.461725+0000","last_clean":"2024-09-13T17:10:01.461725+0000","last_became_active":"2024-09-13T17:09:59.756703+0000","last_became_peered":"2024-09-13T17:09:59.756703+0000","last_unstale":"2024-09-13T17:10:01.461725+0000","last_undegraded":"2024-09-13T17:10:01.461725+0000","last_fullsized":"2024-09-13T17:10:01.461725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:06.860118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131962+0000","last_change":"2024-09-13T17:10:00.146738+0000","last_active":"2024-09-13T17:10:01.131962+0000","last_peered":"2024-09-13T17:10:01.131962+0000","last_clean":"2024-09-13T17:10:01.131962+0000","last_became_active":"2024-09-13T17:10:00.146519+0000","last_became_peered":"2024-09-13T17:10:00.146519+0000","last_unstale":"2024-09-13T17:10:01.131962+0000","last_undegraded":"2024-09-13T17:10:01.131962+0000","last_fullsized":"2024-09-13T17:10:01.131962+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:33.119970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.127946+0000","last_change":"2024-09-13T17:09:59.757900+0000","last_active":"2024-09-13T17:10:01.127946+0000","last_peered":"2024-09-13T17:10:01.127946+0000","last_clean":"2024-09-13T17:10:01.127946+0000","last_became_active":"2024-09-13T17:09:59.757434+0000","last_became_peered":"2024-09-13T17:09:59.757434+0000","last_unstale":"2024-09-13T17:10:01.127946+0000","last_undegraded":"2024-09-13T17:10:01.127946+0000","last_fullsized":"2024-09-13T17:10:01.127946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:04.840174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461646+0000","last_change":"2024-09-13T17:10:00.147692+0000","last_active":"2024-09-13T17:10:01.461646+0000","last_peered":"2024-09-13T17:10:01.461646+0000","last_clean":"2024-09-13T17:10:01.461646+0000","last_became_active":"2024-09-13T17:10:00.143031+0000","last_became_peered":"2024-09-13T17:10:00.143031+0000","last_unstale":"2024-09-13T17:10:01.461646+0000","last_undegraded":"2024-09-13T17:10:01.461646+0000","last_fullsized":"2024-09-13T17:10:01.461646+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:59.785880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459250+0000","last_change":"2024-09-13T17:09:59.761204+0000","last_active":"2024-09-13T17:10:01.459250+0000","last_peered":"2024-09-13T17:10:01.459250+0000","last_clean":"2024-09-13T17:10:01.459250+0000","last_became_active":"2024-09-13T17:09:59.760948+0000","last_became_peered":"2024-09-13T17:09:59.760948+0000","last_unstale":"2024-09-13T17:10:01.459250+0000","last_undegraded":"2024-09-13T17:10:01.459250+0000","last_fullsized":"2024-09-13T17:10:01.459250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:25.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460648+0000","last_change":"2024-09-13T17:10:00.149009+0000","last_active":"2024-09-13T17:10:01.460648+0000","last_peered":"2024-09-13T17:10:01.460648+0000","last_clean":"2024-09-13T17:10:01.460648+0000","last_became_active":"2024-09-13T17:10:00.148738+0000","last_became_peered":"2024-09-13T17:10:00.148738+0000","last_unstale":"2024-09-13T17:10:01.460648+0000","last_undegraded":"2024-09-13T17:10:01.460648+0000","last_fullsized":"2024-09-13T17:10:01.460648+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:27.002775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"85'8","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.359586+0000","last_change":"2024-09-13T17:09:59.759450+0000","last_active":"2024-09-13T17:10:01.359586+0000","last_peered":"2024-09-13T17:10:01.359586+0000","last_clean":"2024-09-13T17:10:01.359586+0000","last_became_active":"2024-09-13T17:09:59.758913+0000","last_became_peered":"2024-09-13T17:09:59.758913+0000","last_unstale":"2024-09-13T17:10:01.359586+0000","last_undegraded":"2024-09-13T17:10:01.359586+0000","last_fullsized":"2024-09-13T17:10:01.359586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:32.164064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.132310+0000","last_change":"2024-09-13T17:10:00.133183+0000","last_active":"2024-09-13T17:10:01.132310+0000","last_peered":"2024-09-13T17:10:01.132310+0000","last_clean":"2024-09-13T17:10:01.132310+0000","last_became_active":"2024-09-13T17:10:00.132957+0000","last_became_peered":"2024-09-13T17:10:00.132957+0000","last_unstale":"2024-09-13T17:10:01.132310+0000","last_undegraded":"2024-09-13T17:10:01.132310+0000","last_fullsized":"2024-09-13T17:10:01.132310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:28.833515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"85'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460852+0000","last_change":"2024-09-13T17:09:59.758816+0000","last_active":"2024-09-13T17:10:01.460852+0000","last_peered":"2024-09-13T17:10:01.460852+0000","last_clean":"2024-09-13T17:10:01.460852+0000","last_became_active":"2024-09-13T17:09:59.758513+0000","last_became_peered":"2024-09-13T17:09:59.758513+0000","last_unstale":"2024-09-13T17:10:01.460852+0000","last_undegraded":"2024-09-13T17:10:01.460852+0000","last_fullsized":"2024-09-13T17:10:01.460852+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:55.772560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460339+0000","last_change":"2024-09-13T17:10:00.137472+0000","last_active":"2024-09-13T17:10:01.460339+0000","last_peered":"2024-09-13T17:10:01.460339+0000","last_clean":"2024-09-13T17:10:01.460339+0000","last_became_active":"2024-09-13T17:10:00.137205+0000","last_became_peered":"2024-09-13T17:10:00.137205+0000","last_unstale":"2024-09-13T17:10:01.460339+0000","last_undegraded":"2024-09-13T17:10:01.460339+0000","last_fullsized":"2024-09-13T17:10:01.460339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:34.509041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"85'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360614+0000","last_change":"2024-09-13T17:09:59.764076+0000","last_active":"2024-09-13T17:10:01.360614+0000","last_peered":"2024-09-13T17:10:01.360614+0000","last_clean":"2024-09-13T17:10:01.360614+0000","last_became_active":"2024-09-13T17:09:59.763797+0000","last_became_peered":"2024-09-13T17:09:59.763797+0000","last_unstale":"2024-09-13T17:10:01.360614+0000","last_undegraded":"2024-09-13T17:10:01.360614+0000","last_fullsized":"2024-09-13T17:10:01.360614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:04.215322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131179+0000","last_change":"2024-09-13T17:10:00.153319+0000","last_active":"2024-09-13T17:10:01.131179+0000","last_peered":"2024-09-13T17:10:01.131179+0000","last_clean":"2024-09-13T17:10:01.131179+0000","last_became_active":"2024-09-13T17:10:00.153104+0000","last_became_peered":"2024-09-13T17:10:00.153104+0000","last_unstale":"2024-09-13T17:10:01.131179+0000","last_undegraded":"2024-09-13T17:10:01.131179+0000","last_fullsized":"2024-09-13T17:10:01.131179+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:53.424016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360452+0000","last_change":"2024-09-13T17:09:59.760580+0000","last_active":"2024-09-13T17:10:01.360452+0000","last_peered":"2024-09-13T17:10:01.360452+0000","last_clean":"2024-09-13T17:10:01.360452+0000","last_became_active":"2024-09-13T17:09:59.760317+0000","last_became_peered":"2024-09-13T17:09:59.760317+0000","last_unstale":"2024-09-13T17:10:01.360452+0000","last_undegraded":"2024-09-13T17:10:01.360452+0000","last_fullsized":"2024-09-13T17:10:01.360452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:32.841503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460445+0000","last_change":"2024-09-13T17:10:00.153710+0000","last_active":"2024-09-13T17:10:01.460445+0000","last_peered":"2024-09-13T17:10:01.460445+0000","last_clean":"2024-09-13T17:10:01.460445+0000","last_became_active":"2024-09-13T17:10:00.152572+0000","last_became_peered":"2024-09-13T17:10:00.152572+0000","last_unstale":"2024-09-13T17:10:01.460445+0000","last_undegraded":"2024-09-13T17:10:01.460445+0000","last_fullsized":"2024-09-13T17:10:01.460445+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:04.535878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"85'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.128294+0000","last_change":"2024-09-13T17:09:59.756068+0000","last_active":"2024-09-13T17:10:01.128294+0000","last_peered":"2024-09-13T17:10:01.128294+0000","last_clean":"2024-09-13T17:10:01.128294+0000","last_became_active":"2024-09-13T17:09:59.755762+0000","last_became_peered":"2024-09-13T17:09:59.755762+0000","last_unstale":"2024-09-13T17:10:01.128294+0000","last_undegraded":"2024-09-13T17:10:01.128294+0000","last_fullsized":"2024-09-13T17:10:01.128294+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:57.205009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459352+0000","last_change":"2024-09-13T17:10:00.144221+0000","last_active":"2024-09-13T17:10:01.459352+0000","last_peered":"2024-09-13T17:10:01.459352+0000","last_clean":"2024-09-13T17:10:01.459352+0000","last_became_active":"2024-09-13T17:10:00.144021+0000","last_became_peered":"2024-09-13T17:10:00.144021+0000","last_unstale":"2024-09-13T17:10:01.459352+0000","last_undegraded":"2024-09-13T17:10:01.459352+0000","last_fullsized":"2024-09-13T17:10:01.459352+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:35.618573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460525+0000","last_change":"2024-09-13T17:09:59.755097+0000","last_active":"2024-09-13T17:10:01.460525+0000","last_peered":"2024-09-13T17:10:01.460525+0000","last_clean":"2024-09-13T17:10:01.460525+0000","last_became_active":"2024-09-13T17:09:59.754027+0000","last_became_peered":"2024-09-13T17:09:59.754027+0000","last_unstale":"2024-09-13T17:10:01.460525+0000","last_undegraded":"2024-09-13T17:10:01.460525+0000","last_fullsized":"2024-09-13T17:10:01.460525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:35.140445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460243+0000","last_change":"2024-09-13T17:10:00.132840+0000","last_active":"2024-09-13T17:10:01.460243+0000","last_peered":"2024-09-13T17:10:01.460243+0000","last_clean":"2024-09-13T17:10:01.460243+0000","last_became_active":"2024-09-13T17:10:00.132579+0000","last_became_peered":"2024-09-13T17:10:00.132579+0000","last_unstale":"2024-09-13T17:10:01.460243+0000","last_undegraded":"2024-09-13T17:10:01.460243+0000","last_fullsized":"2024-09-13T17:10:01.460243+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:04.484639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460304+0000","last_change":"2024-09-13T17:09:59.754905+0000","last_active":"2024-09-13T17:10:01.460304+0000","last_peered":"2024-09-13T17:10:01.460304+0000","last_clean":"2024-09-13T17:10:01.460304+0000","last_became_active":"2024-09-13T17:09:59.754649+0000","last_became_peered":"2024-09-13T17:09:59.754649+0000","last_unstale":"2024-09-13T17:10:01.460304+0000","last_undegraded":"2024-09-13T17:10:01.460304+0000","last_fullsized":"2024-09-13T17:10:01.460304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.000829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.458976+0000","last_change":"2024-09-13T17:10:00.152505+0000","last_active":"2024-09-13T17:10:01.458976+0000","last_peered":"2024-09-13T17:10:01.458976+0000","last_clean":"2024-09-13T17:10:01.458976+0000","last_became_active":"2024-09-13T17:10:00.152193+0000","last_became_peered":"2024-09-13T17:10:00.152193+0000","last_unstale":"2024-09-13T17:10:01.458976+0000","last_undegraded":"2024-09-13T17:10:01.458976+0000","last_fullsized":"2024-09-13T17:10:01.458976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:48.556200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.127793+0000","last_change":"2024-09-13T17:09:59.756770+0000","last_active":"2024-09-13T17:10:01.127793+0000","last_peered":"2024-09-13T17:10:01.127793+0000","last_clean":"2024-09-13T17:10:01.127793+0000","last_became_active":"2024-09-13T17:09:59.756514+0000","last_became_peered":"2024-09-13T17:09:59.756514+0000","last_unstale":"2024-09-13T17:10:01.127793+0000","last_undegraded":"2024-09-13T17:10:01.127793+0000","last_fullsized":"2024-09-13T17:10:01.127793+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:04.215322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131021+0000","last_change":"2024-09-13T17:10:00.133443+0000","last_active":"2024-09-13T17:10:01.131021+0000","last_peered":"2024-09-13T17:10:01.131021+0000","last_clean":"2024-09-13T17:10:01.131021+0000","last_became_active":"2024-09-13T17:10:00.133190+0000","last_became_peered":"2024-09-13T17:10:00.133190+0000","last_unstale":"2024-09-13T17:10:01.131021+0000","last_undegraded":"2024-09-13T17:10:01.131021+0000","last_fullsized":"2024-09-13T17:10:01.131021+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:05.218655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"85'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461695+0000","last_change":"2024-09-13T17:09:59.759991+0000","last_active":"2024-09-13T17:10:01.461695+0000","last_peered":"2024-09-13T17:10:01.461695+0000","last_clean":"2024-09-13T17:10:01.461695+0000","last_became_active":"2024-09-13T17:09:59.759705+0000","last_became_peered":"2024-09-13T17:09:59.759705+0000","last_unstale":"2024-09-13T17:10:01.461695+0000","last_undegraded":"2024-09-13T17:10:01.461695+0000","last_fullsized":"2024-09-13T17:10:01.461695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:00.477149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.132479+0000","last_change":"2024-09-13T17:10:00.142862+0000","last_active":"2024-09-13T17:10:01.132479+0000","last_peered":"2024-09-13T17:10:01.132479+0000","last_clean":"2024-09-13T17:10:01.132479+0000","last_became_active":"2024-09-13T17:10:00.142636+0000","last_became_peered":"2024-09-13T17:10:00.142636+0000","last_unstale":"2024-09-13T17:10:01.132479+0000","last_undegraded":"2024-09-13T17:10:01.132479+0000","last_fullsized":"2024-09-13T17:10:01.132479+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:38.730800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.462102+0000","last_change":"2024-09-13T17:09:59.757488+0000","last_active":"2024-09-13T17:10:01.462102+0000","last_peered":"2024-09-13T17:10:01.462102+0000","last_clean":"2024-09-13T17:10:01.462102+0000","last_became_active":"2024-09-13T17:09:59.757232+0000","last_became_peered":"2024-09-13T17:09:59.757232+0000","last_unstale":"2024-09-13T17:10:01.462102+0000","last_undegraded":"2024-09-13T17:10:01.462102+0000","last_fullsized":"2024-09-13T17:10:01.462102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:32.387241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459759+0000","last_change":"2024-09-13T17:10:00.143061+0000","last_active":"2024-09-13T17:10:01.459759+0000","last_peered":"2024-09-13T17:10:01.459759+0000","last_clean":"2024-09-13T17:10:01.459759+0000","last_became_active":"2024-09-13T17:10:00.142752+0000","last_became_peered":"2024-09-13T17:10:00.142752+0000","last_unstale":"2024-09-13T17:10:01.459759+0000","last_undegraded":"2024-09-13T17:10:01.459759+0000","last_fullsized":"2024-09-13T17:10:01.459759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:48.556200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459725+0000","last_change":"2024-09-13T17:09:59.756416+0000","last_active":"2024-09-13T17:10:01.459725+0000","last_peered":"2024-09-13T17:10:01.459725+0000","last_clean":"2024-09-13T17:10:01.459725+0000","last_became_active":"2024-09-13T17:09:59.755886+0000","last_became_peered":"2024-09-13T17:09:59.755886+0000","last_unstale":"2024-09-13T17:10:01.459725+0000","last_undegraded":"2024-09-13T17:10:01.459725+0000","last_fullsized":"2024-09-13T17:10:01.459725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.798999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131423+0000","last_change":"2024-09-13T17:10:00.146773+0000","last_active":"2024-09-13T17:10:01.131423+0000","last_peered":"2024-09-13T17:10:01.131423+0000","last_clean":"2024-09-13T17:10:01.131423+0000","last_became_active":"2024-09-13T17:10:00.146527+0000","last_became_peered":"2024-09-13T17:10:00.146527+0000","last_unstale":"2024-09-13T17:10:01.131423+0000","last_undegraded":"2024-09-13T17:10:01.131423+0000","last_fullsized":"2024-09-13T17:10:01.131423+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:34.509041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460907+0000","last_change":"2024-09-13T17:09:59.756986+0000","last_active":"2024-09-13T17:10:01.460907+0000","last_peered":"2024-09-13T17:10:01.460907+0000","last_clean":"2024-09-13T17:10:01.460907+0000","last_became_active":"2024-09-13T17:09:59.756710+0000","last_became_peered":"2024-09-13T17:09:59.756710+0000","last_unstale":"2024-09-13T17:10:01.460907+0000","last_undegraded":"2024-09-13T17:10:01.460907+0000","last_fullsized":"2024-09-13T17:10:01.460907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:53.716197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459714+0000","last_change":"2024-09-13T17:10:00.144311+0000","last_active":"2024-09-13T17:10:01.459714+0000","last_peered":"2024-09-13T17:10:01.459714+0000","last_clean":"2024-09-13T17:10:01.459714+0000","last_became_active":"2024-09-13T17:10:00.144036+0000","last_became_peered":"2024-09-13T17:10:00.144036+0000","last_unstale":"2024-09-13T17:10:01.459714+0000","last_undegraded":"2024-09-13T17:10:01.459714+0000","last_fullsized":"2024-09-13T17:10:01.459714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:38.061771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360383+0000","last_change":"2024-09-13T17:09:59.759112+0000","last_active":"2024-09-13T17:10:01.360383+0000","last_peered":"2024-09-13T17:10:01.360383+0000","last_clean":"2024-09-13T17:10:01.360383+0000","last_became_active":"2024-09-13T17:09:59.758494+0000","last_became_peered":"2024-09-13T17:09:59.758494+0000","last_unstale":"2024-09-13T17:10:01.360383+0000","last_undegraded":"2024-09-13T17:10:01.360383+0000","last_fullsized":"2024-09-13T17:10:01.360383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:17.213680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360207+0000","last_change":"2024-09-13T17:10:00.148599+0000","last_active":"2024-09-13T17:10:01.360207+0000","last_peered":"2024-09-13T17:10:01.360207+0000","last_clean":"2024-09-13T17:10:01.360207+0000","last_became_active":"2024-09-13T17:10:00.147525+0000","last_became_peered":"2024-09-13T17:10:00.147525+0000","last_unstale":"2024-09-13T17:10:01.360207+0000","last_undegraded":"2024-09-13T17:10:01.360207+0000","last_fullsized":"2024-09-13T17:10:01.360207+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:56.160489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.132068+0000","last_change":"2024-09-13T17:09:59.762817+0000","last_active":"2024-09-13T17:10:01.132068+0000","last_peered":"2024-09-13T17:10:01.132068+0000","last_clean":"2024-09-13T17:10:01.132068+0000","last_became_active":"2024-09-13T17:09:59.760778+0000","last_became_peered":"2024-09-13T17:09:59.760778+0000","last_unstale":"2024-09-13T17:10:01.132068+0000","last_undegraded":"2024-09-13T17:10:01.132068+0000","last_fullsized":"2024-09-13T17:10:01.132068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:53.716197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131115+0000","last_change":"2024-09-13T17:10:00.151948+0000","last_active":"2024-09-13T17:10:01.131115+0000","last_peered":"2024-09-13T17:10:01.131115+0000","last_clean":"2024-09-13T17:10:01.131115+0000","last_became_active":"2024-09-13T17:10:00.151647+0000","last_became_peered":"2024-09-13T17:10:00.151647+0000","last_unstale":"2024-09-13T17:10:01.131115+0000","last_undegraded":"2024-09-13T17:10:01.131115+0000","last_fullsized":"2024-09-13T17:10:01.131115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:46.207800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459515+0000","last_change":"2024-09-13T17:09:59.758071+0000","last_active":"2024-09-13T17:10:01.459515+0000","last_peered":"2024-09-13T17:10:01.459515+0000","last_clean":"2024-09-13T17:10:01.459515+0000","last_became_active":"2024-09-13T17:09:59.757791+0000","last_became_peered":"2024-09-13T17:09:59.757791+0000","last_unstale":"2024-09-13T17:10:01.459515+0000","last_undegraded":"2024-09-13T17:10:01.459515+0000","last_fullsized":"2024-09-13T17:10:01.459515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:59.675690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459219+0000","last_change":"2024-09-13T17:10:00.137333+0000","last_active":"2024-09-13T17:10:01.459219+0000","last_peered":"2024-09-13T17:10:01.459219+0000","last_clean":"2024-09-13T17:10:01.459219+0000","last_became_active":"2024-09-13T17:10:00.137068+0000","last_became_peered":"2024-09-13T17:10:00.137068+0000","last_unstale":"2024-09-13T17:10:01.459219+0000","last_undegraded":"2024-09-13T17:10:01.459219+0000","last_fullsized":"2024-09-13T17:10:01.459219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:45.284692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130576+0000","last_change":"2024-09-13T17:09:59.762392+0000","last_active":"2024-09-13T17:10:01.130576+0000","last_peered":"2024-09-13T17:10:01.130576+0000","last_clean":"2024-09-13T17:10:01.130576+0000","last_became_active":"2024-09-13T17:09:59.760734+0000","last_became_peered":"2024-09-13T17:09:59.760734+0000","last_unstale":"2024-09-13T17:10:01.130576+0000","last_undegraded":"2024-09-13T17:10:01.130576+0000","last_fullsized":"2024-09-13T17:10:01.130576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.798999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.462100+0000","last_change":"2024-09-13T17:10:00.148422+0000","last_active":"2024-09-13T17:10:01.462100+0000","last_peered":"2024-09-13T17:10:01.462100+0000","last_clean":"2024-09-13T17:10:01.462100+0000","last_became_active":"2024-09-13T17:10:00.146689+0000","last_became_peered":"2024-09-13T17:10:00.146689+0000","last_unstale":"2024-09-13T17:10:01.462100+0000","last_undegraded":"2024-09-13T17:10:01.462100+0000","last_fullsized":"2024-09-13T17:10:01.462100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:56.775893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"85'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.132618+0000","last_change":"2024-09-13T17:09:59.756024+0000","last_active":"2024-09-13T17:10:01.132618+0000","last_peered":"2024-09-13T17:10:01.132618+0000","last_clean":"2024-09-13T17:10:01.132618+0000","last_became_active":"2024-09-13T17:09:59.755740+0000","last_became_peered":"2024-09-13T17:09:59.755740+0000","last_unstale":"2024-09-13T17:10:01.132618+0000","last_undegraded":"2024-09-13T17:10:01.132618+0000","last_fullsized":"2024-09-13T17:10:01.132618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:04.215322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T17:10:00.125893+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:10:00.125893+0000","last_peered":"2024-09-13T17:10:00.125893+0000","last_clean":"2024-09-13T17:10:00.125893+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:10:00.125893+0000","last_undegraded":"2024-09-13T17:10:00.125893+0000","last_fullsized":"2024-09-13T17:10:00.125893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1642496,"data_stored":1034717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83499999999999996,"15min":0.84899999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.212,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.745},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.877,"15min":0.90500000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.871}]},{"osd":1,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.92400000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3979999999999999,"5min":1.456,"15min":1.456},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.85099999999999998,"15min":0.85899999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2210000000000001,"5min":1.238,"15min":1.238},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98399999999999999,"15min":1.004},"min":{"1min":0.64500000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.0029999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.93200000000000005,"15min":0.92200000000000004},"min":{"1min":0.628,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.98299999999999998,"15min":0.998},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.1499999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.89700000000000002,"15min":0.90000000000000002},"min":{"1min":0.66600000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.016,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.099,"15min":1.117},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.3959999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.96999999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.032,"15min":1.0389999999999999},"min":{"1min":0.627,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.0209999999999999,"15min":1.018},"min":{"1min":0.77900000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.93500000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0980000000000001,"15min":1.123},"min":{"1min":0.81799999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7170000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.071,"5min":1.1200000000000001,"15min":1.1339999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1056768,"data_stored":444973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76000000000000001,"15min":0.755},"min":{"1min":0.56200000000000006,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85799999999999998,"15min":0.876},"min":{"1min":0.58599999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.052,"5min":1.431,"15min":1.431},"last":0.94199999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92400000000000004,"15min":0.92700000000000005},"min":{"1min":0.64800000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.163,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.61499999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1020000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.64600000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.89500000000000002,"15min":0.91300000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.071,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.94099999999999995,"15min":0.97299999999999998},"min":{"1min":0.59799999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1679999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.077}]},{"osd":3,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95099999999999996,"15min":0.97499999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.198,"5min":1.359,"15min":1.359},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.038,"15min":1.05},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.873}]},{"osd":4,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.89700000000000002,"15min":0.90600000000000003},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1060000000000001,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2250000000000001,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.2529999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.014,"15min":1.018},"min":{"1min":0.74199999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2170000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.016},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.038,"15min":1.0629999999999999},"min":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1819999999999999,"5min":1.597,"15min":1.597},"last":0.98299999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.091,"15min":1.1040000000000001},"min":{"1min":0.82199999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2969999999999999,"5min":1.728,"15min":1.728},"last":1.21},{"interface":"front","average":{"1min":1.099,"5min":1.167,"15min":1.1899999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.526,"5min":2.194,"15min":2.194},"last":1.131}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":1060864,"data_stored":445865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.83699999999999997,"15min":0.86299999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.232,"5min":1.395,"15min":1.395},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.86299999999999999,"15min":0.88300000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.173,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0309999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94599999999999995,"15min":0.95599999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.232,"5min":1.508,"15min":1.508},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95199999999999996,"15min":0.95399999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.302,"5min":1.482,"15min":1.482},"last":0.91300000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.85099999999999998},"min":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2669999999999999,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.69799999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1899999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.83199999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.96699999999999997,"15min":0.997},"min":{"1min":0.67100000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.206,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.626},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92100000000000004,"15min":0.93100000000000005},"min":{"1min":0.58199999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.335,"5min":1.603,"15min":1.603},"last":0.93500000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.022,"15min":1.0589999999999999},"min":{"1min":0.77300000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.208,"5min":1.466,"15min":1.466},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.999,"15min":1.0309999999999999},"min":{"1min":0.65100000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3640000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0680000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0369999999999999,"15min":1.0649999999999999},"min":{"1min":0.76600000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.2,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1439999999999999,"15min":1.1839999999999999},"min":{"1min":0.76600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2669999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.097,"15min":1.137},"min":{"1min":0.75700000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.1899999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.101},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.169,"15min":1.2050000000000001},"min":{"1min":0.76700000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.466,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.012}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":1056768,"data_stored":450579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.751},"min":{"1min":0.52800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94699999999999995,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.629},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1739999999999999,"5min":1.306,"15min":1.306},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.65900000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1579999999999999,"5min":1.357,"15min":1.357},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.93799999999999994,"15min":0.94699999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2050000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1339999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.89500000000000002,"15min":0.88500000000000001},"min":{"1min":0.65400000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1599999999999999,"5min":1.272,"15min":1.272},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.94099999999999995,"15min":0.91500000000000004},"min":{"1min":0.78400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3220000000000001,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.252}]},{"osd":3,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.90400000000000003,"15min":0.92000000000000004},"min":{"1min":0.63700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1879999999999999,"5min":1.464,"15min":1.464},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.89200000000000002,"15min":0.88500000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.25,"5min":1.353,"15min":1.353},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94699999999999995,"15min":0.93999999999999995},"min":{"1min":0.623,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2210000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.0740000000000001,"15min":1.0649999999999999},"min":{"1min":0.83799999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3200000000000001,"5min":1.478,"15min":1.478},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97099999999999997,"15min":0.97399999999999998},"min":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1659999999999999,"5min":1.26,"15min":1.26},"last":0.754},{"interface":"front","average":{"1min":1.095,"5min":1.0580000000000001,"15min":1.048},"min":{"1min":0.83899999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.429,"5min":1.613,"15min":1.613},"last":1.355}]},{"osd":7,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.087,"15min":1.087},"min":{"1min":0.753,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.373,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.329},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.127,"15min":1.1259999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.399,"5min":2.032,"15min":2.032},"last":1.288}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1069056,"data_stored":452143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.32500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.61399999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80000000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.232,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69799999999999995,"15min":0.71799999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.222,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.35299999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.03,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.91200000000000003,"15min":0.92200000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.014},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.93799999999999994,"15min":0.95799999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3740000000000001,"5min":1.899,"15min":1.899},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.61699999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.377,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.98699999999999999,"15min":0.99299999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4330000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.79600000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0169999999999999,"15min":1.024},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0169999999999999,"15min":1.04},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3089999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.96199999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.0720000000000001,"15min":1.089},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.514,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.05,"15min":1.0680000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6599999999999999,"5min":1.756,"15min":1.756},"last":1.048}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1060864,"data_stored":451161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.872,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81200000000000006,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70399999999999996,"15min":0.72599999999999998},"min":{"1min":0.372,"5min":0.37,"15min":0.37},"max":{"1min":0.92700000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.747,"15min":0.77300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0609999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.46300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82599999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94899999999999995,"5min":1.103,"15min":1.103},"last":0.83899999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.91700000000000004,"15min":0.93899999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.157,"5min":1.3,"15min":1.3},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.92100000000000004,"15min":0.92500000000000004},"min":{"1min":0.65900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.157,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.88100000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.93899999999999995,"15min":0.95299999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2170000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.92800000000000005,"15min":0.91800000000000004},"min":{"1min":0.54600000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.1950000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.92800000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.97799999999999998,"15min":0.97199999999999998},"min":{"1min":0.67800000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1,"15min":0.99199999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.26,"5min":1.413,"15min":1.413},"last":1.1459999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.0309999999999999,"15min":1.054},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.26,"5min":1.506,"15min":1.506},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.64500000000000002,"5min":0.625,"15min":0.625},"max":{"1min":1.3460000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.028}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1056768,"data_stored":444473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65400000000000003,"15min":0.66300000000000003},"min":{"1min":0.44500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.097,"5min":1.151,"15min":1.151},"last":0.496},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0589999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64500000000000002,"15min":0.66400000000000003},"min":{"1min":0.47599999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81299999999999994,"5min":1.306,"15min":1.306},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.751,"15min":0.755},"min":{"1min":0.495,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.079,"5min":1.28,"15min":1.28},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78300000000000003,"15min":0.79000000000000004},"min":{"1min":0.497,"5min":0.308,"15min":0.308},"max":{"1min":1.1699999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.82599999999999996},"min":{"1min":0.50800000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1379999999999999,"5min":1.905,"15min":1.905},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2230000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0069999999999999,"15min":1.0329999999999999},"min":{"1min":0.71899999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.272,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":1.03,"15min":1.0660000000000001},"min":{"1min":0.63600000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.179,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.0820000000000001,"15min":1.1100000000000001},"min":{"1min":0.83599999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.296,"5min":1.556,"15min":1.556},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0549999999999999,"15min":1.077},"min":{"1min":0.69099999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3580000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.119},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.109,"15min":1.1359999999999999},"min":{"1min":0.83299999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.327,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1359999999999999,"15min":1.159},"min":{"1min":0.81000000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4359999999999999,"5min":1.712,"15min":1.712},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.80500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3169999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.0780000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1654784,"data_stored":1040981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69199999999999995,"15min":0.70899999999999996},"min":{"1min":0.434,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.92100000000000004,"5min":3.25,"15min":3.25},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.77600000000000002,"15min":0.81000000000000005},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.103,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71499999999999997,"15min":0.73699999999999999},"min":{"1min":0.55800000000000005,"5min":0.307,"15min":0.307},"max":{"1min":0.91600000000000004,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.63},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.81899999999999995,"15min":0.876},"min":{"1min":0.48399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0760000000000001,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.79600000000000004,"15min":0.85699999999999998},"min":{"1min":0.439,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.016,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.89500000000000002,"15min":0.95499999999999996},"min":{"1min":0.50600000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98799999999999999,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.97199999999999998,"15min":1.02},"min":{"1min":0.65800000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.095,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.024,"15min":1.0549999999999999},"min":{"1min":0.76600000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.379,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":1.1140000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.073},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.413,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.0529999999999999,"15min":1.105},"min":{"1min":0.76800000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.3049999999999999,"5min":5.399,"15min":5.399},"last":0.89800000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.121,"15min":1.153},"min":{"1min":0.84399999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.4530000000000001,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.083,"15min":1.115},"min":{"1min":0.78100000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.51,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.111,"15min":1.1299999999999999},"min":{"1min":0.78700000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4570000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.163,"15min":1.2170000000000001},"min":{"1min":0.79700000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.2889999999999999,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":1.1539999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:10:03.195 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:10:03.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e359e700 1 Processor -- start 2024-09-13T17:10:03.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e359e700 1 -- start start 2024-09-13T17:10:03.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e359e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f79e415e920 0x7f79e40caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:03.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e359e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e4162550 con 0x7f79e40cb020 2024-09-13T17:10:03.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e359e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e40cd690 con 0x7f79e415ed00 2024-09-13T17:10:03.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e359e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e4161f90 con 0x7f79e415e920 2024-09-13T17:10:03.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e259c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f79e415e920 0x7f79e40caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:03.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e259c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f79e415e920 0x7f79e40caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54480/0 (socket says 172.21.15.123:54480) 2024-09-13T17:10:03.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e259c700 1 -- 172.21.15.123:0/3021053221 learned_addr learned my addr 172.21.15.123:0/3021053221 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:03.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e259c700 1 -- 172.21.15.123:0/3021053221 >> v1:172.21.15.153:6789/0 conn(0x7f79e415ed00 legacy=0x7f79e40cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e259c700 1 -- 172.21.15.123:0/3021053221 >> v1:172.21.15.123:6789/0 conn(0x7f79e40cb020 legacy=0x7f79e4161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e259c700 1 -- 172.21.15.123:0/3021053221 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e4162270 con 0x7f79e415e920 2024-09-13T17:10:03.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e259c700 1 --2- 172.21.15.123:0/3021053221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79e415e920 0x7f79e40caae0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009910 tx=0x7f79cc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f51778b7dbabbaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:03.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e159a700 1 -- 172.21.15.123:0/3021053221 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00ba60 con 0x7f79e415e920 2024-09-13T17:10:03.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e159a700 1 -- 172.21.15.123:0/3021053221 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc00bbc0 con 0x7f79e415e920 2024-09-13T17:10:03.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e159a700 1 -- 172.21.15.123:0/3021053221 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc009e60 con 0x7f79e415e920 2024-09-13T17:10:03.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e359e700 1 -- 172.21.15.123:0/3021053221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79e415e920 msgr2=0x7f79e40caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e359e700 1 --2- 172.21.15.123:0/3021053221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79e415e920 0x7f79e40caae0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009910 tx=0x7f79cc009c20 comp rx=0 tx=0).stop 2024-09-13T17:10:03.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e359e700 1 -- 172.21.15.123:0/3021053221 shutdown_connections 2024-09-13T17:10:03.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e359e700 1 --2- 172.21.15.123:0/3021053221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79e415e920 0x7f79e40caae0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e359e700 1 -- 172.21.15.123:0/3021053221 >> 172.21.15.123:0/3021053221 conn(0x7f79e4066150 msgr2=0x7f79e4066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:03.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e359e700 1 -- 172.21.15.123:0/3021053221 shutdown_connections 2024-09-13T17:10:03.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.342+0000 7f79e359e700 1 -- 172.21.15.123:0/3021053221 wait complete. 2024-09-13T17:10:03.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e359e700 1 Processor -- start 2024-09-13T17:10:03.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e359e700 1 -- start start 2024-09-13T17:10:03.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e40cb020 0x7f79e41eafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:03.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79e415e920 0x7f79e4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:03.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e359e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79e415ed00 0x7f79e4072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e359e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e41478f0 con 0x7f79e415e920 2024-09-13T17:10:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e41e8010 con 0x7f79e40cb020 2024-09-13T17:10:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e359e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e414a740 con 0x7f79e415ed00 2024-09-13T17:10:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e1d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79e415e920 0x7f79e4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e1d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79e415e920 0x7f79e4071bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54490/0 (socket says 172.21.15.123:54490) 2024-09-13T17:10:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e1d9b700 1 -- 172.21.15.123:0/2497762652 learned_addr learned my addr 172.21.15.123:0/2497762652 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e259c700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e40cb020 0x7f79e41eafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e2d9d700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79e415ed00 0x7f79e4072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e1d9b700 1 -- 172.21.15.123:0/2497762652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79e415ed00 msgr2=0x7f79e4072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e1d9b700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79e415ed00 0x7f79e4072110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e1d9b700 1 -- 172.21.15.123:0/2497762652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e40cb020 msgr2=0x7f79e41eafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e1d9b700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e40cb020 0x7f79e41eafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e1d9b700 1 -- 172.21.15.123:0/2497762652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc009570 con 0x7f79e415e920 2024-09-13T17:10:03.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e259c700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e40cb020 0x7f79e41eafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:03.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e1d9b700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79e415e920 0x7f79e4071bd0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00cc50 tx=0x7f79dc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:03.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79daffd700 1 -- 172.21.15.123:0/2497762652 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc003c20 con 0x7f79e415e920 2024-09-13T17:10:03.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79daffd700 1 -- 172.21.15.123:0/2497762652 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc003d80 con 0x7f79e415e920 2024-09-13T17:10:03.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e359e700 1 -- 172.21.15.123:0/2497762652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e4147b40 con 0x7f79e415e920 2024-09-13T17:10:03.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79daffd700 1 -- 172.21.15.123:0/2497762652 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc00abc0 con 0x7f79e415e920 2024-09-13T17:10:03.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.346+0000 7f79e359e700 1 -- 172.21.15.123:0/2497762652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e4148100 con 0x7f79e415e920 2024-09-13T17:10:03.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.350+0000 7f79e359e700 1 -- 172.21.15.123:0/2497762652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e40677f0 con 0x7f79e415e920 2024-09-13T17:10:03.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.350+0000 7f79daffd700 1 -- 172.21.15.123:0/2497762652 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f79dc00ad20 con 0x7f79e415e920 2024-09-13T17:10:03.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.350+0000 7f79daffd700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f79c4066730 0x7f79c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:03.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.350+0000 7f79daffd700 1 -- 172.21.15.123:0/2497762652 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79dc084170 con 0x7f79e415e920 2024-09-13T17:10:03.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.350+0000 7f79e259c700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f79c4066730 0x7f79c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:03.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.354+0000 7f79e259c700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f79c4066730 0x7f79c4068bf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f79cc006f80 tx=0x7f79cc008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:03.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.358+0000 7f79daffd700 1 -- 172.21.15.123:0/2497762652 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f79dc051570 con 0x7f79e415e920 2024-09-13T17:10:03.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.518+0000 7f79e359e700 1 -- 172.21.15.123:0/2497762652 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79e4161c50 con 0x7f79c4066730 2024-09-13T17:10:03.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.534+0000 7f79daffd700 1 -- 172.21.15.123:0/2497762652 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288217 (secure 0 0 0) 0x7f79cc004040 con 0x7f79c4066730 2024-09-13T17:10:03.545 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:03.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.542+0000 7f79e359e700 1 -- 172.21.15.123:0/2497762652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f79c4066730 msgr2=0x7f79c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.542+0000 7f79e359e700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f79c4066730 0x7f79c4068bf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f79cc006f80 tx=0x7f79cc008030 comp rx=0 tx=0).stop 2024-09-13T17:10:03.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.542+0000 7f79e359e700 1 -- 172.21.15.123:0/2497762652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79e415e920 msgr2=0x7f79e4071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.542+0000 7f79e359e700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79e415e920 0x7f79e4071bd0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00cc50 tx=0x7f79dc00cf60 comp rx=0 tx=0).stop 2024-09-13T17:10:03.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.542+0000 7f79e359e700 1 -- 172.21.15.123:0/2497762652 shutdown_connections 2024-09-13T17:10:03.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.542+0000 7f79e359e700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f79c4066730 0x7f79c4068bf0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.542+0000 7f79e359e700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79e415ed00 0x7f79e4072110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.542+0000 7f79e359e700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79e415e920 0x7f79e4071bd0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.542+0000 7f79e359e700 1 --2- 172.21.15.123:0/2497762652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e40cb020 0x7f79e41eafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.542+0000 7f79e359e700 1 -- 172.21.15.123:0/2497762652 >> 172.21.15.123:0/2497762652 conn(0x7f79e4066150 msgr2=0x7f79e406c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:03.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.542+0000 7f79e359e700 1 -- 172.21.15.123:0/2497762652 shutdown_connections 2024-09-13T17:10:03.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.542+0000 7f79e359e700 1 -- 172.21.15.123:0/2497762652 wait complete. 2024-09-13T17:10:03.548 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:10:03.562 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-13T17:10:02.793872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246136,"kb_used_data":9432,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754728584,"statfs":{"total":773094113280,"available":772842070016,"internally_reserved":0,"allocated":9658368,"data_stored":4764892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":242208313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.060081"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459871+0000","last_change":"2024-09-13T17:10:00.142668+0000","last_active":"2024-09-13T17:10:01.459871+0000","last_peered":"2024-09-13T17:10:01.459871+0000","last_clean":"2024-09-13T17:10:01.459871+0000","last_became_active":"2024-09-13T17:10:00.142439+0000","last_became_peered":"2024-09-13T17:10:00.142439+0000","last_unstale":"2024-09-13T17:10:01.459871+0000","last_undegraded":"2024-09-13T17:10:01.459871+0000","last_fullsized":"2024-09-13T17:10:01.459871+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:07.003447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.462020+0000","last_change":"2024-09-13T17:10:00.150926+0000","last_active":"2024-09-13T17:10:01.462020+0000","last_peered":"2024-09-13T17:10:01.462020+0000","last_clean":"2024-09-13T17:10:01.462020+0000","last_became_active":"2024-09-13T17:10:00.149190+0000","last_became_peered":"2024-09-13T17:10:00.149190+0000","last_unstale":"2024-09-13T17:10:01.462020+0000","last_undegraded":"2024-09-13T17:10:01.462020+0000","last_fullsized":"2024-09-13T17:10:01.462020+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:11.094128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.132485+0000","last_change":"2024-09-13T17:10:00.137889+0000","last_active":"2024-09-13T17:10:01.132485+0000","last_peered":"2024-09-13T17:10:01.132485+0000","last_clean":"2024-09-13T17:10:01.132485+0000","last_became_active":"2024-09-13T17:10:00.137581+0000","last_became_peered":"2024-09-13T17:10:00.137581+0000","last_unstale":"2024-09-13T17:10:01.132485+0000","last_undegraded":"2024-09-13T17:10:01.132485+0000","last_fullsized":"2024-09-13T17:10:01.132485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:27.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460761+0000","last_change":"2024-09-13T17:10:00.152886+0000","last_active":"2024-09-13T17:10:01.460761+0000","last_peered":"2024-09-13T17:10:01.460761+0000","last_clean":"2024-09-13T17:10:01.460761+0000","last_became_active":"2024-09-13T17:10:00.152589+0000","last_became_peered":"2024-09-13T17:10:00.152589+0000","last_unstale":"2024-09-13T17:10:01.460761+0000","last_undegraded":"2024-09-13T17:10:01.460761+0000","last_fullsized":"2024-09-13T17:10:01.460761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:33.390574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130946+0000","last_change":"2024-09-13T17:10:00.151293+0000","last_active":"2024-09-13T17:10:01.130946+0000","last_peered":"2024-09-13T17:10:01.130946+0000","last_clean":"2024-09-13T17:10:01.130946+0000","last_became_active":"2024-09-13T17:10:00.151053+0000","last_became_peered":"2024-09-13T17:10:00.151053+0000","last_unstale":"2024-09-13T17:10:01.130946+0000","last_undegraded":"2024-09-13T17:10:01.130946+0000","last_fullsized":"2024-09-13T17:10:01.130946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:18.217013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459491+0000","last_change":"2024-09-13T17:10:00.134418+0000","last_active":"2024-09-13T17:10:01.459491+0000","last_peered":"2024-09-13T17:10:01.459491+0000","last_clean":"2024-09-13T17:10:01.459491+0000","last_became_active":"2024-09-13T17:10:00.134033+0000","last_became_peered":"2024-09-13T17:10:00.134033+0000","last_unstale":"2024-09-13T17:10:01.459491+0000","last_undegraded":"2024-09-13T17:10:01.459491+0000","last_fullsized":"2024-09-13T17:10:01.459491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:39.811382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461041+0000","last_change":"2024-09-13T17:10:00.135108+0000","last_active":"2024-09-13T17:10:01.461041+0000","last_peered":"2024-09-13T17:10:01.461041+0000","last_clean":"2024-09-13T17:10:01.461041+0000","last_became_active":"2024-09-13T17:10:00.134866+0000","last_became_peered":"2024-09-13T17:10:00.134866+0000","last_unstale":"2024-09-13T17:10:01.461041+0000","last_undegraded":"2024-09-13T17:10:01.461041+0000","last_fullsized":"2024-09-13T17:10:01.461041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:00.983442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.458942+0000","last_change":"2024-09-13T17:10:00.152869+0000","last_active":"2024-09-13T17:10:01.458942+0000","last_peered":"2024-09-13T17:10:01.458942+0000","last_clean":"2024-09-13T17:10:01.458942+0000","last_became_active":"2024-09-13T17:10:00.152602+0000","last_became_peered":"2024-09-13T17:10:00.152602+0000","last_unstale":"2024-09-13T17:10:01.458942+0000","last_undegraded":"2024-09-13T17:10:01.458942+0000","last_fullsized":"2024-09-13T17:10:01.458942+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:45.284692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459832+0000","last_change":"2024-09-13T17:10:00.146869+0000","last_active":"2024-09-13T17:10:01.459832+0000","last_peered":"2024-09-13T17:10:01.459832+0000","last_clean":"2024-09-13T17:10:01.459832+0000","last_became_active":"2024-09-13T17:10:00.146607+0000","last_became_peered":"2024-09-13T17:10:00.146607+0000","last_unstale":"2024-09-13T17:10:01.459832+0000","last_undegraded":"2024-09-13T17:10:01.459832+0000","last_fullsized":"2024-09-13T17:10:01.459832+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:34.509041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460309+0000","last_change":"2024-09-13T17:10:00.145577+0000","last_active":"2024-09-13T17:10:01.460309+0000","last_peered":"2024-09-13T17:10:01.460309+0000","last_clean":"2024-09-13T17:10:01.460309+0000","last_became_active":"2024-09-13T17:10:00.145232+0000","last_became_peered":"2024-09-13T17:10:00.145232+0000","last_unstale":"2024-09-13T17:10:01.460309+0000","last_undegraded":"2024-09-13T17:10:01.460309+0000","last_fullsized":"2024-09-13T17:10:01.460309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:05.218655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461379+0000","last_change":"2024-09-13T17:10:00.142445+0000","last_active":"2024-09-13T17:10:01.461379+0000","last_peered":"2024-09-13T17:10:01.461379+0000","last_clean":"2024-09-13T17:10:01.461379+0000","last_became_active":"2024-09-13T17:10:00.141728+0000","last_became_peered":"2024-09-13T17:10:00.141728+0000","last_unstale":"2024-09-13T17:10:01.461379+0000","last_undegraded":"2024-09-13T17:10:01.461379+0000","last_fullsized":"2024-09-13T17:10:01.461379+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:50.540753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459899+0000","last_change":"2024-09-13T17:10:00.145124+0000","last_active":"2024-09-13T17:10:01.459899+0000","last_peered":"2024-09-13T17:10:01.459899+0000","last_clean":"2024-09-13T17:10:01.459899+0000","last_became_active":"2024-09-13T17:10:00.144862+0000","last_became_peered":"2024-09-13T17:10:00.144862+0000","last_unstale":"2024-09-13T17:10:01.459899+0000","last_undegraded":"2024-09-13T17:10:01.459899+0000","last_fullsized":"2024-09-13T17:10:01.459899+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:05.843507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130864+0000","last_change":"2024-09-13T17:10:00.135041+0000","last_active":"2024-09-13T17:10:01.130864+0000","last_peered":"2024-09-13T17:10:01.130864+0000","last_clean":"2024-09-13T17:10:01.130864+0000","last_became_active":"2024-09-13T17:10:00.134796+0000","last_became_peered":"2024-09-13T17:10:00.134796+0000","last_unstale":"2024-09-13T17:10:01.130864+0000","last_undegraded":"2024-09-13T17:10:01.130864+0000","last_fullsized":"2024-09-13T17:10:01.130864+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:56.160489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460356+0000","last_change":"2024-09-13T17:10:00.153684+0000","last_active":"2024-09-13T17:10:01.460356+0000","last_peered":"2024-09-13T17:10:01.460356+0000","last_clean":"2024-09-13T17:10:01.460356+0000","last_became_active":"2024-09-13T17:10:00.152607+0000","last_became_peered":"2024-09-13T17:10:00.152607+0000","last_unstale":"2024-09-13T17:10:01.460356+0000","last_undegraded":"2024-09-13T17:10:01.460356+0000","last_fullsized":"2024-09-13T17:10:01.460356+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:01.480482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.127755+0000","last_change":"2024-09-13T17:10:00.142095+0000","last_active":"2024-09-13T17:10:01.127755+0000","last_peered":"2024-09-13T17:10:01.127755+0000","last_clean":"2024-09-13T17:10:01.127755+0000","last_became_active":"2024-09-13T17:10:00.141780+0000","last_became_peered":"2024-09-13T17:10:00.141780+0000","last_unstale":"2024-09-13T17:10:01.127755+0000","last_undegraded":"2024-09-13T17:10:01.127755+0000","last_fullsized":"2024-09-13T17:10:01.127755+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:26.419350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130371+0000","last_change":"2024-09-13T17:10:00.142601+0000","last_active":"2024-09-13T17:10:01.130371+0000","last_peered":"2024-09-13T17:10:01.130371+0000","last_clean":"2024-09-13T17:10:01.130371+0000","last_became_active":"2024-09-13T17:10:00.142342+0000","last_became_peered":"2024-09-13T17:10:00.142342+0000","last_unstale":"2024-09-13T17:10:01.130371+0000","last_undegraded":"2024-09-13T17:10:01.130371+0000","last_fullsized":"2024-09-13T17:10:01.130371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:35.618573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131482+0000","last_change":"2024-09-13T17:10:00.133749+0000","last_active":"2024-09-13T17:10:01.131482+0000","last_peered":"2024-09-13T17:10:01.131482+0000","last_clean":"2024-09-13T17:10:01.131482+0000","last_became_active":"2024-09-13T17:10:00.133194+0000","last_became_peered":"2024-09-13T17:10:00.133194+0000","last_unstale":"2024-09-13T17:10:01.131482+0000","last_undegraded":"2024-09-13T17:10:01.131482+0000","last_fullsized":"2024-09-13T17:10:01.131482+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:58.208341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460510+0000","last_change":"2024-09-13T17:10:00.143625+0000","last_active":"2024-09-13T17:10:01.460510+0000","last_peered":"2024-09-13T17:10:01.460510+0000","last_clean":"2024-09-13T17:10:01.460510+0000","last_became_active":"2024-09-13T17:10:00.143443+0000","last_became_peered":"2024-09-13T17:10:00.143443+0000","last_unstale":"2024-09-13T17:10:01.460510+0000","last_undegraded":"2024-09-13T17:10:01.460510+0000","last_fullsized":"2024-09-13T17:10:01.460510+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:09.640587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360608+0000","last_change":"2024-09-13T17:10:00.150108+0000","last_active":"2024-09-13T17:10:01.360608+0000","last_peered":"2024-09-13T17:10:01.360608+0000","last_clean":"2024-09-13T17:10:01.360608+0000","last_became_active":"2024-09-13T17:10:00.149729+0000","last_became_peered":"2024-09-13T17:10:00.149729+0000","last_unstale":"2024-09-13T17:10:01.360608+0000","last_undegraded":"2024-09-13T17:10:01.360608+0000","last_fullsized":"2024-09-13T17:10:01.360608+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:56.105440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460851+0000","last_change":"2024-09-13T17:10:00.148067+0000","last_active":"2024-09-13T17:10:01.460851+0000","last_peered":"2024-09-13T17:10:01.460851+0000","last_clean":"2024-09-13T17:10:01.460851+0000","last_became_active":"2024-09-13T17:10:00.147474+0000","last_became_peered":"2024-09-13T17:10:00.147474+0000","last_unstale":"2024-09-13T17:10:01.460851+0000","last_undegraded":"2024-09-13T17:10:01.460851+0000","last_fullsized":"2024-09-13T17:10:01.460851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:43.291632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460800+0000","last_change":"2024-09-13T17:10:00.151717+0000","last_active":"2024-09-13T17:10:01.460800+0000","last_peered":"2024-09-13T17:10:01.460800+0000","last_clean":"2024-09-13T17:10:01.460800+0000","last_became_active":"2024-09-13T17:10:00.151390+0000","last_became_peered":"2024-09-13T17:10:00.151390+0000","last_unstale":"2024-09-13T17:10:01.460800+0000","last_undegraded":"2024-09-13T17:10:01.460800+0000","last_fullsized":"2024-09-13T17:10:01.460800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:55.010609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461942+0000","last_change":"2024-09-13T17:10:00.153185+0000","last_active":"2024-09-13T17:10:01.461942+0000","last_peered":"2024-09-13T17:10:01.461942+0000","last_clean":"2024-09-13T17:10:01.461942+0000","last_became_active":"2024-09-13T17:10:00.152966+0000","last_became_peered":"2024-09-13T17:10:00.152966+0000","last_unstale":"2024-09-13T17:10:01.461942+0000","last_undegraded":"2024-09-13T17:10:01.461942+0000","last_fullsized":"2024-09-13T17:10:01.461942+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:28.802332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459288+0000","last_change":"2024-09-13T17:10:00.150346+0000","last_active":"2024-09-13T17:10:01.459288+0000","last_peered":"2024-09-13T17:10:01.459288+0000","last_clean":"2024-09-13T17:10:01.459288+0000","last_became_active":"2024-09-13T17:10:00.150117+0000","last_became_peered":"2024-09-13T17:10:00.150117+0000","last_unstale":"2024-09-13T17:10:01.459288+0000","last_undegraded":"2024-09-13T17:10:01.459288+0000","last_fullsized":"2024-09-13T17:10:01.459288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:58.208341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459985+0000","last_change":"2024-09-13T17:10:00.138985+0000","last_active":"2024-09-13T17:10:01.459985+0000","last_peered":"2024-09-13T17:10:01.459985+0000","last_clean":"2024-09-13T17:10:01.459985+0000","last_became_active":"2024-09-13T17:10:00.138637+0000","last_became_peered":"2024-09-13T17:10:00.138637+0000","last_unstale":"2024-09-13T17:10:01.459985+0000","last_undegraded":"2024-09-13T17:10:01.459985+0000","last_fullsized":"2024-09-13T17:10:01.459985+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:15.536185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461503+0000","last_change":"2024-09-13T17:10:00.148945+0000","last_active":"2024-09-13T17:10:01.461503+0000","last_peered":"2024-09-13T17:10:01.461503+0000","last_clean":"2024-09-13T17:10:01.461503+0000","last_became_active":"2024-09-13T17:10:00.148699+0000","last_became_peered":"2024-09-13T17:10:00.148699+0000","last_unstale":"2024-09-13T17:10:01.461503+0000","last_undegraded":"2024-09-13T17:10:01.461503+0000","last_fullsized":"2024-09-13T17:10:01.461503+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:54.719530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.132214+0000","last_change":"2024-09-13T17:10:00.138758+0000","last_active":"2024-09-13T17:10:01.132214+0000","last_peered":"2024-09-13T17:10:01.132214+0000","last_clean":"2024-09-13T17:10:01.132214+0000","last_became_active":"2024-09-13T17:10:00.138474+0000","last_became_peered":"2024-09-13T17:10:00.138474+0000","last_unstale":"2024-09-13T17:10:01.132214+0000","last_undegraded":"2024-09-13T17:10:01.132214+0000","last_fullsized":"2024-09-13T17:10:01.132214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:51.346670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130836+0000","last_change":"2024-09-13T17:10:00.144089+0000","last_active":"2024-09-13T17:10:01.130836+0000","last_peered":"2024-09-13T17:10:01.130836+0000","last_clean":"2024-09-13T17:10:01.130836+0000","last_became_active":"2024-09-13T17:10:00.143838+0000","last_became_peered":"2024-09-13T17:10:00.143838+0000","last_unstale":"2024-09-13T17:10:01.130836+0000","last_undegraded":"2024-09-13T17:10:01.130836+0000","last_fullsized":"2024-09-13T17:10:01.130836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:48.556200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459308+0000","last_change":"2024-09-13T17:10:00.143242+0000","last_active":"2024-09-13T17:10:01.459308+0000","last_peered":"2024-09-13T17:10:01.459308+0000","last_clean":"2024-09-13T17:10:01.459308+0000","last_became_active":"2024-09-13T17:10:00.142778+0000","last_became_peered":"2024-09-13T17:10:00.142778+0000","last_unstale":"2024-09-13T17:10:01.459308+0000","last_undegraded":"2024-09-13T17:10:01.459308+0000","last_fullsized":"2024-09-13T17:10:01.459308+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:18.217013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461734+0000","last_change":"2024-09-13T17:10:00.149053+0000","last_active":"2024-09-13T17:10:01.461734+0000","last_peered":"2024-09-13T17:10:01.461734+0000","last_clean":"2024-09-13T17:10:01.461734+0000","last_became_active":"2024-09-13T17:10:00.148823+0000","last_became_peered":"2024-09-13T17:10:00.148823+0000","last_unstale":"2024-09-13T17:10:01.461734+0000","last_undegraded":"2024-09-13T17:10:01.461734+0000","last_fullsized":"2024-09-13T17:10:01.461734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:00.679023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461972+0000","last_change":"2024-09-13T17:10:00.148132+0000","last_active":"2024-09-13T17:10:01.461972+0000","last_peered":"2024-09-13T17:10:01.461972+0000","last_clean":"2024-09-13T17:10:01.461972+0000","last_became_active":"2024-09-13T17:10:00.146758+0000","last_became_peered":"2024-09-13T17:10:00.146758+0000","last_unstale":"2024-09-13T17:10:01.461972+0000","last_undegraded":"2024-09-13T17:10:01.461972+0000","last_fullsized":"2024-09-13T17:10:01.461972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:22.008799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130324+0000","last_change":"2024-09-13T17:10:00.146744+0000","last_active":"2024-09-13T17:10:01.130324+0000","last_peered":"2024-09-13T17:10:01.130324+0000","last_clean":"2024-09-13T17:10:01.130324+0000","last_became_active":"2024-09-13T17:10:00.146473+0000","last_became_peered":"2024-09-13T17:10:00.146473+0000","last_unstale":"2024-09-13T17:10:01.130324+0000","last_undegraded":"2024-09-13T17:10:01.130324+0000","last_fullsized":"2024-09-13T17:10:01.130324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:33.167397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459034+0000","last_change":"2024-09-13T17:10:00.154478+0000","last_active":"2024-09-13T17:10:01.459034+0000","last_peered":"2024-09-13T17:10:01.459034+0000","last_clean":"2024-09-13T17:10:01.459034+0000","last_became_active":"2024-09-13T17:10:00.154154+0000","last_became_peered":"2024-09-13T17:10:00.154154+0000","last_unstale":"2024-09-13T17:10:01.459034+0000","last_undegraded":"2024-09-13T17:10:01.459034+0000","last_fullsized":"2024-09-13T17:10:01.459034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:53.424016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130795+0000","last_change":"2024-09-13T17:10:00.142625+0000","last_active":"2024-09-13T17:10:01.130795+0000","last_peered":"2024-09-13T17:10:01.130795+0000","last_clean":"2024-09-13T17:10:01.130795+0000","last_became_active":"2024-09-13T17:10:00.142373+0000","last_became_peered":"2024-09-13T17:10:00.142373+0000","last_unstale":"2024-09-13T17:10:01.130795+0000","last_undegraded":"2024-09-13T17:10:01.130795+0000","last_fullsized":"2024-09-13T17:10:01.130795+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:45.284692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"85'4","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460558+0000","last_change":"2024-09-13T17:09:59.756290+0000","last_active":"2024-09-13T17:10:01.460558+0000","last_peered":"2024-09-13T17:10:01.460558+0000","last_clean":"2024-09-13T17:10:01.460558+0000","last_became_active":"2024-09-13T17:09:59.756002+0000","last_became_peered":"2024-09-13T17:09:59.756002+0000","last_unstale":"2024-09-13T17:10:01.460558+0000","last_undegraded":"2024-09-13T17:10:01.460558+0000","last_fullsized":"2024-09-13T17:10:01.460558+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:25.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460110+0000","last_change":"2024-09-13T17:10:00.150309+0000","last_active":"2024-09-13T17:10:01.460110+0000","last_peered":"2024-09-13T17:10:01.460110+0000","last_clean":"2024-09-13T17:10:01.460110+0000","last_became_active":"2024-09-13T17:10:00.150040+0000","last_became_peered":"2024-09-13T17:10:00.150040+0000","last_unstale":"2024-09-13T17:10:01.460110+0000","last_undegraded":"2024-09-13T17:10:01.460110+0000","last_fullsized":"2024-09-13T17:10:01.460110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:33.167397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"85'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131649+0000","last_change":"2024-09-13T17:09:59.763147+0000","last_active":"2024-09-13T17:10:01.131649+0000","last_peered":"2024-09-13T17:10:01.131649+0000","last_clean":"2024-09-13T17:10:01.131649+0000","last_became_active":"2024-09-13T17:09:59.762449+0000","last_became_peered":"2024-09-13T17:09:59.762449+0000","last_unstale":"2024-09-13T17:10:01.131649+0000","last_undegraded":"2024-09-13T17:10:01.131649+0000","last_fullsized":"2024-09-13T17:10:01.131649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:55.772560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459541+0000","last_change":"2024-09-13T17:10:00.151962+0000","last_active":"2024-09-13T17:10:01.459541+0000","last_peered":"2024-09-13T17:10:01.459541+0000","last_clean":"2024-09-13T17:10:01.459541+0000","last_became_active":"2024-09-13T17:10:00.151701+0000","last_became_peered":"2024-09-13T17:10:00.151701+0000","last_unstale":"2024-09-13T17:10:01.459541+0000","last_undegraded":"2024-09-13T17:10:01.459541+0000","last_fullsized":"2024-09-13T17:10:01.459541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:54.389943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"85'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360758+0000","last_change":"2024-09-13T17:09:59.757280+0000","last_active":"2024-09-13T17:10:01.360758+0000","last_peered":"2024-09-13T17:10:01.360758+0000","last_clean":"2024-09-13T17:10:01.360758+0000","last_became_active":"2024-09-13T17:09:59.757020+0000","last_became_peered":"2024-09-13T17:09:59.757020+0000","last_unstale":"2024-09-13T17:10:01.360758+0000","last_undegraded":"2024-09-13T17:10:01.360758+0000","last_fullsized":"2024-09-13T17:10:01.360758+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:52.420683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.132241+0000","last_change":"2024-09-13T17:10:00.133991+0000","last_active":"2024-09-13T17:10:01.132241+0000","last_peered":"2024-09-13T17:10:01.132241+0000","last_clean":"2024-09-13T17:10:01.132241+0000","last_became_active":"2024-09-13T17:10:00.133743+0000","last_became_peered":"2024-09-13T17:10:00.133743+0000","last_unstale":"2024-09-13T17:10:01.132241+0000","last_undegraded":"2024-09-13T17:10:01.132241+0000","last_fullsized":"2024-09-13T17:10:01.132241+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:56.105440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"85'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360379+0000","last_change":"2024-09-13T17:09:59.758435+0000","last_active":"2024-09-13T17:10:01.360379+0000","last_peered":"2024-09-13T17:10:01.360379+0000","last_clean":"2024-09-13T17:10:01.360379+0000","last_became_active":"2024-09-13T17:09:59.758153+0000","last_became_peered":"2024-09-13T17:09:59.758153+0000","last_unstale":"2024-09-13T17:10:01.360379+0000","last_undegraded":"2024-09-13T17:10:01.360379+0000","last_fullsized":"2024-09-13T17:10:01.360379+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:06.000114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.462144+0000","last_change":"2024-09-13T17:10:00.147882+0000","last_active":"2024-09-13T17:10:01.462144+0000","last_peered":"2024-09-13T17:10:01.462144+0000","last_clean":"2024-09-13T17:10:01.462144+0000","last_became_active":"2024-09-13T17:10:00.143030+0000","last_became_peered":"2024-09-13T17:10:00.143030+0000","last_unstale":"2024-09-13T17:10:01.462144+0000","last_undegraded":"2024-09-13T17:10:01.462144+0000","last_fullsized":"2024-09-13T17:10:01.462144+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:12.346720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"85'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131568+0000","last_change":"2024-09-13T17:09:59.763138+0000","last_active":"2024-09-13T17:10:01.131568+0000","last_peered":"2024-09-13T17:10:01.131568+0000","last_clean":"2024-09-13T17:10:01.131568+0000","last_became_active":"2024-09-13T17:09:59.761156+0000","last_became_peered":"2024-09-13T17:09:59.761156+0000","last_unstale":"2024-09-13T17:10:01.131568+0000","last_undegraded":"2024-09-13T17:10:01.131568+0000","last_fullsized":"2024-09-13T17:10:01.131568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:25.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131178+0000","last_change":"2024-09-13T17:10:00.134608+0000","last_active":"2024-09-13T17:10:01.131178+0000","last_peered":"2024-09-13T17:10:01.131178+0000","last_clean":"2024-09-13T17:10:01.131178+0000","last_became_active":"2024-09-13T17:10:00.134127+0000","last_became_peered":"2024-09-13T17:10:00.134127+0000","last_unstale":"2024-09-13T17:10:01.131178+0000","last_undegraded":"2024-09-13T17:10:01.131178+0000","last_fullsized":"2024-09-13T17:10:01.131178+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:05.843507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"85'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131867+0000","last_change":"2024-09-13T17:09:59.763003+0000","last_active":"2024-09-13T17:10:01.131867+0000","last_peered":"2024-09-13T17:10:01.131867+0000","last_clean":"2024-09-13T17:10:01.131867+0000","last_became_active":"2024-09-13T17:09:59.761197+0000","last_became_peered":"2024-09-13T17:09:59.761197+0000","last_unstale":"2024-09-13T17:10:01.131867+0000","last_undegraded":"2024-09-13T17:10:01.131867+0000","last_fullsized":"2024-09-13T17:10:01.131867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:59.675690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130883+0000","last_change":"2024-09-13T17:10:00.137965+0000","last_active":"2024-09-13T17:10:01.130883+0000","last_peered":"2024-09-13T17:10:01.130883+0000","last_clean":"2024-09-13T17:10:01.130883+0000","last_became_active":"2024-09-13T17:10:00.137698+0000","last_became_peered":"2024-09-13T17:10:00.137698+0000","last_unstale":"2024-09-13T17:10:01.130883+0000","last_undegraded":"2024-09-13T17:10:01.130883+0000","last_fullsized":"2024-09-13T17:10:01.130883+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:23.929852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.359709+0000","last_change":"2024-09-13T17:09:59.760602+0000","last_active":"2024-09-13T17:10:01.359709+0000","last_peered":"2024-09-13T17:10:01.359709+0000","last_clean":"2024-09-13T17:10:01.359709+0000","last_became_active":"2024-09-13T17:09:59.760304+0000","last_became_peered":"2024-09-13T17:09:59.760304+0000","last_unstale":"2024-09-13T17:10:01.359709+0000","last_undegraded":"2024-09-13T17:10:01.359709+0000","last_fullsized":"2024-09-13T17:10:01.359709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:04.840174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.127912+0000","last_change":"2024-09-13T17:10:00.142553+0000","last_active":"2024-09-13T17:10:01.127912+0000","last_peered":"2024-09-13T17:10:01.127912+0000","last_clean":"2024-09-13T17:10:01.127912+0000","last_became_active":"2024-09-13T17:10:00.142322+0000","last_became_peered":"2024-09-13T17:10:00.142322+0000","last_unstale":"2024-09-13T17:10:01.127912+0000","last_undegraded":"2024-09-13T17:10:01.127912+0000","last_fullsized":"2024-09-13T17:10:01.127912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:33.844836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461575+0000","last_change":"2024-09-13T17:09:59.762962+0000","last_active":"2024-09-13T17:10:01.461575+0000","last_peered":"2024-09-13T17:10:01.461575+0000","last_clean":"2024-09-13T17:10:01.461575+0000","last_became_active":"2024-09-13T17:09:59.762646+0000","last_became_peered":"2024-09-13T17:09:59.762646+0000","last_unstale":"2024-09-13T17:10:01.461575+0000","last_undegraded":"2024-09-13T17:10:01.461575+0000","last_fullsized":"2024-09-13T17:10:01.461575+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:42.288299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.128314+0000","last_change":"2024-09-13T17:10:00.141947+0000","last_active":"2024-09-13T17:10:01.128314+0000","last_peered":"2024-09-13T17:10:01.128314+0000","last_clean":"2024-09-13T17:10:01.128314+0000","last_became_active":"2024-09-13T17:10:00.141715+0000","last_became_peered":"2024-09-13T17:10:00.141715+0000","last_unstale":"2024-09-13T17:10:01.128314+0000","last_undegraded":"2024-09-13T17:10:01.128314+0000","last_fullsized":"2024-09-13T17:10:01.128314+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:04.048489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460649+0000","last_change":"2024-09-13T17:09:59.757028+0000","last_active":"2024-09-13T17:10:01.460649+0000","last_peered":"2024-09-13T17:10:01.460649+0000","last_clean":"2024-09-13T17:10:01.460649+0000","last_became_active":"2024-09-13T17:09:59.756695+0000","last_became_peered":"2024-09-13T17:09:59.756695+0000","last_unstale":"2024-09-13T17:10:01.460649+0000","last_undegraded":"2024-09-13T17:10:01.460649+0000","last_fullsized":"2024-09-13T17:10:01.460649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:38.182431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459851+0000","last_change":"2024-09-13T17:10:00.132823+0000","last_active":"2024-09-13T17:10:01.459851+0000","last_peered":"2024-09-13T17:10:01.459851+0000","last_clean":"2024-09-13T17:10:01.459851+0000","last_became_active":"2024-09-13T17:10:00.132579+0000","last_became_peered":"2024-09-13T17:10:00.132579+0000","last_unstale":"2024-09-13T17:10:01.459851+0000","last_undegraded":"2024-09-13T17:10:01.459851+0000","last_fullsized":"2024-09-13T17:10:01.459851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:15:40.423580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460442+0000","last_change":"2024-09-13T17:09:59.763067+0000","last_active":"2024-09-13T17:10:01.460442+0000","last_peered":"2024-09-13T17:10:01.460442+0000","last_clean":"2024-09-13T17:10:01.460442+0000","last_became_active":"2024-09-13T17:09:59.762793+0000","last_became_peered":"2024-09-13T17:09:59.762793+0000","last_unstale":"2024-09-13T17:10:01.460442+0000","last_undegraded":"2024-09-13T17:10:01.460442+0000","last_fullsized":"2024-09-13T17:10:01.460442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:18.984157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360273+0000","last_change":"2024-09-13T17:10:00.149781+0000","last_active":"2024-09-13T17:10:01.360273+0000","last_peered":"2024-09-13T17:10:01.360273+0000","last_clean":"2024-09-13T17:10:01.360273+0000","last_became_active":"2024-09-13T17:10:00.148381+0000","last_became_peered":"2024-09-13T17:10:00.148381+0000","last_unstale":"2024-09-13T17:10:01.360273+0000","last_undegraded":"2024-09-13T17:10:01.360273+0000","last_fullsized":"2024-09-13T17:10:01.360273+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:38.730800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"85'3","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459301+0000","last_change":"2024-09-13T17:09:59.755947+0000","last_active":"2024-09-13T17:10:01.459301+0000","last_peered":"2024-09-13T17:10:01.459301+0000","last_clean":"2024-09-13T17:10:01.459301+0000","last_became_active":"2024-09-13T17:09:59.755637+0000","last_became_peered":"2024-09-13T17:09:59.755637+0000","last_unstale":"2024-09-13T17:10:01.459301+0000","last_undegraded":"2024-09-13T17:10:01.459301+0000","last_fullsized":"2024-09-13T17:10:01.459301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:31.722853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131154+0000","last_change":"2024-09-13T17:10:00.152661+0000","last_active":"2024-09-13T17:10:01.131154+0000","last_peered":"2024-09-13T17:10:01.131154+0000","last_clean":"2024-09-13T17:10:01.131154+0000","last_became_active":"2024-09-13T17:10:00.152449+0000","last_became_peered":"2024-09-13T17:10:00.152449+0000","last_unstale":"2024-09-13T17:10:01.131154+0000","last_undegraded":"2024-09-13T17:10:01.131154+0000","last_fullsized":"2024-09-13T17:10:01.131154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:54.389943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"85'6","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460213+0000","last_change":"2024-09-13T17:09:59.757281+0000","last_active":"2024-09-13T17:10:01.460213+0000","last_peered":"2024-09-13T17:10:01.460213+0000","last_clean":"2024-09-13T17:10:01.460213+0000","last_became_active":"2024-09-13T17:09:59.757002+0000","last_became_peered":"2024-09-13T17:09:59.757002+0000","last_unstale":"2024-09-13T17:10:01.460213+0000","last_undegraded":"2024-09-13T17:10:01.460213+0000","last_fullsized":"2024-09-13T17:10:01.460213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:10.090796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.359860+0000","last_change":"2024-09-13T17:10:00.150544+0000","last_active":"2024-09-13T17:10:01.359860+0000","last_peered":"2024-09-13T17:10:01.359860+0000","last_clean":"2024-09-13T17:10:01.359860+0000","last_became_active":"2024-09-13T17:10:00.148458+0000","last_became_peered":"2024-09-13T17:10:00.148458+0000","last_unstale":"2024-09-13T17:10:01.359860+0000","last_undegraded":"2024-09-13T17:10:01.359860+0000","last_fullsized":"2024-09-13T17:10:01.359860+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:23.929852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"85'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461725+0000","last_change":"2024-09-13T17:09:59.756977+0000","last_active":"2024-09-13T17:10:01.461725+0000","last_peered":"2024-09-13T17:10:01.461725+0000","last_clean":"2024-09-13T17:10:01.461725+0000","last_became_active":"2024-09-13T17:09:59.756703+0000","last_became_peered":"2024-09-13T17:09:59.756703+0000","last_unstale":"2024-09-13T17:10:01.461725+0000","last_undegraded":"2024-09-13T17:10:01.461725+0000","last_fullsized":"2024-09-13T17:10:01.461725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:06.860118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131962+0000","last_change":"2024-09-13T17:10:00.146738+0000","last_active":"2024-09-13T17:10:01.131962+0000","last_peered":"2024-09-13T17:10:01.131962+0000","last_clean":"2024-09-13T17:10:01.131962+0000","last_became_active":"2024-09-13T17:10:00.146519+0000","last_became_peered":"2024-09-13T17:10:00.146519+0000","last_unstale":"2024-09-13T17:10:01.131962+0000","last_undegraded":"2024-09-13T17:10:01.131962+0000","last_fullsized":"2024-09-13T17:10:01.131962+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:33.119970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.127946+0000","last_change":"2024-09-13T17:09:59.757900+0000","last_active":"2024-09-13T17:10:01.127946+0000","last_peered":"2024-09-13T17:10:01.127946+0000","last_clean":"2024-09-13T17:10:01.127946+0000","last_became_active":"2024-09-13T17:09:59.757434+0000","last_became_peered":"2024-09-13T17:09:59.757434+0000","last_unstale":"2024-09-13T17:10:01.127946+0000","last_undegraded":"2024-09-13T17:10:01.127946+0000","last_fullsized":"2024-09-13T17:10:01.127946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:04.840174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461646+0000","last_change":"2024-09-13T17:10:00.147692+0000","last_active":"2024-09-13T17:10:01.461646+0000","last_peered":"2024-09-13T17:10:01.461646+0000","last_clean":"2024-09-13T17:10:01.461646+0000","last_became_active":"2024-09-13T17:10:00.143031+0000","last_became_peered":"2024-09-13T17:10:00.143031+0000","last_unstale":"2024-09-13T17:10:01.461646+0000","last_undegraded":"2024-09-13T17:10:01.461646+0000","last_fullsized":"2024-09-13T17:10:01.461646+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:59.785880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459250+0000","last_change":"2024-09-13T17:09:59.761204+0000","last_active":"2024-09-13T17:10:01.459250+0000","last_peered":"2024-09-13T17:10:01.459250+0000","last_clean":"2024-09-13T17:10:01.459250+0000","last_became_active":"2024-09-13T17:09:59.760948+0000","last_became_peered":"2024-09-13T17:09:59.760948+0000","last_unstale":"2024-09-13T17:10:01.459250+0000","last_undegraded":"2024-09-13T17:10:01.459250+0000","last_fullsized":"2024-09-13T17:10:01.459250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:25.999442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460648+0000","last_change":"2024-09-13T17:10:00.149009+0000","last_active":"2024-09-13T17:10:01.460648+0000","last_peered":"2024-09-13T17:10:01.460648+0000","last_clean":"2024-09-13T17:10:01.460648+0000","last_became_active":"2024-09-13T17:10:00.148738+0000","last_became_peered":"2024-09-13T17:10:00.148738+0000","last_unstale":"2024-09-13T17:10:01.460648+0000","last_undegraded":"2024-09-13T17:10:01.460648+0000","last_fullsized":"2024-09-13T17:10:01.460648+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:27.002775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"85'8","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.359586+0000","last_change":"2024-09-13T17:09:59.759450+0000","last_active":"2024-09-13T17:10:01.359586+0000","last_peered":"2024-09-13T17:10:01.359586+0000","last_clean":"2024-09-13T17:10:01.359586+0000","last_became_active":"2024-09-13T17:09:59.758913+0000","last_became_peered":"2024-09-13T17:09:59.758913+0000","last_unstale":"2024-09-13T17:10:01.359586+0000","last_undegraded":"2024-09-13T17:10:01.359586+0000","last_fullsized":"2024-09-13T17:10:01.359586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:32.164064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.132310+0000","last_change":"2024-09-13T17:10:00.133183+0000","last_active":"2024-09-13T17:10:01.132310+0000","last_peered":"2024-09-13T17:10:01.132310+0000","last_clean":"2024-09-13T17:10:01.132310+0000","last_became_active":"2024-09-13T17:10:00.132957+0000","last_became_peered":"2024-09-13T17:10:00.132957+0000","last_unstale":"2024-09-13T17:10:01.132310+0000","last_undegraded":"2024-09-13T17:10:01.132310+0000","last_fullsized":"2024-09-13T17:10:01.132310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:28.833515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"85'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460852+0000","last_change":"2024-09-13T17:09:59.758816+0000","last_active":"2024-09-13T17:10:01.460852+0000","last_peered":"2024-09-13T17:10:01.460852+0000","last_clean":"2024-09-13T17:10:01.460852+0000","last_became_active":"2024-09-13T17:09:59.758513+0000","last_became_peered":"2024-09-13T17:09:59.758513+0000","last_unstale":"2024-09-13T17:10:01.460852+0000","last_undegraded":"2024-09-13T17:10:01.460852+0000","last_fullsized":"2024-09-13T17:10:01.460852+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:55.772560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460339+0000","last_change":"2024-09-13T17:10:00.137472+0000","last_active":"2024-09-13T17:10:01.460339+0000","last_peered":"2024-09-13T17:10:01.460339+0000","last_clean":"2024-09-13T17:10:01.460339+0000","last_became_active":"2024-09-13T17:10:00.137205+0000","last_became_peered":"2024-09-13T17:10:00.137205+0000","last_unstale":"2024-09-13T17:10:01.460339+0000","last_undegraded":"2024-09-13T17:10:01.460339+0000","last_fullsized":"2024-09-13T17:10:01.460339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:34.509041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"85'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360614+0000","last_change":"2024-09-13T17:09:59.764076+0000","last_active":"2024-09-13T17:10:01.360614+0000","last_peered":"2024-09-13T17:10:01.360614+0000","last_clean":"2024-09-13T17:10:01.360614+0000","last_became_active":"2024-09-13T17:09:59.763797+0000","last_became_peered":"2024-09-13T17:09:59.763797+0000","last_unstale":"2024-09-13T17:10:01.360614+0000","last_undegraded":"2024-09-13T17:10:01.360614+0000","last_fullsized":"2024-09-13T17:10:01.360614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:04.215322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131179+0000","last_change":"2024-09-13T17:10:00.153319+0000","last_active":"2024-09-13T17:10:01.131179+0000","last_peered":"2024-09-13T17:10:01.131179+0000","last_clean":"2024-09-13T17:10:01.131179+0000","last_became_active":"2024-09-13T17:10:00.153104+0000","last_became_peered":"2024-09-13T17:10:00.153104+0000","last_unstale":"2024-09-13T17:10:01.131179+0000","last_undegraded":"2024-09-13T17:10:01.131179+0000","last_fullsized":"2024-09-13T17:10:01.131179+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:53.424016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360452+0000","last_change":"2024-09-13T17:09:59.760580+0000","last_active":"2024-09-13T17:10:01.360452+0000","last_peered":"2024-09-13T17:10:01.360452+0000","last_clean":"2024-09-13T17:10:01.360452+0000","last_became_active":"2024-09-13T17:09:59.760317+0000","last_became_peered":"2024-09-13T17:09:59.760317+0000","last_unstale":"2024-09-13T17:10:01.360452+0000","last_undegraded":"2024-09-13T17:10:01.360452+0000","last_fullsized":"2024-09-13T17:10:01.360452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:32.841503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460445+0000","last_change":"2024-09-13T17:10:00.153710+0000","last_active":"2024-09-13T17:10:01.460445+0000","last_peered":"2024-09-13T17:10:01.460445+0000","last_clean":"2024-09-13T17:10:01.460445+0000","last_became_active":"2024-09-13T17:10:00.152572+0000","last_became_peered":"2024-09-13T17:10:00.152572+0000","last_unstale":"2024-09-13T17:10:01.460445+0000","last_undegraded":"2024-09-13T17:10:01.460445+0000","last_fullsized":"2024-09-13T17:10:01.460445+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:04.535878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"85'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.128294+0000","last_change":"2024-09-13T17:09:59.756068+0000","last_active":"2024-09-13T17:10:01.128294+0000","last_peered":"2024-09-13T17:10:01.128294+0000","last_clean":"2024-09-13T17:10:01.128294+0000","last_became_active":"2024-09-13T17:09:59.755762+0000","last_became_peered":"2024-09-13T17:09:59.755762+0000","last_unstale":"2024-09-13T17:10:01.128294+0000","last_undegraded":"2024-09-13T17:10:01.128294+0000","last_fullsized":"2024-09-13T17:10:01.128294+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:57.205009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459352+0000","last_change":"2024-09-13T17:10:00.144221+0000","last_active":"2024-09-13T17:10:01.459352+0000","last_peered":"2024-09-13T17:10:01.459352+0000","last_clean":"2024-09-13T17:10:01.459352+0000","last_became_active":"2024-09-13T17:10:00.144021+0000","last_became_peered":"2024-09-13T17:10:00.144021+0000","last_unstale":"2024-09-13T17:10:01.459352+0000","last_undegraded":"2024-09-13T17:10:01.459352+0000","last_fullsized":"2024-09-13T17:10:01.459352+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:35.618573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460525+0000","last_change":"2024-09-13T17:09:59.755097+0000","last_active":"2024-09-13T17:10:01.460525+0000","last_peered":"2024-09-13T17:10:01.460525+0000","last_clean":"2024-09-13T17:10:01.460525+0000","last_became_active":"2024-09-13T17:09:59.754027+0000","last_became_peered":"2024-09-13T17:09:59.754027+0000","last_unstale":"2024-09-13T17:10:01.460525+0000","last_undegraded":"2024-09-13T17:10:01.460525+0000","last_fullsized":"2024-09-13T17:10:01.460525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:35.140445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460243+0000","last_change":"2024-09-13T17:10:00.132840+0000","last_active":"2024-09-13T17:10:01.460243+0000","last_peered":"2024-09-13T17:10:01.460243+0000","last_clean":"2024-09-13T17:10:01.460243+0000","last_became_active":"2024-09-13T17:10:00.132579+0000","last_became_peered":"2024-09-13T17:10:00.132579+0000","last_unstale":"2024-09-13T17:10:01.460243+0000","last_undegraded":"2024-09-13T17:10:01.460243+0000","last_fullsized":"2024-09-13T17:10:01.460243+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:04.484639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460304+0000","last_change":"2024-09-13T17:09:59.754905+0000","last_active":"2024-09-13T17:10:01.460304+0000","last_peered":"2024-09-13T17:10:01.460304+0000","last_clean":"2024-09-13T17:10:01.460304+0000","last_became_active":"2024-09-13T17:09:59.754649+0000","last_became_peered":"2024-09-13T17:09:59.754649+0000","last_unstale":"2024-09-13T17:10:01.460304+0000","last_undegraded":"2024-09-13T17:10:01.460304+0000","last_fullsized":"2024-09-13T17:10:01.460304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.000829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.458976+0000","last_change":"2024-09-13T17:10:00.152505+0000","last_active":"2024-09-13T17:10:01.458976+0000","last_peered":"2024-09-13T17:10:01.458976+0000","last_clean":"2024-09-13T17:10:01.458976+0000","last_became_active":"2024-09-13T17:10:00.152193+0000","last_became_peered":"2024-09-13T17:10:00.152193+0000","last_unstale":"2024-09-13T17:10:01.458976+0000","last_undegraded":"2024-09-13T17:10:01.458976+0000","last_fullsized":"2024-09-13T17:10:01.458976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:48.556200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.127793+0000","last_change":"2024-09-13T17:09:59.756770+0000","last_active":"2024-09-13T17:10:01.127793+0000","last_peered":"2024-09-13T17:10:01.127793+0000","last_clean":"2024-09-13T17:10:01.127793+0000","last_became_active":"2024-09-13T17:09:59.756514+0000","last_became_peered":"2024-09-13T17:09:59.756514+0000","last_unstale":"2024-09-13T17:10:01.127793+0000","last_undegraded":"2024-09-13T17:10:01.127793+0000","last_fullsized":"2024-09-13T17:10:01.127793+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:04.215322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131021+0000","last_change":"2024-09-13T17:10:00.133443+0000","last_active":"2024-09-13T17:10:01.131021+0000","last_peered":"2024-09-13T17:10:01.131021+0000","last_clean":"2024-09-13T17:10:01.131021+0000","last_became_active":"2024-09-13T17:10:00.133190+0000","last_became_peered":"2024-09-13T17:10:00.133190+0000","last_unstale":"2024-09-13T17:10:01.131021+0000","last_undegraded":"2024-09-13T17:10:01.131021+0000","last_fullsized":"2024-09-13T17:10:01.131021+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:05.218655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"85'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.461695+0000","last_change":"2024-09-13T17:09:59.759991+0000","last_active":"2024-09-13T17:10:01.461695+0000","last_peered":"2024-09-13T17:10:01.461695+0000","last_clean":"2024-09-13T17:10:01.461695+0000","last_became_active":"2024-09-13T17:09:59.759705+0000","last_became_peered":"2024-09-13T17:09:59.759705+0000","last_unstale":"2024-09-13T17:10:01.461695+0000","last_undegraded":"2024-09-13T17:10:01.461695+0000","last_fullsized":"2024-09-13T17:10:01.461695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:00.477149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.132479+0000","last_change":"2024-09-13T17:10:00.142862+0000","last_active":"2024-09-13T17:10:01.132479+0000","last_peered":"2024-09-13T17:10:01.132479+0000","last_clean":"2024-09-13T17:10:01.132479+0000","last_became_active":"2024-09-13T17:10:00.142636+0000","last_became_peered":"2024-09-13T17:10:00.142636+0000","last_unstale":"2024-09-13T17:10:01.132479+0000","last_undegraded":"2024-09-13T17:10:01.132479+0000","last_fullsized":"2024-09-13T17:10:01.132479+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:38.730800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.462102+0000","last_change":"2024-09-13T17:09:59.757488+0000","last_active":"2024-09-13T17:10:01.462102+0000","last_peered":"2024-09-13T17:10:01.462102+0000","last_clean":"2024-09-13T17:10:01.462102+0000","last_became_active":"2024-09-13T17:09:59.757232+0000","last_became_peered":"2024-09-13T17:09:59.757232+0000","last_unstale":"2024-09-13T17:10:01.462102+0000","last_undegraded":"2024-09-13T17:10:01.462102+0000","last_fullsized":"2024-09-13T17:10:01.462102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:32.387241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459759+0000","last_change":"2024-09-13T17:10:00.143061+0000","last_active":"2024-09-13T17:10:01.459759+0000","last_peered":"2024-09-13T17:10:01.459759+0000","last_clean":"2024-09-13T17:10:01.459759+0000","last_became_active":"2024-09-13T17:10:00.142752+0000","last_became_peered":"2024-09-13T17:10:00.142752+0000","last_unstale":"2024-09-13T17:10:01.459759+0000","last_undegraded":"2024-09-13T17:10:01.459759+0000","last_fullsized":"2024-09-13T17:10:01.459759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:48.556200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459725+0000","last_change":"2024-09-13T17:09:59.756416+0000","last_active":"2024-09-13T17:10:01.459725+0000","last_peered":"2024-09-13T17:10:01.459725+0000","last_clean":"2024-09-13T17:10:01.459725+0000","last_became_active":"2024-09-13T17:09:59.755886+0000","last_became_peered":"2024-09-13T17:09:59.755886+0000","last_unstale":"2024-09-13T17:10:01.459725+0000","last_undegraded":"2024-09-13T17:10:01.459725+0000","last_fullsized":"2024-09-13T17:10:01.459725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.798999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131423+0000","last_change":"2024-09-13T17:10:00.146773+0000","last_active":"2024-09-13T17:10:01.131423+0000","last_peered":"2024-09-13T17:10:01.131423+0000","last_clean":"2024-09-13T17:10:01.131423+0000","last_became_active":"2024-09-13T17:10:00.146527+0000","last_became_peered":"2024-09-13T17:10:00.146527+0000","last_unstale":"2024-09-13T17:10:01.131423+0000","last_undegraded":"2024-09-13T17:10:01.131423+0000","last_fullsized":"2024-09-13T17:10:01.131423+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:34.509041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.460907+0000","last_change":"2024-09-13T17:09:59.756986+0000","last_active":"2024-09-13T17:10:01.460907+0000","last_peered":"2024-09-13T17:10:01.460907+0000","last_clean":"2024-09-13T17:10:01.460907+0000","last_became_active":"2024-09-13T17:09:59.756710+0000","last_became_peered":"2024-09-13T17:09:59.756710+0000","last_unstale":"2024-09-13T17:10:01.460907+0000","last_undegraded":"2024-09-13T17:10:01.460907+0000","last_fullsized":"2024-09-13T17:10:01.460907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:53.716197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459714+0000","last_change":"2024-09-13T17:10:00.144311+0000","last_active":"2024-09-13T17:10:01.459714+0000","last_peered":"2024-09-13T17:10:01.459714+0000","last_clean":"2024-09-13T17:10:01.459714+0000","last_became_active":"2024-09-13T17:10:00.144036+0000","last_became_peered":"2024-09-13T17:10:00.144036+0000","last_unstale":"2024-09-13T17:10:01.459714+0000","last_undegraded":"2024-09-13T17:10:01.459714+0000","last_fullsized":"2024-09-13T17:10:01.459714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:38.061771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360383+0000","last_change":"2024-09-13T17:09:59.759112+0000","last_active":"2024-09-13T17:10:01.360383+0000","last_peered":"2024-09-13T17:10:01.360383+0000","last_clean":"2024-09-13T17:10:01.360383+0000","last_became_active":"2024-09-13T17:09:59.758494+0000","last_became_peered":"2024-09-13T17:09:59.758494+0000","last_unstale":"2024-09-13T17:10:01.360383+0000","last_undegraded":"2024-09-13T17:10:01.360383+0000","last_fullsized":"2024-09-13T17:10:01.360383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:17.213680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.360207+0000","last_change":"2024-09-13T17:10:00.148599+0000","last_active":"2024-09-13T17:10:01.360207+0000","last_peered":"2024-09-13T17:10:01.360207+0000","last_clean":"2024-09-13T17:10:01.360207+0000","last_became_active":"2024-09-13T17:10:00.147525+0000","last_became_peered":"2024-09-13T17:10:00.147525+0000","last_unstale":"2024-09-13T17:10:01.360207+0000","last_undegraded":"2024-09-13T17:10:01.360207+0000","last_fullsized":"2024-09-13T17:10:01.360207+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:56.160489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.132068+0000","last_change":"2024-09-13T17:09:59.762817+0000","last_active":"2024-09-13T17:10:01.132068+0000","last_peered":"2024-09-13T17:10:01.132068+0000","last_clean":"2024-09-13T17:10:01.132068+0000","last_became_active":"2024-09-13T17:09:59.760778+0000","last_became_peered":"2024-09-13T17:09:59.760778+0000","last_unstale":"2024-09-13T17:10:01.132068+0000","last_undegraded":"2024-09-13T17:10:01.132068+0000","last_fullsized":"2024-09-13T17:10:01.132068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:53.716197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.131115+0000","last_change":"2024-09-13T17:10:00.151948+0000","last_active":"2024-09-13T17:10:01.131115+0000","last_peered":"2024-09-13T17:10:01.131115+0000","last_clean":"2024-09-13T17:10:01.131115+0000","last_became_active":"2024-09-13T17:10:00.151647+0000","last_became_peered":"2024-09-13T17:10:00.151647+0000","last_unstale":"2024-09-13T17:10:01.131115+0000","last_undegraded":"2024-09-13T17:10:01.131115+0000","last_fullsized":"2024-09-13T17:10:01.131115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:46.207800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459515+0000","last_change":"2024-09-13T17:09:59.758071+0000","last_active":"2024-09-13T17:10:01.459515+0000","last_peered":"2024-09-13T17:10:01.459515+0000","last_clean":"2024-09-13T17:10:01.459515+0000","last_became_active":"2024-09-13T17:09:59.757791+0000","last_became_peered":"2024-09-13T17:09:59.757791+0000","last_unstale":"2024-09-13T17:10:01.459515+0000","last_undegraded":"2024-09-13T17:10:01.459515+0000","last_fullsized":"2024-09-13T17:10:01.459515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:59.675690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.459219+0000","last_change":"2024-09-13T17:10:00.137333+0000","last_active":"2024-09-13T17:10:01.459219+0000","last_peered":"2024-09-13T17:10:01.459219+0000","last_clean":"2024-09-13T17:10:01.459219+0000","last_became_active":"2024-09-13T17:10:00.137068+0000","last_became_peered":"2024-09-13T17:10:00.137068+0000","last_unstale":"2024-09-13T17:10:01.459219+0000","last_undegraded":"2024-09-13T17:10:01.459219+0000","last_fullsized":"2024-09-13T17:10:01.459219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:45.284692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.130576+0000","last_change":"2024-09-13T17:09:59.762392+0000","last_active":"2024-09-13T17:10:01.130576+0000","last_peered":"2024-09-13T17:10:01.130576+0000","last_clean":"2024-09-13T17:10:01.130576+0000","last_became_active":"2024-09-13T17:09:59.760734+0000","last_became_peered":"2024-09-13T17:09:59.760734+0000","last_unstale":"2024-09-13T17:10:01.130576+0000","last_undegraded":"2024-09-13T17:10:01.130576+0000","last_fullsized":"2024-09-13T17:10:01.130576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:27.798999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.462100+0000","last_change":"2024-09-13T17:10:00.148422+0000","last_active":"2024-09-13T17:10:01.462100+0000","last_peered":"2024-09-13T17:10:01.462100+0000","last_clean":"2024-09-13T17:10:01.462100+0000","last_became_active":"2024-09-13T17:10:00.146689+0000","last_became_peered":"2024-09-13T17:10:00.146689+0000","last_unstale":"2024-09-13T17:10:01.462100+0000","last_undegraded":"2024-09-13T17:10:01.462100+0000","last_fullsized":"2024-09-13T17:10:01.462100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:59.730851+0000","last_clean_scrub_stamp":"2024-09-13T17:09:59.730851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:56.775893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"85'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T17:10:01.132618+0000","last_change":"2024-09-13T17:09:59.756024+0000","last_active":"2024-09-13T17:10:01.132618+0000","last_peered":"2024-09-13T17:10:01.132618+0000","last_clean":"2024-09-13T17:10:01.132618+0000","last_became_active":"2024-09-13T17:09:59.755740+0000","last_became_peered":"2024-09-13T17:09:59.755740+0000","last_unstale":"2024-09-13T17:10:01.132618+0000","last_undegraded":"2024-09-13T17:10:01.132618+0000","last_fullsized":"2024-09-13T17:10:01.132618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:09:58.727518+0000","last_clean_scrub_stamp":"2024-09-13T17:09:58.727518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:04.215322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T17:10:00.125893+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:10:00.125893+0000","last_peered":"2024-09-13T17:10:00.125893+0000","last_clean":"2024-09-13T17:10:00.125893+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:10:00.125893+0000","last_undegraded":"2024-09-13T17:10:00.125893+0000","last_fullsized":"2024-09-13T17:10:00.125893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1642496,"data_stored":1034717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83499999999999996,"15min":0.84899999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.212,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.745},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.877,"15min":0.90500000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.871}]},{"osd":1,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.92400000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3979999999999999,"5min":1.456,"15min":1.456},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.85099999999999998,"15min":0.85899999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2210000000000001,"5min":1.238,"15min":1.238},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98399999999999999,"15min":1.004},"min":{"1min":0.64500000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.0029999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.93200000000000005,"15min":0.92200000000000004},"min":{"1min":0.628,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.98299999999999998,"15min":0.998},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.1499999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.89700000000000002,"15min":0.90000000000000002},"min":{"1min":0.66600000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.016,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.099,"15min":1.117},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.3959999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.96999999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.032,"15min":1.0389999999999999},"min":{"1min":0.627,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.0209999999999999,"15min":1.018},"min":{"1min":0.77900000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.93500000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0980000000000001,"15min":1.123},"min":{"1min":0.81799999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7170000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.071,"5min":1.1200000000000001,"15min":1.1339999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1056768,"data_stored":444973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76000000000000001,"15min":0.755},"min":{"1min":0.56200000000000006,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85799999999999998,"15min":0.876},"min":{"1min":0.58599999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.052,"5min":1.431,"15min":1.431},"last":0.94199999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92400000000000004,"15min":0.92700000000000005},"min":{"1min":0.64800000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.163,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.61499999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1020000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.64600000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.89500000000000002,"15min":0.91300000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.071,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.94099999999999995,"15min":0.97299999999999998},"min":{"1min":0.59799999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1679999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.077}]},{"osd":3,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95099999999999996,"15min":0.97499999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.198,"5min":1.359,"15min":1.359},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.038,"15min":1.05},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.873}]},{"osd":4,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.89700000000000002,"15min":0.90600000000000003},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1060000000000001,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2250000000000001,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.2529999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.014,"15min":1.018},"min":{"1min":0.74199999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2170000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.016},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.038,"15min":1.0629999999999999},"min":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1819999999999999,"5min":1.597,"15min":1.597},"last":0.98299999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.091,"15min":1.1040000000000001},"min":{"1min":0.82199999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2969999999999999,"5min":1.728,"15min":1.728},"last":1.21},{"interface":"front","average":{"1min":1.099,"5min":1.167,"15min":1.1899999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.526,"5min":2.194,"15min":2.194},"last":1.131}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":1060864,"data_stored":445865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.83699999999999997,"15min":0.86299999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.232,"5min":1.395,"15min":1.395},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.86299999999999999,"15min":0.88300000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.173,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0309999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94599999999999995,"15min":0.95599999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.232,"5min":1.508,"15min":1.508},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95199999999999996,"15min":0.95399999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.302,"5min":1.482,"15min":1.482},"last":0.91300000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.85099999999999998},"min":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2669999999999999,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.69799999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1899999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.83199999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.96699999999999997,"15min":0.997},"min":{"1min":0.67100000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.206,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.626},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92100000000000004,"15min":0.93100000000000005},"min":{"1min":0.58199999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.335,"5min":1.603,"15min":1.603},"last":0.93500000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.022,"15min":1.0589999999999999},"min":{"1min":0.77300000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.208,"5min":1.466,"15min":1.466},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.999,"15min":1.0309999999999999},"min":{"1min":0.65100000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3640000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0680000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0369999999999999,"15min":1.0649999999999999},"min":{"1min":0.76600000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.2,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1439999999999999,"15min":1.1839999999999999},"min":{"1min":0.76600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2669999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.097,"15min":1.137},"min":{"1min":0.75700000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.1899999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.101},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.169,"15min":1.2050000000000001},"min":{"1min":0.76700000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.466,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.012}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":1056768,"data_stored":450579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.751},"min":{"1min":0.52800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94699999999999995,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.629},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1739999999999999,"5min":1.306,"15min":1.306},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.65900000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1579999999999999,"5min":1.357,"15min":1.357},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.93799999999999994,"15min":0.94699999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2050000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1339999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.89500000000000002,"15min":0.88500000000000001},"min":{"1min":0.65400000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1599999999999999,"5min":1.272,"15min":1.272},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.94099999999999995,"15min":0.91500000000000004},"min":{"1min":0.78400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3220000000000001,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.252}]},{"osd":3,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.90400000000000003,"15min":0.92000000000000004},"min":{"1min":0.63700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1879999999999999,"5min":1.464,"15min":1.464},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.89200000000000002,"15min":0.88500000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.25,"5min":1.353,"15min":1.353},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94699999999999995,"15min":0.93999999999999995},"min":{"1min":0.623,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2210000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.0740000000000001,"15min":1.0649999999999999},"min":{"1min":0.83799999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3200000000000001,"5min":1.478,"15min":1.478},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97099999999999997,"15min":0.97399999999999998},"min":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1659999999999999,"5min":1.26,"15min":1.26},"last":0.754},{"interface":"front","average":{"1min":1.095,"5min":1.0580000000000001,"15min":1.048},"min":{"1min":0.83899999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.429,"5min":1.613,"15min":1.613},"last":1.355}]},{"osd":7,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.087,"15min":1.087},"min":{"1min":0.753,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.373,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.329},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.127,"15min":1.1259999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.399,"5min":2.032,"15min":2.032},"last":1.288}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1069056,"data_stored":452143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.32500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.61399999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80000000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.232,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69799999999999995,"15min":0.71799999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.222,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.35299999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.03,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.91200000000000003,"15min":0.92200000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.014},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.93799999999999994,"15min":0.95799999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3740000000000001,"5min":1.899,"15min":1.899},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.61699999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.377,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.98699999999999999,"15min":0.99299999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4330000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.79600000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0169999999999999,"15min":1.024},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0169999999999999,"15min":1.04},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3089999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.96199999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.0720000000000001,"15min":1.089},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.514,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.05,"15min":1.0680000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6599999999999999,"5min":1.756,"15min":1.756},"last":1.048}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1060864,"data_stored":451161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.872,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81200000000000006,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70399999999999996,"15min":0.72599999999999998},"min":{"1min":0.372,"5min":0.37,"15min":0.37},"max":{"1min":0.92700000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.747,"15min":0.77300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0609999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.46300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82599999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94899999999999995,"5min":1.103,"15min":1.103},"last":0.83899999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.91700000000000004,"15min":0.93899999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.157,"5min":1.3,"15min":1.3},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.92100000000000004,"15min":0.92500000000000004},"min":{"1min":0.65900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.157,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.88100000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.93899999999999995,"15min":0.95299999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2170000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.92800000000000005,"15min":0.91800000000000004},"min":{"1min":0.54600000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.1950000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.92800000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.97799999999999998,"15min":0.97199999999999998},"min":{"1min":0.67800000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1,"15min":0.99199999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.26,"5min":1.413,"15min":1.413},"last":1.1459999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.0309999999999999,"15min":1.054},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.26,"5min":1.506,"15min":1.506},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.64500000000000002,"5min":0.625,"15min":0.625},"max":{"1min":1.3460000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.028}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1056768,"data_stored":444473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65400000000000003,"15min":0.66300000000000003},"min":{"1min":0.44500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.097,"5min":1.151,"15min":1.151},"last":0.496},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0589999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64500000000000002,"15min":0.66400000000000003},"min":{"1min":0.47599999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81299999999999994,"5min":1.306,"15min":1.306},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.751,"15min":0.755},"min":{"1min":0.495,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.079,"5min":1.28,"15min":1.28},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78300000000000003,"15min":0.79000000000000004},"min":{"1min":0.497,"5min":0.308,"15min":0.308},"max":{"1min":1.1699999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.82599999999999996},"min":{"1min":0.50800000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1379999999999999,"5min":1.905,"15min":1.905},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2230000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0069999999999999,"15min":1.0329999999999999},"min":{"1min":0.71899999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.272,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":1.03,"15min":1.0660000000000001},"min":{"1min":0.63600000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.179,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.0820000000000001,"15min":1.1100000000000001},"min":{"1min":0.83599999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.296,"5min":1.556,"15min":1.556},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0549999999999999,"15min":1.077},"min":{"1min":0.69099999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3580000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.119},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.109,"15min":1.1359999999999999},"min":{"1min":0.83299999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.327,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1359999999999999,"15min":1.159},"min":{"1min":0.81000000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4359999999999999,"5min":1.712,"15min":1.712},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.80500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3169999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.0780000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1654784,"data_stored":1040981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69199999999999995,"15min":0.70899999999999996},"min":{"1min":0.434,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.92100000000000004,"5min":3.25,"15min":3.25},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.77600000000000002,"15min":0.81000000000000005},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.103,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71499999999999997,"15min":0.73699999999999999},"min":{"1min":0.55800000000000005,"5min":0.307,"15min":0.307},"max":{"1min":0.91600000000000004,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.63},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.81899999999999995,"15min":0.876},"min":{"1min":0.48399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0760000000000001,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.79600000000000004,"15min":0.85699999999999998},"min":{"1min":0.439,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.016,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.89500000000000002,"15min":0.95499999999999996},"min":{"1min":0.50600000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98799999999999999,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.97199999999999998,"15min":1.02},"min":{"1min":0.65800000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.095,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.024,"15min":1.0549999999999999},"min":{"1min":0.76600000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.379,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":1.1140000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.073},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.413,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.0529999999999999,"15min":1.105},"min":{"1min":0.76800000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.3049999999999999,"5min":5.399,"15min":5.399},"last":0.89800000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.121,"15min":1.153},"min":{"1min":0.84399999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.4530000000000001,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.083,"15min":1.115},"min":{"1min":0.78100000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.51,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.111,"15min":1.1299999999999999},"min":{"1min":0.78700000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4570000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.163,"15min":1.2170000000000001},"min":{"1min":0.79700000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.2889999999999999,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":1.1539999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:10:03.566 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:10:03.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T17:10:03.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.690+0000 7fc40dde7700 1 Processor -- start 2024-09-13T17:10:03.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.690+0000 7fc40dde7700 1 -- start start 2024-09-13T17:10:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.690+0000 7fc40dde7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc4080d0f40 0x7fc4080d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.690+0000 7fc40dde7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4080cd5e0 0x7fc4080cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.690+0000 7fc40dde7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4080d0cb0 con 0x7fc4080b58b0 2024-09-13T17:10:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.690+0000 7fc40dde7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4080b0060 con 0x7fc4080d0f40 2024-09-13T17:10:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.690+0000 7fc40dde7700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4080b0340 con 0x7fc4080cd5e0 2024-09-13T17:10:03.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.690+0000 7fc40cde5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc4080d0f40 0x7fc4080d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:03.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.690+0000 7fc407fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc4080b58b0 0x7fc4080d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48572/0 (socket says 172.21.15.123:48572) 2024-09-13T17:10:03.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.690+0000 7fc407fff700 1 -- 172.21.15.123:0/1161660718 learned_addr learned my addr 172.21.15.123:0/1161660718 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:03.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.690+0000 7fc40d5e6700 1 --2- 172.21.15.123:0/1161660718 >> v2:172.21.15.153:3300/0 conn(0x7fc4080cd5e0 0x7fc4080cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:03.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc4077fe700 1 -- 172.21.15.123:0/1161660718 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884902954 0 0) 0x7fc4080d0cb0 con 0x7fc4080b58b0 2024-09-13T17:10:03.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc4077fe700 1 -- 172.21.15.123:0/1161660718 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3f00035d0 con 0x7fc4080b58b0 2024-09-13T17:10:03.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc40cde5700 1 -- 172.21.15.123:0/1161660718 >> v2:172.21.15.153:3300/0 conn(0x7fc4080cd5e0 msgr2=0x7fc4080cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:03.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc40cde5700 1 --2- 172.21.15.123:0/1161660718 >> v2:172.21.15.153:3300/0 conn(0x7fc4080cd5e0 0x7fc4080cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc40cde5700 1 -- 172.21.15.123:0/1161660718 >> v1:172.21.15.123:6789/0 conn(0x7fc4080b58b0 legacy=0x7fc4080d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc40cde5700 1 -- 172.21.15.123:0/1161660718 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4080b0620 con 0x7fc4080d0f40 2024-09-13T17:10:03.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc40cde5700 1 --2- 172.21.15.123:0/1161660718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4080d0f40 0x7fc4080d1320 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc4080b8ad0 tx=0x7fc3fc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bb5ff6c0483b0a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:03.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc4077fe700 1 -- 172.21.15.123:0/1161660718 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc011830 con 0x7fc4080d0f40 2024-09-13T17:10:03.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc4077fe700 1 -- 172.21.15.123:0/1161660718 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc011990 con 0x7fc4080d0f40 2024-09-13T17:10:03.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc4077fe700 1 -- 172.21.15.123:0/1161660718 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc011d00 con 0x7fc4080d0f40 2024-09-13T17:10:03.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc40dde7700 1 -- 172.21.15.123:0/1161660718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4080d0f40 msgr2=0x7fc4080d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc40dde7700 1 --2- 172.21.15.123:0/1161660718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4080d0f40 0x7fc4080d1320 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc4080b8ad0 tx=0x7fc3fc009b30 comp rx=0 tx=0).stop 2024-09-13T17:10:03.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc40dde7700 1 -- 172.21.15.123:0/1161660718 shutdown_connections 2024-09-13T17:10:03.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc40dde7700 1 --2- 172.21.15.123:0/1161660718 >> v2:172.21.15.153:3300/0 conn(0x7fc4080cd5e0 0x7fc4080cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc40dde7700 1 --2- 172.21.15.123:0/1161660718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4080d0f40 0x7fc4080d1320 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc40dde7700 1 -- 172.21.15.123:0/1161660718 >> 172.21.15.123:0/1161660718 conn(0x7fc4080d2a60 msgr2=0x7fc4080d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:03.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc40dde7700 1 -- 172.21.15.123:0/1161660718 shutdown_connections 2024-09-13T17:10:03.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.694+0000 7fc40dde7700 1 -- 172.21.15.123:0/1161660718 wait complete. 2024-09-13T17:10:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.698+0000 7fc40dde7700 1 Processor -- start 2024-09-13T17:10:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.698+0000 7fc40dde7700 1 -- start start 2024-09-13T17:10:03.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.698+0000 7fc40dde7700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4080b58b0 0x7fc408150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:03.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.698+0000 7fc40dde7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4080cd5e0 0x7fc40815fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:03.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.698+0000 7fc40dde7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4080d0f40 0x7fc40809c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:03.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.698+0000 7fc40dde7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080b39f0 con 0x7fc4080cd5e0 2024-09-13T17:10:03.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.698+0000 7fc40dde7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080b3cd0 con 0x7fc4080d0f40 2024-09-13T17:10:03.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.698+0000 7fc40dde7700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080b3fb0 con 0x7fc4080b58b0 2024-09-13T17:10:03.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.698+0000 7fc407fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4080cd5e0 0x7fc40815fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:03.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.698+0000 7fc407fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4080cd5e0 0x7fc40815fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54502/0 (socket says 172.21.15.123:54502) 2024-09-13T17:10:03.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.698+0000 7fc407fff700 1 -- 172.21.15.123:0/2161076634 learned_addr learned my addr 172.21.15.123:0/2161076634 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:03.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.698+0000 7fc40d5e6700 1 --2- 172.21.15.123:0/2161076634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4080d0f40 0x7fc40809c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:03.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.698+0000 7fc40cde5700 1 --2- 172.21.15.123:0/2161076634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4080b58b0 0x7fc408150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:03.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.702+0000 7fc407fff700 1 -- 172.21.15.123:0/2161076634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4080b58b0 msgr2=0x7fc408150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.702+0000 7fc407fff700 1 --2- 172.21.15.123:0/2161076634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4080b58b0 0x7fc408150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.702+0000 7fc407fff700 1 -- 172.21.15.123:0/2161076634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4080d0f40 msgr2=0x7fc40809c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.702+0000 7fc407fff700 1 --2- 172.21.15.123:0/2161076634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4080d0f40 0x7fc40809c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.702+0000 7fc407fff700 1 -- 172.21.15.123:0/2161076634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc0094b0 con 0x7fc4080cd5e0 2024-09-13T17:10:03.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.702+0000 7fc407fff700 1 --2- 172.21.15.123:0/2161076634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4080cd5e0 0x7fc40815fbf0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800c4f0 tx=0x7fc3f800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:03.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.702+0000 7fc4057fa700 1 -- 172.21.15.123:0/2161076634 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8005d90 con 0x7fc4080cd5e0 2024-09-13T17:10:03.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.702+0000 7fc4057fa700 1 -- 172.21.15.123:0/2161076634 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f80070d0 con 0x7fc4080cd5e0 2024-09-13T17:10:03.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.702+0000 7fc40dde7700 1 -- 172.21.15.123:0/2161076634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4080b4290 con 0x7fc4080cd5e0 2024-09-13T17:10:03.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.702+0000 7fc4057fa700 1 -- 172.21.15.123:0/2161076634 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8007440 con 0x7fc4080cd5e0 2024-09-13T17:10:03.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.702+0000 7fc40dde7700 1 -- 172.21.15.123:0/2161076634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc408151490 con 0x7fc4080cd5e0 2024-09-13T17:10:03.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.702+0000 7fc40dde7700 1 -- 172.21.15.123:0/2161076634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4080b47b0 con 0x7fc4080cd5e0 2024-09-13T17:10:03.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.702+0000 7fc4057fa700 1 -- 172.21.15.123:0/2161076634 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc3f80075a0 con 0x7fc4080cd5e0 2024-09-13T17:10:03.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.706+0000 7fc4057fa700 1 --2- 172.21.15.123:0/2161076634 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc3f4066760 0x7fc3f4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:03.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.706+0000 7fc40cde5700 1 --2- 172.21.15.123:0/2161076634 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc3f4066760 0x7fc3f4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:03.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.706+0000 7fc4057fa700 1 -- 172.21.15.123:0/2161076634 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3f8083380 con 0x7fc4080cd5e0 2024-09-13T17:10:03.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.706+0000 7fc40cde5700 1 --2- 172.21.15.123:0/2161076634 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc3f4066760 0x7fc3f4068c20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0090b0 tx=0x7fc3fc008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:03.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.710+0000 7fc4057fa700 1 -- 172.21.15.123:0/2161076634 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc4080b47b0 con 0x7fc4080cd5e0 2024-09-13T17:10:03.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.946+0000 7fc40dde7700 1 -- 172.21.15.123:0/2161076634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc4080b47b0 con 0x7fc4080cd5e0 2024-09-13T17:10:03.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.954+0000 7fc4057fa700 1 -- 172.21.15.123:0/2161076634 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc4080b47b0 con 0x7fc4080cd5e0 2024-09-13T17:10:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.954+0000 7fc40dde7700 1 -- 172.21.15.123:0/2161076634 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc3f4066760 msgr2=0x7fc3f4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.954+0000 7fc40dde7700 1 --2- 172.21.15.123:0/2161076634 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc3f4066760 0x7fc3f4068c20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0090b0 tx=0x7fc3fc008030 comp rx=0 tx=0).stop 2024-09-13T17:10:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.954+0000 7fc40dde7700 1 -- 172.21.15.123:0/2161076634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4080cd5e0 msgr2=0x7fc40815fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.954+0000 7fc40dde7700 1 --2- 172.21.15.123:0/2161076634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4080cd5e0 0x7fc40815fbf0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800c4f0 tx=0x7fc3f800c800 comp rx=0 tx=0).stop 2024-09-13T17:10:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.954+0000 7fc40dde7700 1 -- 172.21.15.123:0/2161076634 shutdown_connections 2024-09-13T17:10:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.954+0000 7fc40dde7700 1 --2- 172.21.15.123:0/2161076634 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc3f4066760 0x7fc3f4068c20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.954+0000 7fc40dde7700 1 --2- 172.21.15.123:0/2161076634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4080d0f40 0x7fc40809c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.954+0000 7fc40dde7700 1 --2- 172.21.15.123:0/2161076634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4080cd5e0 0x7fc40815fbf0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.954+0000 7fc40dde7700 1 --2- 172.21.15.123:0/2161076634 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4080b58b0 0x7fc408150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.954+0000 7fc40dde7700 1 -- 172.21.15.123:0/2161076634 >> 172.21.15.123:0/2161076634 conn(0x7fc4080d2a60 msgr2=0x7fc408070d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.954+0000 7fc40dde7700 1 -- 172.21.15.123:0/2161076634 shutdown_connections 2024-09-13T17:10:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:03.954+0000 7fc40dde7700 1 -- 172.21.15.123:0/2161076634 wait complete. 2024-09-13T17:10:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-13T17:10:03.975 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:04.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f5336fc9700 1 Processor -- start 2024-09-13T17:10:04.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f5336fc9700 1 -- start start 2024-09-13T17:10:04.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f5336fc9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533015a8c0 0x7f53300705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f5336fc9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5330071580 0x7f53300cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f5336fc9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53300cee80 con 0x7f533015b9b0 2024-09-13T17:10:04.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f5336fc9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53300ce270 con 0x7f5330071580 2024-09-13T17:10:04.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f5336fc9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53300ce550 con 0x7f533015a8c0 2024-09-13T17:10:04.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f53357c6700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f533015b9b0 0x7f5330070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48584/0 (socket says 172.21.15.123:48584) 2024-09-13T17:10:04.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f53357c6700 1 -- 172.21.15.123:0/48772007 learned_addr learned my addr 172.21.15.123:0/48772007 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:04.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f53367c8700 1 --2- 172.21.15.123:0/48772007 >> v2:172.21.15.123:3300/0 conn(0x7f5330071580 0x7f53300cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f5335fc7700 1 --2- 172.21.15.123:0/48772007 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533015a8c0 0x7f53300705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f5334fc5700 1 -- 172.21.15.123:0/48772007 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370897288 0 0) 0x7f53300cee80 con 0x7f533015b9b0 2024-09-13T17:10:04.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f5334fc5700 1 -- 172.21.15.123:0/48772007 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53180035d0 con 0x7f533015b9b0 2024-09-13T17:10:04.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f53367c8700 1 -- 172.21.15.123:0/48772007 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533015a8c0 msgr2=0x7f53300705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:04.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f53367c8700 1 --2- 172.21.15.123:0/48772007 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533015a8c0 0x7f53300705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f53367c8700 1 -- 172.21.15.123:0/48772007 >> v1:172.21.15.123:6789/0 conn(0x7f533015b9b0 legacy=0x7f5330070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f53367c8700 1 -- 172.21.15.123:0/48772007 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53300ce830 con 0x7f5330071580 2024-09-13T17:10:04.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f53367c8700 1 --2- 172.21.15.123:0/48772007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5330071580 0x7f53300cc620 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f5328009850 tx=0x7f5328009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f0bf5fb785d531 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:04.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.086+0000 7f5334fc5700 1 -- 172.21.15.123:0/48772007 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328011830 con 0x7f5330071580 2024-09-13T17:10:04.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5334fc5700 1 -- 172.21.15.123:0/48772007 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5328011990 con 0x7f5330071580 2024-09-13T17:10:04.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5334fc5700 1 -- 172.21.15.123:0/48772007 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328011d00 con 0x7f5330071580 2024-09-13T17:10:04.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 -- 172.21.15.123:0/48772007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5330071580 msgr2=0x7f53300cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 --2- 172.21.15.123:0/48772007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5330071580 0x7f53300cc620 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f5328009850 tx=0x7f5328009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:04.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 -- 172.21.15.123:0/48772007 shutdown_connections 2024-09-13T17:10:04.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 --2- 172.21.15.123:0/48772007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5330071580 0x7f53300cc620 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 --2- 172.21.15.123:0/48772007 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533015a8c0 0x7f53300705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 -- 172.21.15.123:0/48772007 >> 172.21.15.123:0/48772007 conn(0x7f5330066150 msgr2=0x7f5330066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:04.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 -- 172.21.15.123:0/48772007 shutdown_connections 2024-09-13T17:10:04.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 -- 172.21.15.123:0/48772007 wait complete. 2024-09-13T17:10:04.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 Processor -- start 2024-09-13T17:10:04.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 -- start start 2024-09-13T17:10:04.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5330071580 0x7f5330159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f533015a8c0 0x7f5330154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533015b9b0 0x7f5330158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53300ca8c0 con 0x7f5330071580 2024-09-13T17:10:04.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5330159fb0 con 0x7f533015a8c0 2024-09-13T17:10:04.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.090+0000 7f5336fc9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5330157e80 con 0x7f533015b9b0 2024-09-13T17:10:04.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f5335fc7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5330071580 0x7f5330159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f5335fc7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5330071580 0x7f5330159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54524/0 (socket says 172.21.15.123:54524) 2024-09-13T17:10:04.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f5335fc7700 1 -- 172.21.15.123:0/1369089213 learned_addr learned my addr 172.21.15.123:0/1369089213 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:04.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f53357c6700 1 --2- 172.21.15.123:0/1369089213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f533015a8c0 0x7f5330154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f53367c8700 1 --2- 172.21.15.123:0/1369089213 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533015b9b0 0x7f5330158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f5335fc7700 1 -- 172.21.15.123:0/1369089213 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533015b9b0 msgr2=0x7f5330158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f5335fc7700 1 --2- 172.21.15.123:0/1369089213 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533015b9b0 0x7f5330158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f5335fc7700 1 -- 172.21.15.123:0/1369089213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f533015a8c0 msgr2=0x7f5330154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f5335fc7700 1 --2- 172.21.15.123:0/1369089213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f533015a8c0 0x7f5330154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f5335fc7700 1 -- 172.21.15.123:0/1369089213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53280094b0 con 0x7f5330071580 2024-09-13T17:10:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f5335fc7700 1 --2- 172.21.15.123:0/1369089213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5330071580 0x7f5330159a70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f532000e9d0 tx=0x7f532000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f532e7fc700 1 -- 172.21.15.123:0/1369089213 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5320009720 con 0x7f5330071580 2024-09-13T17:10:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f532e7fc700 1 -- 172.21.15.123:0/1369089213 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532000ee70 con 0x7f5330071580 2024-09-13T17:10:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f532e7fc700 1 -- 172.21.15.123:0/1369089213 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532000ca50 con 0x7f5330071580 2024-09-13T17:10:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f5336fc9700 1 -- 172.21.15.123:0/1369089213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5330158160 con 0x7f5330071580 2024-09-13T17:10:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.094+0000 7f5336fc9700 1 -- 172.21.15.123:0/1369089213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5330158720 con 0x7f5330071580 2024-09-13T17:10:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.098+0000 7f532e7fc700 1 -- 172.21.15.123:0/1369089213 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f532000cbb0 con 0x7f5330071580 2024-09-13T17:10:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.098+0000 7f5336fc9700 1 -- 172.21.15.123:0/1369089213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53300677f0 con 0x7f5330071580 2024-09-13T17:10:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.098+0000 7f532e7fc700 1 --2- 172.21.15.123:0/1369089213 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f531c066730 0x7f531c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.098+0000 7f532e7fc700 1 -- 172.21.15.123:0/1369089213 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5320084230 con 0x7f5330071580 2024-09-13T17:10:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.098+0000 7f53357c6700 1 --2- 172.21.15.123:0/1369089213 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f531c066730 0x7f531c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.098+0000 7f53357c6700 1 --2- 172.21.15.123:0/1369089213 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f531c066730 0x7f531c068bf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5330159a00 tx=0x7f5324009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:04.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.102+0000 7f532e7fc700 1 -- 172.21.15.123:0/1369089213 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5320051480 con 0x7f5330071580 2024-09-13T17:10:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.302+0000 7f5336fc9700 1 -- 172.21.15.123:0/1369089213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53300705b0 con 0x7f5330071580 2024-09-13T17:10:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.306+0000 7f532e7fc700 1 -- 172.21.15.123:0/1369089213 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f532000ce60 con 0x7f5330071580 2024-09-13T17:10:04.310 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:04.310 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":41,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6173,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3730345323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3730345323},{"type":"v1","addr":"172.21.15.153:6835","nonce":3730345323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1181784822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1181784822},{"type":"v1","addr":"172.21.15.153:6834","nonce":1181784822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1969180357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1969180357},{"type":"v1","addr":"172.21.15.123:6835","nonce":1969180357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:10:00.116252+0000","modified":"2024-09-13T17:10:02.136736+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2288571456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2288571456},{"type":"v1","addr":"172.21.15.123:6837","nonce":2288571456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T17:10:04.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.306+0000 7f5336fc9700 1 -- 172.21.15.123:0/1369089213 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f531c066730 msgr2=0x7f531c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.306+0000 7f5336fc9700 1 --2- 172.21.15.123:0/1369089213 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f531c066730 0x7f531c068bf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5330159a00 tx=0x7f5324009040 comp rx=0 tx=0).stop 2024-09-13T17:10:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.306+0000 7f5336fc9700 1 -- 172.21.15.123:0/1369089213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5330071580 msgr2=0x7f5330159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.306+0000 7f5336fc9700 1 --2- 172.21.15.123:0/1369089213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5330071580 0x7f5330159a70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f532000e9d0 tx=0x7f532000ece0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.306+0000 7f5336fc9700 1 -- 172.21.15.123:0/1369089213 shutdown_connections 2024-09-13T17:10:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.306+0000 7f5336fc9700 1 --2- 172.21.15.123:0/1369089213 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f531c066730 0x7f531c068bf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.306+0000 7f5336fc9700 1 --2- 172.21.15.123:0/1369089213 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f533015b9b0 0x7f5330158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.306+0000 7f5336fc9700 1 --2- 172.21.15.123:0/1369089213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f533015a8c0 0x7f5330154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.306+0000 7f5336fc9700 1 --2- 172.21.15.123:0/1369089213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5330071580 0x7f5330159a70 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.306+0000 7f5336fc9700 1 -- 172.21.15.123:0/1369089213 >> 172.21.15.123:0/1369089213 conn(0x7f5330066150 msgr2=0x7f5330066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.306+0000 7f5336fc9700 1 -- 172.21.15.123:0/1369089213 shutdown_connections 2024-09-13T17:10:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.306+0000 7f5336fc9700 1 -- 172.21.15.123:0/1369089213 wait complete. 2024-09-13T17:10:04.314 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 41 2024-09-13T17:10:04.733 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:10:00.116252+0000', 'modified': '2024-09-13T17:10:02.136736+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6999}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6999': {'gid': 6999, 'name': 'c', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6837/2288571456', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6836', 'nonce': 2288571456}, {'type': 'v1', 'addr': '172.21.15.123:6837', 'nonce': 2288571456}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:10:04.733 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:10:04.734 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T17:10:04.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.850+0000 7fef2759e700 1 Processor -- start 2024-09-13T17:10:04.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.850+0000 7fef2759e700 1 -- start start 2024-09-13T17:10:04.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2759e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef281571f0 0x7fef2806d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fef2815d0d0 0x7fef2815d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2759e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef281575d0 con 0x7fef2806f280 2024-09-13T17:10:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2759e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2806cf40 con 0x7fef281571f0 2024-09-13T17:10:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2806de90 con 0x7fef2815d0d0 2024-09-13T17:10:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2659c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef281571f0 0x7fef2806d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef26d9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fef2806f280 0x7fef2806a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48588/0 (socket says 172.21.15.123:48588) 2024-09-13T17:10:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef26d9d700 1 -- 172.21.15.123:0/3645952645 learned_addr learned my addr 172.21.15.123:0/3645952645 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef25d9b700 1 --2- 172.21.15.123:0/3645952645 >> v2:172.21.15.153:3300/0 conn(0x7fef2815d0d0 0x7fef2815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2559a700 1 -- 172.21.15.123:0/3645952645 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167542180 0 0) 0x7fef281575d0 con 0x7fef2806f280 2024-09-13T17:10:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2559a700 1 -- 172.21.15.123:0/3645952645 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef100035d0 con 0x7fef2806f280 2024-09-13T17:10:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2659c700 1 -- 172.21.15.123:0/3645952645 >> v2:172.21.15.153:3300/0 conn(0x7fef2815d0d0 msgr2=0x7fef2815d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2659c700 1 --2- 172.21.15.123:0/3645952645 >> v2:172.21.15.153:3300/0 conn(0x7fef2815d0d0 0x7fef2815d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2559a700 1 -- 172.21.15.123:0/3645952645 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 744017237 0 0) 0x7fef100035d0 con 0x7fef2806f280 2024-09-13T17:10:04.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2659c700 1 -- 172.21.15.123:0/3645952645 >> v1:172.21.15.123:6789/0 conn(0x7fef2806f280 legacy=0x7fef2806a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2659c700 1 -- 172.21.15.123:0/3645952645 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2815dc00 con 0x7fef281571f0 2024-09-13T17:10:04.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef25d9b700 1 --2- 172.21.15.123:0/3645952645 >> v2:172.21.15.153:3300/0 conn(0x7fef2815d0d0 0x7fef2815d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:04.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2659c700 1 --2- 172.21.15.123:0/3645952645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef281571f0 0x7fef2806d950 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fef2806ba70 tx=0x7fef1c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5be088a0788690 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:04.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2559a700 1 -- 172.21.15.123:0/3645952645 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef200019f0 con 0x7fef281571f0 2024-09-13T17:10:04.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2559a700 1 -- 172.21.15.123:0/3645952645 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c004030 con 0x7fef281571f0 2024-09-13T17:10:04.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2559a700 1 -- 172.21.15.123:0/3645952645 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0043a0 con 0x7fef281571f0 2024-09-13T17:10:04.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2759e700 1 -- 172.21.15.123:0/3645952645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef281571f0 msgr2=0x7fef2806d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2759e700 1 --2- 172.21.15.123:0/3645952645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef281571f0 0x7fef2806d950 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fef2806ba70 tx=0x7fef1c009b30 comp rx=0 tx=0).stop 2024-09-13T17:10:04.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2759e700 1 -- 172.21.15.123:0/3645952645 shutdown_connections 2024-09-13T17:10:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2759e700 1 --2- 172.21.15.123:0/3645952645 >> v2:172.21.15.153:3300/0 conn(0x7fef2815d0d0 0x7fef2815d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2759e700 1 --2- 172.21.15.123:0/3645952645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef281571f0 0x7fef2806d950 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2759e700 1 -- 172.21.15.123:0/3645952645 >> 172.21.15.123:0/3645952645 conn(0x7fef28066780 msgr2=0x7fef280719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2759e700 1 -- 172.21.15.123:0/3645952645 shutdown_connections 2024-09-13T17:10:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.854+0000 7fef2759e700 1 -- 172.21.15.123:0/3645952645 wait complete. 2024-09-13T17:10:04.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2759e700 1 Processor -- start 2024-09-13T17:10:04.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2759e700 1 -- start start 2024-09-13T17:10:04.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef2806f280 0x7fef281532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef281571f0 0x7fef281f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef2815d0d0 0x7fef281f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef28157b50 con 0x7fef2806f280 2024-09-13T17:10:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef281f32a0 con 0x7fef281571f0 2024-09-13T17:10:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef281f2ce0 con 0x7fef2815d0d0 2024-09-13T17:10:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef2806f280 0x7fef281532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef2806f280 0x7fef281532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54544/0 (socket says 172.21.15.123:54544) 2024-09-13T17:10:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2659c700 1 -- 172.21.15.123:0/2469828311 learned_addr learned my addr 172.21.15.123:0/2469828311 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2659c700 1 -- 172.21.15.123:0/2469828311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef2815d0d0 msgr2=0x7fef281f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2659c700 1 --2- 172.21.15.123:0/2469828311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef2815d0d0 0x7fef281f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2659c700 1 -- 172.21.15.123:0/2469828311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef281571f0 msgr2=0x7fef281f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2659c700 1 --2- 172.21.15.123:0/2469828311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef281571f0 0x7fef281f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2659c700 1 -- 172.21.15.123:0/2469828311 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180094b0 con 0x7fef2806f280 2024-09-13T17:10:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.858+0000 7fef2659c700 1 --2- 172.21.15.123:0/2469828311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef2806f280 0x7fef281532b0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0090b0 tx=0x7fef1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.862+0000 7fef16ffd700 1 -- 172.21.15.123:0/2469828311 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c003d70 con 0x7fef2806f280 2024-09-13T17:10:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.862+0000 7fef16ffd700 1 -- 172.21.15.123:0/2469828311 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c01f070 con 0x7fef2806f280 2024-09-13T17:10:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.862+0000 7fef2759e700 1 -- 172.21.15.123:0/2469828311 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1c0094b0 con 0x7fef2806f280 2024-09-13T17:10:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.862+0000 7fef16ffd700 1 -- 172.21.15.123:0/2469828311 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c011870 con 0x7fef2806f280 2024-09-13T17:10:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.862+0000 7fef2759e700 1 -- 172.21.15.123:0/2469828311 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef28157770 con 0x7fef2806f280 2024-09-13T17:10:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.862+0000 7fef16ffd700 1 -- 172.21.15.123:0/2469828311 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fef1c0119d0 con 0x7fef2806f280 2024-09-13T17:10:04.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.862+0000 7fef16ffd700 1 --2- 172.21.15.123:0/2469828311 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fef08066730 0x7fef08068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef25d9b700 1 --2- 172.21.15.123:0/2469828311 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fef08066730 0x7fef08068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef16ffd700 1 -- 172.21.15.123:0/2469828311 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef1c021070 con 0x7fef2806f280 2024-09-13T17:10:04.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef25d9b700 1 --2- 172.21.15.123:0/2469828311 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fef08066730 0x7fef08068bf0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fef18006f30 tx=0x7fef18006e80 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:04.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef2ff31740 1 Processor -- start 2024-09-13T17:10:04.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef2ff31740 1 -- start start 2024-09-13T17:10:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef2ff31740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9230 0x26f9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef2ff31740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26c1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef2ff31740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 0x26c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef2ff31740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x2620d80 con 0x26d7e90 2024-09-13T17:10:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef2ff31740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x261e510 con 0x26f9230 2024-09-13T17:10:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef2ff31740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x2619e00 con 0x26f9b50 2024-09-13T17:10:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef25d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef25d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26c1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54546/0 (socket says 172.21.15.123:54546) 2024-09-13T17:10:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef25d9b700 1 -- 172.21.15.123:0/857842048 learned_addr learned my addr 172.21.15.123:0/857842048 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef26d9d700 1 --2- 172.21.15.123:0/857842048 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 0x26c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef2659c700 1 --2- 172.21.15.123:0/857842048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9230 0x26f9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef25d9b700 1 -- 172.21.15.123:0/857842048 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 msgr2=0x26c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef25d9b700 1 --2- 172.21.15.123:0/857842048 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 0x26c1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef25d9b700 1 -- 172.21.15.123:0/857842048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9230 msgr2=0x26f9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef25d9b700 1 --2- 172.21.15.123:0/857842048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9230 0x26f9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef25d9b700 1 -- 172.21.15.123:0/857842048 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x248c960 con 0x26d7e90 2024-09-13T17:10:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.866+0000 7fef2659c700 1 --2- 172.21.15.123:0/857842048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9230 0x26f9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef25d9b700 1 --2- 172.21.15.123:0/857842048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26c1890 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fef1800eb90 tx=0x7fef18011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c840ee1b204b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:04.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef07fff700 1 -- 172.21.15.123:0/857842048 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18023070 con 0x26d7e90 2024-09-13T17:10:04.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef07fff700 1 -- 172.21.15.123:0/857842048 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef18004020 con 0x26d7e90 2024-09-13T17:10:04.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef07fff700 1 -- 172.21.15.123:0/857842048 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18004190 con 0x26d7e90 2024-09-13T17:10:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef2ff31740 1 -- 172.21.15.123:0/857842048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 msgr2=0x26c1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef2ff31740 1 --2- 172.21.15.123:0/857842048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26c1890 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fef1800eb90 tx=0x7fef18011000 comp rx=0 tx=0).stop 2024-09-13T17:10:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef2ff31740 1 -- 172.21.15.123:0/857842048 shutdown_connections 2024-09-13T17:10:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef2ff31740 1 --2- 172.21.15.123:0/857842048 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 0x26c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef2ff31740 1 --2- 172.21.15.123:0/857842048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26c1890 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef2ff31740 1 --2- 172.21.15.123:0/857842048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9230 0x26f9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef2ff31740 1 -- 172.21.15.123:0/857842048 >> 172.21.15.123:0/857842048 conn(0x24414d0 msgr2=0x26dae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef2ff31740 1 -- 172.21.15.123:0/857842048 shutdown_connections 2024-09-13T17:10:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef2ff31740 1 -- 172.21.15.123:0/857842048 wait complete. 2024-09-13T17:10:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef2ff31740 1 -- start start 2024-09-13T17:10:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.870+0000 7fef2ff31740 1 Processor -- start 2024-09-13T17:10:04.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9230 0x26d73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 0x26d9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x25d7730 con 0x26d7e90 2024-09-13T17:10:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x25dd5b0 con 0x26f9230 2024-09-13T17:10:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x24c5aa0 con 0x26f9b50 2024-09-13T17:10:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 10 client.0 _ll_register_callbacks cb 0x2613610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:10:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54552/0 (socket says 172.21.15.123:54552) 2024-09-13T17:10:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2659c700 1 -- 172.21.15.123:0/678351094 learned_addr learned my addr 172.21.15.123:0/678351094 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef26d9d700 1 --2- 172.21.15.123:0/678351094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 0x26d9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef25d9b700 1 --2- 172.21.15.123:0/678351094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9230 0x26d73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2659c700 1 -- 172.21.15.123:0/678351094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 msgr2=0x26d9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2659c700 1 --2- 172.21.15.123:0/678351094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 0x26d9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2659c700 1 -- 172.21.15.123:0/678351094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9230 msgr2=0x26d73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2659c700 1 --2- 172.21.15.123:0/678351094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9230 0x26d73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2659c700 1 -- 172.21.15.123:0/678351094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1800e870 con 0x26d7e90 2024-09-13T17:10:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef25d9b700 1 --2- 172.21.15.123:0/678351094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9230 0x26d73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2659c700 1 --2- 172.21.15.123:0/678351094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26b3120 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fef1c057fd0 tx=0x7fef1c0576c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8526248b81bc46f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef057fa700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-13T17:10:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef057fa700 1 -- 172.21.15.123:0/678351094 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c084200 con 0x26d7e90 2024-09-13T17:10:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef057fa700 1 -- 172.21.15.123:0/678351094 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef1c05f3b0 con 0x26d7e90 2024-09-13T17:10:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 -- 172.21.15.123:0/678351094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x244e1e0 con 0x26d7e90 2024-09-13T17:10:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef057fa700 1 -- 172.21.15.123:0/678351094 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef1c055360 con 0x26d7e90 2024-09-13T17:10:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 10 client.7146 fetch_fsmap learned FSMap version 41 2024-09-13T17:10:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 -- 172.21.15.123:0/678351094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x25e0220 con 0x26d7e90 2024-09-13T17:10:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef057fa700 1 -- 172.21.15.123:0/678351094 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x244e1e0 con 0x26d7e90 2024-09-13T17:10:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef057fa700 1 -- 172.21.15.123:0/678351094 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 41) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fef1c011c80 con 0x26d7e90 2024-09-13T17:10:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 10 client.7146 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T17:10:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 10 client.7146 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:10:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 20 client.7146 populate_metadata read hostname 'smithi123' 2024-09-13T17:10:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 --2- 172.21.15.123:0/678351094 >> [v2:172.21.15.123:6836/2288571456,v1:172.21.15.123:6837/2288571456] conn(0x26b1bf0 0x26b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 4 client.7146 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:10:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 -- 172.21.15.123:0/678351094 --> [v2:172.21.15.123:6836/2288571456,v1:172.21.15.123:6837/2288571456] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2498460 con 0x26b1bf0 2024-09-13T17:10:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef25d9b700 1 --2- 172.21.15.123:0/678351094 >> [v2:172.21.15.123:6836/2288571456,v1:172.21.15.123:6837/2288571456] conn(0x26b1bf0 0x26b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef25d9b700 1 --2- 172.21.15.123:0/678351094 >> [v2:172.21.15.123:6836/2288571456,v1:172.21.15.123:6837/2288571456] conn(0x26b1bf0 0x26b1fd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a451a45846b53f2d server_cookie=8d93a072f7c99702 in_seq=0 out_seq=0 2024-09-13T17:10:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef057fa700 10 client.7146 ms_handle_connect on v2:172.21.15.123:6836/2288571456 2024-09-13T17:10:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef057fa700 1 -- 172.21.15.123:0/678351094 <== mds.0 v2:172.21.15.123:6836/2288571456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2498460 con 0x26b1bf0 2024-09-13T17:10:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef057fa700 10 client.7146 handle_command_reply: tid=0 2024-09-13T17:10:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 client.7146 shutdown 2024-09-13T17:10:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 -- 172.21.15.123:0/678351094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 msgr2=0x26b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 --2- 172.21.15.123:0/678351094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26b3120 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fef1c057fd0 tx=0x7fef1c0576c0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 -- 172.21.15.123:0/678351094 shutdown_connections 2024-09-13T17:10:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 --2- 172.21.15.123:0/678351094 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 0x26d9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 --2- 172.21.15.123:0/678351094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9230 0x26d73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 --2- 172.21.15.123:0/678351094 >> [v2:172.21.15.123:6836/2288571456,v1:172.21.15.123:6837/2288571456] conn(0x26b1bf0 0x26b1fd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef2ff31740 1 --2- 172.21.15.123:0/678351094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26b3120 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.874+0000 7fef057fa700 0 client.7146 ms_handle_reset on v2:172.21.15.123:6836/2288571456 2024-09-13T17:10:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.878+0000 7fef2ff31740 1 -- 172.21.15.123:0/678351094 >> 172.21.15.123:0/678351094 conn(0x24414d0 msgr2=0x26ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:04.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.878+0000 7fef2ff31740 1 -- 172.21.15.123:0/678351094 shutdown_connections 2024-09-13T17:10:04.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.878+0000 7fef2ff31740 1 -- 172.21.15.123:0/678351094 wait complete. 2024-09-13T17:10:04.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.878+0000 7fef2ff31740 20 client.7146 trim_cache size 0 max 16384 2024-09-13T17:10:04.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.898+0000 7fef2ff31740 1 Processor -- start 2024-09-13T17:10:04.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.898+0000 7fef2ff31740 1 -- start start 2024-09-13T17:10:04.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.898+0000 7fef2ff31740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26f8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.898+0000 7fef2ff31740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9230 0x26b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.898+0000 7fef2ff31740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9b50 0x26b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.898+0000 7fef2ff31740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x26a9320 con 0x26d7e90 2024-09-13T17:10:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.898+0000 7fef2ff31740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x25c2020 con 0x26f9b50 2024-09-13T17:10:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.898+0000 7fef2ff31740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x263ff50 con 0x26f9230 2024-09-13T17:10:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.898+0000 7fef2659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.898+0000 7fef2659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26f8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54566/0 (socket says 172.21.15.123:54566) 2024-09-13T17:10:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.898+0000 7fef2659c700 1 -- 172.21.15.123:0/1308125575 learned_addr learned my addr 172.21.15.123:0/1308125575 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.898+0000 7fef25d9b700 1 --2- 172.21.15.123:0/1308125575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9230 0x26b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.898+0000 7fef26d9d700 1 --2- 172.21.15.123:0/1308125575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9b50 0x26b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2659c700 1 -- 172.21.15.123:0/1308125575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9230 msgr2=0x26b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2659c700 1 --2- 172.21.15.123:0/1308125575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9230 0x26b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2659c700 1 -- 172.21.15.123:0/1308125575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9b50 msgr2=0x26b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2659c700 1 --2- 172.21.15.123:0/1308125575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9b50 0x26b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2659c700 1 -- 172.21.15.123:0/1308125575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x25c6450 con 0x26d7e90 2024-09-13T17:10:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef26d9d700 1 --2- 172.21.15.123:0/1308125575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9b50 0x26b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2659c700 1 --2- 172.21.15.123:0/1308125575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26f8200 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fef1c057180 tx=0x7fef1c05a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6fcf11394a3c98 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef14ff9700 1 -- 172.21.15.123:0/1308125575 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c084200 con 0x26d7e90 2024-09-13T17:10:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef14ff9700 1 -- 172.21.15.123:0/1308125575 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c053300 con 0x26d7e90 2024-09-13T17:10:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef14ff9700 1 -- 172.21.15.123:0/1308125575 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0574a0 con 0x26d7e90 2024-09-13T17:10:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2ff31740 1 -- 172.21.15.123:0/1308125575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 msgr2=0x26f8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2ff31740 1 --2- 172.21.15.123:0/1308125575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26f8200 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fef1c057180 tx=0x7fef1c05a000 comp rx=0 tx=0).stop 2024-09-13T17:10:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2ff31740 1 -- 172.21.15.123:0/1308125575 shutdown_connections 2024-09-13T17:10:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2ff31740 1 --2- 172.21.15.123:0/1308125575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26f9b50 0x26b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2ff31740 1 --2- 172.21.15.123:0/1308125575 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9230 0x26b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2ff31740 1 --2- 172.21.15.123:0/1308125575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26d7e90 0x26f8200 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2ff31740 1 -- 172.21.15.123:0/1308125575 >> 172.21.15.123:0/1308125575 conn(0x24414d0 msgr2=0x26f7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:04.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2ff31740 1 -- 172.21.15.123:0/1308125575 shutdown_connections 2024-09-13T17:10:04.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2ff31740 1 -- 172.21.15.123:0/1308125575 wait complete. 2024-09-13T17:10:04.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2ff31740 1 -- start start 2024-09-13T17:10:04.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.902+0000 7fef2ff31740 1 Processor -- start 2024-09-13T17:10:04.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef2ff31740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26d7e90 0x26fede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef2ff31740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26f9230 0x27592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef2ff31740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 0x275a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef2ff31740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x2717ac0 con 0x26f9230 2024-09-13T17:10:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef2ff31740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x25e14c0 con 0x26d7e90 2024-09-13T17:10:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef2ff31740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x26b1020 con 0x26f9b50 2024-09-13T17:10:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef25d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26f9230 0x27592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef25d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26f9230 0x27592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54568/0 (socket says 172.21.15.123:54568) 2024-09-13T17:10:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef25d9b700 1 -- 172.21.15.123:0/649876093 learned_addr learned my addr 172.21.15.123:0/649876093 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef2ff31740 10 client.0 _ll_register_callbacks cb 0x25cbce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:10:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef2659c700 1 --2- 172.21.15.123:0/649876093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26d7e90 0x26fede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef26d9d700 1 --2- 172.21.15.123:0/649876093 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 0x275a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef25d9b700 1 -- 172.21.15.123:0/649876093 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 msgr2=0x275a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef25d9b700 1 --2- 172.21.15.123:0/649876093 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 0x275a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef25d9b700 1 -- 172.21.15.123:0/649876093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26d7e90 msgr2=0x26fede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef25d9b700 1 --2- 172.21.15.123:0/649876093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26d7e90 0x26fede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef25d9b700 1 -- 172.21.15.123:0/649876093 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1800e870 con 0x26f9230 2024-09-13T17:10:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef25d9b700 1 --2- 172.21.15.123:0/649876093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26f9230 0x27592f0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fef18006c80 tx=0x7fef18009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197df22bd154e085 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef057fa700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-13T17:10:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef057fa700 1 -- 172.21.15.123:0/649876093 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18023040 con 0x26f9230 2024-09-13T17:10:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef057fa700 1 -- 172.21.15.123:0/649876093 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef1802fd00 con 0x26f9230 2024-09-13T17:10:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef2ff31740 1 -- 172.21.15.123:0/649876093 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef18004020 con 0x26f9230 2024-09-13T17:10:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef057fa700 1 -- 172.21.15.123:0/649876093 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef180045a0 con 0x26f9230 2024-09-13T17:10:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef2ff31740 10 client.7152 fetch_fsmap learned FSMap version 41 2024-09-13T17:10:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef2ff31740 1 -- 172.21.15.123:0/649876093 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x25ba720 con 0x26f9230 2024-09-13T17:10:04.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef057fa700 1 -- 172.21.15.123:0/649876093 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef18004020 con 0x26f9230 2024-09-13T17:10:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef057fa700 1 -- 172.21.15.123:0/649876093 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 41) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fef1802f1c0 con 0x26f9230 2024-09-13T17:10:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef2ff31740 10 client.7152 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T17:10:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef2ff31740 10 client.7152 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:10:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.906+0000 7fef2ff31740 20 client.7152 populate_metadata read hostname 'smithi123' 2024-09-13T17:10:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 1 --2- 172.21.15.123:0/649876093 >> [v2:172.21.15.123:6836/2288571456,v1:172.21.15.123:6837/2288571456] conn(0x275aea0 0x26fcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 4 client.7152 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:10:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 1 -- 172.21.15.123:0/649876093 --> [v2:172.21.15.123:6836/2288571456,v1:172.21.15.123:6837/2288571456] -- command(tid 0: {"prefix": "status"}) v1 -- 0x24bd1e0 con 0x275aea0 2024-09-13T17:10:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2659c700 1 --2- 172.21.15.123:0/649876093 >> [v2:172.21.15.123:6836/2288571456,v1:172.21.15.123:6837/2288571456] conn(0x275aea0 0x26fcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2659c700 1 --2- 172.21.15.123:0/649876093 >> [v2:172.21.15.123:6836/2288571456,v1:172.21.15.123:6837/2288571456] conn(0x275aea0 0x26fcf90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fea88e035d68aedd server_cookie=41a20307e0630096 in_seq=0 out_seq=0 2024-09-13T17:10:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef057fa700 10 client.7152 ms_handle_connect on v2:172.21.15.123:6836/2288571456 2024-09-13T17:10:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef057fa700 1 -- 172.21.15.123:0/649876093 <== mds.0 v2:172.21.15.123:6836/2288571456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x24bd1e0 con 0x275aea0 2024-09-13T17:10:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef057fa700 10 client.7152 handle_command_reply: tid=0 2024-09-13T17:10:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 1 client.7152 shutdown 2024-09-13T17:10:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 1 -- 172.21.15.123:0/649876093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26f9230 msgr2=0x27592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 1 --2- 172.21.15.123:0/649876093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26f9230 0x27592f0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fef18006c80 tx=0x7fef18009240 comp rx=0 tx=0).stop 2024-09-13T17:10:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 1 -- 172.21.15.123:0/649876093 shutdown_connections 2024-09-13T17:10:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 1 --2- 172.21.15.123:0/649876093 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x26f9b50 0x275a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 1 --2- 172.21.15.123:0/649876093 >> [v2:172.21.15.123:6836/2288571456,v1:172.21.15.123:6837/2288571456] conn(0x275aea0 0x26fcf90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef057fa700 0 client.7152 ms_handle_reset on v2:172.21.15.123:6836/2288571456 2024-09-13T17:10:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 1 --2- 172.21.15.123:0/649876093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x26f9230 0x27592f0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 1 --2- 172.21.15.123:0/649876093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26d7e90 0x26fede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 1 -- 172.21.15.123:0/649876093 >> 172.21.15.123:0/649876093 conn(0x24414d0 msgr2=0x2708d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 1 -- 172.21.15.123:0/649876093 shutdown_connections 2024-09-13T17:10:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 1 -- 172.21.15.123:0/649876093 wait complete. 2024-09-13T17:10:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2ff31740 20 client.7152 trim_cache size 0 max 16384 2024-09-13T17:10:04.920 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:10:04.920 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "c45759e3-62b7-46ff-ad19-917097e4c126", 2024-09-13T17:10:04.920 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-13T17:10:04.920 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 6999, 2024-09-13T17:10:04.920 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-13T17:10:04.920 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-13T17:10:04.920 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-13T17:10:04.920 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 4.7948829269999997, 2024-09-13T17:10:04.920 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 41, 2024-09-13T17:10:04.920 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 86, 2024-09-13T17:10:04.921 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T17:10:04.921 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 9.2482533250000003 2024-09-13T17:10:04.921 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:10:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2759e700 1 -- 172.21.15.123:0/2469828311 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fef08066730 msgr2=0x7fef08068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2759e700 1 --2- 172.21.15.123:0/2469828311 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fef08066730 0x7fef08068bf0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fef18006f30 tx=0x7fef18006e80 comp rx=0 tx=0).stop 2024-09-13T17:10:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2759e700 1 -- 172.21.15.123:0/2469828311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef2806f280 msgr2=0x7fef281532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2759e700 1 --2- 172.21.15.123:0/2469828311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef2806f280 0x7fef281532b0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0090b0 tx=0x7fef1c004770 comp rx=0 tx=0).stop 2024-09-13T17:10:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2759e700 1 -- 172.21.15.123:0/2469828311 shutdown_connections 2024-09-13T17:10:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2759e700 1 --2- 172.21.15.123:0/2469828311 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fef08066730 0x7fef08068bf0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2759e700 1 --2- 172.21.15.123:0/2469828311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef2815d0d0 0x7fef281f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2759e700 1 --2- 172.21.15.123:0/2469828311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef281571f0 0x7fef281f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2759e700 1 --2- 172.21.15.123:0/2469828311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef2806f280 0x7fef281532b0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2759e700 1 -- 172.21.15.123:0/2469828311 >> 172.21.15.123:0/2469828311 conn(0x7fef28066780 msgr2=0x7fef2815ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2759e700 1 -- 172.21.15.123:0/2469828311 shutdown_connections 2024-09-13T17:10:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:04.910+0000 7fef2759e700 1 -- 172.21.15.123:0/2469828311 wait complete. 2024-09-13T17:10:04.931 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:10:05.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f69020e0700 1 Processor -- start 2024-09-13T17:10:05.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f69020e0700 1 -- start start 2024-09-13T17:10:05.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f69020e0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f68fc0cf470 0x7f68fc0b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:05.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f69020e0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68fc06c050 con 0x7f68fc14fac0 2024-09-13T17:10:05.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f69020e0700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68fc15a0f0 con 0x7f68fc0b1d20 2024-09-13T17:10:05.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f69020e0700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68fc15d050 con 0x7f68fc0cf470 2024-09-13T17:10:05.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f68fb7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f68fc14fac0 0x7f68fc0ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48598/0 (socket says 172.21.15.123:48598) 2024-09-13T17:10:05.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f68fb7fe700 1 -- 172.21.15.123:0/2843198521 learned_addr learned my addr 172.21.15.123:0/2843198521 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:05.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f68faffd700 1 --2- 172.21.15.123:0/2843198521 >> v2:172.21.15.123:3300/0 conn(0x7f68fc0cf470 0x7f68fc0b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:05.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f68fa7fc700 1 -- 172.21.15.123:0/2843198521 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271393392 0 0) 0x7f68fc06c050 con 0x7f68fc14fac0 2024-09-13T17:10:05.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f68fa7fc700 1 -- 172.21.15.123:0/2843198521 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68e40035d0 con 0x7f68fc14fac0 2024-09-13T17:10:05.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f68faffd700 1 -- 172.21.15.123:0/2843198521 >> v1:172.21.15.153:6789/0 conn(0x7f68fc0b1d20 legacy=0x7f68fc159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:05.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f68faffd700 1 -- 172.21.15.123:0/2843198521 >> v1:172.21.15.123:6789/0 conn(0x7f68fc14fac0 legacy=0x7f68fc0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:05.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f68faffd700 1 -- 172.21.15.123:0/2843198521 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc15c740 con 0x7f68fc0cf470 2024-09-13T17:10:05.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f68faffd700 1 --2- 172.21.15.123:0/2843198521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68fc0cf470 0x7f68fc0b17e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009880 tx=0x7f68f0009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32cc11851f539 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:05.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f68fa7fc700 1 -- 172.21.15.123:0/2843198521 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0011830 con 0x7f68fc0cf470 2024-09-13T17:10:05.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f68fa7fc700 1 -- 172.21.15.123:0/2843198521 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f0011990 con 0x7f68fc0cf470 2024-09-13T17:10:05.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.046+0000 7f68fa7fc700 1 -- 172.21.15.123:0/2843198521 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0011d20 con 0x7f68fc0cf470 2024-09-13T17:10:05.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.050+0000 7f69020e0700 1 -- 172.21.15.123:0/2843198521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68fc0cf470 msgr2=0x7f68fc0b17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:05.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.050+0000 7f69020e0700 1 --2- 172.21.15.123:0/2843198521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68fc0cf470 0x7f68fc0b17e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009880 tx=0x7f68f0009b90 comp rx=0 tx=0).stop 2024-09-13T17:10:05.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.050+0000 7f69020e0700 1 -- 172.21.15.123:0/2843198521 shutdown_connections 2024-09-13T17:10:05.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.050+0000 7f69020e0700 1 --2- 172.21.15.123:0/2843198521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68fc0cf470 0x7f68fc0b17e0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:05.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.050+0000 7f69020e0700 1 -- 172.21.15.123:0/2843198521 >> 172.21.15.123:0/2843198521 conn(0x7f68fc066570 msgr2=0x7f68fc066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:05.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.050+0000 7f69020e0700 1 -- 172.21.15.123:0/2843198521 shutdown_connections 2024-09-13T17:10:05.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.050+0000 7f69020e0700 1 -- 172.21.15.123:0/2843198521 wait complete. 2024-09-13T17:10:05.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.050+0000 7f69020e0700 1 Processor -- start 2024-09-13T17:10:05.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.050+0000 7f69020e0700 1 -- start start 2024-09-13T17:10:05.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f69020e0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68fc0b1d20 0x7f68fc143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f69020e0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68fc0cf470 0x7f68fc142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f69020e0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68fc14fac0 0x7f68fc142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f69020e0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc143a70 con 0x7f68fc0b1d20 2024-09-13T17:10:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f69020e0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc144440 con 0x7f68fc14fac0 2024-09-13T17:10:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f69020e0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc152ec0 con 0x7f68fc0cf470 2024-09-13T17:10:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f68fb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68fc0b1d20 0x7f68fc143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f68fb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68fc0b1d20 0x7f68fc143f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54586/0 (socket says 172.21.15.123:54586) 2024-09-13T17:10:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f68fb7fe700 1 -- 172.21.15.123:0/3689730674 learned_addr learned my addr 172.21.15.123:0/3689730674 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f68faffd700 1 --2- 172.21.15.123:0/3689730674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68fc0cf470 0x7f68fc142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f68fbfff700 1 --2- 172.21.15.123:0/3689730674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68fc14fac0 0x7f68fc142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f68fb7fe700 1 -- 172.21.15.123:0/3689730674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68fc0cf470 msgr2=0x7f68fc142890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f68fb7fe700 1 --2- 172.21.15.123:0/3689730674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68fc0cf470 0x7f68fc142890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f68fb7fe700 1 -- 172.21.15.123:0/3689730674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68fc14fac0 msgr2=0x7f68fc142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f68fb7fe700 1 --2- 172.21.15.123:0/3689730674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68fc14fac0 0x7f68fc142dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f68fb7fe700 1 -- 172.21.15.123:0/3689730674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f00094b0 con 0x7f68fc0b1d20 2024-09-13T17:10:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f68fb7fe700 1 --2- 172.21.15.123:0/3689730674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68fc0b1d20 0x7f68fc143f00 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00c4d0 tx=0x7f68ec00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f68e3fff700 1 -- 172.21.15.123:0/3689730674 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec005d90 con 0x7f68fc0b1d20 2024-09-13T17:10:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f68e3fff700 1 -- 172.21.15.123:0/3689730674 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec0070d0 con 0x7f68fc0b1d20 2024-09-13T17:10:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f69020e0700 1 -- 172.21.15.123:0/3689730674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68fc143420 con 0x7f68fc0b1d20 2024-09-13T17:10:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f68e3fff700 1 -- 172.21.15.123:0/3689730674 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec007480 con 0x7f68fc0b1d20 2024-09-13T17:10:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.054+0000 7f69020e0700 1 -- 172.21.15.123:0/3689730674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc0a8fd0 con 0x7f68fc0b1d20 2024-09-13T17:10:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.058+0000 7f69020e0700 1 -- 172.21.15.123:0/3689730674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68fc15d4e0 con 0x7f68fc0b1d20 2024-09-13T17:10:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.058+0000 7f68e3fff700 1 -- 172.21.15.123:0/3689730674 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f68ec0075e0 con 0x7f68fc0b1d20 2024-09-13T17:10:05.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.058+0000 7f68e3fff700 1 --2- 172.21.15.123:0/3689730674 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f68e8066730 0x7f68e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:05.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.058+0000 7f68e3fff700 1 -- 172.21.15.123:0/3689730674 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68ec083780 con 0x7f68fc0b1d20 2024-09-13T17:10:05.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.058+0000 7f68faffd700 1 --2- 172.21.15.123:0/3689730674 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f68e8066730 0x7f68e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:05.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.058+0000 7f68faffd700 1 --2- 172.21.15.123:0/3689730674 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f68e8066730 0x7f68e8068bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f68f00090b0 tx=0x7f68f0008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:05.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.066+0000 7f68e3fff700 1 -- 172.21.15.123:0/3689730674 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f68ec050a50 con 0x7f68fc0b1d20 2024-09-13T17:10:05.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.282+0000 7f69020e0700 1 -- 172.21.15.123:0/3689730674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f68fc06dd00 con 0x7f68fc0b1d20 2024-09-13T17:10:05.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.282+0000 7f68e3fff700 1 -- 172.21.15.123:0/3689730674 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) v1 ==== 53+0+73 (secure 0 0 0) 0x7f68ec017060 con 0x7f68fc0b1d20 2024-09-13T17:10:05.287 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:10:05.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.286+0000 7f69020e0700 1 -- 172.21.15.123:0/3689730674 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f68e8066730 msgr2=0x7f68e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:05.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.286+0000 7f69020e0700 1 --2- 172.21.15.123:0/3689730674 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f68e8066730 0x7f68e8068bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f68f00090b0 tx=0x7f68f0008030 comp rx=0 tx=0).stop 2024-09-13T17:10:05.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.286+0000 7f69020e0700 1 -- 172.21.15.123:0/3689730674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68fc0b1d20 msgr2=0x7f68fc143f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:05.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.286+0000 7f69020e0700 1 --2- 172.21.15.123:0/3689730674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68fc0b1d20 0x7f68fc143f00 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00c4d0 tx=0x7f68ec00c890 comp rx=0 tx=0).stop 2024-09-13T17:10:05.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.286+0000 7f69020e0700 1 -- 172.21.15.123:0/3689730674 shutdown_connections 2024-09-13T17:10:05.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.286+0000 7f69020e0700 1 --2- 172.21.15.123:0/3689730674 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f68e8066730 0x7f68e8068bf0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:05.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.286+0000 7f69020e0700 1 --2- 172.21.15.123:0/3689730674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68fc14fac0 0x7f68fc142dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:05.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.286+0000 7f69020e0700 1 --2- 172.21.15.123:0/3689730674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f68fc0cf470 0x7f68fc142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:05.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.286+0000 7f69020e0700 1 --2- 172.21.15.123:0/3689730674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68fc0b1d20 0x7f68fc143f00 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:05.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.286+0000 7f69020e0700 1 -- 172.21.15.123:0/3689730674 >> 172.21.15.123:0/3689730674 conn(0x7f68fc066570 msgr2=0x7f68fc148b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:05.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.286+0000 7f69020e0700 1 -- 172.21.15.123:0/3689730674 shutdown_connections 2024-09-13T17:10:05.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:05.286+0000 7f69020e0700 1 -- 172.21.15.123:0/3689730674 wait complete. 2024-09-13T17:10:05.302 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:10:05.302 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:10:05.302 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-13T17:10:05.302 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:10:05.302 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:10:05.302 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:10:05.303 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:10:05.303 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:10:05.303 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:10:05.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:05.303 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-13T17:10:05.311 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:10:05.311 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:10:05.311 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:10:05.312 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:05.312 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-13T17:10:05.312 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:05.312 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:10:05.312 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:05.312 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:10:05.312 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:05.312 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:10:05.312 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:05.312 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:10:05.312 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:05.312 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:10:05.313 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42402sec preferred_lft 42402sec 2024-09-13T17:10:05.313 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-09-13T17:10:05.313 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:05.313 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:10:05.313 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:b1:d7:75:e9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:05.313 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:10:05.313 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:05.313 INFO:teuthology.orchestra.run.smithi123.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:10:05.313 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether d6:8a:3c:97:49:a9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:05.313 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:10:05.313 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:05.313 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::a038:65ff:fec0:5513/64 scope link 2024-09-13T17:10:05.313 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:05.314 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:10:05.314 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether da:a9:95:cd:41:8c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:10:05.314 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::d8a9:95ff:fecd:418c/64 scope link 2024-09-13T17:10:05.314 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:05.314 INFO:teuthology.orchestra.run.smithi123.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:10:05.314 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether d6:8a:3c:97:49:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:10:05.314 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::d48a:3cff:fe97:49a9/64 scope link 2024-09-13T17:10:05.314 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:05.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:05.314 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:10:05.328 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-13T17:10:05.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:05.330 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-13T17:10:05.337 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-13T17:10:05.337 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:10:05.337 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:10:05.337 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:10:05.337 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:10:05.337 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:10:05.338 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:10:05.338 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:10:05.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:05.338 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:10:05.338 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:10:05.338 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:10:05.338 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:10:05.339 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:10:05.339 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:10:05.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:05.416 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-13T17:10:05.424 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:10:05.424 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:10:05.424 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:10:05.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:05.425 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-13T17:10:05.439 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:10:05.439 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:10:05.439 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:10:05.447 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:10:05.447 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:10:05.448 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:10:05.454 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:10:05.469 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:10:05.469 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:10:05.529 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:10:05.530 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:10:05.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:05.531 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:10:05.538 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:10:05.538 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:10:05.540 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:10:05.554 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:10:05.555 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:10:05.612 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:10:05.613 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:10:05.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:05.613 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:10:05.629 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:2024-09-13T17:10:05.622+0000 7ff5c45c4640 -1 init, newargv = 0x55b437c86410 newargc=15 2024-09-13T17:10:05.629 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[44355]: starting ceph client 2024-09-13T17:10:05.638 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[44355]: starting fuse 2024-09-13T17:10:06.018 INFO:tasks.ceph.mds.c.smithi123.stderr:2024-09-13T17:10:06.014+0000 7f51ff6e9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:10:06.719 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:10:06.738 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:10:06.738 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:10:06.796 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:10:06.797 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:10:06.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:06.798 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:10:06.803 INFO:teuthology.orchestra.run.smithi123.stdout:52 2024-09-13T17:10:06.803 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:10:06.803 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:10:06.803 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2024-09-13T17:10:06.803 DEBUG:teuthology.orchestra.run.smithi123:> import re 2024-09-13T17:10:06.803 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-13T17:10:06.803 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2024-09-13T17:10:06.803 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:10:06.803 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2024-09-13T17:10:06.804 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2024-09-13T17:10:06.805 DEBUG:teuthology.orchestra.run.smithi123:> return f 2024-09-13T17:10:06.805 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:10:06.805 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:10:06.805 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.0")) 2024-09-13T17:10:06.805 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-13T17:10:06.888 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.0.44355.asok 2024-09-13T17:10:07.072 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44355.asok 2024-09-13T17:10:07.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:07.072 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44355.asok status 2024-09-13T17:10:07.218 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:10:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2024-09-13T17:10:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:10:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:10:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "0", 2024-09-13T17:10:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2024-09-13T17:10:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:10:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "44355", 2024-09-13T17:10:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2024-09-13T17:10:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2024-09-13T17:10:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2024-09-13T17:10:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 7167, 2024-09-13T17:10:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2024-09-13T17:10:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2024-09-13T17:10:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2024-09-13T17:10:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 7167 2024-09-13T17:10:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:10:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:10:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:10:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 943046960 2024-09-13T17:10:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:10:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:10:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:10:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 943046960 2024-09-13T17:10:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.7167 192.168.0.1:0/943046960", 2024-09-13T17:10:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.1:0/943046960", 2024-09-13T17:10:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2024-09-13T17:10:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 41, 2024-09-13T17:10:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 86, 2024-09-13T17:10:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:10:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2024-09-13T17:10:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2024-09-13T17:10:07.221 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:10:07.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:07.229 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2024-09-13T17:10:07.229 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:10:07.238 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2024-09-13T17:10:07.238 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:10:07.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:07.238 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:10:07.251 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:10:07.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752b59e700 1 Processor -- start 2024-09-13T17:10:07.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752b59e700 1 -- start start 2024-09-13T17:10:07.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752b59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752c15a8c0 0x7f752c0705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:07.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752b59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f752c071580 0x7f752c0cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:07.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752b59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752c0cee80 con 0x7f752c15b9b0 2024-09-13T17:10:07.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752b59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752c0ce270 con 0x7f752c071580 2024-09-13T17:10:07.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752b59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c0ce550 con 0x7f752c15a8c0 2024-09-13T17:10:07.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752ad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f752c071580 0x7f752c0cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:07.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752ad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f752c071580 0x7f752c0cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54598/0 (socket says 172.21.15.123:54598) 2024-09-13T17:10:07.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752ad9d700 1 -- 172.21.15.123:0/2299766835 learned_addr learned my addr 172.21.15.123:0/2299766835 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:07.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752a59c700 1 --2- 172.21.15.123:0/2299766835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752c15a8c0 0x7f752c0705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:07.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752959a700 1 -- 172.21.15.123:0/2299766835 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894587803 0 0) 0x7f752c0cee80 con 0x7f752c15b9b0 2024-09-13T17:10:07.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752959a700 1 -- 172.21.15.123:0/2299766835 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75140035d0 con 0x7f752c15b9b0 2024-09-13T17:10:07.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752ad9d700 1 -- 172.21.15.123:0/2299766835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752c15a8c0 msgr2=0x7f752c0705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:07.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752ad9d700 1 --2- 172.21.15.123:0/2299766835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752c15a8c0 0x7f752c0705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:07.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752ad9d700 1 -- 172.21.15.123:0/2299766835 >> v1:172.21.15.153:6789/0 conn(0x7f752c15b9b0 legacy=0x7f752c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:07.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752ad9d700 1 -- 172.21.15.123:0/2299766835 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c0ce830 con 0x7f752c071580 2024-09-13T17:10:07.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752ad9d700 1 --2- 172.21.15.123:0/2299766835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f752c071580 0x7f752c0cc620 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7524009e50 tx=0x7f752400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46e69cac8108e03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:07.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752959a700 1 -- 172.21.15.123:0/2299766835 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400e070 con 0x7f752c071580 2024-09-13T17:10:07.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752959a700 1 -- 172.21.15.123:0/2299766835 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752400b910 con 0x7f752c071580 2024-09-13T17:10:07.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752959a700 1 -- 172.21.15.123:0/2299766835 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400bc80 con 0x7f752c071580 2024-09-13T17:10:07.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752b59e700 1 -- 172.21.15.123:0/2299766835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f752c071580 msgr2=0x7f752c0cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:07.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.365+0000 7f752b59e700 1 --2- 172.21.15.123:0/2299766835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f752c071580 0x7f752c0cc620 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7524009e50 tx=0x7f752400b330 comp rx=0 tx=0).stop 2024-09-13T17:10:07.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f752b59e700 1 -- 172.21.15.123:0/2299766835 shutdown_connections 2024-09-13T17:10:07.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f752b59e700 1 --2- 172.21.15.123:0/2299766835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f752c071580 0x7f752c0cc620 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:07.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f752b59e700 1 --2- 172.21.15.123:0/2299766835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752c15a8c0 0x7f752c0705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:07.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f752b59e700 1 -- 172.21.15.123:0/2299766835 >> 172.21.15.123:0/2299766835 conn(0x7f752c066150 msgr2=0x7f752c066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:07.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f752b59e700 1 -- 172.21.15.123:0/2299766835 shutdown_connections 2024-09-13T17:10:07.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f752b59e700 1 -- 172.21.15.123:0/2299766835 wait complete. 2024-09-13T17:10:07.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f752b59e700 1 Processor -- start 2024-09-13T17:10:07.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f752b59e700 1 -- start start 2024-09-13T17:10:07.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f752b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f752c071580 0x7f752c151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f752b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f752c15a8c0 0x7f752c0acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f752b59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752c15b9b0 0x7f752c0af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f752b59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c1f1190 con 0x7f752c15a8c0 2024-09-13T17:10:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f752b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c06cf80 con 0x7f752c071580 2024-09-13T17:10:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f752b59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c1f0300 con 0x7f752c15b9b0 2024-09-13T17:10:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.369+0000 7f7529d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f752c15a8c0 0x7f752c0acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f7529d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f752c15a8c0 0x7f752c0acae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54614/0 (socket says 172.21.15.123:54614) 2024-09-13T17:10:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f7529d9b700 1 -- 172.21.15.123:0/47176522 learned_addr learned my addr 172.21.15.123:0/47176522 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f752a59c700 1 --2- 172.21.15.123:0/47176522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f752c071580 0x7f752c151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f752ad9d700 1 --2- 172.21.15.123:0/47176522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752c15b9b0 0x7f752c0af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f7529d9b700 1 -- 172.21.15.123:0/47176522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752c15b9b0 msgr2=0x7f752c0af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f7529d9b700 1 --2- 172.21.15.123:0/47176522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752c15b9b0 0x7f752c0af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f7529d9b700 1 -- 172.21.15.123:0/47176522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f752c071580 msgr2=0x7f752c151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f7529d9b700 1 --2- 172.21.15.123:0/47176522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f752c071580 0x7f752c151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f7529d9b700 1 -- 172.21.15.123:0/47176522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7524009b30 con 0x7f752c15a8c0 2024-09-13T17:10:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f7529d9b700 1 --2- 172.21.15.123:0/47176522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f752c15a8c0 0x7f752c0acae0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f752000c500 tx=0x7f752000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f751affd700 1 -- 172.21.15.123:0/47176522 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75200052d0 con 0x7f752c15a8c0 2024-09-13T17:10:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f751affd700 1 -- 172.21.15.123:0/47176522 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7520005450 con 0x7f752c15a8c0 2024-09-13T17:10:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f752b59e700 1 -- 172.21.15.123:0/47176522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c1f0580 con 0x7f752c15a8c0 2024-09-13T17:10:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f751affd700 1 -- 172.21.15.123:0/47176522 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75200038e0 con 0x7f752c15a8c0 2024-09-13T17:10:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f752b59e700 1 -- 172.21.15.123:0/47176522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c1f0b40 con 0x7f752c15a8c0 2024-09-13T17:10:07.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f752b59e700 1 -- 172.21.15.123:0/47176522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752c0677f0 con 0x7f752c15a8c0 2024-09-13T17:10:07.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.373+0000 7f751affd700 1 -- 172.21.15.123:0/47176522 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7520003a40 con 0x7f752c15a8c0 2024-09-13T17:10:07.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.377+0000 7f751affd700 1 --2- 172.21.15.123:0/47176522 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f750c066730 0x7f750c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:07.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.377+0000 7f751affd700 1 -- 172.21.15.123:0/47176522 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7520083460 con 0x7f752c15a8c0 2024-09-13T17:10:07.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.377+0000 7f752a59c700 1 --2- 172.21.15.123:0/47176522 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f750c066730 0x7f750c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:07.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.377+0000 7f752a59c700 1 --2- 172.21.15.123:0/47176522 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f750c066730 0x7f750c068bf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f751c009bf0 tx=0x7f751c009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:07.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.385+0000 7f751affd700 1 -- 172.21.15.123:0/47176522 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f75200507d0 con 0x7f752c15a8c0 2024-09-13T17:10:07.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.589+0000 7f752b59e700 1 -- 172.21.15.123:0/47176522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f752c066530 con 0x7f752c15a8c0 2024-09-13T17:10:07.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.589+0000 7f751affd700 1 -- 172.21.15.123:0/47176522 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7520053df0 con 0x7f752c15a8c0 2024-09-13T17:10:07.596 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:10:07.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.593+0000 7f752b59e700 1 -- 172.21.15.123:0/47176522 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f750c066730 msgr2=0x7f750c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:07.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.593+0000 7f752b59e700 1 --2- 172.21.15.123:0/47176522 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f750c066730 0x7f750c068bf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f751c009bf0 tx=0x7f751c009240 comp rx=0 tx=0).stop 2024-09-13T17:10:07.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.593+0000 7f752b59e700 1 -- 172.21.15.123:0/47176522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f752c15a8c0 msgr2=0x7f752c0acae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:07.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.593+0000 7f752b59e700 1 --2- 172.21.15.123:0/47176522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f752c15a8c0 0x7f752c0acae0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f752000c500 tx=0x7f752000c810 comp rx=0 tx=0).stop 2024-09-13T17:10:07.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.593+0000 7f752b59e700 1 -- 172.21.15.123:0/47176522 shutdown_connections 2024-09-13T17:10:07.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.593+0000 7f752b59e700 1 --2- 172.21.15.123:0/47176522 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f750c066730 0x7f750c068bf0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:07.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.593+0000 7f752b59e700 1 --2- 172.21.15.123:0/47176522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752c15b9b0 0x7f752c0af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:07.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.593+0000 7f752b59e700 1 --2- 172.21.15.123:0/47176522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f752c15a8c0 0x7f752c0acae0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:07.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.593+0000 7f752b59e700 1 --2- 172.21.15.123:0/47176522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f752c071580 0x7f752c151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:07.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.593+0000 7f752b59e700 1 -- 172.21.15.123:0/47176522 >> 172.21.15.123:0/47176522 conn(0x7f752c066150 msgr2=0x7f752c0b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:07.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.593+0000 7f752b59e700 1 -- 172.21.15.123:0/47176522 shutdown_connections 2024-09-13T17:10:07.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:07.593+0000 7f752b59e700 1 -- 172.21.15.123:0/47176522 wait complete. 2024-09-13T17:10:07.610 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:10:07.610 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:10:07.610 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-13T17:10:07.610 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:10:07.610 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:10:07.611 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:10:07.611 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:10:07.611 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:10:07.611 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:10:07.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:07.611 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-13T17:10:07.620 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:10:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:10:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:10:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-13T17:10:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:07.620 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:10:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:07.620 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:10:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:07.621 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:10:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:07.621 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:10:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:10:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42403sec preferred_lft 42403sec 2024-09-13T17:10:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-09-13T17:10:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:07.621 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:10:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:73:6c:03:01 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:10:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:07.622 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:10:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:10:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::f82f:21ff:fe0c:65de/64 scope link 2024-09-13T17:10:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:07.622 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:10:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:10:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::346e:9ff:fe92:ffa0/64 scope link 2024-09-13T17:10:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:07.622 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:10:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether c6:e2:c1:7b:16:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:10:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::c4e2:c1ff:fe7b:1657/64 scope link 2024-09-13T17:10:07.623 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:07.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:07.623 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:10:07.638 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-13T17:10:07.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:07.639 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-13T17:10:07.693 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-13T17:10:07.693 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:10:07.693 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:10:07.693 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:10:07.694 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:10:07.694 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:10:07.694 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:10:07.694 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:10:07.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:07.694 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:10:07.694 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:10:07.694 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:10:07.694 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:10:07.694 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:10:07.694 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:10:07.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:07.732 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-13T17:10:07.737 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:10:07.737 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:10:07.737 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:10:07.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:07.737 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-09-13T17:10:07.750 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:10:07.750 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:10:07.751 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:10:07.799 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:10:07.799 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:10:07.799 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:10:07.806 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:10:07.819 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:10:07.819 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:10:07.876 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:10:07.877 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:10:07.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:07.878 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:10:07.884 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:10:07.884 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:10:07.886 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:10:07.902 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:10:07.902 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:10:07.915 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:10:07.917 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:10:07.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:07.917 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:10:07.977 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:2024-09-13T17:10:07.972+0000 7fd94766f640 -1 init, newargv = 0x55dd90b239b0 newargc=15 2024-09-13T17:10:07.977 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33611]: starting ceph client 2024-09-13T17:10:07.986 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33611]: starting fuse 2024-09-13T17:10:09.068 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:10:09.086 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:10:09.087 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:10:09.096 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:10:09.097 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:10:09.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:09.098 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:10:09.147 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-09-13T17:10:09.147 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:10:09.147 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:10:09.147 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-09-13T17:10:09.147 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-09-13T17:10:09.148 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-13T17:10:09.148 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-09-13T17:10:09.148 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:09.148 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-09-13T17:10:09.148 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:10:09.148 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-09-13T17:10:09.148 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:10:09.148 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:09.148 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-09-13T17:10:09.148 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-09-13T17:10:09.148 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-09-13T17:10:09.148 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-09-13T17:10:09.148 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:09.149 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-09-13T17:10:09.149 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:10:09.149 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:10:09.149 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:10:09.149 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-09-13T17:10:09.149 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-09-13T17:10:09.149 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-09-13T17:10:09.149 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:10:09.149 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:09.149 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.1")) 2024-09-13T17:10:09.149 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-13T17:10:09.228 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.1.33611.asok 2024-09-13T17:10:09.415 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33611.asok 2024-09-13T17:10:09.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:09.415 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33611.asok status 2024-09-13T17:10:09.521 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-13T17:10:09.522 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-09-13T17:10:09.522 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:10:09.522 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:10:09.522 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "1", 2024-09-13T17:10:09.522 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-09-13T17:10:09.522 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:10:09.522 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "33611", 2024-09-13T17:10:09.522 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-09-13T17:10:09.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:10:09.523 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-09-13T17:10:09.523 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-09-13T17:10:09.523 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 6287, 2024-09-13T17:10:09.523 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-09-13T17:10:09.523 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-09-13T17:10:09.523 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-09-13T17:10:09.523 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 6287 2024-09-13T17:10:09.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:10:09.523 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:10:09.523 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:10:09.523 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:10:09.524 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 2898187732 2024-09-13T17:10:09.524 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-13T17:10:09.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:10:09.524 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:10:09.524 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:10:09.524 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:10:09.524 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 2898187732 2024-09-13T17:10:09.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:10:09.524 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.6287 192.168.0.1:0/2898187732", 2024-09-13T17:10:09.524 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.1:0/2898187732", 2024-09-13T17:10:09.524 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-09-13T17:10:09.524 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 41, 2024-09-13T17:10:09.525 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 86, 2024-09-13T17:10:09.525 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:10:09.525 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-09-13T17:10:09.525 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-09-13T17:10:09.525 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-13T17:10:09.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:09.531 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-09-13T17:10:09.531 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:10:09.537 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-09-13T17:10:09.537 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:10:09.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:09.537 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:10:09.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:09.548 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-13T17:10:09.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:09.567 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2024-09-13T17:10:09.620 INFO:teuthology.orchestra.run.smithi123.stderr:./subdir: ceph.quota.max_files: No such attribute 2024-09-13T17:10:09.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:10:09.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:09.621 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2024-09-13T17:10:09.650 INFO:teuthology.orchestra.run.smithi153.stderr:./subdir: ceph.quota.max_files: No such attribute 2024-09-13T17:10:09.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:10:09.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:09.651 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_files -v 10 ./subdir) 2024-09-13T17:10:09.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:09.666 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2024-09-13T17:10:09.720 INFO:teuthology.orchestra.run.smithi123.stdout:10 2024-09-13T17:10:09.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:09.721 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2024-09-13T17:10:09.733 INFO:teuthology.orchestra.run.smithi153.stdout:10 2024-09-13T17:10:09.733 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:10:09.733 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:10:09.752 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:10:09.773 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:10:09.773 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:10:09.773 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:09.781 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:09.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f7445b48700 1 Processor -- start 2024-09-13T17:10:09.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f7445b48700 1 -- start start 2024-09-13T17:10:09.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f7445b48700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f74401598b0 0x7f7440071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:09.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f7445b48700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74400cdfd0 0x7f74400ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:09.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f7445b48700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744015d360 con 0x7f74400cebf0 2024-09-13T17:10:09.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f7445b48700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744015aca0 con 0x7f74401598b0 2024-09-13T17:10:09.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f7445b48700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74400cf060 con 0x7f74400cdfd0 2024-09-13T17:10:09.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f7445347700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f74400cebf0 0x7f74400b15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48606/0 (socket says 172.21.15.123:48606) 2024-09-13T17:10:09.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f7445347700 1 -- 172.21.15.123:0/3692288581 learned_addr learned my addr 172.21.15.123:0/3692288581 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:09.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f743ffff700 1 --2- 172.21.15.123:0/3692288581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74400cdfd0 0x7f74400ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:09.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f7444b46700 1 --2- 172.21.15.123:0/3692288581 >> v2:172.21.15.153:3300/0 conn(0x7f74401598b0 0x7f7440071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:09.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f743f7fe700 1 -- 172.21.15.123:0/3692288581 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434835462 0 0) 0x7f744015d360 con 0x7f74400cebf0 2024-09-13T17:10:09.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f743f7fe700 1 -- 172.21.15.123:0/3692288581 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f742c0035d0 con 0x7f74400cebf0 2024-09-13T17:10:09.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f743ffff700 1 -- 172.21.15.123:0/3692288581 >> v2:172.21.15.153:3300/0 conn(0x7f74401598b0 msgr2=0x7f7440071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:09.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f743ffff700 1 --2- 172.21.15.123:0/3692288581 >> v2:172.21.15.153:3300/0 conn(0x7f74401598b0 0x7f7440071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:09.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f743ffff700 1 -- 172.21.15.123:0/3692288581 >> v1:172.21.15.123:6789/0 conn(0x7f74400cebf0 legacy=0x7f74400b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:09.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f743ffff700 1 -- 172.21.15.123:0/3692288581 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74400ce3d0 con 0x7f74400cdfd0 2024-09-13T17:10:09.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.937+0000 7f743ffff700 1 --2- 172.21.15.123:0/3692288581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74400cdfd0 0x7f74400ce6b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7428009850 tx=0x7f7428009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e25e5b5bb820031 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:09.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.941+0000 7f743f7fe700 1 -- 172.21.15.123:0/3692288581 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428011830 con 0x7f74400cdfd0 2024-09-13T17:10:09.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.941+0000 7f743f7fe700 1 -- 172.21.15.123:0/3692288581 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7428011990 con 0x7f74400cdfd0 2024-09-13T17:10:09.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.941+0000 7f743f7fe700 1 -- 172.21.15.123:0/3692288581 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428011d40 con 0x7f74400cdfd0 2024-09-13T17:10:09.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.941+0000 7f7445b48700 1 -- 172.21.15.123:0/3692288581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74400cdfd0 msgr2=0x7f74400ce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:09.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.941+0000 7f7445b48700 1 --2- 172.21.15.123:0/3692288581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74400cdfd0 0x7f74400ce6b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7428009850 tx=0x7f7428009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:09.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.941+0000 7f7445b48700 1 -- 172.21.15.123:0/3692288581 shutdown_connections 2024-09-13T17:10:09.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.941+0000 7f7445b48700 1 --2- 172.21.15.123:0/3692288581 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74400cdfd0 0x7f74400ce6b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:09.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.941+0000 7f7445b48700 1 --2- 172.21.15.123:0/3692288581 >> v2:172.21.15.153:3300/0 conn(0x7f74401598b0 0x7f7440071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:09.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.941+0000 7f7445b48700 1 -- 172.21.15.123:0/3692288581 >> 172.21.15.123:0/3692288581 conn(0x7f7440066150 msgr2=0x7f7440066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:09.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.941+0000 7f7445b48700 1 -- 172.21.15.123:0/3692288581 shutdown_connections 2024-09-13T17:10:09.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.941+0000 7f7445b48700 1 -- 172.21.15.123:0/3692288581 wait complete. 2024-09-13T17:10:09.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.941+0000 7f7445b48700 1 Processor -- start 2024-09-13T17:10:09.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.941+0000 7f7445b48700 1 -- start start 2024-09-13T17:10:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7445b48700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74400cdfd0 0x7f7440158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7445b48700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74400cebf0 0x7f74400aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7445b48700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74401598b0 0x7f74400af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7445b48700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74400a9750 con 0x7f74400cdfd0 2024-09-13T17:10:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7445b48700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74400a99a0 con 0x7f74400cebf0 2024-09-13T17:10:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7445b48700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74400a9c80 con 0x7f74401598b0 2024-09-13T17:10:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7444b46700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74400cdfd0 0x7f7440158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7444b46700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74400cdfd0 0x7f7440158a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54620/0 (socket says 172.21.15.123:54620) 2024-09-13T17:10:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7444b46700 1 -- 172.21.15.123:0/3423754201 learned_addr learned my addr 172.21.15.123:0/3423754201 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f743ffff700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74400cebf0 0x7f74400aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7445347700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74401598b0 0x7f74400af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7444b46700 1 -- 172.21.15.123:0/3423754201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74401598b0 msgr2=0x7f74400af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7444b46700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74401598b0 0x7f74400af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7444b46700 1 -- 172.21.15.123:0/3423754201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74400cebf0 msgr2=0x7f74400aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7444b46700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74400cebf0 0x7f74400aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7444b46700 1 -- 172.21.15.123:0/3423754201 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74280094b0 con 0x7f74400cdfd0 2024-09-13T17:10:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f743ffff700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74400cebf0 0x7f74400aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:09.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7445347700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74401598b0 0x7f74400af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:09.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7444b46700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74400cdfd0 0x7f7440158a30 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f743000e840 tx=0x7f743000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:09.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f743d7fa700 1 -- 172.21.15.123:0/3423754201 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74300095a0 con 0x7f74400cdfd0 2024-09-13T17:10:09.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f743d7fa700 1 -- 172.21.15.123:0/3423754201 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743000c690 con 0x7f74400cdfd0 2024-09-13T17:10:09.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7445b48700 1 -- 172.21.15.123:0/3423754201 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74400a9f60 con 0x7f74400cdfd0 2024-09-13T17:10:09.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f743d7fa700 1 -- 172.21.15.123:0/3423754201 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743000ca00 con 0x7f74400cdfd0 2024-09-13T17:10:09.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7445b48700 1 -- 172.21.15.123:0/3423754201 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74400ac340 con 0x7f74400cdfd0 2024-09-13T17:10:09.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f7445b48700 1 -- 172.21.15.123:0/3423754201 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74400677f0 con 0x7f74400cdfd0 2024-09-13T17:10:09.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.945+0000 7f743d7fa700 1 -- 172.21.15.123:0/3423754201 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f743000cbe0 con 0x7f74400cdfd0 2024-09-13T17:10:09.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.949+0000 7f743d7fa700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7420066730 0x7f7420068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:09.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.949+0000 7f743ffff700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7420066730 0x7f7420068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:09.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.949+0000 7f743d7fa700 1 -- 172.21.15.123:0/3423754201 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7430084190 con 0x7f74400cdfd0 2024-09-13T17:10:09.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.949+0000 7f743ffff700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7420066730 0x7f7420068bf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f74280090b0 tx=0x7f7428008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:09.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:09.953+0000 7f743d7fa700 1 -- 172.21.15.123:0/3423754201 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7430051460 con 0x7f74400cdfd0 2024-09-13T17:10:10.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.129+0000 7f7445b48700 1 -- 172.21.15.123:0/3423754201 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f744015e090 con 0x7f74400cdfd0 2024-09-13T17:10:10.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.133+0000 7f743d7fa700 1 -- 172.21.15.123:0/3423754201 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f7430054a80 con 0x7f74400cdfd0 2024-09-13T17:10:10.139 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:10.140 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:01.118924+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:58.436099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:59.120652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:10.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.133+0000 7f7445b48700 1 -- 172.21.15.123:0/3423754201 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7420066730 msgr2=0x7f7420068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.133+0000 7f7445b48700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7420066730 0x7f7420068bf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f74280090b0 tx=0x7f7428008030 comp rx=0 tx=0).stop 2024-09-13T17:10:10.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.133+0000 7f7445b48700 1 -- 172.21.15.123:0/3423754201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74400cdfd0 msgr2=0x7f7440158a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.133+0000 7f7445b48700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74400cdfd0 0x7f7440158a30 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f743000e840 tx=0x7f743000ec00 comp rx=0 tx=0).stop 2024-09-13T17:10:10.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.133+0000 7f7445b48700 1 -- 172.21.15.123:0/3423754201 shutdown_connections 2024-09-13T17:10:10.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.133+0000 7f7445b48700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7420066730 0x7f7420068bf0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.133+0000 7f7445b48700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74401598b0 0x7f74400af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.133+0000 7f7445b48700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74400cebf0 0x7f74400aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.133+0000 7f7445b48700 1 --2- 172.21.15.123:0/3423754201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74400cdfd0 0x7f7440158a30 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.133+0000 7f7445b48700 1 -- 172.21.15.123:0/3423754201 >> 172.21.15.123:0/3423754201 conn(0x7f7440066150 msgr2=0x7f74400b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:10.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.133+0000 7f7445b48700 1 -- 172.21.15.123:0/3423754201 shutdown_connections 2024-09-13T17:10:10.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.137+0000 7f7445b48700 1 -- 172.21.15.123:0/3423754201 wait complete. 2024-09-13T17:10:10.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:09:58.436099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:09:59.120652+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:10:10.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:10:10.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.269+0000 7f8e15225700 1 Processor -- start 2024-09-13T17:10:10.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.269+0000 7f8e15225700 1 -- start start 2024-09-13T17:10:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.269+0000 7f8e15225700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e1015ceb0 0x7f8e100cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e15225700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e100d08e0 0x7f8e100d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e15225700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e100cc250 con 0x7f8e100cc6e0 2024-09-13T17:10:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e15225700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e100d12d0 con 0x7f8e100d08e0 2024-09-13T17:10:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e15225700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100cb960 con 0x7f8e1015ceb0 2024-09-13T17:10:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e14a24700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e100d08e0 0x7f8e100d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e14a24700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e100d08e0 0x7f8e100d0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54624/0 (socket says 172.21.15.123:54624) 2024-09-13T17:10:10.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e14a24700 1 -- 172.21.15.123:0/1901737947 learned_addr learned my addr 172.21.15.123:0/1901737947 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:10.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e0ffff700 1 --2- 172.21.15.123:0/1901737947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e1015ceb0 0x7f8e100cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e0effd700 1 -- 172.21.15.123:0/1901737947 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018099272 0 0) 0x7f8e100cc250 con 0x7f8e100cc6e0 2024-09-13T17:10:10.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e0effd700 1 -- 172.21.15.123:0/1901737947 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8df80035d0 con 0x7f8e100cc6e0 2024-09-13T17:10:10.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e0ffff700 1 -- 172.21.15.123:0/1901737947 >> v2:172.21.15.123:3300/0 conn(0x7f8e100d08e0 msgr2=0x7f8e100d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:10.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e0ffff700 1 --2- 172.21.15.123:0/1901737947 >> v2:172.21.15.123:3300/0 conn(0x7f8e100d08e0 0x7f8e100d0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e0ffff700 1 -- 172.21.15.123:0/1901737947 >> v1:172.21.15.153:6789/0 conn(0x7f8e100cc6e0 legacy=0x7f8e1006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e0ffff700 1 -- 172.21.15.123:0/1901737947 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e100d0560 con 0x7f8e1015ceb0 2024-09-13T17:10:10.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e14a24700 1 --2- 172.21.15.123:0/1901737947 >> v2:172.21.15.123:3300/0 conn(0x7f8e100d08e0 0x7f8e100d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:10.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e0ffff700 1 --2- 172.21.15.123:0/1901737947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e1015ceb0 0x7f8e100cfef0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009850 tx=0x7f8e00009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7975ce3464943d82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:10.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e0effd700 1 -- 172.21.15.123:0/1901737947 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00011830 con 0x7f8e1015ceb0 2024-09-13T17:10:10.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e0effd700 1 -- 172.21.15.123:0/1901737947 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e00011990 con 0x7f8e1015ceb0 2024-09-13T17:10:10.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e0effd700 1 -- 172.21.15.123:0/1901737947 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00011d00 con 0x7f8e1015ceb0 2024-09-13T17:10:10.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e15225700 1 -- 172.21.15.123:0/1901737947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e1015ceb0 msgr2=0x7f8e100cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e15225700 1 --2- 172.21.15.123:0/1901737947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e1015ceb0 0x7f8e100cfef0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009850 tx=0x7f8e00009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:10.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e15225700 1 -- 172.21.15.123:0/1901737947 shutdown_connections 2024-09-13T17:10:10.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e15225700 1 --2- 172.21.15.123:0/1901737947 >> v2:172.21.15.123:3300/0 conn(0x7f8e100d08e0 0x7f8e100d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e15225700 1 --2- 172.21.15.123:0/1901737947 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e1015ceb0 0x7f8e100cfef0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e15225700 1 -- 172.21.15.123:0/1901737947 >> 172.21.15.123:0/1901737947 conn(0x7f8e1006e090 msgr2=0x7f8e1006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:10.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e15225700 1 -- 172.21.15.123:0/1901737947 shutdown_connections 2024-09-13T17:10:10.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.273+0000 7f8e15225700 1 -- 172.21.15.123:0/1901737947 wait complete. 2024-09-13T17:10:10.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.277+0000 7f8e15225700 1 Processor -- start 2024-09-13T17:10:10.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.277+0000 7f8e15225700 1 -- start start 2024-09-13T17:10:10.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e15225700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e100cc6e0 0x7f8e10155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e15225700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e100d08e0 0x7f8e100b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e15225700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e1015ceb0 0x7f8e100b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e15225700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100c7cd0 con 0x7f8e100d08e0 2024-09-13T17:10:10.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e15225700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100c9240 con 0x7f8e100cc6e0 2024-09-13T17:10:10.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e15225700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100c9520 con 0x7f8e1015ceb0 2024-09-13T17:10:10.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e0f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e100d08e0 0x7f8e100b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e0f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e100d08e0 0x7f8e100b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54634/0 (socket says 172.21.15.123:54634) 2024-09-13T17:10:10.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e0f7fe700 1 -- 172.21.15.123:0/3521495433 learned_addr learned my addr 172.21.15.123:0/3521495433 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:10.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e14a24700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e1015ceb0 0x7f8e100b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e0ffff700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e100cc6e0 0x7f8e10155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e0f7fe700 1 -- 172.21.15.123:0/3521495433 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e1015ceb0 msgr2=0x7f8e100b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e0f7fe700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e1015ceb0 0x7f8e100b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e0f7fe700 1 -- 172.21.15.123:0/3521495433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e100cc6e0 msgr2=0x7f8e10155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e0f7fe700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e100cc6e0 0x7f8e10155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e0f7fe700 1 -- 172.21.15.123:0/3521495433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e08009b30 con 0x7f8e100d08e0 2024-09-13T17:10:10.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e0ffff700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e100cc6e0 0x7f8e10155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:10.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e0f7fe700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e100d08e0 0x7f8e100b24a0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400c500 tx=0x7f8e0400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:10.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e0cff9700 1 -- 172.21.15.123:0/3521495433 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e040052d0 con 0x7f8e100d08e0 2024-09-13T17:10:10.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e0cff9700 1 -- 172.21.15.123:0/3521495433 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e04005450 con 0x7f8e100d08e0 2024-09-13T17:10:10.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e15225700 1 -- 172.21.15.123:0/3521495433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e000094b0 con 0x7f8e100d08e0 2024-09-13T17:10:10.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e0cff9700 1 -- 172.21.15.123:0/3521495433 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e040038e0 con 0x7f8e100d08e0 2024-09-13T17:10:10.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e15225700 1 -- 172.21.15.123:0/3521495433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1015d410 con 0x7f8e100d08e0 2024-09-13T17:10:10.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.281+0000 7f8e15225700 1 -- 172.21.15.123:0/3521495433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e10072520 con 0x7f8e100d08e0 2024-09-13T17:10:10.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.285+0000 7f8e0cff9700 1 -- 172.21.15.123:0/3521495433 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e04003a40 con 0x7f8e100d08e0 2024-09-13T17:10:10.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.285+0000 7f8e0cff9700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8dfc066730 0x7f8dfc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.285+0000 7f8e0cff9700 1 -- 172.21.15.123:0/3521495433 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e04083650 con 0x7f8e100d08e0 2024-09-13T17:10:10.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.285+0000 7f8e0ffff700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8dfc066730 0x7f8dfc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.285+0000 7f8e0ffff700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8dfc066730 0x7f8dfc068bf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8e000090b0 tx=0x7f8e00008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:10.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.293+0000 7f8e0cff9700 1 -- 172.21.15.123:0/3521495433 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e040509e0 con 0x7f8e100d08e0 2024-09-13T17:10:10.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.465+0000 7f8e15225700 1 -- 172.21.15.123:0/3521495433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e100ce9e0 con 0x7f8e100d08e0 2024-09-13T17:10:10.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.465+0000 7f8e0cff9700 1 -- 172.21.15.123:0/3521495433 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8e04054000 con 0x7f8e100d08e0 2024-09-13T17:10:10.471 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:10:10.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.465+0000 7f8e15225700 1 -- 172.21.15.123:0/3521495433 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8dfc066730 msgr2=0x7f8dfc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.465+0000 7f8e15225700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8dfc066730 0x7f8dfc068bf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8e000090b0 tx=0x7f8e00008030 comp rx=0 tx=0).stop 2024-09-13T17:10:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.465+0000 7f8e15225700 1 -- 172.21.15.123:0/3521495433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e100d08e0 msgr2=0x7f8e100b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.465+0000 7f8e15225700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e100d08e0 0x7f8e100b24a0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400c500 tx=0x7f8e0400c810 comp rx=0 tx=0).stop 2024-09-13T17:10:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.465+0000 7f8e15225700 1 -- 172.21.15.123:0/3521495433 shutdown_connections 2024-09-13T17:10:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.465+0000 7f8e15225700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8dfc066730 0x7f8dfc068bf0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.465+0000 7f8e15225700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e1015ceb0 0x7f8e100b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.465+0000 7f8e15225700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e100d08e0 0x7f8e100b24a0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.465+0000 7f8e15225700 1 --2- 172.21.15.123:0/3521495433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e100cc6e0 0x7f8e10155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.465+0000 7f8e15225700 1 -- 172.21.15.123:0/3521495433 >> 172.21.15.123:0/3521495433 conn(0x7f8e1006e090 msgr2=0x7f8e1015b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.465+0000 7f8e15225700 1 -- 172.21.15.123:0/3521495433 shutdown_connections 2024-09-13T17:10:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.465+0000 7f8e15225700 1 -- 172.21.15.123:0/3521495433 wait complete. 2024-09-13T17:10:10.491 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:10:10.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb545c86700 1 Processor -- start 2024-09-13T17:10:10.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb545c86700 1 -- start start 2024-09-13T17:10:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb545c86700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5401592e0 0x7fb54015d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb545c86700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb5401596c0 0x7fb54015d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb545c86700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5400cd2e0 con 0x7fb54006dc90 2024-09-13T17:10:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb545c86700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5400cb810 con 0x7fb5401596c0 2024-09-13T17:10:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb545c86700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400cd5c0 con 0x7fb5401592e0 2024-09-13T17:10:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb544c84700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5401592e0 0x7fb54015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb53ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb5401596c0 0x7fb54015d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb544c84700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5401592e0 0x7fb54015d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:45246/0 (socket says 172.21.15.123:45246) 2024-09-13T17:10:10.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb544c84700 1 -- 172.21.15.123:0/4118644570 learned_addr learned my addr 172.21.15.123:0/4118644570 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:10.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb544c84700 1 -- 172.21.15.123:0/4118644570 >> v2:172.21.15.153:3300/0 conn(0x7fb5401596c0 msgr2=0x7fb54015d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:10.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb544c84700 1 --2- 172.21.15.123:0/4118644570 >> v2:172.21.15.153:3300/0 conn(0x7fb5401596c0 0x7fb54015d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb544c84700 1 -- 172.21.15.123:0/4118644570 >> v1:172.21.15.153:6789/0 conn(0x7fb54006dc90 legacy=0x7fb5400cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb544c84700 1 -- 172.21.15.123:0/4118644570 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400cd8a0 con 0x7fb5401592e0 2024-09-13T17:10:10.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb544c84700 1 --2- 172.21.15.123:0/4118644570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5401592e0 0x7fb54015d030 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb53400bbb0 tx=0x7fb53400bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=592f67e089dd4a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:10.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb53f7fe700 1 -- 172.21.15.123:0/4118644570 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53400dd30 con 0x7fb5401592e0 2024-09-13T17:10:10.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb53f7fe700 1 -- 172.21.15.123:0/4118644570 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53400de90 con 0x7fb5401592e0 2024-09-13T17:10:10.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.605+0000 7fb53f7fe700 1 -- 172.21.15.123:0/4118644570 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534010690 con 0x7fb5401592e0 2024-09-13T17:10:10.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.609+0000 7fb545c86700 1 -- 172.21.15.123:0/4118644570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5401592e0 msgr2=0x7fb54015d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.609+0000 7fb545c86700 1 --2- 172.21.15.123:0/4118644570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5401592e0 0x7fb54015d030 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb53400bbb0 tx=0x7fb53400bec0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.609+0000 7fb545c86700 1 -- 172.21.15.123:0/4118644570 shutdown_connections 2024-09-13T17:10:10.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.609+0000 7fb545c86700 1 --2- 172.21.15.123:0/4118644570 >> v2:172.21.15.153:3300/0 conn(0x7fb5401596c0 0x7fb54015d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.609+0000 7fb545c86700 1 --2- 172.21.15.123:0/4118644570 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5401592e0 0x7fb54015d030 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.609+0000 7fb545c86700 1 -- 172.21.15.123:0/4118644570 >> 172.21.15.123:0/4118644570 conn(0x7fb5400b01d0 msgr2=0x7fb5400b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:10.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.609+0000 7fb545c86700 1 -- 172.21.15.123:0/4118644570 shutdown_connections 2024-09-13T17:10:10.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.609+0000 7fb545c86700 1 -- 172.21.15.123:0/4118644570 wait complete. 2024-09-13T17:10:10.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.609+0000 7fb545c86700 1 Processor -- start 2024-09-13T17:10:10.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.609+0000 7fb545c86700 1 -- start start 2024-09-13T17:10:10.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545c86700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb54006dc90 0x7fb540157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545c86700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5401592e0 0x7fb5400c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545c86700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5401596c0 0x7fb5401ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545c86700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400a9ad0 con 0x7fb5401592e0 2024-09-13T17:10:10.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545c86700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400a8ec0 con 0x7fb54006dc90 2024-09-13T17:10:10.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545c86700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400a91a0 con 0x7fb5401596c0 2024-09-13T17:10:10.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb53ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5401592e0 0x7fb5400c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb544c84700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb54006dc90 0x7fb540157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545485700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5401596c0 0x7fb5401ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb53ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5401592e0 0x7fb5400c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54644/0 (socket says 172.21.15.123:54644) 2024-09-13T17:10:10.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb53ffff700 1 -- 172.21.15.123:0/546341788 learned_addr learned my addr 172.21.15.123:0/546341788 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:10.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545485700 1 -- 172.21.15.123:0/546341788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb54006dc90 msgr2=0x7fb540157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545485700 1 --2- 172.21.15.123:0/546341788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb54006dc90 0x7fb540157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545485700 1 -- 172.21.15.123:0/546341788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5401592e0 msgr2=0x7fb5400c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545485700 1 --2- 172.21.15.123:0/546341788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5401592e0 0x7fb5400c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545485700 1 -- 172.21.15.123:0/546341788 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53400b810 con 0x7fb5401596c0 2024-09-13T17:10:10.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb53ffff700 1 --2- 172.21.15.123:0/546341788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5401592e0 0x7fb5400c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:10.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545485700 1 --2- 172.21.15.123:0/546341788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5401596c0 0x7fb5401ee840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb53800cb90 tx=0x7fb53800cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:10.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb53d7fa700 1 -- 172.21.15.123:0/546341788 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538003c20 con 0x7fb5401596c0 2024-09-13T17:10:10.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb53d7fa700 1 -- 172.21.15.123:0/546341788 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb538003d80 con 0x7fb5401596c0 2024-09-13T17:10:10.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb53d7fa700 1 -- 172.21.15.123:0/546341788 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53800aa80 con 0x7fb5401596c0 2024-09-13T17:10:10.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545c86700 1 -- 172.21.15.123:0/546341788 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5400a9480 con 0x7fb5401596c0 2024-09-13T17:10:10.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.613+0000 7fb545c86700 1 -- 172.21.15.123:0/546341788 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5400c8980 con 0x7fb5401596c0 2024-09-13T17:10:10.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.617+0000 7fb545c86700 1 -- 172.21.15.123:0/546341788 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5400a9c80 con 0x7fb5401596c0 2024-09-13T17:10:10.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.617+0000 7fb53d7fa700 1 -- 172.21.15.123:0/546341788 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb53800abe0 con 0x7fb5401596c0 2024-09-13T17:10:10.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.617+0000 7fb53d7fa700 1 --2- 172.21.15.123:0/546341788 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb524066730 0x7fb524068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.617+0000 7fb53d7fa700 1 -- 172.21.15.123:0/546341788 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb538084020 con 0x7fb5401596c0 2024-09-13T17:10:10.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.617+0000 7fb544c84700 1 --2- 172.21.15.123:0/546341788 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb524066730 0x7fb524068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.617+0000 7fb544c84700 1 --2- 172.21.15.123:0/546341788 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb524066730 0x7fb524068bf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb53400bfd0 tx=0x7fb534013000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:10.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.629+0000 7fb53d7fa700 1 -- 172.21.15.123:0/546341788 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb5400a9c80 con 0x7fb5401596c0 2024-09-13T17:10:10.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.801+0000 7fb545c86700 1 -- 172.21.15.123:0/546341788 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5400ccf60 con 0x7fb5401596c0 2024-09-13T17:10:10.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.801+0000 7fb53d7fa700 1 -- 172.21.15.123:0/546341788 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb538051380 con 0x7fb5401596c0 2024-09-13T17:10:10.809 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:10:10.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.805+0000 7fb545c86700 1 -- 172.21.15.123:0/546341788 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb524066730 msgr2=0x7fb524068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.805+0000 7fb545c86700 1 --2- 172.21.15.123:0/546341788 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb524066730 0x7fb524068bf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb53400bfd0 tx=0x7fb534013000 comp rx=0 tx=0).stop 2024-09-13T17:10:10.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.805+0000 7fb545c86700 1 -- 172.21.15.123:0/546341788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5401596c0 msgr2=0x7fb5401ee840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.805+0000 7fb545c86700 1 --2- 172.21.15.123:0/546341788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5401596c0 0x7fb5401ee840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb53800cb90 tx=0x7fb53800cea0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.805+0000 7fb545c86700 1 -- 172.21.15.123:0/546341788 shutdown_connections 2024-09-13T17:10:10.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.805+0000 7fb545c86700 1 --2- 172.21.15.123:0/546341788 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb524066730 0x7fb524068bf0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.805+0000 7fb545c86700 1 --2- 172.21.15.123:0/546341788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb5401596c0 0x7fb5401ee840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.805+0000 7fb545c86700 1 --2- 172.21.15.123:0/546341788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5401592e0 0x7fb5400c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.805+0000 7fb545c86700 1 --2- 172.21.15.123:0/546341788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb54006dc90 0x7fb540157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.805+0000 7fb545c86700 1 -- 172.21.15.123:0/546341788 >> 172.21.15.123:0/546341788 conn(0x7fb5400b01d0 msgr2=0x7fb540158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:10.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.805+0000 7fb545c86700 1 -- 172.21.15.123:0/546341788 shutdown_connections 2024-09-13T17:10:10.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.805+0000 7fb545c86700 1 -- 172.21.15.123:0/546341788 wait complete. 2024-09-13T17:10:10.824 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:10:10.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f9814a2a700 1 Processor -- start 2024-09-13T17:10:10.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f9814a2a700 1 -- start start 2024-09-13T17:10:10.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f9814a2a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9810159c10 0x7f98100ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f9814a2a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f98100cadf0 0x7f981006a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f9814a2a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981006d1d0 con 0x7f9810159830 2024-09-13T17:10:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f9814a2a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981006d400 con 0x7f98100cadf0 2024-09-13T17:10:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f9814a2a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981006d6a0 con 0x7f9810159c10 2024-09-13T17:10:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980e59c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9810159830 0x7f981006e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48614/0 (socket says 172.21.15.123:48614) 2024-09-13T17:10:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980e59c700 1 -- 172.21.15.123:0/3559597001 learned_addr learned my addr 172.21.15.123:0/3559597001 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980ed9d700 1 --2- 172.21.15.123:0/3559597001 >> v2:172.21.15.123:3300/0 conn(0x7f98100cadf0 0x7f981006a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980dd9b700 1 --2- 172.21.15.123:0/3559597001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9810159c10 0x7f98100ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980d59a700 1 -- 172.21.15.123:0/3559597001 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318782029 0 0) 0x7f981006d1d0 con 0x7f9810159830 2024-09-13T17:10:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980d59a700 1 -- 172.21.15.123:0/3559597001 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97fc0035d0 con 0x7f9810159830 2024-09-13T17:10:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980ed9d700 1 -- 172.21.15.123:0/3559597001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9810159c10 msgr2=0x7f98100ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980ed9d700 1 --2- 172.21.15.123:0/3559597001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9810159c10 0x7f98100ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980ed9d700 1 -- 172.21.15.123:0/3559597001 >> v1:172.21.15.123:6789/0 conn(0x7f9810159830 legacy=0x7f981006e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980ed9d700 1 -- 172.21.15.123:0/3559597001 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981006d980 con 0x7f98100cadf0 2024-09-13T17:10:10.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980dd9b700 1 --2- 172.21.15.123:0/3559597001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9810159c10 0x7f98100ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:10.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980ed9d700 1 --2- 172.21.15.123:0/3559597001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98100cadf0 0x7f981006a260 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f9808009880 tx=0x7f9808009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33abb33dcc5b4239 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:10.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980d59a700 1 -- 172.21.15.123:0/3559597001 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808011830 con 0x7f98100cadf0 2024-09-13T17:10:10.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980d59a700 1 -- 172.21.15.123:0/3559597001 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9808011990 con 0x7f98100cadf0 2024-09-13T17:10:10.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.933+0000 7f980d59a700 1 -- 172.21.15.123:0/3559597001 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808011d20 con 0x7f98100cadf0 2024-09-13T17:10:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.937+0000 7f9814a2a700 1 -- 172.21.15.123:0/3559597001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98100cadf0 msgr2=0x7f981006a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.937+0000 7f9814a2a700 1 --2- 172.21.15.123:0/3559597001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98100cadf0 0x7f981006a260 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f9808009880 tx=0x7f9808009b90 comp rx=0 tx=0).stop 2024-09-13T17:10:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.937+0000 7f9814a2a700 1 -- 172.21.15.123:0/3559597001 shutdown_connections 2024-09-13T17:10:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.937+0000 7f9814a2a700 1 --2- 172.21.15.123:0/3559597001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98100cadf0 0x7f981006a260 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.937+0000 7f9814a2a700 1 --2- 172.21.15.123:0/3559597001 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9810159c10 0x7f98100ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.937+0000 7f9814a2a700 1 -- 172.21.15.123:0/3559597001 >> 172.21.15.123:0/3559597001 conn(0x7f98100b0eb0 msgr2=0x7f98100b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.937+0000 7f9814a2a700 1 -- 172.21.15.123:0/3559597001 shutdown_connections 2024-09-13T17:10:10.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.937+0000 7f9814a2a700 1 -- 172.21.15.123:0/3559597001 wait complete. 2024-09-13T17:10:10.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.937+0000 7f9814a2a700 1 Processor -- start 2024-09-13T17:10:10.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.937+0000 7f9814a2a700 1 -- start start 2024-09-13T17:10:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f9814a2a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98100cadf0 0x7f98100adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f9814a2a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9810159830 0x7f98100b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f9814a2a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9810159c10 0x7f98100b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f9814a2a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9810156040 con 0x7f9810159830 2024-09-13T17:10:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f9814a2a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981015e260 con 0x7f9810159c10 2024-09-13T17:10:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f9814a2a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981015df80 con 0x7f98100cadf0 2024-09-13T17:10:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f980dd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9810159830 0x7f98100b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f980dd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9810159830 0x7f98100b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54664/0 (socket says 172.21.15.123:54664) 2024-09-13T17:10:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f980dd9b700 1 -- 172.21.15.123:0/3726729940 learned_addr learned my addr 172.21.15.123:0/3726729940 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f980e59c700 1 --2- 172.21.15.123:0/3726729940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98100cadf0 0x7f98100adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f980ed9d700 1 --2- 172.21.15.123:0/3726729940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9810159c10 0x7f98100b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f980dd9b700 1 -- 172.21.15.123:0/3726729940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98100cadf0 msgr2=0x7f98100adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f980dd9b700 1 --2- 172.21.15.123:0/3726729940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98100cadf0 0x7f98100adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f980dd9b700 1 -- 172.21.15.123:0/3726729940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9810159c10 msgr2=0x7f98100b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:10.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f980dd9b700 1 --2- 172.21.15.123:0/3726729940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9810159c10 0x7f98100b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:10.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f980dd9b700 1 -- 172.21.15.123:0/3726729940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98080094b0 con 0x7f9810159830 2024-09-13T17:10:10.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f980dd9b700 1 --2- 172.21.15.123:0/3726729940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9810159830 0x7f98100b00a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f97f800e810 tx=0x7f97f800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:10.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f9806ffd700 1 -- 172.21.15.123:0/3726729940 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8004230 con 0x7f9810159830 2024-09-13T17:10:10.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f9806ffd700 1 -- 172.21.15.123:0/3726729940 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f8004390 con 0x7f9810159830 2024-09-13T17:10:10.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f9814a2a700 1 -- 172.21.15.123:0/3726729940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98101f2a30 con 0x7f9810159830 2024-09-13T17:10:10.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f9806ffd700 1 -- 172.21.15.123:0/3726729940 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f80036c0 con 0x7f9810159830 2024-09-13T17:10:10.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.941+0000 7f9814a2a700 1 -- 172.21.15.123:0/3726729940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98101f2ff0 con 0x7f9810159830 2024-09-13T17:10:10.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.945+0000 7f9814a2a700 1 -- 172.21.15.123:0/3726729940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981006a880 con 0x7f9810159830 2024-09-13T17:10:10.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.945+0000 7f9806ffd700 1 -- 172.21.15.123:0/3726729940 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f97f8003840 con 0x7f9810159830 2024-09-13T17:10:10.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.945+0000 7f9806ffd700 1 --2- 172.21.15.123:0/3726729940 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97f0066730 0x7f97f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:10.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.945+0000 7f980e59c700 1 --2- 172.21.15.123:0/3726729940 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97f0066730 0x7f97f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:10.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.945+0000 7f9806ffd700 1 -- 172.21.15.123:0/3726729940 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97f8083a20 con 0x7f9810159830 2024-09-13T17:10:10.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.945+0000 7f980e59c700 1 --2- 172.21.15.123:0/3726729940 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97f0066730 0x7f97f0068bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9800001560 tx=0x7f9800001a90 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:10.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:10.953+0000 7f9806ffd700 1 -- 172.21.15.123:0/3726729940 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f97f8050e20 con 0x7f9810159830 2024-09-13T17:10:11.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.121+0000 7f9814a2a700 1 -- 172.21.15.123:0/3726729940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98100cbbe0 con 0x7f9810159830 2024-09-13T17:10:11.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.121+0000 7f9806ffd700 1 -- 172.21.15.123:0/3726729940 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97f80200a0 con 0x7f9810159830 2024-09-13T17:10:11.127 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:10:11.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.121+0000 7f9814a2a700 1 -- 172.21.15.123:0/3726729940 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97f0066730 msgr2=0x7f97f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.121+0000 7f9814a2a700 1 --2- 172.21.15.123:0/3726729940 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97f0066730 0x7f97f0068bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9800001560 tx=0x7f9800001a90 comp rx=0 tx=0).stop 2024-09-13T17:10:11.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.121+0000 7f9814a2a700 1 -- 172.21.15.123:0/3726729940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9810159830 msgr2=0x7f98100b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.121+0000 7f9814a2a700 1 --2- 172.21.15.123:0/3726729940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9810159830 0x7f98100b00a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f97f800e810 tx=0x7f97f800eb20 comp rx=0 tx=0).stop 2024-09-13T17:10:11.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.125+0000 7f9814a2a700 1 -- 172.21.15.123:0/3726729940 shutdown_connections 2024-09-13T17:10:11.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.125+0000 7f9814a2a700 1 --2- 172.21.15.123:0/3726729940 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f97f0066730 0x7f97f0068bf0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.125+0000 7f9814a2a700 1 --2- 172.21.15.123:0/3726729940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9810159c10 0x7f98100b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.125+0000 7f9814a2a700 1 --2- 172.21.15.123:0/3726729940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9810159830 0x7f98100b00a0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.125+0000 7f9814a2a700 1 --2- 172.21.15.123:0/3726729940 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98100cadf0 0x7f98100adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.125+0000 7f9814a2a700 1 -- 172.21.15.123:0/3726729940 >> 172.21.15.123:0/3726729940 conn(0x7f98100b0eb0 msgr2=0x7f98100ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:11.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.125+0000 7f9814a2a700 1 -- 172.21.15.123:0/3726729940 shutdown_connections 2024-09-13T17:10:11.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.125+0000 7f9814a2a700 1 -- 172.21.15.123:0/3726729940 wait complete. 2024-09-13T17:10:11.142 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:10:11.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.245+0000 7f059cb5f700 1 Processor -- start 2024-09-13T17:10:11.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.245+0000 7f059cb5f700 1 -- start start 2024-09-13T17:10:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f059cb5f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980d0f40 0x7f05980d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f059cb5f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f05980cd5e0 0x7f05980cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f059cb5f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05980d0cb0 con 0x7f05980b58b0 2024-09-13T17:10:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f059cb5f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05980b0060 con 0x7f05980cd5e0 2024-09-13T17:10:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f059cb5f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05980b0340 con 0x7f05980d0f40 2024-09-13T17:10:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f0597fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f05980cd5e0 0x7f05980cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f05977fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980d0f40 0x7f05980d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f0597fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f05980cd5e0 0x7f05980cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:34088/0 (socket says 172.21.15.123:34088) 2024-09-13T17:10:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f05977fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980d0f40 0x7f05980d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:45268/0 (socket says 172.21.15.123:45268) 2024-09-13T17:10:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f0597fff700 1 -- 172.21.15.123:0/2702477191 learned_addr learned my addr 172.21.15.123:0/2702477191 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:11.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f0596ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f05980b58b0 0x7f05980d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:43916/0 (socket says 172.21.15.123:43916) 2024-09-13T17:10:11.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f0597fff700 1 -- 172.21.15.123:0/2702477191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980d0f40 msgr2=0x7f05980d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:11.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f0597fff700 1 --2- 172.21.15.123:0/2702477191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980d0f40 0x7f05980d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f0597fff700 1 -- 172.21.15.123:0/2702477191 >> v1:172.21.15.153:6789/0 conn(0x7f05980b58b0 legacy=0x7f05980d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f0597fff700 1 -- 172.21.15.123:0/2702477191 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980b0620 con 0x7f05980cd5e0 2024-09-13T17:10:11.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f0597fff700 1 --2- 172.21.15.123:0/2702477191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05980cd5e0 0x7f05980cda30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0590009e50 tx=0x7f059000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f413702f000a4715 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:11.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f05967fc700 1 -- 172.21.15.123:0/2702477191 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059000e070 con 0x7f05980cd5e0 2024-09-13T17:10:11.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f05967fc700 1 -- 172.21.15.123:0/2702477191 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059000b910 con 0x7f05980cd5e0 2024-09-13T17:10:11.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.249+0000 7f05967fc700 1 -- 172.21.15.123:0/2702477191 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059000bcc0 con 0x7f05980cd5e0 2024-09-13T17:10:11.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.253+0000 7f059cb5f700 1 -- 172.21.15.123:0/2702477191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05980cd5e0 msgr2=0x7f05980cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.253+0000 7f059cb5f700 1 --2- 172.21.15.123:0/2702477191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05980cd5e0 0x7f05980cda30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0590009e50 tx=0x7f059000b330 comp rx=0 tx=0).stop 2024-09-13T17:10:11.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.253+0000 7f059cb5f700 1 -- 172.21.15.123:0/2702477191 shutdown_connections 2024-09-13T17:10:11.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.253+0000 7f059cb5f700 1 --2- 172.21.15.123:0/2702477191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05980cd5e0 0x7f05980cda30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.253+0000 7f059cb5f700 1 --2- 172.21.15.123:0/2702477191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980d0f40 0x7f05980d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.253+0000 7f059cb5f700 1 -- 172.21.15.123:0/2702477191 >> 172.21.15.123:0/2702477191 conn(0x7f05980d2a60 msgr2=0x7f05980d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:11.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.253+0000 7f059cb5f700 1 -- 172.21.15.123:0/2702477191 shutdown_connections 2024-09-13T17:10:11.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.253+0000 7f059cb5f700 1 -- 172.21.15.123:0/2702477191 wait complete. 2024-09-13T17:10:11.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.253+0000 7f059cb5f700 1 Processor -- start 2024-09-13T17:10:11.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.253+0000 7f059cb5f700 1 -- start start 2024-09-13T17:10:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f059cb5f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980b58b0 0x7f05980c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f059cb5f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05980cd5e0 0x7f059815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f059cb5f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05980d0f40 0x7f05981f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f059cb5f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05980cce90 con 0x7f05980cd5e0 2024-09-13T17:10:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f059cb5f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05980c9fe0 con 0x7f05980d0f40 2024-09-13T17:10:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f059cb5f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05980cc030 con 0x7f05980b58b0 2024-09-13T17:10:11.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f0596ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05980cd5e0 0x7f059815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f05977fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980b58b0 0x7f05980c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f0596ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05980cd5e0 0x7f059815ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54678/0 (socket says 172.21.15.123:54678) 2024-09-13T17:10:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f0596ffd700 1 -- 172.21.15.123:0/2831725218 learned_addr learned my addr 172.21.15.123:0/2831725218 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f0597fff700 1 --2- 172.21.15.123:0/2831725218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05980d0f40 0x7f05981f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f0596ffd700 1 -- 172.21.15.123:0/2831725218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980b58b0 msgr2=0x7f05980c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f0596ffd700 1 --2- 172.21.15.123:0/2831725218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980b58b0 0x7f05980c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f0596ffd700 1 -- 172.21.15.123:0/2831725218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05980d0f40 msgr2=0x7f05981f2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f0596ffd700 1 --2- 172.21.15.123:0/2831725218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05980d0f40 0x7f05981f2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f0596ffd700 1 -- 172.21.15.123:0/2831725218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0590009b30 con 0x7f05980cd5e0 2024-09-13T17:10:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f05977fe700 1 --2- 172.21.15.123:0/2831725218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980b58b0 0x7f05980c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f0596ffd700 1 --2- 172.21.15.123:0/2831725218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05980cd5e0 0x7f059815ebe0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f058800c460 tx=0x7f058800c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f057ffff700 1 -- 172.21.15.123:0/2831725218 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588005cd0 con 0x7f05980cd5e0 2024-09-13T17:10:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f057ffff700 1 -- 172.21.15.123:0/2831725218 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0588005e30 con 0x7f05980cd5e0 2024-09-13T17:10:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f059cb5f700 1 -- 172.21.15.123:0/2831725218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05980cc310 con 0x7f05980cd5e0 2024-09-13T17:10:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f057ffff700 1 -- 172.21.15.123:0/2831725218 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05880072d0 con 0x7f05980cd5e0 2024-09-13T17:10:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.257+0000 7f059cb5f700 1 -- 172.21.15.123:0/2831725218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05980cc8d0 con 0x7f05980cd5e0 2024-09-13T17:10:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.261+0000 7f059cb5f700 1 -- 172.21.15.123:0/2831725218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059815ce70 con 0x7f05980cd5e0 2024-09-13T17:10:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.261+0000 7f057ffff700 1 -- 172.21.15.123:0/2831725218 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0588007430 con 0x7f05980cd5e0 2024-09-13T17:10:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.261+0000 7f057ffff700 1 --2- 172.21.15.123:0/2831725218 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0584066760 0x7f0584068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.261+0000 7f057ffff700 1 -- 172.21.15.123:0/2831725218 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0588083340 con 0x7f05980cd5e0 2024-09-13T17:10:11.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.261+0000 7f05977fe700 1 --2- 172.21.15.123:0/2831725218 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0584066760 0x7f0584068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.261+0000 7f05977fe700 1 --2- 172.21.15.123:0/2831725218 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0584066760 0x7f0584068c20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f05980719f0 tx=0x7f058c009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.269+0000 7f057ffff700 1 -- 172.21.15.123:0/2831725218 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0588050770 con 0x7f05980cd5e0 2024-09-13T17:10:11.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.449+0000 7f059cb5f700 1 -- 172.21.15.123:0/2831725218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f059808c250 con 0x7f05980cd5e0 2024-09-13T17:10:11.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.449+0000 7f057ffff700 1 -- 172.21.15.123:0/2831725218 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v86) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0588053d90 con 0x7f05980cd5e0 2024-09-13T17:10:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.453+0000 7f059cb5f700 1 -- 172.21.15.123:0/2831725218 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0584066760 msgr2=0x7f0584068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.453+0000 7f059cb5f700 1 --2- 172.21.15.123:0/2831725218 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0584066760 0x7f0584068c20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f05980719f0 tx=0x7f058c009240 comp rx=0 tx=0).stop 2024-09-13T17:10:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.453+0000 7f059cb5f700 1 -- 172.21.15.123:0/2831725218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05980cd5e0 msgr2=0x7f059815ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.453+0000 7f059cb5f700 1 --2- 172.21.15.123:0/2831725218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05980cd5e0 0x7f059815ebe0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f058800c460 tx=0x7f058800c770 comp rx=0 tx=0).stop 2024-09-13T17:10:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.453+0000 7f059cb5f700 1 -- 172.21.15.123:0/2831725218 shutdown_connections 2024-09-13T17:10:11.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.453+0000 7f059cb5f700 1 --2- 172.21.15.123:0/2831725218 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0584066760 0x7f0584068c20 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.453+0000 7f059cb5f700 1 --2- 172.21.15.123:0/2831725218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05980d0f40 0x7f05981f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.453+0000 7f059cb5f700 1 --2- 172.21.15.123:0/2831725218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05980cd5e0 0x7f059815ebe0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.453+0000 7f059cb5f700 1 --2- 172.21.15.123:0/2831725218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f05980b58b0 0x7f05980c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.453+0000 7f059cb5f700 1 -- 172.21.15.123:0/2831725218 >> 172.21.15.123:0/2831725218 conn(0x7f05980d2a60 msgr2=0x7f05980c84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:11.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.453+0000 7f059cb5f700 1 -- 172.21.15.123:0/2831725218 shutdown_connections 2024-09-13T17:10:11.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.453+0000 7f059cb5f700 1 -- 172.21.15.123:0/2831725218 wait complete. 2024-09-13T17:10:11.459 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:10:11.474 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2024-09-13T17:10:11.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:11.474 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:10:11.486 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[44355]: fuse finished with error 0 and tester_r 0 2024-09-13T17:10:11.487 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:10:11.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:11.487 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:10:11.609 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:10:11.609 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:11.618 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:11.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 Processor -- start 2024-09-13T17:10:11.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 -- start start 2024-09-13T17:10:11.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0640cec90 0x7ff0640adef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff0640cbd00 0x7ff0640cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06406d220 con 0x7ff0640ad9a0 2024-09-13T17:10:11.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06406d500 con 0x7ff0640cbd00 2024-09-13T17:10:11.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06406d7e0 con 0x7ff0640cec90 2024-09-13T17:10:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06909a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff0640cbd00 0x7ff0640cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06909a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff0640cbd00 0x7ff0640cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54694/0 (socket says 172.21.15.123:54694) 2024-09-13T17:10:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06909a700 1 -- 172.21.15.123:0/2473304612 learned_addr learned my addr 172.21.15.123:0/2473304612 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff068899700 1 --2- 172.21.15.123:0/2473304612 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0640cec90 0x7ff0640adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06909a700 1 -- 172.21.15.123:0/2473304612 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0640cec90 msgr2=0x7ff0640adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06909a700 1 --2- 172.21.15.123:0/2473304612 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0640cec90 0x7ff0640adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06909a700 1 -- 172.21.15.123:0/2473304612 >> v1:172.21.15.153:6789/0 conn(0x7ff0640ad9a0 legacy=0x7ff0640cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06909a700 1 -- 172.21.15.123:0/2473304612 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06406dac0 con 0x7ff0640cbd00 2024-09-13T17:10:11.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06909a700 1 --2- 172.21.15.123:0/2473304612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0640cbd00 0x7ff0640cc1b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff05c009910 tx=0x7ff05c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5302fcca863bd96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:11.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff0637fe700 1 -- 172.21.15.123:0/2473304612 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c011830 con 0x7ff0640cbd00 2024-09-13T17:10:11.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff0637fe700 1 -- 172.21.15.123:0/2473304612 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05c011990 con 0x7ff0640cbd00 2024-09-13T17:10:11.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff0637fe700 1 -- 172.21.15.123:0/2473304612 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c011d40 con 0x7ff0640cbd00 2024-09-13T17:10:11.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 -- 172.21.15.123:0/2473304612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0640cbd00 msgr2=0x7ff0640cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 --2- 172.21.15.123:0/2473304612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0640cbd00 0x7ff0640cc1b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff05c009910 tx=0x7ff05c009c20 comp rx=0 tx=0).stop 2024-09-13T17:10:11.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 -- 172.21.15.123:0/2473304612 shutdown_connections 2024-09-13T17:10:11.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 --2- 172.21.15.123:0/2473304612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0640cbd00 0x7ff0640cc1b0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 --2- 172.21.15.123:0/2473304612 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0640cec90 0x7ff0640adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 -- 172.21.15.123:0/2473304612 >> 172.21.15.123:0/2473304612 conn(0x7ff064066570 msgr2=0x7ff064066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:11.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 -- 172.21.15.123:0/2473304612 shutdown_connections 2024-09-13T17:10:11.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.769+0000 7ff06aafd700 1 -- 172.21.15.123:0/2473304612 wait complete. 2024-09-13T17:10:11.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff06aafd700 1 Processor -- start 2024-09-13T17:10:11.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff06aafd700 1 -- start start 2024-09-13T17:10:11.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff06aafd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0640ad9a0 0x7ff06414eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff06aafd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0640cbd00 0x7ff0640b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff06aafd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0640cec90 0x7ff06414fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff06aafd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0640a9f00 con 0x7ff0640cbd00 2024-09-13T17:10:11.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff06aafd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0640aa700 con 0x7ff0640cec90 2024-09-13T17:10:11.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff06aafd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff064151a50 con 0x7ff0640ad9a0 2024-09-13T17:10:11.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff063fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0640cbd00 0x7ff0640b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff068899700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0640ad9a0 0x7ff06414eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff063fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0640cbd00 0x7ff0640b2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54706/0 (socket says 172.21.15.123:54706) 2024-09-13T17:10:11.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff063fff700 1 -- 172.21.15.123:0/3705506667 learned_addr learned my addr 172.21.15.123:0/3705506667 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff068899700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0640ad9a0 0x7ff06414eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:45296/0 (socket says 172.21.15.123:45296) 2024-09-13T17:10:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff06909a700 1 --2- 172.21.15.123:0/3705506667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0640cec90 0x7ff06414fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff068899700 1 -- 172.21.15.123:0/3705506667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0640cec90 msgr2=0x7ff06414fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff068899700 1 --2- 172.21.15.123:0/3705506667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0640cec90 0x7ff06414fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff068899700 1 -- 172.21.15.123:0/3705506667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0640cbd00 msgr2=0x7ff0640b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff068899700 1 --2- 172.21.15.123:0/3705506667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0640cbd00 0x7ff0640b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff068899700 1 -- 172.21.15.123:0/3705506667 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c009570 con 0x7ff0640ad9a0 2024-09-13T17:10:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff063fff700 1 --2- 172.21.15.123:0/3705506667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0640cbd00 0x7ff0640b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.773+0000 7ff068899700 1 --2- 172.21.15.123:0/3705506667 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0640ad9a0 0x7ff06414eb90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00e870 tx=0x7ff04c00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.777+0000 7ff0617fa700 1 -- 172.21.15.123:0/3705506667 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c013680 con 0x7ff0640ad9a0 2024-09-13T17:10:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.777+0000 7ff0617fa700 1 -- 172.21.15.123:0/3705506667 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c0137e0 con 0x7ff0640ad9a0 2024-09-13T17:10:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.777+0000 7ff0617fa700 1 -- 172.21.15.123:0/3705506667 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c013b70 con 0x7ff0640ad9a0 2024-09-13T17:10:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.777+0000 7ff06aafd700 1 -- 172.21.15.123:0/3705506667 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff064151d30 con 0x7ff0640ad9a0 2024-09-13T17:10:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.777+0000 7ff06aafd700 1 -- 172.21.15.123:0/3705506667 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0641525d0 con 0x7ff0640ad9a0 2024-09-13T17:10:11.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.777+0000 7ff06aafd700 1 -- 172.21.15.123:0/3705506667 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff064066f20 con 0x7ff0640ad9a0 2024-09-13T17:10:11.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.777+0000 7ff0617fa700 1 -- 172.21.15.123:0/3705506667 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff04c013cd0 con 0x7ff0640ad9a0 2024-09-13T17:10:11.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.777+0000 7ff0617fa700 1 --2- 172.21.15.123:0/3705506667 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff044066730 0x7ff044068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.777+0000 7ff0617fa700 1 -- 172.21.15.123:0/3705506667 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff04c084770 con 0x7ff0640ad9a0 2024-09-13T17:10:11.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.777+0000 7ff063fff700 1 --2- 172.21.15.123:0/3705506667 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff044066730 0x7ff044068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.781+0000 7ff063fff700 1 --2- 172.21.15.123:0/3705506667 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff044066730 0x7ff044068bf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff064165490 tx=0x7ff054009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:11.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.785+0000 7ff0617fa700 1 -- 172.21.15.123:0/3705506667 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff04c051ae0 con 0x7ff0640ad9a0 2024-09-13T17:10:11.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.965+0000 7ff06aafd700 1 -- 172.21.15.123:0/3705506667 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0640cc1b0 con 0x7ff0640ad9a0 2024-09-13T17:10:11.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.969+0000 7ff0617fa700 1 -- 172.21.15.123:0/3705506667 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16608 (secure 0 0 0) 0x7ff04c021090 con 0x7ff0640ad9a0 2024-09-13T17:10:11.977 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:11.977 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:01.118924+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:58.436099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:59.120652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.973+0000 7ff06aafd700 1 -- 172.21.15.123:0/3705506667 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff044066730 msgr2=0x7ff044068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.973+0000 7ff06aafd700 1 --2- 172.21.15.123:0/3705506667 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff044066730 0x7ff044068bf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff064165490 tx=0x7ff054009040 comp rx=0 tx=0).stop 2024-09-13T17:10:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.973+0000 7ff06aafd700 1 -- 172.21.15.123:0/3705506667 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0640ad9a0 msgr2=0x7ff06414eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.973+0000 7ff06aafd700 1 --2- 172.21.15.123:0/3705506667 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0640ad9a0 0x7ff06414eb90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00e870 tx=0x7ff04c00eb80 comp rx=0 tx=0).stop 2024-09-13T17:10:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.973+0000 7ff06aafd700 1 -- 172.21.15.123:0/3705506667 shutdown_connections 2024-09-13T17:10:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.973+0000 7ff06aafd700 1 --2- 172.21.15.123:0/3705506667 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff044066730 0x7ff044068bf0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.973+0000 7ff06aafd700 1 --2- 172.21.15.123:0/3705506667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0640cec90 0x7ff06414fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.973+0000 7ff06aafd700 1 --2- 172.21.15.123:0/3705506667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0640cbd00 0x7ff0640b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.973+0000 7ff06aafd700 1 --2- 172.21.15.123:0/3705506667 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff0640ad9a0 0x7ff06414eb90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.973+0000 7ff06aafd700 1 -- 172.21.15.123:0/3705506667 >> 172.21.15.123:0/3705506667 conn(0x7ff064066570 msgr2=0x7ff0641556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.973+0000 7ff06aafd700 1 -- 172.21.15.123:0/3705506667 shutdown_connections 2024-09-13T17:10:11.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:11.973+0000 7ff06aafd700 1 -- 172.21.15.123:0/3705506667 wait complete. 2024-09-13T17:10:11.993 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:09:58.436099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:09:59.120652+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:10:11.993 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:10:12.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.101+0000 7ff4d563b700 1 Processor -- start 2024-09-13T17:10:12.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.101+0000 7ff4d563b700 1 -- start start 2024-09-13T17:10:12.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d563b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4d0158d90 0x7ff4d006a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d563b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff4d00b2fb0 0x7ff4d006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d563b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d00b35d0 con 0x7ff4d0159170 2024-09-13T17:10:12.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d563b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d00b3b90 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d563b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00b38b0 con 0x7ff4d0158d90 2024-09-13T17:10:12.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d4e3a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff4d00b2fb0 0x7ff4d006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d4e3a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff4d00b2fb0 0x7ff4d006a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60988/0 (socket says 172.21.15.123:60988) 2024-09-13T17:10:12.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d4e3a700 1 -- 172.21.15.123:0/1342088176 learned_addr learned my addr 172.21.15.123:0/1342088176 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:12.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4cffff700 1 --2- 172.21.15.123:0/1342088176 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4d0158d90 0x7ff4d006a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d4e3a700 1 -- 172.21.15.123:0/1342088176 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4d0158d90 msgr2=0x7ff4d006a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:12.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d4e3a700 1 --2- 172.21.15.123:0/1342088176 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4d0158d90 0x7ff4d006a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d4e3a700 1 -- 172.21.15.123:0/1342088176 >> v1:172.21.15.153:6789/0 conn(0x7ff4d0159170 legacy=0x7ff4d00b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d4e3a700 1 -- 172.21.15.123:0/1342088176 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0159610 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d4e3a700 1 --2- 172.21.15.123:0/1342088176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d00b2fb0 0x7ff4d006a7a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800d150 tx=0x7ff4c800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8c527e98c89ebd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:12.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4ceffd700 1 -- 172.21.15.123:0/1342088176 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8010070 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4ceffd700 1 -- 172.21.15.123:0/1342088176 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c800db00 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4ceffd700 1 -- 172.21.15.123:0/1342088176 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8016400 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d563b700 1 -- 172.21.15.123:0/1342088176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d00b2fb0 msgr2=0x7ff4d006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.105+0000 7ff4d563b700 1 --2- 172.21.15.123:0/1342088176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d00b2fb0 0x7ff4d006a7a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800d150 tx=0x7ff4c800d460 comp rx=0 tx=0).stop 2024-09-13T17:10:12.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.109+0000 7ff4d563b700 1 -- 172.21.15.123:0/1342088176 shutdown_connections 2024-09-13T17:10:12.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.109+0000 7ff4d563b700 1 --2- 172.21.15.123:0/1342088176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d00b2fb0 0x7ff4d006a7a0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.109+0000 7ff4d563b700 1 --2- 172.21.15.123:0/1342088176 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4d0158d90 0x7ff4d006a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.109+0000 7ff4d563b700 1 -- 172.21.15.123:0/1342088176 >> 172.21.15.123:0/1342088176 conn(0x7ff4d006f940 msgr2=0x7ff4d00b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:12.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.109+0000 7ff4d563b700 1 -- 172.21.15.123:0/1342088176 shutdown_connections 2024-09-13T17:10:12.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.109+0000 7ff4d563b700 1 -- 172.21.15.123:0/1342088176 wait complete. 2024-09-13T17:10:12.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.109+0000 7ff4d563b700 1 Processor -- start 2024-09-13T17:10:12.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.109+0000 7ff4d563b700 1 -- start start 2024-09-13T17:10:12.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.109+0000 7ff4d563b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d00b2fb0 0x7ff4d014f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.109+0000 7ff4d563b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4d0158d90 0x7ff4d01f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.109+0000 7ff4d563b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4d0159170 0x7ff4d00cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.109+0000 7ff4d563b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d01f21b0 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.109+0000 7ff4d563b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00cb7a0 con 0x7ff4d0159170 2024-09-13T17:10:12.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.109+0000 7ff4d563b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d01f2450 con 0x7ff4d0158d90 2024-09-13T17:10:12.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4cffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d00b2fb0 0x7ff4d014f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4cffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d00b2fb0 0x7ff4d014f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60996/0 (socket says 172.21.15.123:60996) 2024-09-13T17:10:12.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4cffff700 1 -- 172.21.15.123:0/1852414786 learned_addr learned my addr 172.21.15.123:0/1852414786 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:12.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4d4e3a700 1 --2- 172.21.15.123:0/1852414786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4d0159170 0x7ff4d00cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4cf7fe700 1 --2- 172.21.15.123:0/1852414786 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4d0158d90 0x7ff4d01f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4cffff700 1 -- 172.21.15.123:0/1852414786 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4d0158d90 msgr2=0x7ff4d01f1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4cffff700 1 --2- 172.21.15.123:0/1852414786 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4d0158d90 0x7ff4d01f1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4cffff700 1 -- 172.21.15.123:0/1852414786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4d0159170 msgr2=0x7ff4d00cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4cffff700 1 --2- 172.21.15.123:0/1852414786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4d0159170 0x7ff4d00cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4cffff700 1 -- 172.21.15.123:0/1852414786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c800bd40 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4cffff700 1 --2- 172.21.15.123:0/1852414786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d00b2fb0 0x7ff4d014f150 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000e9d0 tx=0x7ff4c000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:12.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4ccff9700 1 -- 172.21.15.123:0/1852414786 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0009720 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4ccff9700 1 -- 172.21.15.123:0/1852414786 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c000ee70 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4d563b700 1 -- 172.21.15.123:0/1852414786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d01f2730 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4ccff9700 1 -- 172.21.15.123:0/1852414786 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000ca50 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4d563b700 1 -- 172.21.15.123:0/1852414786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d00cba60 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4d563b700 1 -- 172.21.15.123:0/1852414786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d00cbc20 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.113+0000 7ff4ccff9700 1 -- 172.21.15.123:0/1852414786 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff4c000cbb0 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.117+0000 7ff4ccff9700 1 --2- 172.21.15.123:0/1852414786 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4b8066730 0x7ff4b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.117+0000 7ff4cf7fe700 1 --2- 172.21.15.123:0/1852414786 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4b8066730 0x7ff4b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.117+0000 7ff4ccff9700 1 -- 172.21.15.123:0/1852414786 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4c0084120 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.117+0000 7ff4cf7fe700 1 --2- 172.21.15.123:0/1852414786 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4b8066730 0x7ff4b8068bf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff4d015ba80 tx=0x7ff4bc009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:12.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.121+0000 7ff4ccff9700 1 -- 172.21.15.123:0/1852414786 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff4c0051480 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.289+0000 7ff4d563b700 1 -- 172.21.15.123:0/1852414786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4d00aeb80 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.293+0000 7ff4ccff9700 1 -- 172.21.15.123:0/1852414786 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4c000ce60 con 0x7ff4d00b2fb0 2024-09-13T17:10:12.298 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:10:12.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.293+0000 7ff4d563b700 1 -- 172.21.15.123:0/1852414786 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4b8066730 msgr2=0x7ff4b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.293+0000 7ff4d563b700 1 --2- 172.21.15.123:0/1852414786 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4b8066730 0x7ff4b8068bf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff4d015ba80 tx=0x7ff4bc009040 comp rx=0 tx=0).stop 2024-09-13T17:10:12.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.293+0000 7ff4d563b700 1 -- 172.21.15.123:0/1852414786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d00b2fb0 msgr2=0x7ff4d014f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.293+0000 7ff4d563b700 1 --2- 172.21.15.123:0/1852414786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d00b2fb0 0x7ff4d014f150 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000e9d0 tx=0x7ff4c000ece0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.293+0000 7ff4d563b700 1 -- 172.21.15.123:0/1852414786 shutdown_connections 2024-09-13T17:10:12.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.293+0000 7ff4d563b700 1 --2- 172.21.15.123:0/1852414786 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4b8066730 0x7ff4b8068bf0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.293+0000 7ff4d563b700 1 --2- 172.21.15.123:0/1852414786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4d0159170 0x7ff4d00cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.293+0000 7ff4d563b700 1 --2- 172.21.15.123:0/1852414786 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4d0158d90 0x7ff4d01f1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.293+0000 7ff4d563b700 1 --2- 172.21.15.123:0/1852414786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d00b2fb0 0x7ff4d014f150 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.293+0000 7ff4d563b700 1 -- 172.21.15.123:0/1852414786 >> 172.21.15.123:0/1852414786 conn(0x7ff4d006f940 msgr2=0x7ff4d00b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.293+0000 7ff4d563b700 1 -- 172.21.15.123:0/1852414786 shutdown_connections 2024-09-13T17:10:12.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.293+0000 7ff4d563b700 1 -- 172.21.15.123:0/1852414786 wait complete. 2024-09-13T17:10:12.316 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:10:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.425+0000 7f19391ae700 1 Processor -- start 2024-09-13T17:10:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.425+0000 7f19391ae700 1 -- start start 2024-09-13T17:10:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f19391ae700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1934154f50 0x7f19340d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f19391ae700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f193406f280 0x7f193406f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f19391ae700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193406fc20 con 0x7f193415b0f0 2024-09-13T17:10:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f19391ae700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19340cc650 con 0x7f1934154f50 2024-09-13T17:10:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f19391ae700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19340cf4e0 con 0x7f193406f280 2024-09-13T17:10:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f1933fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1934154f50 0x7f19340d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f19337fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f193406f280 0x7f193406f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f1933fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1934154f50 0x7f19340d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:48946/0 (socket says 172.21.15.123:48946) 2024-09-13T17:10:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f19337fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f193406f280 0x7f193406f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:35840/0 (socket says 172.21.15.123:35840) 2024-09-13T17:10:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f19389ad700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f193415b0f0 0x7f193415b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:45068/0 (socket says 172.21.15.123:45068) 2024-09-13T17:10:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f19337fe700 1 -- 172.21.15.123:0/547866446 learned_addr learned my addr 172.21.15.123:0/547866446 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f19337fe700 1 -- 172.21.15.123:0/547866446 >> v2:172.21.15.153:3300/0 conn(0x7f1934154f50 msgr2=0x7f19340d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f19337fe700 1 --2- 172.21.15.123:0/547866446 >> v2:172.21.15.153:3300/0 conn(0x7f1934154f50 0x7f19340d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f19337fe700 1 -- 172.21.15.123:0/547866446 >> v1:172.21.15.153:6789/0 conn(0x7f193415b0f0 legacy=0x7f193415b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f19337fe700 1 -- 172.21.15.123:0/547866446 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193415be20 con 0x7f193406f280 2024-09-13T17:10:12.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f19337fe700 1 --2- 172.21.15.123:0/547866446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f193406f280 0x7f193406f6e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1928009910 tx=0x7f1928009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=889403dc38c5093b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:12.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f1932ffd700 1 -- 172.21.15.123:0/547866446 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1928011830 con 0x7f193406f280 2024-09-13T17:10:12.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f1932ffd700 1 -- 172.21.15.123:0/547866446 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1928011990 con 0x7f193406f280 2024-09-13T17:10:12.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.429+0000 7f1932ffd700 1 -- 172.21.15.123:0/547866446 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1928011d40 con 0x7f193406f280 2024-09-13T17:10:12.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.433+0000 7f19391ae700 1 -- 172.21.15.123:0/547866446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f193406f280 msgr2=0x7f193406f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.433+0000 7f19391ae700 1 --2- 172.21.15.123:0/547866446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f193406f280 0x7f193406f6e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1928009910 tx=0x7f1928009c20 comp rx=0 tx=0).stop 2024-09-13T17:10:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.433+0000 7f19391ae700 1 -- 172.21.15.123:0/547866446 shutdown_connections 2024-09-13T17:10:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.433+0000 7f19391ae700 1 --2- 172.21.15.123:0/547866446 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f193406f280 0x7f193406f6e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.433+0000 7f19391ae700 1 --2- 172.21.15.123:0/547866446 >> v2:172.21.15.153:3300/0 conn(0x7f1934154f50 0x7f19340d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.433+0000 7f19391ae700 1 -- 172.21.15.123:0/547866446 >> 172.21.15.123:0/547866446 conn(0x7f1934066780 msgr2=0x7f19340718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.433+0000 7f19391ae700 1 -- 172.21.15.123:0/547866446 shutdown_connections 2024-09-13T17:10:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.433+0000 7f19391ae700 1 -- 172.21.15.123:0/547866446 wait complete. 2024-09-13T17:10:12.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.433+0000 7f19391ae700 1 Processor -- start 2024-09-13T17:10:12.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.433+0000 7f19391ae700 1 -- start start 2024-09-13T17:10:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f19391ae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934154f50 0x7f19341593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f19391ae700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f193415b0f0 0x7f19341462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f19391ae700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19340c5430 0x7f19341f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f19391ae700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193415a650 con 0x7f1934154f50 2024-09-13T17:10:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f19391ae700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19341599d0 con 0x7f19340c5430 2024-09-13T17:10:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f19391ae700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1934159cb0 con 0x7f193415b0f0 2024-09-13T17:10:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f1933fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934154f50 0x7f19341593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f1933fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934154f50 0x7f19341593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60998/0 (socket says 172.21.15.123:60998) 2024-09-13T17:10:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f1933fff700 1 -- 172.21.15.123:0/4018378413 learned_addr learned my addr 172.21.15.123:0/4018378413 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f19389ad700 1 --2- 172.21.15.123:0/4018378413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19340c5430 0x7f19341f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f19337fe700 1 --2- 172.21.15.123:0/4018378413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f193415b0f0 0x7f19341462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f1933fff700 1 -- 172.21.15.123:0/4018378413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f193415b0f0 msgr2=0x7f19341462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f1933fff700 1 --2- 172.21.15.123:0/4018378413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f193415b0f0 0x7f19341462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f1933fff700 1 -- 172.21.15.123:0/4018378413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19340c5430 msgr2=0x7f19341f08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f1933fff700 1 --2- 172.21.15.123:0/4018378413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19340c5430 0x7f19341f08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f1933fff700 1 -- 172.21.15.123:0/4018378413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1928009570 con 0x7f1934154f50 2024-09-13T17:10:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f1933fff700 1 --2- 172.21.15.123:0/4018378413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934154f50 0x7f19341593f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f192400efc0 tx=0x7f192400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f1930ff9700 1 -- 172.21.15.123:0/4018378413 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400cd10 con 0x7f1934154f50 2024-09-13T17:10:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f1930ff9700 1 -- 172.21.15.123:0/4018378413 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192400f040 con 0x7f1934154f50 2024-09-13T17:10:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f19391ae700 1 -- 172.21.15.123:0/4018378413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1934159f90 con 0x7f1934154f50 2024-09-13T17:10:12.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f1930ff9700 1 -- 172.21.15.123:0/4018378413 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19240146a0 con 0x7f1934154f50 2024-09-13T17:10:12.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.437+0000 7f19391ae700 1 -- 172.21.15.123:0/4018378413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19341467f0 con 0x7f1934154f50 2024-09-13T17:10:12.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.441+0000 7f19391ae700 1 -- 172.21.15.123:0/4018378413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193406f6e0 con 0x7f1934154f50 2024-09-13T17:10:12.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.441+0000 7f1930ff9700 1 -- 172.21.15.123:0/4018378413 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1924014800 con 0x7f1934154f50 2024-09-13T17:10:12.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.441+0000 7f1930ff9700 1 --2- 172.21.15.123:0/4018378413 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1920066730 0x7f1920068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.441+0000 7f19337fe700 1 --2- 172.21.15.123:0/4018378413 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1920066730 0x7f1920068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.441+0000 7f1930ff9700 1 -- 172.21.15.123:0/4018378413 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1924084b10 con 0x7f1934154f50 2024-09-13T17:10:12.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.441+0000 7f19337fe700 1 --2- 172.21.15.123:0/4018378413 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1920066730 0x7f1920068bf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f19340cda60 tx=0x7f1928008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:12.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.449+0000 7f1930ff9700 1 -- 172.21.15.123:0/4018378413 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1924051d50 con 0x7f1934154f50 2024-09-13T17:10:12.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.617+0000 7f19391ae700 1 -- 172.21.15.123:0/4018378413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f193415a8c0 con 0x7f1934154f50 2024-09-13T17:10:12.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.617+0000 7f1930ff9700 1 -- 172.21.15.123:0/4018378413 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1924055370 con 0x7f1934154f50 2024-09-13T17:10:12.623 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:10:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.621+0000 7f19391ae700 1 -- 172.21.15.123:0/4018378413 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1920066730 msgr2=0x7f1920068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.621+0000 7f19391ae700 1 --2- 172.21.15.123:0/4018378413 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1920066730 0x7f1920068bf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f19340cda60 tx=0x7f1928008030 comp rx=0 tx=0).stop 2024-09-13T17:10:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.621+0000 7f19391ae700 1 -- 172.21.15.123:0/4018378413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934154f50 msgr2=0x7f19341593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.621+0000 7f19391ae700 1 --2- 172.21.15.123:0/4018378413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934154f50 0x7f19341593f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f192400efc0 tx=0x7f192400c3a0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.621+0000 7f19391ae700 1 -- 172.21.15.123:0/4018378413 shutdown_connections 2024-09-13T17:10:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.621+0000 7f19391ae700 1 --2- 172.21.15.123:0/4018378413 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1920066730 0x7f1920068bf0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.621+0000 7f19391ae700 1 --2- 172.21.15.123:0/4018378413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19340c5430 0x7f19341f08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.621+0000 7f19391ae700 1 --2- 172.21.15.123:0/4018378413 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f193415b0f0 0x7f19341462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.621+0000 7f19391ae700 1 --2- 172.21.15.123:0/4018378413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1934154f50 0x7f19341593f0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.621+0000 7f19391ae700 1 -- 172.21.15.123:0/4018378413 >> 172.21.15.123:0/4018378413 conn(0x7f1934066780 msgr2=0x7f193406dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:12.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.621+0000 7f19391ae700 1 -- 172.21.15.123:0/4018378413 shutdown_connections 2024-09-13T17:10:12.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.621+0000 7f19391ae700 1 -- 172.21.15.123:0/4018378413 wait complete. 2024-09-13T17:10:12.642 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:10:12.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.757+0000 7fadeb1f8700 1 Processor -- start 2024-09-13T17:10:12.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.757+0000 7fadeb1f8700 1 -- start start 2024-09-13T17:10:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.757+0000 7fadeb1f8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faddc0536b0 0x7faddc0eb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.757+0000 7fadeb1f8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faddc0520d0 con 0x7faddc0e1910 2024-09-13T17:10:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.757+0000 7fadeb1f8700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faddc057680 con 0x7faddc052560 2024-09-13T17:10:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.757+0000 7fadeb1f8700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc0517a0 con 0x7faddc0536b0 2024-09-13T17:10:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.757+0000 7fadea1f6700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7faddc0e1910 0x7faddc056f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35830/0 (socket says 172.21.15.123:35830) 2024-09-13T17:10:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.757+0000 7fadea1f6700 1 -- 172.21.15.123:0/3327701332 learned_addr learned my addr 172.21.15.123:0/3327701332 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.757+0000 7fadea9f7700 1 --2- 172.21.15.123:0/3327701332 >> v2:172.21.15.153:3300/0 conn(0x7faddc0536b0 0x7faddc0eb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.757+0000 7fade91f4700 1 -- 172.21.15.123:0/3327701332 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077801966 0 0) 0x7faddc0520d0 con 0x7faddc0e1910 2024-09-13T17:10:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fade91f4700 1 -- 172.21.15.123:0/3327701332 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd00035d0 con 0x7faddc0e1910 2024-09-13T17:10:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fadea9f7700 1 -- 172.21.15.123:0/3327701332 >> v1:172.21.15.153:6789/0 conn(0x7faddc052560 legacy=0x7faddc052fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fadea9f7700 1 -- 172.21.15.123:0/3327701332 >> v1:172.21.15.123:6789/0 conn(0x7faddc0e1910 legacy=0x7faddc056f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fadea9f7700 1 -- 172.21.15.123:0/3327701332 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc051a80 con 0x7faddc0536b0 2024-09-13T17:10:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fadea9f7700 1 --2- 172.21.15.123:0/3327701332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faddc0536b0 0x7faddc0eb7f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fade4000b60 tx=0x7fade4069900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1718787432efb68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fade91f4700 1 -- 172.21.15.123:0/3327701332 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40675b0 con 0x7faddc0536b0 2024-09-13T17:10:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fade91f4700 1 -- 172.21.15.123:0/3327701332 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade4073f10 con 0x7faddc0536b0 2024-09-13T17:10:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fade91f4700 1 -- 172.21.15.123:0/3327701332 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40742c0 con 0x7faddc0536b0 2024-09-13T17:10:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fadeb1f8700 1 -- 172.21.15.123:0/3327701332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faddc0536b0 msgr2=0x7faddc0eb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fadeb1f8700 1 --2- 172.21.15.123:0/3327701332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faddc0536b0 0x7faddc0eb7f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fade4000b60 tx=0x7fade4069900 comp rx=0 tx=0).stop 2024-09-13T17:10:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fadeb1f8700 1 -- 172.21.15.123:0/3327701332 shutdown_connections 2024-09-13T17:10:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fadeb1f8700 1 --2- 172.21.15.123:0/3327701332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faddc0536b0 0x7faddc0eb7f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fadeb1f8700 1 -- 172.21.15.123:0/3327701332 >> 172.21.15.123:0/3327701332 conn(0x7faddc01fbf0 msgr2=0x7faddc056860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fadeb1f8700 1 -- 172.21.15.123:0/3327701332 shutdown_connections 2024-09-13T17:10:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.761+0000 7fadeb1f8700 1 -- 172.21.15.123:0/3327701332 wait complete. 2024-09-13T17:10:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadeb1f8700 1 Processor -- start 2024-09-13T17:10:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadeb1f8700 1 -- start start 2024-09-13T17:10:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadeb1f8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faddc052560 0x7faddc176460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadeb1f8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faddc0536b0 0x7faddc0dccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadeb1f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faddc0e1910 0x7faddc0e0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadeb1f8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc03aae0 con 0x7faddc052560 2024-09-13T17:10:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadeb1f8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc03ad50 con 0x7faddc0e1910 2024-09-13T17:10:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadeb1f8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc03b030 con 0x7faddc0536b0 2024-09-13T17:10:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadea1f6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faddc052560 0x7faddc176460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadea1f6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faddc052560 0x7faddc176460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32770/0 (socket says 172.21.15.123:32770) 2024-09-13T17:10:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadea1f6700 1 -- 172.21.15.123:0/1194487806 learned_addr learned my addr 172.21.15.123:0/1194487806 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadea9f7700 1 --2- 172.21.15.123:0/1194487806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faddc0e1910 0x7faddc0e0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fade99f5700 1 --2- 172.21.15.123:0/1194487806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faddc0536b0 0x7faddc0dccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadea1f6700 1 -- 172.21.15.123:0/1194487806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faddc0536b0 msgr2=0x7faddc0dccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadea1f6700 1 --2- 172.21.15.123:0/1194487806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faddc0536b0 0x7faddc0dccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadea1f6700 1 -- 172.21.15.123:0/1194487806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faddc0e1910 msgr2=0x7faddc0e0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadea1f6700 1 --2- 172.21.15.123:0/1194487806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faddc0e1910 0x7faddc0e0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadea1f6700 1 -- 172.21.15.123:0/1194487806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade404f5c0 con 0x7faddc052560 2024-09-13T17:10:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadea1f6700 1 --2- 172.21.15.123:0/1194487806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faddc052560 0x7faddc176460 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fade000c4d0 tx=0x7fade000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7faddaffd700 1 -- 172.21.15.123:0/1194487806 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0005d90 con 0x7faddc052560 2024-09-13T17:10:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7faddaffd700 1 -- 172.21.15.123:0/1194487806 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade00070d0 con 0x7faddc052560 2024-09-13T17:10:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadeb1f8700 1 -- 172.21.15.123:0/1194487806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc03b310 con 0x7faddc052560 2024-09-13T17:10:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7faddaffd700 1 -- 172.21.15.123:0/1194487806 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0007480 con 0x7faddc052560 2024-09-13T17:10:12.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.765+0000 7fadeb1f8700 1 -- 172.21.15.123:0/1194487806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc1769a0 con 0x7faddc052560 2024-09-13T17:10:12.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.769+0000 7fadeb1f8700 1 -- 172.21.15.123:0/1194487806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc052fa0 con 0x7faddc052560 2024-09-13T17:10:12.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.769+0000 7faddaffd700 1 -- 172.21.15.123:0/1194487806 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fade00075e0 con 0x7faddc052560 2024-09-13T17:10:12.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.769+0000 7faddaffd700 1 --2- 172.21.15.123:0/1194487806 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fadc8066730 0x7fadc8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:12.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.769+0000 7faddaffd700 1 -- 172.21.15.123:0/1194487806 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fade00835f0 con 0x7faddc052560 2024-09-13T17:10:12.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.769+0000 7fade99f5700 1 --2- 172.21.15.123:0/1194487806 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fadc8066730 0x7fadc8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:12.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.769+0000 7fade99f5700 1 --2- 172.21.15.123:0/1194487806 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fadc8066730 0x7fadc8068bf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7faddc04c9f0 tx=0x7fadd4009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:12.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.781+0000 7faddaffd700 1 -- 172.21.15.123:0/1194487806 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fade00508e0 con 0x7faddc052560 2024-09-13T17:10:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.953+0000 7fadeb1f8700 1 -- 172.21.15.123:0/1194487806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faddc054120 con 0x7faddc052560 2024-09-13T17:10:12.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.953+0000 7faddaffd700 1 -- 172.21.15.123:0/1194487806 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fade0053f00 con 0x7faddc052560 2024-09-13T17:10:12.959 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:10:12.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.953+0000 7fadeb1f8700 1 -- 172.21.15.123:0/1194487806 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fadc8066730 msgr2=0x7fadc8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.953+0000 7fadeb1f8700 1 --2- 172.21.15.123:0/1194487806 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fadc8066730 0x7fadc8068bf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7faddc04c9f0 tx=0x7fadd4009040 comp rx=0 tx=0).stop 2024-09-13T17:10:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.953+0000 7fadeb1f8700 1 -- 172.21.15.123:0/1194487806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faddc052560 msgr2=0x7faddc176460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.953+0000 7fadeb1f8700 1 --2- 172.21.15.123:0/1194487806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faddc052560 0x7faddc176460 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fade000c4d0 tx=0x7fade000c7e0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.953+0000 7fadeb1f8700 1 -- 172.21.15.123:0/1194487806 shutdown_connections 2024-09-13T17:10:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.953+0000 7fadeb1f8700 1 --2- 172.21.15.123:0/1194487806 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fadc8066730 0x7fadc8068bf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.953+0000 7fadeb1f8700 1 --2- 172.21.15.123:0/1194487806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faddc0e1910 0x7faddc0e0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.953+0000 7fadeb1f8700 1 --2- 172.21.15.123:0/1194487806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faddc0536b0 0x7faddc0dccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.953+0000 7fadeb1f8700 1 --2- 172.21.15.123:0/1194487806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faddc052560 0x7faddc176460 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.953+0000 7fadeb1f8700 1 -- 172.21.15.123:0/1194487806 >> 172.21.15.123:0/1194487806 conn(0x7faddc01fbf0 msgr2=0x7faddc0e4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.953+0000 7fadeb1f8700 1 -- 172.21.15.123:0/1194487806 shutdown_connections 2024-09-13T17:10:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:12.953+0000 7fadeb1f8700 1 -- 172.21.15.123:0/1194487806 wait complete. 2024-09-13T17:10:12.974 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:10:13.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4d1706700 1 Processor -- start 2024-09-13T17:10:13.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4d1706700 1 -- start start 2024-09-13T17:10:13.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4d1706700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa4cc0c8cd0 0x7fa4cc0ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4d1706700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4cc0c93b0 con 0x7fa4cc0c1280 2024-09-13T17:10:13.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4d1706700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4cc0cc580 con 0x7fa4cc0cb090 2024-09-13T17:10:13.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4d1706700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4cc0cae90 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4d0f05700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa4cc0c1280 0x7fa4cc0c1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35846/0 (socket says 172.21.15.123:35846) 2024-09-13T17:10:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4d0f05700 1 -- 172.21.15.123:0/1819938970 learned_addr learned my addr 172.21.15.123:0/1819938970 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4cb7fe700 1 --2- 172.21.15.123:0/1819938970 >> v2:172.21.15.153:3300/0 conn(0x7fa4cc0c8cd0 0x7fa4cc0ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4caffd700 1 -- 172.21.15.123:0/1819938970 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968066425 0 0) 0x7fa4cc0c93b0 con 0x7fa4cc0c1280 2024-09-13T17:10:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4caffd700 1 -- 172.21.15.123:0/1819938970 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4b80035d0 con 0x7fa4cc0c1280 2024-09-13T17:10:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4caffd700 1 -- 172.21.15.123:0/1819938970 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2021927316 0 0) 0x7fa4b80035d0 con 0x7fa4cc0c1280 2024-09-13T17:10:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4cb7fe700 1 -- 172.21.15.123:0/1819938970 >> v1:172.21.15.153:6789/0 conn(0x7fa4cc0cb090 legacy=0x7fa4cc0cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4cb7fe700 1 -- 172.21.15.123:0/1819938970 >> v1:172.21.15.123:6789/0 conn(0x7fa4cc0c1280 legacy=0x7fa4cc0c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.081+0000 7fa4cb7fe700 1 -- 172.21.15.123:0/1819938970 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc0cd100 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.085+0000 7fa4cb7fe700 1 --2- 172.21.15.123:0/1819938970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4cc0c8cd0 0x7fa4cc0ca950 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009850 tx=0x7fa4bc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6f0a68806cb8abf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.085+0000 7fa4caffd700 1 -- 172.21.15.123:0/1819938970 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40019f0 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.085+0000 7fa4caffd700 1 -- 172.21.15.123:0/1819938970 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc004030 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.085+0000 7fa4caffd700 1 -- 172.21.15.123:0/1819938970 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc0043a0 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.085+0000 7fa4d1706700 1 -- 172.21.15.123:0/1819938970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4cc0c8cd0 msgr2=0x7fa4cc0ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.085+0000 7fa4d1706700 1 --2- 172.21.15.123:0/1819938970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4cc0c8cd0 0x7fa4cc0ca950 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009850 tx=0x7fa4bc009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:13.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.085+0000 7fa4d1706700 1 -- 172.21.15.123:0/1819938970 shutdown_connections 2024-09-13T17:10:13.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.085+0000 7fa4d1706700 1 --2- 172.21.15.123:0/1819938970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4cc0c8cd0 0x7fa4cc0ca950 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.085+0000 7fa4d1706700 1 -- 172.21.15.123:0/1819938970 >> 172.21.15.123:0/1819938970 conn(0x7fa4cc0b01d0 msgr2=0x7fa4cc0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:13.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.085+0000 7fa4d1706700 1 -- 172.21.15.123:0/1819938970 shutdown_connections 2024-09-13T17:10:13.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.085+0000 7fa4d1706700 1 -- 172.21.15.123:0/1819938970 wait complete. 2024-09-13T17:10:13.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.085+0000 7fa4d1706700 1 Processor -- start 2024-09-13T17:10:13.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.085+0000 7fa4d1706700 1 -- start start 2024-09-13T17:10:13.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4d1706700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4cc0c1280 0x7fa4cc0c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4d1706700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4cc0c8cd0 0x7fa4cc0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4d1706700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4cc0cb090 0x7fa4cc0c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4d1706700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0c7140 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4d1706700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0c7420 con 0x7fa4cc0cb090 2024-09-13T17:10:13.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4d1706700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0c7700 con 0x7fa4cc0c1280 2024-09-13T17:10:13.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4cb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4cc0c8cd0 0x7fa4cc0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4cb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4cc0c8cd0 0x7fa4cc0b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32784/0 (socket says 172.21.15.123:32784) 2024-09-13T17:10:13.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4cb7fe700 1 -- 172.21.15.123:0/1005166401 learned_addr learned my addr 172.21.15.123:0/1005166401 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:13.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4cbfff700 1 --2- 172.21.15.123:0/1005166401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4cc0c1280 0x7fa4cc0c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4d0f05700 1 --2- 172.21.15.123:0/1005166401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4cc0cb090 0x7fa4cc0c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4cb7fe700 1 -- 172.21.15.123:0/1005166401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4cc0c1280 msgr2=0x7fa4cc0c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4cb7fe700 1 --2- 172.21.15.123:0/1005166401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4cc0c1280 0x7fa4cc0c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4cb7fe700 1 -- 172.21.15.123:0/1005166401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4cc0cb090 msgr2=0x7fa4cc0c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4cb7fe700 1 --2- 172.21.15.123:0/1005166401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4cc0cb090 0x7fa4cc0c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4cb7fe700 1 -- 172.21.15.123:0/1005166401 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc0094b0 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4cb7fe700 1 --2- 172.21.15.123:0/1005166401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4cc0c8cd0 0x7fa4cc0b39b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0090b0 tx=0x7fa4bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:13.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4c8ff9700 1 -- 172.21.15.123:0/1005166401 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc011630 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4c8ff9700 1 -- 172.21.15.123:0/1005166401 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc01f070 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4d1706700 1 -- 172.21.15.123:0/1005166401 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4cc0c79e0 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4c8ff9700 1 -- 172.21.15.123:0/1005166401 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc0119f0 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4d1706700 1 -- 172.21.15.123:0/1005166401 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4cc0c4820 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.089+0000 7fa4d1706700 1 -- 172.21.15.123:0/1005166401 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4cc0c7f00 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.093+0000 7fa4c8ff9700 1 -- 172.21.15.123:0/1005166401 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa4bc011b50 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.093+0000 7fa4c8ff9700 1 --2- 172.21.15.123:0/1005166401 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa4ac066730 0x7fa4ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.093+0000 7fa4cbfff700 1 --2- 172.21.15.123:0/1005166401 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa4ac066730 0x7fa4ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.093+0000 7fa4c8ff9700 1 -- 172.21.15.123:0/1005166401 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4bc021070 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.093+0000 7fa4cbfff700 1 --2- 172.21.15.123:0/1005166401 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa4ac066730 0x7fa4ac068bf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40018a0 tx=0x7fa4b4009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:13.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.097+0000 7fa4c8ff9700 1 -- 172.21.15.123:0/1005166401 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa4cc0c7f00 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.281+0000 7fa4d1706700 1 -- 172.21.15.123:0/1005166401 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa4cc0c7f00 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.281+0000 7fa4c8ff9700 1 -- 172.21.15.123:0/1005166401 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v86) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa4cc0c7f00 con 0x7fa4cc0c8cd0 2024-09-13T17:10:13.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.285+0000 7fa4d1706700 1 -- 172.21.15.123:0/1005166401 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa4ac066730 msgr2=0x7fa4ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.285+0000 7fa4d1706700 1 --2- 172.21.15.123:0/1005166401 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa4ac066730 0x7fa4ac068bf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40018a0 tx=0x7fa4b4009040 comp rx=0 tx=0).stop 2024-09-13T17:10:13.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.285+0000 7fa4d1706700 1 -- 172.21.15.123:0/1005166401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4cc0c8cd0 msgr2=0x7fa4cc0b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.285+0000 7fa4d1706700 1 --2- 172.21.15.123:0/1005166401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4cc0c8cd0 0x7fa4cc0b39b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0090b0 tx=0x7fa4bc004770 comp rx=0 tx=0).stop 2024-09-13T17:10:13.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.285+0000 7fa4d1706700 1 -- 172.21.15.123:0/1005166401 shutdown_connections 2024-09-13T17:10:13.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.285+0000 7fa4d1706700 1 --2- 172.21.15.123:0/1005166401 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa4ac066730 0x7fa4ac068bf0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.285+0000 7fa4d1706700 1 --2- 172.21.15.123:0/1005166401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4cc0cb090 0x7fa4cc0c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.285+0000 7fa4d1706700 1 --2- 172.21.15.123:0/1005166401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4cc0c8cd0 0x7fa4cc0b39b0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.285+0000 7fa4d1706700 1 --2- 172.21.15.123:0/1005166401 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4cc0c1280 0x7fa4cc0c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.285+0000 7fa4d1706700 1 -- 172.21.15.123:0/1005166401 >> 172.21.15.123:0/1005166401 conn(0x7fa4cc0b01d0 msgr2=0x7fa4cc0cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:13.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.285+0000 7fa4d1706700 1 -- 172.21.15.123:0/1005166401 shutdown_connections 2024-09-13T17:10:13.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.285+0000 7fa4d1706700 1 -- 172.21.15.123:0/1005166401 wait complete. 2024-09-13T17:10:13.293 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:10:13.304 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-09-13T17:10:13.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:13.305 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:10:13.321 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33611]: fuse finished with error 0 and tester_r 0 2024-09-13T17:10:13.323 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:10:13.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:13.323 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:10:13.366 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:10:13.367 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:13.374 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:10:13.374 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:10:13.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:13.375 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:10:13.381 INFO:teuthology.orchestra.run.smithi123.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T17:10:13.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:10:13.382 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:10:13.382 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:13.415 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:10:13.415 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:10:13.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:13.416 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:10:13.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:10:13.423 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T17:10:13.423 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:13.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.537+0000 7f654bfff700 1 Processor -- start 2024-09-13T17:10:13.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.537+0000 7f654bfff700 1 -- start start 2024-09-13T17:10:13.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.537+0000 7f654bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f654c0ce1c0 0x7f654c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.537+0000 7f654bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f654c0d14f0 0x7f654c0b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.537+0000 7f654bfff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654c0cea60 con 0x7f654c15cc00 2024-09-13T17:10:13.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.537+0000 7f654bfff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654c0d1960 con 0x7f654c0d14f0 2024-09-13T17:10:13.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.537+0000 7f654bfff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654c0ce780 con 0x7f654c0ce1c0 2024-09-13T17:10:13.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.537+0000 7f654b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f654c0d14f0 0x7f654c0b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.537+0000 7f654b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f654c0d14f0 0x7f654c0b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32800/0 (socket says 172.21.15.123:32800) 2024-09-13T17:10:13.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.537+0000 7f654affd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f654c15cc00 0x7f654c0d0790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:45088/0 (socket says 172.21.15.123:45088) 2024-09-13T17:10:13.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.537+0000 7f654b7fe700 1 -- 172.21.15.123:0/1663827764 learned_addr learned my addr 172.21.15.123:0/1663827764 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:13.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.537+0000 7f6543fff700 1 --2- 172.21.15.123:0/1663827764 >> v2:172.21.15.153:3300/0 conn(0x7f654c0ce1c0 0x7f654c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654b7fe700 1 -- 172.21.15.123:0/1663827764 >> v2:172.21.15.153:3300/0 conn(0x7f654c0ce1c0 msgr2=0x7f654c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:13.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654b7fe700 1 --2- 172.21.15.123:0/1663827764 >> v2:172.21.15.153:3300/0 conn(0x7f654c0ce1c0 0x7f654c0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654b7fe700 1 -- 172.21.15.123:0/1663827764 >> v1:172.21.15.153:6789/0 conn(0x7f654c15cc00 legacy=0x7f654c0d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654b7fe700 1 -- 172.21.15.123:0/1663827764 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c0af710 con 0x7f654c0d14f0 2024-09-13T17:10:13.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654b7fe700 1 --2- 172.21.15.123:0/1663827764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c0d14f0 0x7f654c0b01f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f654c160750 tx=0x7f654400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65740c9eb60271a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:13.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654a7fc700 1 -- 172.21.15.123:0/1663827764 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654400e070 con 0x7f654c0d14f0 2024-09-13T17:10:13.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654a7fc700 1 -- 172.21.15.123:0/1663827764 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654400b910 con 0x7f654c0d14f0 2024-09-13T17:10:13.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654a7fc700 1 -- 172.21.15.123:0/1663827764 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654400bcc0 con 0x7f654c0d14f0 2024-09-13T17:10:13.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654bfff700 1 -- 172.21.15.123:0/1663827764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c0d14f0 msgr2=0x7f654c0b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654bfff700 1 --2- 172.21.15.123:0/1663827764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c0d14f0 0x7f654c0b01f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f654c160750 tx=0x7f654400b330 comp rx=0 tx=0).stop 2024-09-13T17:10:13.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654bfff700 1 -- 172.21.15.123:0/1663827764 shutdown_connections 2024-09-13T17:10:13.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654bfff700 1 --2- 172.21.15.123:0/1663827764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c0d14f0 0x7f654c0b01f0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654bfff700 1 --2- 172.21.15.123:0/1663827764 >> v2:172.21.15.153:3300/0 conn(0x7f654c0ce1c0 0x7f654c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654bfff700 1 -- 172.21.15.123:0/1663827764 >> 172.21.15.123:0/1663827764 conn(0x7f654c0d2a80 msgr2=0x7f654c0d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:13.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654bfff700 1 -- 172.21.15.123:0/1663827764 shutdown_connections 2024-09-13T17:10:13.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654bfff700 1 -- 172.21.15.123:0/1663827764 wait complete. 2024-09-13T17:10:13.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654bfff700 1 Processor -- start 2024-09-13T17:10:13.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.541+0000 7f654bfff700 1 -- start start 2024-09-13T17:10:13.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c0ce1c0 0x7f654c14c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654c0d14f0 0x7f654c160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c15cc00 0x7f654c0c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654bfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0b3d30 con 0x7f654c0ce1c0 2024-09-13T17:10:13.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654bfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c1605a0 con 0x7f654c0d14f0 2024-09-13T17:10:13.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654bfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0ca000 con 0x7f654c15cc00 2024-09-13T17:10:13.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c0ce1c0 0x7f654c14c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c0ce1c0 0x7f654c14c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32812/0 (socket says 172.21.15.123:32812) 2024-09-13T17:10:13.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654affd700 1 -- 172.21.15.123:0/590717535 learned_addr learned my addr 172.21.15.123:0/590717535 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:13.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f6543fff700 1 --2- 172.21.15.123:0/590717535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654c0d14f0 0x7f654c160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654b7fe700 1 --2- 172.21.15.123:0/590717535 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c15cc00 0x7f654c0c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654affd700 1 -- 172.21.15.123:0/590717535 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c15cc00 msgr2=0x7f654c0c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654affd700 1 --2- 172.21.15.123:0/590717535 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c15cc00 0x7f654c0c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654affd700 1 -- 172.21.15.123:0/590717535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654c0d14f0 msgr2=0x7f654c160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654affd700 1 --2- 172.21.15.123:0/590717535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654c0d14f0 0x7f654c160060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654affd700 1 -- 172.21.15.123:0/590717535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6544009b30 con 0x7f654c0ce1c0 2024-09-13T17:10:13.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654affd700 1 --2- 172.21.15.123:0/590717535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c0ce1c0 0x7f654c14c720 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f653c00c500 tx=0x7f653c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:13.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f65437fe700 1 -- 172.21.15.123:0/590717535 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c005cd0 con 0x7f654c0ce1c0 2024-09-13T17:10:13.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f65437fe700 1 -- 172.21.15.123:0/590717535 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c005e30 con 0x7f654c0ce1c0 2024-09-13T17:10:13.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654bfff700 1 -- 172.21.15.123:0/590717535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654c15d160 con 0x7f654c0ce1c0 2024-09-13T17:10:13.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f65437fe700 1 -- 172.21.15.123:0/590717535 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c0072f0 con 0x7f654c0ce1c0 2024-09-13T17:10:13.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654bfff700 1 -- 172.21.15.123:0/590717535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654c0b3400 con 0x7f654c0ce1c0 2024-09-13T17:10:13.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.545+0000 7f654bfff700 1 -- 172.21.15.123:0/590717535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654c0d0fb0 con 0x7f654c0ce1c0 2024-09-13T17:10:13.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.549+0000 7f65437fe700 1 -- 172.21.15.123:0/590717535 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f653c007450 con 0x7f654c0ce1c0 2024-09-13T17:10:13.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.549+0000 7f65437fe700 1 --2- 172.21.15.123:0/590717535 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f652c066730 0x7f652c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.549+0000 7f65437fe700 1 -- 172.21.15.123:0/590717535 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f653c0835f0 con 0x7f654c0ce1c0 2024-09-13T17:10:13.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.549+0000 7f6543fff700 1 --2- 172.21.15.123:0/590717535 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f652c066730 0x7f652c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.549+0000 7f6543fff700 1 --2- 172.21.15.123:0/590717535 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f652c066730 0x7f652c068bf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f654c0cd6e0 tx=0x7f6534009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:13.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.557+0000 7f65437fe700 1 -- 172.21.15.123:0/590717535 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f653c0508e0 con 0x7f654c0ce1c0 2024-09-13T17:10:13.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.765+0000 7f654bfff700 1 -- 172.21.15.123:0/590717535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f654c08cb10 con 0x7f654c0ce1c0 2024-09-13T17:10:13.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.765+0000 7f65437fe700 1 -- 172.21.15.123:0/590717535 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f653c053f00 con 0x7f654c0ce1c0 2024-09-13T17:10:13.772 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:13.772 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":41,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6173,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3730345323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3730345323},{"type":"v1","addr":"172.21.15.153:6835","nonce":3730345323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1181784822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1181784822},{"type":"v1","addr":"172.21.15.153:6834","nonce":1181784822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1969180357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1969180357},{"type":"v1","addr":"172.21.15.123:6835","nonce":1969180357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:10:00.116252+0000","modified":"2024-09-13T17:10:02.136736+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2288571456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2288571456},{"type":"v1","addr":"172.21.15.123:6837","nonce":2288571456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T17:10:13.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.769+0000 7f654bfff700 1 -- 172.21.15.123:0/590717535 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f652c066730 msgr2=0x7f652c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.769+0000 7f654bfff700 1 --2- 172.21.15.123:0/590717535 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f652c066730 0x7f652c068bf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f654c0cd6e0 tx=0x7f6534009240 comp rx=0 tx=0).stop 2024-09-13T17:10:13.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.769+0000 7f654bfff700 1 -- 172.21.15.123:0/590717535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c0ce1c0 msgr2=0x7f654c14c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.769+0000 7f654bfff700 1 --2- 172.21.15.123:0/590717535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c0ce1c0 0x7f654c14c720 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f653c00c500 tx=0x7f653c00c810 comp rx=0 tx=0).stop 2024-09-13T17:10:13.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.769+0000 7f654bfff700 1 -- 172.21.15.123:0/590717535 shutdown_connections 2024-09-13T17:10:13.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.769+0000 7f654bfff700 1 --2- 172.21.15.123:0/590717535 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f652c066730 0x7f652c068bf0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.769+0000 7f654bfff700 1 --2- 172.21.15.123:0/590717535 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f654c15cc00 0x7f654c0c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.769+0000 7f654bfff700 1 --2- 172.21.15.123:0/590717535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f654c0d14f0 0x7f654c160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.769+0000 7f654bfff700 1 --2- 172.21.15.123:0/590717535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c0ce1c0 0x7f654c14c720 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.769+0000 7f654bfff700 1 -- 172.21.15.123:0/590717535 >> 172.21.15.123:0/590717535 conn(0x7f654c0d2a80 msgr2=0x7f654c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:13.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.769+0000 7f654bfff700 1 -- 172.21.15.123:0/590717535 shutdown_connections 2024-09-13T17:10:13.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.769+0000 7f654bfff700 1 -- 172.21.15.123:0/590717535 wait complete. 2024-09-13T17:10:13.776 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 41 2024-09-13T17:10:13.787 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:13.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9fa636700 1 Processor -- start 2024-09-13T17:10:13.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9fa636700 1 -- start start 2024-09-13T17:10:13.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9fa636700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f415e920 0x7fa9f40caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9fa636700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa9f415ed00 0x7fa9f40cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9fa636700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f4162550 con 0x7fa9f40cb020 2024-09-13T17:10:13.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9fa636700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f40cd690 con 0x7fa9f415ed00 2024-09-13T17:10:13.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9fa636700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f4161f90 con 0x7fa9f415e920 2024-09-13T17:10:13.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9f8e33700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa9f40cb020 0x7fa9f4161540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35854/0 (socket says 172.21.15.123:35854) 2024-09-13T17:10:13.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9f8e33700 1 -- 172.21.15.123:0/1066862407 learned_addr learned my addr 172.21.15.123:0/1066862407 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:13.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9f9e35700 1 --2- 172.21.15.123:0/1066862407 >> v2:172.21.15.153:3300/0 conn(0x7fa9f415ed00 0x7fa9f40cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9f9634700 1 --2- 172.21.15.123:0/1066862407 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f415e920 0x7fa9f40caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9ebfff700 1 -- 172.21.15.123:0/1066862407 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 642488614 0 0) 0x7fa9f4162550 con 0x7fa9f40cb020 2024-09-13T17:10:13.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9ebfff700 1 -- 172.21.15.123:0/1066862407 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9e00035d0 con 0x7fa9f40cb020 2024-09-13T17:10:13.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9ebfff700 1 -- 172.21.15.123:0/1066862407 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 575057927 0 0) 0x7fa9e00035d0 con 0x7fa9f40cb020 2024-09-13T17:10:13.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9f9634700 1 -- 172.21.15.123:0/1066862407 >> v2:172.21.15.153:3300/0 conn(0x7fa9f415ed00 msgr2=0x7fa9f40cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:13.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9f9634700 1 --2- 172.21.15.123:0/1066862407 >> v2:172.21.15.153:3300/0 conn(0x7fa9f415ed00 0x7fa9f40cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9f9634700 1 -- 172.21.15.123:0/1066862407 >> v1:172.21.15.123:6789/0 conn(0x7fa9f40cb020 legacy=0x7fa9f4161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9f9634700 1 -- 172.21.15.123:0/1066862407 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f4162270 con 0x7fa9f415e920 2024-09-13T17:10:13.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9f9e35700 1 --2- 172.21.15.123:0/1066862407 >> v2:172.21.15.153:3300/0 conn(0x7fa9f415ed00 0x7fa9f40cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:13.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9f9634700 1 --2- 172.21.15.123:0/1066862407 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f415e920 0x7fa9f40caae0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009850 tx=0x7fa9f0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f28ddcaab50c85c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:13.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9ebfff700 1 -- 172.21.15.123:0/1066862407 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4001670 con 0x7fa9f415e920 2024-09-13T17:10:13.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9ebfff700 1 -- 172.21.15.123:0/1066862407 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f0004030 con 0x7fa9f415e920 2024-09-13T17:10:13.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9ebfff700 1 -- 172.21.15.123:0/1066862407 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f00043e0 con 0x7fa9f415e920 2024-09-13T17:10:13.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9fa636700 1 -- 172.21.15.123:0/1066862407 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f415e920 msgr2=0x7fa9f40caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9fa636700 1 --2- 172.21.15.123:0/1066862407 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f415e920 0x7fa9f40caae0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009850 tx=0x7fa9f0009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:13.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.893+0000 7fa9fa636700 1 -- 172.21.15.123:0/1066862407 shutdown_connections 2024-09-13T17:10:13.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 --2- 172.21.15.123:0/1066862407 >> v2:172.21.15.153:3300/0 conn(0x7fa9f415ed00 0x7fa9f40cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 --2- 172.21.15.123:0/1066862407 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f415e920 0x7fa9f40caae0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 -- 172.21.15.123:0/1066862407 >> 172.21.15.123:0/1066862407 conn(0x7fa9f4066150 msgr2=0x7fa9f4066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:13.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 -- 172.21.15.123:0/1066862407 shutdown_connections 2024-09-13T17:10:13.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 -- 172.21.15.123:0/1066862407 wait complete. 2024-09-13T17:10:13.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 Processor -- start 2024-09-13T17:10:13.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 -- start start 2024-09-13T17:10:13.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f40cb020 0x7fa9f40c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9f415e920 0x7fa9f414b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f415ed00 0x7fa9f40c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f40c9bc0 con 0x7fa9f40cb020 2024-09-13T17:10:13.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f414e720 con 0x7fa9f415e920 2024-09-13T17:10:13.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f40c9220 con 0x7fa9f415ed00 2024-09-13T17:10:13.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9f9634700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f40cb020 0x7fa9f40c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9f9634700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f40cb020 0x7fa9f40c7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32826/0 (socket says 172.21.15.123:32826) 2024-09-13T17:10:13.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9f9634700 1 -- 172.21.15.123:0/2626266100 learned_addr learned my addr 172.21.15.123:0/2626266100 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:13.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9f9e35700 1 --2- 172.21.15.123:0/2626266100 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f415ed00 0x7fa9f40c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9f8e33700 1 --2- 172.21.15.123:0/2626266100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9f415e920 0x7fa9f414b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9f9634700 1 -- 172.21.15.123:0/2626266100 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f415ed00 msgr2=0x7fa9f40c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9f9634700 1 --2- 172.21.15.123:0/2626266100 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f415ed00 0x7fa9f40c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9f9634700 1 -- 172.21.15.123:0/2626266100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9f415e920 msgr2=0x7fa9f414b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:13.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9f9634700 1 --2- 172.21.15.123:0/2626266100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9f415e920 0x7fa9f414b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:13.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9f9634700 1 -- 172.21.15.123:0/2626266100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec009a70 con 0x7fa9f40cb020 2024-09-13T17:10:13.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9f9634700 1 --2- 172.21.15.123:0/2626266100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f40cb020 0x7fa9f40c7630 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0000c00 tx=0x7fa9f0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:13.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9e9ffb700 1 -- 172.21.15.123:0/2626266100 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0011630 con 0x7fa9f40cb020 2024-09-13T17:10:13.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9e9ffb700 1 -- 172.21.15.123:0/2626266100 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f001f070 con 0x7fa9f40cb020 2024-09-13T17:10:13.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 -- 172.21.15.123:0/2626266100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f00094b0 con 0x7fa9f40cb020 2024-09-13T17:10:13.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9e9ffb700 1 -- 172.21.15.123:0/2626266100 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f00119f0 con 0x7fa9f40cb020 2024-09-13T17:10:13.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.897+0000 7fa9fa636700 1 -- 172.21.15.123:0/2626266100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f40c97e0 con 0x7fa9f40cb020 2024-09-13T17:10:13.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.901+0000 7fa9e9ffb700 1 -- 172.21.15.123:0/2626266100 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa9f0011b50 con 0x7fa9f40cb020 2024-09-13T17:10:13.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.901+0000 7fa9fa636700 1 -- 172.21.15.123:0/2626266100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f40677f0 con 0x7fa9f40cb020 2024-09-13T17:10:13.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.901+0000 7fa9e9ffb700 1 --2- 172.21.15.123:0/2626266100 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa9d8066730 0x7fa9d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:13.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.901+0000 7fa9e9ffb700 1 -- 172.21.15.123:0/2626266100 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9f0021070 con 0x7fa9f40cb020 2024-09-13T17:10:13.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.901+0000 7fa9f8e33700 1 --2- 172.21.15.123:0/2626266100 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa9d8066730 0x7fa9d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:13.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.901+0000 7fa9f8e33700 1 --2- 172.21.15.123:0/2626266100 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa9d8066730 0x7fa9d8068bf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4001eb0 tx=0x7fa9e4001d40 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:13.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:13.909+0000 7fa9e9ffb700 1 -- 172.21.15.123:0/2626266100 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa9f0052bb0 con 0x7fa9f40cb020 2024-09-13T17:10:14.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.081+0000 7fa9fa636700 1 -- 172.21.15.123:0/2626266100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9f40c9d00 con 0x7fa9f40cb020 2024-09-13T17:10:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.085+0000 7fa9e9ffb700 1 -- 172.21.15.123:0/2626266100 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16608 (secure 0 0 0) 0x7fa9f40c9d00 con 0x7fa9f40cb020 2024-09-13T17:10:14.091 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:14.091 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:01.118924+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:58.436099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:59.120652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:14.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.085+0000 7fa9fa636700 1 -- 172.21.15.123:0/2626266100 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa9d8066730 msgr2=0x7fa9d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.085+0000 7fa9fa636700 1 --2- 172.21.15.123:0/2626266100 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa9d8066730 0x7fa9d8068bf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4001eb0 tx=0x7fa9e4001d40 comp rx=0 tx=0).stop 2024-09-13T17:10:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.085+0000 7fa9fa636700 1 -- 172.21.15.123:0/2626266100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f40cb020 msgr2=0x7fa9f40c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.085+0000 7fa9fa636700 1 --2- 172.21.15.123:0/2626266100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f40cb020 0x7fa9f40c7630 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0000c00 tx=0x7fa9f0004770 comp rx=0 tx=0).stop 2024-09-13T17:10:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.085+0000 7fa9fa636700 1 -- 172.21.15.123:0/2626266100 shutdown_connections 2024-09-13T17:10:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.085+0000 7fa9fa636700 1 --2- 172.21.15.123:0/2626266100 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa9d8066730 0x7fa9d8068bf0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.085+0000 7fa9fa636700 1 --2- 172.21.15.123:0/2626266100 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f415ed00 0x7fa9f40c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.085+0000 7fa9fa636700 1 --2- 172.21.15.123:0/2626266100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9f415e920 0x7fa9f414b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.085+0000 7fa9fa636700 1 --2- 172.21.15.123:0/2626266100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f40cb020 0x7fa9f40c7630 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.085+0000 7fa9fa636700 1 -- 172.21.15.123:0/2626266100 >> 172.21.15.123:0/2626266100 conn(0x7fa9f4066150 msgr2=0x7fa9f406d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.085+0000 7fa9fa636700 1 -- 172.21.15.123:0/2626266100 shutdown_connections 2024-09-13T17:10:14.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.089+0000 7fa9fa636700 1 -- 172.21.15.123:0/2626266100 wait complete. 2024-09-13T17:10:14.107 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:09:58.436099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:09:59.120652+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:10:14.107 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:10:14.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.217+0000 7f521ffff700 1 Processor -- start 2024-09-13T17:10:14.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.217+0000 7f521ffff700 1 -- start start 2024-09-13T17:10:14.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f52201506b0 0x7f52200b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521ffff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52200b3310 con 0x7f52200b4990 2024-09-13T17:10:14.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521ffff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522015e280 con 0x7f52200b37a0 2024-09-13T17:10:14.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521ffff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52200b4e00 con 0x7f52201506b0 2024-09-13T17:10:14.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521effd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f52201506b0 0x7f52200b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521f7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f52200b4990 0x7f52200cdac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35868/0 (socket says 172.21.15.123:35868) 2024-09-13T17:10:14.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521f7fe700 1 -- 172.21.15.123:0/866580602 learned_addr learned my addr 172.21.15.123:0/866580602 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:14.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521effd700 1 -- 172.21.15.123:0/866580602 >> v1:172.21.15.153:6789/0 conn(0x7f52200b37a0 legacy=0x7f522015d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521effd700 1 -- 172.21.15.123:0/866580602 >> v1:172.21.15.123:6789/0 conn(0x7f52200b4990 legacy=0x7f52200cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521e7fc700 1 -- 172.21.15.123:0/866580602 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368443360 0 0) 0x7f522015e280 con 0x7f52200b37a0 2024-09-13T17:10:14.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521effd700 1 -- 172.21.15.123:0/866580602 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200b29e0 con 0x7f52201506b0 2024-09-13T17:10:14.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521effd700 1 --2- 172.21.15.123:0/866580602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52201506b0 0x7f52200b4450 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5210009850 tx=0x7f5210009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b42726201beec98 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:14.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521e7fc700 1 -- 172.21.15.123:0/866580602 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5210004230 con 0x7f52201506b0 2024-09-13T17:10:14.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521e7fc700 1 -- 172.21.15.123:0/866580602 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5210004390 con 0x7f52201506b0 2024-09-13T17:10:14.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521e7fc700 1 -- 172.21.15.123:0/866580602 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52100036c0 con 0x7f52201506b0 2024-09-13T17:10:14.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521ffff700 1 -- 172.21.15.123:0/866580602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52201506b0 msgr2=0x7f52200b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521ffff700 1 --2- 172.21.15.123:0/866580602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52201506b0 0x7f52200b4450 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5210009850 tx=0x7f5210009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521ffff700 1 -- 172.21.15.123:0/866580602 shutdown_connections 2024-09-13T17:10:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.221+0000 7f521ffff700 1 --2- 172.21.15.123:0/866580602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52201506b0 0x7f52200b4450 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.225+0000 7f521ffff700 1 -- 172.21.15.123:0/866580602 >> 172.21.15.123:0/866580602 conn(0x7f5220066780 msgr2=0x7f52200719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.225+0000 7f521ffff700 1 -- 172.21.15.123:0/866580602 shutdown_connections 2024-09-13T17:10:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.225+0000 7f521ffff700 1 -- 172.21.15.123:0/866580602 wait complete. 2024-09-13T17:10:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.225+0000 7f521ffff700 1 Processor -- start 2024-09-13T17:10:14.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.225+0000 7f521ffff700 1 -- start start 2024-09-13T17:10:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52200b37a0 0x7f52201f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52200b4990 0x7f52201f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52201506b0 0x7f5220153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521ffff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5220145a10 con 0x7f52201506b0 2024-09-13T17:10:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521ffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52201f14c0 con 0x7f52200b37a0 2024-09-13T17:10:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521ffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5220145c40 con 0x7f52200b4990 2024-09-13T17:10:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52201506b0 0x7f5220153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52201506b0 0x7f5220153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32844/0 (socket says 172.21.15.123:32844) 2024-09-13T17:10:14.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521f7fe700 1 -- 172.21.15.123:0/3850360297 learned_addr learned my addr 172.21.15.123:0/3850360297 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:14.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521effd700 1 --2- 172.21.15.123:0/3850360297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52200b37a0 0x7f52201f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f52167fc700 1 --2- 172.21.15.123:0/3850360297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52200b4990 0x7f52201f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521f7fe700 1 -- 172.21.15.123:0/3850360297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52200b4990 msgr2=0x7f52201f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521f7fe700 1 --2- 172.21.15.123:0/3850360297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52200b4990 0x7f52201f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521f7fe700 1 -- 172.21.15.123:0/3850360297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52200b37a0 msgr2=0x7f52201f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521f7fe700 1 --2- 172.21.15.123:0/3850360297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52200b37a0 0x7f52201f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521f7fe700 1 -- 172.21.15.123:0/3850360297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52100094b0 con 0x7f52201506b0 2024-09-13T17:10:14.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521f7fe700 1 --2- 172.21.15.123:0/3850360297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52201506b0 0x7f5220153030 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f521800cca0 tx=0x7f521800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:14.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f5217fff700 1 -- 172.21.15.123:0/3850360297 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521800ab30 con 0x7f52201506b0 2024-09-13T17:10:14.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f5217fff700 1 -- 172.21.15.123:0/3850360297 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521800ac90 con 0x7f52201506b0 2024-09-13T17:10:14.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521ffff700 1 -- 172.21.15.123:0/3850360297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5220145f20 con 0x7f52201506b0 2024-09-13T17:10:14.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f5217fff700 1 -- 172.21.15.123:0/3850360297 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52180070d0 con 0x7f52201506b0 2024-09-13T17:10:14.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.229+0000 7f521ffff700 1 -- 172.21.15.123:0/3850360297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52201464e0 con 0x7f52201506b0 2024-09-13T17:10:14.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.233+0000 7f521ffff700 1 -- 172.21.15.123:0/3850360297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52201466d0 con 0x7f52201506b0 2024-09-13T17:10:14.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.233+0000 7f5217fff700 1 -- 172.21.15.123:0/3850360297 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5218007250 con 0x7f52201506b0 2024-09-13T17:10:14.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.233+0000 7f5217fff700 1 --2- 172.21.15.123:0/3850360297 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5200066730 0x7f5200068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.233+0000 7f521effd700 1 --2- 172.21.15.123:0/3850360297 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5200066730 0x7f5200068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.233+0000 7f5217fff700 1 -- 172.21.15.123:0/3850360297 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5218083c90 con 0x7f52201506b0 2024-09-13T17:10:14.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.233+0000 7f521effd700 1 --2- 172.21.15.123:0/3850360297 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5200066730 0x7f5200068bf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5210009850 tx=0x7f5210010000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:14.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.237+0000 7f5217fff700 1 -- 172.21.15.123:0/3850360297 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5218050f70 con 0x7f52201506b0 2024-09-13T17:10:14.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.405+0000 7f521ffff700 1 -- 172.21.15.123:0/3850360297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52200b4450 con 0x7f52201506b0 2024-09-13T17:10:14.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.405+0000 7f5217fff700 1 -- 172.21.15.123:0/3850360297 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52180180a0 con 0x7f52201506b0 2024-09-13T17:10:14.413 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:10:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.409+0000 7f521ffff700 1 -- 172.21.15.123:0/3850360297 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5200066730 msgr2=0x7f5200068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.409+0000 7f521ffff700 1 --2- 172.21.15.123:0/3850360297 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5200066730 0x7f5200068bf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5210009850 tx=0x7f5210010000 comp rx=0 tx=0).stop 2024-09-13T17:10:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.409+0000 7f521ffff700 1 -- 172.21.15.123:0/3850360297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52201506b0 msgr2=0x7f5220153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.409+0000 7f521ffff700 1 --2- 172.21.15.123:0/3850360297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52201506b0 0x7f5220153030 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f521800cca0 tx=0x7f521800a060 comp rx=0 tx=0).stop 2024-09-13T17:10:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.409+0000 7f521ffff700 1 -- 172.21.15.123:0/3850360297 shutdown_connections 2024-09-13T17:10:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.409+0000 7f521ffff700 1 --2- 172.21.15.123:0/3850360297 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f5200066730 0x7f5200068bf0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.409+0000 7f521ffff700 1 --2- 172.21.15.123:0/3850360297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52201506b0 0x7f5220153030 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.409+0000 7f521ffff700 1 --2- 172.21.15.123:0/3850360297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f52200b4990 0x7f52201f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.409+0000 7f521ffff700 1 --2- 172.21.15.123:0/3850360297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52200b37a0 0x7f52201f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.409+0000 7f521ffff700 1 -- 172.21.15.123:0/3850360297 >> 172.21.15.123:0/3850360297 conn(0x7f5220066780 msgr2=0x7f522015a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.409+0000 7f521ffff700 1 -- 172.21.15.123:0/3850360297 shutdown_connections 2024-09-13T17:10:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.409+0000 7f521ffff700 1 -- 172.21.15.123:0/3850360297 wait complete. 2024-09-13T17:10:14.428 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:10:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.541+0000 7ffb2dd3b700 1 Processor -- start 2024-09-13T17:10:14.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.541+0000 7ffb2dd3b700 1 -- start start 2024-09-13T17:10:14.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.541+0000 7ffb2dd3b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb2815ccb0 0x7ffb280cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.541+0000 7ffb2dd3b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb280aca60 con 0x7ffb2815d090 2024-09-13T17:10:14.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.541+0000 7ffb2dd3b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb280adc00 con 0x7ffb280cb670 2024-09-13T17:10:14.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.541+0000 7ffb2dd3b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb280ad9f0 con 0x7ffb2815ccb0 2024-09-13T17:10:14.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.541+0000 7ffb277fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb2815ccb0 0x7ffb280cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.541+0000 7ffb26ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ffb2815d090 0x7ffb280caf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35872/0 (socket says 172.21.15.123:35872) 2024-09-13T17:10:14.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.541+0000 7ffb26ffd700 1 -- 172.21.15.123:0/1142398652 learned_addr learned my addr 172.21.15.123:0/1142398652 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:14.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb267fc700 1 -- 172.21.15.123:0/1142398652 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053910591 0 0) 0x7ffb280aca60 con 0x7ffb2815d090 2024-09-13T17:10:14.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb267fc700 1 -- 172.21.15.123:0/1142398652 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb100035d0 con 0x7ffb2815d090 2024-09-13T17:10:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb267fc700 1 -- 172.21.15.123:0/1142398652 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2401603885 0 0) 0x7ffb100035d0 con 0x7ffb2815d090 2024-09-13T17:10:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb277fe700 1 -- 172.21.15.123:0/1142398652 >> v1:172.21.15.153:6789/0 conn(0x7ffb280cb670 legacy=0x7ffb280c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb277fe700 1 -- 172.21.15.123:0/1142398652 >> v1:172.21.15.123:6789/0 conn(0x7ffb2815d090 legacy=0x7ffb280caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb277fe700 1 -- 172.21.15.123:0/1142398652 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb280acd00 con 0x7ffb2815ccb0 2024-09-13T17:10:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb277fe700 1 --2- 172.21.15.123:0/1142398652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2815ccb0 0x7ffb280cce40 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009850 tx=0x7ffb1c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d889d47d1f971362 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb267fc700 1 -- 172.21.15.123:0/1142398652 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb200019f0 con 0x7ffb2815ccb0 2024-09-13T17:10:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb267fc700 1 -- 172.21.15.123:0/1142398652 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c004030 con 0x7ffb2815ccb0 2024-09-13T17:10:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb267fc700 1 -- 172.21.15.123:0/1142398652 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0043c0 con 0x7ffb2815ccb0 2024-09-13T17:10:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/1142398652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2815ccb0 msgr2=0x7ffb280cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb2dd3b700 1 --2- 172.21.15.123:0/1142398652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2815ccb0 0x7ffb280cce40 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009850 tx=0x7ffb1c009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/1142398652 shutdown_connections 2024-09-13T17:10:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb2dd3b700 1 --2- 172.21.15.123:0/1142398652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2815ccb0 0x7ffb280cce40 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/1142398652 >> 172.21.15.123:0/1142398652 conn(0x7ffb280b0450 msgr2=0x7ffb280b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:14.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/1142398652 shutdown_connections 2024-09-13T17:10:14.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/1142398652 wait complete. 2024-09-13T17:10:14.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb2dd3b700 1 Processor -- start 2024-09-13T17:10:14.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.545+0000 7ffb2dd3b700 1 -- start start 2024-09-13T17:10:14.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb2dd3b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb280cb670 0x7ffb280c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb2dd3b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb2815ccb0 0x7ffb28156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb2dd3b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2815d090 0x7ffb28157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb2dd3b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb28158ab0 con 0x7ffb2815d090 2024-09-13T17:10:14.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb2dd3b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2815a410 con 0x7ffb280cb670 2024-09-13T17:10:14.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb2dd3b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280b1860 con 0x7ffb2815ccb0 2024-09-13T17:10:14.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb27fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2815d090 0x7ffb28157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb26ffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb2815ccb0 0x7ffb28156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb27fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2815d090 0x7ffb28157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32866/0 (socket says 172.21.15.123:32866) 2024-09-13T17:10:14.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb27fff700 1 -- 172.21.15.123:0/2069268910 learned_addr learned my addr 172.21.15.123:0/2069268910 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:14.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb277fe700 1 --2- 172.21.15.123:0/2069268910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb280cb670 0x7ffb280c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb27fff700 1 -- 172.21.15.123:0/2069268910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb2815ccb0 msgr2=0x7ffb28156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb27fff700 1 --2- 172.21.15.123:0/2069268910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb2815ccb0 0x7ffb28156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb27fff700 1 -- 172.21.15.123:0/2069268910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb280cb670 msgr2=0x7ffb280c2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb27fff700 1 --2- 172.21.15.123:0/2069268910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb280cb670 0x7ffb280c2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb27fff700 1 -- 172.21.15.123:0/2069268910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0094b0 con 0x7ffb2815d090 2024-09-13T17:10:14.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb27fff700 1 --2- 172.21.15.123:0/2069268910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2815d090 0x7ffb28157f00 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800c480 tx=0x7ffb1800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:14.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb0ffff700 1 -- 172.21.15.123:0/2069268910 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb180052d0 con 0x7ffb2815d090 2024-09-13T17:10:14.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb0ffff700 1 -- 172.21.15.123:0/2069268910 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1800ce90 con 0x7ffb2815d090 2024-09-13T17:10:14.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/2069268910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb280b1b40 con 0x7ffb2815d090 2024-09-13T17:10:14.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb0ffff700 1 -- 172.21.15.123:0/2069268910 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb180036a0 con 0x7ffb2815d090 2024-09-13T17:10:14.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.549+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/2069268910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb280b2100 con 0x7ffb2815d090 2024-09-13T17:10:14.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.553+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/2069268910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb280cce40 con 0x7ffb2815d090 2024-09-13T17:10:14.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.553+0000 7ffb0ffff700 1 -- 172.21.15.123:0/2069268910 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb18003800 con 0x7ffb2815d090 2024-09-13T17:10:14.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.553+0000 7ffb0ffff700 1 --2- 172.21.15.123:0/2069268910 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb14066760 0x7ffb14068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.553+0000 7ffb0ffff700 1 -- 172.21.15.123:0/2069268910 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb18083490 con 0x7ffb2815d090 2024-09-13T17:10:14.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.553+0000 7ffb277fe700 1 --2- 172.21.15.123:0/2069268910 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb14066760 0x7ffb14068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.553+0000 7ffb277fe700 1 --2- 172.21.15.123:0/2069268910 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb14066760 0x7ffb14068c20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0090b0 tx=0x7ffb1c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:14.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.561+0000 7ffb0ffff700 1 -- 172.21.15.123:0/2069268910 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffb180507f0 con 0x7ffb2815d090 2024-09-13T17:10:14.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.725+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/2069268910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb28160070 con 0x7ffb2815d090 2024-09-13T17:10:14.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.725+0000 7ffb0ffff700 1 -- 172.21.15.123:0/2069268910 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb18053e10 con 0x7ffb2815d090 2024-09-13T17:10:14.733 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:10:14.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.729+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/2069268910 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb14066760 msgr2=0x7ffb14068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.729+0000 7ffb2dd3b700 1 --2- 172.21.15.123:0/2069268910 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb14066760 0x7ffb14068c20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0090b0 tx=0x7ffb1c008030 comp rx=0 tx=0).stop 2024-09-13T17:10:14.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.729+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/2069268910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2815d090 msgr2=0x7ffb28157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.729+0000 7ffb2dd3b700 1 --2- 172.21.15.123:0/2069268910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2815d090 0x7ffb28157f00 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800c480 tx=0x7ffb1800c790 comp rx=0 tx=0).stop 2024-09-13T17:10:14.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.729+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/2069268910 shutdown_connections 2024-09-13T17:10:14.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.729+0000 7ffb2dd3b700 1 --2- 172.21.15.123:0/2069268910 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffb14066760 0x7ffb14068c20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.729+0000 7ffb2dd3b700 1 --2- 172.21.15.123:0/2069268910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2815d090 0x7ffb28157f00 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.729+0000 7ffb2dd3b700 1 --2- 172.21.15.123:0/2069268910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffb2815ccb0 0x7ffb28156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.729+0000 7ffb2dd3b700 1 --2- 172.21.15.123:0/2069268910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb280cb670 0x7ffb280c2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.729+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/2069268910 >> 172.21.15.123:0/2069268910 conn(0x7ffb280b0450 msgr2=0x7ffb2806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:14.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.729+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/2069268910 shutdown_connections 2024-09-13T17:10:14.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.729+0000 7ffb2dd3b700 1 -- 172.21.15.123:0/2069268910 wait complete. 2024-09-13T17:10:14.752 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:10:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.861+0000 7f6f973c8700 1 Processor -- start 2024-09-13T17:10:14.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.861+0000 7f6f973c8700 1 -- start start 2024-09-13T17:10:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f900d0f40 0x7f6f900d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6f900cd5e0 0x7f6f900cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f900d0cb0 con 0x7f6f900b58b0 2024-09-13T17:10:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f900b0060 con 0x7f6f900cd5e0 2024-09-13T17:10:14.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900b0340 con 0x7f6f900d0f40 2024-09-13T17:10:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f96bc7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6f900cd5e0 0x7f6f900cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f96bc7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6f900cd5e0 0x7f6f900cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32874/0 (socket says 172.21.15.123:32874) 2024-09-13T17:10:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f96bc7700 1 -- 172.21.15.123:0/705291956 learned_addr learned my addr 172.21.15.123:0/705291956 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f963c6700 1 --2- 172.21.15.123:0/705291956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f900d0f40 0x7f6f900d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f96bc7700 1 -- 172.21.15.123:0/705291956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f900d0f40 msgr2=0x7f6f900d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f96bc7700 1 --2- 172.21.15.123:0/705291956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f900d0f40 0x7f6f900d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f96bc7700 1 -- 172.21.15.123:0/705291956 >> v1:172.21.15.153:6789/0 conn(0x7f6f900b58b0 legacy=0x7f6f900d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f96bc7700 1 -- 172.21.15.123:0/705291956 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f900b0620 con 0x7f6f900cd5e0 2024-09-13T17:10:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f96bc7700 1 --2- 172.21.15.123:0/705291956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f900cd5e0 0x7f6f900cda30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009e50 tx=0x7f6f8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee4d6d08814735a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f953c4700 1 -- 172.21.15.123:0/705291956 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800e070 con 0x7f6f900cd5e0 2024-09-13T17:10:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f953c4700 1 -- 172.21.15.123:0/705291956 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8800b9c0 con 0x7f6f900cd5e0 2024-09-13T17:10:14.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f953c4700 1 -- 172.21.15.123:0/705291956 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800bd70 con 0x7f6f900cd5e0 2024-09-13T17:10:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 -- 172.21.15.123:0/705291956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f900cd5e0 msgr2=0x7f6f900cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 --2- 172.21.15.123:0/705291956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f900cd5e0 0x7f6f900cda30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009e50 tx=0x7f6f8800b330 comp rx=0 tx=0).stop 2024-09-13T17:10:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 -- 172.21.15.123:0/705291956 shutdown_connections 2024-09-13T17:10:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 --2- 172.21.15.123:0/705291956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f900cd5e0 0x7f6f900cda30 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 --2- 172.21.15.123:0/705291956 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f900d0f40 0x7f6f900d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 -- 172.21.15.123:0/705291956 >> 172.21.15.123:0/705291956 conn(0x7f6f900d2a60 msgr2=0x7f6f900d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:14.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 -- 172.21.15.123:0/705291956 shutdown_connections 2024-09-13T17:10:14.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 -- 172.21.15.123:0/705291956 wait complete. 2024-09-13T17:10:14.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 Processor -- start 2024-09-13T17:10:14.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.865+0000 7f6f973c8700 1 -- start start 2024-09-13T17:10:14.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f973c8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f900b58b0 0x7f6f90159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f973c8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f900cd5e0 0x7f6f900c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f973c8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f900d0f40 0x7f6f900c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f973c8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900c7560 con 0x7f6f900b58b0 2024-09-13T17:10:14.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f973c8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f901584b0 con 0x7f6f900cd5e0 2024-09-13T17:10:14.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f973c8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f90158790 con 0x7f6f900d0f40 2024-09-13T17:10:14.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f963c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f900b58b0 0x7f6f90159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f963c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f900b58b0 0x7f6f90159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32890/0 (socket says 172.21.15.123:32890) 2024-09-13T17:10:14.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f963c6700 1 -- 172.21.15.123:0/1373257455 learned_addr learned my addr 172.21.15.123:0/1373257455 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:14.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f95bc5700 1 --2- 172.21.15.123:0/1373257455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f900cd5e0 0x7f6f900c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f96bc7700 1 --2- 172.21.15.123:0/1373257455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f900d0f40 0x7f6f900c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f963c6700 1 -- 172.21.15.123:0/1373257455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f900d0f40 msgr2=0x7f6f900c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f963c6700 1 --2- 172.21.15.123:0/1373257455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f900d0f40 0x7f6f900c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f963c6700 1 -- 172.21.15.123:0/1373257455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f900cd5e0 msgr2=0x7f6f900c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:14.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f963c6700 1 --2- 172.21.15.123:0/1373257455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f900cd5e0 0x7f6f900c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:14.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f963c6700 1 -- 172.21.15.123:0/1373257455 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f88009b30 con 0x7f6f900b58b0 2024-09-13T17:10:14.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f963c6700 1 --2- 172.21.15.123:0/1373257455 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f900b58b0 0x7f6f90159270 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00d800 tx=0x7f6f8c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:14.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f82ffd700 1 -- 172.21.15.123:0/1373257455 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0125f0 con 0x7f6f900b58b0 2024-09-13T17:10:14.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f82ffd700 1 -- 172.21.15.123:0/1373257455 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c012750 con 0x7f6f900b58b0 2024-09-13T17:10:14.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f973c8700 1 -- 172.21.15.123:0/1373257455 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f90158a70 con 0x7f6f900b58b0 2024-09-13T17:10:14.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f82ffd700 1 -- 172.21.15.123:0/1373257455 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c012b00 con 0x7f6f900b58b0 2024-09-13T17:10:14.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f973c8700 1 -- 172.21.15.123:0/1373257455 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9015fdd0 con 0x7f6f900b58b0 2024-09-13T17:10:14.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.869+0000 7f6f973c8700 1 -- 172.21.15.123:0/1373257455 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9006f910 con 0x7f6f900b58b0 2024-09-13T17:10:14.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.873+0000 7f6f82ffd700 1 -- 172.21.15.123:0/1373257455 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6f8c012c60 con 0x7f6f900b58b0 2024-09-13T17:10:14.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.873+0000 7f6f82ffd700 1 --2- 172.21.15.123:0/1373257455 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f74066730 0x7f6f74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:14.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.873+0000 7f6f95bc5700 1 --2- 172.21.15.123:0/1373257455 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f74066730 0x7f6f74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:14.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.873+0000 7f6f82ffd700 1 -- 172.21.15.123:0/1373257455 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f8c084390 con 0x7f6f900b58b0 2024-09-13T17:10:14.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.873+0000 7f6f95bc5700 1 --2- 172.21.15.123:0/1373257455 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f74066730 0x7f6f74068bf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6f900748d0 tx=0x7f6f84009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:14.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:14.881+0000 7f6f82ffd700 1 -- 172.21.15.123:0/1373257455 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6f8c051650 con 0x7f6f900b58b0 2024-09-13T17:10:15.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.045+0000 7f6f973c8700 1 -- 172.21.15.123:0/1373257455 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f900c97b0 con 0x7f6f900b58b0 2024-09-13T17:10:15.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.045+0000 7f6f82ffd700 1 -- 172.21.15.123:0/1373257455 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f8c054c70 con 0x7f6f900b58b0 2024-09-13T17:10:15.051 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:10:15.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.049+0000 7f6f973c8700 1 -- 172.21.15.123:0/1373257455 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f74066730 msgr2=0x7f6f74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.049+0000 7f6f973c8700 1 --2- 172.21.15.123:0/1373257455 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f74066730 0x7f6f74068bf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6f900748d0 tx=0x7f6f84009040 comp rx=0 tx=0).stop 2024-09-13T17:10:15.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.049+0000 7f6f973c8700 1 -- 172.21.15.123:0/1373257455 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f900b58b0 msgr2=0x7f6f90159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.049+0000 7f6f973c8700 1 --2- 172.21.15.123:0/1373257455 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f900b58b0 0x7f6f90159270 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00d800 tx=0x7f6f8c00db10 comp rx=0 tx=0).stop 2024-09-13T17:10:15.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.049+0000 7f6f973c8700 1 -- 172.21.15.123:0/1373257455 shutdown_connections 2024-09-13T17:10:15.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.049+0000 7f6f973c8700 1 --2- 172.21.15.123:0/1373257455 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6f74066730 0x7f6f74068bf0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.049+0000 7f6f973c8700 1 --2- 172.21.15.123:0/1373257455 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6f900d0f40 0x7f6f900c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.049+0000 7f6f973c8700 1 --2- 172.21.15.123:0/1373257455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f900cd5e0 0x7f6f900c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.049+0000 7f6f973c8700 1 --2- 172.21.15.123:0/1373257455 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f900b58b0 0x7f6f90159270 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.049+0000 7f6f973c8700 1 -- 172.21.15.123:0/1373257455 >> 172.21.15.123:0/1373257455 conn(0x7f6f900d2a60 msgr2=0x7f6f90071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:15.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.049+0000 7f6f973c8700 1 -- 172.21.15.123:0/1373257455 shutdown_connections 2024-09-13T17:10:15.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.049+0000 7f6f973c8700 1 -- 172.21.15.123:0/1373257455 wait complete. 2024-09-13T17:10:15.066 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:15.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.173+0000 7fe32929f700 1 Processor -- start 2024-09-13T17:10:15.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.173+0000 7fe32929f700 1 -- start start 2024-09-13T17:10:15.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.173+0000 7fe32929f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe324153390 0x7fe324159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.173+0000 7fe32929f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe3240cdb70 0x7fe3240cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.173+0000 7fe32929f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe324153770 0x7fe3240ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.173+0000 7fe32929f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3241595a0 con 0x7fe3240cdb70 2024-09-13T17:10:15.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.173+0000 7fe32929f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32415a4c0 con 0x7fe324153390 2024-09-13T17:10:15.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.173+0000 7fe32929f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240cb730 con 0x7fe324153770 2024-09-13T17:10:15.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.173+0000 7fe31b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe3240cdb70 0x7fe3240cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.173+0000 7fe31b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe3240cdb70 0x7fe3240cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32900/0 (socket says 172.21.15.123:32900) 2024-09-13T17:10:15.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe31b7fe700 1 -- 172.21.15.123:0/4086871022 learned_addr learned my addr 172.21.15.123:0/4086871022 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:15.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe328a9e700 1 --2- 172.21.15.123:0/4086871022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe324153770 0x7fe3240ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe323fff700 1 --2- 172.21.15.123:0/4086871022 >> v2:172.21.15.153:3300/0 conn(0x7fe324153390 0x7fe324159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe31b7fe700 1 -- 172.21.15.123:0/4086871022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe324153770 msgr2=0x7fe3240ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:15.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe31b7fe700 1 --2- 172.21.15.123:0/4086871022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe324153770 0x7fe3240ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe31b7fe700 1 -- 172.21.15.123:0/4086871022 >> v2:172.21.15.153:3300/0 conn(0x7fe324153390 msgr2=0x7fe324159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:15.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe31b7fe700 1 --2- 172.21.15.123:0/4086871022 >> v2:172.21.15.153:3300/0 conn(0x7fe324153390 0x7fe324159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe31b7fe700 1 -- 172.21.15.123:0/4086871022 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3240cba10 con 0x7fe3240cdb70 2024-09-13T17:10:15.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe323fff700 1 --2- 172.21.15.123:0/4086871022 >> v2:172.21.15.153:3300/0 conn(0x7fe324153390 0x7fe324159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:15.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe31b7fe700 1 --2- 172.21.15.123:0/4086871022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3240cdb70 0x7fe3240cae30 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009940 tx=0x7fe30c009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949123a4b73420a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:15.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe3237fe700 1 -- 172.21.15.123:0/4086871022 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00b9e0 con 0x7fe3240cdb70 2024-09-13T17:10:15.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe3237fe700 1 -- 172.21.15.123:0/4086871022 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c009e90 con 0x7fe3240cdb70 2024-09-13T17:10:15.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe3237fe700 1 -- 172.21.15.123:0/4086871022 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00bd60 con 0x7fe3240cdb70 2024-09-13T17:10:15.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe32929f700 1 -- 172.21.15.123:0/4086871022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3240cdb70 msgr2=0x7fe3240cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe32929f700 1 --2- 172.21.15.123:0/4086871022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3240cdb70 0x7fe3240cae30 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009940 tx=0x7fe30c009c50 comp rx=0 tx=0).stop 2024-09-13T17:10:15.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe32929f700 1 -- 172.21.15.123:0/4086871022 shutdown_connections 2024-09-13T17:10:15.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe32929f700 1 --2- 172.21.15.123:0/4086871022 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe324153770 0x7fe3240ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe32929f700 1 --2- 172.21.15.123:0/4086871022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3240cdb70 0x7fe3240cae30 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe32929f700 1 --2- 172.21.15.123:0/4086871022 >> v2:172.21.15.153:3300/0 conn(0x7fe324153390 0x7fe324159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe32929f700 1 -- 172.21.15.123:0/4086871022 >> 172.21.15.123:0/4086871022 conn(0x7fe324066150 msgr2=0x7fe324066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:15.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe32929f700 1 -- 172.21.15.123:0/4086871022 shutdown_connections 2024-09-13T17:10:15.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe32929f700 1 -- 172.21.15.123:0/4086871022 wait complete. 2024-09-13T17:10:15.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe32929f700 1 Processor -- start 2024-09-13T17:10:15.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.177+0000 7fe32929f700 1 -- start start 2024-09-13T17:10:15.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe32929f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe3240cdb70 0x7fe324155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe32929f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe324153390 0x7fe324071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe32929f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe324153770 0x7fe324156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe32929f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32414d190 con 0x7fe324153390 2024-09-13T17:10:15.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe32929f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3241545c0 con 0x7fe324153770 2024-09-13T17:10:15.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe32929f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3241548a0 con 0x7fe3240cdb70 2024-09-13T17:10:15.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe31b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe324153390 0x7fe324071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe31b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe324153390 0x7fe324071bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32912/0 (socket says 172.21.15.123:32912) 2024-09-13T17:10:15.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe31b7fe700 1 -- 172.21.15.123:0/2846346652 learned_addr learned my addr 172.21.15.123:0/2846346652 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:15.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe328a9e700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe324153770 0x7fe324156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe323fff700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe3240cdb70 0x7fe324155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe31b7fe700 1 -- 172.21.15.123:0/2846346652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe3240cdb70 msgr2=0x7fe324155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe31b7fe700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe3240cdb70 0x7fe324155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe31b7fe700 1 -- 172.21.15.123:0/2846346652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe324153770 msgr2=0x7fe324156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe31b7fe700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe324153770 0x7fe324156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe31b7fe700 1 -- 172.21.15.123:0/2846346652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c009570 con 0x7fe324153390 2024-09-13T17:10:15.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe328a9e700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe324153770 0x7fe324156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:15.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe31b7fe700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe324153390 0x7fe324071bd0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe30c000c00 tx=0x7fe30c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:15.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe3217fa700 1 -- 172.21.15.123:0/2846346652 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c004610 con 0x7fe324153390 2024-09-13T17:10:15.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe3217fa700 1 -- 172.21.15.123:0/2846346652 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c0036c0 con 0x7fe324153390 2024-09-13T17:10:15.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe32929f700 1 -- 172.21.15.123:0/2846346652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe324154b80 con 0x7fe324153390 2024-09-13T17:10:15.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe3217fa700 1 -- 172.21.15.123:0/2846346652 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c003a70 con 0x7fe324153390 2024-09-13T17:10:15.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe32929f700 1 -- 172.21.15.123:0/2846346652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe324155140 con 0x7fe324153390 2024-09-13T17:10:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.181+0000 7fe32929f700 1 -- 172.21.15.123:0/2846346652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3240677f0 con 0x7fe324153390 2024-09-13T17:10:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.185+0000 7fe3217fa700 1 -- 172.21.15.123:0/2846346652 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe30c021070 con 0x7fe324153390 2024-09-13T17:10:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.185+0000 7fe3217fa700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe304066760 0x7fe304068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.185+0000 7fe3217fa700 1 -- 172.21.15.123:0/2846346652 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe30c085930 con 0x7fe324153390 2024-09-13T17:10:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.185+0000 7fe323fff700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe304066760 0x7fe304068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.185+0000 7fe323fff700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe304066760 0x7fe304068c20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe314006fd0 tx=0x7fe314008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:15.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.193+0000 7fe3217fa700 1 -- 172.21.15.123:0/2846346652 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe30c052c10 con 0x7fe324153390 2024-09-13T17:10:15.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.397+0000 7fe32929f700 1 -- 172.21.15.123:0/2846346652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe324155660 con 0x7fe324153390 2024-09-13T17:10:15.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.401+0000 7fe3217fa700 1 -- 172.21.15.123:0/2846346652 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4748 (secure 0 0 0) 0x7fe324155660 con 0x7fe324153390 2024-09-13T17:10:15.408 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:15.408 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":41,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6173,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3730345323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3730345323},{"type":"v1","addr":"172.21.15.153:6835","nonce":3730345323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1181784822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1181784822},{"type":"v1","addr":"172.21.15.153:6834","nonce":1181784822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1969180357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1969180357},{"type":"v1","addr":"172.21.15.123:6835","nonce":1969180357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:10:00.116252+0000","modified":"2024-09-13T17:10:02.136736+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2288571456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2288571456},{"type":"v1","addr":"172.21.15.123:6837","nonce":2288571456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T17:10:15.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.401+0000 7fe32929f700 1 -- 172.21.15.123:0/2846346652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe304066760 msgr2=0x7fe304068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.401+0000 7fe32929f700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe304066760 0x7fe304068c20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe314006fd0 tx=0x7fe314008040 comp rx=0 tx=0).stop 2024-09-13T17:10:15.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.401+0000 7fe32929f700 1 -- 172.21.15.123:0/2846346652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe324153390 msgr2=0x7fe324071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.401+0000 7fe32929f700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe324153390 0x7fe324071bd0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe30c000c00 tx=0x7fe30c004770 comp rx=0 tx=0).stop 2024-09-13T17:10:15.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.401+0000 7fe32929f700 1 -- 172.21.15.123:0/2846346652 shutdown_connections 2024-09-13T17:10:15.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.401+0000 7fe32929f700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe304066760 0x7fe304068c20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.401+0000 7fe32929f700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe324153770 0x7fe324156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.401+0000 7fe32929f700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe324153390 0x7fe324071bd0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.401+0000 7fe32929f700 1 --2- 172.21.15.123:0/2846346652 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe3240cdb70 0x7fe324155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.401+0000 7fe32929f700 1 -- 172.21.15.123:0/2846346652 >> 172.21.15.123:0/2846346652 conn(0x7fe324066150 msgr2=0x7fe3240b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:15.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.401+0000 7fe32929f700 1 -- 172.21.15.123:0/2846346652 shutdown_connections 2024-09-13T17:10:15.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.401+0000 7fe32929f700 1 -- 172.21.15.123:0/2846346652 wait complete. 2024-09-13T17:10:15.410 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 41 2024-09-13T17:10:15.421 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:15.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.525+0000 7f1b4cf36700 1 Processor -- start 2024-09-13T17:10:15.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.525+0000 7f1b4cf36700 1 -- start start 2024-09-13T17:10:15.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.525+0000 7f1b4cf36700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b48071580 0x7f1b480705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.525+0000 7f1b4cf36700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1b4815b9b0 0x7f1b480cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.525+0000 7f1b4cf36700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b480cee80 con 0x7f1b4815a8c0 2024-09-13T17:10:15.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.525+0000 7f1b4cf36700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b480ce270 con 0x7f1b4815b9b0 2024-09-13T17:10:15.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.525+0000 7f1b4cf36700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480ce550 con 0x7f1b48071580 2024-09-13T17:10:15.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.525+0000 7f1b47fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1b4815b9b0 0x7f1b480cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.525+0000 7f1b477fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1b4815a8c0 0x7f1b48070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35874/0 (socket says 172.21.15.123:35874) 2024-09-13T17:10:15.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.525+0000 7f1b47fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1b4815b9b0 0x7f1b480cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32918/0 (socket says 172.21.15.123:32918) 2024-09-13T17:10:15.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.525+0000 7f1b477fe700 1 -- 172.21.15.123:0/738011193 learned_addr learned my addr 172.21.15.123:0/738011193 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:15.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.525+0000 7f1b3effd700 1 --2- 172.21.15.123:0/738011193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b48071580 0x7f1b480705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b47fff700 1 -- 172.21.15.123:0/738011193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b48071580 msgr2=0x7f1b480705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:15.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b47fff700 1 --2- 172.21.15.123:0/738011193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b48071580 0x7f1b480705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b47fff700 1 -- 172.21.15.123:0/738011193 >> v1:172.21.15.123:6789/0 conn(0x7f1b4815a8c0 legacy=0x7f1b48070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b47fff700 1 -- 172.21.15.123:0/738011193 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b480ce830 con 0x7f1b4815b9b0 2024-09-13T17:10:15.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b3effd700 1 --2- 172.21.15.123:0/738011193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b48071580 0x7f1b480705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:15.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b47fff700 1 --2- 172.21.15.123:0/738011193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4815b9b0 0x7f1b480cc620 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009dc0 tx=0x7f1b4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7a7d2b13768580 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:15.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b46ffd700 1 -- 172.21.15.123:0/738011193 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4000e070 con 0x7f1b4815b9b0 2024-09-13T17:10:15.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b46ffd700 1 -- 172.21.15.123:0/738011193 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4000bb90 con 0x7f1b4815b9b0 2024-09-13T17:10:15.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b46ffd700 1 -- 172.21.15.123:0/738011193 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40012430 con 0x7f1b4815b9b0 2024-09-13T17:10:15.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b4cf36700 1 -- 172.21.15.123:0/738011193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4815b9b0 msgr2=0x7f1b480cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b4cf36700 1 --2- 172.21.15.123:0/738011193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4815b9b0 0x7f1b480cc620 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009dc0 tx=0x7f1b4000b330 comp rx=0 tx=0).stop 2024-09-13T17:10:15.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b4cf36700 1 -- 172.21.15.123:0/738011193 shutdown_connections 2024-09-13T17:10:15.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b4cf36700 1 --2- 172.21.15.123:0/738011193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4815b9b0 0x7f1b480cc620 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b4cf36700 1 --2- 172.21.15.123:0/738011193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b48071580 0x7f1b480705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b4cf36700 1 -- 172.21.15.123:0/738011193 >> 172.21.15.123:0/738011193 conn(0x7f1b48066150 msgr2=0x7f1b48066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:15.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b4cf36700 1 -- 172.21.15.123:0/738011193 shutdown_connections 2024-09-13T17:10:15.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b4cf36700 1 -- 172.21.15.123:0/738011193 wait complete. 2024-09-13T17:10:15.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b4cf36700 1 Processor -- start 2024-09-13T17:10:15.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.529+0000 7f1b4cf36700 1 -- start start 2024-09-13T17:10:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b4cf36700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b48071580 0x7f1b4814fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b4cf36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b4815a8c0 0x7f1b48144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b4cf36700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b4815b9b0 0x7f1b480ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b4cf36700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b48145970 con 0x7f1b48071580 2024-09-13T17:10:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b4cf36700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b48127a30 con 0x7f1b4815a8c0 2024-09-13T17:10:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b4cf36700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b48127cd0 con 0x7f1b4815b9b0 2024-09-13T17:10:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b477fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b48071580 0x7f1b4814fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b477fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b48071580 0x7f1b4814fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32920/0 (socket says 172.21.15.123:32920) 2024-09-13T17:10:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b477fe700 1 -- 172.21.15.123:0/1581995193 learned_addr learned my addr 172.21.15.123:0/1581995193 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b47fff700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b4815b9b0 0x7f1b480ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b3effd700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b4815a8c0 0x7f1b48144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b477fe700 1 -- 172.21.15.123:0/1581995193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b4815b9b0 msgr2=0x7f1b480ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b477fe700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b4815b9b0 0x7f1b480ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b477fe700 1 -- 172.21.15.123:0/1581995193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b4815a8c0 msgr2=0x7f1b48144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b477fe700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b4815a8c0 0x7f1b48144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b477fe700 1 -- 172.21.15.123:0/1581995193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b40009a70 con 0x7f1b48071580 2024-09-13T17:10:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b3effd700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b4815a8c0 0x7f1b48144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b477fe700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b48071580 0x7f1b4814fd90 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800c500 tx=0x7f1b3800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b44ff9700 1 -- 172.21.15.123:0/1581995193 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38005d90 con 0x7f1b48071580 2024-09-13T17:10:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b44ff9700 1 -- 172.21.15.123:0/1581995193 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b380070d0 con 0x7f1b48071580 2024-09-13T17:10:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b4cf36700 1 -- 172.21.15.123:0/1581995193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b48127fb0 con 0x7f1b48071580 2024-09-13T17:10:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b44ff9700 1 -- 172.21.15.123:0/1581995193 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38007460 con 0x7f1b48071580 2024-09-13T17:10:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b4cf36700 1 -- 172.21.15.123:0/1581995193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b481441b0 con 0x7f1b48071580 2024-09-13T17:10:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.533+0000 7f1b4cf36700 1 -- 172.21.15.123:0/1581995193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b480677f0 con 0x7f1b48071580 2024-09-13T17:10:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.537+0000 7f1b44ff9700 1 -- 172.21.15.123:0/1581995193 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1b380075c0 con 0x7f1b48071580 2024-09-13T17:10:15.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.537+0000 7f1b44ff9700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1b2c066760 0x7f1b2c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.537+0000 7f1b44ff9700 1 -- 172.21.15.123:0/1581995193 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b380839a0 con 0x7f1b48071580 2024-09-13T17:10:15.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.537+0000 7f1b3effd700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1b2c066760 0x7f1b2c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.537+0000 7f1b3effd700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1b2c066760 0x7f1b2c068c20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1b480665e0 tx=0x7f1b30008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:15.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.541+0000 7f1b44ff9700 1 -- 172.21.15.123:0/1581995193 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1b38050e80 con 0x7f1b48071580 2024-09-13T17:10:15.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.713+0000 7f1b4cf36700 1 -- 172.21.15.123:0/1581995193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b481284d0 con 0x7f1b48071580 2024-09-13T17:10:15.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.713+0000 7f1b44ff9700 1 -- 172.21.15.123:0/1581995193 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f1b481284d0 con 0x7f1b48071580 2024-09-13T17:10:15.721 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:15.721 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:01.118924+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:58.436099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:59.120652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.717+0000 7f1b4cf36700 1 -- 172.21.15.123:0/1581995193 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1b2c066760 msgr2=0x7f1b2c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.717+0000 7f1b4cf36700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1b2c066760 0x7f1b2c068c20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1b480665e0 tx=0x7f1b30008040 comp rx=0 tx=0).stop 2024-09-13T17:10:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.717+0000 7f1b4cf36700 1 -- 172.21.15.123:0/1581995193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b48071580 msgr2=0x7f1b4814fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.717+0000 7f1b4cf36700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b48071580 0x7f1b4814fd90 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800c500 tx=0x7f1b3800c8c0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.717+0000 7f1b4cf36700 1 -- 172.21.15.123:0/1581995193 shutdown_connections 2024-09-13T17:10:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.717+0000 7f1b4cf36700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1b2c066760 0x7f1b2c068c20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.717+0000 7f1b4cf36700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b4815b9b0 0x7f1b480ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.717+0000 7f1b4cf36700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b4815a8c0 0x7f1b48144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.717+0000 7f1b4cf36700 1 --2- 172.21.15.123:0/1581995193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b48071580 0x7f1b4814fd90 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.717+0000 7f1b4cf36700 1 -- 172.21.15.123:0/1581995193 >> 172.21.15.123:0/1581995193 conn(0x7f1b48066150 msgr2=0x7f1b480af900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:15.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.717+0000 7f1b4cf36700 1 -- 172.21.15.123:0/1581995193 shutdown_connections 2024-09-13T17:10:15.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.717+0000 7f1b4cf36700 1 -- 172.21.15.123:0/1581995193 wait complete. 2024-09-13T17:10:15.740 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:10:15.740 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:15.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.845+0000 7ff3bffff700 1 Processor -- start 2024-09-13T17:10:15.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.845+0000 7ff3bffff700 1 -- start start 2024-09-13T17:10:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.845+0000 7ff3bffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff3c0153f00 0x7ff3c00ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.845+0000 7ff3bffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3c015e0d0 0x7ff3c00cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.845+0000 7ff3bffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c015ab30 0x7ff3c00cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.845+0000 7ff3bffff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c00ced30 con 0x7ff3c0153f00 2024-09-13T17:10:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.845+0000 7ff3bffff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c01542e0 con 0x7ff3c015e0d0 2024-09-13T17:10:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.845+0000 7ff3bffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c0159df0 con 0x7ff3c015ab30 2024-09-13T17:10:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.845+0000 7ff3beffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff3c0153f00 0x7ff3c00ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.845+0000 7ff3beffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff3c0153f00 0x7ff3c00ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32928/0 (socket says 172.21.15.123:32928) 2024-09-13T17:10:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.845+0000 7ff3beffd700 1 -- 172.21.15.123:0/2216678903 learned_addr learned my addr 172.21.15.123:0/2216678903 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3bf7fe700 1 --2- 172.21.15.123:0/2216678903 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c015ab30 0x7ff3c00cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3b7fff700 1 --2- 172.21.15.123:0/2216678903 >> v2:172.21.15.153:3300/0 conn(0x7ff3c015e0d0 0x7ff3c00cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3beffd700 1 -- 172.21.15.123:0/2216678903 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c015ab30 msgr2=0x7ff3c00cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3beffd700 1 --2- 172.21.15.123:0/2216678903 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c015ab30 0x7ff3c00cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3beffd700 1 -- 172.21.15.123:0/2216678903 >> v2:172.21.15.153:3300/0 conn(0x7ff3c015e0d0 msgr2=0x7ff3c00cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3beffd700 1 --2- 172.21.15.123:0/2216678903 >> v2:172.21.15.153:3300/0 conn(0x7ff3c015e0d0 0x7ff3c00cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3beffd700 1 -- 172.21.15.123:0/2216678903 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c00cea50 con 0x7ff3c0153f00 2024-09-13T17:10:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3bf7fe700 1 --2- 172.21.15.123:0/2216678903 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c015ab30 0x7ff3c00cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3beffd700 1 --2- 172.21.15.123:0/2216678903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c0153f00 0x7ff3c00ce0e0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00cde80 tx=0x7ff3b000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bcc8c917519129 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3be7fc700 1 -- 172.21.15.123:0/2216678903 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b000dd90 con 0x7ff3c0153f00 2024-09-13T17:10:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3be7fc700 1 -- 172.21.15.123:0/2216678903 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b0010470 con 0x7ff3c0153f00 2024-09-13T17:10:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3be7fc700 1 -- 172.21.15.123:0/2216678903 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0010800 con 0x7ff3c0153f00 2024-09-13T17:10:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3bffff700 1 -- 172.21.15.123:0/2216678903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c0153f00 msgr2=0x7ff3c00ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3bffff700 1 --2- 172.21.15.123:0/2216678903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c0153f00 0x7ff3c00ce0e0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00cde80 tx=0x7ff3b000be90 comp rx=0 tx=0).stop 2024-09-13T17:10:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3bffff700 1 -- 172.21.15.123:0/2216678903 shutdown_connections 2024-09-13T17:10:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3bffff700 1 --2- 172.21.15.123:0/2216678903 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c015ab30 0x7ff3c00cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3bffff700 1 --2- 172.21.15.123:0/2216678903 >> v2:172.21.15.153:3300/0 conn(0x7ff3c015e0d0 0x7ff3c00cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3bffff700 1 --2- 172.21.15.123:0/2216678903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c0153f00 0x7ff3c00ce0e0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3bffff700 1 -- 172.21.15.123:0/2216678903 >> 172.21.15.123:0/2216678903 conn(0x7ff3c0066780 msgr2=0x7ff3c00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3bffff700 1 -- 172.21.15.123:0/2216678903 shutdown_connections 2024-09-13T17:10:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3bffff700 1 -- 172.21.15.123:0/2216678903 wait complete. 2024-09-13T17:10:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3bffff700 1 Processor -- start 2024-09-13T17:10:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.849+0000 7ff3bffff700 1 -- start start 2024-09-13T17:10:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3bffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c0153f00 0x7ff3c014eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3bffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c015ab30 0x7ff3c013aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3bffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c015e0d0 0x7ff3c00cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3bffff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c014e630 con 0x7ff3c015ab30 2024-09-13T17:10:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3bffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c013e250 con 0x7ff3c015e0d0 2024-09-13T17:10:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3bffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c014dfe0 con 0x7ff3c0153f00 2024-09-13T17:10:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3b7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c015ab30 0x7ff3c013aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3b7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c015ab30 0x7ff3c013aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32932/0 (socket says 172.21.15.123:32932) 2024-09-13T17:10:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3b7fff700 1 -- 172.21.15.123:0/1399680805 learned_addr learned my addr 172.21.15.123:0/1399680805 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3bf7fe700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c015e0d0 0x7ff3c00cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3beffd700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c0153f00 0x7ff3c014eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3b7fff700 1 -- 172.21.15.123:0/1399680805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c0153f00 msgr2=0x7ff3c014eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3b7fff700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c0153f00 0x7ff3c014eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3b7fff700 1 -- 172.21.15.123:0/1399680805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c015e0d0 msgr2=0x7ff3c00cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3b7fff700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c015e0d0 0x7ff3c00cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3b7fff700 1 -- 172.21.15.123:0/1399680805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b000b810 con 0x7ff3c015ab30 2024-09-13T17:10:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3bf7fe700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c015e0d0 0x7ff3c00cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3b7fff700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c015ab30 0x7ff3c013aa20 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800e810 tx=0x7ff3a800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3b77fe700 1 -- 172.21.15.123:0/1399680805 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8004230 con 0x7ff3c015ab30 2024-09-13T17:10:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3b77fe700 1 -- 172.21.15.123:0/1399680805 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a8004390 con 0x7ff3c015ab30 2024-09-13T17:10:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3bffff700 1 -- 172.21.15.123:0/1399680805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c014e2c0 con 0x7ff3c015ab30 2024-09-13T17:10:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3b77fe700 1 -- 172.21.15.123:0/1399680805 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a80036c0 con 0x7ff3c015ab30 2024-09-13T17:10:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3bffff700 1 -- 172.21.15.123:0/1399680805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c013af60 con 0x7ff3c015ab30 2024-09-13T17:10:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.853+0000 7ff3bffff700 1 -- 172.21.15.123:0/1399680805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c014e7e0 con 0x7ff3c015ab30 2024-09-13T17:10:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.857+0000 7ff3b77fe700 1 -- 172.21.15.123:0/1399680805 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3a8003840 con 0x7ff3c015ab30 2024-09-13T17:10:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.857+0000 7ff3b77fe700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3a0066780 0x7ff3a0068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.857+0000 7ff3b77fe700 1 -- 172.21.15.123:0/1399680805 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3a8083f90 con 0x7ff3c015ab30 2024-09-13T17:10:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.857+0000 7ff3beffd700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3a0066780 0x7ff3a0068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:15.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.857+0000 7ff3beffd700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3a0066780 0x7ff3a0068c40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff3b000bfd0 tx=0x7ff3b0013000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:15.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:15.865+0000 7ff3b77fe700 1 -- 172.21.15.123:0/1399680805 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3c014e7e0 con 0x7ff3c015ab30 2024-09-13T17:10:16.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.065+0000 7ff3bffff700 1 -- 172.21.15.123:0/1399680805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3c014de20 con 0x7ff3c015ab30 2024-09-13T17:10:16.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.065+0000 7ff3b77fe700 1 -- 172.21.15.123:0/1399680805 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4748 (secure 0 0 0) 0x7ff3a80512f0 con 0x7ff3c015ab30 2024-09-13T17:10:16.074 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:16.074 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":41,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6173,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3730345323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3730345323},{"type":"v1","addr":"172.21.15.153:6835","nonce":3730345323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1181784822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1181784822},{"type":"v1","addr":"172.21.15.153:6834","nonce":1181784822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1969180357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1969180357},{"type":"v1","addr":"172.21.15.123:6835","nonce":1969180357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:10:00.116252+0000","modified":"2024-09-13T17:10:02.136736+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2288571456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2288571456},{"type":"v1","addr":"172.21.15.123:6837","nonce":2288571456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T17:10:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.069+0000 7ff3bffff700 1 -- 172.21.15.123:0/1399680805 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3a0066780 msgr2=0x7ff3a0068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.069+0000 7ff3bffff700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3a0066780 0x7ff3a0068c40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff3b000bfd0 tx=0x7ff3b0013000 comp rx=0 tx=0).stop 2024-09-13T17:10:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.069+0000 7ff3bffff700 1 -- 172.21.15.123:0/1399680805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c015ab30 msgr2=0x7ff3c013aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.069+0000 7ff3bffff700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c015ab30 0x7ff3c013aa20 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800e810 tx=0x7ff3a800ebd0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.069+0000 7ff3bffff700 1 -- 172.21.15.123:0/1399680805 shutdown_connections 2024-09-13T17:10:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.069+0000 7ff3bffff700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff3a0066780 0x7ff3a0068c40 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.069+0000 7ff3bffff700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c015e0d0 0x7ff3c00cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.069+0000 7ff3bffff700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c015ab30 0x7ff3c013aa20 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.069+0000 7ff3bffff700 1 --2- 172.21.15.123:0/1399680805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff3c0153f00 0x7ff3c014eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.069+0000 7ff3bffff700 1 -- 172.21.15.123:0/1399680805 >> 172.21.15.123:0/1399680805 conn(0x7ff3c0066780 msgr2=0x7ff3c006fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.069+0000 7ff3bffff700 1 -- 172.21.15.123:0/1399680805 shutdown_connections 2024-09-13T17:10:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.069+0000 7ff3bffff700 1 -- 172.21.15.123:0/1399680805 wait complete. 2024-09-13T17:10:16.077 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 41 2024-09-13T17:10:16.088 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:16.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.201+0000 7f2dbbfff700 1 Processor -- start 2024-09-13T17:10:16.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.201+0000 7f2dbbfff700 1 -- start start 2024-09-13T17:10:16.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2dbbfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2db40df160 0x7f2db4039b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2dbbfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2db4033c10 0x7f2db4007100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2dbbfff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db40df540 con 0x7f2db4055b70 2024-09-13T17:10:16.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2dbbfff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db4055720 con 0x7f2db4033c10 2024-09-13T17:10:16.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2dbbfff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db400c3f0 con 0x7f2db40df160 2024-09-13T17:10:16.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2dbb7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2db4033c10 0x7f2db4007100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2dba7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2db4055b70 0x7f2db403a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35886/0 (socket says 172.21.15.123:35886) 2024-09-13T17:10:16.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2dba7fc700 1 -- 172.21.15.123:0/2250725961 learned_addr learned my addr 172.21.15.123:0/2250725961 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:16.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2dbaffd700 1 --2- 172.21.15.123:0/2250725961 >> v2:172.21.15.153:3300/0 conn(0x7f2db40df160 0x7f2db4039b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2db9ffb700 1 -- 172.21.15.123:0/2250725961 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397948640 0 0) 0x7f2db40df540 con 0x7f2db4055b70 2024-09-13T17:10:16.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2db9ffb700 1 -- 172.21.15.123:0/2250725961 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da40035d0 con 0x7f2db4055b70 2024-09-13T17:10:16.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2dbb7fe700 1 -- 172.21.15.123:0/2250725961 >> v2:172.21.15.153:3300/0 conn(0x7f2db40df160 msgr2=0x7f2db4039b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:16.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2dbb7fe700 1 --2- 172.21.15.123:0/2250725961 >> v2:172.21.15.153:3300/0 conn(0x7f2db40df160 0x7f2db4039b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2dbb7fe700 1 -- 172.21.15.123:0/2250725961 >> v1:172.21.15.123:6789/0 conn(0x7f2db4055b70 legacy=0x7f2db403a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2dbb7fe700 1 -- 172.21.15.123:0/2250725961 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db400a4d0 con 0x7f2db4033c10 2024-09-13T17:10:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2dbb7fe700 1 --2- 172.21.15.123:0/2250725961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db4033c10 0x7f2db4007100 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc000b60 tx=0x7f2dbc069900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73e8c8cda044572 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2db9ffb700 1 -- 172.21.15.123:0/2250725961 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0675b0 con 0x7f2db4033c10 2024-09-13T17:10:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2db9ffb700 1 -- 172.21.15.123:0/2250725961 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc073f10 con 0x7f2db4033c10 2024-09-13T17:10:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.205+0000 7f2db9ffb700 1 -- 172.21.15.123:0/2250725961 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc067710 con 0x7f2db4033c10 2024-09-13T17:10:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 -- 172.21.15.123:0/2250725961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db4033c10 msgr2=0x7f2db4007100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 --2- 172.21.15.123:0/2250725961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db4033c10 0x7f2db4007100 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc000b60 tx=0x7f2dbc069900 comp rx=0 tx=0).stop 2024-09-13T17:10:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 -- 172.21.15.123:0/2250725961 shutdown_connections 2024-09-13T17:10:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 --2- 172.21.15.123:0/2250725961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db4033c10 0x7f2db4007100 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 --2- 172.21.15.123:0/2250725961 >> v2:172.21.15.153:3300/0 conn(0x7f2db40df160 0x7f2db4039b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 -- 172.21.15.123:0/2250725961 >> 172.21.15.123:0/2250725961 conn(0x7f2db401e270 msgr2=0x7f2db4054ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 -- 172.21.15.123:0/2250725961 shutdown_connections 2024-09-13T17:10:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 -- 172.21.15.123:0/2250725961 wait complete. 2024-09-13T17:10:16.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 Processor -- start 2024-09-13T17:10:16.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 -- start start 2024-09-13T17:10:16.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2db4033c10 0x7f2db404bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db4055b70 0x7f2db40daf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2db40df160 0x7f2db416cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db416c090 con 0x7f2db4055b70 2024-09-13T17:10:16.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db416ba60 con 0x7f2db4033c10 2024-09-13T17:10:16.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dbbfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db404ea30 con 0x7f2db40df160 2024-09-13T17:10:16.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.209+0000 7f2dba7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db4055b70 0x7f2db40daf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2dba7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db4055b70 0x7f2db40daf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32950/0 (socket says 172.21.15.123:32950) 2024-09-13T17:10:16.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2dba7fc700 1 -- 172.21.15.123:0/747936882 learned_addr learned my addr 172.21.15.123:0/747936882 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:16.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2dbaffd700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2db4033c10 0x7f2db404bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2dbb7fe700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2db40df160 0x7f2db416cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2dba7fc700 1 -- 172.21.15.123:0/747936882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2db40df160 msgr2=0x7f2db416cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2dba7fc700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2db40df160 0x7f2db416cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2dba7fc700 1 -- 172.21.15.123:0/747936882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2db4033c10 msgr2=0x7f2db404bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2dba7fc700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2db4033c10 0x7f2db404bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2dba7fc700 1 -- 172.21.15.123:0/747936882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc04f5c0 con 0x7f2db4055b70 2024-09-13T17:10:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2dbaffd700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2db4033c10 0x7f2db404bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2dba7fc700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db4055b70 0x7f2db40daf90 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f2db0005930 tx=0x7f2db000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2da3fff700 1 -- 172.21.15.123:0/747936882 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db0005d90 con 0x7f2db4055b70 2024-09-13T17:10:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2da3fff700 1 -- 172.21.15.123:0/747936882 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db00070d0 con 0x7f2db4055b70 2024-09-13T17:10:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2dbbfff700 1 -- 172.21.15.123:0/747936882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db404ed10 con 0x7f2db4055b70 2024-09-13T17:10:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2da3fff700 1 -- 172.21.15.123:0/747936882 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db0007480 con 0x7f2db4055b70 2024-09-13T17:10:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2dbbfff700 1 -- 172.21.15.123:0/747936882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db40db4d0 con 0x7f2db4055b70 2024-09-13T17:10:16.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2dbbfff700 1 -- 172.21.15.123:0/747936882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db416c200 con 0x7f2db4055b70 2024-09-13T17:10:16.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.213+0000 7f2da3fff700 1 -- 172.21.15.123:0/747936882 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2db00075e0 con 0x7f2db4055b70 2024-09-13T17:10:16.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.217+0000 7f2da3fff700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2da8066730 0x7f2da8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.217+0000 7f2dbaffd700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2da8066730 0x7f2da8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.217+0000 7f2da3fff700 1 -- 172.21.15.123:0/747936882 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2db00836d0 con 0x7f2db4055b70 2024-09-13T17:10:16.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.217+0000 7f2dbaffd700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2da8066730 0x7f2da8068bf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009c30 tx=0x7f2dac008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:16.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.225+0000 7f2da3fff700 1 -- 172.21.15.123:0/747936882 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2db0050ad0 con 0x7f2db4055b70 2024-09-13T17:10:16.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.429+0000 7f2dbbfff700 1 -- 172.21.15.123:0/747936882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2db40df540 con 0x7f2db4055b70 2024-09-13T17:10:16.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.429+0000 7f2da3fff700 1 -- 172.21.15.123:0/747936882 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f2db00540f0 con 0x7f2db4055b70 2024-09-13T17:10:16.437 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:16.437 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":41,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6173,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3730345323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3730345323},{"type":"v1","addr":"172.21.15.153:6835","nonce":3730345323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1181784822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1181784822},{"type":"v1","addr":"172.21.15.153:6834","nonce":1181784822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1969180357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1969180357},{"type":"v1","addr":"172.21.15.123:6835","nonce":1969180357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:10:00.116252+0000","modified":"2024-09-13T17:10:02.136736+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/2288571456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2288571456},{"type":"v1","addr":"172.21.15.123:6837","nonce":2288571456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T17:10:16.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.433+0000 7f2dbbfff700 1 -- 172.21.15.123:0/747936882 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2da8066730 msgr2=0x7f2da8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.433+0000 7f2dbbfff700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2da8066730 0x7f2da8068bf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009c30 tx=0x7f2dac008040 comp rx=0 tx=0).stop 2024-09-13T17:10:16.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.433+0000 7f2dbbfff700 1 -- 172.21.15.123:0/747936882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db4055b70 msgr2=0x7f2db40daf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.433+0000 7f2dbbfff700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db4055b70 0x7f2db40daf90 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f2db0005930 tx=0x7f2db000ca90 comp rx=0 tx=0).stop 2024-09-13T17:10:16.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.433+0000 7f2dbbfff700 1 -- 172.21.15.123:0/747936882 shutdown_connections 2024-09-13T17:10:16.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.433+0000 7f2dbbfff700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2da8066730 0x7f2da8068bf0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.433+0000 7f2dbbfff700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2db40df160 0x7f2db416cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.433+0000 7f2dbbfff700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2db4055b70 0x7f2db40daf90 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.433+0000 7f2dbbfff700 1 --2- 172.21.15.123:0/747936882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2db4033c10 0x7f2db404bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.433+0000 7f2dbbfff700 1 -- 172.21.15.123:0/747936882 >> 172.21.15.123:0/747936882 conn(0x7f2db401e270 msgr2=0x7f2db40537b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:16.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.433+0000 7f2dbbfff700 1 -- 172.21.15.123:0/747936882 shutdown_connections 2024-09-13T17:10:16.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.433+0000 7f2dbbfff700 1 -- 172.21.15.123:0/747936882 wait complete. 2024-09-13T17:10:16.441 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 41 2024-09-13T17:10:16.452 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:16.458 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:10:16.499 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:10:16.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.553+0000 7f8f7f4c6700 1 Processor -- start 2024-09-13T17:10:16.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.553+0000 7f8f7f4c6700 1 -- start start 2024-09-13T17:10:16.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7f4c6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8f7815a8c0 0x7f8f780705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7f4c6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8f7815b9b0 0x7f8f78070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7f4c6700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f780cee80 con 0x7f8f780713b0 2024-09-13T17:10:16.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7f4c6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f78071820 con 0x7f8f7815a8c0 2024-09-13T17:10:16.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7f4c6700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f780ce270 con 0x7f8f7815b9b0 2024-09-13T17:10:16.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7e4c4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8f7815a8c0 0x7f8f780705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7e4c4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8f7815a8c0 0x7f8f780705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32952/0 (socket says 172.21.15.123:32952) 2024-09-13T17:10:16.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7e4c4700 1 -- 172.21.15.123:0/2838051712 learned_addr learned my addr 172.21.15.123:0/2838051712 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:16.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7dcc3700 1 --2- 172.21.15.123:0/2838051712 >> v2:172.21.15.153:3300/0 conn(0x7f8f7815b9b0 0x7f8f78070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7e4c4700 1 -- 172.21.15.123:0/2838051712 >> v2:172.21.15.153:3300/0 conn(0x7f8f7815b9b0 msgr2=0x7f8f78070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:16.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7e4c4700 1 --2- 172.21.15.123:0/2838051712 >> v2:172.21.15.153:3300/0 conn(0x7f8f7815b9b0 0x7f8f78070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7e4c4700 1 -- 172.21.15.123:0/2838051712 >> v1:172.21.15.153:6789/0 conn(0x7f8f780713b0 legacy=0x7f8f780cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7e4c4700 1 -- 172.21.15.123:0/2838051712 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f780ce550 con 0x7f8f7815a8c0 2024-09-13T17:10:16.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7e4c4700 1 --2- 172.21.15.123:0/2838051712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f7815a8c0 0x7f8f780705b0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f8f780cdf90 tx=0x7f8f6c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd69c44be029448 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:16.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7d4c2700 1 -- 172.21.15.123:0/2838051712 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c011830 con 0x7f8f7815a8c0 2024-09-13T17:10:16.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7d4c2700 1 -- 172.21.15.123:0/2838051712 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c011990 con 0x7f8f7815a8c0 2024-09-13T17:10:16.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7d4c2700 1 -- 172.21.15.123:0/2838051712 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c011d20 con 0x7f8f7815a8c0 2024-09-13T17:10:16.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/2838051712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f7815a8c0 msgr2=0x7f8f780705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7f4c6700 1 --2- 172.21.15.123:0/2838051712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f7815a8c0 0x7f8f780705b0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f8f780cdf90 tx=0x7f8f6c009bf0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/2838051712 shutdown_connections 2024-09-13T17:10:16.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7f4c6700 1 --2- 172.21.15.123:0/2838051712 >> v2:172.21.15.153:3300/0 conn(0x7f8f7815b9b0 0x7f8f78070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7f4c6700 1 --2- 172.21.15.123:0/2838051712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f7815a8c0 0x7f8f780705b0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/2838051712 >> 172.21.15.123:0/2838051712 conn(0x7f8f78066150 msgr2=0x7f8f78066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:16.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/2838051712 shutdown_connections 2024-09-13T17:10:16.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/2838051712 wait complete. 2024-09-13T17:10:16.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.557+0000 7f8f7f4c6700 1 Processor -- start 2024-09-13T17:10:16.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7f4c6700 1 -- start start 2024-09-13T17:10:16.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7f4c6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f780713b0 0x7f8f781f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7f4c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f7815a8c0 0x7f8f78151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7f4c6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f7815b9b0 0x7f8f781540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7f4c6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f78152270 con 0x7f8f7815a8c0 2024-09-13T17:10:16.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7f4c6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f78152520 con 0x7f8f780713b0 2024-09-13T17:10:16.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7f4c6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f78152800 con 0x7f8f7815b9b0 2024-09-13T17:10:16.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7dcc3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f7815a8c0 0x7f8f78151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7dcc3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f7815a8c0 0x7f8f78151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32964/0 (socket says 172.21.15.123:32964) 2024-09-13T17:10:16.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7dcc3700 1 -- 172.21.15.123:0/1590673369 learned_addr learned my addr 172.21.15.123:0/1590673369 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:16.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7e4c4700 1 --2- 172.21.15.123:0/1590673369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f780713b0 0x7f8f781f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7ecc5700 1 --2- 172.21.15.123:0/1590673369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f7815b9b0 0x7f8f781540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7dcc3700 1 -- 172.21.15.123:0/1590673369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f7815b9b0 msgr2=0x7f8f781540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7dcc3700 1 --2- 172.21.15.123:0/1590673369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f7815b9b0 0x7f8f781540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7dcc3700 1 -- 172.21.15.123:0/1590673369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f780713b0 msgr2=0x7f8f781f0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7dcc3700 1 --2- 172.21.15.123:0/1590673369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f780713b0 0x7f8f781f0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7dcc3700 1 -- 172.21.15.123:0/1590673369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c009570 con 0x7f8f7815a8c0 2024-09-13T17:10:16.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7dcc3700 1 --2- 172.21.15.123:0/1590673369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f7815a8c0 0x7f8f78151d30 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800efc0 tx=0x7f8f6800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:16.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f76ffd700 1 -- 172.21.15.123:0/1590673369 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6800cc00 con 0x7f8f7815a8c0 2024-09-13T17:10:16.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f76ffd700 1 -- 172.21.15.123:0/1590673369 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6800f040 con 0x7f8f7815a8c0 2024-09-13T17:10:16.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/1590673369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f78152ae0 con 0x7f8f7815a8c0 2024-09-13T17:10:16.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f76ffd700 1 -- 172.21.15.123:0/1590673369 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68014480 con 0x7f8f7815a8c0 2024-09-13T17:10:16.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/1590673369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f781530a0 con 0x7f8f7815a8c0 2024-09-13T17:10:16.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.561+0000 7f8f76ffd700 1 -- 172.21.15.123:0/1590673369 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8f680145e0 con 0x7f8f7815a8c0 2024-09-13T17:10:16.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.565+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/1590673369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f780677f0 con 0x7f8f7815a8c0 2024-09-13T17:10:16.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.565+0000 7f8f76ffd700 1 --2- 172.21.15.123:0/1590673369 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8f64066760 0x7f8f64068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.565+0000 7f8f76ffd700 1 -- 172.21.15.123:0/1590673369 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f68084c90 con 0x7f8f7815a8c0 2024-09-13T17:10:16.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.565+0000 7f8f7e4c4700 1 --2- 172.21.15.123:0/1590673369 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8f64066760 0x7f8f64068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.565+0000 7f8f7e4c4700 1 --2- 172.21.15.123:0/1590673369 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8f64066760 0x7f8f64068c20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c000c00 tx=0x7f8f6c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:16.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.573+0000 7f8f76ffd700 1 -- 172.21.15.123:0/1590673369 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8f68052000 con 0x7f8f7815a8c0 2024-09-13T17:10:16.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.745+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/1590673369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f780705b0 con 0x7f8f7815a8c0 2024-09-13T17:10:16.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.745+0000 7f8f76ffd700 1 -- 172.21.15.123:0/1590673369 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f8f68018090 con 0x7f8f7815a8c0 2024-09-13T17:10:16.753 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:16.754 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:01.118924+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:09:58.436099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T17:09:59.120652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.749+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/1590673369 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8f64066760 msgr2=0x7f8f64068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.749+0000 7f8f7f4c6700 1 --2- 172.21.15.123:0/1590673369 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8f64066760 0x7f8f64068c20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c000c00 tx=0x7f8f6c008030 comp rx=0 tx=0).stop 2024-09-13T17:10:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.749+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/1590673369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f7815a8c0 msgr2=0x7f8f78151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.749+0000 7f8f7f4c6700 1 --2- 172.21.15.123:0/1590673369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f7815a8c0 0x7f8f78151d30 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800efc0 tx=0x7f8f6800c0c0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.749+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/1590673369 shutdown_connections 2024-09-13T17:10:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.749+0000 7f8f7f4c6700 1 --2- 172.21.15.123:0/1590673369 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8f64066760 0x7f8f64068c20 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.749+0000 7f8f7f4c6700 1 --2- 172.21.15.123:0/1590673369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8f7815b9b0 0x7f8f781540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.749+0000 7f8f7f4c6700 1 --2- 172.21.15.123:0/1590673369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f7815a8c0 0x7f8f78151d30 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.749+0000 7f8f7f4c6700 1 --2- 172.21.15.123:0/1590673369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f780713b0 0x7f8f781f0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.749+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/1590673369 >> 172.21.15.123:0/1590673369 conn(0x7f8f78066150 msgr2=0x7f8f780ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.749+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/1590673369 shutdown_connections 2024-09-13T17:10:16.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.749+0000 7f8f7f4c6700 1 -- 172.21.15.123:0/1590673369 wait complete. 2024-09-13T17:10:16.768 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:10:16.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 Processor -- start 2024-09-13T17:10:16.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 -- start start 2024-09-13T17:10:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff51015b000 0x7ff510071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5100ccfd0 0x7ff5100cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff5100cd410 0x7ff5100cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5100cdb90 con 0x7ff51015b000 2024-09-13T17:10:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5100cc580 con 0x7ff5100cd410 2024-09-13T17:10:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100cdde0 con 0x7ff5100ccfd0 2024-09-13T17:10:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5152ba700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff51015b000 0x7ff510071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5152ba700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff51015b000 0x7ff510071f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32970/0 (socket says 172.21.15.123:32970) 2024-09-13T17:10:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5152ba700 1 -- 172.21.15.123:0/2882711053 learned_addr learned my addr 172.21.15.123:0/2882711053 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5152ba700 1 -- 172.21.15.123:0/2882711053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5100ccfd0 msgr2=0x7ff5100cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5152ba700 1 --2- 172.21.15.123:0/2882711053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5100ccfd0 0x7ff5100cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5152ba700 1 -- 172.21.15.123:0/2882711053 >> v2:172.21.15.153:3300/0 conn(0x7ff5100cd410 msgr2=0x7ff5100cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5152ba700 1 --2- 172.21.15.123:0/2882711053 >> v2:172.21.15.153:3300/0 conn(0x7ff5100cd410 0x7ff5100cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5152ba700 1 -- 172.21.15.123:0/2882711053 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5100ce0c0 con 0x7ff51015b000 2024-09-13T17:10:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5152ba700 1 --2- 172.21.15.123:0/2882711053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff51015b000 0x7ff510071f50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7ff5100cc050 tx=0x7ff50c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ec6955f03e1f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff507fff700 1 -- 172.21.15.123:0/2882711053 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c00b8a0 con 0x7ff51015b000 2024-09-13T17:10:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff507fff700 1 -- 172.21.15.123:0/2882711053 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c00ba00 con 0x7ff51015b000 2024-09-13T17:10:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff507fff700 1 -- 172.21.15.123:0/2882711053 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c00bd90 con 0x7ff51015b000 2024-09-13T17:10:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 -- 172.21.15.123:0/2882711053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff51015b000 msgr2=0x7ff510071f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 --2- 172.21.15.123:0/2882711053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff51015b000 0x7ff510071f50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7ff5100cc050 tx=0x7ff50c009bf0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 -- 172.21.15.123:0/2882711053 shutdown_connections 2024-09-13T17:10:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 --2- 172.21.15.123:0/2882711053 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5100ccfd0 0x7ff5100cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 --2- 172.21.15.123:0/2882711053 >> v2:172.21.15.153:3300/0 conn(0x7ff5100cd410 0x7ff5100cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 --2- 172.21.15.123:0/2882711053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff51015b000 0x7ff510071f50 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 -- 172.21.15.123:0/2882711053 >> 172.21.15.123:0/2882711053 conn(0x7ff5100b01d0 msgr2=0x7ff5100b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 -- 172.21.15.123:0/2882711053 shutdown_connections 2024-09-13T17:10:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.881+0000 7ff5162bc700 1 -- 172.21.15.123:0/2882711053 wait complete. 2024-09-13T17:10:16.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff5162bc700 1 Processor -- start 2024-09-13T17:10:16.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff5162bc700 1 -- start start 2024-09-13T17:10:16.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff5162bc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5100ccfd0 0x7ff51014dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff5162bc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5100cd410 0x7ff5100c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff5162bc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff51015b000 0x7ff5100c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff5162bc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100b1790 con 0x7ff51015b000 2024-09-13T17:10:16.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff5162bc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100c8a00 con 0x7ff5100cd410 2024-09-13T17:10:16.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff5162bc700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100c8160 con 0x7ff5100ccfd0 2024-09-13T17:10:16.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff515abb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff51015b000 0x7ff5100c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff5152ba700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5100ccfd0 0x7ff51014dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff5152ba700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5100ccfd0 0x7ff51014dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:36018/0 (socket says 172.21.15.123:36018) 2024-09-13T17:10:16.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff5152ba700 1 -- 172.21.15.123:0/4144610468 learned_addr learned my addr 172.21.15.123:0/4144610468 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:16.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff515abb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff51015b000 0x7ff5100c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32980/0 (socket says 172.21.15.123:32980) 2024-09-13T17:10:16.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff514ab9700 1 --2- 172.21.15.123:0/4144610468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5100cd410 0x7ff5100c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff515abb700 1 -- 172.21.15.123:0/4144610468 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5100ccfd0 msgr2=0x7ff51014dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff515abb700 1 --2- 172.21.15.123:0/4144610468 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5100ccfd0 0x7ff51014dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff515abb700 1 -- 172.21.15.123:0/4144610468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5100cd410 msgr2=0x7ff5100c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:16.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff515abb700 1 --2- 172.21.15.123:0/4144610468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5100cd410 0x7ff5100c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:16.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff515abb700 1 -- 172.21.15.123:0/4144610468 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c009570 con 0x7ff51015b000 2024-09-13T17:10:16.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff515abb700 1 --2- 172.21.15.123:0/4144610468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff51015b000 0x7ff5100c4700 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff50800be20 tx=0x7ff508009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:16.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff505ffb700 1 -- 172.21.15.123:0/4144610468 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50800cb90 con 0x7ff51015b000 2024-09-13T17:10:16.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff505ffb700 1 -- 172.21.15.123:0/4144610468 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50800cd10 con 0x7ff51015b000 2024-09-13T17:10:16.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff5162bc700 1 -- 172.21.15.123:0/4144610468 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5100c8440 con 0x7ff51015b000 2024-09-13T17:10:16.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff505ffb700 1 -- 172.21.15.123:0/4144610468 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508014680 con 0x7ff51015b000 2024-09-13T17:10:16.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.885+0000 7ff5162bc700 1 -- 172.21.15.123:0/4144610468 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51014e1e0 con 0x7ff51015b000 2024-09-13T17:10:16.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.889+0000 7ff5162bc700 1 -- 172.21.15.123:0/4144610468 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5100b18d0 con 0x7ff51015b000 2024-09-13T17:10:16.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.889+0000 7ff505ffb700 1 -- 172.21.15.123:0/4144610468 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff50801d3b0 con 0x7ff51015b000 2024-09-13T17:10:16.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.889+0000 7ff505ffb700 1 --2- 172.21.15.123:0/4144610468 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4f4066730 0x7ff4f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:16.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.889+0000 7ff505ffb700 1 -- 172.21.15.123:0/4144610468 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff508083ff0 con 0x7ff51015b000 2024-09-13T17:10:16.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.889+0000 7ff5152ba700 1 --2- 172.21.15.123:0/4144610468 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4f4066730 0x7ff4f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:16.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.889+0000 7ff5152ba700 1 --2- 172.21.15.123:0/4144610468 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4f4066730 0x7ff4f4068bf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009c30 tx=0x7ff50c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:16.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:16.897+0000 7ff505ffb700 1 -- 172.21.15.123:0/4144610468 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5100b18d0 con 0x7ff51015b000 2024-09-13T17:10:17.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.101+0000 7ff5162bc700 1 -- 172.21.15.123:0/4144610468 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff5100b18d0 con 0x7ff51015b000 2024-09-13T17:10:17.109 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-13T17:10:17.101+0000 7f1c63ac9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:10:17.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.113+0000 7ff505ffb700 1 -- 172.21.15.123:0/4144610468 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff5100b18d0 con 0x7ff51015b000 2024-09-13T17:10:17.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.117+0000 7ff5162bc700 1 -- 172.21.15.123:0/4144610468 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4f4066730 msgr2=0x7ff4f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:17.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.117+0000 7ff5162bc700 1 --2- 172.21.15.123:0/4144610468 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4f4066730 0x7ff4f4068bf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009c30 tx=0x7ff50c008030 comp rx=0 tx=0).stop 2024-09-13T17:10:17.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.117+0000 7ff5162bc700 1 -- 172.21.15.123:0/4144610468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff51015b000 msgr2=0x7ff5100c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:17.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.117+0000 7ff5162bc700 1 --2- 172.21.15.123:0/4144610468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff51015b000 0x7ff5100c4700 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff50800be20 tx=0x7ff508009ed0 comp rx=0 tx=0).stop 2024-09-13T17:10:17.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.117+0000 7ff5162bc700 1 -- 172.21.15.123:0/4144610468 shutdown_connections 2024-09-13T17:10:17.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.117+0000 7ff5162bc700 1 --2- 172.21.15.123:0/4144610468 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff4f4066730 0x7ff4f4068bf0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:17.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.117+0000 7ff5162bc700 1 --2- 172.21.15.123:0/4144610468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff51015b000 0x7ff5100c4700 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:17.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.117+0000 7ff5162bc700 1 --2- 172.21.15.123:0/4144610468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5100cd410 0x7ff5100c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:17.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.117+0000 7ff5162bc700 1 --2- 172.21.15.123:0/4144610468 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5100ccfd0 0x7ff51014dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:17.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.117+0000 7ff5162bc700 1 -- 172.21.15.123:0/4144610468 >> 172.21.15.123:0/4144610468 conn(0x7ff5100b01d0 msgr2=0x7ff5100cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:17.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.117+0000 7ff5162bc700 1 -- 172.21.15.123:0/4144610468 shutdown_connections 2024-09-13T17:10:17.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.117+0000 7ff5162bc700 1 -- 172.21.15.123:0/4144610468 wait complete. 2024-09-13T17:10:17.125 INFO:tasks.ceph.mds.c.smithi123.stderr: -1810> 2024-09-13T17:10:06.014+0000 7f51ff6e9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:10:17.126 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:10:17.138 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:10:17.156 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-13T17:10:17.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.241+0000 7fcd429e5700 1 Processor -- start 2024-09-13T17:10:17.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.241+0000 7fcd429e5700 1 -- start start 2024-09-13T17:10:17.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd429e5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcd3c15b5a0 0x7fcd3c06a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:17.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd429e5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd3c06f280 0x7fcd3c06f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:17.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd429e5700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3c06aa90 con 0x7fcd3c15b980 2024-09-13T17:10:17.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd429e5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3c06fc30 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd429e5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c06d1a0 con 0x7fcd3c06f280 2024-09-13T17:10:17.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd3bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcd3c15b5a0 0x7fcd3c06a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:17.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd3bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcd3c15b5a0 0x7fcd3c06a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33006/0 (socket says 172.21.15.123:33006) 2024-09-13T17:10:17.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd3bfff700 1 -- 172.21.15.123:0/2794525458 learned_addr learned my addr 172.21.15.123:0/2794525458 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:17.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd40f82700 1 --2- 172.21.15.123:0/2794525458 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd3c06f280 0x7fcd3c06f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:17.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd3bfff700 1 -- 172.21.15.123:0/2794525458 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd3c06f280 msgr2=0x7fcd3c06f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:17.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd3bfff700 1 --2- 172.21.15.123:0/2794525458 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd3c06f280 0x7fcd3c06f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:17.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd3bfff700 1 -- 172.21.15.123:0/2794525458 >> v1:172.21.15.153:6789/0 conn(0x7fcd3c15b980 legacy=0x7fcd3c06dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:17.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd3bfff700 1 -- 172.21.15.123:0/2794525458 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c06d480 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd3bfff700 1 --2- 172.21.15.123:0/2794525458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd3c15b5a0 0x7fcd3c06a260 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009910 tx=0x7fcd2c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fde9359fbd79cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:17.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd3affd700 1 -- 172.21.15.123:0/2794525458 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c011830 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd3affd700 1 -- 172.21.15.123:0/2794525458 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c011990 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd3affd700 1 -- 172.21.15.123:0/2794525458 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c011d40 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd429e5700 1 -- 172.21.15.123:0/2794525458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd3c15b5a0 msgr2=0x7fcd3c06a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:17.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd429e5700 1 --2- 172.21.15.123:0/2794525458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd3c15b5a0 0x7fcd3c06a260 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009910 tx=0x7fcd2c009c20 comp rx=0 tx=0).stop 2024-09-13T17:10:17.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd429e5700 1 -- 172.21.15.123:0/2794525458 shutdown_connections 2024-09-13T17:10:17.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd429e5700 1 --2- 172.21.15.123:0/2794525458 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd3c06f280 0x7fcd3c06f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:17.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd429e5700 1 --2- 172.21.15.123:0/2794525458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd3c15b5a0 0x7fcd3c06a260 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:17.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd429e5700 1 -- 172.21.15.123:0/2794525458 >> 172.21.15.123:0/2794525458 conn(0x7fcd3c0b1700 msgr2=0x7fcd3c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:17.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd429e5700 1 -- 172.21.15.123:0/2794525458 shutdown_connections 2024-09-13T17:10:17.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.245+0000 7fcd429e5700 1 -- 172.21.15.123:0/2794525458 wait complete. 2024-09-13T17:10:17.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd429e5700 1 Processor -- start 2024-09-13T17:10:17.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd429e5700 1 -- start start 2024-09-13T17:10:17.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd429e5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd3c06f280 0x7fcd3c1e5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:17.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd429e5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd3c15b5a0 0x7fcd3c14bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:17.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd429e5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd3c15b980 0x7fcd3c15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:17.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd429e5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c153ef0 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd429e5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c14b1c0 con 0x7fcd3c06f280 2024-09-13T17:10:17.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd429e5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c14b4a0 con 0x7fcd3c15b980 2024-09-13T17:10:17.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd3b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd3c15b5a0 0x7fcd3c14bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:17.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd3b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd3c15b5a0 0x7fcd3c14bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33018/0 (socket says 172.21.15.123:33018) 2024-09-13T17:10:17.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd3b7fe700 1 -- 172.21.15.123:0/839565970 learned_addr learned my addr 172.21.15.123:0/839565970 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:17.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd3bfff700 1 --2- 172.21.15.123:0/839565970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd3c06f280 0x7fcd3c1e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:17.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd40f82700 1 --2- 172.21.15.123:0/839565970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd3c15b980 0x7fcd3c15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:17.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd3b7fe700 1 -- 172.21.15.123:0/839565970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd3c15b980 msgr2=0x7fcd3c15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:17.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd3b7fe700 1 --2- 172.21.15.123:0/839565970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd3c15b980 0x7fcd3c15caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:17.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd3b7fe700 1 -- 172.21.15.123:0/839565970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd3c06f280 msgr2=0x7fcd3c1e5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:17.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd3b7fe700 1 --2- 172.21.15.123:0/839565970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd3c06f280 0x7fcd3c1e5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:17.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.249+0000 7fcd3b7fe700 1 -- 172.21.15.123:0/839565970 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c009570 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.253+0000 7fcd3b7fe700 1 --2- 172.21.15.123:0/839565970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd3c15b5a0 0x7fcd3c14bca0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000c410 tx=0x7fcd3000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:17.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.253+0000 7fcd38ff9700 1 -- 172.21.15.123:0/839565970 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd300052d0 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.253+0000 7fcd38ff9700 1 -- 172.21.15.123:0/839565970 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd30005430 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.253+0000 7fcd429e5700 1 -- 172.21.15.123:0/839565970 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3c14b780 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.253+0000 7fcd38ff9700 1 -- 172.21.15.123:0/839565970 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd300055a0 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.253+0000 7fcd429e5700 1 -- 172.21.15.123:0/839565970 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3c1e5fb0 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.253+0000 7fcd429e5700 1 -- 172.21.15.123:0/839565970 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3c14b9c0 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.257+0000 7fcd38ff9700 1 -- 172.21.15.123:0/839565970 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd300036a0 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.257+0000 7fcd38ff9700 1 --2- 172.21.15.123:0/839565970 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd28066730 0x7fcd28068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:17.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.257+0000 7fcd3bfff700 1 --2- 172.21.15.123:0/839565970 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd28066730 0x7fcd28068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:17.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.257+0000 7fcd38ff9700 1 -- 172.21.15.123:0/839565970 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fcd300833f0 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.257+0000 7fcd3bfff700 1 --2- 172.21.15.123:0/839565970 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd28066730 0x7fcd28068bf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009c60 tx=0x7fcd2c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:17.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.261+0000 7fcd38ff9700 1 -- 172.21.15.123:0/839565970 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcd300507e0 con 0x7fcd3c15b5a0 2024-09-13T17:10:17.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:17.477+0000 7fcd429e5700 1 -- 172.21.15.123:0/839565970 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcd3c1e5fb0 con 0x7fcd3c15b5a0 2024-09-13T17:10:18.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.117+0000 7fcd38ff9700 1 -- 172.21.15.123:0/839565970 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcd30053e00 con 0x7fcd3c15b5a0 2024-09-13T17:10:18.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.125+0000 7fcd429e5700 1 -- 172.21.15.123:0/839565970 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd28066730 msgr2=0x7fcd28068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.125+0000 7fcd429e5700 1 --2- 172.21.15.123:0/839565970 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd28066730 0x7fcd28068bf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009c60 tx=0x7fcd2c008030 comp rx=0 tx=0).stop 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.125+0000 7fcd429e5700 1 -- 172.21.15.123:0/839565970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd3c15b5a0 msgr2=0x7fcd3c14bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.125+0000 7fcd429e5700 1 --2- 172.21.15.123:0/839565970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd3c15b5a0 0x7fcd3c14bca0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000c410 tx=0x7fcd3000c720 comp rx=0 tx=0).stop 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.125+0000 7fcd429e5700 1 -- 172.21.15.123:0/839565970 shutdown_connections 2024-09-13T17:10:18.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.125+0000 7fcd429e5700 1 --2- 172.21.15.123:0/839565970 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcd28066730 0x7fcd28068bf0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.125+0000 7fcd429e5700 1 --2- 172.21.15.123:0/839565970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcd3c15b980 0x7fcd3c15caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.125+0000 7fcd429e5700 1 --2- 172.21.15.123:0/839565970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd3c15b5a0 0x7fcd3c14bca0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.125+0000 7fcd429e5700 1 --2- 172.21.15.123:0/839565970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd3c06f280 0x7fcd3c1e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.125+0000 7fcd429e5700 1 -- 172.21.15.123:0/839565970 >> 172.21.15.123:0/839565970 conn(0x7fcd3c0b1700 msgr2=0x7fcd3c074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.125+0000 7fcd429e5700 1 -- 172.21.15.123:0/839565970 shutdown_connections 2024-09-13T17:10:18.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.125+0000 7fcd429e5700 1 -- 172.21.15.123:0/839565970 wait complete. 2024-09-13T17:10:18.147 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:10:18.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.265+0000 7fbb29d5e700 1 Processor -- start 2024-09-13T17:10:18.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.265+0000 7fbb29d5e700 1 -- start start 2024-09-13T17:10:18.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb29d5e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240d3220 0x7fbb240d36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:18.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb29d5e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbb240d1080 0x7fbb240d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:18.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb29d5e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb241606f0 con 0x7fbb24160310 2024-09-13T17:10:18.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb29d5e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb240d1a70 con 0x7fbb240d1080 2024-09-13T17:10:18.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb29d5e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240ce7b0 con 0x7fbb240d3220 2024-09-13T17:10:18.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb2955d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbb240d1080 0x7fbb240d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:18.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb2955d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbb240d1080 0x7fbb240d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:49182/0 (socket says 172.21.15.123:49182) 2024-09-13T17:10:18.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb28d5c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbb24160310 0x7fbb240cf850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:45140/0 (socket says 172.21.15.123:45140) 2024-09-13T17:10:18.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb2955d700 1 -- 172.21.15.123:0/2829284091 learned_addr learned my addr 172.21.15.123:0/2829284091 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:18.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb23fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240d3220 0x7fbb240d36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:18.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb2955d700 1 -- 172.21.15.123:0/2829284091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240d3220 msgr2=0x7fbb240d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:18.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb2955d700 1 --2- 172.21.15.123:0/2829284091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240d3220 0x7fbb240d36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:18.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb2955d700 1 -- 172.21.15.123:0/2829284091 >> v1:172.21.15.153:6789/0 conn(0x7fbb24160310 legacy=0x7fbb240cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:18.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb2955d700 1 -- 172.21.15.123:0/2829284091 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb240cea90 con 0x7fbb240d1080 2024-09-13T17:10:18.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb2955d700 1 --2- 172.21.15.123:0/2829284091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb240d1080 0x7fbb240d1530 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009e50 tx=0x7fbb1c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=264058657bd62860 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:18.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb237fe700 1 -- 172.21.15.123:0/2829284091 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c00e070 con 0x7fbb240d1080 2024-09-13T17:10:18.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb237fe700 1 -- 172.21.15.123:0/2829284091 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c00b910 con 0x7fbb240d1080 2024-09-13T17:10:18.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb237fe700 1 -- 172.21.15.123:0/2829284091 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c00bcc0 con 0x7fbb240d1080 2024-09-13T17:10:18.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb29d5e700 1 -- 172.21.15.123:0/2829284091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb240d1080 msgr2=0x7fbb240d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:18.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb29d5e700 1 --2- 172.21.15.123:0/2829284091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb240d1080 0x7fbb240d1530 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009e50 tx=0x7fbb1c00b330 comp rx=0 tx=0).stop 2024-09-13T17:10:18.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb29d5e700 1 -- 172.21.15.123:0/2829284091 shutdown_connections 2024-09-13T17:10:18.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb29d5e700 1 --2- 172.21.15.123:0/2829284091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb240d1080 0x7fbb240d1530 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:18.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb29d5e700 1 --2- 172.21.15.123:0/2829284091 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240d3220 0x7fbb240d36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:18.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb29d5e700 1 -- 172.21.15.123:0/2829284091 >> 172.21.15.123:0/2829284091 conn(0x7fbb2409be50 msgr2=0x7fbb240d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:18.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb29d5e700 1 -- 172.21.15.123:0/2829284091 shutdown_connections 2024-09-13T17:10:18.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.269+0000 7fbb29d5e700 1 -- 172.21.15.123:0/2829284091 wait complete. 2024-09-13T17:10:18.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb29d5e700 1 Processor -- start 2024-09-13T17:10:18.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb29d5e700 1 -- start start 2024-09-13T17:10:18.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb29d5e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb240d1080 0x7fbb24157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:18.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb29d5e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240d3220 0x7fbb2415d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:18.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb29d5e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb24160310 0x7fbb240ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:18.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb29d5e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240cb1d0 con 0x7fbb240d1080 2024-09-13T17:10:18.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb29d5e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240c6770 con 0x7fbb24160310 2024-09-13T17:10:18.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb29d5e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240caef0 con 0x7fbb240d3220 2024-09-13T17:10:18.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb28d5c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb240d1080 0x7fbb24157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:18.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb28d5c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb240d1080 0x7fbb24157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33020/0 (socket says 172.21.15.123:33020) 2024-09-13T17:10:18.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb28d5c700 1 -- 172.21.15.123:0/1920968680 learned_addr learned my addr 172.21.15.123:0/1920968680 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:18.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb2955d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb24160310 0x7fbb240ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:18.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb23fff700 1 --2- 172.21.15.123:0/1920968680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240d3220 0x7fbb2415d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:18.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb2955d700 1 -- 172.21.15.123:0/1920968680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240d3220 msgr2=0x7fbb2415d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:18.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb2955d700 1 --2- 172.21.15.123:0/1920968680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240d3220 0x7fbb2415d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:18.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb2955d700 1 -- 172.21.15.123:0/1920968680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb240d1080 msgr2=0x7fbb24157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:18.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb2955d700 1 --2- 172.21.15.123:0/1920968680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb240d1080 0x7fbb24157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:18.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.273+0000 7fbb2955d700 1 -- 172.21.15.123:0/1920968680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c009b30 con 0x7fbb24160310 2024-09-13T17:10:18.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.277+0000 7fbb2955d700 1 --2- 172.21.15.123:0/1920968680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb24160310 0x7fbb240ca5f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c015000 tx=0x7fbb1c004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:18.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.277+0000 7fbb217fa700 1 -- 172.21.15.123:0/1920968680 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c004900 con 0x7fbb24160310 2024-09-13T17:10:18.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.277+0000 7fbb217fa700 1 -- 172.21.15.123:0/1920968680 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c0092e0 con 0x7fbb24160310 2024-09-13T17:10:18.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.277+0000 7fbb29d5e700 1 -- 172.21.15.123:0/1920968680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb240c6a10 con 0x7fbb24160310 2024-09-13T17:10:18.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.277+0000 7fbb217fa700 1 -- 172.21.15.123:0/1920968680 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c01c660 con 0x7fbb24160310 2024-09-13T17:10:18.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.277+0000 7fbb29d5e700 1 -- 172.21.15.123:0/1920968680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb240cab30 con 0x7fbb24160310 2024-09-13T17:10:18.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.277+0000 7fbb29d5e700 1 -- 172.21.15.123:0/1920968680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb240cacc0 con 0x7fbb24160310 2024-09-13T17:10:18.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.277+0000 7fbb217fa700 1 -- 172.21.15.123:0/1920968680 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbb1c01c7c0 con 0x7fbb24160310 2024-09-13T17:10:18.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.277+0000 7fbb217fa700 1 --2- 172.21.15.123:0/1920968680 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb08066730 0x7fbb08068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:18.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.277+0000 7fbb217fa700 1 -- 172.21.15.123:0/1920968680 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fbb1c085a10 con 0x7fbb24160310 2024-09-13T17:10:18.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.281+0000 7fbb28d5c700 1 --2- 172.21.15.123:0/1920968680 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb08066730 0x7fbb08068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:18.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.281+0000 7fbb28d5c700 1 --2- 172.21.15.123:0/1920968680 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb08066730 0x7fbb08068bf0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fbb18004e90 tx=0x7fbb18001080 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:18.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.289+0000 7fbb217fa700 1 -- 172.21.15.123:0/1920968680 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbb1c052db0 con 0x7fbb24160310 2024-09-13T17:10:18.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:18.465+0000 7fbb29d5e700 1 -- 172.21.15.123:0/1920968680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbb240677f0 con 0x7fbb24160310 2024-09-13T17:10:19.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.129+0000 7fbb217fa700 1 -- 172.21.15.123:0/1920968680 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbb1c0563d0 con 0x7fbb24160310 2024-09-13T17:10:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.133+0000 7fbb29d5e700 1 -- 172.21.15.123:0/1920968680 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb08066730 msgr2=0x7fbb08068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.133+0000 7fbb29d5e700 1 --2- 172.21.15.123:0/1920968680 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb08066730 0x7fbb08068bf0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fbb18004e90 tx=0x7fbb18001080 comp rx=0 tx=0).stop 2024-09-13T17:10:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.133+0000 7fbb29d5e700 1 -- 172.21.15.123:0/1920968680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb24160310 msgr2=0x7fbb240ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.133+0000 7fbb29d5e700 1 --2- 172.21.15.123:0/1920968680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb24160310 0x7fbb240ca5f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c015000 tx=0x7fbb1c004af0 comp rx=0 tx=0).stop 2024-09-13T17:10:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.133+0000 7fbb29d5e700 1 -- 172.21.15.123:0/1920968680 shutdown_connections 2024-09-13T17:10:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.133+0000 7fbb29d5e700 1 --2- 172.21.15.123:0/1920968680 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb08066730 0x7fbb08068bf0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.133+0000 7fbb29d5e700 1 --2- 172.21.15.123:0/1920968680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb24160310 0x7fbb240ca5f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.133+0000 7fbb29d5e700 1 --2- 172.21.15.123:0/1920968680 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbb240d3220 0x7fbb2415d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.133+0000 7fbb29d5e700 1 --2- 172.21.15.123:0/1920968680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb240d1080 0x7fbb24157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.133+0000 7fbb29d5e700 1 -- 172.21.15.123:0/1920968680 >> 172.21.15.123:0/1920968680 conn(0x7fbb2409be50 msgr2=0x7fbb240cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.133+0000 7fbb29d5e700 1 -- 172.21.15.123:0/1920968680 shutdown_connections 2024-09-13T17:10:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.133+0000 7fbb29d5e700 1 -- 172.21.15.123:0/1920968680 wait complete. 2024-09-13T17:10:19.141 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:10:19.153 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:10:19.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e85b2700 1 Processor -- start 2024-09-13T17:10:19.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e85b2700 1 -- start start 2024-09-13T17:10:19.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e85b2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc8e0160460 0x7fc8e00d3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:19.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e85b2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc8e00cfd80 0x7fc8e00af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:19.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e85b2700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e00d1850 con 0x7fc8e00b1a50 2024-09-13T17:10:19.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e85b2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e00cead0 con 0x7fc8e00cfd80 2024-09-13T17:10:19.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e85b2700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e00d1240 con 0x7fc8e0160460 2024-09-13T17:10:19.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e6b4f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc8e00cfd80 0x7fc8e00af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:19.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e6b4f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc8e00cfd80 0x7fc8e00af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33030/0 (socket says 172.21.15.123:33030) 2024-09-13T17:10:19.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e6b4f700 1 -- 172.21.15.123:0/1116599463 learned_addr learned my addr 172.21.15.123:0/1116599463 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:19.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e634e700 1 --2- 172.21.15.123:0/1116599463 >> v2:172.21.15.153:3300/0 conn(0x7fc8e0160460 0x7fc8e00d3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:19.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e6b4f700 1 -- 172.21.15.123:0/1116599463 >> v2:172.21.15.153:3300/0 conn(0x7fc8e0160460 msgr2=0x7fc8e00d3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:19.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e6b4f700 1 --2- 172.21.15.123:0/1116599463 >> v2:172.21.15.153:3300/0 conn(0x7fc8e0160460 0x7fc8e00d3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:19.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e6b4f700 1 -- 172.21.15.123:0/1116599463 >> v1:172.21.15.153:6789/0 conn(0x7fc8e00b1a50 legacy=0x7fc8e00cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:19.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e6b4f700 1 -- 172.21.15.123:0/1116599463 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e0160840 con 0x7fc8e00cfd80 2024-09-13T17:10:19.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e6b4f700 1 --2- 172.21.15.123:0/1116599463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00cfd80 0x7fc8e00af830 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009e50 tx=0x7fc8d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd141a567187278 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:19.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e534c700 1 -- 172.21.15.123:0/1116599463 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d800e070 con 0x7fc8e00cfd80 2024-09-13T17:10:19.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e534c700 1 -- 172.21.15.123:0/1116599463 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d800b8d0 con 0x7fc8e00cfd80 2024-09-13T17:10:19.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.261+0000 7fc8e534c700 1 -- 172.21.15.123:0/1116599463 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d800bc80 con 0x7fc8e00cfd80 2024-09-13T17:10:19.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1116599463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00cfd80 msgr2=0x7fc8e00af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:19.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 --2- 172.21.15.123:0/1116599463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00cfd80 0x7fc8e00af830 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009e50 tx=0x7fc8d800b330 comp rx=0 tx=0).stop 2024-09-13T17:10:19.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1116599463 shutdown_connections 2024-09-13T17:10:19.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 --2- 172.21.15.123:0/1116599463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00cfd80 0x7fc8e00af830 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:19.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 --2- 172.21.15.123:0/1116599463 >> v2:172.21.15.153:3300/0 conn(0x7fc8e0160460 0x7fc8e00d3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:19.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1116599463 >> 172.21.15.123:0/1116599463 conn(0x7fc8e00d2c60 msgr2=0x7fc8e00d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:19.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1116599463 shutdown_connections 2024-09-13T17:10:19.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1116599463 wait complete. 2024-09-13T17:10:19.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 Processor -- start 2024-09-13T17:10:19.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 -- start start 2024-09-13T17:10:19.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00b1a50 0x7fc8e00c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:19.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e00cfd80 0x7fc8e00b7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:19.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e0160460 0x7fc8e01f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:19.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e00ca460 con 0x7fc8e00b1a50 2024-09-13T17:10:19.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e00ca270 con 0x7fc8e00cfd80 2024-09-13T17:10:19.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e85b2700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e00cc310 con 0x7fc8e0160460 2024-09-13T17:10:19.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e634e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00b1a50 0x7fc8e00c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:19.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e634e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00b1a50 0x7fc8e00c9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33038/0 (socket says 172.21.15.123:33038) 2024-09-13T17:10:19.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e634e700 1 -- 172.21.15.123:0/1532613622 learned_addr learned my addr 172.21.15.123:0/1532613622 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:19.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.265+0000 7fc8e5b4d700 1 --2- 172.21.15.123:0/1532613622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e00cfd80 0x7fc8e00b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:19.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8e6b4f700 1 --2- 172.21.15.123:0/1532613622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e0160460 0x7fc8e01f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:19.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8e634e700 1 -- 172.21.15.123:0/1532613622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e0160460 msgr2=0x7fc8e01f23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:19.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8e634e700 1 --2- 172.21.15.123:0/1532613622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e0160460 0x7fc8e01f23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:19.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8e634e700 1 -- 172.21.15.123:0/1532613622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e00cfd80 msgr2=0x7fc8e00b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:19.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8e634e700 1 --2- 172.21.15.123:0/1532613622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e00cfd80 0x7fc8e00b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:19.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8e634e700 1 -- 172.21.15.123:0/1532613622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d8009b30 con 0x7fc8e00b1a50 2024-09-13T17:10:19.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8e634e700 1 --2- 172.21.15.123:0/1532613622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00b1a50 0x7fc8e00c9d30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00e840 tx=0x7fc8dc00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:19.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8d6ffd700 1 -- 172.21.15.123:0/1532613622 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc0095a0 con 0x7fc8e00b1a50 2024-09-13T17:10:19.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8d6ffd700 1 -- 172.21.15.123:0/1532613622 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc013680 con 0x7fc8e00b1a50 2024-09-13T17:10:19.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1532613622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e00cc560 con 0x7fc8e00b1a50 2024-09-13T17:10:19.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8d6ffd700 1 -- 172.21.15.123:0/1532613622 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc0139f0 con 0x7fc8e00b1a50 2024-09-13T17:10:19.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1532613622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e00ccb20 con 0x7fc8e00b1a50 2024-09-13T17:10:19.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1532613622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e00d3780 con 0x7fc8e00b1a50 2024-09-13T17:10:19.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8d6ffd700 1 -- 172.21.15.123:0/1532613622 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc8dc013b50 con 0x7fc8e00b1a50 2024-09-13T17:10:19.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.269+0000 7fc8d6ffd700 1 --2- 172.21.15.123:0/1532613622 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc8c4066730 0x7fc8c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:19.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.273+0000 7fc8d6ffd700 1 -- 172.21.15.123:0/1532613622 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fc8dc083ee0 con 0x7fc8e00b1a50 2024-09-13T17:10:19.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.273+0000 7fc8e5b4d700 1 --2- 172.21.15.123:0/1532613622 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc8c4066730 0x7fc8c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:19.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.273+0000 7fc8e5b4d700 1 --2- 172.21.15.123:0/1532613622 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc8c4066730 0x7fc8c4068bf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00c6470 tx=0x7fc8d0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:19.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.281+0000 7fc8d6ffd700 1 -- 172.21.15.123:0/1532613622 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc8dc0513b0 con 0x7fc8e00b1a50 2024-09-13T17:10:19.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:19.449+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1532613622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc8e015d7a0 con 0x7fc8e00b1a50 2024-09-13T17:10:20.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.137+0000 7fc8d6ffd700 1 -- 172.21.15.123:0/1532613622 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc8dc0549d0 con 0x7fc8e00b1a50 2024-09-13T17:10:20.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.145+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1532613622 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc8c4066730 msgr2=0x7fc8c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:20.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.145+0000 7fc8e85b2700 1 --2- 172.21.15.123:0/1532613622 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc8c4066730 0x7fc8c4068bf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00c6470 tx=0x7fc8d0009040 comp rx=0 tx=0).stop 2024-09-13T17:10:20.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.145+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1532613622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00b1a50 msgr2=0x7fc8e00c9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:20.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.145+0000 7fc8e85b2700 1 --2- 172.21.15.123:0/1532613622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00b1a50 0x7fc8e00c9d30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00e840 tx=0x7fc8dc00eb50 comp rx=0 tx=0).stop 2024-09-13T17:10:20.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.145+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1532613622 shutdown_connections 2024-09-13T17:10:20.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.145+0000 7fc8e85b2700 1 --2- 172.21.15.123:0/1532613622 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc8c4066730 0x7fc8c4068bf0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.145+0000 7fc8e85b2700 1 --2- 172.21.15.123:0/1532613622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8e0160460 0x7fc8e01f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.145+0000 7fc8e85b2700 1 --2- 172.21.15.123:0/1532613622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e00cfd80 0x7fc8e00b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.145+0000 7fc8e85b2700 1 --2- 172.21.15.123:0/1532613622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8e00b1a50 0x7fc8e00c9d30 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.145+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1532613622 >> 172.21.15.123:0/1532613622 conn(0x7fc8e00d2c60 msgr2=0x7fc8e00ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:20.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.145+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1532613622 shutdown_connections 2024-09-13T17:10:20.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.145+0000 7fc8e85b2700 1 -- 172.21.15.123:0/1532613622 wait complete. 2024-09-13T17:10:20.153 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-13T17:10:20.171 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T17:10:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.269+0000 7f60893d5700 1 Processor -- start 2024-09-13T17:10:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.269+0000 7f60893d5700 1 -- start start 2024-09-13T17:10:20.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f60893d5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f608406a260 0x7f608406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:20.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f60893d5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1650 0x7f60840cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:20.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f60893d5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608406d710 con 0x7f608415ab00 2024-09-13T17:10:20.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f60893d5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608415afa0 con 0x7f608406a260 2024-09-13T17:10:20.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f60893d5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608406e3f0 con 0x7f60840b1650 2024-09-13T17:10:20.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f607b7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f608415ab00 0x7f608406a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35902/0 (socket says 172.21.15.123:35902) 2024-09-13T17:10:20.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f607b7fe700 1 -- 172.21.15.123:0/3369310533 learned_addr learned my addr 172.21.15.123:0/3369310533 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:20.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f6083fff700 1 --2- 172.21.15.123:0/3369310533 >> v2:172.21.15.153:3300/0 conn(0x7f608406a260 0x7f608406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:20.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f6088bd4700 1 --2- 172.21.15.123:0/3369310533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1650 0x7f60840cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:20.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f60837fe700 1 -- 172.21.15.123:0/3369310533 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728503710 0 0) 0x7f608406d710 con 0x7f608415ab00 2024-09-13T17:10:20.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f60837fe700 1 -- 172.21.15.123:0/3369310533 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60700035d0 con 0x7f608415ab00 2024-09-13T17:10:20.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f6083fff700 1 -- 172.21.15.123:0/3369310533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1650 msgr2=0x7f60840cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:20.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f60837fe700 1 -- 172.21.15.123:0/3369310533 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3758746815 0 0) 0x7f60700035d0 con 0x7f608415ab00 2024-09-13T17:10:20.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f6083fff700 1 --2- 172.21.15.123:0/3369310533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1650 0x7f60840cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f6083fff700 1 -- 172.21.15.123:0/3369310533 >> v1:172.21.15.123:6789/0 conn(0x7f608415ab00 legacy=0x7f608406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:20.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f6083fff700 1 -- 172.21.15.123:0/3369310533 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608406e6d0 con 0x7f608406a260 2024-09-13T17:10:20.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f6088bd4700 1 --2- 172.21.15.123:0/3369310533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1650 0x7f60840cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:20.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.273+0000 7f6083fff700 1 --2- 172.21.15.123:0/3369310533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f608406a260 0x7f608406d1d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6074009850 tx=0x7f6074009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45dfb351ab6dd854 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:20.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.277+0000 7f60837fe700 1 -- 172.21.15.123:0/3369310533 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c001670 con 0x7f608406a260 2024-09-13T17:10:20.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.277+0000 7f60837fe700 1 -- 172.21.15.123:0/3369310533 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074004030 con 0x7f608406a260 2024-09-13T17:10:20.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.277+0000 7f60837fe700 1 -- 172.21.15.123:0/3369310533 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60740043a0 con 0x7f608406a260 2024-09-13T17:10:20.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.277+0000 7f60893d5700 1 -- 172.21.15.123:0/3369310533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f608406a260 msgr2=0x7f608406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:20.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.277+0000 7f60893d5700 1 --2- 172.21.15.123:0/3369310533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f608406a260 0x7f608406d1d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6074009850 tx=0x7f6074009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:20.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.277+0000 7f60893d5700 1 -- 172.21.15.123:0/3369310533 shutdown_connections 2024-09-13T17:10:20.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.277+0000 7f60893d5700 1 --2- 172.21.15.123:0/3369310533 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1650 0x7f60840cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.277+0000 7f60893d5700 1 --2- 172.21.15.123:0/3369310533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f608406a260 0x7f608406d1d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.277+0000 7f60893d5700 1 -- 172.21.15.123:0/3369310533 >> 172.21.15.123:0/3369310533 conn(0x7f608406f940 msgr2=0x7f60840b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:20.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.277+0000 7f60893d5700 1 -- 172.21.15.123:0/3369310533 shutdown_connections 2024-09-13T17:10:20.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.277+0000 7f60893d5700 1 -- 172.21.15.123:0/3369310533 wait complete. 2024-09-13T17:10:20.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f60893d5700 1 Processor -- start 2024-09-13T17:10:20.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f60893d5700 1 -- start start 2024-09-13T17:10:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f60893d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f608406a260 0x7f6084146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f60893d5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1650 0x7f6084150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f60893d5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f608415ab00 0x7f608414d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f60893d5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60841503f0 con 0x7f608406a260 2024-09-13T17:10:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f60893d5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608414f820 con 0x7f608415ab00 2024-09-13T17:10:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f60893d5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608414fa50 con 0x7f60840b1650 2024-09-13T17:10:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f6083fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f608406a260 0x7f6084146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f6083fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f608406a260 0x7f6084146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33048/0 (socket says 172.21.15.123:33048) 2024-09-13T17:10:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f6083fff700 1 -- 172.21.15.123:0/1659787918 learned_addr learned my addr 172.21.15.123:0/1659787918 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f607b7fe700 1 --2- 172.21.15.123:0/1659787918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1650 0x7f6084150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f6088bd4700 1 --2- 172.21.15.123:0/1659787918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f608415ab00 0x7f608414d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f6083fff700 1 -- 172.21.15.123:0/1659787918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1650 msgr2=0x7f6084150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f6083fff700 1 --2- 172.21.15.123:0/1659787918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1650 0x7f6084150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f6083fff700 1 -- 172.21.15.123:0/1659787918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f608415ab00 msgr2=0x7f608414d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f6083fff700 1 --2- 172.21.15.123:0/1659787918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f608415ab00 0x7f608414d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f6083fff700 1 -- 172.21.15.123:0/1659787918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c009a70 con 0x7f608406a260 2024-09-13T17:10:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.281+0000 7f6083fff700 1 --2- 172.21.15.123:0/1659787918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f608406a260 0x7f6084146020 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f60840b4530 tx=0x7f6074004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.285+0000 7f60817fa700 1 -- 172.21.15.123:0/1659787918 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074003d80 con 0x7f608406a260 2024-09-13T17:10:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.285+0000 7f60817fa700 1 -- 172.21.15.123:0/1659787918 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607401f070 con 0x7f608406a260 2024-09-13T17:10:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.285+0000 7f60817fa700 1 -- 172.21.15.123:0/1659787918 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074011870 con 0x7f608406a260 2024-09-13T17:10:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.285+0000 7f60893d5700 1 -- 172.21.15.123:0/1659787918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60740094b0 con 0x7f608406a260 2024-09-13T17:10:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.285+0000 7f60893d5700 1 -- 172.21.15.123:0/1659787918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6084150010 con 0x7f608406a260 2024-09-13T17:10:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.285+0000 7f60893d5700 1 -- 172.21.15.123:0/1659787918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60840cd0c0 con 0x7f608406a260 2024-09-13T17:10:20.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.285+0000 7f60817fa700 1 -- 172.21.15.123:0/1659787918 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f60740119d0 con 0x7f608406a260 2024-09-13T17:10:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.285+0000 7f60817fa700 1 --2- 172.21.15.123:0/1659787918 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6064066760 0x7f6064068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.285+0000 7f60817fa700 1 -- 172.21.15.123:0/1659787918 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6074021070 con 0x7f608406a260 2024-09-13T17:10:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.285+0000 7f607b7fe700 1 --2- 172.21.15.123:0/1659787918 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6064066760 0x7f6064068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.289+0000 7f607b7fe700 1 --2- 172.21.15.123:0/1659787918 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6064066760 0x7f6064068c20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f608414e240 tx=0x7f606c001da0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:20.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.289+0000 7f60817fa700 1 -- 172.21.15.123:0/1659787918 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6074052d40 con 0x7f608406a260 2024-09-13T17:10:20.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.461+0000 7f60893d5700 1 -- 172.21.15.123:0/1659787918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f60840745a0 con 0x7f608406a260 2024-09-13T17:10:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.465+0000 7f60817fa700 1 -- 172.21.15.123:0/1659787918 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6074056360 con 0x7f608406a260 2024-09-13T17:10:20.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.469+0000 7f60893d5700 1 -- 172.21.15.123:0/1659787918 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6064066760 msgr2=0x7f6064068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:20.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.469+0000 7f60893d5700 1 --2- 172.21.15.123:0/1659787918 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6064066760 0x7f6064068c20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f608414e240 tx=0x7f606c001da0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.469+0000 7f60893d5700 1 -- 172.21.15.123:0/1659787918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f608406a260 msgr2=0x7f6084146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:20.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.469+0000 7f60893d5700 1 --2- 172.21.15.123:0/1659787918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f608406a260 0x7f6084146020 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f60840b4530 tx=0x7f6074004770 comp rx=0 tx=0).stop 2024-09-13T17:10:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.469+0000 7f60893d5700 1 -- 172.21.15.123:0/1659787918 shutdown_connections 2024-09-13T17:10:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.469+0000 7f60893d5700 1 --2- 172.21.15.123:0/1659787918 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6064066760 0x7f6064068c20 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.469+0000 7f60893d5700 1 --2- 172.21.15.123:0/1659787918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f608415ab00 0x7f608414d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.469+0000 7f60893d5700 1 --2- 172.21.15.123:0/1659787918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60840b1650 0x7f6084150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.469+0000 7f60893d5700 1 --2- 172.21.15.123:0/1659787918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f608406a260 0x7f6084146020 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.469+0000 7f60893d5700 1 -- 172.21.15.123:0/1659787918 >> 172.21.15.123:0/1659787918 conn(0x7f608406f940 msgr2=0x7f60841591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.469+0000 7f60893d5700 1 -- 172.21.15.123:0/1659787918 shutdown_connections 2024-09-13T17:10:20.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.469+0000 7f60893d5700 1 -- 172.21.15.123:0/1659787918 wait complete. 2024-09-13T17:10:20.490 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr' 2024-09-13T17:10:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.593+0000 7fa3596be700 1 Processor -- start 2024-09-13T17:10:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.593+0000 7fa3596be700 1 -- start start 2024-09-13T17:10:20.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.593+0000 7fa3596be700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa35415cc00 0x7fa3540d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:20.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.593+0000 7fa3596be700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3540cea60 con 0x7fa3540d16c0 2024-09-13T17:10:20.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.593+0000 7fa3596be700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3540ce780 con 0x7fa3540ce1c0 2024-09-13T17:10:20.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.593+0000 7fa3596be700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3540af710 con 0x7fa35415cc00 2024-09-13T17:10:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.593+0000 7fa353fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa35415cc00 0x7fa3540d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.593+0000 7fa358ebd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa3540d16c0 0x7fa3540b01f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35908/0 (socket says 172.21.15.123:35908) 2024-09-13T17:10:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.593+0000 7fa358ebd700 1 -- 172.21.15.123:0/967467429 learned_addr learned my addr 172.21.15.123:0/967467429 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa352ffd700 1 -- 172.21.15.123:0/967467429 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703632384 0 0) 0x7fa3540cea60 con 0x7fa3540d16c0 2024-09-13T17:10:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa352ffd700 1 -- 172.21.15.123:0/967467429 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa33c0035d0 con 0x7fa3540d16c0 2024-09-13T17:10:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa353fff700 1 -- 172.21.15.123:0/967467429 >> v1:172.21.15.153:6789/0 conn(0x7fa3540ce1c0 legacy=0x7fa3540d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa353fff700 1 -- 172.21.15.123:0/967467429 >> v1:172.21.15.123:6789/0 conn(0x7fa3540d16c0 legacy=0x7fa3540b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa353fff700 1 -- 172.21.15.123:0/967467429 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3540af9f0 con 0x7fa35415cc00 2024-09-13T17:10:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa353fff700 1 --2- 172.21.15.123:0/967467429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa35415cc00 0x7fa3540d0790 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa348009850 tx=0x7fa348009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca6421f3be9e65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa352ffd700 1 -- 172.21.15.123:0/967467429 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348011830 con 0x7fa35415cc00 2024-09-13T17:10:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa352ffd700 1 -- 172.21.15.123:0/967467429 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa348011990 con 0x7fa35415cc00 2024-09-13T17:10:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa352ffd700 1 -- 172.21.15.123:0/967467429 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348011d40 con 0x7fa35415cc00 2024-09-13T17:10:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa3596be700 1 -- 172.21.15.123:0/967467429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa35415cc00 msgr2=0x7fa3540d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa3596be700 1 --2- 172.21.15.123:0/967467429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa35415cc00 0x7fa3540d0790 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa348009850 tx=0x7fa348009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa3596be700 1 -- 172.21.15.123:0/967467429 shutdown_connections 2024-09-13T17:10:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa3596be700 1 --2- 172.21.15.123:0/967467429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa35415cc00 0x7fa3540d0790 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa3596be700 1 -- 172.21.15.123:0/967467429 >> 172.21.15.123:0/967467429 conn(0x7fa3540d2a80 msgr2=0x7fa3540d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa3596be700 1 -- 172.21.15.123:0/967467429 shutdown_connections 2024-09-13T17:10:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa3596be700 1 -- 172.21.15.123:0/967467429 wait complete. 2024-09-13T17:10:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.597+0000 7fa3596be700 1 Processor -- start 2024-09-13T17:10:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa3596be700 1 -- start start 2024-09-13T17:10:20.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa3596be700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3540ce1c0 0x7fa3540cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:20.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa3596be700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3540d16c0 0x7fa3540c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:20.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa3596be700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35415cc00 0x7fa354159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa3596be700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540ca310 con 0x7fa3540ce1c0 2024-09-13T17:10:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa3596be700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540ca5f0 con 0x7fa35415cc00 2024-09-13T17:10:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa3596be700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540ca8d0 con 0x7fa3540d16c0 2024-09-13T17:10:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa353fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3540ce1c0 0x7fa3540cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa353fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3540ce1c0 0x7fa3540cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33068/0 (socket says 172.21.15.123:33068) 2024-09-13T17:10:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa353fff700 1 -- 172.21.15.123:0/2658542985 learned_addr learned my addr 172.21.15.123:0/2658542985 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa3537fe700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3540d16c0 0x7fa3540c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa358ebd700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35415cc00 0x7fa354159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa353fff700 1 -- 172.21.15.123:0/2658542985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3540d16c0 msgr2=0x7fa3540c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa353fff700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3540d16c0 0x7fa3540c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa353fff700 1 -- 172.21.15.123:0/2658542985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35415cc00 msgr2=0x7fa354159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa353fff700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35415cc00 0x7fa354159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa353fff700 1 -- 172.21.15.123:0/2658542985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3480094b0 con 0x7fa3540ce1c0 2024-09-13T17:10:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa358ebd700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35415cc00 0x7fa354159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa3537fe700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3540d16c0 0x7fa3540c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa353fff700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3540ce1c0 0x7fa3540cb3b0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa348014040 tx=0x7fa348004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa350ff9700 1 -- 172.21.15.123:0/2658542985 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348019ab0 con 0x7fa3540ce1c0 2024-09-13T17:10:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa350ff9700 1 -- 172.21.15.123:0/2658542985 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34801e070 con 0x7fa3540ce1c0 2024-09-13T17:10:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa3596be700 1 -- 172.21.15.123:0/2658542985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35415d160 con 0x7fa3540ce1c0 2024-09-13T17:10:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa350ff9700 1 -- 172.21.15.123:0/2658542985 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348019e50 con 0x7fa3540ce1c0 2024-09-13T17:10:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.601+0000 7fa3596be700 1 -- 172.21.15.123:0/2658542985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3540cae90 con 0x7fa3540ce1c0 2024-09-13T17:10:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.605+0000 7fa3596be700 1 -- 172.21.15.123:0/2658542985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3540cb080 con 0x7fa3540ce1c0 2024-09-13T17:10:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.605+0000 7fa350ff9700 1 -- 172.21.15.123:0/2658542985 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa34802d450 con 0x7fa3540ce1c0 2024-09-13T17:10:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.605+0000 7fa350ff9700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa340066730 0x7fa340068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.605+0000 7fa3537fe700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa340066730 0x7fa340068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.605+0000 7fa350ff9700 1 -- 172.21.15.123:0/2658542985 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa348084f20 con 0x7fa3540ce1c0 2024-09-13T17:10:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.605+0000 7fa3537fe700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa340066730 0x7fa340068bf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa3540c7cc0 tx=0x7fa344009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:20.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.609+0000 7fa350ff9700 1 -- 172.21.15.123:0/2658542985 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa348052590 con 0x7fa3540ce1c0 2024-09-13T17:10:20.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:20.841+0000 7fa3596be700 1 -- 172.21.15.123:0/2658542985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]} v 0) v1 -- 0x7fa3540d0790 con 0x7fa3540ce1c0 2024-09-13T17:10:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.145+0000 7fa350ff9700 1 -- 172.21.15.123:0/2658542985 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]}]=0 v216) v1 ==== 140+0+0 (secure 0 0 0) 0x7fa3480150d0 con 0x7fa3540ce1c0 2024-09-13T17:10:21.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.153+0000 7fa3596be700 1 -- 172.21.15.123:0/2658542985 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa340066730 msgr2=0x7fa340068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.153+0000 7fa3596be700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa340066730 0x7fa340068bf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa3540c7cc0 tx=0x7fa344009040 comp rx=0 tx=0).stop 2024-09-13T17:10:21.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.153+0000 7fa3596be700 1 -- 172.21.15.123:0/2658542985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3540ce1c0 msgr2=0x7fa3540cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.153+0000 7fa3596be700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3540ce1c0 0x7fa3540cb3b0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa348014040 tx=0x7fa348004770 comp rx=0 tx=0).stop 2024-09-13T17:10:21.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.153+0000 7fa3596be700 1 -- 172.21.15.123:0/2658542985 shutdown_connections 2024-09-13T17:10:21.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.153+0000 7fa3596be700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa340066730 0x7fa340068bf0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.153+0000 7fa3596be700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa35415cc00 0x7fa354159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.153+0000 7fa3596be700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa3540d16c0 0x7fa3540c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.153+0000 7fa3596be700 1 --2- 172.21.15.123:0/2658542985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3540ce1c0 0x7fa3540cb3b0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.153+0000 7fa3596be700 1 -- 172.21.15.123:0/2658542985 >> 172.21.15.123:0/2658542985 conn(0x7fa3540d2a80 msgr2=0x7fa3540b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:21.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.153+0000 7fa3596be700 1 -- 172.21.15.123:0/2658542985 shutdown_connections 2024-09-13T17:10:21.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.153+0000 7fa3596be700 1 -- 172.21.15.123:0/2658542985 wait complete. 2024-09-13T17:10:21.175 INFO:tasks.cephfs_test_runner:That quota changes made from one client are visible to another ... ok 2024-09-13T17:10:21.175 INFO:tasks.cephfs_test_runner:Starting test: test_remote_update_write (tasks.cephfs.test_quota.TestQuota) That when a client modifies the quota on a directory used 2024-09-13T17:10:21.175 INFO:tasks.cephfs_test_runner:test_remote_update_write (tasks.cephfs.test_quota.TestQuota) 2024-09-13T17:10:21.176 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:21.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.289+0000 7f98ff59e700 1 Processor -- start 2024-09-13T17:10:21.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.289+0000 7f98ff59e700 1 -- start start 2024-09-13T17:10:21.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.289+0000 7f98ff59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900071760 0x7f99000cce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.289+0000 7f98ff59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990015bd10 con 0x7f990015a9d0 2024-09-13T17:10:21.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.289+0000 7f98ff59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990015b100 con 0x7f99000ceda0 2024-09-13T17:10:21.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.289+0000 7f98ff59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990015b3e0 con 0x7f9900071760 2024-09-13T17:10:21.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98fe59c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f990015a9d0 0x7f99000ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35922/0 (socket says 172.21.15.123:35922) 2024-09-13T17:10:21.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98fe59c700 1 -- 172.21.15.123:0/3710536798 learned_addr learned my addr 172.21.15.123:0/3710536798 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:21.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98fed9d700 1 --2- 172.21.15.123:0/3710536798 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900071760 0x7f99000cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98fd59a700 1 -- 172.21.15.123:0/3710536798 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309916841 0 0) 0x7f990015b100 con 0x7f99000ceda0 2024-09-13T17:10:21.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98fed9d700 1 -- 172.21.15.123:0/3710536798 >> v1:172.21.15.153:6789/0 conn(0x7f99000ceda0 legacy=0x7f990015e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98fed9d700 1 -- 172.21.15.123:0/3710536798 >> v1:172.21.15.123:6789/0 conn(0x7f990015a9d0 legacy=0x7f99000ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98fed9d700 1 -- 172.21.15.123:0/3710536798 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990015b6c0 con 0x7f9900071760 2024-09-13T17:10:21.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98fed9d700 1 --2- 172.21.15.123:0/3710536798 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900071760 0x7f99000cce80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f98f8009880 tx=0x7f98f8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de3987652ced8847 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:21.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98fd59a700 1 -- 172.21.15.123:0/3710536798 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8004230 con 0x7f9900071760 2024-09-13T17:10:21.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98fd59a700 1 -- 172.21.15.123:0/3710536798 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f8004390 con 0x7f9900071760 2024-09-13T17:10:21.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98fd59a700 1 -- 172.21.15.123:0/3710536798 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f80036c0 con 0x7f9900071760 2024-09-13T17:10:21.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98ff59e700 1 -- 172.21.15.123:0/3710536798 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900071760 msgr2=0x7f99000cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98ff59e700 1 --2- 172.21.15.123:0/3710536798 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900071760 0x7f99000cce80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f98f8009880 tx=0x7f98f8009b90 comp rx=0 tx=0).stop 2024-09-13T17:10:21.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98ff59e700 1 -- 172.21.15.123:0/3710536798 shutdown_connections 2024-09-13T17:10:21.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98ff59e700 1 --2- 172.21.15.123:0/3710536798 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9900071760 0x7f99000cce80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98ff59e700 1 -- 172.21.15.123:0/3710536798 >> 172.21.15.123:0/3710536798 conn(0x7f9900066150 msgr2=0x7f9900066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:21.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98ff59e700 1 -- 172.21.15.123:0/3710536798 shutdown_connections 2024-09-13T17:10:21.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98ff59e700 1 -- 172.21.15.123:0/3710536798 wait complete. 2024-09-13T17:10:21.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98ff59e700 1 Processor -- start 2024-09-13T17:10:21.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.293+0000 7f98ff59e700 1 -- start start 2024-09-13T17:10:21.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98ff59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9900071760 0x7f990015d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98ff59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99000ceda0 0x7f9900148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98ff59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f990015a9d0 0x7f9900149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98ff59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9900152df0 con 0x7f990015a9d0 2024-09-13T17:10:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98ff59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9900153210 con 0x7f9900071760 2024-09-13T17:10:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98ff59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9900152170 con 0x7f99000ceda0 2024-09-13T17:10:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98fed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f990015a9d0 0x7f9900149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98fed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f990015a9d0 0x7f9900149410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33080/0 (socket says 172.21.15.123:33080) 2024-09-13T17:10:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98fed9d700 1 -- 172.21.15.123:0/3082148190 learned_addr learned my addr 172.21.15.123:0/3082148190 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98fdd9b700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99000ceda0 0x7f9900148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98fe59c700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9900071760 0x7f990015d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98fdd9b700 1 -- 172.21.15.123:0/3082148190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9900071760 msgr2=0x7f990015d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98fdd9b700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9900071760 0x7f990015d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98fdd9b700 1 -- 172.21.15.123:0/3082148190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f990015a9d0 msgr2=0x7f9900149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98fdd9b700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f990015a9d0 0x7f9900149410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98fdd9b700 1 -- 172.21.15.123:0/3082148190 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f80094b0 con 0x7f99000ceda0 2024-09-13T17:10:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98fed9d700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f990015a9d0 0x7f9900149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98fe59c700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9900071760 0x7f990015d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98fdd9b700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99000ceda0 0x7f9900148ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f98f0001f80 tx=0x7f98f000a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98eeffd700 1 -- 172.21.15.123:0/3082148190 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0003e50 con 0x7f99000ceda0 2024-09-13T17:10:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98eeffd700 1 -- 172.21.15.123:0/3082148190 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f00020d0 con 0x7f99000ceda0 2024-09-13T17:10:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98ff59e700 1 -- 172.21.15.123:0/3082148190 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9900152450 con 0x7f99000ceda0 2024-09-13T17:10:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98eeffd700 1 -- 172.21.15.123:0/3082148190 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f000ab70 con 0x7f99000ceda0 2024-09-13T17:10:21.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.297+0000 7f98ff59e700 1 -- 172.21.15.123:0/3082148190 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9900152a10 con 0x7f99000ceda0 2024-09-13T17:10:21.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.301+0000 7f98ff59e700 1 -- 172.21.15.123:0/3082148190 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99000677f0 con 0x7f99000ceda0 2024-09-13T17:10:21.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.301+0000 7f98eeffd700 1 -- 172.21.15.123:0/3082148190 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f98f000acd0 con 0x7f99000ceda0 2024-09-13T17:10:21.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.301+0000 7f98eeffd700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f98e0066730 0x7f98e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.301+0000 7f98fe59c700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f98e0066730 0x7f98e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.301+0000 7f98eeffd700 1 -- 172.21.15.123:0/3082148190 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f98f0083f80 con 0x7f99000ceda0 2024-09-13T17:10:21.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.301+0000 7f98fe59c700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f98e0066730 0x7f98e0068bf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f98f4000f60 tx=0x7f98f4007e70 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:21.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.309+0000 7f98eeffd700 1 -- 172.21.15.123:0/3082148190 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f98f00b5db0 con 0x7f99000ceda0 2024-09-13T17:10:21.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.481+0000 7f98ff59e700 1 -- 172.21.15.123:0/3082148190 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9900152f30 con 0x7f99000ceda0 2024-09-13T17:10:21.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.485+0000 7f98eeffd700 1 -- 172.21.15.123:0/3082148190 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+13037 (secure 0 0 0) 0x7f9900152f30 con 0x7f99000ceda0 2024-09-13T17:10:21.491 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:21.491 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":89,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:20.128792+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6837/2288571456":"2024-09-14T17:10:17.108243+0000","172.21.15.123:6836/2288571456":"2024-09-14T17:10:17.108243+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:21.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.485+0000 7f98ff59e700 1 -- 172.21.15.123:0/3082148190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f98e0066730 msgr2=0x7f98e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.485+0000 7f98ff59e700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f98e0066730 0x7f98e0068bf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f98f4000f60 tx=0x7f98f4007e70 comp rx=0 tx=0).stop 2024-09-13T17:10:21.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.485+0000 7f98ff59e700 1 -- 172.21.15.123:0/3082148190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99000ceda0 msgr2=0x7f9900148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.485+0000 7f98ff59e700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99000ceda0 0x7f9900148ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f98f0001f80 tx=0x7f98f000a340 comp rx=0 tx=0).stop 2024-09-13T17:10:21.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.485+0000 7f98ff59e700 1 -- 172.21.15.123:0/3082148190 shutdown_connections 2024-09-13T17:10:21.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.485+0000 7f98ff59e700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f98e0066730 0x7f98e0068bf0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.485+0000 7f98ff59e700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f990015a9d0 0x7f9900149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.485+0000 7f98ff59e700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99000ceda0 0x7f9900148ed0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.485+0000 7f98ff59e700 1 --2- 172.21.15.123:0/3082148190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9900071760 0x7f990015d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.485+0000 7f98ff59e700 1 -- 172.21.15.123:0/3082148190 >> 172.21.15.123:0/3082148190 conn(0x7f9900066150 msgr2=0x7f99000b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:21.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.485+0000 7f98ff59e700 1 -- 172.21.15.123:0/3082148190 shutdown_connections 2024-09-13T17:10:21.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.485+0000 7f98ff59e700 1 -- 172.21.15.123:0/3082148190 wait complete. 2024-09-13T17:10:21.507 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:10:21.508 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:10:21.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.617+0000 7f06197ba700 1 Processor -- start 2024-09-13T17:10:21.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.617+0000 7f06197ba700 1 -- start start 2024-09-13T17:10:21.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.617+0000 7f06197ba700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f061415ceb0 0x7f06140cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.617+0000 7f06197ba700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06140cc6e0 0x7f061406c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.617+0000 7f06197ba700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06140cc250 con 0x7f06140d08e0 2024-09-13T17:10:21.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.617+0000 7f06197ba700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06140cb960 con 0x7f06140cc6e0 2024-09-13T17:10:21.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.617+0000 7f06197ba700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06140d0560 con 0x7f061415ceb0 2024-09-13T17:10:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.617+0000 7f06137fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06140cc6e0 0x7f061406c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.617+0000 7f0618fb9700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f06140d08e0 0x7f06140cd340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35936/0 (socket says 172.21.15.123:35936) 2024-09-13T17:10:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.617+0000 7f0618fb9700 1 -- 172.21.15.123:0/4061491351 learned_addr learned my addr 172.21.15.123:0/4061491351 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f0613fff700 1 --2- 172.21.15.123:0/4061491351 >> v2:172.21.15.153:3300/0 conn(0x7f061415ceb0 0x7f06140cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f0612ffd700 1 -- 172.21.15.123:0/4061491351 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193415970 0 0) 0x7f06140cc250 con 0x7f06140d08e0 2024-09-13T17:10:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f0612ffd700 1 -- 172.21.15.123:0/4061491351 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05fc0035d0 con 0x7f06140d08e0 2024-09-13T17:10:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06137fe700 1 -- 172.21.15.123:0/4061491351 >> v2:172.21.15.153:3300/0 conn(0x7f061415ceb0 msgr2=0x7f06140cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06137fe700 1 --2- 172.21.15.123:0/4061491351 >> v2:172.21.15.153:3300/0 conn(0x7f061415ceb0 0x7f06140cfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06137fe700 1 -- 172.21.15.123:0/4061491351 >> v1:172.21.15.123:6789/0 conn(0x7f06140d08e0 legacy=0x7f06140cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06137fe700 1 -- 172.21.15.123:0/4061491351 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06140cbc00 con 0x7f06140cc6e0 2024-09-13T17:10:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f0613fff700 1 --2- 172.21.15.123:0/4061491351 >> v2:172.21.15.153:3300/0 conn(0x7f061415ceb0 0x7f06140cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06137fe700 1 --2- 172.21.15.123:0/4061491351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06140cc6e0 0x7f061406c4b0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f06140b3510 tx=0x7f0604009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87baf00664df0c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:21.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f0612ffd700 1 -- 172.21.15.123:0/4061491351 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604011830 con 0x7f06140cc6e0 2024-09-13T17:10:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f0612ffd700 1 -- 172.21.15.123:0/4061491351 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0604011990 con 0x7f06140cc6e0 2024-09-13T17:10:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f0612ffd700 1 -- 172.21.15.123:0/4061491351 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604011d20 con 0x7f06140cc6e0 2024-09-13T17:10:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06197ba700 1 -- 172.21.15.123:0/4061491351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06140cc6e0 msgr2=0x7f061406c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06197ba700 1 --2- 172.21.15.123:0/4061491351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06140cc6e0 0x7f061406c4b0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f06140b3510 tx=0x7f0604009b30 comp rx=0 tx=0).stop 2024-09-13T17:10:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06197ba700 1 -- 172.21.15.123:0/4061491351 shutdown_connections 2024-09-13T17:10:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06197ba700 1 --2- 172.21.15.123:0/4061491351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06140cc6e0 0x7f061406c4b0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06197ba700 1 --2- 172.21.15.123:0/4061491351 >> v2:172.21.15.153:3300/0 conn(0x7f061415ceb0 0x7f06140cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06197ba700 1 -- 172.21.15.123:0/4061491351 >> 172.21.15.123:0/4061491351 conn(0x7f061406e090 msgr2=0x7f061406e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06197ba700 1 -- 172.21.15.123:0/4061491351 shutdown_connections 2024-09-13T17:10:21.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06197ba700 1 -- 172.21.15.123:0/4061491351 wait complete. 2024-09-13T17:10:21.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06197ba700 1 Processor -- start 2024-09-13T17:10:21.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.621+0000 7f06197ba700 1 -- start start 2024-09-13T17:10:21.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06197ba700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06140cc6e0 0x7f06140b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06197ba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06140d08e0 0x7f061415a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06197ba700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f061415ceb0 0x7f06141f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06197ba700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061415a550 con 0x7f06140d08e0 2024-09-13T17:10:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06197ba700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061415fb70 con 0x7f06140cc6e0 2024-09-13T17:10:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06197ba700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061415fe50 con 0x7f061415ceb0 2024-09-13T17:10:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06137fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06140d08e0 0x7f061415a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f0613fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06140cc6e0 0x7f06140b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06137fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06140d08e0 0x7f061415a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33098/0 (socket says 172.21.15.123:33098) 2024-09-13T17:10:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06137fe700 1 -- 172.21.15.123:0/1760621362 learned_addr learned my addr 172.21.15.123:0/1760621362 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f0618fb9700 1 --2- 172.21.15.123:0/1760621362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f061415ceb0 0x7f06141f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06137fe700 1 -- 172.21.15.123:0/1760621362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f061415ceb0 msgr2=0x7f06141f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06137fe700 1 --2- 172.21.15.123:0/1760621362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f061415ceb0 0x7f06141f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06137fe700 1 -- 172.21.15.123:0/1760621362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06140cc6e0 msgr2=0x7f06140b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06137fe700 1 --2- 172.21.15.123:0/1760621362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06140cc6e0 0x7f06140b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06137fe700 1 -- 172.21.15.123:0/1760621362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06040094b0 con 0x7f06140d08e0 2024-09-13T17:10:21.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06137fe700 1 --2- 172.21.15.123:0/1760621362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06140d08e0 0x7f061415a010 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f0604009b70 tx=0x7f0604004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:21.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f0610ff9700 1 -- 172.21.15.123:0/1760621362 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604004400 con 0x7f06140d08e0 2024-09-13T17:10:21.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f0610ff9700 1 -- 172.21.15.123:0/1760621362 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060401f070 con 0x7f06140d08e0 2024-09-13T17:10:21.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06197ba700 1 -- 172.21.15.123:0/1760621362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061415d410 con 0x7f06140d08e0 2024-09-13T17:10:21.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f0610ff9700 1 -- 172.21.15.123:0/1760621362 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06040036c0 con 0x7f06140d08e0 2024-09-13T17:10:21.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.625+0000 7f06197ba700 1 -- 172.21.15.123:0/1760621362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061415e050 con 0x7f06140d08e0 2024-09-13T17:10:21.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.629+0000 7f0610ff9700 1 -- 172.21.15.123:0/1760621362 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0604021030 con 0x7f06140d08e0 2024-09-13T17:10:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.629+0000 7f06197ba700 1 -- 172.21.15.123:0/1760621362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0614072520 con 0x7f06140d08e0 2024-09-13T17:10:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.629+0000 7f0610ff9700 1 --2- 172.21.15.123:0/1760621362 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0600066730 0x7f0600068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.629+0000 7f0610ff9700 1 -- 172.21.15.123:0/1760621362 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0604085130 con 0x7f06140d08e0 2024-09-13T17:10:21.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.629+0000 7f0613fff700 1 --2- 172.21.15.123:0/1760621362 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0600066730 0x7f0600068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.629+0000 7f0613fff700 1 --2- 172.21.15.123:0/1760621362 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0600066730 0x7f0600068bf0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f060800c960 tx=0x7f0608008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:21.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.637+0000 7f0610ff9700 1 -- 172.21.15.123:0/1760621362 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0604052830 con 0x7f06140d08e0 2024-09-13T17:10:21.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.801+0000 7f06197ba700 1 -- 172.21.15.123:0/1760621362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f061406c4b0 con 0x7f06140d08e0 2024-09-13T17:10:21.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.805+0000 7f0610ff9700 1 -- 172.21.15.123:0/1760621362 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0604055e50 con 0x7f06140d08e0 2024-09-13T17:10:21.811 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:10:21.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.805+0000 7f06197ba700 1 -- 172.21.15.123:0/1760621362 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0600066730 msgr2=0x7f0600068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.805+0000 7f06197ba700 1 --2- 172.21.15.123:0/1760621362 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0600066730 0x7f0600068bf0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f060800c960 tx=0x7f0608008040 comp rx=0 tx=0).stop 2024-09-13T17:10:21.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.805+0000 7f06197ba700 1 -- 172.21.15.123:0/1760621362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06140d08e0 msgr2=0x7f061415a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.805+0000 7f06197ba700 1 --2- 172.21.15.123:0/1760621362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06140d08e0 0x7f061415a010 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f0604009b70 tx=0x7f0604004770 comp rx=0 tx=0).stop 2024-09-13T17:10:21.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.805+0000 7f06197ba700 1 -- 172.21.15.123:0/1760621362 shutdown_connections 2024-09-13T17:10:21.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.805+0000 7f06197ba700 1 --2- 172.21.15.123:0/1760621362 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0600066730 0x7f0600068bf0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.805+0000 7f06197ba700 1 --2- 172.21.15.123:0/1760621362 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f061415ceb0 0x7f06141f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.805+0000 7f06197ba700 1 --2- 172.21.15.123:0/1760621362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06140d08e0 0x7f061415a010 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.805+0000 7f06197ba700 1 --2- 172.21.15.123:0/1760621362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06140cc6e0 0x7f06140b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.805+0000 7f06197ba700 1 -- 172.21.15.123:0/1760621362 >> 172.21.15.123:0/1760621362 conn(0x7f061406e090 msgr2=0x7f0614071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:21.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.805+0000 7f06197ba700 1 -- 172.21.15.123:0/1760621362 shutdown_connections 2024-09-13T17:10:21.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.805+0000 7f06197ba700 1 -- 172.21.15.123:0/1760621362 wait complete. 2024-09-13T17:10:21.829 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_write' 2024-09-13T17:10:21.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab146f700 1 Processor -- start 2024-09-13T17:10:21.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab146f700 1 -- start start 2024-09-13T17:10:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab146f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4aac15ed00 0x7f4aac161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab146f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4aac161a80 0x7f4aac0cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab146f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aac162550 con 0x7f4aac15e920 2024-09-13T17:10:21.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab146f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aac0cd690 con 0x7f4aac161a80 2024-09-13T17:10:21.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab146f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aac161f90 con 0x7f4aac15ed00 2024-09-13T17:10:21.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab0c6e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4aac161a80 0x7f4aac0cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab0c6e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4aac161a80 0x7f4aac0cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33108/0 (socket says 172.21.15.123:33108) 2024-09-13T17:10:21.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab0c6e700 1 -- 172.21.15.123:0/3959679848 learned_addr learned my addr 172.21.15.123:0/3959679848 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:21.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4aab7fe700 1 --2- 172.21.15.123:0/3959679848 >> v2:172.21.15.153:3300/0 conn(0x7f4aac15ed00 0x7f4aac161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab0c6e700 1 -- 172.21.15.123:0/3959679848 >> v2:172.21.15.153:3300/0 conn(0x7f4aac15ed00 msgr2=0x7f4aac161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:21.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab0c6e700 1 --2- 172.21.15.123:0/3959679848 >> v2:172.21.15.153:3300/0 conn(0x7f4aac15ed00 0x7f4aac161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab0c6e700 1 -- 172.21.15.123:0/3959679848 >> v1:172.21.15.153:6789/0 conn(0x7f4aac15e920 legacy=0x7f4aac0caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab0c6e700 1 -- 172.21.15.123:0/3959679848 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac162270 con 0x7f4aac161a80 2024-09-13T17:10:21.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4aab7fe700 1 --2- 172.21.15.123:0/3959679848 >> v2:172.21.15.153:3300/0 conn(0x7f4aac15ed00 0x7f4aac161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:21.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab0c6e700 1 --2- 172.21.15.123:0/3959679848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aac161a80 0x7f4aac0cdb20 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0cc740 tx=0x7f4aa4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f39f998b17cd981 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:21.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4aaaffd700 1 -- 172.21.15.123:0/3959679848 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400b8a0 con 0x7f4aac161a80 2024-09-13T17:10:21.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4aaaffd700 1 -- 172.21.15.123:0/3959679848 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa400ba00 con 0x7f4aac161a80 2024-09-13T17:10:21.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4aaaffd700 1 -- 172.21.15.123:0/3959679848 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400bd90 con 0x7f4aac161a80 2024-09-13T17:10:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab146f700 1 -- 172.21.15.123:0/3959679848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aac161a80 msgr2=0x7f4aac0cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab146f700 1 --2- 172.21.15.123:0/3959679848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aac161a80 0x7f4aac0cdb20 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0cc740 tx=0x7f4aa4009bf0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab146f700 1 -- 172.21.15.123:0/3959679848 shutdown_connections 2024-09-13T17:10:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab146f700 1 --2- 172.21.15.123:0/3959679848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aac161a80 0x7f4aac0cdb20 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab146f700 1 --2- 172.21.15.123:0/3959679848 >> v2:172.21.15.153:3300/0 conn(0x7f4aac15ed00 0x7f4aac161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.937+0000 7f4ab146f700 1 -- 172.21.15.123:0/3959679848 >> 172.21.15.123:0/3959679848 conn(0x7f4aac066150 msgr2=0x7f4aac066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4ab146f700 1 -- 172.21.15.123:0/3959679848 shutdown_connections 2024-09-13T17:10:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4ab146f700 1 -- 172.21.15.123:0/3959679848 wait complete. 2024-09-13T17:10:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4ab146f700 1 Processor -- start 2024-09-13T17:10:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4ab146f700 1 -- start start 2024-09-13T17:10:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4ab146f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4aac15e920 0x7f4aac145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4ab146f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aac15ed00 0x7f4aac1e7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4ab146f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4aac161a80 0x7f4aac15c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4ab146f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac145bb0 con 0x7f4aac15ed00 2024-09-13T17:10:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4ab146f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac1461e0 con 0x7f4aac15e920 2024-09-13T17:10:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4ab146f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac1464c0 con 0x7f4aac161a80 2024-09-13T17:10:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4aab7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aac15ed00 0x7f4aac1e7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4aab7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aac15ed00 0x7f4aac1e7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33116/0 (socket says 172.21.15.123:33116) 2024-09-13T17:10:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4aab7fe700 1 -- 172.21.15.123:0/54893230 learned_addr learned my addr 172.21.15.123:0/54893230 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4ab0c6e700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4aac161a80 0x7f4aac15c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4aabfff700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4aac15e920 0x7f4aac145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4aab7fe700 1 -- 172.21.15.123:0/54893230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4aac161a80 msgr2=0x7f4aac15c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4aab7fe700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4aac161a80 0x7f4aac15c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4aab7fe700 1 -- 172.21.15.123:0/54893230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4aac15e920 msgr2=0x7f4aac145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4aab7fe700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4aac15e920 0x7f4aac145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4aab7fe700 1 -- 172.21.15.123:0/54893230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa4009570 con 0x7f4aac15ed00 2024-09-13T17:10:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4aabfff700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4aac15e920 0x7f4aac145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4aab7fe700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aac15ed00 0x7f4aac1e7510 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009fc0 tx=0x7f4a9c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4aa8ff9700 1 -- 172.21.15.123:0/54893230 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c003a40 con 0x7f4aac15ed00 2024-09-13T17:10:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4aa8ff9700 1 -- 172.21.15.123:0/54893230 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c00f040 con 0x7f4aac15ed00 2024-09-13T17:10:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4ab146f700 1 -- 172.21.15.123:0/54893230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aac1467a0 con 0x7f4aac15ed00 2024-09-13T17:10:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4aa8ff9700 1 -- 172.21.15.123:0/54893230 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c003dc0 con 0x7f4aac15ed00 2024-09-13T17:10:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.941+0000 7f4ab146f700 1 -- 172.21.15.123:0/54893230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aac146d60 con 0x7f4aac15ed00 2024-09-13T17:10:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.945+0000 7f4ab146f700 1 -- 172.21.15.123:0/54893230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aac0677f0 con 0x7f4aac15ed00 2024-09-13T17:10:21.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.945+0000 7f4aa8ff9700 1 -- 172.21.15.123:0/54893230 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a9c004030 con 0x7f4aac15ed00 2024-09-13T17:10:21.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.945+0000 7f4aa8ff9700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4a98066730 0x7f4a98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:21.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.945+0000 7f4aa8ff9700 1 -- 172.21.15.123:0/54893230 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4a9c083f40 con 0x7f4aac15ed00 2024-09-13T17:10:21.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.945+0000 7f4aabfff700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4a98066730 0x7f4a98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:21.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.945+0000 7f4aabfff700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4a98066730 0x7f4a98068bf0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0001820 tx=0x7f4aa0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:21.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:21.953+0000 7f4aa8ff9700 1 -- 172.21.15.123:0/54893230 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4a9c051660 con 0x7f4aac15ed00 2024-09-13T17:10:22.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:22.181+0000 7f4ab146f700 1 -- 172.21.15.123:0/54893230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]} v 0) v1 -- 0x7f4aac161540 con 0x7f4aac15ed00 2024-09-13T17:10:23.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.157+0000 7f4aa8ff9700 1 -- 172.21.15.123:0/54893230 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]}]=0 v218) v1 ==== 140+0+0 (secure 0 0 0) 0x7f4a9c054c80 con 0x7f4aac15ed00 2024-09-13T17:10:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.161+0000 7f4ab146f700 1 -- 172.21.15.123:0/54893230 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4a98066730 msgr2=0x7f4a98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.161+0000 7f4ab146f700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4a98066730 0x7f4a98068bf0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0001820 tx=0x7f4aa0009040 comp rx=0 tx=0).stop 2024-09-13T17:10:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.161+0000 7f4ab146f700 1 -- 172.21.15.123:0/54893230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aac15ed00 msgr2=0x7f4aac1e7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.161+0000 7f4ab146f700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aac15ed00 0x7f4aac1e7510 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009fc0 tx=0x7f4a9c00d3b0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.161+0000 7f4ab146f700 1 -- 172.21.15.123:0/54893230 shutdown_connections 2024-09-13T17:10:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.161+0000 7f4ab146f700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4a98066730 0x7f4a98068bf0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.161+0000 7f4ab146f700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4aac161a80 0x7f4aac15c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.161+0000 7f4ab146f700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aac15ed00 0x7f4aac1e7510 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.161+0000 7f4ab146f700 1 --2- 172.21.15.123:0/54893230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4aac15e920 0x7f4aac145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.161+0000 7f4ab146f700 1 -- 172.21.15.123:0/54893230 >> 172.21.15.123:0/54893230 conn(0x7f4aac066150 msgr2=0x7f4aac071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.161+0000 7f4ab146f700 1 -- 172.21.15.123:0/54893230 shutdown_connections 2024-09-13T17:10:23.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.161+0000 7f4ab146f700 1 -- 172.21.15.123:0/54893230 wait complete. 2024-09-13T17:10:23.185 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T17:10:23.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.305+0000 7fa7cf59e700 1 Processor -- start 2024-09-13T17:10:23.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.305+0000 7fa7cf59e700 1 -- start start 2024-09-13T17:10:23.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cf59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa7d015cc30 0x7fa7d00b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:23.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cf59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7d00ccfd0 0x7fa7d00b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:23.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cf59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d00704c0 con 0x7fa7d0071a70 2024-09-13T17:10:23.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cf59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d015d010 con 0x7fa7d015cc30 2024-09-13T17:10:23.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cf59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00707a0 con 0x7fa7d00ccfd0 2024-09-13T17:10:23.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7ce59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa7d015cc30 0x7fa7d00b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:23.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cdd9b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7d00ccfd0 0x7fa7d00b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:23.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cdd9b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7d00ccfd0 0x7fa7d00b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:49300/0 (socket says 172.21.15.123:49300) 2024-09-13T17:10:23.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cdd9b700 1 -- 172.21.15.123:0/3611654 learned_addr learned my addr 172.21.15.123:0/3611654 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:23.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7ced9d700 1 --1- 172.21.15.123:0/3611654 >> v1:172.21.15.153:6789/0 conn(0x7fa7d0071a70 0x7fa7d006df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:37508/0 (socket says 172.21.15.123:37508) 2024-09-13T17:10:23.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cdd9b700 1 -- 172.21.15.123:0/3611654 >> v2:172.21.15.153:3300/0 conn(0x7fa7d015cc30 msgr2=0x7fa7d00b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:23.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cdd9b700 1 --2- 172.21.15.123:0/3611654 >> v2:172.21.15.153:3300/0 conn(0x7fa7d015cc30 0x7fa7d00b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cdd9b700 1 -- 172.21.15.123:0/3611654 >> v1:172.21.15.153:6789/0 conn(0x7fa7d0071a70 legacy=0x7fa7d006df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:23.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cdd9b700 1 -- 172.21.15.123:0/3611654 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d0070a80 con 0x7fa7d00ccfd0 2024-09-13T17:10:23.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cdd9b700 1 --2- 172.21.15.123:0/3611654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7d00ccfd0 0x7fa7d00b2930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8009910 tx=0x7fa7b8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37a8a646e3d721ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:23.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cd59a700 1 -- 172.21.15.123:0/3611654 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8011830 con 0x7fa7d00ccfd0 2024-09-13T17:10:23.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cd59a700 1 -- 172.21.15.123:0/3611654 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b8011990 con 0x7fa7d00ccfd0 2024-09-13T17:10:23.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cd59a700 1 -- 172.21.15.123:0/3611654 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8011d40 con 0x7fa7d00ccfd0 2024-09-13T17:10:23.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cf59e700 1 -- 172.21.15.123:0/3611654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7d00ccfd0 msgr2=0x7fa7d00b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:23.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cf59e700 1 --2- 172.21.15.123:0/3611654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7d00ccfd0 0x7fa7d00b2930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8009910 tx=0x7fa7b8009c20 comp rx=0 tx=0).stop 2024-09-13T17:10:23.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cf59e700 1 -- 172.21.15.123:0/3611654 shutdown_connections 2024-09-13T17:10:23.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cf59e700 1 --2- 172.21.15.123:0/3611654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7d00ccfd0 0x7fa7d00b2930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cf59e700 1 --2- 172.21.15.123:0/3611654 >> v2:172.21.15.153:3300/0 conn(0x7fa7d015cc30 0x7fa7d00b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cf59e700 1 -- 172.21.15.123:0/3611654 >> 172.21.15.123:0/3611654 conn(0x7fa7d0066780 msgr2=0x7fa7d00cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:23.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cf59e700 1 -- 172.21.15.123:0/3611654 shutdown_connections 2024-09-13T17:10:23.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.309+0000 7fa7cf59e700 1 -- 172.21.15.123:0/3611654 wait complete. 2024-09-13T17:10:23.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7cf59e700 1 Processor -- start 2024-09-13T17:10:23.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7cf59e700 1 -- start start 2024-09-13T17:10:23.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7cf59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7d0071a70 0x7fa7d0148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:23.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7cf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d00ccfd0 0x7fa7d01e5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:23.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7cf59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d015cc30 0x7fa7d01e5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:23.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7cf59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d01e8ce0 con 0x7fa7d015cc30 2024-09-13T17:10:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7cf59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d01e80d0 con 0x7fa7d00ccfd0 2024-09-13T17:10:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7cf59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d01e83b0 con 0x7fa7d0071a70 2024-09-13T17:10:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7ced9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d015cc30 0x7fa7d01e5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7ced9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d015cc30 0x7fa7d01e5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35942/0 (socket says 172.21.15.123:35942) 2024-09-13T17:10:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7ced9d700 1 -- 172.21.15.123:0/967860250 learned_addr learned my addr 172.21.15.123:0/967860250 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7cdd9b700 1 --2- 172.21.15.123:0/967860250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d00ccfd0 0x7fa7d01e5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7ce59c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7d0071a70 0x7fa7d0148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:23.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7ced9d700 1 -- 172.21.15.123:0/967860250 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7d0071a70 msgr2=0x7fa7d0148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:23.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7ced9d700 1 --2- 172.21.15.123:0/967860250 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7d0071a70 0x7fa7d0148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7ced9d700 1 -- 172.21.15.123:0/967860250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d00ccfd0 msgr2=0x7fa7d01e5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:23.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7ced9d700 1 --2- 172.21.15.123:0/967860250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d00ccfd0 0x7fa7d01e5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7ced9d700 1 -- 172.21.15.123:0/967860250 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b8009570 con 0x7fa7d015cc30 2024-09-13T17:10:23.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7cdd9b700 1 --2- 172.21.15.123:0/967860250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d00ccfd0 0x7fa7d01e5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:23.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.313+0000 7fa7ced9d700 1 --2- 172.21.15.123:0/967860250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d015cc30 0x7fa7d01e5780 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800cbd0 tx=0x7fa7c800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:23.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.317+0000 7fa7c6ffd700 1 -- 172.21.15.123:0/967860250 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c800aaa0 con 0x7fa7d015cc30 2024-09-13T17:10:23.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.317+0000 7fa7c6ffd700 1 -- 172.21.15.123:0/967860250 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c800ac00 con 0x7fa7d015cc30 2024-09-13T17:10:23.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.317+0000 7fa7cf59e700 1 -- 172.21.15.123:0/967860250 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d01e8690 con 0x7fa7d015cc30 2024-09-13T17:10:23.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.317+0000 7fa7c6ffd700 1 -- 172.21.15.123:0/967860250 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8007070 con 0x7fa7d015cc30 2024-09-13T17:10:23.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.317+0000 7fa7cf59e700 1 -- 172.21.15.123:0/967860250 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d0149260 con 0x7fa7d015cc30 2024-09-13T17:10:23.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.317+0000 7fa7c6ffd700 1 -- 172.21.15.123:0/967860250 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa7c80071d0 con 0x7fa7d015cc30 2024-09-13T17:10:23.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.317+0000 7fa7cf59e700 1 -- 172.21.15.123:0/967860250 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d01e8e50 con 0x7fa7d015cc30 2024-09-13T17:10:23.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.321+0000 7fa7c6ffd700 1 --2- 172.21.15.123:0/967860250 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa7b0066730 0x7fa7b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:23.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.321+0000 7fa7c6ffd700 1 -- 172.21.15.123:0/967860250 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa7c80839e0 con 0x7fa7d015cc30 2024-09-13T17:10:23.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.321+0000 7fa7ce59c700 1 --2- 172.21.15.123:0/967860250 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa7b0066730 0x7fa7b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:23.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.321+0000 7fa7ce59c700 1 --2- 172.21.15.123:0/967860250 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa7b0066730 0x7fa7b0068bf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0009b50 tx=0x7fa7c0009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:23.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.325+0000 7fa7c6ffd700 1 -- 172.21.15.123:0/967860250 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa7c8051190 con 0x7fa7d015cc30 2024-09-13T17:10:23.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.493+0000 7fa7cf59e700 1 -- 172.21.15.123:0/967860250 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa7d00b23f0 con 0x7fa7d015cc30 2024-09-13T17:10:23.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.501+0000 7fa7c6ffd700 1 -- 172.21.15.123:0/967860250 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa7c8017070 con 0x7fa7d015cc30 2024-09-13T17:10:23.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.501+0000 7fa7cf59e700 1 -- 172.21.15.123:0/967860250 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa7b0066730 msgr2=0x7fa7b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.501+0000 7fa7cf59e700 1 --2- 172.21.15.123:0/967860250 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa7b0066730 0x7fa7b0068bf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0009b50 tx=0x7fa7c0009240 comp rx=0 tx=0).stop 2024-09-13T17:10:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.501+0000 7fa7cf59e700 1 -- 172.21.15.123:0/967860250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d015cc30 msgr2=0x7fa7d01e5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.501+0000 7fa7cf59e700 1 --2- 172.21.15.123:0/967860250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d015cc30 0x7fa7d01e5780 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800cbd0 tx=0x7fa7c800cee0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.501+0000 7fa7cf59e700 1 -- 172.21.15.123:0/967860250 shutdown_connections 2024-09-13T17:10:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.501+0000 7fa7cf59e700 1 --2- 172.21.15.123:0/967860250 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa7b0066730 0x7fa7b0068bf0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.501+0000 7fa7cf59e700 1 --2- 172.21.15.123:0/967860250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d015cc30 0x7fa7d01e5780 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.501+0000 7fa7cf59e700 1 --2- 172.21.15.123:0/967860250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d00ccfd0 0x7fa7d01e5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.501+0000 7fa7cf59e700 1 --2- 172.21.15.123:0/967860250 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa7d0071a70 0x7fa7d0148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.501+0000 7fa7cf59e700 1 -- 172.21.15.123:0/967860250 >> 172.21.15.123:0/967860250 conn(0x7fa7d0066780 msgr2=0x7fa7d015d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.501+0000 7fa7cf59e700 1 -- 172.21.15.123:0/967860250 shutdown_connections 2024-09-13T17:10:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.501+0000 7fa7cf59e700 1 -- 172.21.15.123:0/967860250 wait complete. 2024-09-13T17:10:23.525 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:10:23.525 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:10:23.543 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:10:23.562 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:10:23.562 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:10:23.563 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:23.569 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:10:23.570 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:10:23.570 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:23.577 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:10:23.577 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:10:23.578 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:23.620 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:10:23.620 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:10:23.620 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:23.627 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:10:23.628 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T17:10:23.628 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:23.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.741+0000 7f1608e13700 1 Processor -- start 2024-09-13T17:10:23.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.741+0000 7f1608e13700 1 -- start start 2024-09-13T17:10:23.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.741+0000 7f1608e13700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1604157070 0x7f16040717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:23.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.741+0000 7f1608e13700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f16040ad620 0x7f160406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:23.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.741+0000 7f1608e13700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1604157450 con 0x7f1604071d20 2024-09-13T17:10:23.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.741+0000 7f1608e13700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16040adc80 con 0x7f16040ad620 2024-09-13T17:10:23.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.741+0000 7f1608e13700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16040721b0 con 0x7f1604157070 2024-09-13T17:10:23.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1603fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f16040ad620 0x7f160406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:23.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1603fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f16040ad620 0x7f160406ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35954/0 (socket says 172.21.15.123:35954) 2024-09-13T17:10:23.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1603fff700 1 -- 172.21.15.123:0/3282112722 learned_addr learned my addr 172.21.15.123:0/3282112722 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:23.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f16037fe700 1 --2- 172.21.15.123:0/3282112722 >> v2:172.21.15.153:3300/0 conn(0x7f1604157070 0x7f16040717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:23.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1603fff700 1 -- 172.21.15.123:0/3282112722 >> v2:172.21.15.153:3300/0 conn(0x7f1604157070 msgr2=0x7f16040717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:23.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1603fff700 1 --2- 172.21.15.123:0/3282112722 >> v2:172.21.15.153:3300/0 conn(0x7f1604157070 0x7f16040717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1603fff700 1 -- 172.21.15.123:0/3282112722 >> v1:172.21.15.153:6789/0 conn(0x7f1604071d20 legacy=0x7f16040acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:23.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1603fff700 1 -- 172.21.15.123:0/3282112722 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160415d1e0 con 0x7f16040ad620 2024-09-13T17:10:23.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1603fff700 1 --2- 172.21.15.123:0/3282112722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16040ad620 0x7f160406ce40 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f16040b2570 tx=0x7f15fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92b5f3fb84a13a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:23.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1602ffd700 1 -- 172.21.15.123:0/3282112722 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00e070 con 0x7f16040ad620 2024-09-13T17:10:23.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1602ffd700 1 -- 172.21.15.123:0/3282112722 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc00b910 con 0x7f16040ad620 2024-09-13T17:10:23.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1602ffd700 1 -- 172.21.15.123:0/3282112722 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00bcc0 con 0x7f16040ad620 2024-09-13T17:10:23.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1608e13700 1 -- 172.21.15.123:0/3282112722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16040ad620 msgr2=0x7f160406ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:23.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1608e13700 1 --2- 172.21.15.123:0/3282112722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16040ad620 0x7f160406ce40 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f16040b2570 tx=0x7f15fc00b330 comp rx=0 tx=0).stop 2024-09-13T17:10:23.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1608e13700 1 -- 172.21.15.123:0/3282112722 shutdown_connections 2024-09-13T17:10:23.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1608e13700 1 --2- 172.21.15.123:0/3282112722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16040ad620 0x7f160406ce40 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1608e13700 1 --2- 172.21.15.123:0/3282112722 >> v2:172.21.15.153:3300/0 conn(0x7f1604157070 0x7f16040717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1608e13700 1 -- 172.21.15.123:0/3282112722 >> 172.21.15.123:0/3282112722 conn(0x7f1604066150 msgr2=0x7f1604066560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:23.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1608e13700 1 -- 172.21.15.123:0/3282112722 shutdown_connections 2024-09-13T17:10:23.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.745+0000 7f1608e13700 1 -- 172.21.15.123:0/3282112722 wait complete. 2024-09-13T17:10:23.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1608e13700 1 Processor -- start 2024-09-13T17:10:23.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1608e13700 1 -- start start 2024-09-13T17:10:23.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1608e13700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1604071d20 0x7f16040b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:23.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1608e13700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16040ad620 0x7f160414d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:23.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1608e13700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1604157070 0x7f160414eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:23.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1608e13700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16040b0550 con 0x7f1604157070 2024-09-13T17:10:23.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1608e13700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16040af8d0 con 0x7f16040ad620 2024-09-13T17:10:23.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1608e13700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16040afbb0 con 0x7f1604071d20 2024-09-13T17:10:23.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1603fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1604157070 0x7f160414eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:23.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1603fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1604157070 0x7f160414eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35968/0 (socket says 172.21.15.123:35968) 2024-09-13T17:10:23.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1603fff700 1 -- 172.21.15.123:0/1117575316 learned_addr learned my addr 172.21.15.123:0/1117575316 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:23.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f16037fe700 1 --2- 172.21.15.123:0/1117575316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1604071d20 0x7f16040b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:23.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f15faffd700 1 --2- 172.21.15.123:0/1117575316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16040ad620 0x7f160414d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:23.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1603fff700 1 -- 172.21.15.123:0/1117575316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1604071d20 msgr2=0x7f16040b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:23.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1603fff700 1 --2- 172.21.15.123:0/1117575316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1604071d20 0x7f16040b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1603fff700 1 -- 172.21.15.123:0/1117575316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16040ad620 msgr2=0x7f160414d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:23.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1603fff700 1 --2- 172.21.15.123:0/1117575316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16040ad620 0x7f160414d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1603fff700 1 -- 172.21.15.123:0/1117575316 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc009b30 con 0x7f1604157070 2024-09-13T17:10:23.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1603fff700 1 --2- 172.21.15.123:0/1117575316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1604157070 0x7f160414eb70 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f16040d0800 tx=0x7f15fc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:23.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1600ff9700 1 -- 172.21.15.123:0/1117575316 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc004880 con 0x7f1604157070 2024-09-13T17:10:23.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1600ff9700 1 -- 172.21.15.123:0/1117575316 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc0092e0 con 0x7f1604157070 2024-09-13T17:10:23.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1600ff9700 1 -- 172.21.15.123:0/1117575316 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc01c660 con 0x7f1604157070 2024-09-13T17:10:23.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1608e13700 1 -- 172.21.15.123:0/1117575316 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16040afe90 con 0x7f1604157070 2024-09-13T17:10:23.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.749+0000 7f1608e13700 1 -- 172.21.15.123:0/1117575316 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16040b0eb0 con 0x7f1604157070 2024-09-13T17:10:23.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.753+0000 7f1608e13700 1 -- 172.21.15.123:0/1117575316 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16040b0690 con 0x7f1604157070 2024-09-13T17:10:23.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.753+0000 7f1600ff9700 1 -- 172.21.15.123:0/1117575316 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f15fc01c7c0 con 0x7f1604157070 2024-09-13T17:10:23.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.753+0000 7f1600ff9700 1 --2- 172.21.15.123:0/1117575316 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f15e8066730 0x7f15e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:23.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.753+0000 7f1600ff9700 1 -- 172.21.15.123:0/1117575316 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f15fc085680 con 0x7f1604157070 2024-09-13T17:10:23.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.753+0000 7f16037fe700 1 --2- 172.21.15.123:0/1117575316 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f15e8066730 0x7f15e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:23.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.753+0000 7f16037fe700 1 --2- 172.21.15.123:0/1117575316 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f15e8066730 0x7f15e8068bf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009b50 tx=0x7f15f4009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:23.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.765+0000 7f1600ff9700 1 -- 172.21.15.123:0/1117575316 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f16040b0690 con 0x7f1604157070 2024-09-13T17:10:23.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.969+0000 7f1608e13700 1 -- 172.21.15.123:0/1117575316 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16040b0690 con 0x7f1604157070 2024-09-13T17:10:23.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.969+0000 7f1600ff9700 1 -- 172.21.15.123:0/1117575316 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f16040b0690 con 0x7f1604157070 2024-09-13T17:10:23.975 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:23.975 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6173,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3730345323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3730345323},{"type":"v1","addr":"172.21.15.153:6835","nonce":3730345323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1181784822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1181784822},{"type":"v1","addr":"172.21.15.153:6834","nonce":1181784822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1969180357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1969180357},{"type":"v1","addr":"172.21.15.123:6835","nonce":1969180357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":7317,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1715510496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1715510496},{"type":"v1","addr":"172.21.15.123:6837","nonce":1715510496}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[]} 2024-09-13T17:10:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.969+0000 7f1608e13700 1 -- 172.21.15.123:0/1117575316 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f15e8066730 msgr2=0x7f15e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.969+0000 7f1608e13700 1 --2- 172.21.15.123:0/1117575316 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f15e8066730 0x7f15e8068bf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009b50 tx=0x7f15f4009240 comp rx=0 tx=0).stop 2024-09-13T17:10:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.969+0000 7f1608e13700 1 -- 172.21.15.123:0/1117575316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1604157070 msgr2=0x7f160414eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.969+0000 7f1608e13700 1 --2- 172.21.15.123:0/1117575316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1604157070 0x7f160414eb70 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f16040d0800 tx=0x7f15fc004af0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.969+0000 7f1608e13700 1 -- 172.21.15.123:0/1117575316 shutdown_connections 2024-09-13T17:10:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.969+0000 7f1608e13700 1 --2- 172.21.15.123:0/1117575316 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f15e8066730 0x7f15e8068bf0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.969+0000 7f1608e13700 1 --2- 172.21.15.123:0/1117575316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1604157070 0x7f160414eb70 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.969+0000 7f1608e13700 1 --2- 172.21.15.123:0/1117575316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16040ad620 0x7f160414d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.969+0000 7f1608e13700 1 --2- 172.21.15.123:0/1117575316 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1604071d20 0x7f16040b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.969+0000 7f1608e13700 1 -- 172.21.15.123:0/1117575316 >> 172.21.15.123:0/1117575316 conn(0x7f1604066150 msgr2=0x7f1604066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.973+0000 7f1608e13700 1 -- 172.21.15.123:0/1117575316 shutdown_connections 2024-09-13T17:10:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:23.973+0000 7f1608e13700 1 -- 172.21.15.123:0/1117575316 wait complete. 2024-09-13T17:10:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 43 2024-09-13T17:10:23.998 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:10:23.998 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:10:23.998 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:10:23.999 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:10:23.999 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:10:23.999 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:10:23.999 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:10:23.999 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:10:23.999 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:10:23.999 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:10:24.000 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:10:24.000 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:10:24.000 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:10:24.000 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:10:24.000 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:10:24.000 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:10:24.009 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:10:24.009 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:10:24.011 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:10:24.012 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:10:24.017 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:10:24.017 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:10:24.018 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:10:24.018 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:10:24.019 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:10:24.020 DEBUG:teuthology.parallel:result is None 2024-09-13T17:10:24.021 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:10:24.021 DEBUG:teuthology.parallel:result is None 2024-09-13T17:10:24.055 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:10:24.055 DEBUG:teuthology.parallel:result is None 2024-09-13T17:10:24.056 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:10:24.056 DEBUG:teuthology.parallel:result is None 2024-09-13T17:10:24.057 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T17:10:24.116 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-09-13T17:10:24.117 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-09-13T17:10:24.143 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-13T17:10:24.150 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-13T17:10:24.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.157+0000 7f70fe272700 1 Processor -- start 2024-09-13T17:10:24.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.157+0000 7f70fe272700 1 -- start start 2024-09-13T17:10:24.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fe272700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f70f8159550 0x7f70f80cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:24.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fe272700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70f80c9610 0x7f70f80cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fe272700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f806dc20 con 0x7f70f80710b0 2024-09-13T17:10:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fe272700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f806c5a0 con 0x7f70f8159550 2024-09-13T17:10:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fe272700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8071620 con 0x7f70f80c9610 2024-09-13T17:10:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fd270700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f70f8159550 0x7f70f80cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fda71700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70f80c9610 0x7f70f80cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fd270700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f70f8159550 0x7f70f80cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36018/0 (socket says 172.21.15.123:36018) 2024-09-13T17:10:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fca6f700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f70f80710b0 0x7f70f80c8f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42368/0 (socket says 172.21.15.123:42368) 2024-09-13T17:10:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fd270700 1 -- 172.21.15.123:0/433508536 learned_addr learned my addr 172.21.15.123:0/433508536 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fd270700 1 -- 172.21.15.123:0/433508536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70f80c9610 msgr2=0x7f70f80cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fd270700 1 --2- 172.21.15.123:0/433508536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70f80c9610 0x7f70f80cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fd270700 1 -- 172.21.15.123:0/433508536 >> v1:172.21.15.123:6789/0 conn(0x7f70f80710b0 legacy=0x7f70f80c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fd270700 1 -- 172.21.15.123:0/433508536 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f80cc0a0 con 0x7f70f8159550 2024-09-13T17:10:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.161+0000 7f70fd270700 1 --2- 172.21.15.123:0/433508536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f8159550 0x7f70f80cc580 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f70e800aab0 tx=0x7f70e800adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00a3f990185652c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:24.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.165+0000 7f70effff700 1 -- 172.21.15.123:0/433508536 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e800cb70 con 0x7f70f8159550 2024-09-13T17:10:24.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.165+0000 7f70effff700 1 -- 172.21.15.123:0/433508536 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e800ccd0 con 0x7f70f8159550 2024-09-13T17:10:24.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.165+0000 7f70effff700 1 -- 172.21.15.123:0/433508536 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8018620 con 0x7f70f8159550 2024-09-13T17:10:24.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.169+0000 7f70fe272700 1 -- 172.21.15.123:0/433508536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f8159550 msgr2=0x7f70f80cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:24.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.169+0000 7f70fe272700 1 --2- 172.21.15.123:0/433508536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f8159550 0x7f70f80cc580 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f70e800aab0 tx=0x7f70e800adc0 comp rx=0 tx=0).stop 2024-09-13T17:10:24.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.169+0000 7f70fe272700 1 -- 172.21.15.123:0/433508536 shutdown_connections 2024-09-13T17:10:24.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.169+0000 7f70fe272700 1 --2- 172.21.15.123:0/433508536 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70f80c9610 0x7f70f80cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:24.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.169+0000 7f70fe272700 1 --2- 172.21.15.123:0/433508536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f8159550 0x7f70f80cc580 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:24.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.169+0000 7f70fe272700 1 -- 172.21.15.123:0/433508536 >> 172.21.15.123:0/433508536 conn(0x7f70f80b01d0 msgr2=0x7f70f80b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:24.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.169+0000 7f70fe272700 1 -- 172.21.15.123:0/433508536 shutdown_connections 2024-09-13T17:10:24.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.169+0000 7f70fe272700 1 -- 172.21.15.123:0/433508536 wait complete. 2024-09-13T17:10:24.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.169+0000 7f70fe272700 1 Processor -- start 2024-09-13T17:10:24.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.169+0000 7f70fe272700 1 -- start start 2024-09-13T17:10:24.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fe272700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70f80710b0 0x7f70f80c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:24.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fe272700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f80c9610 0x7f70f815c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:24.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fe272700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70f8159550 0x7f70f806cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:24.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fe272700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f81ee7e0 con 0x7f70f80c9610 2024-09-13T17:10:24.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fe272700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f815cab0 con 0x7f70f8159550 2024-09-13T17:10:24.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fe272700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f81ee9d0 con 0x7f70f80710b0 2024-09-13T17:10:24.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fca6f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f80c9610 0x7f70f815c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:24.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fca6f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f80c9610 0x7f70f815c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36030/0 (socket says 172.21.15.123:36030) 2024-09-13T17:10:24.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fca6f700 1 -- 172.21.15.123:0/2984880405 learned_addr learned my addr 172.21.15.123:0/2984880405 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:24.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fda71700 1 --2- 172.21.15.123:0/2984880405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70f8159550 0x7f70f806cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:24.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fd270700 1 --2- 172.21.15.123:0/2984880405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70f80710b0 0x7f70f80c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:24.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fca6f700 1 -- 172.21.15.123:0/2984880405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70f80710b0 msgr2=0x7f70f80c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:24.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fca6f700 1 --2- 172.21.15.123:0/2984880405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70f80710b0 0x7f70f80c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:24.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fca6f700 1 -- 172.21.15.123:0/2984880405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70f8159550 msgr2=0x7f70f806cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:24.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fca6f700 1 --2- 172.21.15.123:0/2984880405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70f8159550 0x7f70f806cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:24.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fca6f700 1 -- 172.21.15.123:0/2984880405 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e800a710 con 0x7f70f80c9610 2024-09-13T17:10:24.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fca6f700 1 --2- 172.21.15.123:0/2984880405 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f80c9610 0x7f70f815c570 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f70f400c700 tx=0x7f70f400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:24.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70edffb700 1 -- 172.21.15.123:0/2984880405 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4005cd0 con 0x7f70f80c9610 2024-09-13T17:10:24.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fe272700 1 -- 172.21.15.123:0/2984880405 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f81eec90 con 0x7f70f80c9610 2024-09-13T17:10:24.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fe272700 1 -- 172.21.15.123:0/2984880405 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f81ef250 con 0x7f70f80c9610 2024-09-13T17:10:24.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70edffb700 1 -- 172.21.15.123:0/2984880405 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f4005e30 con 0x7f70f80c9610 2024-09-13T17:10:24.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70edffb700 1 -- 172.21.15.123:0/2984880405 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f40072d0 con 0x7f70f80c9610 2024-09-13T17:10:24.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.173+0000 7f70fe272700 1 -- 172.21.15.123:0/2984880405 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d8005310 con 0x7f70f80c9610 2024-09-13T17:10:24.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.177+0000 7f70edffb700 1 -- 172.21.15.123:0/2984880405 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f70f4017020 con 0x7f70f80c9610 2024-09-13T17:10:24.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.177+0000 7f70edffb700 1 --2- 172.21.15.123:0/2984880405 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70dc066730 0x7f70dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:24.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.177+0000 7f70edffb700 1 -- 172.21.15.123:0/2984880405 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f70f4087530 con 0x7f70f80c9610 2024-09-13T17:10:24.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.177+0000 7f70fd270700 1 --2- 172.21.15.123:0/2984880405 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70dc066730 0x7f70dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:24.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.177+0000 7f70fd270700 1 --2- 172.21.15.123:0/2984880405 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70dc066730 0x7f70dc068bf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f70e8000c00 tx=0x7f70e801b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:24.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.185+0000 7f70edffb700 1 -- 172.21.15.123:0/2984880405 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f70f4054b20 con 0x7f70f80c9610 2024-09-13T17:10:24.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:24.373+0000 7f70fe272700 1 -- 172.21.15.123:0/2984880405 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f70d80055c0 con 0x7f70f80c9610 2024-09-13T17:10:25.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.181+0000 7f70edffb700 1 -- 172.21.15.123:0/2984880405 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v94) v1 ==== 97+0+0 (secure 0 0 0) 0x7f70f401f080 con 0x7f70f80c9610 2024-09-13T17:10:25.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.189+0000 7f70fe272700 1 -- 172.21.15.123:0/2984880405 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70dc066730 msgr2=0x7f70dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.189+0000 7f70fe272700 1 --2- 172.21.15.123:0/2984880405 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70dc066730 0x7f70dc068bf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f70e8000c00 tx=0x7f70e801b040 comp rx=0 tx=0).stop 2024-09-13T17:10:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.189+0000 7f70fe272700 1 -- 172.21.15.123:0/2984880405 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f80c9610 msgr2=0x7f70f815c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.189+0000 7f70fe272700 1 --2- 172.21.15.123:0/2984880405 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f80c9610 0x7f70f815c570 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f70f400c700 tx=0x7f70f400ca10 comp rx=0 tx=0).stop 2024-09-13T17:10:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.189+0000 7f70fe272700 1 -- 172.21.15.123:0/2984880405 shutdown_connections 2024-09-13T17:10:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.189+0000 7f70fe272700 1 --2- 172.21.15.123:0/2984880405 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f70dc066730 0x7f70dc068bf0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.189+0000 7f70fe272700 1 --2- 172.21.15.123:0/2984880405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70f8159550 0x7f70f806cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.189+0000 7f70fe272700 1 --2- 172.21.15.123:0/2984880405 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f80c9610 0x7f70f815c570 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.189+0000 7f70fe272700 1 --2- 172.21.15.123:0/2984880405 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f70f80710b0 0x7f70f80c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.189+0000 7f70fe272700 1 -- 172.21.15.123:0/2984880405 >> 172.21.15.123:0/2984880405 conn(0x7f70f80b01d0 msgr2=0x7f70f8157bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.189+0000 7f70fe272700 1 -- 172.21.15.123:0/2984880405 shutdown_connections 2024-09-13T17:10:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.189+0000 7f70fe272700 1 -- 172.21.15.123:0/2984880405 wait complete. 2024-09-13T17:10:25.196 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-13T17:10:25.210 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T17:10:25.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.321+0000 7f1c5496c700 1 Processor -- start 2024-09-13T17:10:25.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.321+0000 7f1c5496c700 1 -- start start 2024-09-13T17:10:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.321+0000 7f1c5496c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c500cdb20 0x7f1c500cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.321+0000 7f1c5496c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c50162550 con 0x7f1c5015e920 2024-09-13T17:10:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.321+0000 7f1c5496c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c500ce4a0 con 0x7f1c5015ed00 2024-09-13T17:10:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.321+0000 7f1c5496c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c500cd690 con 0x7f1c500cdb20 2024-09-13T17:10:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.321+0000 7f1c4ed9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1c5015e920 0x7f1c500caae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42372/0 (socket says 172.21.15.123:42372) 2024-09-13T17:10:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.321+0000 7f1c4ed9d700 1 -- 172.21.15.123:0/3445561337 learned_addr learned my addr 172.21.15.123:0/3445561337 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:25.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.321+0000 7f1c4f59e700 1 --2- 172.21.15.123:0/3445561337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c500cdb20 0x7f1c500cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c4dd9b700 1 -- 172.21.15.123:0/3445561337 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468081933 0 0) 0x7f1c50162550 con 0x7f1c5015e920 2024-09-13T17:10:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c4dd9b700 1 -- 172.21.15.123:0/3445561337 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c380035d0 con 0x7f1c5015e920 2024-09-13T17:10:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c4dd9b700 1 -- 172.21.15.123:0/3445561337 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937635004 0 0) 0x7f1c40001110 con 0x7f1c5015ed00 2024-09-13T17:10:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c4f59e700 1 -- 172.21.15.123:0/3445561337 >> v1:172.21.15.153:6789/0 conn(0x7f1c5015ed00 legacy=0x7f1c50161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c4f59e700 1 -- 172.21.15.123:0/3445561337 >> v1:172.21.15.123:6789/0 conn(0x7f1c5015e920 legacy=0x7f1c500caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c4f59e700 1 -- 172.21.15.123:0/3445561337 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c50161f90 con 0x7f1c500cdb20 2024-09-13T17:10:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c4f59e700 1 --2- 172.21.15.123:0/3445561337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c500cdb20 0x7f1c500cdf60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009dc0 tx=0x7f1c4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73ed01ecca8094aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c4dd9b700 1 -- 172.21.15.123:0/3445561337 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4800e070 con 0x7f1c500cdb20 2024-09-13T17:10:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c4dd9b700 1 -- 172.21.15.123:0/3445561337 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4800bb20 con 0x7f1c500cdb20 2024-09-13T17:10:25.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c4dd9b700 1 -- 172.21.15.123:0/3445561337 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4800be90 con 0x7f1c500cdb20 2024-09-13T17:10:25.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c5496c700 1 -- 172.21.15.123:0/3445561337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c500cdb20 msgr2=0x7f1c500cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c5496c700 1 --2- 172.21.15.123:0/3445561337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c500cdb20 0x7f1c500cdf60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009dc0 tx=0x7f1c4800b330 comp rx=0 tx=0).stop 2024-09-13T17:10:25.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c5496c700 1 -- 172.21.15.123:0/3445561337 shutdown_connections 2024-09-13T17:10:25.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c5496c700 1 --2- 172.21.15.123:0/3445561337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c500cdb20 0x7f1c500cdf60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c5496c700 1 -- 172.21.15.123:0/3445561337 >> 172.21.15.123:0/3445561337 conn(0x7f1c50066150 msgr2=0x7f1c50066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:25.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c5496c700 1 -- 172.21.15.123:0/3445561337 shutdown_connections 2024-09-13T17:10:25.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.325+0000 7f1c5496c700 1 -- 172.21.15.123:0/3445561337 wait complete. 2024-09-13T17:10:25.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c5496c700 1 Processor -- start 2024-09-13T17:10:25.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c5496c700 1 -- start start 2024-09-13T17:10:25.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c5496c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c500cdb20 0x7f1c50071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:25.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c5496c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c5015e920 0x7f1c501e7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:25.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c5496c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c5015ed00 0x7f1c50158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:25.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c5496c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5015c410 con 0x7f1c5015e920 2024-09-13T17:10:25.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c5496c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5015b790 con 0x7f1c5015ed00 2024-09-13T17:10:25.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c5496c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5015ba70 con 0x7f1c500cdb20 2024-09-13T17:10:25.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c4e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c5015e920 0x7f1c501e7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:25.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c4e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c5015e920 0x7f1c501e7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36042/0 (socket says 172.21.15.123:36042) 2024-09-13T17:10:25.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c4e59c700 1 -- 172.21.15.123:0/208197058 learned_addr learned my addr 172.21.15.123:0/208197058 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c4ed9d700 1 --2- 172.21.15.123:0/208197058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c500cdb20 0x7f1c50071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c4f59e700 1 --2- 172.21.15.123:0/208197058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c5015ed00 0x7f1c50158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c4e59c700 1 -- 172.21.15.123:0/208197058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c500cdb20 msgr2=0x7f1c50071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c4e59c700 1 --2- 172.21.15.123:0/208197058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c500cdb20 0x7f1c50071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c4e59c700 1 -- 172.21.15.123:0/208197058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c5015ed00 msgr2=0x7f1c50158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c4e59c700 1 --2- 172.21.15.123:0/208197058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c5015ed00 0x7f1c50158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.329+0000 7f1c4e59c700 1 -- 172.21.15.123:0/208197058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c48009a70 con 0x7f1c5015e920 2024-09-13T17:10:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.333+0000 7f1c4e59c700 1 --2- 172.21.15.123:0/208197058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c5015e920 0x7f1c501e7be0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000c520 tx=0x7f1c4000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.333+0000 7f1c377fe700 1 -- 172.21.15.123:0/208197058 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c400054e0 con 0x7f1c5015e920 2024-09-13T17:10:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.333+0000 7f1c5496c700 1 -- 172.21.15.123:0/208197058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5015bd50 con 0x7f1c5015e920 2024-09-13T17:10:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.333+0000 7f1c377fe700 1 -- 172.21.15.123:0/208197058 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c400036a0 con 0x7f1c5015e920 2024-09-13T17:10:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.333+0000 7f1c377fe700 1 -- 172.21.15.123:0/208197058 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40003a50 con 0x7f1c5015e920 2024-09-13T17:10:25.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.333+0000 7f1c5496c700 1 -- 172.21.15.123:0/208197058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5015b420 con 0x7f1c5015e920 2024-09-13T17:10:25.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.333+0000 7f1c5496c700 1 -- 172.21.15.123:0/208197058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c500677f0 con 0x7f1c5015e920 2024-09-13T17:10:25.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.333+0000 7f1c377fe700 1 -- 172.21.15.123:0/208197058 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c40003bb0 con 0x7f1c5015e920 2024-09-13T17:10:25.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.333+0000 7f1c377fe700 1 --2- 172.21.15.123:0/208197058 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c3c066730 0x7f1c3c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:25.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.333+0000 7f1c377fe700 1 -- 172.21.15.123:0/208197058 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1c40083000 con 0x7f1c5015e920 2024-09-13T17:10:25.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.333+0000 7f1c4ed9d700 1 --2- 172.21.15.123:0/208197058 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c3c066730 0x7f1c3c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:25.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.337+0000 7f1c4ed9d700 1 --2- 172.21.15.123:0/208197058 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c3c066730 0x7f1c3c068bf0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1c44007fd0 tx=0x7f1c44009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:25.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.341+0000 7f1c377fe700 1 -- 172.21.15.123:0/208197058 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c400506d0 con 0x7f1c5015e920 2024-09-13T17:10:25.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.573+0000 7f1c5496c700 1 -- 172.21.15.123:0/208197058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1c5015c550 con 0x7f1c5015e920 2024-09-13T17:10:25.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.577+0000 7f1c377fe700 1 -- 172.21.15.123:0/208197058 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1c5015c550 con 0x7f1c5015e920 2024-09-13T17:10:25.582 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:25.582 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:10:25.582 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-13T17:10:25.582 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.583 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-13T17:10:25.583 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmcINWChAAjEdCM4Sk1OsLUQerqFqnGg==", 2024-09-13T17:10:25.583 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.583 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:10:25.583 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:10:25.583 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:10:25.583 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.583 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.583 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.583 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.583 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-13T17:10:25.583 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmesC1ERAA2ZS4r6KU9vqfDLLX+0kwwg==", 2024-09-13T17:10:25.583 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.584 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:10:25.584 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:10:25.584 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:10:25.584 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.584 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.584 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.584 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.584 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-13T17:10:25.584 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORm+dvcDRAA5o6AtNdAEM2RTXMTKTuwvA==", 2024-09-13T17:10:25.584 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.584 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:10:25.585 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:10:25.585 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:10:25.585 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.585 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.585 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.585 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.585 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-13T17:10:25.585 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmnFIgGBAAZbqUsdKOG1nN0iHsKRqyHA==", 2024-09-13T17:10:25.585 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.585 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:10:25.585 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:10:25.585 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:10:25.585 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.585 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.586 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.586 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.586 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-13T17:10:25.586 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDucORmpvNQEhAAg2TDxfqiCxv8rfzNXd8ghw==", 2024-09-13T17:10:25.586 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.586 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:10:25.586 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:10:25.586 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.586 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.586 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.586 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.586 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-13T17:10:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDxcORmnAU+FxAAxjWreGRwyuQT2RRMicHAXg==", 2024-09-13T17:10:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:10:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:10:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-13T17:10:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD0cORmMXQpGhAADjhpu3evLXhYS+YKeKf8WQ==", 2024-09-13T17:10:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:10:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:10:25.587 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.588 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.588 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.588 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.588 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-13T17:10:25.588 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD3cORmAo7hHxAA80EcAMAxPmMPuKxUg6RYhQ==", 2024-09-13T17:10:25.588 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.588 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:10:25.588 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:10:25.588 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.588 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.588 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.588 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.589 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-13T17:10:25.589 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQD9cORm2j1KCxAA57ClQVuoJdhuk76L4nPHVQ==", 2024-09-13T17:10:25.589 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.589 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:10:25.589 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:10:25.589 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.589 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.589 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.589 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.589 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-13T17:10:25.589 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAAceRmu5IeExAAyUOWIVy5i703n829U0KSuw==", 2024-09-13T17:10:25.589 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.590 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:10:25.590 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:10:25.590 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.590 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.590 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.590 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.590 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-13T17:10:25.590 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQADceRmhiXfFhAAt6aAa3EUOvKclLyGEl84SA==", 2024-09-13T17:10:25.590 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.590 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:10:25.590 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:10:25.590 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.590 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.590 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.591 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.591 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-13T17:10:25.591 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQAGceRmjYdfHBAAHn19wbVS72wMYHvMh+Cpyg==", 2024-09-13T17:10:25.591 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.591 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-13T17:10:25.591 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-13T17:10:25.591 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.591 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.591 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.591 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.591 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-13T17:10:25.591 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmieDjGxAA9C8qfFqgRul4Kzk+0+UMTA==", 2024-09-13T17:10:25.591 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.592 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:10:25.592 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-13T17:10:25.592 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T17:10:25.592 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.592 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.592 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.592 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-13T17:10:25.592 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmJvUUJRAAQci63exaXrtjPfssFai1jw==", 2024-09-13T17:10:25.592 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.592 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:10:25.592 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:10:25.592 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:10:25.592 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:10:25.592 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmgbzRIRAA8VlhYQpFRQUNOo6nplFySA==", 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmwT+9KhAASidrLfvv55brtJ3Mk+qdxA==", 2024-09-13T17:10:25.593 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.594 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-13T17:10:25.594 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-13T17:10:25.594 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-13T17:10:25.594 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-13T17:10:25.594 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.594 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.594 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.594 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-13T17:10:25.596 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDqcORmn/ceNxAAxs8e7/yGRB9oykHDFVQ0lA==", 2024-09-13T17:10:25.596 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.596 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:10:25.596 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-13T17:10:25.596 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-13T17:10:25.596 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.597 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.597 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.597 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.597 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-13T17:10:25.597 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmFSRNBhAAbI1RASXCwIZPggcjMdXynw==", 2024-09-13T17:10:25.597 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.597 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:10:25.597 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-13T17:10:25.597 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.597 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.597 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:25.597 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:25.597 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-13T17:10:25.597 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQDrcORmLhAcAxAAHSNEbQ2dLEBPGDMMKc7dQQ==", 2024-09-13T17:10:25.598 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-13T17:10:25.598 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-13T17:10:25.598 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-13T17:10:25.598 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-13T17:10:25.598 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.598 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:25.598 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-13T17:10:25.598 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:10:25.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.577+0000 7f1c5496c700 1 -- 172.21.15.123:0/208197058 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c3c066730 msgr2=0x7f1c3c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.577+0000 7f1c5496c700 1 --2- 172.21.15.123:0/208197058 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c3c066730 0x7f1c3c068bf0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1c44007fd0 tx=0x7f1c44009040 comp rx=0 tx=0).stop 2024-09-13T17:10:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.577+0000 7f1c5496c700 1 -- 172.21.15.123:0/208197058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c5015e920 msgr2=0x7f1c501e7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.577+0000 7f1c5496c700 1 --2- 172.21.15.123:0/208197058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c5015e920 0x7f1c501e7be0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000c520 tx=0x7f1c4000c830 comp rx=0 tx=0).stop 2024-09-13T17:10:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.577+0000 7f1c5496c700 1 -- 172.21.15.123:0/208197058 shutdown_connections 2024-09-13T17:10:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.577+0000 7f1c5496c700 1 --2- 172.21.15.123:0/208197058 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1c3c066730 0x7f1c3c068bf0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.577+0000 7f1c5496c700 1 --2- 172.21.15.123:0/208197058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c5015ed00 0x7f1c50158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.577+0000 7f1c5496c700 1 --2- 172.21.15.123:0/208197058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c5015e920 0x7f1c501e7be0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.577+0000 7f1c5496c700 1 --2- 172.21.15.123:0/208197058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1c500cdb20 0x7f1c50071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.577+0000 7f1c5496c700 1 -- 172.21.15.123:0/208197058 >> 172.21.15.123:0/208197058 conn(0x7f1c50066150 msgr2=0x7f1c5006be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.577+0000 7f1c5496c700 1 -- 172.21.15.123:0/208197058 shutdown_connections 2024-09-13T17:10:25.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.577+0000 7f1c5496c700 1 -- 172.21.15.123:0/208197058 wait complete. 2024-09-13T17:10:25.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:25.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.705+0000 7fc663fff700 1 Processor -- start 2024-09-13T17:10:25.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc663fff700 1 -- start start 2024-09-13T17:10:25.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc663fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6640cedc0 0x7fc664071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:25.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc663fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66415d360 con 0x7fc6640cdfd0 2024-09-13T17:10:25.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc663fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640724c0 con 0x7fc6641598b0 2024-09-13T17:10:25.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc663fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640ce480 con 0x7fc6640cedc0 2024-09-13T17:10:25.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc6637fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc6640cdfd0 0x7fc664159c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42378/0 (socket says 172.21.15.123:42378) 2024-09-13T17:10:25.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc6637fe700 1 -- 172.21.15.123:0/4033960597 learned_addr learned my addr 172.21.15.123:0/4033960597 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:25.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc6627fc700 1 --2- 172.21.15.123:0/4033960597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6640cedc0 0x7fc664071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:25.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc661ffb700 1 -- 172.21.15.123:0/4033960597 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490927239 0 0) 0x7fc66415d360 con 0x7fc6640cdfd0 2024-09-13T17:10:25.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc661ffb700 1 -- 172.21.15.123:0/4033960597 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc64c0035d0 con 0x7fc6640cdfd0 2024-09-13T17:10:25.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc6627fc700 1 -- 172.21.15.123:0/4033960597 >> v1:172.21.15.153:6789/0 conn(0x7fc6641598b0 legacy=0x7fc6640ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc6627fc700 1 -- 172.21.15.123:0/4033960597 >> v1:172.21.15.123:6789/0 conn(0x7fc6640cdfd0 legacy=0x7fc664159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc661ffb700 1 -- 172.21.15.123:0/4033960597 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2564353899 0 0) 0x7fc64c0035d0 con 0x7fc6640cdfd0 2024-09-13T17:10:25.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc6627fc700 1 -- 172.21.15.123:0/4033960597 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66415d5b0 con 0x7fc6640cedc0 2024-09-13T17:10:25.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc6627fc700 1 --2- 172.21.15.123:0/4033960597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6640cedc0 0x7fc664071e60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc654009880 tx=0x7fc654009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23dbb07dc8d1e4db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:25.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc661ffb700 1 -- 172.21.15.123:0/4033960597 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0019f0 con 0x7fc6640cedc0 2024-09-13T17:10:25.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc661ffb700 1 -- 172.21.15.123:0/4033960597 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc654004030 con 0x7fc6640cedc0 2024-09-13T17:10:25.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc661ffb700 1 -- 172.21.15.123:0/4033960597 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6540043c0 con 0x7fc6640cedc0 2024-09-13T17:10:25.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc663fff700 1 -- 172.21.15.123:0/4033960597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6640cedc0 msgr2=0x7fc664071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc663fff700 1 --2- 172.21.15.123:0/4033960597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6640cedc0 0x7fc664071e60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc654009880 tx=0x7fc654009b90 comp rx=0 tx=0).stop 2024-09-13T17:10:25.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc663fff700 1 -- 172.21.15.123:0/4033960597 shutdown_connections 2024-09-13T17:10:25.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc663fff700 1 --2- 172.21.15.123:0/4033960597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6640cedc0 0x7fc664071e60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc663fff700 1 -- 172.21.15.123:0/4033960597 >> 172.21.15.123:0/4033960597 conn(0x7fc664066150 msgr2=0x7fc664066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:25.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc663fff700 1 -- 172.21.15.123:0/4033960597 shutdown_connections 2024-09-13T17:10:25.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.709+0000 7fc663fff700 1 -- 172.21.15.123:0/4033960597 wait complete. 2024-09-13T17:10:25.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc663fff700 1 Processor -- start 2024-09-13T17:10:25.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc663fff700 1 -- start start 2024-09-13T17:10:25.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc663fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6640cdfd0 0x7fc664150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:25.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc663fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6640cedc0 0x7fc664144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:25.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc663fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6641598b0 0x7fc6641453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:25.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc663fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664152410 con 0x7fc6640cdfd0 2024-09-13T17:10:25.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc663fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664156fd0 con 0x7fc6641598b0 2024-09-13T17:10:25.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc663fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640af3c0 con 0x7fc6640cedc0 2024-09-13T17:10:25.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc662ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6640cdfd0 0x7fc664150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:25.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc6627fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6640cedc0 0x7fc664144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:25.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc662ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6640cdfd0 0x7fc664150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36048/0 (socket says 172.21.15.123:36048) 2024-09-13T17:10:25.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc662ffd700 1 -- 172.21.15.123:0/2757742149 learned_addr learned my addr 172.21.15.123:0/2757742149 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:25.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc6637fe700 1 --2- 172.21.15.123:0/2757742149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6641598b0 0x7fc6641453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:25.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc662ffd700 1 -- 172.21.15.123:0/2757742149 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6640cedc0 msgr2=0x7fc664144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc662ffd700 1 --2- 172.21.15.123:0/2757742149 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6640cedc0 0x7fc664144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc662ffd700 1 -- 172.21.15.123:0/2757742149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6641598b0 msgr2=0x7fc6641453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc662ffd700 1 --2- 172.21.15.123:0/2757742149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6641598b0 0x7fc6641453b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc662ffd700 1 -- 172.21.15.123:0/2757742149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6540094b0 con 0x7fc6640cdfd0 2024-09-13T17:10:25.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc6637fe700 1 --2- 172.21.15.123:0/2757742149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6641598b0 0x7fc6641453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:25.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc662ffd700 1 --2- 172.21.15.123:0/2757742149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6640cdfd0 0x7fc664150eb0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc65800c530 tx=0x7fc65800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:25.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc64b7fe700 1 -- 172.21.15.123:0/2757742149 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6580052d0 con 0x7fc6640cdfd0 2024-09-13T17:10:25.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc64b7fe700 1 -- 172.21.15.123:0/2757742149 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc658005430 con 0x7fc6640cdfd0 2024-09-13T17:10:25.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc663fff700 1 -- 172.21.15.123:0/2757742149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6641538d0 con 0x7fc6640cdfd0 2024-09-13T17:10:25.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc64b7fe700 1 -- 172.21.15.123:0/2757742149 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6580055a0 con 0x7fc6640cdfd0 2024-09-13T17:10:25.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.713+0000 7fc663fff700 1 -- 172.21.15.123:0/2757742149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc664153e90 con 0x7fc6640cdfd0 2024-09-13T17:10:25.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.717+0000 7fc663fff700 1 -- 172.21.15.123:0/2757742149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6640677f0 con 0x7fc6640cdfd0 2024-09-13T17:10:25.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.717+0000 7fc64b7fe700 1 -- 172.21.15.123:0/2757742149 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc6580038e0 con 0x7fc6640cdfd0 2024-09-13T17:10:25.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.717+0000 7fc64b7fe700 1 --2- 172.21.15.123:0/2757742149 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc650066730 0x7fc650068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:25.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.717+0000 7fc64b7fe700 1 -- 172.21.15.123:0/2757742149 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc658083200 con 0x7fc6640cdfd0 2024-09-13T17:10:25.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.717+0000 7fc6627fc700 1 --2- 172.21.15.123:0/2757742149 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc650066730 0x7fc650068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:25.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.717+0000 7fc6627fc700 1 --2- 172.21.15.123:0/2757742149 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc650066730 0x7fc650068bf0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc6540090b0 tx=0x7fc654010000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:25.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.725+0000 7fc64b7fe700 1 -- 172.21.15.123:0/2757742149 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc6580508c0 con 0x7fc6640cdfd0 2024-09-13T17:10:25.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.897+0000 7fc663fff700 1 -- 172.21.15.123:0/2757742149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc664071e60 con 0x7fc6640cdfd0 2024-09-13T17:10:25.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.897+0000 7fc64b7fe700 1 -- 172.21.15.123:0/2757742149 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+12906 (secure 0 0 0) 0x7fc658053ee0 con 0x7fc6640cdfd0 2024-09-13T17:10:25.904 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:25.904 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":94,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:25.182241+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.901+0000 7fc663fff700 1 -- 172.21.15.123:0/2757742149 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc650066730 msgr2=0x7fc650068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.901+0000 7fc663fff700 1 --2- 172.21.15.123:0/2757742149 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc650066730 0x7fc650068bf0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc6540090b0 tx=0x7fc654010000 comp rx=0 tx=0).stop 2024-09-13T17:10:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.901+0000 7fc663fff700 1 -- 172.21.15.123:0/2757742149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6640cdfd0 msgr2=0x7fc664150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.901+0000 7fc663fff700 1 --2- 172.21.15.123:0/2757742149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6640cdfd0 0x7fc664150eb0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc65800c530 tx=0x7fc65800c840 comp rx=0 tx=0).stop 2024-09-13T17:10:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.901+0000 7fc663fff700 1 -- 172.21.15.123:0/2757742149 shutdown_connections 2024-09-13T17:10:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.901+0000 7fc663fff700 1 --2- 172.21.15.123:0/2757742149 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc650066730 0x7fc650068bf0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.901+0000 7fc663fff700 1 --2- 172.21.15.123:0/2757742149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6641598b0 0x7fc6641453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.901+0000 7fc663fff700 1 --2- 172.21.15.123:0/2757742149 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6640cedc0 0x7fc664144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.901+0000 7fc663fff700 1 --2- 172.21.15.123:0/2757742149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6640cdfd0 0x7fc664150eb0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:25.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.901+0000 7fc663fff700 1 -- 172.21.15.123:0/2757742149 >> 172.21.15.123:0/2757742149 conn(0x7fc664066150 msgr2=0x7fc66406d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:25.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.901+0000 7fc663fff700 1 -- 172.21.15.123:0/2757742149 shutdown_connections 2024-09-13T17:10:25.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:25.901+0000 7fc663fff700 1 -- 172.21.15.123:0/2757742149 wait complete. 2024-09-13T17:10:25.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:10:25.919 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:10:26.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 Processor -- start 2024-09-13T17:10:26.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 -- start start 2024-09-13T17:10:26.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f71cc0d0f40 0x7f71cc0d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71cc0cd5e0 0x7f71cc0cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71cc0d0cb0 con 0x7f71cc0b58b0 2024-09-13T17:10:26.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71cc0b0060 con 0x7f71cc0d0f40 2024-09-13T17:10:26.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc0b0340 con 0x7f71cc0cd5e0 2024-09-13T17:10:26.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71cb7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f71cc0d0f40 0x7f71cc0d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71cb7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f71cc0d0f40 0x7f71cc0d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36064/0 (socket says 172.21.15.123:36064) 2024-09-13T17:10:26.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71caffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f71cc0b58b0 0x7f71cc0d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42394/0 (socket says 172.21.15.123:42394) 2024-09-13T17:10:26.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71cb7fe700 1 -- 172.21.15.123:0/1157806682 learned_addr learned my addr 172.21.15.123:0/1157806682 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:26.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71cbfff700 1 --2- 172.21.15.123:0/1157806682 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71cc0cd5e0 0x7f71cc0cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71cb7fe700 1 -- 172.21.15.123:0/1157806682 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71cc0cd5e0 msgr2=0x7f71cc0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:26.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71cb7fe700 1 --2- 172.21.15.123:0/1157806682 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71cc0cd5e0 0x7f71cc0cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71cb7fe700 1 -- 172.21.15.123:0/1157806682 >> v1:172.21.15.123:6789/0 conn(0x7f71cc0b58b0 legacy=0x7f71cc0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:26.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71ca7fc700 1 -- 172.21.15.123:0/1157806682 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145755383 0 0) 0x7f71cc0d0cb0 con 0x7f71cc0b58b0 2024-09-13T17:10:26.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71cb7fe700 1 -- 172.21.15.123:0/1157806682 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc0b0620 con 0x7f71cc0d0f40 2024-09-13T17:10:26.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71cb7fe700 1 --2- 172.21.15.123:0/1157806682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0d0f40 0x7f71cc0d1320 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009910 tx=0x7f71bc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f56e7ce27bf25ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:26.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71ca7fc700 1 -- 172.21.15.123:0/1157806682 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc00ba60 con 0x7f71cc0d0f40 2024-09-13T17:10:26.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71ca7fc700 1 -- 172.21.15.123:0/1157806682 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc00bbc0 con 0x7f71cc0d0f40 2024-09-13T17:10:26.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71ca7fc700 1 -- 172.21.15.123:0/1157806682 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc009e60 con 0x7f71cc0d0f40 2024-09-13T17:10:26.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 -- 172.21.15.123:0/1157806682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0d0f40 msgr2=0x7f71cc0d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:26.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 --2- 172.21.15.123:0/1157806682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0d0f40 0x7f71cc0d1320 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009910 tx=0x7f71bc009c20 comp rx=0 tx=0).stop 2024-09-13T17:10:26.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 -- 172.21.15.123:0/1157806682 shutdown_connections 2024-09-13T17:10:26.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 --2- 172.21.15.123:0/1157806682 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71cc0cd5e0 0x7f71cc0cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 --2- 172.21.15.123:0/1157806682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0d0f40 0x7f71cc0d1320 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 -- 172.21.15.123:0/1157806682 >> 172.21.15.123:0/1157806682 conn(0x7f71cc0d2a60 msgr2=0x7f71cc0d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:26.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 -- 172.21.15.123:0/1157806682 shutdown_connections 2024-09-13T17:10:26.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 -- 172.21.15.123:0/1157806682 wait complete. 2024-09-13T17:10:26.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.033+0000 7f71d0dcd700 1 Processor -- start 2024-09-13T17:10:26.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71d0dcd700 1 -- start start 2024-09-13T17:10:26.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71d0dcd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71cc0b58b0 0x7f71cc0b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71d0dcd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0cd5e0 0x7f71cc0cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71d0dcd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71cc0d0f40 0x7f71cc0b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71d0dcd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc15ff20 con 0x7f71cc0cd5e0 2024-09-13T17:10:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71d0dcd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc0b6000 con 0x7f71cc0d0f40 2024-09-13T17:10:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71d0dcd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc0b7010 con 0x7f71cc0b58b0 2024-09-13T17:10:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71caffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0cd5e0 0x7f71cc0cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71caffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0cd5e0 0x7f71cc0cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36070/0 (socket says 172.21.15.123:36070) 2024-09-13T17:10:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71caffd700 1 -- 172.21.15.123:0/936558769 learned_addr learned my addr 172.21.15.123:0/936558769 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71cb7fe700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71cc0b58b0 0x7f71cc0b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71cbfff700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71cc0d0f40 0x7f71cc0b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71caffd700 1 -- 172.21.15.123:0/936558769 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71cc0b58b0 msgr2=0x7f71cc0b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71caffd700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71cc0b58b0 0x7f71cc0b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71caffd700 1 -- 172.21.15.123:0/936558769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71cc0d0f40 msgr2=0x7f71cc0b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:26.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71caffd700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71cc0d0f40 0x7f71cc0b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71caffd700 1 -- 172.21.15.123:0/936558769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc009570 con 0x7f71cc0cd5e0 2024-09-13T17:10:26.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71cb7fe700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71cc0b58b0 0x7f71cc0b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:26.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71caffd700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0cd5e0 0x7f71cc0cf690 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f71c000c4e0 tx=0x7f71c000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:26.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71b3fff700 1 -- 172.21.15.123:0/936558769 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c0004ca0 con 0x7f71cc0cd5e0 2024-09-13T17:10:26.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71b3fff700 1 -- 172.21.15.123:0/936558769 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c0004e20 con 0x7f71cc0cd5e0 2024-09-13T17:10:26.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71b3fff700 1 -- 172.21.15.123:0/936558769 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c0007310 con 0x7f71cc0cd5e0 2024-09-13T17:10:26.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71d0dcd700 1 -- 172.21.15.123:0/936558769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71cc0b6250 con 0x7f71cc0cd5e0 2024-09-13T17:10:26.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.037+0000 7f71d0dcd700 1 -- 172.21.15.123:0/936558769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc0b6810 con 0x7f71cc0cd5e0 2024-09-13T17:10:26.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.041+0000 7f71d0dcd700 1 -- 172.21.15.123:0/936558769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71cc15ce70 con 0x7f71cc0cd5e0 2024-09-13T17:10:26.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.041+0000 7f71b3fff700 1 -- 172.21.15.123:0/936558769 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f71c0007470 con 0x7f71cc0cd5e0 2024-09-13T17:10:26.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.041+0000 7f71b3fff700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f71b8066760 0x7f71b8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.041+0000 7f71cb7fe700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f71b8066760 0x7f71b8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.041+0000 7f71b3fff700 1 -- 172.21.15.123:0/936558769 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f71c0083b40 con 0x7f71cc0cd5e0 2024-09-13T17:10:26.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.041+0000 7f71cb7fe700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f71b8066760 0x7f71b8068c20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f71bc000c00 tx=0x7f71bc008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:26.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.053+0000 7f71b3fff700 1 -- 172.21.15.123:0/936558769 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f71c0051210 con 0x7f71cc0cd5e0 2024-09-13T17:10:26.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.209+0000 7f71d0dcd700 1 -- 172.21.15.123:0/936558769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71cc08c250 con 0x7f71cc0cd5e0 2024-09-13T17:10:26.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.209+0000 7f71b3fff700 1 -- 172.21.15.123:0/936558769 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71c0007720 con 0x7f71cc0cd5e0 2024-09-13T17:10:26.217 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:10:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.213+0000 7f71d0dcd700 1 -- 172.21.15.123:0/936558769 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f71b8066760 msgr2=0x7f71b8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.213+0000 7f71d0dcd700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f71b8066760 0x7f71b8068c20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f71bc000c00 tx=0x7f71bc008030 comp rx=0 tx=0).stop 2024-09-13T17:10:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.213+0000 7f71d0dcd700 1 -- 172.21.15.123:0/936558769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0cd5e0 msgr2=0x7f71cc0cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.213+0000 7f71d0dcd700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0cd5e0 0x7f71cc0cf690 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f71c000c4e0 tx=0x7f71c000c8a0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.213+0000 7f71d0dcd700 1 -- 172.21.15.123:0/936558769 shutdown_connections 2024-09-13T17:10:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.213+0000 7f71d0dcd700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f71b8066760 0x7f71b8068c20 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.213+0000 7f71d0dcd700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71cc0d0f40 0x7f71cc0b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.213+0000 7f71d0dcd700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0cd5e0 0x7f71cc0cf690 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.213+0000 7f71d0dcd700 1 --2- 172.21.15.123:0/936558769 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f71cc0b58b0 0x7f71cc0b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.213+0000 7f71d0dcd700 1 -- 172.21.15.123:0/936558769 >> 172.21.15.123:0/936558769 conn(0x7f71cc0d2a60 msgr2=0x7f71cc0b8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.213+0000 7f71d0dcd700 1 -- 172.21.15.123:0/936558769 shutdown_connections 2024-09-13T17:10:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.213+0000 7f71d0dcd700 1 -- 172.21.15.123:0/936558769 wait complete. 2024-09-13T17:10:26.231 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:10:26.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 Processor -- start 2024-09-13T17:10:26.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 -- start start 2024-09-13T17:10:26.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2140071580 0x7f21400705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f214015b9b0 0x7f21400cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21400cee80 con 0x7f214015a8c0 2024-09-13T17:10:26.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214015be60 con 0x7f2140071580 2024-09-13T17:10:26.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21400ce270 con 0x7f214015b9b0 2024-09-13T17:10:26.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f213ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2140071580 0x7f21400705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f213ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2140071580 0x7f21400705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36080/0 (socket says 172.21.15.123:36080) 2024-09-13T17:10:26.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f213ffff700 1 -- 172.21.15.123:0/472352545 learned_addr learned my addr 172.21.15.123:0/472352545 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:26.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f214527b700 1 --2- 172.21.15.123:0/472352545 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f214015b9b0 0x7f21400cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f213ffff700 1 -- 172.21.15.123:0/472352545 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f214015b9b0 msgr2=0x7f21400cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:26.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f213ffff700 1 --2- 172.21.15.123:0/472352545 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f214015b9b0 0x7f21400cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f213ffff700 1 -- 172.21.15.123:0/472352545 >> v1:172.21.15.153:6789/0 conn(0x7f214015a8c0 legacy=0x7f2140070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:26.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f213ffff700 1 -- 172.21.15.123:0/472352545 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21400ce550 con 0x7f2140071580 2024-09-13T17:10:26.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f213ffff700 1 --2- 172.21.15.123:0/472352545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2140071580 0x7f21400705b0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f2130009e50 tx=0x7f213000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a483b9faf648946 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:26.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f213f7fe700 1 -- 172.21.15.123:0/472352545 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213000e070 con 0x7f2140071580 2024-09-13T17:10:26.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f213f7fe700 1 -- 172.21.15.123:0/472352545 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2130003a40 con 0x7f2140071580 2024-09-13T17:10:26.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f213f7fe700 1 -- 172.21.15.123:0/472352545 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130003df0 con 0x7f2140071580 2024-09-13T17:10:26.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 -- 172.21.15.123:0/472352545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2140071580 msgr2=0x7f21400705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:26.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 --2- 172.21.15.123:0/472352545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2140071580 0x7f21400705b0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f2130009e50 tx=0x7f213000b330 comp rx=0 tx=0).stop 2024-09-13T17:10:26.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 -- 172.21.15.123:0/472352545 shutdown_connections 2024-09-13T17:10:26.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 --2- 172.21.15.123:0/472352545 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f214015b9b0 0x7f21400cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 --2- 172.21.15.123:0/472352545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2140071580 0x7f21400705b0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 -- 172.21.15.123:0/472352545 >> 172.21.15.123:0/472352545 conn(0x7f2140066150 msgr2=0x7f2140066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:26.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 -- 172.21.15.123:0/472352545 shutdown_connections 2024-09-13T17:10:26.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.337+0000 7f2145a7c700 1 -- 172.21.15.123:0/472352545 wait complete. 2024-09-13T17:10:26.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2145a7c700 1 Processor -- start 2024-09-13T17:10:26.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2145a7c700 1 -- start start 2024-09-13T17:10:26.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2145a7c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2140071580 0x7f21401482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2145a7c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f214015a8c0 0x7f2140158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2145a7c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f214015b9b0 0x7f21401545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2145a7c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2140153e20 con 0x7f2140071580 2024-09-13T17:10:26.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2145a7c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2140152d80 con 0x7f214015a8c0 2024-09-13T17:10:26.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2145a7c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2140153060 con 0x7f214015b9b0 2024-09-13T17:10:26.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2144a7a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2140071580 0x7f21401482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2144a7a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2140071580 0x7f21401482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36094/0 (socket says 172.21.15.123:36094) 2024-09-13T17:10:26.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2144a7a700 1 -- 172.21.15.123:0/2954710783 learned_addr learned my addr 172.21.15.123:0/2954710783 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:26.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f214527b700 1 --2- 172.21.15.123:0/2954710783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f214015b9b0 0x7f21401545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f213ffff700 1 --2- 172.21.15.123:0/2954710783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f214015a8c0 0x7f2140158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2144a7a700 1 -- 172.21.15.123:0/2954710783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f214015b9b0 msgr2=0x7f21401545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:26.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2144a7a700 1 --2- 172.21.15.123:0/2954710783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f214015b9b0 0x7f21401545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2144a7a700 1 -- 172.21.15.123:0/2954710783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f214015a8c0 msgr2=0x7f2140158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:26.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2144a7a700 1 --2- 172.21.15.123:0/2954710783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f214015a8c0 0x7f2140158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2144a7a700 1 -- 172.21.15.123:0/2954710783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2130009b30 con 0x7f2140071580 2024-09-13T17:10:26.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2144a7a700 1 --2- 172.21.15.123:0/2954710783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2140071580 0x7f21401482c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f212800c4e0 tx=0x7f212800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:26.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f213d7fa700 1 -- 172.21.15.123:0/2954710783 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2128011790 con 0x7f2140071580 2024-09-13T17:10:26.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f213d7fa700 1 -- 172.21.15.123:0/2954710783 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2128011910 con 0x7f2140071580 2024-09-13T17:10:26.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2145a7c700 1 -- 172.21.15.123:0/2954710783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2140153340 con 0x7f2140071580 2024-09-13T17:10:26.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f213d7fa700 1 -- 172.21.15.123:0/2954710783 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2128011cc0 con 0x7f2140071580 2024-09-13T17:10:26.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.341+0000 7f2145a7c700 1 -- 172.21.15.123:0/2954710783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2140153900 con 0x7f2140071580 2024-09-13T17:10:26.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.345+0000 7f2145a7c700 1 -- 172.21.15.123:0/2954710783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21400677f0 con 0x7f2140071580 2024-09-13T17:10:26.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.345+0000 7f213d7fa700 1 -- 172.21.15.123:0/2954710783 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f212801c460 con 0x7f2140071580 2024-09-13T17:10:26.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.345+0000 7f213d7fa700 1 --2- 172.21.15.123:0/2954710783 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2120066730 0x7f2120068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.345+0000 7f213ffff700 1 --2- 172.21.15.123:0/2954710783 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2120066730 0x7f2120068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.345+0000 7f213d7fa700 1 -- 172.21.15.123:0/2954710783 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2128083bf0 con 0x7f2140071580 2024-09-13T17:10:26.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.345+0000 7f213ffff700 1 --2- 172.21.15.123:0/2954710783 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2120066730 0x7f2120068bf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2130015040 tx=0x7f2130009000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:26.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.353+0000 7f213d7fa700 1 -- 172.21.15.123:0/2954710783 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2128051210 con 0x7f2140071580 2024-09-13T17:10:26.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.525+0000 7f2145a7c700 1 -- 172.21.15.123:0/2954710783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f21400705b0 con 0x7f2140071580 2024-09-13T17:10:26.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.525+0000 7f213d7fa700 1 -- 172.21.15.123:0/2954710783 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v94) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2128054830 con 0x7f2140071580 2024-09-13T17:10:26.532 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:26.532 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-13T17:10:26.533 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-13T17:10:26.533 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-13T17:10:26.533 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-13T17:10:26.533 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:26.533 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-13T17:10:26.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.529+0000 7f2145a7c700 1 -- 172.21.15.123:0/2954710783 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2120066730 msgr2=0x7f2120068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:26.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.529+0000 7f2145a7c700 1 --2- 172.21.15.123:0/2954710783 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2120066730 0x7f2120068bf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2130015040 tx=0x7f2130009000 comp rx=0 tx=0).stop 2024-09-13T17:10:26.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.529+0000 7f2145a7c700 1 -- 172.21.15.123:0/2954710783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2140071580 msgr2=0x7f21401482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:26.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.529+0000 7f2145a7c700 1 --2- 172.21.15.123:0/2954710783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2140071580 0x7f21401482c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f212800c4e0 tx=0x7f212800c7f0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.529+0000 7f2145a7c700 1 -- 172.21.15.123:0/2954710783 shutdown_connections 2024-09-13T17:10:26.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.529+0000 7f2145a7c700 1 --2- 172.21.15.123:0/2954710783 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2120066730 0x7f2120068bf0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.529+0000 7f2145a7c700 1 --2- 172.21.15.123:0/2954710783 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f214015b9b0 0x7f21401545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.529+0000 7f2145a7c700 1 --2- 172.21.15.123:0/2954710783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f214015a8c0 0x7f2140158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.529+0000 7f2145a7c700 1 --2- 172.21.15.123:0/2954710783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2140071580 0x7f21401482c0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.529+0000 7f2145a7c700 1 -- 172.21.15.123:0/2954710783 >> 172.21.15.123:0/2954710783 conn(0x7f2140066150 msgr2=0x7f214006cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:26.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.529+0000 7f2145a7c700 1 -- 172.21.15.123:0/2954710783 shutdown_connections 2024-09-13T17:10:26.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.529+0000 7f2145a7c700 1 -- 172.21.15.123:0/2954710783 wait complete. 2024-09-13T17:10:26.547 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:10:26.547 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:10:26.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.661+0000 7f98be684700 1 Processor -- start 2024-09-13T17:10:26.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.661+0000 7f98be684700 1 -- start start 2024-09-13T17:10:26.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f98b00e2d30 0x7f98b0056fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98b0057520 0x7f98b000c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f98b000cdb0 0x7f98b00e67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b000d240 con 0x7f98b000cdb0 2024-09-13T17:10:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b0007780 con 0x7f98b00e2d30 2024-09-13T17:10:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b00e3110 con 0x7f98b0057520 2024-09-13T17:10:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bde83700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f98b000cdb0 0x7f98b00e67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bde83700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f98b000cdb0 0x7f98b00e67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36108/0 (socket says 172.21.15.123:36108) 2024-09-13T17:10:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bde83700 1 -- 172.21.15.123:0/2407422927 learned_addr learned my addr 172.21.15.123:0/2407422927 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bd682700 1 --2- 172.21.15.123:0/2407422927 >> v2:172.21.15.153:3300/0 conn(0x7f98b00e2d30 0x7f98b0056fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bce81700 1 --2- 172.21.15.123:0/2407422927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98b0057520 0x7f98b000c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bde83700 1 -- 172.21.15.123:0/2407422927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98b0057520 msgr2=0x7f98b000c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bde83700 1 --2- 172.21.15.123:0/2407422927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98b0057520 0x7f98b000c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bde83700 1 -- 172.21.15.123:0/2407422927 >> v2:172.21.15.153:3300/0 conn(0x7f98b00e2d30 msgr2=0x7f98b0056fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bde83700 1 --2- 172.21.15.123:0/2407422927 >> v2:172.21.15.153:3300/0 conn(0x7f98b00e2d30 0x7f98b0056fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bde83700 1 -- 172.21.15.123:0/2407422927 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b0055840 con 0x7f98b000cdb0 2024-09-13T17:10:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bde83700 1 --2- 172.21.15.123:0/2407422927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98b000cdb0 0x7f98b00e67d0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f98b8064010 tx=0x7f98b8069900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d057899684b92f33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98affff700 1 -- 172.21.15.123:0/2407422927 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b80687a0 con 0x7f98b000cdb0 2024-09-13T17:10:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98affff700 1 -- 172.21.15.123:0/2407422927 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b8073f10 con 0x7f98b000cdb0 2024-09-13T17:10:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98affff700 1 -- 172.21.15.123:0/2407422927 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8074300 con 0x7f98b000cdb0 2024-09-13T17:10:26.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 -- 172.21.15.123:0/2407422927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98b000cdb0 msgr2=0x7f98b00e67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:26.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 --2- 172.21.15.123:0/2407422927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98b000cdb0 0x7f98b00e67d0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f98b8064010 tx=0x7f98b8069900 comp rx=0 tx=0).stop 2024-09-13T17:10:26.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 -- 172.21.15.123:0/2407422927 shutdown_connections 2024-09-13T17:10:26.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 --2- 172.21.15.123:0/2407422927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98b0057520 0x7f98b000c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 --2- 172.21.15.123:0/2407422927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98b000cdb0 0x7f98b00e67d0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 --2- 172.21.15.123:0/2407422927 >> v2:172.21.15.153:3300/0 conn(0x7f98b00e2d30 0x7f98b0056fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 -- 172.21.15.123:0/2407422927 >> 172.21.15.123:0/2407422927 conn(0x7f98b001fc00 msgr2=0x7f98b00568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:26.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 -- 172.21.15.123:0/2407422927 shutdown_connections 2024-09-13T17:10:26.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 -- 172.21.15.123:0/2407422927 wait complete. 2024-09-13T17:10:26.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 Processor -- start 2024-09-13T17:10:26.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 -- start start 2024-09-13T17:10:26.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98b000cdb0 0x7f98b0038e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98b0057520 0x7f98b00cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b00e2d30 0x7f98b003a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b004e050 con 0x7f98b000cdb0 2024-09-13T17:10:26.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b0050990 con 0x7f98b00e2d30 2024-09-13T17:10:26.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b004dad0 con 0x7f98b0057520 2024-09-13T17:10:26.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bd682700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98b000cdb0 0x7f98b0038e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bd682700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98b000cdb0 0x7f98b0038e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36124/0 (socket says 172.21.15.123:36124) 2024-09-13T17:10:26.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bd682700 1 -- 172.21.15.123:0/223094385 learned_addr learned my addr 172.21.15.123:0/223094385 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:26.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bce81700 1 --2- 172.21.15.123:0/223094385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98b0057520 0x7f98b00cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bde83700 1 --2- 172.21.15.123:0/223094385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b00e2d30 0x7f98b003a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bd682700 1 -- 172.21.15.123:0/223094385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98b0057520 msgr2=0x7f98b00cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:26.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bd682700 1 --2- 172.21.15.123:0/223094385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98b0057520 0x7f98b00cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bd682700 1 -- 172.21.15.123:0/223094385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b00e2d30 msgr2=0x7f98b003a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:26.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bd682700 1 --2- 172.21.15.123:0/223094385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b00e2d30 0x7f98b003a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:26.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bd682700 1 -- 172.21.15.123:0/223094385 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b804f5c0 con 0x7f98b000cdb0 2024-09-13T17:10:26.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98bd682700 1 --2- 172.21.15.123:0/223094385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98b000cdb0 0x7f98b0038e90 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f98a800d800 tx=0x7f98a800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:26.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98adffb700 1 -- 172.21.15.123:0/223094385 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8018070 con 0x7f98b000cdb0 2024-09-13T17:10:26.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98adffb700 1 -- 172.21.15.123:0/223094385 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a8005a40 con 0x7f98b000cdb0 2024-09-13T17:10:26.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 -- 172.21.15.123:0/223094385 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b00506b0 con 0x7f98b000cdb0 2024-09-13T17:10:26.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98adffb700 1 -- 172.21.15.123:0/223094385 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8005bf0 con 0x7f98b000cdb0 2024-09-13T17:10:26.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.669+0000 7f98be684700 1 -- 172.21.15.123:0/223094385 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b0036910 con 0x7f98b000cdb0 2024-09-13T17:10:26.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.673+0000 7f98be684700 1 -- 172.21.15.123:0/223094385 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b0036760 con 0x7f98b000cdb0 2024-09-13T17:10:26.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.673+0000 7f98adffb700 1 -- 172.21.15.123:0/223094385 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f98a8005d50 con 0x7f98b000cdb0 2024-09-13T17:10:26.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.673+0000 7f98adffb700 1 --2- 172.21.15.123:0/223094385 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f989c066730 0x7f989c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:26.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.673+0000 7f98adffb700 1 -- 172.21.15.123:0/223094385 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f98a8083b00 con 0x7f98b000cdb0 2024-09-13T17:10:26.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.673+0000 7f98bce81700 1 --2- 172.21.15.123:0/223094385 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f989c066730 0x7f989c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:26.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.673+0000 7f98bce81700 1 --2- 172.21.15.123:0/223094385 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f989c066730 0x7f989c068bf0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f98b000de80 tx=0x7f98b4008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:26.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.689+0000 7f98adffb700 1 -- 172.21.15.123:0/223094385 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f98a80511d0 con 0x7f98b000cdb0 2024-09-13T17:10:26.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:26.853+0000 7f98be684700 1 -- 172.21.15.123:0/223094385 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f98b00109b0 con 0x7f98b000cdb0 2024-09-13T17:10:27.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.201+0000 7f98adffb700 1 -- 172.21.15.123:0/223094385 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v95) v1 ==== 138+0+0 (secure 0 0 0) 0x7f98a80547f0 con 0x7f98b000cdb0 2024-09-13T17:10:27.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.205+0000 7f98be684700 1 -- 172.21.15.123:0/223094385 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f989c066730 msgr2=0x7f989c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:27.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.205+0000 7f98be684700 1 --2- 172.21.15.123:0/223094385 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f989c066730 0x7f989c068bf0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f98b000de80 tx=0x7f98b4008040 comp rx=0 tx=0).stop 2024-09-13T17:10:27.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.205+0000 7f98be684700 1 -- 172.21.15.123:0/223094385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98b000cdb0 msgr2=0x7f98b0038e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:27.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.205+0000 7f98be684700 1 --2- 172.21.15.123:0/223094385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98b000cdb0 0x7f98b0038e90 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f98a800d800 tx=0x7f98a800dbc0 comp rx=0 tx=0).stop 2024-09-13T17:10:27.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.205+0000 7f98be684700 1 -- 172.21.15.123:0/223094385 shutdown_connections 2024-09-13T17:10:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.205+0000 7f98be684700 1 --2- 172.21.15.123:0/223094385 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f989c066730 0x7f989c068bf0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.205+0000 7f98be684700 1 --2- 172.21.15.123:0/223094385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98b00e2d30 0x7f98b003a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.205+0000 7f98be684700 1 --2- 172.21.15.123:0/223094385 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f98b0057520 0x7f98b00cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.205+0000 7f98be684700 1 --2- 172.21.15.123:0/223094385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98b000cdb0 0x7f98b0038e90 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.205+0000 7f98be684700 1 -- 172.21.15.123:0/223094385 >> 172.21.15.123:0/223094385 conn(0x7f98b001fc00 msgr2=0x7f98b00e1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.205+0000 7f98be684700 1 -- 172.21.15.123:0/223094385 shutdown_connections 2024-09-13T17:10:27.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.205+0000 7f98be684700 1 -- 172.21.15.123:0/223094385 wait complete. 2024-09-13T17:10:27.213 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-13T17:10:27.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.341+0000 7f26f58e4700 1 Processor -- start 2024-09-13T17:10:27.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.341+0000 7f26f58e4700 1 -- start start 2024-09-13T17:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.341+0000 7f26f58e4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26f006a260 0x7f26f006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.341+0000 7f26f58e4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f00cd7d0 con 0x7f26f015ab00 2024-09-13T17:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.341+0000 7f26f58e4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f006d710 con 0x7f26f00b1650 2024-09-13T17:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.341+0000 7f26f58e4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f015afa0 con 0x7f26f006a260 2024-09-13T17:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.341+0000 7f26f48e2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26f006a260 0x7f26f006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26f48e2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26f006a260 0x7f26f006d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36128/0 (socket says 172.21.15.123:36128) 2024-09-13T17:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26f48e2700 1 -- 172.21.15.123:0/331242709 learned_addr learned my addr 172.21.15.123:0/331242709 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:27.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26effff700 1 --1- 172.21.15.123:0/331242709 >> v1:172.21.15.123:6789/0 conn(0x7f26f015ab00 0x7f26f006a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42396/0 (socket says 172.21.15.123:42396) 2024-09-13T17:10:27.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26f48e2700 1 -- 172.21.15.123:0/331242709 >> v1:172.21.15.153:6789/0 conn(0x7f26f00b1650 legacy=0x7f26f00cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:27.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26f48e2700 1 -- 172.21.15.123:0/331242709 >> v1:172.21.15.123:6789/0 conn(0x7f26f015ab00 legacy=0x7f26f006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:27.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26f48e2700 1 -- 172.21.15.123:0/331242709 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f006e3f0 con 0x7f26f006a260 2024-09-13T17:10:27.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26f48e2700 1 --2- 172.21.15.123:0/331242709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f006a260 0x7f26f006d1d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009e50 tx=0x7f26e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6565e0ea71c49af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:27.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26ef7fe700 1 -- 172.21.15.123:0/331242709 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e000e070 con 0x7f26f006a260 2024-09-13T17:10:27.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26ef7fe700 1 -- 172.21.15.123:0/331242709 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e000b9c0 con 0x7f26f006a260 2024-09-13T17:10:27.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26ef7fe700 1 -- 172.21.15.123:0/331242709 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e000bd70 con 0x7f26f006a260 2024-09-13T17:10:27.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26f58e4700 1 -- 172.21.15.123:0/331242709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f006a260 msgr2=0x7f26f006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:27.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26f58e4700 1 --2- 172.21.15.123:0/331242709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f006a260 0x7f26f006d1d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009e50 tx=0x7f26e000b330 comp rx=0 tx=0).stop 2024-09-13T17:10:27.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26f58e4700 1 -- 172.21.15.123:0/331242709 shutdown_connections 2024-09-13T17:10:27.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26f58e4700 1 --2- 172.21.15.123:0/331242709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f006a260 0x7f26f006d1d0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:27.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26f58e4700 1 -- 172.21.15.123:0/331242709 >> 172.21.15.123:0/331242709 conn(0x7f26f006f940 msgr2=0x7f26f00b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:27.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26f58e4700 1 -- 172.21.15.123:0/331242709 shutdown_connections 2024-09-13T17:10:27.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.345+0000 7f26f58e4700 1 -- 172.21.15.123:0/331242709 wait complete. 2024-09-13T17:10:27.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26f58e4700 1 Processor -- start 2024-09-13T17:10:27.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26f58e4700 1 -- start start 2024-09-13T17:10:27.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26f58e4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f006a260 0x7f26f01498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:27.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26f58e4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f00b1650 0x7f26f01e3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:27.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26f58e4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f015ab00 0x7f26f01e4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:27.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26f58e4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f01e5470 con 0x7f26f00b1650 2024-09-13T17:10:27.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26f58e4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f0149e20 con 0x7f26f015ab00 2024-09-13T17:10:27.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26f58e4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f01e48f0 con 0x7f26f006a260 2024-09-13T17:10:27.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26effff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f00b1650 0x7f26f01e3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26effff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f00b1650 0x7f26f01e3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36144/0 (socket says 172.21.15.123:36144) 2024-09-13T17:10:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26effff700 1 -- 172.21.15.123:0/2224431090 learned_addr learned my addr 172.21.15.123:0/2224431090 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26f48e2700 1 --2- 172.21.15.123:0/2224431090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f006a260 0x7f26f01498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26f50e3700 1 --2- 172.21.15.123:0/2224431090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f015ab00 0x7f26f01e4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26effff700 1 -- 172.21.15.123:0/2224431090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f006a260 msgr2=0x7f26f01498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26effff700 1 --2- 172.21.15.123:0/2224431090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f006a260 0x7f26f01498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26effff700 1 -- 172.21.15.123:0/2224431090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f015ab00 msgr2=0x7f26f01e4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26effff700 1 --2- 172.21.15.123:0/2224431090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f015ab00 0x7f26f01e4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26effff700 1 -- 172.21.15.123:0/2224431090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e0009b30 con 0x7f26f00b1650 2024-09-13T17:10:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26effff700 1 --2- 172.21.15.123:0/2224431090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f00b1650 0x7f26f01e3d30 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f26e400c490 tx=0x7f26e400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26ed7fa700 1 -- 172.21.15.123:0/2224431090 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4005cd0 con 0x7f26f00b1650 2024-09-13T17:10:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26ed7fa700 1 -- 172.21.15.123:0/2224431090 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e4005e30 con 0x7f26f00b1650 2024-09-13T17:10:27.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26f58e4700 1 -- 172.21.15.123:0/2224431090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f01e4bd0 con 0x7f26f00b1650 2024-09-13T17:10:27.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26ed7fa700 1 -- 172.21.15.123:0/2224431090 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4007310 con 0x7f26f00b1650 2024-09-13T17:10:27.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.349+0000 7f26f58e4700 1 -- 172.21.15.123:0/2224431090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f01e5190 con 0x7f26f00b1650 2024-09-13T17:10:27.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.353+0000 7f26ed7fa700 1 -- 172.21.15.123:0/2224431090 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26e4007470 con 0x7f26f00b1650 2024-09-13T17:10:27.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.353+0000 7f26f58e4700 1 -- 172.21.15.123:0/2224431090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f00cb7c0 con 0x7f26f00b1650 2024-09-13T17:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.353+0000 7f26ed7fa700 1 --2- 172.21.15.123:0/2224431090 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f26dc066760 0x7f26dc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.353+0000 7f26f48e2700 1 --2- 172.21.15.123:0/2224431090 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f26dc066760 0x7f26dc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:27.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.353+0000 7f26ed7fa700 1 -- 172.21.15.123:0/2224431090 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f26e40832c0 con 0x7f26f00b1650 2024-09-13T17:10:27.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.353+0000 7f26f48e2700 1 --2- 172.21.15.123:0/2224431090 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f26dc066760 0x7f26dc068c20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f26e000b370 tx=0x7f26e0009000 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:27.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.361+0000 7f26ed7fa700 1 -- 172.21.15.123:0/2224431090 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f26e40507f0 con 0x7f26f00b1650 2024-09-13T17:10:27.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:27.525+0000 7f26f58e4700 1 -- 172.21.15.123:0/2224431090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f26f006d1d0 con 0x7f26f00b1650 2024-09-13T17:10:28.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.213+0000 7f26ed7fa700 1 -- 172.21.15.123:0/2224431090 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v96) v1 ==== 170+0+0 (secure 0 0 0) 0x7f26e400ce60 con 0x7f26f00b1650 2024-09-13T17:10:28.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.233+0000 7f26f58e4700 1 -- 172.21.15.123:0/2224431090 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f26dc066760 msgr2=0x7f26dc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:28.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.233+0000 7f26f58e4700 1 --2- 172.21.15.123:0/2224431090 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f26dc066760 0x7f26dc068c20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f26e000b370 tx=0x7f26e0009000 comp rx=0 tx=0).stop 2024-09-13T17:10:28.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.233+0000 7f26f58e4700 1 -- 172.21.15.123:0/2224431090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f00b1650 msgr2=0x7f26f01e3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:28.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.233+0000 7f26f58e4700 1 --2- 172.21.15.123:0/2224431090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f00b1650 0x7f26f01e3d30 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f26e400c490 tx=0x7f26e400c7a0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.233+0000 7f26f58e4700 1 -- 172.21.15.123:0/2224431090 shutdown_connections 2024-09-13T17:10:28.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.233+0000 7f26f58e4700 1 --2- 172.21.15.123:0/2224431090 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f26dc066760 0x7f26dc068c20 secure :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f26e000b370 tx=0x7f26e0009000 comp rx=0 tx=0).stop 2024-09-13T17:10:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.233+0000 7f26f58e4700 1 --2- 172.21.15.123:0/2224431090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f015ab00 0x7f26f01e4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.233+0000 7f26f58e4700 1 --2- 172.21.15.123:0/2224431090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f00b1650 0x7f26f01e3d30 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.233+0000 7f26f58e4700 1 --2- 172.21.15.123:0/2224431090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f26f006a260 0x7f26f01498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.233+0000 7f26f58e4700 1 -- 172.21.15.123:0/2224431090 >> 172.21.15.123:0/2224431090 conn(0x7f26f006f940 msgr2=0x7f26f0159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.233+0000 7f26f58e4700 1 -- 172.21.15.123:0/2224431090 shutdown_connections 2024-09-13T17:10:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.233+0000 7f26f58e4700 1 -- 172.21.15.123:0/2224431090 wait complete. 2024-09-13T17:10:28.237 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-13T17:10:28.249 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:10:28.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e773c5700 1 Processor -- start 2024-09-13T17:10:28.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e773c5700 1 -- start start 2024-09-13T17:10:28.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e773c5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e70145dd0 0x7f3e70161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:28.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e773c5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3e700b2580 0x7f3e700731a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:28.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e773c5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e700716a0 con 0x7f3e700b21a0 2024-09-13T17:10:28.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e773c5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e70071bc0 con 0x7f3e70145dd0 2024-09-13T17:10:28.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e773c5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e70160770 con 0x7f3e700b2580 2024-09-13T17:10:28.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e75bc2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e70145dd0 0x7f3e70161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:28.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e763c3700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3e700b21a0 0x7f3e7006c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42404/0 (socket says 172.21.15.123:42404) 2024-09-13T17:10:28.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e75bc2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e70145dd0 0x7f3e70161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36154/0 (socket says 172.21.15.123:36154) 2024-09-13T17:10:28.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e75bc2700 1 -- 172.21.15.123:0/3033174633 learned_addr learned my addr 172.21.15.123:0/3033174633 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:28.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e76bc4700 1 --2- 172.21.15.123:0/3033174633 >> v2:172.21.15.153:3300/0 conn(0x7f3e700b2580 0x7f3e700731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:28.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e75bc2700 1 -- 172.21.15.123:0/3033174633 >> v2:172.21.15.153:3300/0 conn(0x7f3e700b2580 msgr2=0x7f3e700731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:28.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e75bc2700 1 --2- 172.21.15.123:0/3033174633 >> v2:172.21.15.153:3300/0 conn(0x7f3e700b2580 0x7f3e700731a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e75bc2700 1 -- 172.21.15.123:0/3033174633 >> v1:172.21.15.123:6789/0 conn(0x7f3e700b21a0 legacy=0x7f3e7006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:28.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.365+0000 7f3e75bc2700 1 -- 172.21.15.123:0/3033174633 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700718e0 con 0x7f3e70145dd0 2024-09-13T17:10:28.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e75bc2700 1 --2- 172.21.15.123:0/3033174633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e70145dd0 0x7f3e70161210 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f3e700b2af0 tx=0x7f3e6c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1435480f1b46d7b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:28.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e753c1700 1 -- 172.21.15.123:0/3033174633 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c00b8a0 con 0x7f3e70145dd0 2024-09-13T17:10:28.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e753c1700 1 -- 172.21.15.123:0/3033174633 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c00ba00 con 0x7f3e70145dd0 2024-09-13T17:10:28.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e753c1700 1 -- 172.21.15.123:0/3033174633 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c00bd90 con 0x7f3e70145dd0 2024-09-13T17:10:28.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 -- 172.21.15.123:0/3033174633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e70145dd0 msgr2=0x7f3e70161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 --2- 172.21.15.123:0/3033174633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e70145dd0 0x7f3e70161210 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f3e700b2af0 tx=0x7f3e6c009bf0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 -- 172.21.15.123:0/3033174633 shutdown_connections 2024-09-13T17:10:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 --2- 172.21.15.123:0/3033174633 >> v2:172.21.15.153:3300/0 conn(0x7f3e700b2580 0x7f3e700731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 --2- 172.21.15.123:0/3033174633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e70145dd0 0x7f3e70161210 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 -- 172.21.15.123:0/3033174633 >> 172.21.15.123:0/3033174633 conn(0x7f3e7006f280 msgr2=0x7f3e7006f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 -- 172.21.15.123:0/3033174633 shutdown_connections 2024-09-13T17:10:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 -- 172.21.15.123:0/3033174633 wait complete. 2024-09-13T17:10:28.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 Processor -- start 2024-09-13T17:10:28.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 -- start start 2024-09-13T17:10:28.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e700b21a0 0x7f3e7013c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:28.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e700b2580 0x7f3e70155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:28.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e70145dd0 0x7f3e7013f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:28.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e701f3140 con 0x7f3e700b21a0 2024-09-13T17:10:28.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e701556d0 con 0x7f3e70145dd0 2024-09-13T17:10:28.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e773c5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e701f2b30 con 0x7f3e700b2580 2024-09-13T17:10:28.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e763c3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e700b21a0 0x7f3e7013c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:28.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e763c3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e700b21a0 0x7f3e7013c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36156/0 (socket says 172.21.15.123:36156) 2024-09-13T17:10:28.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e763c3700 1 -- 172.21.15.123:0/3382180881 learned_addr learned my addr 172.21.15.123:0/3382180881 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:28.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e75bc2700 1 --2- 172.21.15.123:0/3382180881 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e700b2580 0x7f3e70155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:28.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.369+0000 7f3e76bc4700 1 --2- 172.21.15.123:0/3382180881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e70145dd0 0x7f3e7013f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:28.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.373+0000 7f3e763c3700 1 -- 172.21.15.123:0/3382180881 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e700b2580 msgr2=0x7f3e70155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:28.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.373+0000 7f3e763c3700 1 --2- 172.21.15.123:0/3382180881 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e700b2580 0x7f3e70155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.373+0000 7f3e763c3700 1 -- 172.21.15.123:0/3382180881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e70145dd0 msgr2=0x7f3e7013f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:28.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.373+0000 7f3e763c3700 1 --2- 172.21.15.123:0/3382180881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e70145dd0 0x7f3e7013f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.373+0000 7f3e763c3700 1 -- 172.21.15.123:0/3382180881 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c009570 con 0x7f3e700b21a0 2024-09-13T17:10:28.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.373+0000 7f3e763c3700 1 --2- 172.21.15.123:0/3382180881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e700b21a0 0x7f3e7013c570 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000c500 tx=0x7f3e6000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:28.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.373+0000 7f3e66ffd700 1 -- 172.21.15.123:0/3382180881 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e60005cd0 con 0x7f3e700b21a0 2024-09-13T17:10:28.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.373+0000 7f3e66ffd700 1 -- 172.21.15.123:0/3382180881 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e60005e30 con 0x7f3e700b21a0 2024-09-13T17:10:28.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.373+0000 7f3e773c5700 1 -- 172.21.15.123:0/3382180881 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7013cab0 con 0x7f3e700b21a0 2024-09-13T17:10:28.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.373+0000 7f3e66ffd700 1 -- 172.21.15.123:0/3382180881 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e600072f0 con 0x7f3e700b21a0 2024-09-13T17:10:28.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.373+0000 7f3e773c5700 1 -- 172.21.15.123:0/3382180881 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e701f2dd0 con 0x7f3e700b21a0 2024-09-13T17:10:28.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.373+0000 7f3e773c5700 1 -- 172.21.15.123:0/3382180881 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e70073c90 con 0x7f3e700b21a0 2024-09-13T17:10:28.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.377+0000 7f3e66ffd700 1 -- 172.21.15.123:0/3382180881 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e60007450 con 0x7f3e700b21a0 2024-09-13T17:10:28.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.377+0000 7f3e66ffd700 1 --2- 172.21.15.123:0/3382180881 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e54066730 0x7f3e54068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:28.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.377+0000 7f3e66ffd700 1 -- 172.21.15.123:0/3382180881 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3e60083980 con 0x7f3e700b21a0 2024-09-13T17:10:28.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.377+0000 7f3e75bc2700 1 --2- 172.21.15.123:0/3382180881 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e54066730 0x7f3e54068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:28.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.377+0000 7f3e75bc2700 1 --2- 172.21.15.123:0/3382180881 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e54066730 0x7f3e54068bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c000c00 tx=0x7f3e6c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:28.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.381+0000 7f3e66ffd700 1 -- 172.21.15.123:0/3382180881 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3e60050ec0 con 0x7f3e700b21a0 2024-09-13T17:10:28.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.581+0000 7f3e773c5700 1 -- 172.21.15.123:0/3382180881 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3e700716a0 con 0x7f3e700b21a0 2024-09-13T17:10:28.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.593+0000 7f3e66ffd700 1 -- 172.21.15.123:0/3382180881 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v45) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3e700716a0 con 0x7f3e700b21a0 2024-09-13T17:10:28.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.597+0000 7f3e773c5700 1 -- 172.21.15.123:0/3382180881 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e54066730 msgr2=0x7f3e54068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:28.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.597+0000 7f3e773c5700 1 --2- 172.21.15.123:0/3382180881 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e54066730 0x7f3e54068bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c000c00 tx=0x7f3e6c008030 comp rx=0 tx=0).stop 2024-09-13T17:10:28.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.601+0000 7f3e773c5700 1 -- 172.21.15.123:0/3382180881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e700b21a0 msgr2=0x7f3e7013c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:28.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.601+0000 7f3e773c5700 1 --2- 172.21.15.123:0/3382180881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e700b21a0 0x7f3e7013c570 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000c500 tx=0x7f3e6000c810 comp rx=0 tx=0).stop 2024-09-13T17:10:28.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.605+0000 7f3e773c5700 1 -- 172.21.15.123:0/3382180881 shutdown_connections 2024-09-13T17:10:28.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.605+0000 7f3e773c5700 1 --2- 172.21.15.123:0/3382180881 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3e54066730 0x7f3e54068bf0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.605+0000 7f3e773c5700 1 --2- 172.21.15.123:0/3382180881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e70145dd0 0x7f3e7013f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.605+0000 7f3e773c5700 1 --2- 172.21.15.123:0/3382180881 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3e700b2580 0x7f3e70155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.605+0000 7f3e773c5700 1 --2- 172.21.15.123:0/3382180881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e700b21a0 0x7f3e7013c570 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.605+0000 7f3e773c5700 1 -- 172.21.15.123:0/3382180881 >> 172.21.15.123:0/3382180881 conn(0x7f3e7006f280 msgr2=0x7f3e7006f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:28.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.605+0000 7f3e773c5700 1 -- 172.21.15.123:0/3382180881 shutdown_connections 2024-09-13T17:10:28.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.605+0000 7f3e773c5700 1 -- 172.21.15.123:0/3382180881 wait complete. 2024-09-13T17:10:28.615 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 14 and data pool 15 2024-09-13T17:10:28.632 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:28.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.729+0000 7fc94208a700 1 Processor -- start 2024-09-13T17:10:28.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.729+0000 7fc94208a700 1 -- start start 2024-09-13T17:10:28.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.729+0000 7fc94208a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc93c15a8c0 0x7fc93c0705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:28.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.729+0000 7fc94208a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc93c15b9b0 0x7fc93c070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:28.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.729+0000 7fc94208a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93c0cee80 con 0x7fc93c0713b0 2024-09-13T17:10:28.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.729+0000 7fc94208a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93c071820 con 0x7fc93c15a8c0 2024-09-13T17:10:28.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.729+0000 7fc94208a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93c0ce270 con 0x7fc93c15b9b0 2024-09-13T17:10:28.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.729+0000 7fc941088700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc93c15a8c0 0x7fc93c0705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:28.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc941088700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc93c15a8c0 0x7fc93c0705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36158/0 (socket says 172.21.15.123:36158) 2024-09-13T17:10:28.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc941088700 1 -- 172.21.15.123:0/3218028710 learned_addr learned my addr 172.21.15.123:0/3218028710 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:28.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc940887700 1 --2- 172.21.15.123:0/3218028710 >> v2:172.21.15.153:3300/0 conn(0x7fc93c15b9b0 0x7fc93c070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:28.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc940887700 1 -- 172.21.15.123:0/3218028710 >> v2:172.21.15.123:3300/0 conn(0x7fc93c15a8c0 msgr2=0x7fc93c0705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:28.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc940887700 1 --2- 172.21.15.123:0/3218028710 >> v2:172.21.15.123:3300/0 conn(0x7fc93c15a8c0 0x7fc93c0705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc940887700 1 -- 172.21.15.123:0/3218028710 >> v1:172.21.15.153:6789/0 conn(0x7fc93c0713b0 legacy=0x7fc93c0cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:28.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc940887700 1 -- 172.21.15.123:0/3218028710 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c0ce550 con 0x7fc93c15b9b0 2024-09-13T17:10:28.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc941088700 1 --2- 172.21.15.123:0/3218028710 >> v2:172.21.15.123:3300/0 conn(0x7fc93c15a8c0 0x7fc93c0705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:28.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc940887700 1 --2- 172.21.15.123:0/3218028710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c15b9b0 0x7fc93c070e70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0cdf90 tx=0x7fc938009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=180141df151281bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:28.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc933fff700 1 -- 172.21.15.123:0/3218028710 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938011830 con 0x7fc93c15b9b0 2024-09-13T17:10:28.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc933fff700 1 -- 172.21.15.123:0/3218028710 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc938011990 con 0x7fc93c15b9b0 2024-09-13T17:10:28.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc933fff700 1 -- 172.21.15.123:0/3218028710 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938011d20 con 0x7fc93c15b9b0 2024-09-13T17:10:28.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc94208a700 1 -- 172.21.15.123:0/3218028710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c15b9b0 msgr2=0x7fc93c070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:28.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc94208a700 1 --2- 172.21.15.123:0/3218028710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c15b9b0 0x7fc93c070e70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0cdf90 tx=0x7fc938009b30 comp rx=0 tx=0).stop 2024-09-13T17:10:28.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc94208a700 1 -- 172.21.15.123:0/3218028710 shutdown_connections 2024-09-13T17:10:28.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc94208a700 1 --2- 172.21.15.123:0/3218028710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c15b9b0 0x7fc93c070e70 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc94208a700 1 --2- 172.21.15.123:0/3218028710 >> v2:172.21.15.123:3300/0 conn(0x7fc93c15a8c0 0x7fc93c0705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc94208a700 1 -- 172.21.15.123:0/3218028710 >> 172.21.15.123:0/3218028710 conn(0x7fc93c066150 msgr2=0x7fc93c066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:28.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc94208a700 1 -- 172.21.15.123:0/3218028710 shutdown_connections 2024-09-13T17:10:28.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.733+0000 7fc94208a700 1 -- 172.21.15.123:0/3218028710 wait complete. 2024-09-13T17:10:28.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.737+0000 7fc94208a700 1 Processor -- start 2024-09-13T17:10:28.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.737+0000 7fc94208a700 1 -- start start 2024-09-13T17:10:28.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.737+0000 7fc94208a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc93c0713b0 0x7fc93c150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:28.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.737+0000 7fc94208a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c15a8c0 0x7fc93c143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:28.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.737+0000 7fc94208a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c15b9b0 0x7fc93c143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:28.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.737+0000 7fc94208a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c143320 con 0x7fc93c0713b0 2024-09-13T17:10:28.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.737+0000 7fc94208a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c142710 con 0x7fc93c15a8c0 2024-09-13T17:10:28.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.737+0000 7fc94208a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c1429f0 con 0x7fc93c15b9b0 2024-09-13T17:10:28.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc941088700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc93c0713b0 0x7fc93c150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:28.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc941088700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc93c0713b0 0x7fc93c150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36170/0 (socket says 172.21.15.123:36170) 2024-09-13T17:10:28.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc941088700 1 -- 172.21.15.123:0/4167747368 learned_addr learned my addr 172.21.15.123:0/4167747368 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:28.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc941889700 1 --2- 172.21.15.123:0/4167747368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c15b9b0 0x7fc93c143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:28.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc940887700 1 --2- 172.21.15.123:0/4167747368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c15a8c0 0x7fc93c143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:28.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc941088700 1 -- 172.21.15.123:0/4167747368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c15b9b0 msgr2=0x7fc93c143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:28.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc941088700 1 --2- 172.21.15.123:0/4167747368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c15b9b0 0x7fc93c143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc941088700 1 -- 172.21.15.123:0/4167747368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c15a8c0 msgr2=0x7fc93c143a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:28.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc941088700 1 --2- 172.21.15.123:0/4167747368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c15a8c0 0x7fc93c143a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc941088700 1 -- 172.21.15.123:0/4167747368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c009b30 con 0x7fc93c0713b0 2024-09-13T17:10:28.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc941088700 1 --2- 172.21.15.123:0/4167747368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc93c0713b0 0x7fc93c150f10 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00efc0 tx=0x7fc92c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:28.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc931ffb700 1 -- 172.21.15.123:0/4167747368 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c00cb00 con 0x7fc93c0713b0 2024-09-13T17:10:28.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc94208a700 1 -- 172.21.15.123:0/4167747368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9380094b0 con 0x7fc93c0713b0 2024-09-13T17:10:28.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc931ffb700 1 -- 172.21.15.123:0/4167747368 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c00f040 con 0x7fc93c0713b0 2024-09-13T17:10:28.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc931ffb700 1 -- 172.21.15.123:0/4167747368 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c00ce80 con 0x7fc93c0713b0 2024-09-13T17:10:28.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc94208a700 1 -- 172.21.15.123:0/4167747368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93c142fb0 con 0x7fc93c0713b0 2024-09-13T17:10:28.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc94208a700 1 -- 172.21.15.123:0/4167747368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93c0677f0 con 0x7fc93c0713b0 2024-09-13T17:10:28.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc931ffb700 1 -- 172.21.15.123:0/4167747368 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc92c014480 con 0x7fc93c0713b0 2024-09-13T17:10:28.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.741+0000 7fc931ffb700 1 --2- 172.21.15.123:0/4167747368 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc928066730 0x7fc928068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:28.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.745+0000 7fc931ffb700 1 -- 172.21.15.123:0/4167747368 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc92c084790 con 0x7fc93c0713b0 2024-09-13T17:10:28.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.745+0000 7fc940887700 1 --2- 172.21.15.123:0/4167747368 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc928066730 0x7fc928068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:28.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.745+0000 7fc940887700 1 --2- 172.21.15.123:0/4167747368 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc928066730 0x7fc928068bf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc938000c00 tx=0x7fc938008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:28.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.749+0000 7fc931ffb700 1 -- 172.21.15.123:0/4167747368 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc92c051b10 con 0x7fc93c0713b0 2024-09-13T17:10:28.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.925+0000 7fc94208a700 1 -- 172.21.15.123:0/4167747368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc93c0705b0 con 0x7fc93c0713b0 2024-09-13T17:10:28.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.929+0000 7fc931ffb700 1 -- 172.21.15.123:0/4167747368 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fc92c055130 con 0x7fc93c0713b0 2024-09-13T17:10:28.933 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:28.933 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":97,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:28.586212+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:10:26.903248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T17:10:27.570928+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:28.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.933+0000 7fc94208a700 1 -- 172.21.15.123:0/4167747368 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc928066730 msgr2=0x7fc928068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:28.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.933+0000 7fc94208a700 1 --2- 172.21.15.123:0/4167747368 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc928066730 0x7fc928068bf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc938000c00 tx=0x7fc938008030 comp rx=0 tx=0).stop 2024-09-13T17:10:28.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.933+0000 7fc94208a700 1 -- 172.21.15.123:0/4167747368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc93c0713b0 msgr2=0x7fc93c150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:28.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.933+0000 7fc94208a700 1 --2- 172.21.15.123:0/4167747368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc93c0713b0 0x7fc93c150f10 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00efc0 tx=0x7fc92c00c3a0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.933+0000 7fc94208a700 1 -- 172.21.15.123:0/4167747368 shutdown_connections 2024-09-13T17:10:28.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.933+0000 7fc94208a700 1 --2- 172.21.15.123:0/4167747368 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc928066730 0x7fc928068bf0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.933+0000 7fc94208a700 1 --2- 172.21.15.123:0/4167747368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc93c15b9b0 0x7fc93c143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.933+0000 7fc94208a700 1 --2- 172.21.15.123:0/4167747368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c15a8c0 0x7fc93c143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.933+0000 7fc94208a700 1 --2- 172.21.15.123:0/4167747368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc93c0713b0 0x7fc93c150f10 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:28.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.933+0000 7fc94208a700 1 -- 172.21.15.123:0/4167747368 >> 172.21.15.123:0/4167747368 conn(0x7fc93c066150 msgr2=0x7fc93c0aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:28.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.933+0000 7fc94208a700 1 -- 172.21.15.123:0/4167747368 shutdown_connections 2024-09-13T17:10:28.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:28.933+0000 7fc94208a700 1 -- 172.21.15.123:0/4167747368 wait complete. 2024-09-13T17:10:28.948 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:29.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.057+0000 7fd978ff8700 1 Processor -- start 2024-09-13T17:10:29.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.057+0000 7fd978ff8700 1 -- start start 2024-09-13T17:10:29.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.057+0000 7fd978ff8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd9741596e0 0x7fd9740b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.057+0000 7fd978ff8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9740cd9a0 0x7fd974071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.057+0000 7fd978ff8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd974072160 con 0x7fd9740717e0 2024-09-13T17:10:29.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.057+0000 7fd978ff8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9740cde10 con 0x7fd9741596e0 2024-09-13T17:10:29.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.057+0000 7fd978ff8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9740cc230 con 0x7fd9740cd9a0 2024-09-13T17:10:29.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd96bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd9740717e0 0x7fd9740b1530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42412/0 (socket says 172.21.15.123:42412) 2024-09-13T17:10:29.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd9737fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd9741596e0 0x7fd9740b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd96bfff700 1 -- 172.21.15.123:0/96512436 learned_addr learned my addr 172.21.15.123:0/96512436 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:29.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd973fff700 1 --2- 172.21.15.123:0/96512436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9740cd9a0 0x7fd974071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd972ffd700 1 -- 172.21.15.123:0/96512436 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050395124 0 0) 0x7fd974072160 con 0x7fd9740717e0 2024-09-13T17:10:29.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd972ffd700 1 -- 172.21.15.123:0/96512436 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9600035d0 con 0x7fd9740717e0 2024-09-13T17:10:29.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd9737fe700 1 -- 172.21.15.123:0/96512436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9740cd9a0 msgr2=0x7fd974071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:29.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd9737fe700 1 --2- 172.21.15.123:0/96512436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9740cd9a0 0x7fd974071c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd9737fe700 1 -- 172.21.15.123:0/96512436 >> v1:172.21.15.123:6789/0 conn(0x7fd9740717e0 legacy=0x7fd9740b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd9737fe700 1 -- 172.21.15.123:0/96512436 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9740b3790 con 0x7fd9741596e0 2024-09-13T17:10:29.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd9737fe700 1 --2- 172.21.15.123:0/96512436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9741596e0 0x7fd9740b3250 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fd964009850 tx=0x7fd964009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0046acaa3f0465e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:29.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd972ffd700 1 -- 172.21.15.123:0/96512436 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964011830 con 0x7fd9741596e0 2024-09-13T17:10:29.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd972ffd700 1 -- 172.21.15.123:0/96512436 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964011990 con 0x7fd9741596e0 2024-09-13T17:10:29.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd972ffd700 1 -- 172.21.15.123:0/96512436 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964011d40 con 0x7fd9741596e0 2024-09-13T17:10:29.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd978ff8700 1 -- 172.21.15.123:0/96512436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9741596e0 msgr2=0x7fd9740b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd978ff8700 1 --2- 172.21.15.123:0/96512436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9741596e0 0x7fd9740b3250 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fd964009850 tx=0x7fd964009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:29.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd978ff8700 1 -- 172.21.15.123:0/96512436 shutdown_connections 2024-09-13T17:10:29.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd978ff8700 1 --2- 172.21.15.123:0/96512436 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9740cd9a0 0x7fd974071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd978ff8700 1 --2- 172.21.15.123:0/96512436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9741596e0 0x7fd9740b3250 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd978ff8700 1 -- 172.21.15.123:0/96512436 >> 172.21.15.123:0/96512436 conn(0x7fd974066150 msgr2=0x7fd974066560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:29.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd978ff8700 1 -- 172.21.15.123:0/96512436 shutdown_connections 2024-09-13T17:10:29.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.061+0000 7fd978ff8700 1 -- 172.21.15.123:0/96512436 wait complete. 2024-09-13T17:10:29.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd978ff8700 1 Processor -- start 2024-09-13T17:10:29.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd978ff8700 1 -- start start 2024-09-13T17:10:29.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd978ff8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9740717e0 0x7fd9741420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd978ff8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9740cd9a0 0x7fd97414d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd978ff8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9741596e0 0x7fd9741555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd978ff8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97414cfd0 con 0x7fd9740cd9a0 2024-09-13T17:10:29.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd978ff8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9741f5850 con 0x7fd9740717e0 2024-09-13T17:10:29.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd978ff8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97414c210 con 0x7fd9741596e0 2024-09-13T17:10:29.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd96bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9740cd9a0 0x7fd97414d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd96bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9740cd9a0 0x7fd97414d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36194/0 (socket says 172.21.15.123:36194) 2024-09-13T17:10:29.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd96bfff700 1 -- 172.21.15.123:0/1644920058 learned_addr learned my addr 172.21.15.123:0/1644920058 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:29.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd973fff700 1 --2- 172.21.15.123:0/1644920058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9741596e0 0x7fd9741555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd9737fe700 1 --2- 172.21.15.123:0/1644920058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9740717e0 0x7fd9741420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd96bfff700 1 -- 172.21.15.123:0/1644920058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9741596e0 msgr2=0x7fd9741555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd96bfff700 1 --2- 172.21.15.123:0/1644920058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9741596e0 0x7fd9741555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd96bfff700 1 -- 172.21.15.123:0/1644920058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9740717e0 msgr2=0x7fd9741420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd96bfff700 1 --2- 172.21.15.123:0/1644920058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9740717e0 0x7fd9741420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd96bfff700 1 -- 172.21.15.123:0/1644920058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640094b0 con 0x7fd9740cd9a0 2024-09-13T17:10:29.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd96bfff700 1 --2- 172.21.15.123:0/1644920058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9740cd9a0 0x7fd97414d1f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00c700 tx=0x7fd95c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:29.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd970ff9700 1 -- 172.21.15.123:0/1644920058 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c005d90 con 0x7fd9740cd9a0 2024-09-13T17:10:29.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd970ff9700 1 -- 172.21.15.123:0/1644920058 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c0070d0 con 0x7fd9740cd9a0 2024-09-13T17:10:29.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd978ff8700 1 -- 172.21.15.123:0/1644920058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97414c4f0 con 0x7fd9740cd9a0 2024-09-13T17:10:29.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd970ff9700 1 -- 172.21.15.123:0/1644920058 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c007480 con 0x7fd9740cd9a0 2024-09-13T17:10:29.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.065+0000 7fd978ff8700 1 -- 172.21.15.123:0/1644920058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97414cab0 con 0x7fd9740cd9a0 2024-09-13T17:10:29.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.069+0000 7fd978ff8700 1 -- 172.21.15.123:0/1644920058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd974071fa0 con 0x7fd9740cd9a0 2024-09-13T17:10:29.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.069+0000 7fd970ff9700 1 -- 172.21.15.123:0/1644920058 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd95c0075e0 con 0x7fd9740cd9a0 2024-09-13T17:10:29.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.069+0000 7fd970ff9700 1 --2- 172.21.15.123:0/1644920058 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd954066730 0x7fd954068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.069+0000 7fd970ff9700 1 -- 172.21.15.123:0/1644920058 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd95c083930 con 0x7fd9740cd9a0 2024-09-13T17:10:29.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.069+0000 7fd9737fe700 1 --2- 172.21.15.123:0/1644920058 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd954066730 0x7fd954068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.069+0000 7fd9737fe700 1 --2- 172.21.15.123:0/1644920058 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd954066730 0x7fd954068bf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd9640090b0 tx=0x7fd96401c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:29.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.073+0000 7fd970ff9700 1 -- 172.21.15.123:0/1644920058 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd95c050d80 con 0x7fd9740cd9a0 2024-09-13T17:10:29.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.245+0000 7fd978ff8700 1 -- 172.21.15.123:0/1644920058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd97414ccf0 con 0x7fd9740cd9a0 2024-09-13T17:10:29.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.249+0000 7fd970ff9700 1 -- 172.21.15.123:0/1644920058 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fd97414ccf0 con 0x7fd9740cd9a0 2024-09-13T17:10:29.251 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:29.251 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":97,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:28.586212+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:10:26.903248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T17:10:27.570928+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:29.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.253+0000 7fd978ff8700 1 -- 172.21.15.123:0/1644920058 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd954066730 msgr2=0x7fd954068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.253+0000 7fd978ff8700 1 --2- 172.21.15.123:0/1644920058 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd954066730 0x7fd954068bf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd9640090b0 tx=0x7fd96401c040 comp rx=0 tx=0).stop 2024-09-13T17:10:29.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.253+0000 7fd978ff8700 1 -- 172.21.15.123:0/1644920058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9740cd9a0 msgr2=0x7fd97414d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.253+0000 7fd978ff8700 1 --2- 172.21.15.123:0/1644920058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9740cd9a0 0x7fd97414d1f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00c700 tx=0x7fd95c00ca10 comp rx=0 tx=0).stop 2024-09-13T17:10:29.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.253+0000 7fd978ff8700 1 -- 172.21.15.123:0/1644920058 shutdown_connections 2024-09-13T17:10:29.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.253+0000 7fd978ff8700 1 --2- 172.21.15.123:0/1644920058 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd954066730 0x7fd954068bf0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.253+0000 7fd978ff8700 1 --2- 172.21.15.123:0/1644920058 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9741596e0 0x7fd9741555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.253+0000 7fd978ff8700 1 --2- 172.21.15.123:0/1644920058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9740cd9a0 0x7fd97414d1f0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.253+0000 7fd978ff8700 1 --2- 172.21.15.123:0/1644920058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9740717e0 0x7fd9741420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.253+0000 7fd978ff8700 1 -- 172.21.15.123:0/1644920058 >> 172.21.15.123:0/1644920058 conn(0x7fd974066150 msgr2=0x7fd97415a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:29.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.253+0000 7fd978ff8700 1 -- 172.21.15.123:0/1644920058 shutdown_connections 2024-09-13T17:10:29.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.253+0000 7fd978ff8700 1 -- 172.21.15.123:0/1644920058 wait complete. 2024-09-13T17:10:29.271 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:10:29.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f65a4f82700 1 Processor -- start 2024-09-13T17:10:29.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f65a4f82700 1 -- start start 2024-09-13T17:10:29.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f65a4f82700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f65a00cdda0 0x7f65a015e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f65a4f82700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65a0070f90 0x7f65a006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f65a4f82700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a00ada60 con 0x7f65a0159c60 2024-09-13T17:10:29.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f65a4f82700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a015e680 con 0x7f65a00cdda0 2024-09-13T17:10:29.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f65a4f82700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a00720a0 con 0x7f65a0070f90 2024-09-13T17:10:29.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f659ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65a0070f90 0x7f65a006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f659effd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f65a00cdda0 0x7f65a015e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f659f7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f65a0159c60 0x7f65a00cd690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:37572/0 (socket says 172.21.15.123:37572) 2024-09-13T17:10:29.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f659effd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f65a00cdda0 0x7f65a015e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:44614/0 (socket says 172.21.15.123:44614) 2024-09-13T17:10:29.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f659ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65a0070f90 0x7f65a006c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:49506/0 (socket says 172.21.15.123:49506) 2024-09-13T17:10:29.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f659f7fe700 1 -- 172.21.15.123:0/4013466330 learned_addr learned my addr 172.21.15.123:0/4013466330 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:29.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f659effd700 1 -- 172.21.15.123:0/4013466330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65a0070f90 msgr2=0x7f65a006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:29.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f659effd700 1 --2- 172.21.15.123:0/4013466330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65a0070f90 0x7f65a006c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f659effd700 1 -- 172.21.15.123:0/4013466330 >> v1:172.21.15.153:6789/0 conn(0x7f65a0159c60 legacy=0x7f65a00cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.389+0000 7f659effd700 1 -- 172.21.15.123:0/4013466330 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a0072530 con 0x7f65a00cdda0 2024-09-13T17:10:29.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.393+0000 7f659effd700 1 --2- 172.21.15.123:0/4013466330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a00cdda0 0x7f65a015e140 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6590009850 tx=0x7f6590009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fadd03509c993be0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.393+0000 7f659e7fc700 1 -- 172.21.15.123:0/4013466330 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6590011830 con 0x7f65a00cdda0 2024-09-13T17:10:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.393+0000 7f659e7fc700 1 -- 172.21.15.123:0/4013466330 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6590011990 con 0x7f65a00cdda0 2024-09-13T17:10:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.393+0000 7f659e7fc700 1 -- 172.21.15.123:0/4013466330 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6590011d40 con 0x7f65a00cdda0 2024-09-13T17:10:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.393+0000 7f65a4f82700 1 -- 172.21.15.123:0/4013466330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a00cdda0 msgr2=0x7f65a015e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.393+0000 7f65a4f82700 1 --2- 172.21.15.123:0/4013466330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a00cdda0 0x7f65a015e140 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6590009850 tx=0x7f6590009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.393+0000 7f65a4f82700 1 -- 172.21.15.123:0/4013466330 shutdown_connections 2024-09-13T17:10:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.393+0000 7f65a4f82700 1 --2- 172.21.15.123:0/4013466330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65a0070f90 0x7f65a006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.393+0000 7f65a4f82700 1 --2- 172.21.15.123:0/4013466330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a00cdda0 0x7f65a015e140 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.393+0000 7f65a4f82700 1 -- 172.21.15.123:0/4013466330 >> 172.21.15.123:0/4013466330 conn(0x7f65a00b01d0 msgr2=0x7f65a00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:29.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.393+0000 7f65a4f82700 1 -- 172.21.15.123:0/4013466330 shutdown_connections 2024-09-13T17:10:29.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.393+0000 7f65a4f82700 1 -- 172.21.15.123:0/4013466330 wait complete. 2024-09-13T17:10:29.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.393+0000 7f65a4f82700 1 Processor -- start 2024-09-13T17:10:29.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.393+0000 7f65a4f82700 1 -- start start 2024-09-13T17:10:29.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f65a4f82700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65a0070f90 0x7f65a0155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f65a4f82700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a00cdda0 0x7f65a00ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f65a4f82700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65a0159c60 0x7f65a00ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f65a4f82700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a015ae50 con 0x7f65a0070f90 2024-09-13T17:10:29.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f65a4f82700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a015a210 con 0x7f65a00cdda0 2024-09-13T17:10:29.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f65a4f82700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a015a4b0 con 0x7f65a0159c60 2024-09-13T17:10:29.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f659f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65a0070f90 0x7f65a0155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f659f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65a0070f90 0x7f65a0155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36198/0 (socket says 172.21.15.123:36198) 2024-09-13T17:10:29.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f659f7fe700 1 -- 172.21.15.123:0/3342733762 learned_addr learned my addr 172.21.15.123:0/3342733762 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:29.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f659ffff700 1 --2- 172.21.15.123:0/3342733762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65a0159c60 0x7f65a00ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f659effd700 1 --2- 172.21.15.123:0/3342733762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a00cdda0 0x7f65a00ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f659f7fe700 1 -- 172.21.15.123:0/3342733762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65a0159c60 msgr2=0x7f65a00ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f659f7fe700 1 --2- 172.21.15.123:0/3342733762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65a0159c60 0x7f65a00ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f659f7fe700 1 -- 172.21.15.123:0/3342733762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a00cdda0 msgr2=0x7f65a00ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:29.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f659f7fe700 1 --2- 172.21.15.123:0/3342733762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a00cdda0 0x7f65a00ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:29.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f659f7fe700 1 -- 172.21.15.123:0/3342733762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65900094b0 con 0x7f65a0070f90 2024-09-13T17:10:29.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f659f7fe700 1 --2- 172.21.15.123:0/3342733762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65a0070f90 0x7f65a0155260 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f6594001eb0 tx=0x7f659400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:29.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f6587fff700 1 -- 172.21.15.123:0/3342733762 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594005d90 con 0x7f65a0070f90 2024-09-13T17:10:29.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f65a4f82700 1 -- 172.21.15.123:0/3342733762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a015a790 con 0x7f65a0070f90 2024-09-13T17:10:29.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f6587fff700 1 -- 172.21.15.123:0/3342733762 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65940070d0 con 0x7f65a0070f90 2024-09-13T17:10:29.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f6587fff700 1 -- 172.21.15.123:0/3342733762 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594007440 con 0x7f65a0070f90 2024-09-13T17:10:29.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.397+0000 7f65a4f82700 1 -- 172.21.15.123:0/3342733762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a015b270 con 0x7f65a0070f90 2024-09-13T17:10:29.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.401+0000 7f65a4f82700 1 -- 172.21.15.123:0/3342733762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a01f3950 con 0x7f65a0070f90 2024-09-13T17:10:29.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.401+0000 7f6587fff700 1 -- 172.21.15.123:0/3342733762 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f65940075a0 con 0x7f65a0070f90 2024-09-13T17:10:29.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.401+0000 7f6587fff700 1 --2- 172.21.15.123:0/3342733762 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f658c066760 0x7f658c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:29.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.401+0000 7f6587fff700 1 -- 172.21.15.123:0/3342733762 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6594083370 con 0x7f65a0070f90 2024-09-13T17:10:29.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.401+0000 7f659effd700 1 --2- 172.21.15.123:0/3342733762 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f658c066760 0x7f658c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:29.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.401+0000 7f659effd700 1 --2- 172.21.15.123:0/3342733762 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f658c066760 0x7f658c068c20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f65900090b0 tx=0x7f6590008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:29.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.409+0000 7f6587fff700 1 -- 172.21.15.123:0/3342733762 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f65a01f3950 con 0x7f65a0070f90 2024-09-13T17:10:29.519 INFO:tasks.ceph.mds.a.smithi123.stderr:2024-09-13T17:10:29.517+0000 7f4e5393b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:10:29.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:29.621+0000 7f65a4f82700 1 -- 172.21.15.123:0/3342733762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f65a01f3950 con 0x7f65a0070f90 2024-09-13T17:10:30.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.605+0000 7f6587fff700 1 -- 172.21.15.123:0/3342733762 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7f65a01f3950 con 0x7f65a0070f90 2024-09-13T17:10:30.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.609+0000 7f65a4f82700 1 -- 172.21.15.123:0/3342733762 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f658c066760 msgr2=0x7f658c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.609+0000 7f65a4f82700 1 --2- 172.21.15.123:0/3342733762 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f658c066760 0x7f658c068c20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f65900090b0 tx=0x7f6590008030 comp rx=0 tx=0).stop 2024-09-13T17:10:30.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.609+0000 7f65a4f82700 1 -- 172.21.15.123:0/3342733762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65a0070f90 msgr2=0x7f65a0155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.609+0000 7f65a4f82700 1 --2- 172.21.15.123:0/3342733762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65a0070f90 0x7f65a0155260 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f6594001eb0 tx=0x7f659400c7b0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.609+0000 7f65a4f82700 1 -- 172.21.15.123:0/3342733762 shutdown_connections 2024-09-13T17:10:30.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.609+0000 7f65a4f82700 1 --2- 172.21.15.123:0/3342733762 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f658c066760 0x7f658c068c20 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.609+0000 7f65a4f82700 1 --2- 172.21.15.123:0/3342733762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f65a0159c60 0x7f65a00ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.609+0000 7f65a4f82700 1 --2- 172.21.15.123:0/3342733762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65a00cdda0 0x7f65a00ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.609+0000 7f65a4f82700 1 --2- 172.21.15.123:0/3342733762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65a0070f90 0x7f65a0155260 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.609+0000 7f65a4f82700 1 -- 172.21.15.123:0/3342733762 >> 172.21.15.123:0/3342733762 conn(0x7f65a00b01d0 msgr2=0x7f65a00b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:30.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.609+0000 7f65a4f82700 1 -- 172.21.15.123:0/3342733762 shutdown_connections 2024-09-13T17:10:30.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.609+0000 7f65a4f82700 1 -- 172.21.15.123:0/3342733762 wait complete. 2024-09-13T17:10:30.630 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:10:30.631 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:10:30.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9eff59e700 1 Processor -- start 2024-09-13T17:10:30.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9eff59e700 1 -- start start 2024-09-13T17:10:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9eff59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9f00159e10 0x7f9f000c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9eff59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9f000cd620 0x7f9f000cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9eff59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f000c9450 con 0x7f9f00159a30 2024-09-13T17:10:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9eff59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f000ce010 con 0x7f9f00159e10 2024-09-13T17:10:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9eff59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f000c9730 con 0x7f9f000cd620 2024-09-13T17:10:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9ef7fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9f00159e10 0x7f9f000c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9efed9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9f000cd620 0x7f9f000cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9ef7fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9f00159e10 0x7f9f000c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36214/0 (socket says 172.21.15.123:36214) 2024-09-13T17:10:30.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9ef7fff700 1 -- 172.21.15.123:0/1370629925 learned_addr learned my addr 172.21.15.123:0/1370629925 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:30.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9ef7fff700 1 -- 172.21.15.123:0/1370629925 >> v2:172.21.15.153:3300/0 conn(0x7f9f000cd620 msgr2=0x7f9f000cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:30.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9ef7fff700 1 --2- 172.21.15.123:0/1370629925 >> v2:172.21.15.153:3300/0 conn(0x7f9f000cd620 0x7f9f000cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9ef7fff700 1 -- 172.21.15.123:0/1370629925 >> v1:172.21.15.153:6789/0 conn(0x7f9f00159a30 legacy=0x7f9f0006d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.753+0000 7f9ef7fff700 1 -- 172.21.15.123:0/1370629925 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f000c9a10 con 0x7f9f00159e10 2024-09-13T17:10:30.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.757+0000 7f9ef7fff700 1 --2- 172.21.15.123:0/1370629925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f00159e10 0x7f9f000c8e70 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009910 tx=0x7f9ee8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85bfddf5d838b67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:30.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.757+0000 7f9efdd9b700 1 -- 172.21.15.123:0/1370629925 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8011830 con 0x7f9f00159e10 2024-09-13T17:10:30.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.757+0000 7f9efdd9b700 1 -- 172.21.15.123:0/1370629925 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee8011990 con 0x7f9f00159e10 2024-09-13T17:10:30.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.757+0000 7f9efdd9b700 1 -- 172.21.15.123:0/1370629925 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8011d40 con 0x7f9f00159e10 2024-09-13T17:10:30.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.757+0000 7f9eff59e700 1 -- 172.21.15.123:0/1370629925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f00159e10 msgr2=0x7f9f000c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.757+0000 7f9eff59e700 1 --2- 172.21.15.123:0/1370629925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f00159e10 0x7f9f000c8e70 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009910 tx=0x7f9ee8009c20 comp rx=0 tx=0).stop 2024-09-13T17:10:30.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.757+0000 7f9eff59e700 1 -- 172.21.15.123:0/1370629925 shutdown_connections 2024-09-13T17:10:30.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.757+0000 7f9eff59e700 1 --2- 172.21.15.123:0/1370629925 >> v2:172.21.15.153:3300/0 conn(0x7f9f000cd620 0x7f9f000cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.757+0000 7f9eff59e700 1 --2- 172.21.15.123:0/1370629925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f00159e10 0x7f9f000c8e70 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.757+0000 7f9eff59e700 1 -- 172.21.15.123:0/1370629925 >> 172.21.15.123:0/1370629925 conn(0x7f9f000b0160 msgr2=0x7f9f000b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:30.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.757+0000 7f9eff59e700 1 -- 172.21.15.123:0/1370629925 shutdown_connections 2024-09-13T17:10:30.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.757+0000 7f9eff59e700 1 -- 172.21.15.123:0/1370629925 wait complete. 2024-09-13T17:10:30.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.757+0000 7f9eff59e700 1 Processor -- start 2024-09-13T17:10:30.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.757+0000 7f9eff59e700 1 -- start start 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9eff59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f000cd620 0x7f9f000b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9eff59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f00159a30 0x7f9f000c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9eff59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f00159e10 0x7f9f0015bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9eff59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0015a210 con 0x7f9f000cd620 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9eff59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f000b1a20 con 0x7f9f00159e10 2024-09-13T17:10:30.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9eff59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f000b1d00 con 0x7f9f00159a30 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9efe59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f000cd620 0x7f9f000b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9efe59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f000cd620 0x7f9f000b29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36216/0 (socket says 172.21.15.123:36216) 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9efe59c700 1 -- 172.21.15.123:0/2865116655 learned_addr learned my addr 172.21.15.123:0/2865116655 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9efed9d700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f00159e10 0x7f9f0015bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9ef7fff700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f00159a30 0x7f9f000c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9efe59c700 1 -- 172.21.15.123:0/2865116655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f00159a30 msgr2=0x7f9f000c2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9efe59c700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f00159a30 0x7f9f000c2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9efe59c700 1 -- 172.21.15.123:0/2865116655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f00159e10 msgr2=0x7f9f0015bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9efe59c700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f00159e10 0x7f9f0015bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9efe59c700 1 -- 172.21.15.123:0/2865116655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee8009570 con 0x7f9f000cd620 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9ef7fff700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f00159a30 0x7f9f000c2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:30.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9efe59c700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f000cd620 0x7f9f000b29f0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f9ef000c500 tx=0x7f9ef000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9ef6ffd700 1 -- 172.21.15.123:0/2865116655 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef00052d0 con 0x7f9f000cd620 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9ef6ffd700 1 -- 172.21.15.123:0/2865116655 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef0005430 con 0x7f9f000cd620 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9eff59e700 1 -- 172.21.15.123:0/2865116655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f000b1fe0 con 0x7f9f000cd620 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9ef6ffd700 1 -- 172.21.15.123:0/2865116655 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef00055a0 con 0x7f9f000cd620 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9eff59e700 1 -- 172.21.15.123:0/2865116655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f000b33d0 con 0x7f9f000cd620 2024-09-13T17:10:30.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.761+0000 7f9eff59e700 1 -- 172.21.15.123:0/2865116655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f000721a0 con 0x7f9f000cd620 2024-09-13T17:10:30.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.765+0000 7f9ef6ffd700 1 -- 172.21.15.123:0/2865116655 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ef00036a0 con 0x7f9f000cd620 2024-09-13T17:10:30.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.765+0000 7f9ef6ffd700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ee0066730 0x7f9ee0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:30.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.765+0000 7f9ef6ffd700 1 -- 172.21.15.123:0/2865116655 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ef0083340 con 0x7f9f000cd620 2024-09-13T17:10:30.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.765+0000 7f9ef7fff700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ee0066730 0x7f9ee0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:30.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.765+0000 7f9ef7fff700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ee0066730 0x7f9ee0068bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8014040 tx=0x7f9ee8008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:30.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.773+0000 7f9ef6ffd700 1 -- 172.21.15.123:0/2865116655 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ef0050740 con 0x7f9f000cd620 2024-09-13T17:10:30.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:30.985+0000 7f9eff59e700 1 -- 172.21.15.123:0/2865116655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9f000cdad0 con 0x7f9f000cd620 2024-09-13T17:10:31.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.617+0000 7f9ef6ffd700 1 -- 172.21.15.123:0/2865116655 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9ef0053d60 con 0x7f9f000cd620 2024-09-13T17:10:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.621+0000 7f9eff59e700 1 -- 172.21.15.123:0/2865116655 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ee0066730 msgr2=0x7f9ee0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.621+0000 7f9eff59e700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ee0066730 0x7f9ee0068bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8014040 tx=0x7f9ee8008030 comp rx=0 tx=0).stop 2024-09-13T17:10:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.621+0000 7f9eff59e700 1 -- 172.21.15.123:0/2865116655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f000cd620 msgr2=0x7f9f000b29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.621+0000 7f9eff59e700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f000cd620 0x7f9f000b29f0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f9ef000c500 tx=0x7f9ef000c810 comp rx=0 tx=0).stop 2024-09-13T17:10:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.621+0000 7f9eff59e700 1 -- 172.21.15.123:0/2865116655 shutdown_connections 2024-09-13T17:10:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.621+0000 7f9eff59e700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9ee0066730 0x7f9ee0068bf0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.621+0000 7f9eff59e700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f00159e10 0x7f9f0015bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.621+0000 7f9eff59e700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9f00159a30 0x7f9f000c2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.621+0000 7f9eff59e700 1 --2- 172.21.15.123:0/2865116655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f000cd620 0x7f9f000b29f0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.621+0000 7f9eff59e700 1 -- 172.21.15.123:0/2865116655 >> 172.21.15.123:0/2865116655 conn(0x7f9f000b0160 msgr2=0x7f9f000ae140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.621+0000 7f9eff59e700 1 -- 172.21.15.123:0/2865116655 shutdown_connections 2024-09-13T17:10:31.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.621+0000 7f9eff59e700 1 -- 172.21.15.123:0/2865116655 wait complete. 2024-09-13T17:10:31.641 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:10:31.641 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:31.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.757+0000 7f684b59e700 1 Processor -- start 2024-09-13T17:10:31.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.757+0000 7f684b59e700 1 -- start start 2024-09-13T17:10:31.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f684c15a8c0 0x7f684c0705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:31.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f684c15b9b0 0x7f684c070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:31.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f684c0713b0 0x7f684c0cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:31.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684c071840 con 0x7f684c15a8c0 2024-09-13T17:10:31.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684c0cee80 con 0x7f684c15b9b0 2024-09-13T17:10:31.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0ce270 con 0x7f684c0713b0 2024-09-13T17:10:31.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684a59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f684c15a8c0 0x7f684c0705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:31.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684a59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f684c15a8c0 0x7f684c0705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36218/0 (socket says 172.21.15.123:36218) 2024-09-13T17:10:31.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684a59c700 1 -- 172.21.15.123:0/3990703593 learned_addr learned my addr 172.21.15.123:0/3990703593 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:31.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f6849d9b700 1 --2- 172.21.15.123:0/3990703593 >> v2:172.21.15.153:3300/0 conn(0x7f684c15b9b0 0x7f684c070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:31.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684ad9d700 1 --2- 172.21.15.123:0/3990703593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f684c0713b0 0x7f684c0cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:31.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684a59c700 1 -- 172.21.15.123:0/3990703593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f684c0713b0 msgr2=0x7f684c0cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:31.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684a59c700 1 --2- 172.21.15.123:0/3990703593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f684c0713b0 0x7f684c0cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684a59c700 1 -- 172.21.15.123:0/3990703593 >> v2:172.21.15.153:3300/0 conn(0x7f684c15b9b0 msgr2=0x7f684c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:31.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684a59c700 1 --2- 172.21.15.123:0/3990703593 >> v2:172.21.15.153:3300/0 conn(0x7f684c15b9b0 0x7f684c070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684a59c700 1 -- 172.21.15.123:0/3990703593 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c0ce550 con 0x7f684c15a8c0 2024-09-13T17:10:31.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684a59c700 1 --2- 172.21.15.123:0/3990703593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f684c15a8c0 0x7f684c0705b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f684c0cdf90 tx=0x7f683c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd936639d9ee9e20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:31.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684959a700 1 -- 172.21.15.123:0/3990703593 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c00ba20 con 0x7f684c15a8c0 2024-09-13T17:10:31.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684959a700 1 -- 172.21.15.123:0/3990703593 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c00bb80 con 0x7f684c15a8c0 2024-09-13T17:10:31.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684959a700 1 -- 172.21.15.123:0/3990703593 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c009e60 con 0x7f684c15a8c0 2024-09-13T17:10:31.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 -- 172.21.15.123:0/3990703593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f684c15a8c0 msgr2=0x7f684c0705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 --2- 172.21.15.123:0/3990703593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f684c15a8c0 0x7f684c0705b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f684c0cdf90 tx=0x7f683c009c20 comp rx=0 tx=0).stop 2024-09-13T17:10:31.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 -- 172.21.15.123:0/3990703593 shutdown_connections 2024-09-13T17:10:31.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 --2- 172.21.15.123:0/3990703593 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f684c0713b0 0x7f684c0cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 --2- 172.21.15.123:0/3990703593 >> v2:172.21.15.153:3300/0 conn(0x7f684c15b9b0 0x7f684c070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 --2- 172.21.15.123:0/3990703593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f684c15a8c0 0x7f684c0705b0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 -- 172.21.15.123:0/3990703593 >> 172.21.15.123:0/3990703593 conn(0x7f684c066150 msgr2=0x7f684c066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:31.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 -- 172.21.15.123:0/3990703593 shutdown_connections 2024-09-13T17:10:31.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.761+0000 7f684b59e700 1 -- 172.21.15.123:0/3990703593 wait complete. 2024-09-13T17:10:31.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.765+0000 7f684b59e700 1 Processor -- start 2024-09-13T17:10:31.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.765+0000 7f684b59e700 1 -- start start 2024-09-13T17:10:31.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684b59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f684c0713b0 0x7f684c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:31.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f684c15a8c0 0x7f684c0ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:31.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f684c15b9b0 0x7f684c157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:31.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684b59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c151950 con 0x7f684c15b9b0 2024-09-13T17:10:31.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c142010 con 0x7f684c15a8c0 2024-09-13T17:10:31.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684b59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0a8540 con 0x7f684c0713b0 2024-09-13T17:10:31.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f684c15b9b0 0x7f684c157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:31.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684a59c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f684c0713b0 0x7f684c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:31.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f684c15b9b0 0x7f684c157d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36220/0 (socket says 172.21.15.123:36220) 2024-09-13T17:10:31.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684ad9d700 1 -- 172.21.15.123:0/1802945482 learned_addr learned my addr 172.21.15.123:0/1802945482 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:31.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f6849d9b700 1 --2- 172.21.15.123:0/1802945482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f684c15a8c0 0x7f684c0ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:31.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684ad9d700 1 -- 172.21.15.123:0/1802945482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f684c0713b0 msgr2=0x7f684c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684ad9d700 1 --2- 172.21.15.123:0/1802945482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f684c0713b0 0x7f684c154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684ad9d700 1 -- 172.21.15.123:0/1802945482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f684c15a8c0 msgr2=0x7f684c0ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684ad9d700 1 --2- 172.21.15.123:0/1802945482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f684c15a8c0 0x7f684c0ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684ad9d700 1 -- 172.21.15.123:0/1802945482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683c009570 con 0x7f684c15b9b0 2024-09-13T17:10:31.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684ad9d700 1 --2- 172.21.15.123:0/1802945482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f684c15b9b0 0x7f684c157d00 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f6844007e40 tx=0x7f684400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:31.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f683affd700 1 -- 172.21.15.123:0/1802945482 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684400ed30 con 0x7f684c15b9b0 2024-09-13T17:10:31.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f683affd700 1 -- 172.21.15.123:0/1802945482 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6844014420 con 0x7f684c15b9b0 2024-09-13T17:10:31.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684b59e700 1 -- 172.21.15.123:0/1802945482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684c0a8820 con 0x7f684c15b9b0 2024-09-13T17:10:31.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f683affd700 1 -- 172.21.15.123:0/1802945482 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68440147d0 con 0x7f684c15b9b0 2024-09-13T17:10:31.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684b59e700 1 -- 172.21.15.123:0/1802945482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684c142540 con 0x7f684c15b9b0 2024-09-13T17:10:31.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.769+0000 7f684b59e700 1 -- 172.21.15.123:0/1802945482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684c0677f0 con 0x7f684c15b9b0 2024-09-13T17:10:31.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.773+0000 7f683affd700 1 -- 172.21.15.123:0/1802945482 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6844014930 con 0x7f684c15b9b0 2024-09-13T17:10:31.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.773+0000 7f683affd700 1 --2- 172.21.15.123:0/1802945482 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f682c066730 0x7f682c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:31.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.773+0000 7f684a59c700 1 --2- 172.21.15.123:0/1802945482 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f682c066730 0x7f682c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:31.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.773+0000 7f683affd700 1 -- 172.21.15.123:0/1802945482 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6844084800 con 0x7f684c15b9b0 2024-09-13T17:10:31.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.773+0000 7f684a59c700 1 --2- 172.21.15.123:0/1802945482 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f682c066730 0x7f682c068bf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f683c000c00 tx=0x7f683c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:31.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.781+0000 7f683affd700 1 -- 172.21.15.123:0/1802945482 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6844051b70 con 0x7f684c15b9b0 2024-09-13T17:10:31.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.985+0000 7f684b59e700 1 -- 172.21.15.123:0/1802945482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f684c0a8a60 con 0x7f684c15b9b0 2024-09-13T17:10:31.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.985+0000 7f683affd700 1 -- 172.21.15.123:0/1802945482 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f6844055190 con 0x7f684c15b9b0 2024-09-13T17:10:31.990 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:31.990 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":48,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7156,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3705271604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705271604},{"type":"v1","addr":"172.21.15.153:6834","nonce":3705271604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2842144578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":2842144578},{"type":"v1","addr":"172.21.15.153:6835","nonce":2842144578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7398,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2022373739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2022373739},{"type":"v1","addr":"172.21.15.123:6835","nonce":2022373739}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:10:28.586943+0000","modified":"2024-09-13T17:10:31.604775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7401":{"gid":7401,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/1688881065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1688881065},{"type":"v1","addr":"172.21.15.123:6837","nonce":1688881065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:10:31.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.989+0000 7f684b59e700 1 -- 172.21.15.123:0/1802945482 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f682c066730 msgr2=0x7f682c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.989+0000 7f684b59e700 1 --2- 172.21.15.123:0/1802945482 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f682c066730 0x7f682c068bf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f683c000c00 tx=0x7f683c008030 comp rx=0 tx=0).stop 2024-09-13T17:10:31.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.989+0000 7f684b59e700 1 -- 172.21.15.123:0/1802945482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f684c15b9b0 msgr2=0x7f684c157d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.989+0000 7f684b59e700 1 --2- 172.21.15.123:0/1802945482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f684c15b9b0 0x7f684c157d00 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f6844007e40 tx=0x7f684400e3c0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.989+0000 7f684b59e700 1 -- 172.21.15.123:0/1802945482 shutdown_connections 2024-09-13T17:10:31.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.989+0000 7f684b59e700 1 --2- 172.21.15.123:0/1802945482 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f682c066730 0x7f682c068bf0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.989+0000 7f684b59e700 1 --2- 172.21.15.123:0/1802945482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f684c15b9b0 0x7f684c157d00 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.989+0000 7f684b59e700 1 --2- 172.21.15.123:0/1802945482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f684c15a8c0 0x7f684c0ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.989+0000 7f684b59e700 1 --2- 172.21.15.123:0/1802945482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f684c0713b0 0x7f684c154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.989+0000 7f684b59e700 1 -- 172.21.15.123:0/1802945482 >> 172.21.15.123:0/1802945482 conn(0x7f684c066150 msgr2=0x7f684c0ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:31.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.989+0000 7f684b59e700 1 -- 172.21.15.123:0/1802945482 shutdown_connections 2024-09-13T17:10:31.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:31.989+0000 7f684b59e700 1 -- 172.21.15.123:0/1802945482 wait complete. 2024-09-13T17:10:31.994 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 48 2024-09-13T17:10:32.005 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:32.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3409d50700 1 Processor -- start 2024-09-13T17:10:32.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3409d50700 1 -- start start 2024-09-13T17:10:32.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3409d50700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f340415ed00 0x7f3404161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3409d50700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3404161a80 0x7f34040cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3409d50700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3404162550 con 0x7f340415e920 2024-09-13T17:10:32.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3409d50700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34040cd690 con 0x7f340415ed00 2024-09-13T17:10:32.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3409d50700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3404161f90 con 0x7f3404161a80 2024-09-13T17:10:32.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3403fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f340415ed00 0x7f3404161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3403fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f340415ed00 0x7f3404161540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34232/0 (socket says 172.21.15.123:34232) 2024-09-13T17:10:32.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3403fff700 1 -- 172.21.15.123:0/1698026847 learned_addr learned my addr 172.21.15.123:0/1698026847 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:32.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3408d4e700 1 --1- 172.21.15.123:0/1698026847 >> v1:172.21.15.123:6789/0 conn(0x7f340415e920 0x7f34040caae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58134/0 (socket says 172.21.15.123:58134) 2024-09-13T17:10:32.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f340954f700 1 --2- 172.21.15.123:0/1698026847 >> v2:172.21.15.153:3300/0 conn(0x7f3404161a80 0x7f34040cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f34037fe700 1 -- 172.21.15.123:0/1698026847 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836573706 0 0) 0x7f3404162550 con 0x7f340415e920 2024-09-13T17:10:32.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3403fff700 1 -- 172.21.15.123:0/1698026847 >> v2:172.21.15.153:3300/0 conn(0x7f3404161a80 msgr2=0x7f34040cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:32.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3403fff700 1 --2- 172.21.15.123:0/1698026847 >> v2:172.21.15.153:3300/0 conn(0x7f3404161a80 0x7f34040cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3403fff700 1 -- 172.21.15.123:0/1698026847 >> v1:172.21.15.123:6789/0 conn(0x7f340415e920 legacy=0x7f34040caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3403fff700 1 -- 172.21.15.123:0/1698026847 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3404162270 con 0x7f340415ed00 2024-09-13T17:10:32.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.117+0000 7f3403fff700 1 --2- 172.21.15.123:0/1698026847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f340415ed00 0x7f3404161540 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f34040728e0 tx=0x7f33fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89dd04c7f35812c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:32.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f34037fe700 1 -- 172.21.15.123:0/1698026847 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc00e070 con 0x7f340415ed00 2024-09-13T17:10:32.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f34037fe700 1 -- 172.21.15.123:0/1698026847 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc00b910 con 0x7f340415ed00 2024-09-13T17:10:32.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f34037fe700 1 -- 172.21.15.123:0/1698026847 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc00bcc0 con 0x7f340415ed00 2024-09-13T17:10:32.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 -- 172.21.15.123:0/1698026847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f340415ed00 msgr2=0x7f3404161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 --2- 172.21.15.123:0/1698026847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f340415ed00 0x7f3404161540 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f34040728e0 tx=0x7f33fc00b330 comp rx=0 tx=0).stop 2024-09-13T17:10:32.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 -- 172.21.15.123:0/1698026847 shutdown_connections 2024-09-13T17:10:32.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 --2- 172.21.15.123:0/1698026847 >> v2:172.21.15.153:3300/0 conn(0x7f3404161a80 0x7f34040cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 --2- 172.21.15.123:0/1698026847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f340415ed00 0x7f3404161540 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 -- 172.21.15.123:0/1698026847 >> 172.21.15.123:0/1698026847 conn(0x7f3404066150 msgr2=0x7f3404066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:32.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 -- 172.21.15.123:0/1698026847 shutdown_connections 2024-09-13T17:10:32.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 -- 172.21.15.123:0/1698026847 wait complete. 2024-09-13T17:10:32.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 Processor -- start 2024-09-13T17:10:32.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 -- start start 2024-09-13T17:10:32.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f340415e920 0x7f3404158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f340415ed00 0x7f34041eb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3404161a80 0x7f34041e74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34041ea1e0 con 0x7f340415ed00 2024-09-13T17:10:32.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3404159560 con 0x7f340415e920 2024-09-13T17:10:32.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3409d50700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34041ea3f0 con 0x7f3404161a80 2024-09-13T17:10:32.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3403fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f340415ed00 0x7f34041eb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3403fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f340415ed00 0x7f34041eb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34246/0 (socket says 172.21.15.123:34246) 2024-09-13T17:10:32.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3403fff700 1 -- 172.21.15.123:0/2721287350 learned_addr learned my addr 172.21.15.123:0/2721287350 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:32.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.121+0000 7f3408d4e700 1 --2- 172.21.15.123:0/2721287350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f340415e920 0x7f3404158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.125+0000 7f340954f700 1 --2- 172.21.15.123:0/2721287350 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3404161a80 0x7f34041e74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.125+0000 7f3403fff700 1 -- 172.21.15.123:0/2721287350 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3404161a80 msgr2=0x7f34041e74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.125+0000 7f3403fff700 1 --2- 172.21.15.123:0/2721287350 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3404161a80 0x7f34041e74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.125+0000 7f3403fff700 1 -- 172.21.15.123:0/2721287350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f340415e920 msgr2=0x7f3404158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.125+0000 7f3403fff700 1 --2- 172.21.15.123:0/2721287350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f340415e920 0x7f3404158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.125+0000 7f3403fff700 1 -- 172.21.15.123:0/2721287350 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc009b30 con 0x7f340415ed00 2024-09-13T17:10:32.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.125+0000 7f3403fff700 1 --2- 172.21.15.123:0/2721287350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f340415ed00 0x7f34041eb490 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f34040670e0 tx=0x7f33fc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:32.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.125+0000 7f34017fa700 1 -- 172.21.15.123:0/2721287350 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc0092e0 con 0x7f340415ed00 2024-09-13T17:10:32.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.125+0000 7f34017fa700 1 -- 172.21.15.123:0/2721287350 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc004970 con 0x7f340415ed00 2024-09-13T17:10:32.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.125+0000 7f3409d50700 1 -- 172.21.15.123:0/2721287350 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34041ea6d0 con 0x7f340415ed00 2024-09-13T17:10:32.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.125+0000 7f34017fa700 1 -- 172.21.15.123:0/2721287350 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc01c680 con 0x7f340415ed00 2024-09-13T17:10:32.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.125+0000 7f3409d50700 1 -- 172.21.15.123:0/2721287350 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34041eac90 con 0x7f340415ed00 2024-09-13T17:10:32.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.125+0000 7f3409d50700 1 -- 172.21.15.123:0/2721287350 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34040677f0 con 0x7f340415ed00 2024-09-13T17:10:32.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.129+0000 7f34017fa700 1 -- 172.21.15.123:0/2721287350 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f33fc01c7e0 con 0x7f340415ed00 2024-09-13T17:10:32.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.129+0000 7f34017fa700 1 --2- 172.21.15.123:0/2721287350 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f33e4066730 0x7f33e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.129+0000 7f34017fa700 1 -- 172.21.15.123:0/2721287350 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33fc085d60 con 0x7f340415ed00 2024-09-13T17:10:32.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.129+0000 7f3408d4e700 1 --2- 172.21.15.123:0/2721287350 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f33e4066730 0x7f33e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.129+0000 7f3408d4e700 1 --2- 172.21.15.123:0/2721287350 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f33e4066730 0x7f33e4068bf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f33ec000f60 tx=0x7f33ec007e00 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:32.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.133+0000 7f34017fa700 1 -- 172.21.15.123:0/2721287350 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f33fc053240 con 0x7f340415ed00 2024-09-13T17:10:32.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.301+0000 7f3409d50700 1 -- 172.21.15.123:0/2721287350 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3404161540 con 0x7f340415ed00 2024-09-13T17:10:32.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.305+0000 7f34017fa700 1 -- 172.21.15.123:0/2721287350 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16556 (secure 0 0 0) 0x7f33fc056860 con 0x7f340415ed00 2024-09-13T17:10:32.307 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:32.307 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":98,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:29.590478+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:10:26.903248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T17:10:27.570928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:32.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.309+0000 7f3409d50700 1 -- 172.21.15.123:0/2721287350 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f33e4066730 msgr2=0x7f33e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.309+0000 7f3409d50700 1 --2- 172.21.15.123:0/2721287350 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f33e4066730 0x7f33e4068bf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f33ec000f60 tx=0x7f33ec007e00 comp rx=0 tx=0).stop 2024-09-13T17:10:32.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.309+0000 7f3409d50700 1 -- 172.21.15.123:0/2721287350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f340415ed00 msgr2=0x7f34041eb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.309+0000 7f3409d50700 1 --2- 172.21.15.123:0/2721287350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f340415ed00 0x7f34041eb490 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f34040670e0 tx=0x7f33fc004af0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.309+0000 7f3409d50700 1 -- 172.21.15.123:0/2721287350 shutdown_connections 2024-09-13T17:10:32.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.309+0000 7f3409d50700 1 --2- 172.21.15.123:0/2721287350 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f33e4066730 0x7f33e4068bf0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.309+0000 7f3409d50700 1 --2- 172.21.15.123:0/2721287350 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3404161a80 0x7f34041e74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.309+0000 7f3409d50700 1 --2- 172.21.15.123:0/2721287350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f340415ed00 0x7f34041eb490 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.309+0000 7f3409d50700 1 --2- 172.21.15.123:0/2721287350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f340415e920 0x7f3404158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.309+0000 7f3409d50700 1 -- 172.21.15.123:0/2721287350 >> 172.21.15.123:0/2721287350 conn(0x7f3404066150 msgr2=0x7f340406cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:32.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.309+0000 7f3409d50700 1 -- 172.21.15.123:0/2721287350 shutdown_connections 2024-09-13T17:10:32.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.309+0000 7f3409d50700 1 -- 172.21.15.123:0/2721287350 wait complete. 2024-09-13T17:10:32.327 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:10:32.327 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:10:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f6393fff700 1 Processor -- start 2024-09-13T17:10:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f6393fff700 1 -- start start 2024-09-13T17:10:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f6393fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6394071580 0x7f63940705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f6393fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63940cee80 con 0x7f639415b9b0 2024-09-13T17:10:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f6393fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63940ce270 con 0x7f639415a8c0 2024-09-13T17:10:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f6393fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63940ce550 con 0x7f6394071580 2024-09-13T17:10:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f63937fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f639415b9b0 0x7f63940cc620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58148/0 (socket says 172.21.15.123:58148) 2024-09-13T17:10:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f63937fe700 1 -- 172.21.15.123:0/2889385288 learned_addr learned my addr 172.21.15.123:0/2889385288 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f63927fc700 1 --2- 172.21.15.123:0/2889385288 >> v2:172.21.15.123:3300/0 conn(0x7f6394071580 0x7f63940705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f63927fc700 1 -- 172.21.15.123:0/2889385288 >> v1:172.21.15.153:6789/0 conn(0x7f639415a8c0 legacy=0x7f6394070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f63927fc700 1 -- 172.21.15.123:0/2889385288 >> v1:172.21.15.123:6789/0 conn(0x7f639415b9b0 legacy=0x7f63940cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f63927fc700 1 -- 172.21.15.123:0/2889385288 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63940ce830 con 0x7f6394071580 2024-09-13T17:10:32.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f6391ffb700 1 -- 172.21.15.123:0/2889385288 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423276384 0 0) 0x7f63940cee80 con 0x7f639415b9b0 2024-09-13T17:10:32.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f63927fc700 1 --2- 172.21.15.123:0/2889385288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6394071580 0x7f63940705b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6384009d90 tx=0x7f638400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63bb5743b1fd94b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:32.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f6391ffb700 1 -- 172.21.15.123:0/2889385288 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638400e070 con 0x7f6394071580 2024-09-13T17:10:32.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f6391ffb700 1 -- 172.21.15.123:0/2889385288 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638400bbd0 con 0x7f6394071580 2024-09-13T17:10:32.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.433+0000 7f6391ffb700 1 -- 172.21.15.123:0/2889385288 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6384012430 con 0x7f6394071580 2024-09-13T17:10:32.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 -- 172.21.15.123:0/2889385288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6394071580 msgr2=0x7f63940705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 --2- 172.21.15.123:0/2889385288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6394071580 0x7f63940705b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6384009d90 tx=0x7f638400b330 comp rx=0 tx=0).stop 2024-09-13T17:10:32.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 -- 172.21.15.123:0/2889385288 shutdown_connections 2024-09-13T17:10:32.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 --2- 172.21.15.123:0/2889385288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6394071580 0x7f63940705b0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 -- 172.21.15.123:0/2889385288 >> 172.21.15.123:0/2889385288 conn(0x7f6394066150 msgr2=0x7f6394066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:32.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 -- 172.21.15.123:0/2889385288 shutdown_connections 2024-09-13T17:10:32.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 -- 172.21.15.123:0/2889385288 wait complete. 2024-09-13T17:10:32.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 Processor -- start 2024-09-13T17:10:32.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 -- start start 2024-09-13T17:10:32.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6394071580 0x7f6394158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f639415a8c0 0x7f63940acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f639415b9b0 0x7f63941543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6394159940 con 0x7f639415a8c0 2024-09-13T17:10:32.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63941efe50 con 0x7f6394071580 2024-09-13T17:10:32.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6393fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63941f00b0 con 0x7f639415b9b0 2024-09-13T17:10:32.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f63927fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f639415a8c0 0x7f63940acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f63927fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f639415a8c0 0x7f63940acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34270/0 (socket says 172.21.15.123:34270) 2024-09-13T17:10:32.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f63927fc700 1 -- 172.21.15.123:0/4238312888 learned_addr learned my addr 172.21.15.123:0/4238312888 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:32.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f6392ffd700 1 --2- 172.21.15.123:0/4238312888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6394071580 0x7f6394158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.437+0000 7f63937fe700 1 --2- 172.21.15.123:0/4238312888 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f639415b9b0 0x7f63941543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f63927fc700 1 -- 172.21.15.123:0/4238312888 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f639415b9b0 msgr2=0x7f63941543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f63927fc700 1 --2- 172.21.15.123:0/4238312888 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f639415b9b0 0x7f63941543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f63927fc700 1 -- 172.21.15.123:0/4238312888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6394071580 msgr2=0x7f6394158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f63927fc700 1 --2- 172.21.15.123:0/4238312888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6394071580 0x7f6394158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f63927fc700 1 -- 172.21.15.123:0/4238312888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6384009a70 con 0x7f639415a8c0 2024-09-13T17:10:32.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f63927fc700 1 --2- 172.21.15.123:0/4238312888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f639415a8c0 0x7f63940acbf0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f6384000f80 tx=0x7f6384004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:32.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f638b7fe700 1 -- 172.21.15.123:0/4238312888 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638401b810 con 0x7f639415a8c0 2024-09-13T17:10:32.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f638b7fe700 1 -- 172.21.15.123:0/4238312888 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6384020070 con 0x7f639415a8c0 2024-09-13T17:10:32.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f638b7fe700 1 -- 172.21.15.123:0/4238312888 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638401bbd0 con 0x7f639415a8c0 2024-09-13T17:10:32.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f6393fff700 1 -- 172.21.15.123:0/4238312888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6394159390 con 0x7f639415a8c0 2024-09-13T17:10:32.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f6393fff700 1 -- 172.21.15.123:0/4238312888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63941f0350 con 0x7f639415a8c0 2024-09-13T17:10:32.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f6393fff700 1 -- 172.21.15.123:0/4238312888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63940677f0 con 0x7f639415a8c0 2024-09-13T17:10:32.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f638b7fe700 1 -- 172.21.15.123:0/4238312888 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f638401bd30 con 0x7f639415a8c0 2024-09-13T17:10:32.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f638b7fe700 1 --2- 172.21.15.123:0/4238312888 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6374066730 0x7f6374068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f638b7fe700 1 -- 172.21.15.123:0/4238312888 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6384022070 con 0x7f639415a8c0 2024-09-13T17:10:32.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.441+0000 7f6392ffd700 1 --2- 172.21.15.123:0/4238312888 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6374066730 0x7f6374068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.445+0000 7f6392ffd700 1 --2- 172.21.15.123:0/4238312888 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6374066730 0x7f6374068bf0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f637c000f60 tx=0x7f637c009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:32.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.449+0000 7f638b7fe700 1 -- 172.21.15.123:0/4238312888 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f63840538b0 con 0x7f639415a8c0 2024-09-13T17:10:32.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.621+0000 7f6393fff700 1 -- 172.21.15.123:0/4238312888 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f639415be40 con 0x7f6374066730 2024-09-13T17:10:32.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.629+0000 7f638b7fe700 1 -- 172.21.15.123:0/4238312888 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273388 (secure 0 0 0) 0x7f637c0015e0 con 0x7f6374066730 2024-09-13T17:10:32.637 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:32.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.633+0000 7f6393fff700 1 -- 172.21.15.123:0/4238312888 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6374066730 msgr2=0x7f6374068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.633+0000 7f6393fff700 1 --2- 172.21.15.123:0/4238312888 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6374066730 0x7f6374068bf0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f637c000f60 tx=0x7f637c009040 comp rx=0 tx=0).stop 2024-09-13T17:10:32.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.633+0000 7f6393fff700 1 -- 172.21.15.123:0/4238312888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f639415a8c0 msgr2=0x7f63940acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.633+0000 7f6393fff700 1 --2- 172.21.15.123:0/4238312888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f639415a8c0 0x7f63940acbf0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f6384000f80 tx=0x7f6384004af0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.633+0000 7f6393fff700 1 -- 172.21.15.123:0/4238312888 shutdown_connections 2024-09-13T17:10:32.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.633+0000 7f6393fff700 1 --2- 172.21.15.123:0/4238312888 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f6374066730 0x7f6374068bf0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.633+0000 7f6393fff700 1 --2- 172.21.15.123:0/4238312888 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f639415b9b0 0x7f63941543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.633+0000 7f6393fff700 1 --2- 172.21.15.123:0/4238312888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f639415a8c0 0x7f63940acbf0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.633+0000 7f6393fff700 1 --2- 172.21.15.123:0/4238312888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6394071580 0x7f6394158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.633+0000 7f6393fff700 1 -- 172.21.15.123:0/4238312888 >> 172.21.15.123:0/4238312888 conn(0x7f6394066150 msgr2=0x7f63940cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:32.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.637+0000 7f6393fff700 1 -- 172.21.15.123:0/4238312888 shutdown_connections 2024-09-13T17:10:32.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.637+0000 7f6393fff700 1 -- 172.21.15.123:0/4238312888 wait complete. 2024-09-13T17:10:32.640 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:10:32.651 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-09-13T17:10:30.802123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":251056,"kb_used_data":10248,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754723664,"statfs":{"total":773094113280,"available":772837031936,"internally_reserved":0,"allocated":10493952,"data_stored":5132152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001041"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:28.197489+0000","last_change":"2024-09-13T17:10:28.197489+0000","last_active":"2024-09-13T17:10:28.197489+0000","last_peered":"2024-09-13T17:10:28.197489+0000","last_clean":"2024-09-13T17:10:28.197489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:28.197489+0000","last_undegraded":"2024-09-13T17:10:28.197489+0000","last_fullsized":"2024-09-13T17:10:28.197489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:10:27.187644+0000","last_change":"2024-09-13T17:10:27.187644+0000","last_active":"2024-09-13T17:10:27.187644+0000","last_peered":"2024-09-13T17:10:27.187644+0000","last_clean":"2024-09-13T17:10:27.187644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:10:27.187644+0000","last_undegraded":"2024-09-13T17:10:27.187644+0000","last_fullsized":"2024-09-13T17:10:27.187644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":239,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:10:24.179916+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:10:24.179916+0000","last_peered":"2024-09-13T17:10:24.179916+0000","last_clean":"2024-09-13T17:10:24.179916+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:10:24.179916+0000","last_undegraded":"2024-09-13T17:10:24.179916+0000","last_fullsized":"2024-09-13T17:10:24.179916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1757184,"data_stored":1084295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83499999999999996,"15min":0.84899999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.212,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.877,"15min":0.90500000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.92400000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3979999999999999,"5min":1.456,"15min":1.456},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.89400000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.85099999999999998,"15min":0.85899999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2210000000000001,"5min":1.238,"15min":1.238},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98399999999999999,"15min":1.004},"min":{"1min":0.64500000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.86099999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.93200000000000005,"15min":0.92200000000000004},"min":{"1min":0.628,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.98299999999999998,"15min":0.998},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.89700000000000002,"15min":0.90000000000000002},"min":{"1min":0.66600000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.016,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.099,"15min":1.117},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.3959999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.03}]},{"osd":5,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.032,"15min":1.0389999999999999},"min":{"1min":0.627,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.012,"5min":1.0209999999999999,"15min":1.018},"min":{"1min":0.77900000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.97099999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0980000000000001,"15min":1.123},"min":{"1min":0.81799999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7170000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.1200000000000001,"15min":1.1339999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.101}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28156,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1163264,"data_stored":493927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76000000000000001,"15min":0.755},"min":{"1min":0.56200000000000006,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85799999999999998,"15min":0.876},"min":{"1min":0.58599999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.052,"5min":1.431,"15min":1.431},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92400000000000004,"15min":0.92700000000000005},"min":{"1min":0.64800000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.163,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.61499999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1020000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.81599999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.89500000000000002,"15min":0.91300000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.071,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.94099999999999995,"15min":0.97299999999999998},"min":{"1min":0.59799999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1679999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.1870000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95099999999999996,"15min":0.97499999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.198,"5min":1.359,"15min":1.359},"last":1.107},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.038,"15min":1.05},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.026}]},{"osd":4,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.89700000000000002,"15min":0.90600000000000003},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1060000000000001,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2250000000000001,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.2410000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.014,"15min":1.018},"min":{"1min":0.74199999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2170000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.038,"15min":1.0629999999999999},"min":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1819999999999999,"5min":1.597,"15min":1.597},"last":1}]},{"osd":7,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.091,"15min":1.1040000000000001},"min":{"1min":0.82199999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2969999999999999,"5min":1.728,"15min":1.728},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.167,"15min":1.1899999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.526,"5min":2.194,"15min":2.194},"last":1.0620000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32260,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1163264,"data_stored":493927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.83699999999999997,"15min":0.86299999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.232,"5min":1.395,"15min":1.395},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.86299999999999999,"15min":0.88300000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.173,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94599999999999995,"15min":0.95599999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.232,"5min":1.508,"15min":1.508},"last":1.133},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95199999999999996,"15min":0.95399999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.302,"5min":1.482,"15min":1.482},"last":1.05}]},{"osd":2,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.85099999999999998},"min":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2669999999999999,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.69799999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1899999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.77900000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.96699999999999997,"15min":0.997},"min":{"1min":0.67100000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.206,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.871},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92100000000000004,"15min":0.93100000000000005},"min":{"1min":0.58199999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.335,"5min":1.603,"15min":1.603},"last":1.0169999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.022,"15min":1.0589999999999999},"min":{"1min":0.77300000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.208,"5min":1.466,"15min":1.466},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.999,"15min":1.0309999999999999},"min":{"1min":0.65100000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3640000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.93000000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0369999999999999,"15min":1.0649999999999999},"min":{"1min":0.76600000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.2,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1439999999999999,"15min":1.1839999999999999},"min":{"1min":0.76600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2669999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.101}]},{"osd":7,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.097,"15min":1.137},"min":{"1min":0.75700000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.1899999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.169,"15min":1.2050000000000001},"min":{"1min":0.76700000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.466,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.2829999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32256,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1163264,"data_stored":493927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.751},"min":{"1min":0.52800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94699999999999995,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1739999999999999,"5min":1.306,"15min":1.306},"last":0.74299999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.65900000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1579999999999999,"5min":1.357,"15min":1.357},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.93799999999999994,"15min":0.94699999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2050000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.181}]},{"osd":2,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.89500000000000002,"15min":0.88500000000000001},"min":{"1min":0.65400000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1599999999999999,"5min":1.272,"15min":1.272},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.94099999999999995,"15min":0.91500000000000004},"min":{"1min":0.78400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3220000000000001,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0620000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.90400000000000003,"15min":0.92000000000000004},"min":{"1min":0.63700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1879999999999999,"5min":1.464,"15min":1.464},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.879,"5min":0.89200000000000002,"15min":0.88500000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.25,"5min":1.353,"15min":1.353},"last":1.028}]},{"osd":5,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94699999999999995,"15min":0.93999999999999995},"min":{"1min":0.623,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2210000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.0740000000000001,"15min":1.0649999999999999},"min":{"1min":0.83799999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3200000000000001,"5min":1.478,"15min":1.478},"last":1.3540000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97099999999999997,"15min":0.97399999999999998},"min":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1659999999999999,"5min":1.26,"15min":1.26},"last":1.155},{"interface":"front","average":{"1min":1.095,"5min":1.0580000000000001,"15min":1.048},"min":{"1min":0.83899999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.429,"5min":1.613,"15min":1.613},"last":1.3049999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.087,"15min":1.087},"min":{"1min":0.753,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.373,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.127,"15min":1.1259999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.399,"5min":2.032,"15min":2.032},"last":1.331}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32268,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1163264,"data_stored":493927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.32500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.58499999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80000000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.232,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69799999999999995,"15min":0.71799999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.222,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.35299999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.03,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.44900000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.91200000000000003,"15min":0.92200000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.93799999999999994,"15min":0.95799999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3740000000000001,"5min":1.899,"15min":1.899},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.61699999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.377,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.98699999999999999,"15min":0.99299999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4330000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1}]},{"osd":6,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0169999999999999,"15min":1.024},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0169999999999999,"15min":1.04},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3089999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.96499999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.0720000000000001,"15min":1.089},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.514,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.056},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.05,"15min":1.0680000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6599999999999999,"5min":1.756,"15min":1.756},"last":0.85399999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28168,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1163264,"data_stored":493927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.872,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81200000000000006,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.79400000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70399999999999996,"15min":0.72599999999999998},"min":{"1min":0.372,"5min":0.37,"15min":0.37},"max":{"1min":0.92700000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.747,"15min":0.77300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0609999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.46300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82599999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.747},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94899999999999995,"5min":1.103,"15min":1.103},"last":0.874}]},{"osd":4,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.91700000000000004,"15min":0.93899999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.157,"5min":1.3,"15min":1.3},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.92100000000000004,"15min":0.92500000000000004},"min":{"1min":0.65900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.157,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.93400000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.93899999999999995,"15min":0.95299999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2170000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.92800000000000005,"15min":0.91800000000000004},"min":{"1min":0.54600000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.1950000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.90800000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.97799999999999998,"15min":0.97199999999999998},"min":{"1min":0.67800000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.115},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1,"15min":0.99199999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.26,"5min":1.413,"15min":1.413},"last":1.0920000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.0309999999999999,"15min":1.054},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.26,"5min":1.506,"15min":1.506},"last":1.077},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.64500000000000002,"5min":0.625,"15min":0.625},"max":{"1min":1.3460000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.95799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32264,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1163264,"data_stored":493927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65400000000000003,"15min":0.66300000000000003},"min":{"1min":0.44500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.097,"5min":1.151,"15min":1.151},"last":0.629},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0589999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.85099999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64500000000000002,"15min":0.66400000000000003},"min":{"1min":0.47599999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81299999999999994,"5min":1.306,"15min":1.306},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.751,"15min":0.755},"min":{"1min":0.495,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.079,"5min":1.28,"15min":1.28},"last":0.73399999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78300000000000003,"15min":0.79000000000000004},"min":{"1min":0.497,"5min":0.308,"15min":0.308},"max":{"1min":1.1699999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.82599999999999996},"min":{"1min":0.50800000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1379999999999999,"5min":1.905,"15min":1.905},"last":0.59199999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2230000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0069999999999999,"15min":1.0329999999999999},"min":{"1min":0.71899999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.272,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.89100000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":1.03,"15min":1.0660000000000001},"min":{"1min":0.63600000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.179,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.998,"5min":1.0820000000000001,"15min":1.1100000000000001},"min":{"1min":0.83599999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.296,"5min":1.556,"15min":1.556},"last":1.0509999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0549999999999999,"15min":1.077},"min":{"1min":0.69099999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3580000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.028},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.109,"15min":1.1359999999999999},"min":{"1min":0.83299999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.327,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.006}]},{"osd":7,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1359999999999999,"15min":1.159},"min":{"1min":0.81000000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4359999999999999,"5min":1.712,"15min":1.712},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.80500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3169999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.0780000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1757184,"data_stored":1084295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69199999999999995,"15min":0.70899999999999996},"min":{"1min":0.434,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.92100000000000004,"5min":3.25,"15min":3.25},"last":1.411},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.77600000000000002,"15min":0.81000000000000005},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.103,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.629}]},{"osd":2,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71499999999999997,"15min":0.73699999999999999},"min":{"1min":0.55800000000000005,"5min":0.307,"15min":0.307},"max":{"1min":0.91600000000000004,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.81899999999999995,"15min":0.876},"min":{"1min":0.48399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0760000000000001,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.73299999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.79600000000000004,"15min":0.85699999999999998},"min":{"1min":0.439,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.016,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.89500000000000002,"15min":0.95499999999999996},"min":{"1min":0.50600000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98799999999999999,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":1.3149999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.97199999999999998,"15min":1.02},"min":{"1min":0.65800000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.095,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.024,"15min":1.0549999999999999},"min":{"1min":0.76600000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.379,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":1.526}]},{"osd":5,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.073},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.413,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.0529999999999999,"15min":1.105},"min":{"1min":0.76800000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.3049999999999999,"5min":5.399,"15min":5.399},"last":0.95399999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.121,"15min":1.153},"min":{"1min":0.84399999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.4530000000000001,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.4730000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.083,"15min":1.115},"min":{"1min":0.78100000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.51,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.91100000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.111,"15min":1.1299999999999999},"min":{"1min":0.78700000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4570000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.163,"15min":1.2170000000000001},"min":{"1min":0.79700000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.2889999999999999,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":0.77500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:10:32.656 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:10:32.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.765+0000 7f72a91b9700 1 Processor -- start 2024-09-13T17:10:32.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.765+0000 7f72a91b9700 1 -- start start 2024-09-13T17:10:32.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a91b9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72a415ed00 0x7f72a4161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a91b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f72a4161a80 0x7f72a40cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a91b9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a4162550 con 0x7f72a415e920 2024-09-13T17:10:32.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a91b9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a40cd690 con 0x7f72a415ed00 2024-09-13T17:10:32.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a91b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a4161f90 con 0x7f72a4161a80 2024-09-13T17:10:32.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72a415ed00 0x7f72a4161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a3fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f72a415e920 0x7f72a40caae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58162/0 (socket says 172.21.15.123:58162) 2024-09-13T17:10:32.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a3fff700 1 -- 172.21.15.123:0/3700598815 learned_addr learned my addr 172.21.15.123:0/3700598815 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:32.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72a415ed00 0x7f72a4161540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34274/0 (socket says 172.21.15.123:34274) 2024-09-13T17:10:32.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a89b8700 1 --2- 172.21.15.123:0/3700598815 >> v2:172.21.15.153:3300/0 conn(0x7f72a4161a80 0x7f72a40cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a37fe700 1 -- 172.21.15.123:0/3700598815 >> v2:172.21.15.153:3300/0 conn(0x7f72a4161a80 msgr2=0x7f72a40cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a37fe700 1 --2- 172.21.15.123:0/3700598815 >> v2:172.21.15.153:3300/0 conn(0x7f72a4161a80 0x7f72a40cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a37fe700 1 -- 172.21.15.123:0/3700598815 >> v1:172.21.15.123:6789/0 conn(0x7f72a415e920 legacy=0x7f72a40caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a2ffd700 1 -- 172.21.15.123:0/3700598815 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217980310 0 0) 0x7f72a4162550 con 0x7f72a415e920 2024-09-13T17:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a37fe700 1 -- 172.21.15.123:0/3700598815 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4162270 con 0x7f72a415ed00 2024-09-13T17:10:32.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a37fe700 1 --2- 172.21.15.123:0/3700598815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72a415ed00 0x7f72a4161540 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f72a40728e0 tx=0x7f728c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852ac5cae196202c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a2ffd700 1 -- 172.21.15.123:0/3700598815 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c011830 con 0x7f72a415ed00 2024-09-13T17:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a2ffd700 1 -- 172.21.15.123:0/3700598815 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728c011990 con 0x7f72a415ed00 2024-09-13T17:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a2ffd700 1 -- 172.21.15.123:0/3700598815 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c011d20 con 0x7f72a415ed00 2024-09-13T17:10:32.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a91b9700 1 -- 172.21.15.123:0/3700598815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72a415ed00 msgr2=0x7f72a4161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a91b9700 1 --2- 172.21.15.123:0/3700598815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72a415ed00 0x7f72a4161540 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f72a40728e0 tx=0x7f728c009b30 comp rx=0 tx=0).stop 2024-09-13T17:10:32.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a91b9700 1 -- 172.21.15.123:0/3700598815 shutdown_connections 2024-09-13T17:10:32.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a91b9700 1 --2- 172.21.15.123:0/3700598815 >> v2:172.21.15.153:3300/0 conn(0x7f72a4161a80 0x7f72a40cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a91b9700 1 --2- 172.21.15.123:0/3700598815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72a415ed00 0x7f72a4161540 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a91b9700 1 -- 172.21.15.123:0/3700598815 >> 172.21.15.123:0/3700598815 conn(0x7f72a4066150 msgr2=0x7f72a4066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:32.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a91b9700 1 -- 172.21.15.123:0/3700598815 shutdown_connections 2024-09-13T17:10:32.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.769+0000 7f72a91b9700 1 -- 172.21.15.123:0/3700598815 wait complete. 2024-09-13T17:10:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a91b9700 1 Processor -- start 2024-09-13T17:10:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a91b9700 1 -- start start 2024-09-13T17:10:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a91b9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72a415e920 0x7f72a4158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a91b9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72a415ed00 0x7f72a41eb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a91b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72a4161a80 0x7f72a41e74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a91b9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a41ea1e0 con 0x7f72a415e920 2024-09-13T17:10:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a91b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a4159560 con 0x7f72a4161a80 2024-09-13T17:10:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a91b9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a41ea3f0 con 0x7f72a415ed00 2024-09-13T17:10:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72a415e920 0x7f72a4158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72a415e920 0x7f72a4158a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34278/0 (socket says 172.21.15.123:34278) 2024-09-13T17:10:32.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a3fff700 1 -- 172.21.15.123:0/3507690995 learned_addr learned my addr 172.21.15.123:0/3507690995 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a89b8700 1 --2- 172.21.15.123:0/3507690995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72a4161a80 0x7f72a41e74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a37fe700 1 --2- 172.21.15.123:0/3507690995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72a415ed00 0x7f72a41eb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a3fff700 1 -- 172.21.15.123:0/3507690995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72a415ed00 msgr2=0x7f72a41eb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a3fff700 1 --2- 172.21.15.123:0/3507690995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72a415ed00 0x7f72a41eb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a3fff700 1 -- 172.21.15.123:0/3507690995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72a4161a80 msgr2=0x7f72a41e74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a3fff700 1 --2- 172.21.15.123:0/3507690995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72a4161a80 0x7f72a41e74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a3fff700 1 -- 172.21.15.123:0/3507690995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c0094b0 con 0x7f72a415e920 2024-09-13T17:10:32.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a3fff700 1 --2- 172.21.15.123:0/3507690995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72a415e920 0x7f72a4158a50 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f729400c580 tx=0x7f729400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:32.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a0ff9700 1 -- 172.21.15.123:0/3507690995 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294004ca0 con 0x7f72a415e920 2024-09-13T17:10:32.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a0ff9700 1 -- 172.21.15.123:0/3507690995 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7294004e20 con 0x7f72a415e920 2024-09-13T17:10:32.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a0ff9700 1 -- 172.21.15.123:0/3507690995 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294007310 con 0x7f72a415e920 2024-09-13T17:10:32.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a91b9700 1 -- 172.21.15.123:0/3507690995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a41ea6d0 con 0x7f72a415e920 2024-09-13T17:10:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.773+0000 7f72a91b9700 1 -- 172.21.15.123:0/3507690995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a41eac90 con 0x7f72a415e920 2024-09-13T17:10:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.777+0000 7f72a91b9700 1 -- 172.21.15.123:0/3507690995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a40677f0 con 0x7f72a415e920 2024-09-13T17:10:32.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.777+0000 7f72a0ff9700 1 -- 172.21.15.123:0/3507690995 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7294007470 con 0x7f72a415e920 2024-09-13T17:10:32.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.777+0000 7f72a0ff9700 1 --2- 172.21.15.123:0/3507690995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7288066730 0x7f7288068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:32.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.777+0000 7f72a0ff9700 1 -- 172.21.15.123:0/3507690995 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7294083e60 con 0x7f72a415e920 2024-09-13T17:10:32.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.777+0000 7f72a37fe700 1 --2- 172.21.15.123:0/3507690995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7288066730 0x7f7288068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:32.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.777+0000 7f72a37fe700 1 --2- 172.21.15.123:0/3507690995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7288066730 0x7f7288068bf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f728c0090b0 tx=0x7f728c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:32.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.785+0000 7f72a0ff9700 1 -- 172.21.15.123:0/3507690995 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7294051140 con 0x7f72a415e920 2024-09-13T17:10:32.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.953+0000 7f72a91b9700 1 -- 172.21.15.123:0/3507690995 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72a40cb1f0 con 0x7f7288066730 2024-09-13T17:10:32.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.969+0000 7f72a0ff9700 1 -- 172.21.15.123:0/3507690995 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288146 (secure 0 0 0) 0x7f728c011b80 con 0x7f7288066730 2024-09-13T17:10:32.974 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:32.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.973+0000 7f72a91b9700 1 -- 172.21.15.123:0/3507690995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7288066730 msgr2=0x7f7288068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.973+0000 7f72a91b9700 1 --2- 172.21.15.123:0/3507690995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7288066730 0x7f7288068bf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f728c0090b0 tx=0x7f728c008030 comp rx=0 tx=0).stop 2024-09-13T17:10:32.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.973+0000 7f72a91b9700 1 -- 172.21.15.123:0/3507690995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72a415e920 msgr2=0x7f72a4158a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:32.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.973+0000 7f72a91b9700 1 --2- 172.21.15.123:0/3507690995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72a415e920 0x7f72a4158a50 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f729400c580 tx=0x7f729400c890 comp rx=0 tx=0).stop 2024-09-13T17:10:32.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.973+0000 7f72a91b9700 1 -- 172.21.15.123:0/3507690995 shutdown_connections 2024-09-13T17:10:32.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.973+0000 7f72a91b9700 1 --2- 172.21.15.123:0/3507690995 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7288066730 0x7f7288068bf0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.973+0000 7f72a91b9700 1 --2- 172.21.15.123:0/3507690995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72a4161a80 0x7f72a41e74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.973+0000 7f72a91b9700 1 --2- 172.21.15.123:0/3507690995 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72a415ed00 0x7f72a41eb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.973+0000 7f72a91b9700 1 --2- 172.21.15.123:0/3507690995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72a415e920 0x7f72a4158a50 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:32.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.973+0000 7f72a91b9700 1 -- 172.21.15.123:0/3507690995 >> 172.21.15.123:0/3507690995 conn(0x7f72a4066150 msgr2=0x7f72a406cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:32.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.973+0000 7f72a91b9700 1 -- 172.21.15.123:0/3507690995 shutdown_connections 2024-09-13T17:10:32.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:32.973+0000 7f72a91b9700 1 -- 172.21.15.123:0/3507690995 wait complete. 2024-09-13T17:10:32.978 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:10:32.991 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2024-09-13T17:10:32.802596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251456,"kb_used_data":10696,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754723264,"statfs":{"total":773094113280,"available":772836622336,"internally_reserved":0,"allocated":10952704,"data_stored":5338212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.604770"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609316+0000","last_change":"2024-09-13T17:10:28.616231+0000","last_active":"2024-09-13T17:10:29.609316+0000","last_peered":"2024-09-13T17:10:29.609316+0000","last_clean":"2024-09-13T17:10:29.609316+0000","last_became_active":"2024-09-13T17:10:28.615919+0000","last_became_peered":"2024-09-13T17:10:28.615919+0000","last_unstale":"2024-09-13T17:10:29.609316+0000","last_undegraded":"2024-09-13T17:10:29.609316+0000","last_fullsized":"2024-09-13T17:10:29.609316+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:37.355876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953823+0000","last_change":"2024-09-13T17:10:28.616320+0000","last_active":"2024-09-13T17:10:29.953823+0000","last_peered":"2024-09-13T17:10:29.953823+0000","last_clean":"2024-09-13T17:10:29.953823+0000","last_became_active":"2024-09-13T17:10:28.615926+0000","last_became_peered":"2024-09-13T17:10:28.615926+0000","last_unstale":"2024-09-13T17:10:29.953823+0000","last_undegraded":"2024-09-13T17:10:29.953823+0000","last_fullsized":"2024-09-13T17:10:29.953823+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:04.602438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609973+0000","last_change":"2024-09-13T17:10:28.620081+0000","last_active":"2024-09-13T17:10:29.609973+0000","last_peered":"2024-09-13T17:10:29.609973+0000","last_clean":"2024-09-13T17:10:29.609973+0000","last_became_active":"2024-09-13T17:10:28.619841+0000","last_became_peered":"2024-09-13T17:10:28.619841+0000","last_unstale":"2024-09-13T17:10:29.609973+0000","last_undegraded":"2024-09-13T17:10:29.609973+0000","last_fullsized":"2024-09-13T17:10:29.609973+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:07.434778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.606316+0000","last_change":"2024-09-13T17:10:28.609906+0000","last_active":"2024-09-13T17:10:29.606316+0000","last_peered":"2024-09-13T17:10:29.606316+0000","last_clean":"2024-09-13T17:10:29.606316+0000","last_became_active":"2024-09-13T17:10:28.609663+0000","last_became_peered":"2024-09-13T17:10:28.609663+0000","last_unstale":"2024-09-13T17:10:29.606316+0000","last_undegraded":"2024-09-13T17:10:29.606316+0000","last_fullsized":"2024-09-13T17:10:29.606316+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:14.814541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952202+0000","last_change":"2024-09-13T17:10:28.615967+0000","last_active":"2024-09-13T17:10:29.952202+0000","last_peered":"2024-09-13T17:10:29.952202+0000","last_clean":"2024-09-13T17:10:29.952202+0000","last_became_active":"2024-09-13T17:10:28.615665+0000","last_became_peered":"2024-09-13T17:10:28.615665+0000","last_unstale":"2024-09-13T17:10:29.952202+0000","last_undegraded":"2024-09-13T17:10:29.952202+0000","last_fullsized":"2024-09-13T17:10:29.952202+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:14.814541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609521+0000","last_change":"2024-09-13T17:10:28.618457+0000","last_active":"2024-09-13T17:10:29.609521+0000","last_peered":"2024-09-13T17:10:29.609521+0000","last_clean":"2024-09-13T17:10:29.609521+0000","last_became_active":"2024-09-13T17:10:28.618090+0000","last_became_peered":"2024-09-13T17:10:28.618090+0000","last_unstale":"2024-09-13T17:10:29.609521+0000","last_undegraded":"2024-09-13T17:10:29.609521+0000","last_fullsized":"2024-09-13T17:10:29.609521+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:34.499791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609406+0000","last_change":"2024-09-13T17:10:28.616254+0000","last_active":"2024-09-13T17:10:29.609406+0000","last_peered":"2024-09-13T17:10:29.609406+0000","last_clean":"2024-09-13T17:10:29.609406+0000","last_became_active":"2024-09-13T17:10:28.616004+0000","last_became_peered":"2024-09-13T17:10:28.616004+0000","last_unstale":"2024-09-13T17:10:29.609406+0000","last_undegraded":"2024-09-13T17:10:29.609406+0000","last_fullsized":"2024-09-13T17:10:29.609406+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:13.474559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952556+0000","last_change":"2024-09-13T17:10:28.609016+0000","last_active":"2024-09-13T17:10:29.952556+0000","last_peered":"2024-09-13T17:10:29.952556+0000","last_clean":"2024-09-13T17:10:29.952556+0000","last_became_active":"2024-09-13T17:10:28.607168+0000","last_became_peered":"2024-09-13T17:10:28.607168+0000","last_unstale":"2024-09-13T17:10:29.952556+0000","last_undegraded":"2024-09-13T17:10:29.952556+0000","last_fullsized":"2024-09-13T17:10:29.952556+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:40.875788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952520+0000","last_change":"2024-09-13T17:10:28.603137+0000","last_active":"2024-09-13T17:10:29.952520+0000","last_peered":"2024-09-13T17:10:29.952520+0000","last_clean":"2024-09-13T17:10:29.952520+0000","last_became_active":"2024-09-13T17:10:28.602854+0000","last_became_peered":"2024-09-13T17:10:28.602854+0000","last_unstale":"2024-09-13T17:10:29.952520+0000","last_undegraded":"2024-09-13T17:10:29.952520+0000","last_fullsized":"2024-09-13T17:10:29.952520+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:56.515996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952516+0000","last_change":"2024-09-13T17:10:28.611486+0000","last_active":"2024-09-13T17:10:29.952516+0000","last_peered":"2024-09-13T17:10:29.952516+0000","last_clean":"2024-09-13T17:10:29.952516+0000","last_became_active":"2024-09-13T17:10:28.610991+0000","last_became_peered":"2024-09-13T17:10:28.610991+0000","last_unstale":"2024-09-13T17:10:29.952516+0000","last_undegraded":"2024-09-13T17:10:29.952516+0000","last_fullsized":"2024-09-13T17:10:29.952516+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:26.542815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609556+0000","last_change":"2024-09-13T17:10:28.604808+0000","last_active":"2024-09-13T17:10:29.609556+0000","last_peered":"2024-09-13T17:10:29.609556+0000","last_clean":"2024-09-13T17:10:29.609556+0000","last_became_active":"2024-09-13T17:10:28.603791+0000","last_became_peered":"2024-09-13T17:10:28.603791+0000","last_unstale":"2024-09-13T17:10:29.609556+0000","last_undegraded":"2024-09-13T17:10:29.609556+0000","last_fullsized":"2024-09-13T17:10:29.609556+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:02.682051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.951925+0000","last_change":"2024-09-13T17:10:28.611880+0000","last_active":"2024-09-13T17:10:29.951925+0000","last_peered":"2024-09-13T17:10:29.951925+0000","last_clean":"2024-09-13T17:10:29.951925+0000","last_became_active":"2024-09-13T17:10:28.611602+0000","last_became_peered":"2024-09-13T17:10:28.611602+0000","last_unstale":"2024-09-13T17:10:29.951925+0000","last_undegraded":"2024-09-13T17:10:29.951925+0000","last_fullsized":"2024-09-13T17:10:29.951925+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:08.567318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.605883+0000","last_change":"2024-09-13T17:10:28.604610+0000","last_active":"2024-09-13T17:10:29.605883+0000","last_peered":"2024-09-13T17:10:29.605883+0000","last_clean":"2024-09-13T17:10:29.605883+0000","last_became_active":"2024-09-13T17:10:28.603908+0000","last_became_peered":"2024-09-13T17:10:28.603908+0000","last_unstale":"2024-09-13T17:10:29.605883+0000","last_undegraded":"2024-09-13T17:10:29.605883+0000","last_fullsized":"2024-09-13T17:10:29.605883+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:29.485329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952705+0000","last_change":"2024-09-13T17:10:28.620913+0000","last_active":"2024-09-13T17:10:29.952705+0000","last_peered":"2024-09-13T17:10:29.952705+0000","last_clean":"2024-09-13T17:10:29.952705+0000","last_became_active":"2024-09-13T17:10:28.620632+0000","last_became_peered":"2024-09-13T17:10:28.620632+0000","last_unstale":"2024-09-13T17:10:29.952705+0000","last_undegraded":"2024-09-13T17:10:29.952705+0000","last_fullsized":"2024-09-13T17:10:29.952705+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:31.648744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.605734+0000","last_change":"2024-09-13T17:10:28.611290+0000","last_active":"2024-09-13T17:10:29.605734+0000","last_peered":"2024-09-13T17:10:29.605734+0000","last_clean":"2024-09-13T17:10:29.605734+0000","last_became_active":"2024-09-13T17:10:28.611046+0000","last_became_peered":"2024-09-13T17:10:28.611046+0000","last_unstale":"2024-09-13T17:10:29.605734+0000","last_undegraded":"2024-09-13T17:10:29.605734+0000","last_fullsized":"2024-09-13T17:10:29.605734+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:49.022561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609332+0000","last_change":"2024-09-13T17:10:28.618906+0000","last_active":"2024-09-13T17:10:29.609332+0000","last_peered":"2024-09-13T17:10:29.609332+0000","last_clean":"2024-09-13T17:10:29.609332+0000","last_became_active":"2024-09-13T17:10:28.617883+0000","last_became_peered":"2024-09-13T17:10:28.617883+0000","last_unstale":"2024-09-13T17:10:29.609332+0000","last_undegraded":"2024-09-13T17:10:29.609332+0000","last_fullsized":"2024-09-13T17:10:29.609332+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:06.600618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953294+0000","last_change":"2024-09-13T17:10:28.604379+0000","last_active":"2024-09-13T17:10:29.953294+0000","last_peered":"2024-09-13T17:10:29.953294+0000","last_clean":"2024-09-13T17:10:29.953294+0000","last_became_active":"2024-09-13T17:10:28.604137+0000","last_became_peered":"2024-09-13T17:10:28.604137+0000","last_unstale":"2024-09-13T17:10:29.953294+0000","last_undegraded":"2024-09-13T17:10:29.953294+0000","last_fullsized":"2024-09-13T17:10:29.953294+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:12.557260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.606137+0000","last_change":"2024-09-13T17:10:28.611191+0000","last_active":"2024-09-13T17:10:29.606137+0000","last_peered":"2024-09-13T17:10:29.606137+0000","last_clean":"2024-09-13T17:10:29.606137+0000","last_became_active":"2024-09-13T17:10:28.610946+0000","last_became_peered":"2024-09-13T17:10:28.610946+0000","last_unstale":"2024-09-13T17:10:29.606137+0000","last_undegraded":"2024-09-13T17:10:29.606137+0000","last_fullsized":"2024-09-13T17:10:29.606137+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:06.135450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.954634+0000","last_change":"2024-09-13T17:10:28.616464+0000","last_active":"2024-09-13T17:10:29.954634+0000","last_peered":"2024-09-13T17:10:29.954634+0000","last_clean":"2024-09-13T17:10:29.954634+0000","last_became_active":"2024-09-13T17:10:28.616202+0000","last_became_peered":"2024-09-13T17:10:28.616202+0000","last_unstale":"2024-09-13T17:10:29.954634+0000","last_undegraded":"2024-09-13T17:10:29.954634+0000","last_fullsized":"2024-09-13T17:10:29.954634+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:07.279478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952110+0000","last_change":"2024-09-13T17:10:28.603018+0000","last_active":"2024-09-13T17:10:29.952110+0000","last_peered":"2024-09-13T17:10:29.952110+0000","last_clean":"2024-09-13T17:10:29.952110+0000","last_became_active":"2024-09-13T17:10:28.602595+0000","last_became_peered":"2024-09-13T17:10:28.602595+0000","last_unstale":"2024-09-13T17:10:29.952110+0000","last_undegraded":"2024-09-13T17:10:29.952110+0000","last_fullsized":"2024-09-13T17:10:29.952110+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:02.540519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.954392+0000","last_change":"2024-09-13T17:10:28.617363+0000","last_active":"2024-09-13T17:10:29.954392+0000","last_peered":"2024-09-13T17:10:29.954392+0000","last_clean":"2024-09-13T17:10:29.954392+0000","last_became_active":"2024-09-13T17:10:28.617098+0000","last_became_peered":"2024-09-13T17:10:28.617098+0000","last_unstale":"2024-09-13T17:10:29.954392+0000","last_undegraded":"2024-09-13T17:10:29.954392+0000","last_fullsized":"2024-09-13T17:10:29.954392+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:13.616547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953251+0000","last_change":"2024-09-13T17:10:28.619528+0000","last_active":"2024-09-13T17:10:29.953251+0000","last_peered":"2024-09-13T17:10:29.953251+0000","last_clean":"2024-09-13T17:10:29.953251+0000","last_became_active":"2024-09-13T17:10:28.619320+0000","last_became_peered":"2024-09-13T17:10:28.619320+0000","last_unstale":"2024-09-13T17:10:29.953251+0000","last_undegraded":"2024-09-13T17:10:29.953251+0000","last_fullsized":"2024-09-13T17:10:29.953251+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:28.382757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952678+0000","last_change":"2024-09-13T17:10:28.620173+0000","last_active":"2024-09-13T17:10:29.952678+0000","last_peered":"2024-09-13T17:10:29.952678+0000","last_clean":"2024-09-13T17:10:29.952678+0000","last_became_active":"2024-09-13T17:10:28.619950+0000","last_became_peered":"2024-09-13T17:10:28.619950+0000","last_unstale":"2024-09-13T17:10:29.952678+0000","last_undegraded":"2024-09-13T17:10:29.952678+0000","last_fullsized":"2024-09-13T17:10:29.952678+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:34.364832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609448+0000","last_change":"2024-09-13T17:10:28.611127+0000","last_active":"2024-09-13T17:10:29.609448+0000","last_peered":"2024-09-13T17:10:29.609448+0000","last_clean":"2024-09-13T17:10:29.609448+0000","last_became_active":"2024-09-13T17:10:28.610852+0000","last_became_peered":"2024-09-13T17:10:28.610852+0000","last_unstale":"2024-09-13T17:10:29.609448+0000","last_undegraded":"2024-09-13T17:10:29.609448+0000","last_fullsized":"2024-09-13T17:10:29.609448+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:09.428539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953429+0000","last_change":"2024-09-13T17:10:28.617732+0000","last_active":"2024-09-13T17:10:29.953429+0000","last_peered":"2024-09-13T17:10:29.953429+0000","last_clean":"2024-09-13T17:10:29.953429+0000","last_became_active":"2024-09-13T17:10:28.617264+0000","last_became_peered":"2024-09-13T17:10:28.617264+0000","last_unstale":"2024-09-13T17:10:29.953429+0000","last_undegraded":"2024-09-13T17:10:29.953429+0000","last_fullsized":"2024-09-13T17:10:29.953429+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:08.567318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953885+0000","last_change":"2024-09-13T17:10:28.614411+0000","last_active":"2024-09-13T17:10:29.953885+0000","last_peered":"2024-09-13T17:10:29.953885+0000","last_clean":"2024-09-13T17:10:29.953885+0000","last_became_active":"2024-09-13T17:10:28.614170+0000","last_became_peered":"2024-09-13T17:10:28.614170+0000","last_unstale":"2024-09-13T17:10:29.953885+0000","last_undegraded":"2024-09-13T17:10:29.953885+0000","last_fullsized":"2024-09-13T17:10:29.953885+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:02.321066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609688+0000","last_change":"2024-09-13T17:10:28.608739+0000","last_active":"2024-09-13T17:10:29.609688+0000","last_peered":"2024-09-13T17:10:29.609688+0000","last_clean":"2024-09-13T17:10:29.609688+0000","last_became_active":"2024-09-13T17:10:28.608472+0000","last_became_peered":"2024-09-13T17:10:28.608472+0000","last_unstale":"2024-09-13T17:10:29.609688+0000","last_undegraded":"2024-09-13T17:10:29.609688+0000","last_fullsized":"2024-09-13T17:10:29.609688+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:47.659508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952895+0000","last_change":"2024-09-13T17:10:28.616809+0000","last_active":"2024-09-13T17:10:29.952895+0000","last_peered":"2024-09-13T17:10:29.952895+0000","last_clean":"2024-09-13T17:10:29.952895+0000","last_became_active":"2024-09-13T17:10:28.616136+0000","last_became_peered":"2024-09-13T17:10:28.616136+0000","last_unstale":"2024-09-13T17:10:29.952895+0000","last_undegraded":"2024-09-13T17:10:29.952895+0000","last_fullsized":"2024-09-13T17:10:29.952895+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:27.363330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952929+0000","last_change":"2024-09-13T17:10:28.613915+0000","last_active":"2024-09-13T17:10:29.952929+0000","last_peered":"2024-09-13T17:10:29.952929+0000","last_clean":"2024-09-13T17:10:29.952929+0000","last_became_active":"2024-09-13T17:10:28.613679+0000","last_became_peered":"2024-09-13T17:10:28.613679+0000","last_unstale":"2024-09-13T17:10:29.952929+0000","last_undegraded":"2024-09-13T17:10:29.952929+0000","last_fullsized":"2024-09-13T17:10:29.952929+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:30.259407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952971+0000","last_change":"2024-09-13T17:10:28.612661+0000","last_active":"2024-09-13T17:10:29.952971+0000","last_peered":"2024-09-13T17:10:29.952971+0000","last_clean":"2024-09-13T17:10:29.952971+0000","last_became_active":"2024-09-13T17:10:28.611643+0000","last_became_peered":"2024-09-13T17:10:28.611643+0000","last_unstale":"2024-09-13T17:10:29.952971+0000","last_undegraded":"2024-09-13T17:10:29.952971+0000","last_fullsized":"2024-09-13T17:10:29.952971+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:01.166822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.605737+0000","last_change":"2024-09-13T17:10:28.608955+0000","last_active":"2024-09-13T17:10:29.605737+0000","last_peered":"2024-09-13T17:10:29.605737+0000","last_clean":"2024-09-13T17:10:29.605737+0000","last_became_active":"2024-09-13T17:10:28.608706+0000","last_became_peered":"2024-09-13T17:10:28.608706+0000","last_unstale":"2024-09-13T17:10:29.605737+0000","last_undegraded":"2024-09-13T17:10:29.605737+0000","last_fullsized":"2024-09-13T17:10:29.605737+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:08.567318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.608860+0000","last_change":"2024-09-13T17:10:28.618147+0000","last_active":"2024-09-13T17:10:29.608860+0000","last_peered":"2024-09-13T17:10:29.608860+0000","last_clean":"2024-09-13T17:10:29.608860+0000","last_became_active":"2024-09-13T17:10:28.617887+0000","last_became_peered":"2024-09-13T17:10:28.617887+0000","last_unstale":"2024-09-13T17:10:29.608860+0000","last_undegraded":"2024-09-13T17:10:29.608860+0000","last_fullsized":"2024-09-13T17:10:29.608860+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:44.927567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.954995+0000","last_change":"2024-09-13T17:10:28.616984+0000","last_active":"2024-09-13T17:10:29.954995+0000","last_peered":"2024-09-13T17:10:29.954995+0000","last_clean":"2024-09-13T17:10:29.954995+0000","last_became_active":"2024-09-13T17:10:28.616583+0000","last_became_peered":"2024-09-13T17:10:28.616583+0000","last_unstale":"2024-09-13T17:10:29.954995+0000","last_undegraded":"2024-09-13T17:10:29.954995+0000","last_fullsized":"2024-09-13T17:10:29.954995+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:50.677255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"97'4","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953409+0000","last_change":"2024-09-13T17:10:28.228887+0000","last_active":"2024-09-13T17:10:29.953409+0000","last_peered":"2024-09-13T17:10:29.953409+0000","last_clean":"2024-09-13T17:10:29.953409+0000","last_became_active":"2024-09-13T17:10:28.227653+0000","last_became_peered":"2024-09-13T17:10:28.227653+0000","last_unstale":"2024-09-13T17:10:29.953409+0000","last_undegraded":"2024-09-13T17:10:29.953409+0000","last_fullsized":"2024-09-13T17:10:29.953409+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:28.475484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.606789+0000","last_change":"2024-09-13T17:10:28.609035+0000","last_active":"2024-09-13T17:10:29.606789+0000","last_peered":"2024-09-13T17:10:29.606789+0000","last_clean":"2024-09-13T17:10:29.606789+0000","last_became_active":"2024-09-13T17:10:28.608751+0000","last_became_peered":"2024-09-13T17:10:28.608751+0000","last_unstale":"2024-09-13T17:10:29.606789+0000","last_undegraded":"2024-09-13T17:10:29.606789+0000","last_fullsized":"2024-09-13T17:10:29.606789+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:55.958937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"97'1","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.610080+0000","last_change":"2024-09-13T17:10:28.232265+0000","last_active":"2024-09-13T17:10:29.610080+0000","last_peered":"2024-09-13T17:10:29.610080+0000","last_clean":"2024-09-13T17:10:29.610080+0000","last_became_active":"2024-09-13T17:10:28.232057+0000","last_became_peered":"2024-09-13T17:10:28.232057+0000","last_unstale":"2024-09-13T17:10:29.610080+0000","last_undegraded":"2024-09-13T17:10:29.610080+0000","last_fullsized":"2024-09-13T17:10:29.610080+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:01.530674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609623+0000","last_change":"2024-09-13T17:10:28.614969+0000","last_active":"2024-09-13T17:10:29.609623+0000","last_peered":"2024-09-13T17:10:29.609623+0000","last_clean":"2024-09-13T17:10:29.609623+0000","last_became_active":"2024-09-13T17:10:28.614699+0000","last_became_peered":"2024-09-13T17:10:28.614699+0000","last_unstale":"2024-09-13T17:10:29.609623+0000","last_undegraded":"2024-09-13T17:10:29.609623+0000","last_fullsized":"2024-09-13T17:10:29.609623+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:48.552978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"97'2","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952976+0000","last_change":"2024-09-13T17:10:28.231904+0000","last_active":"2024-09-13T17:10:29.952976+0000","last_peered":"2024-09-13T17:10:29.952976+0000","last_clean":"2024-09-13T17:10:29.952976+0000","last_became_active":"2024-09-13T17:10:28.231648+0000","last_became_peered":"2024-09-13T17:10:28.231648+0000","last_unstale":"2024-09-13T17:10:29.952976+0000","last_undegraded":"2024-09-13T17:10:29.952976+0000","last_fullsized":"2024-09-13T17:10:29.952976+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:09.530033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952950+0000","last_change":"2024-09-13T17:10:28.617508+0000","last_active":"2024-09-13T17:10:29.952950+0000","last_peered":"2024-09-13T17:10:29.952950+0000","last_clean":"2024-09-13T17:10:29.952950+0000","last_became_active":"2024-09-13T17:10:28.617209+0000","last_became_peered":"2024-09-13T17:10:28.617209+0000","last_unstale":"2024-09-13T17:10:29.952950+0000","last_undegraded":"2024-09-13T17:10:29.952950+0000","last_fullsized":"2024-09-13T17:10:29.952950+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:29.485329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"97'2","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953376+0000","last_change":"2024-09-13T17:10:28.228838+0000","last_active":"2024-09-13T17:10:29.953376+0000","last_peered":"2024-09-13T17:10:29.953376+0000","last_clean":"2024-09-13T17:10:29.953376+0000","last_became_active":"2024-09-13T17:10:28.228276+0000","last_became_peered":"2024-09-13T17:10:28.228276+0000","last_unstale":"2024-09-13T17:10:29.953376+0000","last_undegraded":"2024-09-13T17:10:29.953376+0000","last_fullsized":"2024-09-13T17:10:29.953376+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:05.125604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.856059+0000","last_change":"2024-09-13T17:10:28.624741+0000","last_active":"2024-09-13T17:10:29.856059+0000","last_peered":"2024-09-13T17:10:29.856059+0000","last_clean":"2024-09-13T17:10:29.856059+0000","last_became_active":"2024-09-13T17:10:28.624374+0000","last_became_peered":"2024-09-13T17:10:28.624374+0000","last_unstale":"2024-09-13T17:10:29.856059+0000","last_undegraded":"2024-09-13T17:10:29.856059+0000","last_fullsized":"2024-09-13T17:10:29.856059+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:10.744975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"97'1","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609286+0000","last_change":"2024-09-13T17:10:28.227968+0000","last_active":"2024-09-13T17:10:29.609286+0000","last_peered":"2024-09-13T17:10:29.609286+0000","last_clean":"2024-09-13T17:10:29.609286+0000","last_became_active":"2024-09-13T17:10:28.227731+0000","last_became_peered":"2024-09-13T17:10:28.227731+0000","last_unstale":"2024-09-13T17:10:29.609286+0000","last_undegraded":"2024-09-13T17:10:29.609286+0000","last_fullsized":"2024-09-13T17:10:29.609286+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:00.156977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609542+0000","last_change":"2024-09-13T17:10:28.607953+0000","last_active":"2024-09-13T17:10:29.609542+0000","last_peered":"2024-09-13T17:10:29.609542+0000","last_clean":"2024-09-13T17:10:29.609542+0000","last_became_active":"2024-09-13T17:10:28.607681+0000","last_became_peered":"2024-09-13T17:10:28.607681+0000","last_unstale":"2024-09-13T17:10:29.609542+0000","last_undegraded":"2024-09-13T17:10:29.609542+0000","last_fullsized":"2024-09-13T17:10:29.609542+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:59.348450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"97'1","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953479+0000","last_change":"2024-09-13T17:10:28.231078+0000","last_active":"2024-09-13T17:10:29.953479+0000","last_peered":"2024-09-13T17:10:29.953479+0000","last_clean":"2024-09-13T17:10:29.953479+0000","last_became_active":"2024-09-13T17:10:28.230827+0000","last_became_peered":"2024-09-13T17:10:28.230827+0000","last_unstale":"2024-09-13T17:10:29.953479+0000","last_undegraded":"2024-09-13T17:10:29.953479+0000","last_fullsized":"2024-09-13T17:10:29.953479+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:56.404399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.605622+0000","last_change":"2024-09-13T17:10:28.612970+0000","last_active":"2024-09-13T17:10:29.605622+0000","last_peered":"2024-09-13T17:10:29.605622+0000","last_clean":"2024-09-13T17:10:29.605622+0000","last_became_active":"2024-09-13T17:10:28.612687+0000","last_became_peered":"2024-09-13T17:10:28.612687+0000","last_unstale":"2024-09-13T17:10:29.605622+0000","last_undegraded":"2024-09-13T17:10:29.605622+0000","last_fullsized":"2024-09-13T17:10:29.605622+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:26.542815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952201+0000","last_change":"2024-09-13T17:10:28.224208+0000","last_active":"2024-09-13T17:10:29.952201+0000","last_peered":"2024-09-13T17:10:29.952201+0000","last_clean":"2024-09-13T17:10:29.952201+0000","last_became_active":"2024-09-13T17:10:28.223917+0000","last_became_peered":"2024-09-13T17:10:28.223917+0000","last_unstale":"2024-09-13T17:10:29.952201+0000","last_undegraded":"2024-09-13T17:10:29.952201+0000","last_fullsized":"2024-09-13T17:10:29.952201+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:20.411061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.951545+0000","last_change":"2024-09-13T17:10:28.621333+0000","last_active":"2024-09-13T17:10:29.951545+0000","last_peered":"2024-09-13T17:10:29.951545+0000","last_clean":"2024-09-13T17:10:29.951545+0000","last_became_active":"2024-09-13T17:10:28.618358+0000","last_became_peered":"2024-09-13T17:10:28.618358+0000","last_unstale":"2024-09-13T17:10:29.951545+0000","last_undegraded":"2024-09-13T17:10:29.951545+0000","last_fullsized":"2024-09-13T17:10:29.951545+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:26.542815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609091+0000","last_change":"2024-09-13T17:10:28.229850+0000","last_active":"2024-09-13T17:10:29.609091+0000","last_peered":"2024-09-13T17:10:29.609091+0000","last_clean":"2024-09-13T17:10:29.609091+0000","last_became_active":"2024-09-13T17:10:28.229597+0000","last_became_peered":"2024-09-13T17:10:28.229597+0000","last_unstale":"2024-09-13T17:10:29.609091+0000","last_undegraded":"2024-09-13T17:10:29.609091+0000","last_fullsized":"2024-09-13T17:10:29.609091+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:07.118917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.954038+0000","last_change":"2024-09-13T17:10:28.614996+0000","last_active":"2024-09-13T17:10:29.954038+0000","last_peered":"2024-09-13T17:10:29.954038+0000","last_clean":"2024-09-13T17:10:29.954038+0000","last_became_active":"2024-09-13T17:10:28.614743+0000","last_became_peered":"2024-09-13T17:10:28.614743+0000","last_unstale":"2024-09-13T17:10:29.954038+0000","last_undegraded":"2024-09-13T17:10:29.954038+0000","last_fullsized":"2024-09-13T17:10:29.954038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:59.909949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609533+0000","last_change":"2024-09-13T17:10:28.226276+0000","last_active":"2024-09-13T17:10:29.609533+0000","last_peered":"2024-09-13T17:10:29.609533+0000","last_clean":"2024-09-13T17:10:29.609533+0000","last_became_active":"2024-09-13T17:10:28.225925+0000","last_became_peered":"2024-09-13T17:10:28.225925+0000","last_unstale":"2024-09-13T17:10:29.609533+0000","last_undegraded":"2024-09-13T17:10:29.609533+0000","last_fullsized":"2024-09-13T17:10:29.609533+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:51.189919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952774+0000","last_change":"2024-09-13T17:10:28.621858+0000","last_active":"2024-09-13T17:10:29.952774+0000","last_peered":"2024-09-13T17:10:29.952774+0000","last_clean":"2024-09-13T17:10:29.952774+0000","last_became_active":"2024-09-13T17:10:28.621072+0000","last_became_peered":"2024-09-13T17:10:28.621072+0000","last_unstale":"2024-09-13T17:10:29.952774+0000","last_undegraded":"2024-09-13T17:10:29.952774+0000","last_fullsized":"2024-09-13T17:10:29.952774+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:55.958937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.606260+0000","last_change":"2024-09-13T17:10:28.233648+0000","last_active":"2024-09-13T17:10:29.606260+0000","last_peered":"2024-09-13T17:10:29.606260+0000","last_clean":"2024-09-13T17:10:29.606260+0000","last_became_active":"2024-09-13T17:10:28.233405+0000","last_became_peered":"2024-09-13T17:10:28.233405+0000","last_unstale":"2024-09-13T17:10:29.606260+0000","last_undegraded":"2024-09-13T17:10:29.606260+0000","last_fullsized":"2024-09-13T17:10:29.606260+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:04.677353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953011+0000","last_change":"2024-09-13T17:10:28.617002+0000","last_active":"2024-09-13T17:10:29.953011+0000","last_peered":"2024-09-13T17:10:29.953011+0000","last_clean":"2024-09-13T17:10:29.953011+0000","last_became_active":"2024-09-13T17:10:28.616503+0000","last_became_peered":"2024-09-13T17:10:28.616503+0000","last_unstale":"2024-09-13T17:10:29.953011+0000","last_undegraded":"2024-09-13T17:10:29.953011+0000","last_fullsized":"2024-09-13T17:10:29.953011+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:55.958937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"97'3","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609994+0000","last_change":"2024-09-13T17:10:28.227599+0000","last_active":"2024-09-13T17:10:29.609994+0000","last_peered":"2024-09-13T17:10:29.609994+0000","last_clean":"2024-09-13T17:10:29.609994+0000","last_became_active":"2024-09-13T17:10:28.227326+0000","last_became_peered":"2024-09-13T17:10:28.227326+0000","last_unstale":"2024-09-13T17:10:29.609994+0000","last_undegraded":"2024-09-13T17:10:29.609994+0000","last_fullsized":"2024-09-13T17:10:29.609994+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:28.475484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609765+0000","last_change":"2024-09-13T17:10:28.615976+0000","last_active":"2024-09-13T17:10:29.609765+0000","last_peered":"2024-09-13T17:10:29.609765+0000","last_clean":"2024-09-13T17:10:29.609765+0000","last_became_active":"2024-09-13T17:10:28.615687+0000","last_became_peered":"2024-09-13T17:10:28.615687+0000","last_unstale":"2024-09-13T17:10:29.609765+0000","last_undegraded":"2024-09-13T17:10:29.609765+0000","last_fullsized":"2024-09-13T17:10:29.609765+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:20.134564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"97'6","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952248+0000","last_change":"2024-09-13T17:10:28.226642+0000","last_active":"2024-09-13T17:10:29.952248+0000","last_peered":"2024-09-13T17:10:29.952248+0000","last_clean":"2024-09-13T17:10:29.952248+0000","last_became_active":"2024-09-13T17:10:28.226419+0000","last_became_peered":"2024-09-13T17:10:28.226419+0000","last_unstale":"2024-09-13T17:10:29.952248+0000","last_undegraded":"2024-09-13T17:10:29.952248+0000","last_fullsized":"2024-09-13T17:10:29.952248+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:43.917721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.605830+0000","last_change":"2024-09-13T17:10:28.606077+0000","last_active":"2024-09-13T17:10:29.605830+0000","last_peered":"2024-09-13T17:10:29.605830+0000","last_clean":"2024-09-13T17:10:29.605830+0000","last_became_active":"2024-09-13T17:10:28.605808+0000","last_became_peered":"2024-09-13T17:10:28.605808+0000","last_unstale":"2024-09-13T17:10:29.605830+0000","last_undegraded":"2024-09-13T17:10:29.605830+0000","last_fullsized":"2024-09-13T17:10:29.605830+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:02.540519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"97'2","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.954654+0000","last_change":"2024-09-13T17:10:28.230334+0000","last_active":"2024-09-13T17:10:29.954654+0000","last_peered":"2024-09-13T17:10:29.954654+0000","last_clean":"2024-09-13T17:10:29.954654+0000","last_became_active":"2024-09-13T17:10:28.230085+0000","last_became_peered":"2024-09-13T17:10:28.230085+0000","last_unstale":"2024-09-13T17:10:29.954654+0000","last_undegraded":"2024-09-13T17:10:29.954654+0000","last_fullsized":"2024-09-13T17:10:29.954654+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:20.880809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609183+0000","last_change":"2024-09-13T17:10:28.618086+0000","last_active":"2024-09-13T17:10:29.609183+0000","last_peered":"2024-09-13T17:10:29.609183+0000","last_clean":"2024-09-13T17:10:29.609183+0000","last_became_active":"2024-09-13T17:10:28.617685+0000","last_became_peered":"2024-09-13T17:10:28.617685+0000","last_unstale":"2024-09-13T17:10:29.609183+0000","last_undegraded":"2024-09-13T17:10:29.609183+0000","last_fullsized":"2024-09-13T17:10:29.609183+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:10.744975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.954048+0000","last_change":"2024-09-13T17:10:28.234629+0000","last_active":"2024-09-13T17:10:29.954048+0000","last_peered":"2024-09-13T17:10:29.954048+0000","last_clean":"2024-09-13T17:10:29.954048+0000","last_became_active":"2024-09-13T17:10:28.234208+0000","last_became_peered":"2024-09-13T17:10:28.234208+0000","last_unstale":"2024-09-13T17:10:29.954048+0000","last_undegraded":"2024-09-13T17:10:29.954048+0000","last_fullsized":"2024-09-13T17:10:29.954048+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:34.460240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.951415+0000","last_change":"2024-09-13T17:10:28.615284+0000","last_active":"2024-09-13T17:10:29.951415+0000","last_peered":"2024-09-13T17:10:29.951415+0000","last_clean":"2024-09-13T17:10:29.951415+0000","last_became_active":"2024-09-13T17:10:28.614492+0000","last_became_peered":"2024-09-13T17:10:28.614492+0000","last_unstale":"2024-09-13T17:10:29.951415+0000","last_undegraded":"2024-09-13T17:10:29.951415+0000","last_fullsized":"2024-09-13T17:10:29.951415+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:10.539879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.951748+0000","last_change":"2024-09-13T17:10:28.226550+0000","last_active":"2024-09-13T17:10:29.951748+0000","last_peered":"2024-09-13T17:10:29.951748+0000","last_clean":"2024-09-13T17:10:29.951748+0000","last_became_active":"2024-09-13T17:10:28.226285+0000","last_became_peered":"2024-09-13T17:10:28.226285+0000","last_unstale":"2024-09-13T17:10:29.951748+0000","last_undegraded":"2024-09-13T17:10:29.951748+0000","last_fullsized":"2024-09-13T17:10:29.951748+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:13.061554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953688+0000","last_change":"2024-09-13T17:10:28.608485+0000","last_active":"2024-09-13T17:10:29.953688+0000","last_peered":"2024-09-13T17:10:29.953688+0000","last_clean":"2024-09-13T17:10:29.953688+0000","last_became_active":"2024-09-13T17:10:28.608230+0000","last_became_peered":"2024-09-13T17:10:28.608230+0000","last_unstale":"2024-09-13T17:10:29.953688+0000","last_undegraded":"2024-09-13T17:10:29.953688+0000","last_fullsized":"2024-09-13T17:10:29.953688+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:12.341493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"97'8","reported_seq":19,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609245+0000","last_change":"2024-09-13T17:10:28.226461+0000","last_active":"2024-09-13T17:10:29.609245+0000","last_peered":"2024-09-13T17:10:29.609245+0000","last_clean":"2024-09-13T17:10:29.609245+0000","last_became_active":"2024-09-13T17:10:28.225533+0000","last_became_peered":"2024-09-13T17:10:28.225533+0000","last_unstale":"2024-09-13T17:10:29.609245+0000","last_undegraded":"2024-09-13T17:10:29.609245+0000","last_fullsized":"2024-09-13T17:10:29.609245+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:05.636098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953641+0000","last_change":"2024-09-13T17:10:28.615017+0000","last_active":"2024-09-13T17:10:29.953641+0000","last_peered":"2024-09-13T17:10:29.953641+0000","last_clean":"2024-09-13T17:10:29.953641+0000","last_became_active":"2024-09-13T17:10:28.614756+0000","last_became_peered":"2024-09-13T17:10:28.614756+0000","last_unstale":"2024-09-13T17:10:29.953641+0000","last_undegraded":"2024-09-13T17:10:29.953641+0000","last_fullsized":"2024-09-13T17:10:29.953641+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:10.976198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"97'2","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952095+0000","last_change":"2024-09-13T17:10:28.231766+0000","last_active":"2024-09-13T17:10:29.952095+0000","last_peered":"2024-09-13T17:10:29.952095+0000","last_clean":"2024-09-13T17:10:29.952095+0000","last_became_active":"2024-09-13T17:10:28.231435+0000","last_became_peered":"2024-09-13T17:10:28.231435+0000","last_unstale":"2024-09-13T17:10:29.952095+0000","last_undegraded":"2024-09-13T17:10:29.952095+0000","last_fullsized":"2024-09-13T17:10:29.952095+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:33.934132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.856001+0000","last_change":"2024-09-13T17:10:28.622061+0000","last_active":"2024-09-13T17:10:29.856001+0000","last_peered":"2024-09-13T17:10:29.856001+0000","last_clean":"2024-09-13T17:10:29.856001+0000","last_became_active":"2024-09-13T17:10:28.621824+0000","last_became_peered":"2024-09-13T17:10:28.621824+0000","last_unstale":"2024-09-13T17:10:29.856001+0000","last_undegraded":"2024-09-13T17:10:29.856001+0000","last_fullsized":"2024-09-13T17:10:29.856001+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:44.927567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"97'1","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.954240+0000","last_change":"2024-09-13T17:10:28.223603+0000","last_active":"2024-09-13T17:10:29.954240+0000","last_peered":"2024-09-13T17:10:29.954240+0000","last_clean":"2024-09-13T17:10:29.954240+0000","last_became_active":"2024-09-13T17:10:28.223174+0000","last_became_peered":"2024-09-13T17:10:28.223174+0000","last_unstale":"2024-09-13T17:10:29.954240+0000","last_undegraded":"2024-09-13T17:10:29.954240+0000","last_fullsized":"2024-09-13T17:10:29.954240+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:33.934132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609810+0000","last_change":"2024-09-13T17:10:28.607778+0000","last_active":"2024-09-13T17:10:29.609810+0000","last_peered":"2024-09-13T17:10:29.609810+0000","last_clean":"2024-09-13T17:10:29.609810+0000","last_became_active":"2024-09-13T17:10:28.607508+0000","last_became_peered":"2024-09-13T17:10:28.607508+0000","last_unstale":"2024-09-13T17:10:29.609810+0000","last_undegraded":"2024-09-13T17:10:29.609810+0000","last_fullsized":"2024-09-13T17:10:29.609810+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:17.769733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953641+0000","last_change":"2024-09-13T17:10:28.228991+0000","last_active":"2024-09-13T17:10:29.953641+0000","last_peered":"2024-09-13T17:10:29.953641+0000","last_clean":"2024-09-13T17:10:29.953641+0000","last_became_active":"2024-09-13T17:10:28.228609+0000","last_became_peered":"2024-09-13T17:10:28.228609+0000","last_unstale":"2024-09-13T17:10:29.953641+0000","last_undegraded":"2024-09-13T17:10:29.953641+0000","last_fullsized":"2024-09-13T17:10:29.953641+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:13.804695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953775+0000","last_change":"2024-09-13T17:10:28.617834+0000","last_active":"2024-09-13T17:10:29.953775+0000","last_peered":"2024-09-13T17:10:29.953775+0000","last_clean":"2024-09-13T17:10:29.953775+0000","last_became_active":"2024-09-13T17:10:28.617619+0000","last_became_peered":"2024-09-13T17:10:28.617619+0000","last_unstale":"2024-09-13T17:10:29.953775+0000","last_undegraded":"2024-09-13T17:10:29.953775+0000","last_fullsized":"2024-09-13T17:10:29.953775+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:08.128763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"97'2","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953172+0000","last_change":"2024-09-13T17:10:28.232661+0000","last_active":"2024-09-13T17:10:29.953172+0000","last_peered":"2024-09-13T17:10:29.953172+0000","last_clean":"2024-09-13T17:10:29.953172+0000","last_became_active":"2024-09-13T17:10:28.232423+0000","last_became_peered":"2024-09-13T17:10:28.232423+0000","last_unstale":"2024-09-13T17:10:29.953172+0000","last_undegraded":"2024-09-13T17:10:29.953172+0000","last_fullsized":"2024-09-13T17:10:29.953172+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:26.353484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.954345+0000","last_change":"2024-09-13T17:10:28.618689+0000","last_active":"2024-09-13T17:10:29.954345+0000","last_peered":"2024-09-13T17:10:29.954345+0000","last_clean":"2024-09-13T17:10:29.954345+0000","last_became_active":"2024-09-13T17:10:28.618309+0000","last_became_peered":"2024-09-13T17:10:28.618309+0000","last_unstale":"2024-09-13T17:10:29.954345+0000","last_undegraded":"2024-09-13T17:10:29.954345+0000","last_fullsized":"2024-09-13T17:10:29.954345+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:33.350572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.856123+0000","last_change":"2024-09-13T17:10:28.231817+0000","last_active":"2024-09-13T17:10:29.856123+0000","last_peered":"2024-09-13T17:10:29.856123+0000","last_clean":"2024-09-13T17:10:29.856123+0000","last_became_active":"2024-09-13T17:10:28.231633+0000","last_became_peered":"2024-09-13T17:10:28.231633+0000","last_unstale":"2024-09-13T17:10:29.856123+0000","last_undegraded":"2024-09-13T17:10:29.856123+0000","last_fullsized":"2024-09-13T17:10:29.856123+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:18.440468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952985+0000","last_change":"2024-09-13T17:10:28.617072+0000","last_active":"2024-09-13T17:10:29.952985+0000","last_peered":"2024-09-13T17:10:29.952985+0000","last_clean":"2024-09-13T17:10:29.952985+0000","last_became_active":"2024-09-13T17:10:28.616827+0000","last_became_peered":"2024-09-13T17:10:28.616827+0000","last_unstale":"2024-09-13T17:10:29.952985+0000","last_undegraded":"2024-09-13T17:10:29.952985+0000","last_fullsized":"2024-09-13T17:10:29.952985+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:52.199765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.855860+0000","last_change":"2024-09-13T17:10:28.228683+0000","last_active":"2024-09-13T17:10:29.855860+0000","last_peered":"2024-09-13T17:10:29.855860+0000","last_clean":"2024-09-13T17:10:29.855860+0000","last_became_active":"2024-09-13T17:10:28.228428+0000","last_became_peered":"2024-09-13T17:10:28.228428+0000","last_unstale":"2024-09-13T17:10:29.855860+0000","last_undegraded":"2024-09-13T17:10:29.855860+0000","last_fullsized":"2024-09-13T17:10:29.855860+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:06.424932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.951598+0000","last_change":"2024-09-13T17:10:28.612441+0000","last_active":"2024-09-13T17:10:29.951598+0000","last_peered":"2024-09-13T17:10:29.951598+0000","last_clean":"2024-09-13T17:10:29.951598+0000","last_became_active":"2024-09-13T17:10:28.612118+0000","last_became_peered":"2024-09-13T17:10:28.612118+0000","last_unstale":"2024-09-13T17:10:29.951598+0000","last_undegraded":"2024-09-13T17:10:29.951598+0000","last_fullsized":"2024-09-13T17:10:29.951598+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:06.135450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952638+0000","last_change":"2024-09-13T17:10:28.229135+0000","last_active":"2024-09-13T17:10:29.952638+0000","last_peered":"2024-09-13T17:10:29.952638+0000","last_clean":"2024-09-13T17:10:29.952638+0000","last_became_active":"2024-09-13T17:10:28.228888+0000","last_became_peered":"2024-09-13T17:10:28.228888+0000","last_unstale":"2024-09-13T17:10:29.952638+0000","last_undegraded":"2024-09-13T17:10:29.952638+0000","last_fullsized":"2024-09-13T17:10:29.952638+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:07.557473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.954021+0000","last_change":"2024-09-13T17:10:28.616148+0000","last_active":"2024-09-13T17:10:29.954021+0000","last_peered":"2024-09-13T17:10:29.954021+0000","last_clean":"2024-09-13T17:10:29.954021+0000","last_became_active":"2024-09-13T17:10:28.615626+0000","last_became_peered":"2024-09-13T17:10:28.615626+0000","last_unstale":"2024-09-13T17:10:29.954021+0000","last_undegraded":"2024-09-13T17:10:29.954021+0000","last_fullsized":"2024-09-13T17:10:29.954021+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:02.651936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"97'2","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.856316+0000","last_change":"2024-09-13T17:10:28.225939+0000","last_active":"2024-09-13T17:10:29.856316+0000","last_peered":"2024-09-13T17:10:29.856316+0000","last_clean":"2024-09-13T17:10:29.856316+0000","last_became_active":"2024-09-13T17:10:28.225647+0000","last_became_peered":"2024-09-13T17:10:28.225647+0000","last_unstale":"2024-09-13T17:10:29.856316+0000","last_undegraded":"2024-09-13T17:10:29.856316+0000","last_fullsized":"2024-09-13T17:10:29.856316+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:32.028371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609530+0000","last_change":"2024-09-13T17:10:28.617284+0000","last_active":"2024-09-13T17:10:29.609530+0000","last_peered":"2024-09-13T17:10:29.609530+0000","last_clean":"2024-09-13T17:10:29.609530+0000","last_became_active":"2024-09-13T17:10:28.617037+0000","last_became_peered":"2024-09-13T17:10:28.617037+0000","last_unstale":"2024-09-13T17:10:29.609530+0000","last_undegraded":"2024-09-13T17:10:29.609530+0000","last_fullsized":"2024-09-13T17:10:29.609530+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:35.071450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.954116+0000","last_change":"2024-09-13T17:10:28.232975+0000","last_active":"2024-09-13T17:10:29.954116+0000","last_peered":"2024-09-13T17:10:29.954116+0000","last_clean":"2024-09-13T17:10:29.954116+0000","last_became_active":"2024-09-13T17:10:28.232742+0000","last_became_peered":"2024-09-13T17:10:28.232742+0000","last_unstale":"2024-09-13T17:10:29.954116+0000","last_undegraded":"2024-09-13T17:10:29.954116+0000","last_fullsized":"2024-09-13T17:10:29.954116+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:09.966352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.609742+0000","last_change":"2024-09-13T17:10:28.612757+0000","last_active":"2024-09-13T17:10:29.609742+0000","last_peered":"2024-09-13T17:10:29.609742+0000","last_clean":"2024-09-13T17:10:29.609742+0000","last_became_active":"2024-09-13T17:10:28.612300+0000","last_became_peered":"2024-09-13T17:10:28.612300+0000","last_unstale":"2024-09-13T17:10:29.609742+0000","last_undegraded":"2024-09-13T17:10:29.609742+0000","last_fullsized":"2024-09-13T17:10:29.609742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:33.038217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953032+0000","last_change":"2024-09-13T17:10:28.228697+0000","last_active":"2024-09-13T17:10:29.953032+0000","last_peered":"2024-09-13T17:10:29.953032+0000","last_clean":"2024-09-13T17:10:29.953032+0000","last_became_active":"2024-09-13T17:10:28.228446+0000","last_became_peered":"2024-09-13T17:10:28.228446+0000","last_unstale":"2024-09-13T17:10:29.953032+0000","last_undegraded":"2024-09-13T17:10:29.953032+0000","last_fullsized":"2024-09-13T17:10:29.953032+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:54.949091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.954041+0000","last_change":"2024-09-13T17:10:28.615788+0000","last_active":"2024-09-13T17:10:29.954041+0000","last_peered":"2024-09-13T17:10:29.954041+0000","last_clean":"2024-09-13T17:10:29.954041+0000","last_became_active":"2024-09-13T17:10:28.615516+0000","last_became_peered":"2024-09-13T17:10:28.615516+0000","last_unstale":"2024-09-13T17:10:29.954041+0000","last_undegraded":"2024-09-13T17:10:29.954041+0000","last_fullsized":"2024-09-13T17:10:29.954041+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:56.515996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953109+0000","last_change":"2024-09-13T17:10:28.224229+0000","last_active":"2024-09-13T17:10:29.953109+0000","last_peered":"2024-09-13T17:10:29.953109+0000","last_clean":"2024-09-13T17:10:29.953109+0000","last_became_active":"2024-09-13T17:10:28.223935+0000","last_became_peered":"2024-09-13T17:10:28.223935+0000","last_unstale":"2024-09-13T17:10:29.953109+0000","last_undegraded":"2024-09-13T17:10:29.953109+0000","last_fullsized":"2024-09-13T17:10:29.953109+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:04.677353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.954038+0000","last_change":"2024-09-13T17:10:28.609849+0000","last_active":"2024-09-13T17:10:29.954038+0000","last_peered":"2024-09-13T17:10:29.954038+0000","last_clean":"2024-09-13T17:10:29.954038+0000","last_became_active":"2024-09-13T17:10:28.609522+0000","last_became_peered":"2024-09-13T17:10:28.609522+0000","last_unstale":"2024-09-13T17:10:29.954038+0000","last_undegraded":"2024-09-13T17:10:29.954038+0000","last_fullsized":"2024-09-13T17:10:29.954038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:26.565392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953389+0000","last_change":"2024-09-13T17:10:28.229545+0000","last_active":"2024-09-13T17:10:29.953389+0000","last_peered":"2024-09-13T17:10:29.953389+0000","last_clean":"2024-09-13T17:10:29.953389+0000","last_became_active":"2024-09-13T17:10:28.227985+0000","last_became_peered":"2024-09-13T17:10:28.227985+0000","last_unstale":"2024-09-13T17:10:29.953389+0000","last_undegraded":"2024-09-13T17:10:29.953389+0000","last_fullsized":"2024-09-13T17:10:29.953389+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:05.151575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.952516+0000","last_change":"2024-09-13T17:10:28.608306+0000","last_active":"2024-09-13T17:10:29.952516+0000","last_peered":"2024-09-13T17:10:29.952516+0000","last_clean":"2024-09-13T17:10:29.952516+0000","last_became_active":"2024-09-13T17:10:28.607908+0000","last_became_peered":"2024-09-13T17:10:28.607908+0000","last_unstale":"2024-09-13T17:10:29.952516+0000","last_undegraded":"2024-09-13T17:10:29.952516+0000","last_fullsized":"2024-09-13T17:10:29.952516+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:49.022561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.951993+0000","last_change":"2024-09-13T17:10:28.224666+0000","last_active":"2024-09-13T17:10:29.951993+0000","last_peered":"2024-09-13T17:10:29.951993+0000","last_clean":"2024-09-13T17:10:29.951993+0000","last_became_active":"2024-09-13T17:10:28.224387+0000","last_became_peered":"2024-09-13T17:10:28.224387+0000","last_unstale":"2024-09-13T17:10:29.951993+0000","last_undegraded":"2024-09-13T17:10:29.951993+0000","last_fullsized":"2024-09-13T17:10:29.951993+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:40.347340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953205+0000","last_change":"2024-09-13T17:10:28.609742+0000","last_active":"2024-09-13T17:10:29.953205+0000","last_peered":"2024-09-13T17:10:29.953205+0000","last_clean":"2024-09-13T17:10:29.953205+0000","last_became_active":"2024-09-13T17:10:28.609466+0000","last_became_peered":"2024-09-13T17:10:28.609466+0000","last_unstale":"2024-09-13T17:10:29.953205+0000","last_undegraded":"2024-09-13T17:10:29.953205+0000","last_fullsized":"2024-09-13T17:10:29.953205+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:06.645944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.605855+0000","last_change":"2024-09-13T17:10:28.233061+0000","last_active":"2024-09-13T17:10:29.605855+0000","last_peered":"2024-09-13T17:10:29.605855+0000","last_clean":"2024-09-13T17:10:29.605855+0000","last_became_active":"2024-09-13T17:10:28.232758+0000","last_became_peered":"2024-09-13T17:10:28.232758+0000","last_unstale":"2024-09-13T17:10:29.605855+0000","last_undegraded":"2024-09-13T17:10:29.605855+0000","last_fullsized":"2024-09-13T17:10:29.605855+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:40.347340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.951845+0000","last_change":"2024-09-13T17:10:28.616608+0000","last_active":"2024-09-13T17:10:29.951845+0000","last_peered":"2024-09-13T17:10:29.951845+0000","last_clean":"2024-09-13T17:10:29.951845+0000","last_became_active":"2024-09-13T17:10:28.615555+0000","last_became_peered":"2024-09-13T17:10:28.615555+0000","last_unstale":"2024-09-13T17:10:29.951845+0000","last_undegraded":"2024-09-13T17:10:29.951845+0000","last_fullsized":"2024-09-13T17:10:29.951845+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:06.161420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.953400+0000","last_change":"2024-09-13T17:10:28.234016+0000","last_active":"2024-09-13T17:10:29.953400+0000","last_peered":"2024-09-13T17:10:29.953400+0000","last_clean":"2024-09-13T17:10:29.953400+0000","last_became_active":"2024-09-13T17:10:28.233776+0000","last_became_peered":"2024-09-13T17:10:28.233776+0000","last_unstale":"2024-09-13T17:10:29.953400+0000","last_undegraded":"2024-09-13T17:10:29.953400+0000","last_fullsized":"2024-09-13T17:10:29.953400+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:01.301629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.954958+0000","last_change":"2024-09-13T17:10:28.619259+0000","last_active":"2024-09-13T17:10:29.954958+0000","last_peered":"2024-09-13T17:10:29.954958+0000","last_clean":"2024-09-13T17:10:29.954958+0000","last_became_active":"2024-09-13T17:10:28.619043+0000","last_became_peered":"2024-09-13T17:10:28.619043+0000","last_unstale":"2024-09-13T17:10:29.954958+0000","last_undegraded":"2024-09-13T17:10:29.954958+0000","last_fullsized":"2024-09-13T17:10:29.954958+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:28.197489+0000","last_clean_scrub_stamp":"2024-09-13T17:10:28.197489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:47.053113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"97'1","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T17:10:29.610106+0000","last_change":"2024-09-13T17:10:28.229616+0000","last_active":"2024-09-13T17:10:29.610106+0000","last_peered":"2024-09-13T17:10:29.610106+0000","last_clean":"2024-09-13T17:10:29.610106+0000","last_became_active":"2024-09-13T17:10:28.229353+0000","last_became_peered":"2024-09-13T17:10:28.229353+0000","last_unstale":"2024-09-13T17:10:29.610106+0000","last_undegraded":"2024-09-13T17:10:29.610106+0000","last_fullsized":"2024-09-13T17:10:29.610106+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:10:27.187644+0000","last_clean_scrub_stamp":"2024-09-13T17:10:27.187644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:09.530033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":243,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-13T17:10:28.595374+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:10:28.595374+0000","last_peered":"2024-09-13T17:10:28.595374+0000","last_clean":"2024-09-13T17:10:28.595374+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:10:28.595374+0000","last_undegraded":"2024-09-13T17:10:28.595374+0000","last_fullsized":"2024-09-13T17:10:28.595374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32900,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338940,"statfs":{"total":96636764160,"available":96603074560,"internally_reserved":0,"allocated":1814528,"data_stored":1109574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83499999999999996,"15min":0.84899999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.212,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.877,"15min":0.90500000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.92400000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3979999999999999,"5min":1.456,"15min":1.456},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.876}]},{"osd":2,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.85099999999999998,"15min":0.85899999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2210000000000001,"5min":1.238,"15min":1.238},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98399999999999999,"15min":1.004},"min":{"1min":0.64500000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.1319999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.93200000000000005,"15min":0.92200000000000004},"min":{"1min":0.628,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.98299999999999998,"15min":0.998},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.96799999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.89700000000000002,"15min":0.90000000000000002},"min":{"1min":0.66600000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.016,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.099,"15min":1.117},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.3959999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.103}]},{"osd":5,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.032,"15min":1.0389999999999999},"min":{"1min":0.627,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.0209999999999999,"15min":1.018},"min":{"1min":0.77900000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.94899999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0980000000000001,"15min":1.123},"min":{"1min":0.81799999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7170000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.1200000000000001,"15min":1.1339999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5669999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.0269999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1220608,"data_stored":519746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76000000000000001,"15min":0.755},"min":{"1min":0.56200000000000006,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85799999999999998,"15min":0.876},"min":{"1min":0.58599999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.052,"5min":1.431,"15min":1.431},"last":0.95499999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92400000000000004,"15min":0.92700000000000005},"min":{"1min":0.64800000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.163,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.61499999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1020000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.89500000000000002,"15min":0.91300000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.071,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.875},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.94099999999999995,"15min":0.97299999999999998},"min":{"1min":0.59799999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1679999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95099999999999996,"15min":0.97499999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.198,"5min":1.359,"15min":1.359},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.038,"15min":1.05},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.0509999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.89700000000000002,"15min":0.90600000000000003},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1060000000000001,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.996},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2250000000000001,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.014,"15min":1.018},"min":{"1min":0.74199999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2170000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.038,"15min":1.0629999999999999},"min":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1819999999999999,"5min":1.597,"15min":1.597},"last":1.077}]},{"osd":7,"last update":"Fri Sep 13 17:09:42 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.091,"15min":1.1040000000000001},"min":{"1min":0.82199999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2969999999999999,"5min":1.728,"15min":1.728},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.167,"15min":1.1899999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.526,"5min":2.194,"15min":2.194},"last":1.1180000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1216512,"data_stored":519164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.83699999999999997,"15min":0.86299999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.232,"5min":1.395,"15min":1.395},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.86299999999999999,"15min":0.88300000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.173,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.96499999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94599999999999995,"15min":0.95599999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.232,"5min":1.508,"15min":1.508},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95199999999999996,"15min":0.95399999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.302,"5min":1.482,"15min":1.482},"last":1.24}]},{"osd":2,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.85099999999999998},"min":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2669999999999999,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.69799999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1899999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.96699999999999997,"15min":0.997},"min":{"1min":0.67100000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.206,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92100000000000004,"15min":0.93100000000000005},"min":{"1min":0.58199999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.335,"5min":1.603,"15min":1.603},"last":1.181}]},{"osd":4,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.022,"15min":1.0589999999999999},"min":{"1min":0.77300000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.208,"5min":1.466,"15min":1.466},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.999,"15min":1.0309999999999999},"min":{"1min":0.65100000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3640000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.218}]},{"osd":6,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0369999999999999,"15min":1.0649999999999999},"min":{"1min":0.76600000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.2,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1439999999999999,"15min":1.1839999999999999},"min":{"1min":0.76600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2669999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.042}]},{"osd":7,"last update":"Fri Sep 13 17:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.097,"15min":1.137},"min":{"1min":0.75700000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.1899999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.089},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.169,"15min":1.2050000000000001},"min":{"1min":0.76700000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.466,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.014}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1232896,"data_stored":520782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.751},"min":{"1min":0.52800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94699999999999995,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1739999999999999,"5min":1.306,"15min":1.306},"last":0.93600000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.65900000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1579999999999999,"5min":1.357,"15min":1.357},"last":1.081},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.93799999999999994,"15min":0.94699999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2050000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.89900000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.89500000000000002,"15min":0.88500000000000001},"min":{"1min":0.65400000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1599999999999999,"5min":1.272,"15min":1.272},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.94099999999999995,"15min":0.91500000000000004},"min":{"1min":0.78400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3220000000000001,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.1299999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.90400000000000003,"15min":0.92000000000000004},"min":{"1min":0.63700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1879999999999999,"5min":1.464,"15min":1.464},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.89200000000000002,"15min":0.88500000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.25,"5min":1.353,"15min":1.353},"last":0.97199999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94699999999999995,"15min":0.93999999999999995},"min":{"1min":0.623,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2210000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.0740000000000001,"15min":1.0649999999999999},"min":{"1min":0.83799999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3200000000000001,"5min":1.478,"15min":1.478},"last":1.103}]},{"osd":6,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97099999999999997,"15min":0.97399999999999998},"min":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1659999999999999,"5min":1.26,"15min":1.26},"last":1.165},{"interface":"front","average":{"1min":1.095,"5min":1.0580000000000001,"15min":1.048},"min":{"1min":0.83899999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.429,"5min":1.613,"15min":1.613},"last":1.2090000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.087,"15min":1.087},"min":{"1min":0.753,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.373,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.054},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.127,"15min":1.1259999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.399,"5min":2.032,"15min":2.032},"last":1.2430000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1228800,"data_stored":520680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.32500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.61299999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80000000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.232,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69799999999999995,"15min":0.71799999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.222,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.35299999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.03,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.56999999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.91200000000000003,"15min":0.92200000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.93799999999999994,"15min":0.95799999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3740000000000001,"5min":1.899,"15min":1.899},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.61699999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.377,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.98699999999999999,"15min":0.99299999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4330000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0169999999999999,"15min":1.024},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0169999999999999,"15min":1.04},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3089999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.036}]},{"osd":7,"last update":"Fri Sep 13 17:09:40 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.0720000000000001,"15min":1.089},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.514,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.05,"15min":1.0680000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6599999999999999,"5min":1.756,"15min":1.756},"last":1.056}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1216512,"data_stored":519128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.872,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81200000000000006,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70399999999999996,"15min":0.72599999999999998},"min":{"1min":0.372,"5min":0.37,"15min":0.37},"max":{"1min":0.92700000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.747,"15min":0.77300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0609999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.878}]},{"osd":3,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.46300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82599999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94899999999999995,"5min":1.103,"15min":1.103},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.91700000000000004,"15min":0.93899999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.157,"5min":1.3,"15min":1.3},"last":1.05},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.92100000000000004,"15min":0.92500000000000004},"min":{"1min":0.65900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.157,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.97099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.93899999999999995,"15min":0.95299999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2170000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.92800000000000005,"15min":0.91800000000000004},"min":{"1min":0.54600000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.1950000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.97799999999999998,"15min":0.97199999999999998},"min":{"1min":0.67800000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1,"15min":0.99199999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.26,"5min":1.413,"15min":1.413},"last":1.1120000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.0309999999999999,"15min":1.054},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.26,"5min":1.506,"15min":1.506},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.64500000000000002,"5min":0.625,"15min":0.625},"max":{"1min":1.3460000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.998}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1212416,"data_stored":519094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65400000000000003,"15min":0.66300000000000003},"min":{"1min":0.44500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.097,"5min":1.151,"15min":1.151},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0589999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.02}]},{"osd":2,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64500000000000002,"15min":0.66400000000000003},"min":{"1min":0.47599999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81299999999999994,"5min":1.306,"15min":1.306},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.751,"15min":0.755},"min":{"1min":0.495,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.079,"5min":1.28,"15min":1.28},"last":0.86899999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78300000000000003,"15min":0.79000000000000004},"min":{"1min":0.497,"5min":0.308,"15min":0.308},"max":{"1min":1.1699999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80400000000000005,"15min":0.82599999999999996},"min":{"1min":0.50800000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1379999999999999,"5min":1.905,"15min":1.905},"last":0.80400000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2230000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.236},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.0069999999999999,"15min":1.0329999999999999},"min":{"1min":0.71899999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.272,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.0629999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":1.03,"15min":1.0660000000000001},"min":{"1min":0.63600000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.179,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.998,"5min":1.0820000000000001,"15min":1.1100000000000001},"min":{"1min":0.83599999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.296,"5min":1.556,"15min":1.556},"last":1.3560000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0549999999999999,"15min":1.077},"min":{"1min":0.69099999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3580000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.141},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.109,"15min":1.1359999999999999},"min":{"1min":0.83299999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.327,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.92400000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:09:39 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1359999999999999,"15min":1.159},"min":{"1min":0.81000000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4359999999999999,"5min":1.712,"15min":1.712},"last":1.48},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.80500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3169999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.3959999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32884,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338956,"statfs":{"total":96636764160,"available":96603090944,"internally_reserved":0,"allocated":1810432,"data_stored":1110044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69199999999999995,"15min":0.70899999999999996},"min":{"1min":0.434,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.92100000000000004,"5min":3.25,"15min":3.25},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.77600000000000002,"15min":0.81000000000000005},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.103,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.749}]},{"osd":2,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71499999999999997,"15min":0.73699999999999999},"min":{"1min":0.55800000000000005,"5min":0.307,"15min":0.307},"max":{"1min":0.91600000000000004,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.81899999999999995,"15min":0.876},"min":{"1min":0.48399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0760000000000001,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.91500000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.79600000000000004,"15min":0.85699999999999998},"min":{"1min":0.439,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.016,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.89500000000000002,"15min":0.95499999999999996},"min":{"1min":0.50600000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98799999999999999,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.83799999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.97199999999999998,"15min":1.02},"min":{"1min":0.65800000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.095,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.024,"15min":1.0549999999999999},"min":{"1min":0.76600000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.379,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":0.98499999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.073},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.413,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.0529999999999999,"15min":1.105},"min":{"1min":0.76800000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.3049999999999999,"5min":5.399,"15min":5.399},"last":1.111}]},{"osd":6,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.121,"15min":1.153},"min":{"1min":0.84399999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.4530000000000001,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.083,"15min":1.115},"min":{"1min":0.78100000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.51,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.157}]},{"osd":7,"last update":"Fri Sep 13 17:09:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.111,"15min":1.1299999999999999},"min":{"1min":0.78700000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4570000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.163,"15min":1.2170000000000001},"min":{"1min":0.79700000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.2889999999999999,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":1.2450000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:10:32.995 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:10:32.996 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T17:10:33.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.121+0000 7fcc226b0700 1 Processor -- start 2024-09-13T17:10:33.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.121+0000 7fcc226b0700 1 -- start start 2024-09-13T17:10:33.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.121+0000 7fcc226b0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcc1c165760 0x7fcc1c167b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.121+0000 7fcc226b0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c0d0cb0 con 0x7fcc1c0b58b0 2024-09-13T17:10:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.121+0000 7fcc226b0700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c0b0060 con 0x7fcc1c0d0f40 2024-09-13T17:10:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.121+0000 7fcc226b0700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1c0b0340 con 0x7fcc1c165760 2024-09-13T17:10:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.121+0000 7fcc21eaf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcc1c165760 0x7fcc1c167b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.121+0000 7fcc20ead700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcc1c0b58b0 0x7fcc1c0d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58168/0 (socket says 172.21.15.123:58168) 2024-09-13T17:10:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.121+0000 7fcc21eaf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcc1c165760 0x7fcc1c167b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34280/0 (socket says 172.21.15.123:34280) 2024-09-13T17:10:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.121+0000 7fcc20ead700 1 -- 172.21.15.123:0/853485413 learned_addr learned my addr 172.21.15.123:0/853485413 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.121+0000 7fcc21eaf700 1 -- 172.21.15.123:0/853485413 >> v1:172.21.15.153:6789/0 conn(0x7fcc1c0d0f40 legacy=0x7fcc1c0d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.121+0000 7fcc21eaf700 1 -- 172.21.15.123:0/853485413 >> v1:172.21.15.123:6789/0 conn(0x7fcc1c0b58b0 legacy=0x7fcc1c0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.121+0000 7fcc21eaf700 1 -- 172.21.15.123:0/853485413 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c0b0620 con 0x7fcc1c165760 2024-09-13T17:10:33.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.121+0000 7fcc21eaf700 1 --2- 172.21.15.123:0/853485413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c165760 0x7fcc1c167b50 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009d90 tx=0x7fcc1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59174c26acf15c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:33.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc0ffff700 1 -- 172.21.15.123:0/853485413 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400e070 con 0x7fcc1c165760 2024-09-13T17:10:33.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc0ffff700 1 -- 172.21.15.123:0/853485413 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1400bbd0 con 0x7fcc1c165760 2024-09-13T17:10:33.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc0ffff700 1 -- 172.21.15.123:0/853485413 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14012430 con 0x7fcc1c165760 2024-09-13T17:10:33.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 -- 172.21.15.123:0/853485413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c165760 msgr2=0x7fcc1c167b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 --2- 172.21.15.123:0/853485413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c165760 0x7fcc1c167b50 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009d90 tx=0x7fcc1400b330 comp rx=0 tx=0).stop 2024-09-13T17:10:33.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 -- 172.21.15.123:0/853485413 shutdown_connections 2024-09-13T17:10:33.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 --2- 172.21.15.123:0/853485413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c165760 0x7fcc1c167b50 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 -- 172.21.15.123:0/853485413 >> 172.21.15.123:0/853485413 conn(0x7fcc1c0d2a60 msgr2=0x7fcc1c0d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:33.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 -- 172.21.15.123:0/853485413 shutdown_connections 2024-09-13T17:10:33.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 -- 172.21.15.123:0/853485413 wait complete. 2024-09-13T17:10:33.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 Processor -- start 2024-09-13T17:10:33.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 -- start start 2024-09-13T17:10:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc1c0b58b0 0x7fcc1c147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c0d0f40 0x7fcc1c144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc1c165760 0x7fcc1c0c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c15e780 con 0x7fcc1c0d0f40 2024-09-13T17:10:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c15ea60 con 0x7fcc1c165760 2024-09-13T17:10:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc226b0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c15ed40 con 0x7fcc1c0b58b0 2024-09-13T17:10:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc20ead700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c0d0f40 0x7fcc1c144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc20ead700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c0d0f40 0x7fcc1c144af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34294/0 (socket says 172.21.15.123:34294) 2024-09-13T17:10:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc20ead700 1 -- 172.21.15.123:0/2570222205 learned_addr learned my addr 172.21.15.123:0/2570222205 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc216ae700 1 --2- 172.21.15.123:0/2570222205 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc1c0b58b0 0x7fcc1c147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.125+0000 7fcc21eaf700 1 --2- 172.21.15.123:0/2570222205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc1c165760 0x7fcc1c0c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.129+0000 7fcc20ead700 1 -- 172.21.15.123:0/2570222205 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc1c0b58b0 msgr2=0x7fcc1c147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.129+0000 7fcc20ead700 1 --2- 172.21.15.123:0/2570222205 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc1c0b58b0 0x7fcc1c147530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.129+0000 7fcc20ead700 1 -- 172.21.15.123:0/2570222205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc1c165760 msgr2=0x7fcc1c0c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.129+0000 7fcc20ead700 1 --2- 172.21.15.123:0/2570222205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc1c165760 0x7fcc1c0c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.129+0000 7fcc20ead700 1 -- 172.21.15.123:0/2570222205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc14009a70 con 0x7fcc1c0d0f40 2024-09-13T17:10:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.129+0000 7fcc20ead700 1 --2- 172.21.15.123:0/2570222205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c0d0f40 0x7fcc1c144af0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000c700 tx=0x7fcc1000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.129+0000 7fcc0dffb700 1 -- 172.21.15.123:0/2570222205 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10005d90 con 0x7fcc1c0d0f40 2024-09-13T17:10:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.129+0000 7fcc0dffb700 1 -- 172.21.15.123:0/2570222205 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc100070d0 con 0x7fcc1c0d0f40 2024-09-13T17:10:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.129+0000 7fcc226b0700 1 -- 172.21.15.123:0/2570222205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c15f020 con 0x7fcc1c0d0f40 2024-09-13T17:10:33.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.129+0000 7fcc0dffb700 1 -- 172.21.15.123:0/2570222205 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10007440 con 0x7fcc1c0d0f40 2024-09-13T17:10:33.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.129+0000 7fcc226b0700 1 -- 172.21.15.123:0/2570222205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c147a70 con 0x7fcc1c0d0f40 2024-09-13T17:10:33.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.129+0000 7fcc226b0700 1 -- 172.21.15.123:0/2570222205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c15f540 con 0x7fcc1c0d0f40 2024-09-13T17:10:33.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.129+0000 7fcc0dffb700 1 -- 172.21.15.123:0/2570222205 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcc100075a0 con 0x7fcc1c0d0f40 2024-09-13T17:10:33.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.133+0000 7fcc0dffb700 1 --2- 172.21.15.123:0/2570222205 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcc00066730 0x7fcc00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.133+0000 7fcc0dffb700 1 -- 172.21.15.123:0/2570222205 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc10083460 con 0x7fcc1c0d0f40 2024-09-13T17:10:33.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.133+0000 7fcc216ae700 1 --2- 172.21.15.123:0/2570222205 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcc00066730 0x7fcc00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.133+0000 7fcc216ae700 1 --2- 172.21.15.123:0/2570222205 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcc00066730 0x7fcc00068bf0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0ce8d0 tx=0x7fcc18009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.141+0000 7fcc0dffb700 1 -- 172.21.15.123:0/2570222205 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcc1c15f540 con 0x7fcc1c0d0f40 2024-09-13T17:10:33.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.373+0000 7fcc226b0700 1 -- 172.21.15.123:0/2570222205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fcc1c15f540 con 0x7fcc1c0d0f40 2024-09-13T17:10:33.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.377+0000 7fcc0dffb700 1 -- 172.21.15.123:0/2570222205 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7fcc1c15f540 con 0x7fcc1c0d0f40 2024-09-13T17:10:33.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.381+0000 7fcc226b0700 1 -- 172.21.15.123:0/2570222205 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcc00066730 msgr2=0x7fcc00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.381+0000 7fcc226b0700 1 --2- 172.21.15.123:0/2570222205 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcc00066730 0x7fcc00068bf0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0ce8d0 tx=0x7fcc18009040 comp rx=0 tx=0).stop 2024-09-13T17:10:33.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.381+0000 7fcc226b0700 1 -- 172.21.15.123:0/2570222205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c0d0f40 msgr2=0x7fcc1c144af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.381+0000 7fcc226b0700 1 --2- 172.21.15.123:0/2570222205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c0d0f40 0x7fcc1c144af0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000c700 tx=0x7fcc1000ca10 comp rx=0 tx=0).stop 2024-09-13T17:10:33.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.381+0000 7fcc226b0700 1 -- 172.21.15.123:0/2570222205 shutdown_connections 2024-09-13T17:10:33.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.381+0000 7fcc226b0700 1 --2- 172.21.15.123:0/2570222205 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fcc00066730 0x7fcc00068bf0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.381+0000 7fcc226b0700 1 --2- 172.21.15.123:0/2570222205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc1c165760 0x7fcc1c0c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.381+0000 7fcc226b0700 1 --2- 172.21.15.123:0/2570222205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc1c0d0f40 0x7fcc1c144af0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.381+0000 7fcc226b0700 1 --2- 172.21.15.123:0/2570222205 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcc1c0b58b0 0x7fcc1c147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.381+0000 7fcc226b0700 1 -- 172.21.15.123:0/2570222205 >> 172.21.15.123:0/2570222205 conn(0x7fcc1c0d2a60 msgr2=0x7fcc1c0d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:33.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.381+0000 7fcc226b0700 1 -- 172.21.15.123:0/2570222205 shutdown_connections 2024-09-13T17:10:33.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.381+0000 7fcc226b0700 1 -- 172.21.15.123:0/2570222205 wait complete. 2024-09-13T17:10:33.386 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-13T17:10:33.398 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:33.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 Processor -- start 2024-09-13T17:10:33.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 -- start start 2024-09-13T17:10:33.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0618160fb0 0x7f061806de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06180cec90 0x7f06180cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06180cf620 con 0x7f061806c050 2024-09-13T17:10:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061806e340 con 0x7f0618160fb0 2024-09-13T17:10:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061806cd60 con 0x7f06180cec90 2024-09-13T17:10:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f061e53c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0618160fb0 0x7f061806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f061ed3d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f061806c050 0x7f061806c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58184/0 (socket says 172.21.15.123:58184) 2024-09-13T17:10:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f061e53c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0618160fb0 0x7f061806de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34304/0 (socket says 172.21.15.123:34304) 2024-09-13T17:10:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f061ed3d700 1 -- 172.21.15.123:0/2487619752 learned_addr learned my addr 172.21.15.123:0/2487619752 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f061dd3b700 1 --2- 172.21.15.123:0/2487619752 >> v2:172.21.15.153:3300/0 conn(0x7f06180cec90 0x7f06180cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f061e53c700 1 -- 172.21.15.123:0/2487619752 >> v2:172.21.15.153:3300/0 conn(0x7f06180cec90 msgr2=0x7f06180cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f061e53c700 1 --2- 172.21.15.123:0/2487619752 >> v2:172.21.15.153:3300/0 conn(0x7f06180cec90 0x7f06180cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f061e53c700 1 -- 172.21.15.123:0/2487619752 >> v1:172.21.15.123:6789/0 conn(0x7f061806c050 legacy=0x7f061806c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f061e53c700 1 -- 172.21.15.123:0/2487619752 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061806d040 con 0x7f0618160fb0 2024-09-13T17:10:33.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f061d53a700 1 -- 172.21.15.123:0/2487619752 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770239321 0 0) 0x7f0614001110 con 0x7f061806c050 2024-09-13T17:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f061e53c700 1 --2- 172.21.15.123:0/2487619752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0618160fb0 0x7f061806de00 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f061806a370 tx=0x7f060c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1079937a799ca376 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f061d53a700 1 -- 172.21.15.123:0/2487619752 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c011830 con 0x7f0618160fb0 2024-09-13T17:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f061d53a700 1 -- 172.21.15.123:0/2487619752 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060c011990 con 0x7f0618160fb0 2024-09-13T17:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f061d53a700 1 -- 172.21.15.123:0/2487619752 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c011d20 con 0x7f0618160fb0 2024-09-13T17:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 -- 172.21.15.123:0/2487619752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0618160fb0 msgr2=0x7f061806de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 --2- 172.21.15.123:0/2487619752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0618160fb0 0x7f061806de00 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f061806a370 tx=0x7f060c009b30 comp rx=0 tx=0).stop 2024-09-13T17:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 -- 172.21.15.123:0/2487619752 shutdown_connections 2024-09-13T17:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 --2- 172.21.15.123:0/2487619752 >> v2:172.21.15.153:3300/0 conn(0x7f06180cec90 0x7f06180cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 --2- 172.21.15.123:0/2487619752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0618160fb0 0x7f061806de00 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 -- 172.21.15.123:0/2487619752 >> 172.21.15.123:0/2487619752 conn(0x7f0618066570 msgr2=0x7f0618066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 -- 172.21.15.123:0/2487619752 shutdown_connections 2024-09-13T17:10:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.509+0000 7f06207a0700 1 -- 172.21.15.123:0/2487619752 wait complete. 2024-09-13T17:10:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.513+0000 7f06207a0700 1 Processor -- start 2024-09-13T17:10:33.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.513+0000 7f06207a0700 1 -- start start 2024-09-13T17:10:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f06207a0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f061806c050 0x7f0618151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f06207a0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06180cec90 0x7f06180af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f06207a0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0618160fb0 0x7f061814ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f06207a0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0618071190 con 0x7f06180cec90 2024-09-13T17:10:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f06207a0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0618151690 con 0x7f061806c050 2024-09-13T17:10:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f06207a0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06180a8540 con 0x7f0618160fb0 2024-09-13T17:10:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f061dd3b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06180cec90 0x7f06180af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f061dd3b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06180cec90 0x7f06180af950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34316/0 (socket says 172.21.15.123:34316) 2024-09-13T17:10:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f061dd3b700 1 -- 172.21.15.123:0/4170139841 learned_addr learned my addr 172.21.15.123:0/4170139841 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:33.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f061e53c700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f061806c050 0x7f0618151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f061ed3d700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0618160fb0 0x7f061814ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f061dd3b700 1 -- 172.21.15.123:0/4170139841 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0618160fb0 msgr2=0x7f061814ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f061dd3b700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0618160fb0 0x7f061814ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f061dd3b700 1 -- 172.21.15.123:0/4170139841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f061806c050 msgr2=0x7f0618151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f061dd3b700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f061806c050 0x7f0618151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f061dd3b700 1 -- 172.21.15.123:0/4170139841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c0094b0 con 0x7f06180cec90 2024-09-13T17:10:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f061ed3d700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0618160fb0 0x7f061814ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f061dd3b700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06180cec90 0x7f06180af950 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f061000efc0 tx=0x7f061000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f060affd700 1 -- 172.21.15.123:0/4170139841 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061000cdc0 con 0x7f06180cec90 2024-09-13T17:10:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f060affd700 1 -- 172.21.15.123:0/4170139841 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061000f040 con 0x7f06180cec90 2024-09-13T17:10:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f06207a0700 1 -- 172.21.15.123:0/4170139841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06180a8820 con 0x7f06180cec90 2024-09-13T17:10:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f060affd700 1 -- 172.21.15.123:0/4170139841 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06100146a0 con 0x7f06180cec90 2024-09-13T17:10:33.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f06207a0700 1 -- 172.21.15.123:0/4170139841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06180a8b00 con 0x7f06180cec90 2024-09-13T17:10:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.517+0000 7f06207a0700 1 -- 172.21.15.123:0/4170139841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06180cf0e0 con 0x7f06180cec90 2024-09-13T17:10:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.521+0000 7f060affd700 1 -- 172.21.15.123:0/4170139841 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0610014800 con 0x7f06180cec90 2024-09-13T17:10:33.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.521+0000 7f060affd700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f05fc066730 0x7f05fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.521+0000 7f060affd700 1 -- 172.21.15.123:0/4170139841 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0610084a20 con 0x7f06180cec90 2024-09-13T17:10:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.521+0000 7f061e53c700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f05fc066730 0x7f05fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.521+0000 7f061e53c700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f05fc066730 0x7f05fc068bf0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f060c009fd0 tx=0x7f060c008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:33.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.529+0000 7f060affd700 1 -- 172.21.15.123:0/4170139841 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0610051ed0 con 0x7f06180cec90 2024-09-13T17:10:33.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.737+0000 7f06207a0700 1 -- 172.21.15.123:0/4170139841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06180aeee0 con 0x7f06180cec90 2024-09-13T17:10:33.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.737+0000 7f060affd700 1 -- 172.21.15.123:0/4170139841 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f06100554f0 con 0x7f06180cec90 2024-09-13T17:10:33.741 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:33.741 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":48,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7156,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3705271604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705271604},{"type":"v1","addr":"172.21.15.153:6834","nonce":3705271604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2842144578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":2842144578},{"type":"v1","addr":"172.21.15.153:6835","nonce":2842144578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7398,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2022373739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2022373739},{"type":"v1","addr":"172.21.15.123:6835","nonce":2022373739}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:10:28.586943+0000","modified":"2024-09-13T17:10:31.604775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7401":{"gid":7401,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/1688881065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1688881065},{"type":"v1","addr":"172.21.15.123:6837","nonce":1688881065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:10:33.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.741+0000 7f06207a0700 1 -- 172.21.15.123:0/4170139841 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f05fc066730 msgr2=0x7f05fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.741+0000 7f06207a0700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f05fc066730 0x7f05fc068bf0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f060c009fd0 tx=0x7f060c008030 comp rx=0 tx=0).stop 2024-09-13T17:10:33.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.741+0000 7f06207a0700 1 -- 172.21.15.123:0/4170139841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06180cec90 msgr2=0x7f06180af950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.741+0000 7f06207a0700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06180cec90 0x7f06180af950 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f061000efc0 tx=0x7f061000c3a0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.741+0000 7f06207a0700 1 -- 172.21.15.123:0/4170139841 shutdown_connections 2024-09-13T17:10:33.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.741+0000 7f06207a0700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f05fc066730 0x7f05fc068bf0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.741+0000 7f06207a0700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0618160fb0 0x7f061814ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.741+0000 7f06207a0700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06180cec90 0x7f06180af950 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.741+0000 7f06207a0700 1 --2- 172.21.15.123:0/4170139841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f061806c050 0x7f0618151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.741+0000 7f06207a0700 1 -- 172.21.15.123:0/4170139841 >> 172.21.15.123:0/4170139841 conn(0x7f0618066570 msgr2=0x7f06180ae430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:33.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.741+0000 7f06207a0700 1 -- 172.21.15.123:0/4170139841 shutdown_connections 2024-09-13T17:10:33.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:33.741+0000 7f06207a0700 1 -- 172.21.15.123:0/4170139841 wait complete. 2024-09-13T17:10:33.745 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 48 2024-09-13T17:10:34.159 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:10:28.586943+0000', 'modified': '2024-09-13T17:10:31.604775+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7401}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7401': {'gid': 7401, 'name': 'a', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6837/1688881065', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6836', 'nonce': 1688881065}, {'type': 'v1', 'addr': '172.21.15.123:6837', 'nonce': 1688881065}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:10:34.159 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:10:34.159 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T17:10:34.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.281+0000 7f58e269e700 1 Processor -- start 2024-09-13T17:10:34.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.281+0000 7f58e269e700 1 -- start start 2024-09-13T17:10:34.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e269e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58dc0c9f80 0x7f58dc0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e269e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58dc06c610 0x7f58dc06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e269e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58dc15b180 con 0x7f58dc0cd690 2024-09-13T17:10:34.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e269e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58dc0c95f0 con 0x7f58dc06c610 2024-09-13T17:10:34.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e269e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc0cae70 con 0x7f58dc0c9f80 2024-09-13T17:10:34.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e169c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58dc0c9f80 0x7f58dc0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e0e9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58dc06c610 0x7f58dc06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e1e9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f58dc0cd690 0x7f58dc0cb5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:51676/0 (socket says 172.21.15.123:51676) 2024-09-13T17:10:34.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e0e9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58dc06c610 0x7f58dc06ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:56690/0 (socket says 172.21.15.123:56690) 2024-09-13T17:10:34.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e1e9d700 1 -- 172.21.15.123:0/1874112838 learned_addr learned my addr 172.21.15.123:0/1874112838 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:34.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e0e9b700 1 -- 172.21.15.123:0/1874112838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58dc0c9f80 msgr2=0x7f58dc0c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:34.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/1874112838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58dc0c9f80 0x7f58dc0c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e0e9b700 1 -- 172.21.15.123:0/1874112838 >> v1:172.21.15.153:6789/0 conn(0x7f58dc0cd690 legacy=0x7f58dc0cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e0e9b700 1 -- 172.21.15.123:0/1874112838 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc0cb140 con 0x7f58dc06c610 2024-09-13T17:10:34.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e169c700 1 --2- 172.21.15.123:0/1874112838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58dc0c9f80 0x7f58dc0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:34.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/1874112838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc06c610 0x7f58dc06ca70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009880 tx=0x7f58cc009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bf0ae4c1cc49a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:34.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58dbfff700 1 -- 172.21.15.123:0/1874112838 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc004230 con 0x7f58dc06c610 2024-09-13T17:10:34.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58dbfff700 1 -- 172.21.15.123:0/1874112838 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc004390 con 0x7f58dc06c610 2024-09-13T17:10:34.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58dbfff700 1 -- 172.21.15.123:0/1874112838 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0036c0 con 0x7f58dc06c610 2024-09-13T17:10:34.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e269e700 1 -- 172.21.15.123:0/1874112838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc06c610 msgr2=0x7f58dc06ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e269e700 1 --2- 172.21.15.123:0/1874112838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc06c610 0x7f58dc06ca70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009880 tx=0x7f58cc009b90 comp rx=0 tx=0).stop 2024-09-13T17:10:34.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e269e700 1 -- 172.21.15.123:0/1874112838 shutdown_connections 2024-09-13T17:10:34.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e269e700 1 --2- 172.21.15.123:0/1874112838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc06c610 0x7f58dc06ca70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e269e700 1 --2- 172.21.15.123:0/1874112838 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58dc0c9f80 0x7f58dc0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e269e700 1 -- 172.21.15.123:0/1874112838 >> 172.21.15.123:0/1874112838 conn(0x7f58dc0b01d0 msgr2=0x7f58dc0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:34.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e269e700 1 -- 172.21.15.123:0/1874112838 shutdown_connections 2024-09-13T17:10:34.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.285+0000 7f58e269e700 1 -- 172.21.15.123:0/1874112838 wait complete. 2024-09-13T17:10:34.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e269e700 1 Processor -- start 2024-09-13T17:10:34.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e269e700 1 -- start start 2024-09-13T17:10:34.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e269e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58dc06c610 0x7f58dc1e3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e269e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58dc0c9f80 0x7f58dc1f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e269e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc0cd690 0x7f58dc0c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e269e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc0ad8c0 con 0x7f58dc0c9f80 2024-09-13T17:10:34.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e269e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc14ea90 con 0x7f58dc0cd690 2024-09-13T17:10:34.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e269e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc0adb10 con 0x7f58dc06c610 2024-09-13T17:10:34.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e0e9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58dc0c9f80 0x7f58dc1f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e0e9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58dc0c9f80 0x7f58dc1f27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34318/0 (socket says 172.21.15.123:34318) 2024-09-13T17:10:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e0e9b700 1 -- 172.21.15.123:0/2166406205 learned_addr learned my addr 172.21.15.123:0/2166406205 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e169c700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58dc06c610 0x7f58dc1e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e1e9d700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc0cd690 0x7f58dc0c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e0e9b700 1 -- 172.21.15.123:0/2166406205 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58dc06c610 msgr2=0x7f58dc1e3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58dc06c610 0x7f58dc1e3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e0e9b700 1 -- 172.21.15.123:0/2166406205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc0cd690 msgr2=0x7f58dc0c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc0cd690 0x7f58dc0c21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e0e9b700 1 -- 172.21.15.123:0/2166406205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d000b750 con 0x7f58dc0c9f80 2024-09-13T17:10:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e1e9d700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc0cd690 0x7f58dc0c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58dc0c9f80 0x7f58dc1f27e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0090b0 tx=0x7f58cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.289+0000 7f58d9ffb700 1 -- 172.21.15.123:0/2166406205 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc006ea0 con 0x7f58dc0c9f80 2024-09-13T17:10:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.293+0000 7f58e269e700 1 -- 172.21.15.123:0/2166406205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58cc0094b0 con 0x7f58dc0c9f80 2024-09-13T17:10:34.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.293+0000 7f58e269e700 1 -- 172.21.15.123:0/2166406205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58dc0ae0d0 con 0x7f58dc0c9f80 2024-09-13T17:10:34.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.293+0000 7f58d9ffb700 1 -- 172.21.15.123:0/2166406205 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc011630 con 0x7f58dc0c9f80 2024-09-13T17:10:34.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.293+0000 7f58d9ffb700 1 -- 172.21.15.123:0/2166406205 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0119a0 con 0x7f58dc0c9f80 2024-09-13T17:10:34.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.293+0000 7f58d9ffb700 1 -- 172.21.15.123:0/2166406205 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f58cc024450 con 0x7f58dc0c9f80 2024-09-13T17:10:34.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.293+0000 7f58d9ffb700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f58c8066730 0x7f58c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.293+0000 7f58d9ffb700 1 -- 172.21.15.123:0/2166406205 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58cc084e20 con 0x7f58dc0c9f80 2024-09-13T17:10:34.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.293+0000 7f58e169c700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f58c8066730 0x7f58c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.293+0000 7f58e169c700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f58c8066730 0x7f58c8068bf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f58d000bf00 tx=0x7f58d000b450 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:34.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.297+0000 7f58e6bb1740 1 Processor -- start 2024-09-13T17:10:34.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.297+0000 7f58e6bb1740 1 -- start start 2024-09-13T17:10:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.297+0000 7f58e6bb1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.297+0000 7f58e6bb1740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 0x25d6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.297+0000 7f58e6bb1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 0x25d6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.297+0000 7f58e6bb1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x2535d80 con 0x260e230 2024-09-13T17:10:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.297+0000 7f58e6bb1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2533510 con 0x260eb50 2024-09-13T17:10:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.297+0000 7f58e6bb1740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x252ee00 con 0x25ece90 2024-09-13T17:10:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.297+0000 7f58e169c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.297+0000 7f58e169c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34332/0 (socket says 172.21.15.123:34332) 2024-09-13T17:10:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.297+0000 7f58e169c700 1 -- 172.21.15.123:0/1318776826 learned_addr learned my addr 172.21.15.123:0/1318776826 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.297+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/1318776826 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 0x25d6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.297+0000 7f58e1e9d700 1 --2- 172.21.15.123:0/1318776826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 0x25d6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e169c700 1 -- 172.21.15.123:0/1318776826 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 msgr2=0x25d6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e169c700 1 --2- 172.21.15.123:0/1318776826 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 0x25d6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e169c700 1 -- 172.21.15.123:0/1318776826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 msgr2=0x25d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:34.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e169c700 1 --2- 172.21.15.123:0/1318776826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 0x25d6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e169c700 1 -- 172.21.15.123:0/1318776826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23a1960 con 0x260e230 2024-09-13T17:10:34.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e169c700 1 --2- 172.21.15.123:0/1318776826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260e610 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f58d000f7a0 tx=0x7f58d0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c839d4577865514 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:34.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58c2ffd700 1 -- 172.21.15.123:0/1318776826 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0004440 con 0x260e230 2024-09-13T17:10:34.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58c2ffd700 1 -- 172.21.15.123:0/1318776826 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d00045a0 con 0x260e230 2024-09-13T17:10:34.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58c2ffd700 1 -- 172.21.15.123:0/1318776826 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d00038c0 con 0x260e230 2024-09-13T17:10:34.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e6bb1740 1 -- 172.21.15.123:0/1318776826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 msgr2=0x260e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/1318776826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260e610 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f58d000f7a0 tx=0x7f58d0014000 comp rx=0 tx=0).stop 2024-09-13T17:10:34.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e6bb1740 1 -- 172.21.15.123:0/1318776826 shutdown_connections 2024-09-13T17:10:34.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/1318776826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 0x25d6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/1318776826 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 0x25d6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/1318776826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260e610 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e6bb1740 1 -- 172.21.15.123:0/1318776826 >> 172.21.15.123:0/1318776826 conn(0x23564d0 msgr2=0x25efe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:34.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e6bb1740 1 -- 172.21.15.123:0/1318776826 shutdown_connections 2024-09-13T17:10:34.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e6bb1740 1 -- 172.21.15.123:0/1318776826 wait complete. 2024-09-13T17:10:34.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e6bb1740 1 -- start start 2024-09-13T17:10:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e6bb1740 1 Processor -- start 2024-09-13T17:10:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.301+0000 7f58e6bb1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25ece90 0x25d7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x260eb50 0x25d5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x24ec730 con 0x260e230 2024-09-13T17:10:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x24f25b0 con 0x25ece90 2024-09-13T17:10:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x23daaa0 con 0x260eb50 2024-09-13T17:10:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 10 client.0 _ll_register_callbacks cb 0x2528610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:10:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e0e9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e0e9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34340/0 (socket says 172.21.15.123:34340) 2024-09-13T17:10:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e0e9b700 1 -- 172.21.15.123:0/4250817918 learned_addr learned my addr 172.21.15.123:0/4250817918 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e169c700 1 --2- 172.21.15.123:0/4250817918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25ece90 0x25d7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e1e9d700 1 --2- 172.21.15.123:0/4250817918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x260eb50 0x25d5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e0e9b700 1 -- 172.21.15.123:0/4250817918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x260eb50 msgr2=0x25d5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/4250817918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x260eb50 0x25d5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e0e9b700 1 -- 172.21.15.123:0/4250817918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25ece90 msgr2=0x25d7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/4250817918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25ece90 0x25d7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e0e9b700 1 -- 172.21.15.123:0/4250817918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d000f4e0 con 0x260e230 2024-09-13T17:10:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/4250817918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260a1d0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f58cc014040 tx=0x7f58cc0566a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fdf6b9deaad2d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-13T17:10:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58bbfff700 1 -- 172.21.15.123:0/4250817918 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc055550 con 0x260e230 2024-09-13T17:10:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58bbfff700 1 -- 172.21.15.123:0/4250817918 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58cc05e250 con 0x260e230 2024-09-13T17:10:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 1 -- 172.21.15.123:0/4250817918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x23631e0 con 0x260e230 2024-09-13T17:10:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58bbfff700 1 -- 172.21.15.123:0/4250817918 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58cc05ddc0 con 0x260e230 2024-09-13T17:10:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 10 client.7545 fetch_fsmap learned FSMap version 48 2024-09-13T17:10:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 1 -- 172.21.15.123:0/4250817918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x24f5220 con 0x260e230 2024-09-13T17:10:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58bbfff700 1 -- 172.21.15.123:0/4250817918 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x23631e0 con 0x260e230 2024-09-13T17:10:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58bbfff700 1 -- 172.21.15.123:0/4250817918 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 48) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f58cc05abb0 con 0x260e230 2024-09-13T17:10:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 10 client.7545 fetch_fsmap finished waiting for FSMap version 48 2024-09-13T17:10:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 10 client.7545 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:10:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 20 client.7545 populate_metadata read hostname 'smithi123' 2024-09-13T17:10:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/4250817918 >> [v2:172.21.15.123:6836/1688881065,v1:172.21.15.123:6837/1688881065] conn(0x25eefa0 0x25ef380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 4 client.7545 mds_command: new command op to 7401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:10:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 1 -- 172.21.15.123:0/4250817918 --> [v2:172.21.15.123:6836/1688881065,v1:172.21.15.123:6837/1688881065] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x23ad460 con 0x25eefa0 2024-09-13T17:10:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e169c700 1 --2- 172.21.15.123:0/4250817918 >> [v2:172.21.15.123:6836/1688881065,v1:172.21.15.123:6837/1688881065] conn(0x25eefa0 0x25ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e169c700 1 --2- 172.21.15.123:0/4250817918 >> [v2:172.21.15.123:6836/1688881065,v1:172.21.15.123:6837/1688881065] conn(0x25eefa0 0x25ef380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73a538fef9f20b1 server_cookie=77a06b4aab4827a2 in_seq=0 out_seq=0 2024-09-13T17:10:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58bbfff700 10 client.7545 ms_handle_connect on v2:172.21.15.123:6836/1688881065 2024-09-13T17:10:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58bbfff700 1 -- 172.21.15.123:0/4250817918 <== mds.0 v2:172.21.15.123:6836/1688881065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x23ad460 con 0x25eefa0 2024-09-13T17:10:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58bbfff700 10 client.7545 handle_command_reply: tid=0 2024-09-13T17:10:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 1 client.7545 shutdown 2024-09-13T17:10:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 1 -- 172.21.15.123:0/4250817918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 msgr2=0x260a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.305+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/4250817918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260a1d0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f58cc014040 tx=0x7f58cc0566a0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.309+0000 7f58e6bb1740 1 -- 172.21.15.123:0/4250817918 shutdown_connections 2024-09-13T17:10:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.309+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/4250817918 >> [v2:172.21.15.123:6836/1688881065,v1:172.21.15.123:6837/1688881065] conn(0x25eefa0 0x25ef380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.309+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/4250817918 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x260eb50 0x25d5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.309+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/4250817918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260a1d0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.309+0000 7f58bbfff700 0 client.7545 ms_handle_reset on v2:172.21.15.123:6836/1688881065 2024-09-13T17:10:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.309+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/4250817918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25ece90 0x25d7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.309+0000 7f58e6bb1740 1 -- 172.21.15.123:0/4250817918 >> 172.21.15.123:0/4250817918 conn(0x23564d0 msgr2=0x25c2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.309+0000 7f58e6bb1740 1 -- 172.21.15.123:0/4250817918 shutdown_connections 2024-09-13T17:10:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.309+0000 7f58e6bb1740 1 -- 172.21.15.123:0/4250817918 wait complete. 2024-09-13T17:10:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.309+0000 7f58e6bb1740 20 client.7545 trim_cache size 0 max 16384 2024-09-13T17:10:34.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.325+0000 7f58e6bb1740 1 Processor -- start 2024-09-13T17:10:34.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.325+0000 7f58e6bb1740 1 -- start start 2024-09-13T17:10:34.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.325+0000 7f58e6bb1740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 0x2609ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.325+0000 7f58e6bb1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.325+0000 7f58e6bb1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 0x2616850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e6bb1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x24eb690 con 0x260e230 2024-09-13T17:10:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e6bb1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x25edc70 con 0x260eb50 2024-09-13T17:10:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e6bb1740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x24d5950 con 0x25ece90 2024-09-13T17:10:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e0e9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e0e9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34344/0 (socket says 172.21.15.123:34344) 2024-09-13T17:10:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e0e9b700 1 -- 172.21.15.123:0/3125762244 learned_addr learned my addr 172.21.15.123:0/3125762244 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e1e9d700 1 --2- 172.21.15.123:0/3125762244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 0x2616850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e169c700 1 --2- 172.21.15.123:0/3125762244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 0x2609ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e0e9b700 1 -- 172.21.15.123:0/3125762244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 msgr2=0x2609ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/3125762244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 0x2609ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e0e9b700 1 -- 172.21.15.123:0/3125762244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 msgr2=0x2616850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:34.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/3125762244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 0x2616850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e0e9b700 1 -- 172.21.15.123:0/3125762244 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x24db450 con 0x260e230 2024-09-13T17:10:34.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/3125762244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260a3e0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0557c0 tx=0x7f58cc084000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f104e4f82c98e10c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58c37fe700 1 -- 172.21.15.123:0/3125762244 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc05e250 con 0x260e230 2024-09-13T17:10:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58c37fe700 1 -- 172.21.15.123:0/3125762244 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc011b00 con 0x260e230 2024-09-13T17:10:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58c37fe700 1 -- 172.21.15.123:0/3125762244 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc011c70 con 0x260e230 2024-09-13T17:10:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e6bb1740 1 -- 172.21.15.123:0/3125762244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 msgr2=0x260a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/3125762244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260a3e0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0557c0 tx=0x7f58cc084000 comp rx=0 tx=0).stop 2024-09-13T17:10:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e6bb1740 1 -- 172.21.15.123:0/3125762244 shutdown_connections 2024-09-13T17:10:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/3125762244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 0x2616850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/3125762244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x260a3e0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/3125762244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 0x2609ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e6bb1740 1 -- 172.21.15.123:0/3125762244 >> 172.21.15.123:0/3125762244 conn(0x23564d0 msgr2=0x25c8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:34.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e6bb1740 1 -- 172.21.15.123:0/3125762244 shutdown_connections 2024-09-13T17:10:34.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e6bb1740 1 -- 172.21.15.123:0/3125762244 wait complete. 2024-09-13T17:10:34.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e6bb1740 1 -- start start 2024-09-13T17:10:34.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.329+0000 7f58e6bb1740 1 Processor -- start 2024-09-13T17:10:34.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e6bb1740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 0x2611340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e6bb1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x2611880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e6bb1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 0x26726c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e6bb1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x260a300 con 0x260e230 2024-09-13T17:10:34.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e6bb1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2611dc0 con 0x260eb50 2024-09-13T17:10:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e6bb1740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x2614530 con 0x25ece90 2024-09-13T17:10:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e6bb1740 10 client.0 _ll_register_callbacks cb 0x24e0ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:10:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e0e9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x2611880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e0e9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x2611880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34354/0 (socket says 172.21.15.123:34354) 2024-09-13T17:10:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e0e9b700 1 -- 172.21.15.123:0/1989937484 learned_addr learned my addr 172.21.15.123:0/1989937484 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e169c700 1 --2- 172.21.15.123:0/1989937484 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 0x2611340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e1e9d700 1 --2- 172.21.15.123:0/1989937484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 0x26726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e0e9b700 1 -- 172.21.15.123:0/1989937484 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 msgr2=0x2611340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/1989937484 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 0x2611340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e0e9b700 1 -- 172.21.15.123:0/1989937484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 msgr2=0x26726c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/1989937484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 0x26726c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e0e9b700 1 -- 172.21.15.123:0/1989937484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d000f4e0 con 0x260e230 2024-09-13T17:10:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e0e9b700 1 --2- 172.21.15.123:0/1989937484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x2611880 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f58cc052360 tx=0x7f58cc052250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4389bf5102b90c4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-13T17:10:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58bbfff700 1 -- 172.21.15.123:0/1989937484 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc05e250 con 0x260e230 2024-09-13T17:10:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58bbfff700 1 -- 172.21.15.123:0/1989937484 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58cc055350 con 0x260e230 2024-09-13T17:10:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e6bb1740 1 -- 172.21.15.123:0/1989937484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58d00045a0 con 0x260e230 2024-09-13T17:10:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58bbfff700 1 -- 172.21.15.123:0/1989937484 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58cc055510 con 0x260e230 2024-09-13T17:10:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e6bb1740 10 client.7551 fetch_fsmap learned FSMap version 48 2024-09-13T17:10:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e6bb1740 1 -- 172.21.15.123:0/1989937484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x24cf720 con 0x260e230 2024-09-13T17:10:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58bbfff700 1 -- 172.21.15.123:0/1989937484 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d00045a0 con 0x260e230 2024-09-13T17:10:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58bbfff700 1 -- 172.21.15.123:0/1989937484 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 48) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f58cc05ddc0 con 0x260e230 2024-09-13T17:10:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e6bb1740 10 client.7551 fetch_fsmap finished waiting for FSMap version 48 2024-09-13T17:10:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e6bb1740 10 client.7551 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:10:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.333+0000 7f58e6bb1740 20 client.7551 populate_metadata read hostname 'smithi123' 2024-09-13T17:10:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/1989937484 >> [v2:172.21.15.123:6836/1688881065,v1:172.21.15.123:6837/1688881065] conn(0x2672ee0 0x25d4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 4 client.7551 mds_command: new command op to 7401 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:10:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 1 -- 172.21.15.123:0/1989937484 --> [v2:172.21.15.123:6836/1688881065,v1:172.21.15.123:6837/1688881065] -- command(tid 0: {"prefix": "status"}) v1 -- 0x23d21e0 con 0x2672ee0 2024-09-13T17:10:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e169c700 1 --2- 172.21.15.123:0/1989937484 >> [v2:172.21.15.123:6836/1688881065,v1:172.21.15.123:6837/1688881065] conn(0x2672ee0 0x25d4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e169c700 1 --2- 172.21.15.123:0/1989937484 >> [v2:172.21.15.123:6836/1688881065,v1:172.21.15.123:6837/1688881065] conn(0x2672ee0 0x25d4c50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15b27b419aaa7d57 server_cookie=4ddd800d5a8f42df in_seq=0 out_seq=0 2024-09-13T17:10:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58bbfff700 10 client.7551 ms_handle_connect on v2:172.21.15.123:6836/1688881065 2024-09-13T17:10:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58bbfff700 1 -- 172.21.15.123:0/1989937484 <== mds.0 v2:172.21.15.123:6836/1688881065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x23d21e0 con 0x2672ee0 2024-09-13T17:10:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58bbfff700 10 client.7551 handle_command_reply: tid=0 2024-09-13T17:10:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 1 client.7551 shutdown 2024-09-13T17:10:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 1 -- 172.21.15.123:0/1989937484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 msgr2=0x2611880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/1989937484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x2611880 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f58cc052360 tx=0x7f58cc052250 comp rx=0 tx=0).stop 2024-09-13T17:10:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 1 -- 172.21.15.123:0/1989937484 shutdown_connections 2024-09-13T17:10:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/1989937484 >> [v2:172.21.15.123:6836/1688881065,v1:172.21.15.123:6837/1688881065] conn(0x2672ee0 0x25d4c50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/1989937484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x260eb50 0x26726c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/1989937484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x260e230 0x2611880 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 1 --2- 172.21.15.123:0/1989937484 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x25ece90 0x2611340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58bbfff700 0 client.7551 ms_handle_reset on v2:172.21.15.123:6836/1688881065 2024-09-13T17:10:34.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 1 -- 172.21.15.123:0/1989937484 >> 172.21.15.123:0/1989937484 conn(0x23564d0 msgr2=0x2616850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:34.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 1 -- 172.21.15.123:0/1989937484 shutdown_connections 2024-09-13T17:10:34.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 1 -- 172.21.15.123:0/1989937484 wait complete. 2024-09-13T17:10:34.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e6bb1740 20 client.7551 trim_cache size 0 max 16384 2024-09-13T17:10:34.342 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:10:34.342 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "c45759e3-62b7-46ff-ad19-917097e4c126", 2024-09-13T17:10:34.343 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-13T17:10:34.343 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 7401, 2024-09-13T17:10:34.343 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-13T17:10:34.343 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-13T17:10:34.343 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-13T17:10:34.343 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 5.7480257080000001, 2024-09-13T17:10:34.343 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 48, 2024-09-13T17:10:34.343 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 98, 2024-09-13T17:10:34.343 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 98, 2024-09-13T17:10:34.343 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 10.186602462 2024-09-13T17:10:34.343 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:10:34.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e269e700 1 -- 172.21.15.123:0/2166406205 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f58c8066730 msgr2=0x7f58c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e269e700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f58c8066730 0x7f58c8068bf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f58d000bf00 tx=0x7f58d000b450 comp rx=0 tx=0).stop 2024-09-13T17:10:34.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e269e700 1 -- 172.21.15.123:0/2166406205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58dc0c9f80 msgr2=0x7f58dc1f27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e269e700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58dc0c9f80 0x7f58dc1f27e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0090b0 tx=0x7f58cc004770 comp rx=0 tx=0).stop 2024-09-13T17:10:34.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e269e700 1 -- 172.21.15.123:0/2166406205 shutdown_connections 2024-09-13T17:10:34.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e269e700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f58c8066730 0x7f58c8068bf0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e269e700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc0cd690 0x7f58dc0c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e269e700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58dc0c9f80 0x7f58dc1f27e0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e269e700 1 --2- 172.21.15.123:0/2166406205 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f58dc06c610 0x7f58dc1e3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e269e700 1 -- 172.21.15.123:0/2166406205 >> 172.21.15.123:0/2166406205 conn(0x7f58dc0b01d0 msgr2=0x7f58dc15bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:34.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e269e700 1 -- 172.21.15.123:0/2166406205 shutdown_connections 2024-09-13T17:10:34.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.337+0000 7f58e269e700 1 -- 172.21.15.123:0/2166406205 wait complete. 2024-09-13T17:10:34.355 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:10:34.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.465+0000 7ff83c88c700 1 Processor -- start 2024-09-13T17:10:34.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.465+0000 7ff83c88c700 1 -- start start 2024-09-13T17:10:34.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83c88c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff838071e60 0x7ff8380cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83c88c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838072280 con 0x7ff8381598b0 2024-09-13T17:10:34.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83c88c700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815d360 con 0x7ff8380cedc0 2024-09-13T17:10:34.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83c88c700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8380724c0 con 0x7ff838071e60 2024-09-13T17:10:34.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff836d9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff8381598b0 0x7ff8380ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58190/0 (socket says 172.21.15.123:58190) 2024-09-13T17:10:34.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff836d9d700 1 -- 172.21.15.123:0/1733733726 learned_addr learned my addr 172.21.15.123:0/1733733726 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:34.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83759e700 1 --2- 172.21.15.123:0/1733733726 >> v2:172.21.15.153:3300/0 conn(0x7ff838071e60 0x7ff8380cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff835d9b700 1 -- 172.21.15.123:0/1733733726 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677494541 0 0) 0x7ff82c001110 con 0x7ff8381598b0 2024-09-13T17:10:34.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff835d9b700 1 -- 172.21.15.123:0/1733733726 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8200035d0 con 0x7ff8381598b0 2024-09-13T17:10:34.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83759e700 1 -- 172.21.15.123:0/1733733726 >> v1:172.21.15.153:6789/0 conn(0x7ff8380cedc0 legacy=0x7ff838159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83759e700 1 -- 172.21.15.123:0/1733733726 >> v1:172.21.15.123:6789/0 conn(0x7ff8381598b0 legacy=0x7ff8380ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83759e700 1 -- 172.21.15.123:0/1733733726 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83815d5b0 con 0x7ff838071e60 2024-09-13T17:10:34.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83759e700 1 --2- 172.21.15.123:0/1733733726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff838071e60 0x7ff8380cdfd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff830009d90 tx=0x7ff83000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff054c1ded7f3265 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:34.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff835d9b700 1 -- 172.21.15.123:0/1733733726 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83000e070 con 0x7ff838071e60 2024-09-13T17:10:34.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff835d9b700 1 -- 172.21.15.123:0/1733733726 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83000bb20 con 0x7ff838071e60 2024-09-13T17:10:34.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff835d9b700 1 -- 172.21.15.123:0/1733733726 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83000be90 con 0x7ff838071e60 2024-09-13T17:10:34.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83c88c700 1 -- 172.21.15.123:0/1733733726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff838071e60 msgr2=0x7ff8380cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83c88c700 1 --2- 172.21.15.123:0/1733733726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff838071e60 0x7ff8380cdfd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff830009d90 tx=0x7ff83000b330 comp rx=0 tx=0).stop 2024-09-13T17:10:34.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83c88c700 1 -- 172.21.15.123:0/1733733726 shutdown_connections 2024-09-13T17:10:34.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83c88c700 1 --2- 172.21.15.123:0/1733733726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff838071e60 0x7ff8380cdfd0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83c88c700 1 -- 172.21.15.123:0/1733733726 >> 172.21.15.123:0/1733733726 conn(0x7ff838066150 msgr2=0x7ff838066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:34.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83c88c700 1 -- 172.21.15.123:0/1733733726 shutdown_connections 2024-09-13T17:10:34.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.469+0000 7ff83c88c700 1 -- 172.21.15.123:0/1733733726 wait complete. 2024-09-13T17:10:34.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83c88c700 1 Processor -- start 2024-09-13T17:10:34.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83c88c700 1 -- start start 2024-09-13T17:10:34.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83c88c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff838071e60 0x7ff8380ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83c88c700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8380cedc0 0x7ff838151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83c88c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8381598b0 0x7ff8381f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83c88c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838151740 con 0x7ff8381598b0 2024-09-13T17:10:34.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83c88c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838151970 con 0x7ff838071e60 2024-09-13T17:10:34.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83c88c700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff838151c50 con 0x7ff8380cedc0 2024-09-13T17:10:34.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8381598b0 0x7ff8381f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8381598b0 0x7ff8381f1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34362/0 (socket says 172.21.15.123:34362) 2024-09-13T17:10:34.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83759e700 1 -- 172.21.15.123:0/3987015670 learned_addr learned my addr 172.21.15.123:0/3987015670 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:34.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff836d9d700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff838071e60 0x7ff8380ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83659c700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8380cedc0 0x7ff838151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83759e700 1 -- 172.21.15.123:0/3987015670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8380cedc0 msgr2=0x7ff838151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83759e700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8380cedc0 0x7ff838151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83759e700 1 -- 172.21.15.123:0/3987015670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff838071e60 msgr2=0x7ff8380ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83759e700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff838071e60 0x7ff8380ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83759e700 1 -- 172.21.15.123:0/3987015670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff830009a70 con 0x7ff8381598b0 2024-09-13T17:10:34.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff836d9d700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff838071e60 0x7ff8380ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:34.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83759e700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8381598b0 0x7ff8381f1db0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7ff83000b370 tx=0x7ff830004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:34.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff81f7fe700 1 -- 172.21.15.123:0/3987015670 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830007000 con 0x7ff8381598b0 2024-09-13T17:10:34.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff81f7fe700 1 -- 172.21.15.123:0/3987015670 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff830012650 con 0x7ff8381598b0 2024-09-13T17:10:34.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff81f7fe700 1 -- 172.21.15.123:0/3987015670 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830012a00 con 0x7ff8381598b0 2024-09-13T17:10:34.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83c88c700 1 -- 172.21.15.123:0/3987015670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff838151f30 con 0x7ff8381598b0 2024-09-13T17:10:34.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.473+0000 7ff83c88c700 1 -- 172.21.15.123:0/3987015670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8381524f0 con 0x7ff8381598b0 2024-09-13T17:10:34.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.477+0000 7ff83c88c700 1 -- 172.21.15.123:0/3987015670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8380677f0 con 0x7ff8381598b0 2024-09-13T17:10:34.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.477+0000 7ff81f7fe700 1 -- 172.21.15.123:0/3987015670 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff830012b60 con 0x7ff8381598b0 2024-09-13T17:10:34.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.477+0000 7ff81f7fe700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff824066730 0x7ff824068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:34.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.477+0000 7ff81f7fe700 1 -- 172.21.15.123:0/3987015670 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff830086200 con 0x7ff8381598b0 2024-09-13T17:10:34.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.477+0000 7ff836d9d700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff824066730 0x7ff824068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:34.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.477+0000 7ff836d9d700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff824066730 0x7ff824068bf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff82c001270 tx=0x7ff82c009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:34.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.485+0000 7ff81f7fe700 1 -- 172.21.15.123:0/3987015670 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff830057140 con 0x7ff8381598b0 2024-09-13T17:10:34.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.689+0000 7ff83c88c700 1 -- 172.21.15.123:0/3987015670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff8380cdfd0 con 0x7ff8381598b0 2024-09-13T17:10:34.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.689+0000 7ff81f7fe700 1 -- 172.21.15.123:0/3987015670 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff830056cd0 con 0x7ff8381598b0 2024-09-13T17:10:34.693 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:10:34.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.693+0000 7ff83c88c700 1 -- 172.21.15.123:0/3987015670 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff824066730 msgr2=0x7ff824068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.693+0000 7ff83c88c700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff824066730 0x7ff824068bf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff82c001270 tx=0x7ff82c009040 comp rx=0 tx=0).stop 2024-09-13T17:10:34.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.693+0000 7ff83c88c700 1 -- 172.21.15.123:0/3987015670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8381598b0 msgr2=0x7ff8381f1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:34.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.693+0000 7ff83c88c700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8381598b0 0x7ff8381f1db0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7ff83000b370 tx=0x7ff830004af0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.693+0000 7ff83c88c700 1 -- 172.21.15.123:0/3987015670 shutdown_connections 2024-09-13T17:10:34.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.693+0000 7ff83c88c700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff824066730 0x7ff824068bf0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.693+0000 7ff83c88c700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8381598b0 0x7ff8381f1db0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.693+0000 7ff83c88c700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff8380cedc0 0x7ff838151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.693+0000 7ff83c88c700 1 --2- 172.21.15.123:0/3987015670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff838071e60 0x7ff8380ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:34.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.693+0000 7ff83c88c700 1 -- 172.21.15.123:0/3987015670 >> 172.21.15.123:0/3987015670 conn(0x7ff838066150 msgr2=0x7ff838066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:34.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.693+0000 7ff83c88c700 1 -- 172.21.15.123:0/3987015670 shutdown_connections 2024-09-13T17:10:34.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:34.693+0000 7ff83c88c700 1 -- 172.21.15.123:0/3987015670 wait complete. 2024-09-13T17:10:34.707 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:10:34.707 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:10:34.707 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-13T17:10:34.707 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:10:34.707 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:10:34.707 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:10:34.708 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:10:34.708 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:10:34.708 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:10:34.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:34.708 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-13T17:10:34.713 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:10:34.713 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:10:34.713 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:10:34.713 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:34.713 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42373sec preferred_lft 42373sec 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:10:34.714 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:b1:d7:75:e9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:34.715 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:10:34.715 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:34.715 INFO:teuthology.orchestra.run.smithi123.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:10:34.715 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether d6:8a:3c:97:49:a9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:34.715 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:10:34.715 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:34.715 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::a038:65ff:fec0:5513/64 scope link 2024-09-13T17:10:34.715 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:34.715 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:10:34.715 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether da:a9:95:cd:41:8c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:10:34.715 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::d8a9:95ff:fecd:418c/64 scope link 2024-09-13T17:10:34.715 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:34.715 INFO:teuthology.orchestra.run.smithi123.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:10:34.715 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether d6:8a:3c:97:49:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:10:34.716 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::d48a:3cff:fe97:49a9/64 scope link 2024-09-13T17:10:34.716 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:34.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:34.716 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:10:34.772 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-13T17:10:34.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:34.774 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-13T17:10:34.782 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-13T17:10:34.782 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:10:34.782 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:10:34.782 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:10:34.782 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:10:34.782 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:10:34.782 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:10:34.782 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:10:34.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:34.783 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-09-13T17:10:34.783 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-13T17:10:34.783 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:10:34.783 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:10:34.783 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:10:34.783 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-13T17:10:34.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:34.823 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-13T17:10:34.830 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:10:34.830 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:10:34.830 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:10:34.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:34.830 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-13T17:10:34.843 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:10:34.843 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:10:34.843 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:10:34.848 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:10:34.848 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:10:34.849 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:10:34.855 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:10:34.912 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:10:34.912 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:10:34.925 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:10:34.926 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:10:34.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:34.927 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:10:34.934 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:10:34.934 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:10:34.937 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:10:34.954 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:10:34.955 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:10:34.966 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:10:34.967 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:10:34.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:34.967 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:10:35.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:2024-09-13T17:10:35.021+0000 7ff96f060640 -1 init, newargv = 0x5623e08d22f0 newargc=15 2024-09-13T17:10:35.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[45979]: starting ceph client 2024-09-13T17:10:35.031 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[45979]: starting fuse 2024-09-13T17:10:36.117 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-09-13T17:10:36.136 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:10:36.136 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:10:36.147 INFO:teuthology.orchestra.run.smithi123.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:10:36.147 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:10:36.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:36.148 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-09-13T17:10:36.154 INFO:teuthology.orchestra.run.smithi123.stdout:52 2024-09-13T17:10:36.155 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:10:36.155 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:10:36.155 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2024-09-13T17:10:36.155 DEBUG:teuthology.orchestra.run.smithi123:> import re 2024-09-13T17:10:36.155 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-13T17:10:36.155 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2024-09-13T17:10:36.155 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:10:36.155 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2024-09-13T17:10:36.155 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:10:36.155 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2024-09-13T17:10:36.156 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:10:36.156 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:10:36.156 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2024-09-13T17:10:36.156 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2024-09-13T17:10:36.156 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2024-09-13T17:10:36.156 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2024-09-13T17:10:36.156 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:10:36.156 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2024-09-13T17:10:36.157 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:10:36.157 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:10:36.157 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:10:36.157 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2024-09-13T17:10:36.157 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2024-09-13T17:10:36.157 DEBUG:teuthology.orchestra.run.smithi123:> return f 2024-09-13T17:10:36.157 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:10:36.157 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-13T17:10:36.157 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.0")) 2024-09-13T17:10:36.157 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-13T17:10:36.239 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.0.45979.asok 2024-09-13T17:10:36.424 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45979.asok 2024-09-13T17:10:36.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:36.424 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45979.asok status 2024-09-13T17:10:36.568 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:10:36.568 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2024-09-13T17:10:36.569 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:10:36.569 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:10:36.569 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "0", 2024-09-13T17:10:36.569 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2024-09-13T17:10:36.569 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:10:36.569 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "45979", 2024-09-13T17:10:36.569 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2024-09-13T17:10:36.569 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:36.569 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2024-09-13T17:10:36.569 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2024-09-13T17:10:36.569 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 7309, 2024-09-13T17:10:36.569 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2024-09-13T17:10:36.569 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2024-09-13T17:10:36.570 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2024-09-13T17:10:36.570 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 7309 2024-09-13T17:10:36.570 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:36.570 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:10:36.570 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:10:36.570 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:10:36.570 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1222469091 2024-09-13T17:10:36.570 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-13T17:10:36.570 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:36.570 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-09-13T17:10:36.570 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-09-13T17:10:36.570 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:10:36.570 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1222469091 2024-09-13T17:10:36.570 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-13T17:10:36.571 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.7309 192.168.0.1:0/1222469091", 2024-09-13T17:10:36.571 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.1:0/1222469091", 2024-09-13T17:10:36.571 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2024-09-13T17:10:36.571 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 48, 2024-09-13T17:10:36.571 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 98, 2024-09-13T17:10:36.571 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:10:36.571 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2024-09-13T17:10:36.571 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2024-09-13T17:10:36.571 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:10:36.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:36.578 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2024-09-13T17:10:36.578 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:10:36.584 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2024-09-13T17:10:36.585 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:10:36.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:36.585 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:10:36.637 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:10:36.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.749+0000 7f94b64dd700 1 Processor -- start 2024-09-13T17:10:36.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.749+0000 7f94b64dd700 1 -- start start 2024-09-13T17:10:36.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f94b015e920 0x7f94b00caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94b00cb020 0x7f94b0161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94b015ed00 0x7f94b00cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b0162550 con 0x7f94b015e920 2024-09-13T17:10:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b00cd690 con 0x7f94b00cb020 2024-09-13T17:10:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b0161f90 con 0x7f94b015ed00 2024-09-13T17:10:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b54db700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f94b015e920 0x7f94b00caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b4cda700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94b00cb020 0x7f94b0161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b54db700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f94b015e920 0x7f94b00caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34378/0 (socket says 172.21.15.123:34378) 2024-09-13T17:10:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b54db700 1 -- 172.21.15.123:0/478849388 learned_addr learned my addr 172.21.15.123:0/478849388 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b5cdc700 1 --2- 172.21.15.123:0/478849388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94b015ed00 0x7f94b00cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b54db700 1 -- 172.21.15.123:0/478849388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94b015ed00 msgr2=0x7f94b00cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b54db700 1 --2- 172.21.15.123:0/478849388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94b015ed00 0x7f94b00cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:36.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b54db700 1 -- 172.21.15.123:0/478849388 >> v2:172.21.15.153:3300/0 conn(0x7f94b00cb020 msgr2=0x7f94b0161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:36.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b54db700 1 --2- 172.21.15.123:0/478849388 >> v2:172.21.15.153:3300/0 conn(0x7f94b00cb020 0x7f94b0161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:36.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b54db700 1 -- 172.21.15.123:0/478849388 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b0162270 con 0x7f94b015e920 2024-09-13T17:10:36.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b54db700 1 --2- 172.21.15.123:0/478849388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94b015e920 0x7f94b00caae0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f94b00cc740 tx=0x7f94a4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806a43d27f6ea19d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:36.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94affff700 1 -- 172.21.15.123:0/478849388 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4011830 con 0x7f94b015e920 2024-09-13T17:10:36.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94affff700 1 -- 172.21.15.123:0/478849388 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a4011990 con 0x7f94b015e920 2024-09-13T17:10:36.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94affff700 1 -- 172.21.15.123:0/478849388 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4011d20 con 0x7f94b015e920 2024-09-13T17:10:36.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 -- 172.21.15.123:0/478849388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94b015e920 msgr2=0x7f94b00caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:36.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 --2- 172.21.15.123:0/478849388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94b015e920 0x7f94b00caae0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f94b00cc740 tx=0x7f94a4009bf0 comp rx=0 tx=0).stop 2024-09-13T17:10:36.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 -- 172.21.15.123:0/478849388 shutdown_connections 2024-09-13T17:10:36.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 --2- 172.21.15.123:0/478849388 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94b015ed00 0x7f94b00cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:36.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 --2- 172.21.15.123:0/478849388 >> v2:172.21.15.153:3300/0 conn(0x7f94b00cb020 0x7f94b0161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:36.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 --2- 172.21.15.123:0/478849388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94b015e920 0x7f94b00caae0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:36.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 -- 172.21.15.123:0/478849388 >> 172.21.15.123:0/478849388 conn(0x7f94b0066150 msgr2=0x7f94b0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:36.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 -- 172.21.15.123:0/478849388 shutdown_connections 2024-09-13T17:10:36.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.753+0000 7f94b64dd700 1 -- 172.21.15.123:0/478849388 wait complete. 2024-09-13T17:10:36.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b64dd700 1 Processor -- start 2024-09-13T17:10:36.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b64dd700 1 -- start start 2024-09-13T17:10:36.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b64dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94b00cb020 0x7f94b01f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:36.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b64dd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94b015e920 0x7f94b00c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:36.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b64dd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94b015ed00 0x7f94b00c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:36.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b64dd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b00c5280 con 0x7f94b00cb020 2024-09-13T17:10:36.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b64dd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b00c5560 con 0x7f94b015e920 2024-09-13T17:10:36.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b64dd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b00c5840 con 0x7f94b015ed00 2024-09-13T17:10:36.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b54db700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94b00cb020 0x7f94b01f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:36.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b54db700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94b00cb020 0x7f94b01f3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34388/0 (socket says 172.21.15.123:34388) 2024-09-13T17:10:36.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b54db700 1 -- 172.21.15.123:0/1270073024 learned_addr learned my addr 172.21.15.123:0/1270073024 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:36.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b4cda700 1 --2- 172.21.15.123:0/1270073024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94b015e920 0x7f94b00c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:36.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b5cdc700 1 --2- 172.21.15.123:0/1270073024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94b015ed00 0x7f94b00c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:36.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b54db700 1 -- 172.21.15.123:0/1270073024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94b015ed00 msgr2=0x7f94b00c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:36.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b54db700 1 --2- 172.21.15.123:0/1270073024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94b015ed00 0x7f94b00c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:36.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b54db700 1 -- 172.21.15.123:0/1270073024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94b015e920 msgr2=0x7f94b00c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:36.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b54db700 1 --2- 172.21.15.123:0/1270073024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94b015e920 0x7f94b00c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:36.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b54db700 1 -- 172.21.15.123:0/1270073024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a4009570 con 0x7f94b00cb020 2024-09-13T17:10:36.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b54db700 1 --2- 172.21.15.123:0/1270073024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94b00cb020 0x7f94b01f3a70 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f94b00670e0 tx=0x7f94a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:36.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94adffb700 1 -- 172.21.15.123:0/1270073024 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4004240 con 0x7f94b00cb020 2024-09-13T17:10:36.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94adffb700 1 -- 172.21.15.123:0/1270073024 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a401f070 con 0x7f94b00cb020 2024-09-13T17:10:36.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b64dd700 1 -- 172.21.15.123:0/1270073024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b00c5b20 con 0x7f94b00cb020 2024-09-13T17:10:36.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94adffb700 1 -- 172.21.15.123:0/1270073024 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4004600 con 0x7f94b00cb020 2024-09-13T17:10:36.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.757+0000 7f94b64dd700 1 -- 172.21.15.123:0/1270073024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b01f3fb0 con 0x7f94b00cb020 2024-09-13T17:10:36.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.761+0000 7f94b64dd700 1 -- 172.21.15.123:0/1270073024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b00677f0 con 0x7f94b00cb020 2024-09-13T17:10:36.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.761+0000 7f94adffb700 1 -- 172.21.15.123:0/1270073024 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f94a4021030 con 0x7f94b00cb020 2024-09-13T17:10:36.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.761+0000 7f94adffb700 1 --2- 172.21.15.123:0/1270073024 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f949c066730 0x7f949c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:36.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.761+0000 7f94adffb700 1 -- 172.21.15.123:0/1270073024 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94a4085140 con 0x7f94b00cb020 2024-09-13T17:10:36.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.761+0000 7f94b4cda700 1 --2- 172.21.15.123:0/1270073024 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f949c066730 0x7f949c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:36.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.761+0000 7f94b4cda700 1 --2- 172.21.15.123:0/1270073024 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f949c066730 0x7f949c068bf0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f94b00cb420 tx=0x7f94a000b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:36.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.769+0000 7f94adffb700 1 -- 172.21.15.123:0/1270073024 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f94a40524e0 con 0x7f94b00cb020 2024-09-13T17:10:36.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.977+0000 7f94b64dd700 1 -- 172.21.15.123:0/1270073024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f94b0161540 con 0x7f94b00cb020 2024-09-13T17:10:36.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.977+0000 7f94adffb700 1 -- 172.21.15.123:0/1270073024 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f94a4055b00 con 0x7f94b00cb020 2024-09-13T17:10:36.979 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:10:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.977+0000 7f94b64dd700 1 -- 172.21.15.123:0/1270073024 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f949c066730 msgr2=0x7f949c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.977+0000 7f94b64dd700 1 --2- 172.21.15.123:0/1270073024 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f949c066730 0x7f949c068bf0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f94b00cb420 tx=0x7f94a000b040 comp rx=0 tx=0).stop 2024-09-13T17:10:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.977+0000 7f94b64dd700 1 -- 172.21.15.123:0/1270073024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94b00cb020 msgr2=0x7f94b01f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.977+0000 7f94b64dd700 1 --2- 172.21.15.123:0/1270073024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94b00cb020 0x7f94b01f3a70 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f94b00670e0 tx=0x7f94a4004770 comp rx=0 tx=0).stop 2024-09-13T17:10:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.977+0000 7f94b64dd700 1 -- 172.21.15.123:0/1270073024 shutdown_connections 2024-09-13T17:10:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.977+0000 7f94b64dd700 1 --2- 172.21.15.123:0/1270073024 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f949c066730 0x7f949c068bf0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.977+0000 7f94b64dd700 1 --2- 172.21.15.123:0/1270073024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94b015ed00 0x7f94b00c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.977+0000 7f94b64dd700 1 --2- 172.21.15.123:0/1270073024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94b015e920 0x7f94b00c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.977+0000 7f94b64dd700 1 --2- 172.21.15.123:0/1270073024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94b00cb020 0x7f94b01f3a70 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.977+0000 7f94b64dd700 1 -- 172.21.15.123:0/1270073024 >> 172.21.15.123:0/1270073024 conn(0x7f94b0066150 msgr2=0x7f94b00ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.977+0000 7f94b64dd700 1 -- 172.21.15.123:0/1270073024 shutdown_connections 2024-09-13T17:10:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:36.977+0000 7f94b64dd700 1 -- 172.21.15.123:0/1270073024 wait complete. 2024-09-13T17:10:36.993 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:10:36.993 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:10:36.993 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-13T17:10:36.993 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:10:36.993 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:10:36.994 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:10:36.994 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:10:36.994 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:10:36.994 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:10:36.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:36.994 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-13T17:10:37.003 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:10:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:10:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:10:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-13T17:10:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:37.003 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:10:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:37.003 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:10:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:37.004 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:10:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:37.004 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:10:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:10:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42374sec preferred_lft 42374sec 2024-09-13T17:10:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-09-13T17:10:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:37.004 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:10:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:73:6c:03:01 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:10:37.004 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:37.005 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:10:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:10:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:10:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::f82f:21ff:fe0c:65de/64 scope link 2024-09-13T17:10:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:37.005 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:10:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 36:6e:09:92:ff:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:10:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::346e:9ff:fe92:ffa0/64 scope link 2024-09-13T17:10:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:37.005 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:10:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether c6:e2:c1:7b:16:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:10:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::c4e2:c1ff:fe7b:1657/64 scope link 2024-09-13T17:10:37.005 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:10:37.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:37.006 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:10:37.060 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-13T17:10:37.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:37.062 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-13T17:10:37.069 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-13T17:10:37.069 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:10:37.070 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:10:37.070 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:10:37.070 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:10:37.070 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T17:10:37.070 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:10:37.070 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:10:37.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:37.070 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2024-09-13T17:10:37.070 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-13T17:10:37.070 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:10:37.070 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:10:37.070 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:10:37.071 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-13T17:10:37.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:37.107 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-13T17:10:37.113 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:10:37.113 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:10:37.113 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:10:37.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:37.114 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-09-13T17:10:37.173 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:10:37.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:10:37.173 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:10:37.178 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:10:37.178 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:10:37.178 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:10:37.185 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:10:37.198 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:10:37.198 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:10:37.210 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:10:37.210 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:10:37.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:37.211 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:10:37.258 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:10:37.259 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:10:37.261 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:10:37.280 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:10:37.280 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:10:37.294 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:10:37.295 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:10:37.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:37.295 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:10:37.350 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:2024-09-13T17:10:37.344+0000 7faeee49a640 -1 init, newargv = 0x55e25e899650 newargc=15 2024-09-13T17:10:37.351 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33769]: starting ceph client 2024-09-13T17:10:37.360 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33769]: starting fuse 2024-09-13T17:10:38.403 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-13T17:10:38.421 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:10:38.421 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:10:38.435 INFO:teuthology.orchestra.run.smithi153.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:10:38.435 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:10:38.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:38.436 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-13T17:10:38.442 INFO:teuthology.orchestra.run.smithi153.stdout:52 2024-09-13T17:10:38.443 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T17:10:38.443 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:10:38.443 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-09-13T17:10:38.443 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-09-13T17:10:38.443 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-13T17:10:38.443 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-09-13T17:10:38.443 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:38.443 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-09-13T17:10:38.443 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:10:38.443 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-09-13T17:10:38.443 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:10:38.443 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:38.443 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-09-13T17:10:38.444 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-09-13T17:10:38.444 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-09-13T17:10:38.444 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-09-13T17:10:38.444 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:38.444 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-09-13T17:10:38.444 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:10:38.444 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:10:38.444 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:10:38.444 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-09-13T17:10:38.444 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-09-13T17:10:38.444 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-09-13T17:10:38.444 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:10:38.444 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:38.444 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.1")) 2024-09-13T17:10:38.445 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-13T17:10:38.570 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.1.33769.asok 2024-09-13T17:10:38.753 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33769.asok 2024-09-13T17:10:38.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:38.753 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33769.asok status 2024-09-13T17:10:38.856 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-13T17:10:38.856 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-09-13T17:10:38.856 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:10:38.856 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:10:38.856 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "1", 2024-09-13T17:10:38.856 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-09-13T17:10:38.856 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:10:38.856 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "33769", 2024-09-13T17:10:38.856 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-09-13T17:10:38.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:10:38.857 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-09-13T17:10:38.857 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-09-13T17:10:38.857 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 7324, 2024-09-13T17:10:38.857 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-09-13T17:10:38.857 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-09-13T17:10:38.857 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-09-13T17:10:38.857 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 7324 2024-09-13T17:10:38.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:10:38.857 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:10:38.857 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:10:38.857 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:10:38.857 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 330901257 2024-09-13T17:10:38.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-13T17:10:38.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:10:38.858 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-13T17:10:38.858 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-13T17:10:38.858 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:10:38.858 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 330901257 2024-09-13T17:10:38.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-13T17:10:38.858 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.7324 192.168.0.1:0/330901257", 2024-09-13T17:10:38.858 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.1:0/330901257", 2024-09-13T17:10:38.858 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-09-13T17:10:38.858 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 48, 2024-09-13T17:10:38.858 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 98, 2024-09-13T17:10:38.858 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:10:38.859 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-09-13T17:10:38.859 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-09-13T17:10:38.859 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-13T17:10:38.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:38.866 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-09-13T17:10:38.866 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:10:38.871 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-09-13T17:10:38.871 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:10:38.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:38.871 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:10:38.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:38.882 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir_files) 2024-09-13T17:10:38.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:38.901 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir_data) 2024-09-13T17:10:38.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:38.959 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_files -v 100 ./subdir_files) 2024-09-13T17:10:38.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:38.980 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 104857600 ./subdir_data) 2024-09-13T17:10:38.995 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:10:38.995 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:39.003 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:10:39.003 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-13T17:10:39.003 DEBUG:teuthology.orchestra.run.smithi153:> import uuid 2024-09-13T17:10:39.003 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:39.003 DEBUG:teuthology.orchestra.run.smithi153:> n = 20 2024-09-13T17:10:39.003 DEBUG:teuthology.orchestra.run.smithi153:> create_hard_links = False 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> if 0 > 0: 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> create_hard_links = True 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> path = "/home/ubuntu/cephtest/mnt.1/subdir_files/file" 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> dpath = os.path.dirname(path) 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> fnameprefix = os.path.basename(path) 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> os.makedirs(dpath, exist_ok=True) 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> try: 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> for i in range(n): 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> with open(fpath, '"'"'w'"'"') as f: 2024-09-13T17:10:39.004 DEBUG:teuthology.orchestra.run.smithi153:> f.write(f"{i}") 2024-09-13T17:10:39.005 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2024-09-13T17:10:39.005 DEBUG:teuthology.orchestra.run.smithi153:> f.flush() 2024-09-13T17:10:39.005 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(f.fileno()) 2024-09-13T17:10:39.005 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2024-09-13T17:10:39.005 DEBUG:teuthology.orchestra.run.smithi153:> os.unlink(fpath) 2024-09-13T17:10:39.005 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2024-09-13T17:10:39.005 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(dirfd) 2024-09-13T17:10:39.005 DEBUG:teuthology.orchestra.run.smithi153:> if create_hard_links: 2024-09-13T17:10:39.005 DEBUG:teuthology.orchestra.run.smithi153:> for j in range(0): 2024-09-13T17:10:39.005 DEBUG:teuthology.orchestra.run.smithi153:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-13T17:10:39.005 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2024-09-13T17:10:39.005 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(dirfd) 2024-09-13T17:10:39.005 DEBUG:teuthology.orchestra.run.smithi153:> finally: 2024-09-13T17:10:39.005 DEBUG:teuthology.orchestra.run.smithi153:> os.close(dirfd) 2024-09-13T17:10:39.006 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-13T17:10:39.464 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:10:39.464 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:39.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:39.470 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec dd if=/dev/urandom of=subdir_data/file bs=1M conv=fdatasync count=20 seek=0) 2024-09-13T17:10:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:20+0 records in 2024-09-13T17:10:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:20+0 records out 2024-09-13T17:10:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:20971520 bytes (21 MB, 20 MiB) copied, 0.191115 s, 110 MB/s 2024-09-13T17:10:39.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:39.723 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_files -v 10 ./subdir_files) 2024-09-13T17:10:39.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:39.737 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1048576 ./subdir_data) 2024-09-13T17:10:39.793 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:10:39.793 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:39.801 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:10:39.801 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-13T17:10:39.801 DEBUG:teuthology.orchestra.run.smithi153:> import uuid 2024-09-13T17:10:39.801 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:39.801 DEBUG:teuthology.orchestra.run.smithi153:> n = 40 2024-09-13T17:10:39.801 DEBUG:teuthology.orchestra.run.smithi153:> create_hard_links = False 2024-09-13T17:10:39.801 DEBUG:teuthology.orchestra.run.smithi153:> if 0 > 0: 2024-09-13T17:10:39.801 DEBUG:teuthology.orchestra.run.smithi153:> create_hard_links = True 2024-09-13T17:10:39.801 DEBUG:teuthology.orchestra.run.smithi153:> path = "/home/ubuntu/cephtest/mnt.1/subdir_files/file" 2024-09-13T17:10:39.801 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> dpath = os.path.dirname(path) 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> fnameprefix = os.path.basename(path) 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> os.makedirs(dpath, exist_ok=True) 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> try: 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> for i in range(n): 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> with open(fpath, '"'"'w'"'"') as f: 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> f.write(f"{i}") 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> f.flush() 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(f.fileno()) 2024-09-13T17:10:39.802 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2024-09-13T17:10:39.803 DEBUG:teuthology.orchestra.run.smithi153:> os.unlink(fpath) 2024-09-13T17:10:39.803 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2024-09-13T17:10:39.803 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(dirfd) 2024-09-13T17:10:39.803 DEBUG:teuthology.orchestra.run.smithi153:> if create_hard_links: 2024-09-13T17:10:39.803 DEBUG:teuthology.orchestra.run.smithi153:> for j in range(0): 2024-09-13T17:10:39.803 DEBUG:teuthology.orchestra.run.smithi153:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-13T17:10:39.803 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2024-09-13T17:10:39.803 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(dirfd) 2024-09-13T17:10:39.803 DEBUG:teuthology.orchestra.run.smithi153:> finally: 2024-09-13T17:10:39.803 DEBUG:teuthology.orchestra.run.smithi153:> os.close(dirfd) 2024-09-13T17:10:39.804 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-13T17:10:40.152 INFO:teuthology.orchestra.run.smithi153.stderr:Traceback (most recent call last): 2024-09-13T17:10:40.153 INFO:teuthology.orchestra.run.smithi153.stderr: File "", line 20, in 2024-09-13T17:10:40.153 INFO:teuthology.orchestra.run.smithi153.stderr:OSError: [Errno 122] Disk quota exceeded: '/home/ubuntu/cephtest/mnt.1/subdir_files/file_20' 2024-09-13T17:10:40.251 INFO:teuthology.orchestra.run.smithi153.stderr:daemon-helper: command failed with exit status 1 2024-09-13T17:10:40.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:10:40.262 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:10:40.262 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:40.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:40.312 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec dd if=/dev/urandom of=subdir_data/file bs=1M conv=fdatasync count=40 seek=0) 2024-09-13T17:10:40.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:10:40.358 INFO:teuthology.orchestra.run.smithi153.stderr:dd: error writing 'subdir_data/file': Disk quota exceeded 2024-09-13T17:10:40.358 INFO:teuthology.orchestra.run.smithi153.stderr:3+0 records in 2024-09-13T17:10:40.358 INFO:teuthology.orchestra.run.smithi153.stderr:2+0 records out 2024-09-13T17:10:40.358 INFO:teuthology.orchestra.run.smithi153.stderr:2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0212677 s, 98.6 MB/s 2024-09-13T17:10:40.358 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:10:40.359 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:10:40.379 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:10:40.399 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:10:40.399 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:10:40.399 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:40.429 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:40.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.541+0000 7f3f37f21700 1 Processor -- start 2024-09-13T17:10:40.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.541+0000 7f3f37f21700 1 -- start start 2024-09-13T17:10:40.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.541+0000 7f3f37f21700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f3015cf10 0x7f3f300ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.541+0000 7f3f37f21700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3f300d3790 0x7f3f300d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.541+0000 7f3f37f21700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f300d1210 con 0x7f3f300cf4f0 2024-09-13T17:10:40.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.541+0000 7f3f37f21700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3015d2f0 con 0x7f3f300d3790 2024-09-13T17:10:40.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.541+0000 7f3f37f21700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f300cec60 con 0x7f3f3015cf10 2024-09-13T17:10:40.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f354bc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3f300d3790 0x7f3f300d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f354bc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3f300d3790 0x7f3f300d16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34394/0 (socket says 172.21.15.123:34394) 2024-09-13T17:10:40.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f354bc700 1 -- 172.21.15.123:0/3535730838 learned_addr learned my addr 172.21.15.123:0/3535730838 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:40.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f35cbd700 1 --2- 172.21.15.123:0/3535730838 >> v2:172.21.15.153:3300/0 conn(0x7f3f3015cf10 0x7f3f300ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f35cbd700 1 -- 172.21.15.123:0/3535730838 >> v2:172.21.15.123:3300/0 conn(0x7f3f300d3790 msgr2=0x7f3f300d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:40.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f35cbd700 1 --2- 172.21.15.123:0/3535730838 >> v2:172.21.15.123:3300/0 conn(0x7f3f300d3790 0x7f3f300d16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f35cbd700 1 -- 172.21.15.123:0/3535730838 >> v1:172.21.15.153:6789/0 conn(0x7f3f300cf4f0 legacy=0x7f3f300cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:40.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f35cbd700 1 -- 172.21.15.123:0/3535730838 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f300d08e0 con 0x7f3f3015cf10 2024-09-13T17:10:40.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f354bc700 1 --2- 172.21.15.123:0/3535730838 >> v2:172.21.15.123:3300/0 conn(0x7f3f300d3790 0x7f3f300d16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f35cbd700 1 --2- 172.21.15.123:0/3535730838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f3015cf10 0x7f3f300ce3d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3f3008c650 tx=0x7f3f2c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c491bbbb653a76c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f34cbb700 1 -- 172.21.15.123:0/3535730838 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c005e50 con 0x7f3f3015cf10 2024-09-13T17:10:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f34cbb700 1 -- 172.21.15.123:0/3535730838 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c006030 con 0x7f3f3015cf10 2024-09-13T17:10:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f34cbb700 1 -- 172.21.15.123:0/3535730838 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0063c0 con 0x7f3f3015cf10 2024-09-13T17:10:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f37f21700 1 -- 172.21.15.123:0/3535730838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f3015cf10 msgr2=0x7f3f300ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f37f21700 1 --2- 172.21.15.123:0/3535730838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f3015cf10 0x7f3f300ce3d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3f3008c650 tx=0x7f3f2c009b20 comp rx=0 tx=0).stop 2024-09-13T17:10:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f37f21700 1 -- 172.21.15.123:0/3535730838 shutdown_connections 2024-09-13T17:10:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f37f21700 1 --2- 172.21.15.123:0/3535730838 >> v2:172.21.15.123:3300/0 conn(0x7f3f300d3790 0x7f3f300d16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f37f21700 1 --2- 172.21.15.123:0/3535730838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f3015cf10 0x7f3f300ce3d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f37f21700 1 -- 172.21.15.123:0/3535730838 >> 172.21.15.123:0/3535730838 conn(0x7f3f300d2c70 msgr2=0x7f3f300d3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f37f21700 1 -- 172.21.15.123:0/3535730838 shutdown_connections 2024-09-13T17:10:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.545+0000 7f3f37f21700 1 -- 172.21.15.123:0/3535730838 wait complete. 2024-09-13T17:10:40.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f37f21700 1 Processor -- start 2024-09-13T17:10:40.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f37f21700 1 -- start start 2024-09-13T17:10:40.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f37f21700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f300cf4f0 0x7f3f3014d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f37f21700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f300d3790 0x7f3f3015d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f37f21700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f3015cf10 0x7f3f3015f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f37f21700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3014dab0 con 0x7f3f300cf4f0 2024-09-13T17:10:40.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f37f21700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3015e930 con 0x7f3f3015cf10 2024-09-13T17:10:40.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f37f21700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3015ddb0 con 0x7f3f300d3790 2024-09-13T17:10:40.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f35cbd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f300cf4f0 0x7f3f3014d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f35cbd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f300cf4f0 0x7f3f3014d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34400/0 (socket says 172.21.15.123:34400) 2024-09-13T17:10:40.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f35cbd700 1 -- 172.21.15.123:0/3871409374 learned_addr learned my addr 172.21.15.123:0/3871409374 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:40.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f354bc700 1 --2- 172.21.15.123:0/3871409374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f300d3790 0x7f3f3015d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f364be700 1 --2- 172.21.15.123:0/3871409374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f3015cf10 0x7f3f3015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f35cbd700 1 -- 172.21.15.123:0/3871409374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f300d3790 msgr2=0x7f3f3015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:40.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f35cbd700 1 --2- 172.21.15.123:0/3871409374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f300d3790 0x7f3f3015d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f35cbd700 1 -- 172.21.15.123:0/3871409374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f3015cf10 msgr2=0x7f3f3015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:40.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f35cbd700 1 --2- 172.21.15.123:0/3871409374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f3015cf10 0x7f3f3015f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f35cbd700 1 -- 172.21.15.123:0/3871409374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f20009570 con 0x7f3f300cf4f0 2024-09-13T17:10:40.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f35cbd700 1 --2- 172.21.15.123:0/3871409374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f300cf4f0 0x7f3f3014d570 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c000c00 tx=0x7f3f2c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:40.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.549+0000 7f3f267fc700 1 -- 172.21.15.123:0/3871409374 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0036c0 con 0x7f3f300cf4f0 2024-09-13T17:10:40.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.553+0000 7f3f267fc700 1 -- 172.21.15.123:0/3871409374 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c020070 con 0x7f3f300cf4f0 2024-09-13T17:10:40.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.553+0000 7f3f267fc700 1 -- 172.21.15.123:0/3871409374 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c003a60 con 0x7f3f300cf4f0 2024-09-13T17:10:40.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.553+0000 7f3f37f21700 1 -- 172.21.15.123:0/3871409374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2c009450 con 0x7f3f300cf4f0 2024-09-13T17:10:40.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.553+0000 7f3f37f21700 1 -- 172.21.15.123:0/3871409374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3015e370 con 0x7f3f300cf4f0 2024-09-13T17:10:40.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.553+0000 7f3f37f21700 1 -- 172.21.15.123:0/3871409374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f300d16a0 con 0x7f3f300cf4f0 2024-09-13T17:10:40.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.553+0000 7f3f267fc700 1 -- 172.21.15.123:0/3871409374 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3f2c022030 con 0x7f3f300cf4f0 2024-09-13T17:10:40.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.557+0000 7f3f267fc700 1 --2- 172.21.15.123:0/3871409374 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3f14066730 0x7f3f14068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.557+0000 7f3f354bc700 1 --2- 172.21.15.123:0/3871409374 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3f14066730 0x7f3f14068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.557+0000 7f3f267fc700 1 -- 172.21.15.123:0/3871409374 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f2c085510 con 0x7f3f300cf4f0 2024-09-13T17:10:40.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.557+0000 7f3f354bc700 1 --2- 172.21.15.123:0/3871409374 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3f14066730 0x7f3f14068bf0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3f301f5cd0 tx=0x7f3f200092e0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:40.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.561+0000 7f3f267fc700 1 -- 172.21.15.123:0/3871409374 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3f2c0528f0 con 0x7f3f300cf4f0 2024-09-13T17:10:40.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.733+0000 7f3f37f21700 1 -- 172.21.15.123:0/3871409374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f300d1fa0 con 0x7f3f300cf4f0 2024-09-13T17:10:40.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.733+0000 7f3f267fc700 1 -- 172.21.15.123:0/3871409374 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16556 (secure 0 0 0) 0x7f3f2c025e60 con 0x7f3f300cf4f0 2024-09-13T17:10:40.737 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:40.738 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":98,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:29.590478+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:10:26.903248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T17:10:27.570928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:40.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.737+0000 7f3f37f21700 1 -- 172.21.15.123:0/3871409374 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3f14066730 msgr2=0x7f3f14068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:40.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.737+0000 7f3f37f21700 1 --2- 172.21.15.123:0/3871409374 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3f14066730 0x7f3f14068bf0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3f301f5cd0 tx=0x7f3f200092e0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.737+0000 7f3f37f21700 1 -- 172.21.15.123:0/3871409374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f300cf4f0 msgr2=0x7f3f3014d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:40.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.737+0000 7f3f37f21700 1 --2- 172.21.15.123:0/3871409374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f300cf4f0 0x7f3f3014d570 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c000c00 tx=0x7f3f2c004770 comp rx=0 tx=0).stop 2024-09-13T17:10:40.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.737+0000 7f3f37f21700 1 -- 172.21.15.123:0/3871409374 shutdown_connections 2024-09-13T17:10:40.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.737+0000 7f3f37f21700 1 --2- 172.21.15.123:0/3871409374 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3f14066730 0x7f3f14068bf0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.737+0000 7f3f37f21700 1 --2- 172.21.15.123:0/3871409374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f3015cf10 0x7f3f3015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.737+0000 7f3f37f21700 1 --2- 172.21.15.123:0/3871409374 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f300d3790 0x7f3f3015d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.737+0000 7f3f37f21700 1 --2- 172.21.15.123:0/3871409374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f300cf4f0 0x7f3f3014d570 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.737+0000 7f3f37f21700 1 -- 172.21.15.123:0/3871409374 >> 172.21.15.123:0/3871409374 conn(0x7f3f300d2c70 msgr2=0x7f3f3015a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:40.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.737+0000 7f3f37f21700 1 -- 172.21.15.123:0/3871409374 shutdown_connections 2024-09-13T17:10:40.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.737+0000 7f3f37f21700 1 -- 172.21.15.123:0/3871409374 wait complete. 2024-09-13T17:10:40.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:10:26.903248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:10:27.570928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:10:40.753 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:10:40.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.865+0000 7f219b3d7700 1 Processor -- start 2024-09-13T17:10:40.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.865+0000 7f219b3d7700 1 -- start start 2024-09-13T17:10:40.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219b3d7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21941506b0 0x7f21940b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219b3d7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21940b37a0 0x7f21940b4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219b3d7700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f219415d4c0 0x7f219415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219b3d7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21940b3310 con 0x7f21940b37a0 2024-09-13T17:10:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219b3d7700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219415e280 con 0x7f21941506b0 2024-09-13T17:10:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219b3d7700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21940b29e0 con 0x7f219415d4c0 2024-09-13T17:10:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f2199bd4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21940b37a0 0x7f21940b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219abd6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f219415d4c0 0x7f219415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219abd6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f219415d4c0 0x7f219415d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:35922/0 (socket says 172.21.15.123:35922) 2024-09-13T17:10:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f2199bd4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21940b37a0 0x7f21940b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34408/0 (socket says 172.21.15.123:34408) 2024-09-13T17:10:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219abd6700 1 -- 172.21.15.123:0/4152445648 learned_addr learned my addr 172.21.15.123:0/4152445648 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219a3d5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21941506b0 0x7f21940b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219abd6700 1 -- 172.21.15.123:0/4152445648 >> v2:172.21.15.153:3300/0 conn(0x7f21941506b0 msgr2=0x7f21940b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:40.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219abd6700 1 --2- 172.21.15.123:0/4152445648 >> v2:172.21.15.153:3300/0 conn(0x7f21941506b0 0x7f21940b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219abd6700 1 -- 172.21.15.123:0/4152445648 >> v2:172.21.15.123:3300/0 conn(0x7f21940b37a0 msgr2=0x7f21940b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:40.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219abd6700 1 --2- 172.21.15.123:0/4152445648 >> v2:172.21.15.123:3300/0 conn(0x7f21940b37a0 0x7f21940b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219abd6700 1 -- 172.21.15.123:0/4152445648 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21940b2cc0 con 0x7f219415d4c0 2024-09-13T17:10:40.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f2199bd4700 1 --2- 172.21.15.123:0/4152445648 >> v2:172.21.15.123:3300/0 conn(0x7f21940b37a0 0x7f21940b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:40.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f219abd6700 1 --2- 172.21.15.123:0/4152445648 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f219415d4c0 0x7f219415d950 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f21940b4f80 tx=0x7f218c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7a92350a3f971ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:40.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f21993d3700 1 -- 172.21.15.123:0/4152445648 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c00e070 con 0x7f219415d4c0 2024-09-13T17:10:40.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f21993d3700 1 -- 172.21.15.123:0/4152445648 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c00b910 con 0x7f219415d4c0 2024-09-13T17:10:40.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.869+0000 7f21993d3700 1 -- 172.21.15.123:0/4152445648 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c00bcc0 con 0x7f219415d4c0 2024-09-13T17:10:40.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.873+0000 7f219b3d7700 1 -- 172.21.15.123:0/4152445648 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f219415d4c0 msgr2=0x7f219415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:40.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.873+0000 7f219b3d7700 1 --2- 172.21.15.123:0/4152445648 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f219415d4c0 0x7f219415d950 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f21940b4f80 tx=0x7f218c00b330 comp rx=0 tx=0).stop 2024-09-13T17:10:40.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.873+0000 7f219b3d7700 1 -- 172.21.15.123:0/4152445648 shutdown_connections 2024-09-13T17:10:40.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.873+0000 7f219b3d7700 1 --2- 172.21.15.123:0/4152445648 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f219415d4c0 0x7f219415d950 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.873+0000 7f219b3d7700 1 --2- 172.21.15.123:0/4152445648 >> v2:172.21.15.123:3300/0 conn(0x7f21940b37a0 0x7f21940b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.873+0000 7f219b3d7700 1 --2- 172.21.15.123:0/4152445648 >> v2:172.21.15.153:3300/0 conn(0x7f21941506b0 0x7f21940b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.873+0000 7f219b3d7700 1 -- 172.21.15.123:0/4152445648 >> 172.21.15.123:0/4152445648 conn(0x7f2194066780 msgr2=0x7f21940719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:40.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.873+0000 7f219b3d7700 1 -- 172.21.15.123:0/4152445648 shutdown_connections 2024-09-13T17:10:40.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.873+0000 7f219b3d7700 1 -- 172.21.15.123:0/4152445648 wait complete. 2024-09-13T17:10:40.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.873+0000 7f219b3d7700 1 Processor -- start 2024-09-13T17:10:40.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.873+0000 7f219b3d7700 1 -- start start 2024-09-13T17:10:40.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219b3d7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21940b37a0 0x7f2194153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219b3d7700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21941506b0 0x7f219413e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219b3d7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f219415d4c0 0x7f21940ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219b3d7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219414fa90 con 0x7f21940b37a0 2024-09-13T17:10:40.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219b3d7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219414ee80 con 0x7f219415d4c0 2024-09-13T17:10:40.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219b3d7700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219414f160 con 0x7f21941506b0 2024-09-13T17:10:40.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219a3d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21940b37a0 0x7f2194153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219a3d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21940b37a0 0x7f2194153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34418/0 (socket says 172.21.15.123:34418) 2024-09-13T17:10:40.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219a3d5700 1 -- 172.21.15.123:0/3001401104 learned_addr learned my addr 172.21.15.123:0/3001401104 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:40.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219abd6700 1 --2- 172.21.15.123:0/3001401104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f219415d4c0 0x7f21940ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f2199bd4700 1 --2- 172.21.15.123:0/3001401104 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21941506b0 0x7f219413e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219a3d5700 1 -- 172.21.15.123:0/3001401104 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21941506b0 msgr2=0x7f219413e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:40.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219a3d5700 1 --2- 172.21.15.123:0/3001401104 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21941506b0 0x7f219413e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219a3d5700 1 -- 172.21.15.123:0/3001401104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f219415d4c0 msgr2=0x7f21940ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:40.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219a3d5700 1 --2- 172.21.15.123:0/3001401104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f219415d4c0 0x7f21940ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219a3d5700 1 -- 172.21.15.123:0/3001401104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21840094b0 con 0x7f21940b37a0 2024-09-13T17:10:40.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219a3d5700 1 --2- 172.21.15.123:0/3001401104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21940b37a0 0x7f2194153b10 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f219000e9d0 tx=0x7f219000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:40.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f218affd700 1 -- 172.21.15.123:0/3001401104 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190009720 con 0x7f21940b37a0 2024-09-13T17:10:40.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f218affd700 1 -- 172.21.15.123:0/3001401104 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219000c850 con 0x7f21940b37a0 2024-09-13T17:10:40.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219b3d7700 1 -- 172.21.15.123:0/3001401104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218c009b30 con 0x7f21940b37a0 2024-09-13T17:10:40.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f218affd700 1 -- 172.21.15.123:0/3001401104 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219000cbc0 con 0x7f21940b37a0 2024-09-13T17:10:40.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219b3d7700 1 -- 172.21.15.123:0/3001401104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219414f720 con 0x7f21940b37a0 2024-09-13T17:10:40.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.877+0000 7f219b3d7700 1 -- 172.21.15.123:0/3001401104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219415d950 con 0x7f21940b37a0 2024-09-13T17:10:40.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.881+0000 7f218affd700 1 -- 172.21.15.123:0/3001401104 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f219000cd20 con 0x7f21940b37a0 2024-09-13T17:10:40.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.881+0000 7f218affd700 1 --2- 172.21.15.123:0/3001401104 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2178066730 0x7f2178068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.881+0000 7f218affd700 1 -- 172.21.15.123:0/3001401104 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2190084310 con 0x7f21940b37a0 2024-09-13T17:10:40.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.881+0000 7f2199bd4700 1 --2- 172.21.15.123:0/3001401104 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2178066730 0x7f2178068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.881+0000 7f2199bd4700 1 --2- 172.21.15.123:0/3001401104 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2178066730 0x7f2178068bf0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f219406e7b0 tx=0x7f2184008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:40.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:40.885+0000 7f218affd700 1 -- 172.21.15.123:0/3001401104 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2190051600 con 0x7f21940b37a0 2024-09-13T17:10:41.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.053+0000 7f219b3d7700 1 -- 172.21.15.123:0/3001401104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f219406e500 con 0x7f21940b37a0 2024-09-13T17:10:41.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.057+0000 7f218affd700 1 -- 172.21.15.123:0/3001401104 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2190054c20 con 0x7f21940b37a0 2024-09-13T17:10:41.058 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:10:41.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.057+0000 7f219b3d7700 1 -- 172.21.15.123:0/3001401104 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2178066730 msgr2=0x7f2178068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.057+0000 7f219b3d7700 1 --2- 172.21.15.123:0/3001401104 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2178066730 0x7f2178068bf0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f219406e7b0 tx=0x7f2184008040 comp rx=0 tx=0).stop 2024-09-13T17:10:41.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.057+0000 7f219b3d7700 1 -- 172.21.15.123:0/3001401104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21940b37a0 msgr2=0x7f2194153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.057+0000 7f219b3d7700 1 --2- 172.21.15.123:0/3001401104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21940b37a0 0x7f2194153b10 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f219000e9d0 tx=0x7f219000ed90 comp rx=0 tx=0).stop 2024-09-13T17:10:41.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.057+0000 7f219b3d7700 1 -- 172.21.15.123:0/3001401104 shutdown_connections 2024-09-13T17:10:41.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.057+0000 7f219b3d7700 1 --2- 172.21.15.123:0/3001401104 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2178066730 0x7f2178068bf0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.057+0000 7f219b3d7700 1 --2- 172.21.15.123:0/3001401104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f219415d4c0 0x7f21940ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.057+0000 7f219b3d7700 1 --2- 172.21.15.123:0/3001401104 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f21941506b0 0x7f219413e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.057+0000 7f219b3d7700 1 --2- 172.21.15.123:0/3001401104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21940b37a0 0x7f2194153b10 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.057+0000 7f219b3d7700 1 -- 172.21.15.123:0/3001401104 >> 172.21.15.123:0/3001401104 conn(0x7f2194066780 msgr2=0x7f21941592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:41.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.057+0000 7f219b3d7700 1 -- 172.21.15.123:0/3001401104 shutdown_connections 2024-09-13T17:10:41.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.057+0000 7f219b3d7700 1 -- 172.21.15.123:0/3001401104 wait complete. 2024-09-13T17:10:41.072 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:10:41.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.185+0000 7ff774c22700 1 Processor -- start 2024-09-13T17:10:41.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.185+0000 7ff774c22700 1 -- start start 2024-09-13T17:10:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff774c22700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700d0be0 0x7ff7700af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff774c22700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7700cf740 con 0x7ff7700cd2b0 2024-09-13T17:10:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff774c22700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7700cb2c0 con 0x7ff7700ce790 2024-09-13T17:10:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff774c22700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700b61f0 con 0x7ff7700d0be0 2024-09-13T17:10:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff76effd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff7700cd2b0 0x7ff77015a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58198/0 (socket says 172.21.15.123:58198) 2024-09-13T17:10:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff76effd700 1 -- 172.21.15.123:0/3718519242 learned_addr learned my addr 172.21.15.123:0/3718519242 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff76ffff700 1 --2- 172.21.15.123:0/3718519242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700d0be0 0x7ff7700af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff76e7fc700 1 -- 172.21.15.123:0/3718519242 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173345597 0 0) 0x7ff7700cf740 con 0x7ff7700cd2b0 2024-09-13T17:10:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff76e7fc700 1 -- 172.21.15.123:0/3718519242 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff75c0035d0 con 0x7ff7700cd2b0 2024-09-13T17:10:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff76e7fc700 1 -- 172.21.15.123:0/3718519242 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 357802693 0 0) 0x7ff75c0035d0 con 0x7ff7700cd2b0 2024-09-13T17:10:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff76ffff700 1 -- 172.21.15.123:0/3718519242 >> v1:172.21.15.153:6789/0 conn(0x7ff7700ce790 legacy=0x7ff77006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff76ffff700 1 -- 172.21.15.123:0/3718519242 >> v1:172.21.15.123:6789/0 conn(0x7ff7700cd2b0 legacy=0x7ff77015a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff76ffff700 1 -- 172.21.15.123:0/3718519242 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7700cd770 con 0x7ff7700d0be0 2024-09-13T17:10:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff76ffff700 1 --2- 172.21.15.123:0/3718519242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700d0be0 0x7ff7700af520 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff768009dc0 tx=0x7ff76800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d254ff464b48fe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff76e7fc700 1 -- 172.21.15.123:0/3718519242 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76800e070 con 0x7ff7700d0be0 2024-09-13T17:10:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff76e7fc700 1 -- 172.21.15.123:0/3718519242 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff768003a40 con 0x7ff7700d0be0 2024-09-13T17:10:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.189+0000 7ff76e7fc700 1 -- 172.21.15.123:0/3718519242 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760001670 con 0x7ff7700d0be0 2024-09-13T17:10:41.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.193+0000 7ff774c22700 1 -- 172.21.15.123:0/3718519242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700d0be0 msgr2=0x7ff7700af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.193+0000 7ff774c22700 1 --2- 172.21.15.123:0/3718519242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700d0be0 0x7ff7700af520 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff768009dc0 tx=0x7ff76800b330 comp rx=0 tx=0).stop 2024-09-13T17:10:41.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.193+0000 7ff774c22700 1 -- 172.21.15.123:0/3718519242 shutdown_connections 2024-09-13T17:10:41.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.193+0000 7ff774c22700 1 --2- 172.21.15.123:0/3718519242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700d0be0 0x7ff7700af520 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.193+0000 7ff774c22700 1 -- 172.21.15.123:0/3718519242 >> 172.21.15.123:0/3718519242 conn(0x7ff77006e090 msgr2=0x7ff77006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:41.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.193+0000 7ff774c22700 1 -- 172.21.15.123:0/3718519242 shutdown_connections 2024-09-13T17:10:41.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.193+0000 7ff774c22700 1 -- 172.21.15.123:0/3718519242 wait complete. 2024-09-13T17:10:41.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.193+0000 7ff774c22700 1 Processor -- start 2024-09-13T17:10:41.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.193+0000 7ff774c22700 1 -- start start 2024-09-13T17:10:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff774c22700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700cd2b0 0x7ff77015b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff774c22700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700ce790 0x7ff7700aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff774c22700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700d0be0 0x7ff7700ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff774c22700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7701f0830 con 0x7ff7700ce790 2024-09-13T17:10:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff774c22700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700ab640 con 0x7ff7700cd2b0 2024-09-13T17:10:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff774c22700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7701f04a0 con 0x7ff7700d0be0 2024-09-13T17:10:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff76effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700ce790 0x7ff7700aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff76f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700cd2b0 0x7ff77015b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff76ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700d0be0 0x7ff7700ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff76f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700cd2b0 0x7ff77015b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:56808/0 (socket says 172.21.15.123:56808) 2024-09-13T17:10:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff76effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700ce790 0x7ff7700aa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34434/0 (socket says 172.21.15.123:34434) 2024-09-13T17:10:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff76ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700d0be0 0x7ff7700ac1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:35952/0 (socket says 172.21.15.123:35952) 2024-09-13T17:10:41.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff76effd700 1 -- 172.21.15.123:0/3935961667 learned_addr learned my addr 172.21.15.123:0/3935961667 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff76effd700 1 -- 172.21.15.123:0/3935961667 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700d0be0 msgr2=0x7ff7700ac1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff76effd700 1 --2- 172.21.15.123:0/3935961667 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700d0be0 0x7ff7700ac1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff76effd700 1 -- 172.21.15.123:0/3935961667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700cd2b0 msgr2=0x7ff77015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff76effd700 1 --2- 172.21.15.123:0/3935961667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700cd2b0 0x7ff77015b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff76effd700 1 -- 172.21.15.123:0/3935961667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff768009a70 con 0x7ff7700ce790 2024-09-13T17:10:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff76f7fe700 1 --2- 172.21.15.123:0/3935961667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700cd2b0 0x7ff77015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff76effd700 1 --2- 172.21.15.123:0/3935961667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700ce790 0x7ff7700aa3b0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff76000c780 tx=0x7ff76000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff767fff700 1 -- 172.21.15.123:0/3935961667 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760004ca0 con 0x7ff7700ce790 2024-09-13T17:10:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff767fff700 1 -- 172.21.15.123:0/3935961667 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff760004e20 con 0x7ff7700ce790 2024-09-13T17:10:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff774c22700 1 -- 172.21.15.123:0/3935961667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77015b5f0 con 0x7ff7700ce790 2024-09-13T17:10:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff767fff700 1 -- 172.21.15.123:0/3935961667 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760007310 con 0x7ff7700ce790 2024-09-13T17:10:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff774c22700 1 -- 172.21.15.123:0/3935961667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7700ab080 con 0x7ff7700ce790 2024-09-13T17:10:41.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.197+0000 7ff774c22700 1 -- 172.21.15.123:0/3935961667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7701f0970 con 0x7ff7700ce790 2024-09-13T17:10:41.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.201+0000 7ff767fff700 1 -- 172.21.15.123:0/3935961667 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff760007470 con 0x7ff7700ce790 2024-09-13T17:10:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.201+0000 7ff767fff700 1 --2- 172.21.15.123:0/3935961667 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff750066730 0x7ff750068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.201+0000 7ff767fff700 1 -- 172.21.15.123:0/3935961667 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff760083f00 con 0x7ff7700ce790 2024-09-13T17:10:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.201+0000 7ff76f7fe700 1 --2- 172.21.15.123:0/3935961667 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff750066730 0x7ff750068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.201+0000 7ff76f7fe700 1 --2- 172.21.15.123:0/3935961667 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff750066730 0x7ff750068bf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff758000f60 tx=0x7ff758009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:41.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.209+0000 7ff767fff700 1 -- 172.21.15.123:0/3935961667 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff7701f0970 con 0x7ff7700ce790 2024-09-13T17:10:41.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.377+0000 7ff774c22700 1 -- 172.21.15.123:0/3935961667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7701f0970 con 0x7ff7700ce790 2024-09-13T17:10:41.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.377+0000 7ff767fff700 1 -- 172.21.15.123:0/3935961667 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff7701f0970 con 0x7ff7700ce790 2024-09-13T17:10:41.381 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:10:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.381+0000 7ff774c22700 1 -- 172.21.15.123:0/3935961667 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff750066730 msgr2=0x7ff750068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.381+0000 7ff774c22700 1 --2- 172.21.15.123:0/3935961667 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff750066730 0x7ff750068bf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff758000f60 tx=0x7ff758009040 comp rx=0 tx=0).stop 2024-09-13T17:10:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.381+0000 7ff774c22700 1 -- 172.21.15.123:0/3935961667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700ce790 msgr2=0x7ff7700aa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.381+0000 7ff774c22700 1 --2- 172.21.15.123:0/3935961667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700ce790 0x7ff7700aa3b0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff76000c780 tx=0x7ff76000ca90 comp rx=0 tx=0).stop 2024-09-13T17:10:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.381+0000 7ff774c22700 1 -- 172.21.15.123:0/3935961667 shutdown_connections 2024-09-13T17:10:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.381+0000 7ff774c22700 1 --2- 172.21.15.123:0/3935961667 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff750066730 0x7ff750068bf0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.381+0000 7ff774c22700 1 --2- 172.21.15.123:0/3935961667 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7700d0be0 0x7ff7700ac1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.381+0000 7ff774c22700 1 --2- 172.21.15.123:0/3935961667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7700ce790 0x7ff7700aa3b0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.381+0000 7ff774c22700 1 --2- 172.21.15.123:0/3935961667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700cd2b0 0x7ff77015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.381+0000 7ff774c22700 1 -- 172.21.15.123:0/3935961667 >> 172.21.15.123:0/3935961667 conn(0x7ff77006e090 msgr2=0x7ff7700c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.381+0000 7ff774c22700 1 -- 172.21.15.123:0/3935961667 shutdown_connections 2024-09-13T17:10:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.381+0000 7ff774c22700 1 -- 172.21.15.123:0/3935961667 wait complete. 2024-09-13T17:10:41.395 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:10:41.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.509+0000 7f610086f700 1 Processor -- start 2024-09-13T17:10:41.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.509+0000 7f610086f700 1 -- start start 2024-09-13T17:10:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.509+0000 7f610086f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f60fc15cfb0 0x7f60fc0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.509+0000 7f610086f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60fc0d3800 0x7f60fc0d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.509+0000 7f610086f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f60fc0d12d0 0x7f60fc0d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.509+0000 7f610086f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60fc0d1ca0 con 0x7f60fc0d12d0 2024-09-13T17:10:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.509+0000 7f610086f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60fc0cd890 con 0x7f60fc15cfb0 2024-09-13T17:10:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.509+0000 7f610086f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc15d390 con 0x7f60fc0d3800 2024-09-13T17:10:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.509+0000 7f60fad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f60fc0d12d0 0x7f60fc0d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.509+0000 7f60fad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f60fc0d12d0 0x7f60fc0d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34442/0 (socket says 172.21.15.123:34442) 2024-09-13T17:10:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.509+0000 7f60fad9d700 1 -- 172.21.15.123:0/1409771301 learned_addr learned my addr 172.21.15.123:0/1409771301 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.509+0000 7f60fa59c700 1 --2- 172.21.15.123:0/1409771301 >> v2:172.21.15.153:3300/0 conn(0x7f60fc15cfb0 0x7f60fc0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.509+0000 7f60f9d9b700 1 --2- 172.21.15.123:0/1409771301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60fc0d3800 0x7f60fc0d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f60fad9d700 1 -- 172.21.15.123:0/1409771301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60fc0d3800 msgr2=0x7f60fc0d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:41.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f60fad9d700 1 --2- 172.21.15.123:0/1409771301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60fc0d3800 0x7f60fc0d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f60fad9d700 1 -- 172.21.15.123:0/1409771301 >> v2:172.21.15.153:3300/0 conn(0x7f60fc15cfb0 msgr2=0x7f60fc0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:41.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f60fad9d700 1 --2- 172.21.15.123:0/1409771301 >> v2:172.21.15.153:3300/0 conn(0x7f60fc15cfb0 0x7f60fc0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f60fad9d700 1 -- 172.21.15.123:0/1409771301 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc0d10c0 con 0x7f60fc0d12d0 2024-09-13T17:10:41.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f60fad9d700 1 --2- 172.21.15.123:0/1409771301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60fc0d12d0 0x7f60fc0d1760 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f60fc08b300 tx=0x7f60f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9939df786817ab0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:41.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f60f959a700 1 -- 172.21.15.123:0/1409771301 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f400e070 con 0x7f60fc0d12d0 2024-09-13T17:10:41.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f60f959a700 1 -- 172.21.15.123:0/1409771301 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f400b9c0 con 0x7f60fc0d12d0 2024-09-13T17:10:41.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f60f959a700 1 -- 172.21.15.123:0/1409771301 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f400bd70 con 0x7f60fc0d12d0 2024-09-13T17:10:41.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 -- 172.21.15.123:0/1409771301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60fc0d12d0 msgr2=0x7f60fc0d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 --2- 172.21.15.123:0/1409771301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60fc0d12d0 0x7f60fc0d1760 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f60fc08b300 tx=0x7f60f400b330 comp rx=0 tx=0).stop 2024-09-13T17:10:41.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 -- 172.21.15.123:0/1409771301 shutdown_connections 2024-09-13T17:10:41.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 --2- 172.21.15.123:0/1409771301 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60fc0d3800 0x7f60fc0d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 --2- 172.21.15.123:0/1409771301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60fc0d12d0 0x7f60fc0d1760 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 --2- 172.21.15.123:0/1409771301 >> v2:172.21.15.153:3300/0 conn(0x7f60fc15cfb0 0x7f60fc0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 -- 172.21.15.123:0/1409771301 >> 172.21.15.123:0/1409771301 conn(0x7f60fc0d2d10 msgr2=0x7f60fc0d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:41.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 -- 172.21.15.123:0/1409771301 shutdown_connections 2024-09-13T17:10:41.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 -- 172.21.15.123:0/1409771301 wait complete. 2024-09-13T17:10:41.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 Processor -- start 2024-09-13T17:10:41.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 -- start start 2024-09-13T17:10:41.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60fc0d12d0 0x7f60fc151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60fc0d3800 0x7f60fc0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60fc15cfb0 0x7f60fc0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc157a80 con 0x7f60fc0d12d0 2024-09-13T17:10:41.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0ca3a0 con 0x7f60fc0d3800 2024-09-13T17:10:41.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f610086f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0ca680 con 0x7f60fc15cfb0 2024-09-13T17:10:41.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f60fa59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60fc0d12d0 0x7f60fc151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f60fa59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60fc0d12d0 0x7f60fc151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34446/0 (socket says 172.21.15.123:34446) 2024-09-13T17:10:41.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f60fad9d700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60fc15cfb0 0x7f60fc0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f60fa59c700 1 -- 172.21.15.123:0/2771428538 learned_addr learned my addr 172.21.15.123:0/2771428538 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:41.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.513+0000 7f60f9d9b700 1 --2- 172.21.15.123:0/2771428538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60fc0d3800 0x7f60fc0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.517+0000 7f60fa59c700 1 -- 172.21.15.123:0/2771428538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60fc15cfb0 msgr2=0x7f60fc0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.517+0000 7f60fa59c700 1 --2- 172.21.15.123:0/2771428538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60fc15cfb0 0x7f60fc0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.517+0000 7f60fa59c700 1 -- 172.21.15.123:0/2771428538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60fc0d3800 msgr2=0x7f60fc0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.517+0000 7f60fa59c700 1 --2- 172.21.15.123:0/2771428538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60fc0d3800 0x7f60fc0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.517+0000 7f60fa59c700 1 -- 172.21.15.123:0/2771428538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f4009b30 con 0x7f60fc0d12d0 2024-09-13T17:10:41.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.517+0000 7f60fa59c700 1 --2- 172.21.15.123:0/2771428538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60fc0d12d0 0x7f60fc151100 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f60f000e760 tx=0x7f60f000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:41.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.517+0000 7f60eaffd700 1 -- 172.21.15.123:0/2771428538 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000c070 con 0x7f60fc0d12d0 2024-09-13T17:10:41.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.517+0000 7f60eaffd700 1 -- 172.21.15.123:0/2771428538 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f0013610 con 0x7f60fc0d12d0 2024-09-13T17:10:41.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.517+0000 7f610086f700 1 -- 172.21.15.123:0/2771428538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60fc0ca960 con 0x7f60fc0d12d0 2024-09-13T17:10:41.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.517+0000 7f60eaffd700 1 -- 172.21.15.123:0/2771428538 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0013980 con 0x7f60fc0d12d0 2024-09-13T17:10:41.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.517+0000 7f610086f700 1 -- 172.21.15.123:0/2771428538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60fc0caf20 con 0x7f60fc0d12d0 2024-09-13T17:10:41.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.517+0000 7f610086f700 1 -- 172.21.15.123:0/2771428538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60fc0677f0 con 0x7f60fc0d12d0 2024-09-13T17:10:41.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.521+0000 7f60eaffd700 1 -- 172.21.15.123:0/2771428538 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f60f0013ae0 con 0x7f60fc0d12d0 2024-09-13T17:10:41.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.521+0000 7f60eaffd700 1 --2- 172.21.15.123:0/2771428538 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f60dc066730 0x7f60dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.521+0000 7f60eaffd700 1 -- 172.21.15.123:0/2771428538 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60f0083eb0 con 0x7f60fc0d12d0 2024-09-13T17:10:41.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.521+0000 7f60f9d9b700 1 --2- 172.21.15.123:0/2771428538 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f60dc066730 0x7f60dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.521+0000 7f60f9d9b700 1 --2- 172.21.15.123:0/2771428538 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f60dc066730 0x7f60dc068bf0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0cc5b0 tx=0x7f60ec008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:41.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.529+0000 7f60eaffd700 1 -- 172.21.15.123:0/2771428538 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f60f0051220 con 0x7f60fc0d12d0 2024-09-13T17:10:41.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.693+0000 7f610086f700 1 -- 172.21.15.123:0/2771428538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60fc0ce320 con 0x7f60fc0d12d0 2024-09-13T17:10:41.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.693+0000 7f60eaffd700 1 -- 172.21.15.123:0/2771428538 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60f0054840 con 0x7f60fc0d12d0 2024-09-13T17:10:41.695 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:10:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.693+0000 7f610086f700 1 -- 172.21.15.123:0/2771428538 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f60dc066730 msgr2=0x7f60dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.693+0000 7f610086f700 1 --2- 172.21.15.123:0/2771428538 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f60dc066730 0x7f60dc068bf0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0cc5b0 tx=0x7f60ec008040 comp rx=0 tx=0).stop 2024-09-13T17:10:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.693+0000 7f610086f700 1 -- 172.21.15.123:0/2771428538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60fc0d12d0 msgr2=0x7f60fc151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.693+0000 7f610086f700 1 --2- 172.21.15.123:0/2771428538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60fc0d12d0 0x7f60fc151100 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f60f000e760 tx=0x7f60f000ea70 comp rx=0 tx=0).stop 2024-09-13T17:10:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.697+0000 7f610086f700 1 -- 172.21.15.123:0/2771428538 shutdown_connections 2024-09-13T17:10:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.697+0000 7f610086f700 1 --2- 172.21.15.123:0/2771428538 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f60dc066730 0x7f60dc068bf0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.697+0000 7f610086f700 1 --2- 172.21.15.123:0/2771428538 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60fc15cfb0 0x7f60fc0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.697+0000 7f610086f700 1 --2- 172.21.15.123:0/2771428538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60fc0d3800 0x7f60fc0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.697+0000 7f610086f700 1 --2- 172.21.15.123:0/2771428538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60fc0d12d0 0x7f60fc151100 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.697+0000 7f610086f700 1 -- 172.21.15.123:0/2771428538 >> 172.21.15.123:0/2771428538 conn(0x7f60fc0d2d10 msgr2=0x7f60fc071730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:41.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.697+0000 7f610086f700 1 -- 172.21.15.123:0/2771428538 shutdown_connections 2024-09-13T17:10:41.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.697+0000 7f610086f700 1 -- 172.21.15.123:0/2771428538 wait complete. 2024-09-13T17:10:41.710 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:10:41.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.821+0000 7f30f48cd700 1 Processor -- start 2024-09-13T17:10:41.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.821+0000 7f30f48cd700 1 -- start start 2024-09-13T17:10:41.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30f48cd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f30f00c9f80 0x7f30f00c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30f48cd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30f006c610 0x7f30f006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30f48cd700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f015b180 con 0x7f30f00cd690 2024-09-13T17:10:41.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30f48cd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f00c95f0 con 0x7f30f00c9f80 2024-09-13T17:10:41.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30f48cd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00cae70 con 0x7f30f006c610 2024-09-13T17:10:41.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30eed9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f30f00c9f80 0x7f30f00c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30eed9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f30f00c9f80 0x7f30f00c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34460/0 (socket says 172.21.15.123:34460) 2024-09-13T17:10:41.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30eed9d700 1 -- 172.21.15.123:0/3141846013 learned_addr learned my addr 172.21.15.123:0/3141846013 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:41.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30ee59c700 1 --2- 172.21.15.123:0/3141846013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30f006c610 0x7f30f006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30eed9d700 1 -- 172.21.15.123:0/3141846013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30f006c610 msgr2=0x7f30f006ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:41.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30eed9d700 1 --2- 172.21.15.123:0/3141846013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30f006c610 0x7f30f006ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30eed9d700 1 -- 172.21.15.123:0/3141846013 >> v1:172.21.15.153:6789/0 conn(0x7f30f00cd690 legacy=0x7f30f00cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30eed9d700 1 -- 172.21.15.123:0/3141846013 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f00cb140 con 0x7f30f00c9f80 2024-09-13T17:10:41.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30ee59c700 1 --2- 172.21.15.123:0/3141846013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30f006c610 0x7f30f006ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:41.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30eed9d700 1 --2- 172.21.15.123:0/3141846013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30f00c9f80 0x7f30f00c90b0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009940 tx=0x7f30e4009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f464d3b83d8069a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:41.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30edd9b700 1 -- 172.21.15.123:0/3141846013 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e400ba20 con 0x7f30f00c9f80 2024-09-13T17:10:41.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30edd9b700 1 -- 172.21.15.123:0/3141846013 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e4009e90 con 0x7f30f00c9f80 2024-09-13T17:10:41.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30edd9b700 1 -- 172.21.15.123:0/3141846013 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e400bda0 con 0x7f30f00c9f80 2024-09-13T17:10:41.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30f48cd700 1 -- 172.21.15.123:0/3141846013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30f00c9f80 msgr2=0x7f30f00c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30f48cd700 1 --2- 172.21.15.123:0/3141846013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30f00c9f80 0x7f30f00c90b0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009940 tx=0x7f30e4009c50 comp rx=0 tx=0).stop 2024-09-13T17:10:41.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30f48cd700 1 -- 172.21.15.123:0/3141846013 shutdown_connections 2024-09-13T17:10:41.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30f48cd700 1 --2- 172.21.15.123:0/3141846013 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30f006c610 0x7f30f006ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30f48cd700 1 --2- 172.21.15.123:0/3141846013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30f00c9f80 0x7f30f00c90b0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30f48cd700 1 -- 172.21.15.123:0/3141846013 >> 172.21.15.123:0/3141846013 conn(0x7f30f00b01d0 msgr2=0x7f30f00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:41.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30f48cd700 1 -- 172.21.15.123:0/3141846013 shutdown_connections 2024-09-13T17:10:41.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.825+0000 7f30f48cd700 1 -- 172.21.15.123:0/3141846013 wait complete. 2024-09-13T17:10:41.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30f48cd700 1 Processor -- start 2024-09-13T17:10:41.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30f48cd700 1 -- start start 2024-09-13T17:10:41.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30f48cd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30f006c610 0x7f30f00b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30f48cd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30f00c9f80 0x7f30f00b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30f48cd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30f00cd690 0x7f30f00cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30f48cd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f01e3950 con 0x7f30f00c9f80 2024-09-13T17:10:41.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30f48cd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f015a050 con 0x7f30f006c610 2024-09-13T17:10:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30f48cd700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f01e3390 con 0x7f30f00cd690 2024-09-13T17:10:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30ee59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30f00c9f80 0x7f30f00b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30ee59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30f00c9f80 0x7f30f00b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34466/0 (socket says 172.21.15.123:34466) 2024-09-13T17:10:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30ee59c700 1 -- 172.21.15.123:0/4118066761 learned_addr learned my addr 172.21.15.123:0/4118066761 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30ef59e700 1 --2- 172.21.15.123:0/4118066761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30f00cd690 0x7f30f00cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30eed9d700 1 --2- 172.21.15.123:0/4118066761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30f006c610 0x7f30f00b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30ee59c700 1 -- 172.21.15.123:0/4118066761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30f00cd690 msgr2=0x7f30f00cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30ee59c700 1 --2- 172.21.15.123:0/4118066761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30f00cd690 0x7f30f00cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30ee59c700 1 -- 172.21.15.123:0/4118066761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30f006c610 msgr2=0x7f30f00b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30ee59c700 1 --2- 172.21.15.123:0/4118066761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30f006c610 0x7f30f00b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.829+0000 7f30ee59c700 1 -- 172.21.15.123:0/4118066761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e4009570 con 0x7f30f00c9f80 2024-09-13T17:10:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.833+0000 7f30ee59c700 1 --2- 172.21.15.123:0/4118066761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30f00c9f80 0x7f30f00b3c30 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f30e0007fc0 tx=0x7f30e000a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.833+0000 7f30d77fe700 1 -- 172.21.15.123:0/4118066761 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0015440 con 0x7f30f00c9f80 2024-09-13T17:10:41.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.833+0000 7f30d77fe700 1 -- 172.21.15.123:0/4118066761 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e00155a0 con 0x7f30f00c9f80 2024-09-13T17:10:41.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.833+0000 7f30f48cd700 1 -- 172.21.15.123:0/4118066761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f01e3670 con 0x7f30f00c9f80 2024-09-13T17:10:41.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.833+0000 7f30d77fe700 1 -- 172.21.15.123:0/4118066761 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0015950 con 0x7f30f00c9f80 2024-09-13T17:10:41.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.833+0000 7f30f48cd700 1 -- 172.21.15.123:0/4118066761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f00c86c0 con 0x7f30f00c9f80 2024-09-13T17:10:41.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.833+0000 7f30d77fe700 1 -- 172.21.15.123:0/4118066761 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f30e0015ab0 con 0x7f30f00c9f80 2024-09-13T17:10:41.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.833+0000 7f30f48cd700 1 -- 172.21.15.123:0/4118066761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f006ca70 con 0x7f30f00c9f80 2024-09-13T17:10:41.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.833+0000 7f30d77fe700 1 --2- 172.21.15.123:0/4118066761 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f30dc066730 0x7f30dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:41.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.837+0000 7f30d77fe700 1 -- 172.21.15.123:0/4118066761 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30e0084600 con 0x7f30f00c9f80 2024-09-13T17:10:41.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.837+0000 7f30eed9d700 1 --2- 172.21.15.123:0/4118066761 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f30dc066730 0x7f30dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:41.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.837+0000 7f30eed9d700 1 --2- 172.21.15.123:0/4118066761 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f30dc066730 0x7f30dc068bf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f30e4000c00 tx=0x7f30e4008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:41.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:41.841+0000 7f30d77fe700 1 -- 172.21.15.123:0/4118066761 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f30e0051a20 con 0x7f30f00c9f80 2024-09-13T17:10:42.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.017+0000 7f30f48cd700 1 -- 172.21.15.123:0/4118066761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f30f00cbe10 con 0x7f30f00c9f80 2024-09-13T17:10:42.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.017+0000 7f30d77fe700 1 -- 172.21.15.123:0/4118066761 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v98) v1 ==== 80+0+0 (secure 0 0 0) 0x7f30e0055040 con 0x7f30f00c9f80 2024-09-13T17:10:42.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.021+0000 7f30f48cd700 1 -- 172.21.15.123:0/4118066761 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f30dc066730 msgr2=0x7f30dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.021+0000 7f30f48cd700 1 --2- 172.21.15.123:0/4118066761 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f30dc066730 0x7f30dc068bf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f30e4000c00 tx=0x7f30e4008030 comp rx=0 tx=0).stop 2024-09-13T17:10:42.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.021+0000 7f30f48cd700 1 -- 172.21.15.123:0/4118066761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30f00c9f80 msgr2=0x7f30f00b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.021+0000 7f30f48cd700 1 --2- 172.21.15.123:0/4118066761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30f00c9f80 0x7f30f00b3c30 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f30e0007fc0 tx=0x7f30e000a3f0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.021+0000 7f30f48cd700 1 -- 172.21.15.123:0/4118066761 shutdown_connections 2024-09-13T17:10:42.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.021+0000 7f30f48cd700 1 --2- 172.21.15.123:0/4118066761 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f30dc066730 0x7f30dc068bf0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.021+0000 7f30f48cd700 1 --2- 172.21.15.123:0/4118066761 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30f00cd690 0x7f30f00cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.021+0000 7f30f48cd700 1 --2- 172.21.15.123:0/4118066761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30f00c9f80 0x7f30f00b3c30 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.021+0000 7f30f48cd700 1 --2- 172.21.15.123:0/4118066761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30f006c610 0x7f30f00b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.021+0000 7f30f48cd700 1 -- 172.21.15.123:0/4118066761 >> 172.21.15.123:0/4118066761 conn(0x7f30f00b01d0 msgr2=0x7f30f00ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:42.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.021+0000 7f30f48cd700 1 -- 172.21.15.123:0/4118066761 shutdown_connections 2024-09-13T17:10:42.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.021+0000 7f30f48cd700 1 -- 172.21.15.123:0/4118066761 wait complete. 2024-09-13T17:10:42.025 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:10:42.039 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2024-09-13T17:10:42.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:42.040 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:10:42.048 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[45979]: fuse finished with error 0 and tester_r 0 2024-09-13T17:10:42.049 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:10:42.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:42.050 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:10:42.171 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:10:42.171 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:42.179 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:42.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.329+0000 7f004cd5f700 1 Processor -- start 2024-09-13T17:10:42.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.329+0000 7f004cd5f700 1 -- start start 2024-09-13T17:10:42.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.329+0000 7f004cd5f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f00481598b0 0x7f0048071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.329+0000 7f004cd5f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f00480cdfd0 0x7f00480ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.329+0000 7f004cd5f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004815d360 con 0x7f00480cebf0 2024-09-13T17:10:42.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.329+0000 7f004cd5f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f004815aca0 con 0x7f00481598b0 2024-09-13T17:10:42.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.329+0000 7f004cd5f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00480ceff0 con 0x7f00480cdfd0 2024-09-13T17:10:42.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.329+0000 7f00477fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f00481598b0 0x7f0048071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.329+0000 7f00477fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f00481598b0 0x7f0048071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50492/0 (socket says 172.21.15.123:50492) 2024-09-13T17:10:42.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.329+0000 7f00477fe700 1 -- 172.21.15.123:0/4021848494 learned_addr learned my addr 172.21.15.123:0/4021848494 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:42.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.329+0000 7f0046ffd700 1 --2- 172.21.15.123:0/4021848494 >> v2:172.21.15.153:3300/0 conn(0x7f00480cdfd0 0x7f00480ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f00477fe700 1 -- 172.21.15.123:0/4021848494 >> v2:172.21.15.153:3300/0 conn(0x7f00480cdfd0 msgr2=0x7f00480ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:42.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f00477fe700 1 --2- 172.21.15.123:0/4021848494 >> v2:172.21.15.153:3300/0 conn(0x7f00480cdfd0 0x7f00480ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f00477fe700 1 -- 172.21.15.123:0/4021848494 >> v1:172.21.15.153:6789/0 conn(0x7f00480cebf0 legacy=0x7f00480b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f00477fe700 1 -- 172.21.15.123:0/4021848494 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00480ce400 con 0x7f00481598b0 2024-09-13T17:10:42.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f00477fe700 1 --2- 172.21.15.123:0/4021848494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00481598b0 0x7f0048071e60 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f004806be20 tx=0x7f0038009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c70d8d337bc6f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:42.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f00467fc700 1 -- 172.21.15.123:0/4021848494 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038011830 con 0x7f00481598b0 2024-09-13T17:10:42.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f00467fc700 1 -- 172.21.15.123:0/4021848494 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0038011990 con 0x7f00481598b0 2024-09-13T17:10:42.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f00467fc700 1 -- 172.21.15.123:0/4021848494 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038011d20 con 0x7f00481598b0 2024-09-13T17:10:42.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f004cd5f700 1 -- 172.21.15.123:0/4021848494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00481598b0 msgr2=0x7f0048071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f004cd5f700 1 --2- 172.21.15.123:0/4021848494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00481598b0 0x7f0048071e60 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f004806be20 tx=0x7f0038009bf0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f004cd5f700 1 -- 172.21.15.123:0/4021848494 shutdown_connections 2024-09-13T17:10:42.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f004cd5f700 1 --2- 172.21.15.123:0/4021848494 >> v2:172.21.15.153:3300/0 conn(0x7f00480cdfd0 0x7f00480ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f004cd5f700 1 --2- 172.21.15.123:0/4021848494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00481598b0 0x7f0048071e60 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f004cd5f700 1 -- 172.21.15.123:0/4021848494 >> 172.21.15.123:0/4021848494 conn(0x7f0048066150 msgr2=0x7f0048066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:42.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f004cd5f700 1 -- 172.21.15.123:0/4021848494 shutdown_connections 2024-09-13T17:10:42.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f004cd5f700 1 -- 172.21.15.123:0/4021848494 wait complete. 2024-09-13T17:10:42.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f004cd5f700 1 Processor -- start 2024-09-13T17:10:42.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.333+0000 7f004cd5f700 1 -- start start 2024-09-13T17:10:42.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f004cd5f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00480cdfd0 0x7f004814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f004cd5f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00480cebf0 0x7f0048146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f004cd5f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00481598b0 0x7f00480ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f004cd5f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0048151180 con 0x7f00480cebf0 2024-09-13T17:10:42.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f004cd5f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004814d560 con 0x7f00480cdfd0 2024-09-13T17:10:42.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f004cd5f700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0048150570 con 0x7f00481598b0 2024-09-13T17:10:42.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f0046ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00480cebf0 0x7f0048146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f0046ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00480cebf0 0x7f0048146560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50494/0 (socket says 172.21.15.123:50494) 2024-09-13T17:10:42.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f0046ffd700 1 -- 172.21.15.123:0/1705959577 learned_addr learned my addr 172.21.15.123:0/1705959577 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:42.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f0047fff700 1 --2- 172.21.15.123:0/1705959577 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00481598b0 0x7f00480ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f00477fe700 1 --2- 172.21.15.123:0/1705959577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00480cdfd0 0x7f004814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f0046ffd700 1 -- 172.21.15.123:0/1705959577 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00481598b0 msgr2=0x7f00480ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f0046ffd700 1 --2- 172.21.15.123:0/1705959577 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00481598b0 0x7f00480ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f0046ffd700 1 -- 172.21.15.123:0/1705959577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00480cdfd0 msgr2=0x7f004814fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f0046ffd700 1 --2- 172.21.15.123:0/1705959577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00480cdfd0 0x7f004814fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f0046ffd700 1 -- 172.21.15.123:0/1705959577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0038009570 con 0x7f00480cebf0 2024-09-13T17:10:42.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f0046ffd700 1 --2- 172.21.15.123:0/1705959577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00480cebf0 0x7f0048146560 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f003000e9d0 tx=0x7f003000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:42.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f003ffff700 1 -- 172.21.15.123:0/1705959577 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0030009720 con 0x7f00480cebf0 2024-09-13T17:10:42.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f003ffff700 1 -- 172.21.15.123:0/1705959577 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003000ee70 con 0x7f00480cebf0 2024-09-13T17:10:42.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f004cd5f700 1 -- 172.21.15.123:0/1705959577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0048150850 con 0x7f00480cebf0 2024-09-13T17:10:42.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f003ffff700 1 -- 172.21.15.123:0/1705959577 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003000ca50 con 0x7f00480cebf0 2024-09-13T17:10:42.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.337+0000 7f004cd5f700 1 -- 172.21.15.123:0/1705959577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0048150e10 con 0x7f00480cebf0 2024-09-13T17:10:42.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.341+0000 7f004cd5f700 1 -- 172.21.15.123:0/1705959577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00480677f0 con 0x7f00480cebf0 2024-09-13T17:10:42.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.341+0000 7f003ffff700 1 -- 172.21.15.123:0/1705959577 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f003000cbb0 con 0x7f00480cebf0 2024-09-13T17:10:42.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.341+0000 7f003ffff700 1 --2- 172.21.15.123:0/1705959577 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0028066730 0x7f0028068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.341+0000 7f003ffff700 1 -- 172.21.15.123:0/1705959577 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0030084180 con 0x7f00480cebf0 2024-09-13T17:10:42.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.341+0000 7f00477fe700 1 --2- 172.21.15.123:0/1705959577 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0028066730 0x7f0028068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.341+0000 7f00477fe700 1 --2- 172.21.15.123:0/1705959577 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0028066730 0x7f0028068bf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0038009860 tx=0x7f0038008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:42.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.345+0000 7f003ffff700 1 -- 172.21.15.123:0/1705959577 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f00300514f0 con 0x7f00480cebf0 2024-09-13T17:10:42.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.517+0000 7f004cd5f700 1 -- 172.21.15.123:0/1705959577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f004815e090 con 0x7f00480cebf0 2024-09-13T17:10:42.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.521+0000 7f003ffff700 1 -- 172.21.15.123:0/1705959577 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16556 (secure 0 0 0) 0x7f003000ce60 con 0x7f00480cebf0 2024-09-13T17:10:42.524 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:42.524 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":98,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:29.590478+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:10:26.903248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T17:10:27.570928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:42.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.525+0000 7f004cd5f700 1 -- 172.21.15.123:0/1705959577 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0028066730 msgr2=0x7f0028068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.525+0000 7f004cd5f700 1 --2- 172.21.15.123:0/1705959577 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0028066730 0x7f0028068bf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0038009860 tx=0x7f0038008030 comp rx=0 tx=0).stop 2024-09-13T17:10:42.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.525+0000 7f004cd5f700 1 -- 172.21.15.123:0/1705959577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00480cebf0 msgr2=0x7f0048146560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.525+0000 7f004cd5f700 1 --2- 172.21.15.123:0/1705959577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00480cebf0 0x7f0048146560 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f003000e9d0 tx=0x7f003000ece0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.525+0000 7f004cd5f700 1 -- 172.21.15.123:0/1705959577 shutdown_connections 2024-09-13T17:10:42.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.525+0000 7f004cd5f700 1 --2- 172.21.15.123:0/1705959577 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0028066730 0x7f0028068bf0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.525+0000 7f004cd5f700 1 --2- 172.21.15.123:0/1705959577 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f00481598b0 0x7f00480ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.525+0000 7f004cd5f700 1 --2- 172.21.15.123:0/1705959577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00480cebf0 0x7f0048146560 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.525+0000 7f004cd5f700 1 --2- 172.21.15.123:0/1705959577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00480cdfd0 0x7f004814fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.525+0000 7f004cd5f700 1 -- 172.21.15.123:0/1705959577 >> 172.21.15.123:0/1705959577 conn(0x7f0048066150 msgr2=0x7f00480b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:42.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.525+0000 7f004cd5f700 1 -- 172.21.15.123:0/1705959577 shutdown_connections 2024-09-13T17:10:42.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.525+0000 7f004cd5f700 1 -- 172.21.15.123:0/1705959577 wait complete. 2024-09-13T17:10:42.544 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:10:26.903248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:10:27.570928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:10:42.544 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:10:42.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.657+0000 7f2fc340b700 1 Processor -- start 2024-09-13T17:10:42.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc340b700 1 -- start start 2024-09-13T17:10:42.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc340b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fbc06bdb0 0x7f2fbc0c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc340b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0ca750 con 0x7f2fbc072260 2024-09-13T17:10:42.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc340b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0c9210 con 0x7f2fbc0cb7e0 2024-09-13T17:10:42.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc340b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc1617b0 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc1c08700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2fbc072260 0x7f2fbc0cc580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40404/0 (socket says 172.21.15.123:40404) 2024-09-13T17:10:42.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc1c08700 1 -- 172.21.15.123:0/4211234932 learned_addr learned my addr 172.21.15.123:0/4211234932 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:42.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc2c0a700 1 --2- 172.21.15.123:0/4211234932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fbc06bdb0 0x7f2fbc0c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc1407700 1 -- 172.21.15.123:0/4211234932 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269824975 0 0) 0x7f2fbc0ca750 con 0x7f2fbc072260 2024-09-13T17:10:42.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc1407700 1 -- 172.21.15.123:0/4211234932 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa80035d0 con 0x7f2fbc072260 2024-09-13T17:10:42.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc2c0a700 1 -- 172.21.15.123:0/4211234932 >> v1:172.21.15.153:6789/0 conn(0x7f2fbc0cb7e0 legacy=0x7f2fbc071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc2c0a700 1 -- 172.21.15.123:0/4211234932 >> v1:172.21.15.123:6789/0 conn(0x7f2fbc072260 legacy=0x7f2fbc0cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc2c0a700 1 -- 172.21.15.123:0/4211234932 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0cbbc0 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc2c0a700 1 --2- 172.21.15.123:0/4211234932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fbc06bdb0 0x7f2fbc0c8cd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009880 tx=0x7f2fb8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcac7d03cdd90479 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:42.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc1407700 1 -- 172.21.15.123:0/4211234932 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8011830 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc1407700 1 -- 172.21.15.123:0/4211234932 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb8011990 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.661+0000 7f2fc1407700 1 -- 172.21.15.123:0/4211234932 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8011d20 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.665+0000 7f2fc340b700 1 -- 172.21.15.123:0/4211234932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fbc06bdb0 msgr2=0x7f2fbc0c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.665+0000 7f2fc340b700 1 --2- 172.21.15.123:0/4211234932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fbc06bdb0 0x7f2fbc0c8cd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009880 tx=0x7f2fb8009b90 comp rx=0 tx=0).stop 2024-09-13T17:10:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.665+0000 7f2fc340b700 1 -- 172.21.15.123:0/4211234932 shutdown_connections 2024-09-13T17:10:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.665+0000 7f2fc340b700 1 --2- 172.21.15.123:0/4211234932 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fbc06bdb0 0x7f2fbc0c8cd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.665+0000 7f2fc340b700 1 -- 172.21.15.123:0/4211234932 >> 172.21.15.123:0/4211234932 conn(0x7f2fbc0b01d0 msgr2=0x7f2fbc0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.665+0000 7f2fc340b700 1 -- 172.21.15.123:0/4211234932 shutdown_connections 2024-09-13T17:10:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.665+0000 7f2fc340b700 1 -- 172.21.15.123:0/4211234932 wait complete. 2024-09-13T17:10:42.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.665+0000 7f2fc340b700 1 Processor -- start 2024-09-13T17:10:42.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.665+0000 7f2fc340b700 1 -- start start 2024-09-13T17:10:42.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc340b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fbc06bdb0 0x7f2fbc155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc340b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fbc072260 0x7f2fbc163d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc340b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fbc0cb7e0 0x7f2fbc164260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc340b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc156040 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc340b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc163160 con 0x7f2fbc0cb7e0 2024-09-13T17:10:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc340b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc162550 con 0x7f2fbc072260 2024-09-13T17:10:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc2409700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fbc06bdb0 0x7f2fbc155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc2409700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fbc06bdb0 0x7f2fbc155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50498/0 (socket says 172.21.15.123:50498) 2024-09-13T17:10:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc2409700 1 -- 172.21.15.123:0/1214563019 learned_addr learned my addr 172.21.15.123:0/1214563019 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc1c08700 1 --2- 172.21.15.123:0/1214563019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fbc072260 0x7f2fbc163d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc2c0a700 1 --2- 172.21.15.123:0/1214563019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fbc0cb7e0 0x7f2fbc164260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc2409700 1 -- 172.21.15.123:0/1214563019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fbc072260 msgr2=0x7f2fbc163d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc2409700 1 --2- 172.21.15.123:0/1214563019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fbc072260 0x7f2fbc163d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc2409700 1 -- 172.21.15.123:0/1214563019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fbc0cb7e0 msgr2=0x7f2fbc164260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc2409700 1 --2- 172.21.15.123:0/1214563019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fbc0cb7e0 0x7f2fbc164260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc2409700 1 -- 172.21.15.123:0/1214563019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb80094b0 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc2409700 1 --2- 172.21.15.123:0/1214563019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fbc06bdb0 0x7f2fbc155b00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400cbd0 tx=0x7f2fb400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fb2ffd700 1 -- 172.21.15.123:0/1214563019 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4003c20 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fb2ffd700 1 -- 172.21.15.123:0/1214563019 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb4003d80 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc340b700 1 -- 172.21.15.123:0/1214563019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc162830 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fb2ffd700 1 -- 172.21.15.123:0/1214563019 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb400aae0 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.669+0000 7f2fc340b700 1 -- 172.21.15.123:0/1214563019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc162df0 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.673+0000 7f2fc340b700 1 -- 172.21.15.123:0/1214563019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc1632d0 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.673+0000 7f2fb2ffd700 1 -- 172.21.15.123:0/1214563019 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2fb400ac40 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.673+0000 7f2fb2ffd700 1 --2- 172.21.15.123:0/1214563019 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2fa0066730 0x7f2fa0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.673+0000 7f2fb2ffd700 1 -- 172.21.15.123:0/1214563019 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fb4084110 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.673+0000 7f2fc1c08700 1 --2- 172.21.15.123:0/1214563019 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2fa0066730 0x7f2fa0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.673+0000 7f2fc1c08700 1 --2- 172.21.15.123:0/1214563019 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2fa0066730 0x7f2fa0068bf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc0743d0 tx=0x7f2fac009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.677+0000 7f2fb2ffd700 1 -- 172.21.15.123:0/1214563019 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2fb4051480 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.841+0000 7f2fc340b700 1 -- 172.21.15.123:0/1214563019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fbc0c1480 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.845+0000 7f2fb2ffd700 1 -- 172.21.15.123:0/1214563019 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fb4054aa0 con 0x7f2fbc06bdb0 2024-09-13T17:10:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:10:42.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.845+0000 7f2fc340b700 1 -- 172.21.15.123:0/1214563019 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2fa0066730 msgr2=0x7f2fa0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.845+0000 7f2fc340b700 1 --2- 172.21.15.123:0/1214563019 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2fa0066730 0x7f2fa0068bf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc0743d0 tx=0x7f2fac009040 comp rx=0 tx=0).stop 2024-09-13T17:10:42.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.845+0000 7f2fc340b700 1 -- 172.21.15.123:0/1214563019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fbc06bdb0 msgr2=0x7f2fbc155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.845+0000 7f2fc340b700 1 --2- 172.21.15.123:0/1214563019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fbc06bdb0 0x7f2fbc155b00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400cbd0 tx=0x7f2fb400cee0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.845+0000 7f2fc340b700 1 -- 172.21.15.123:0/1214563019 shutdown_connections 2024-09-13T17:10:42.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.845+0000 7f2fc340b700 1 --2- 172.21.15.123:0/1214563019 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2fa0066730 0x7f2fa0068bf0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.845+0000 7f2fc340b700 1 --2- 172.21.15.123:0/1214563019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fbc0cb7e0 0x7f2fbc164260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.845+0000 7f2fc340b700 1 --2- 172.21.15.123:0/1214563019 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2fbc072260 0x7f2fbc163d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.845+0000 7f2fc340b700 1 --2- 172.21.15.123:0/1214563019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fbc06bdb0 0x7f2fbc155b00 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.845+0000 7f2fc340b700 1 -- 172.21.15.123:0/1214563019 >> 172.21.15.123:0/1214563019 conn(0x7f2fbc0b01d0 msgr2=0x7f2fbc0ae400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:42.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.845+0000 7f2fc340b700 1 -- 172.21.15.123:0/1214563019 shutdown_connections 2024-09-13T17:10:42.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.845+0000 7f2fc340b700 1 -- 172.21.15.123:0/1214563019 wait complete. 2024-09-13T17:10:42.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:10:42.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf749e700 1 Processor -- start 2024-09-13T17:10:42.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf749e700 1 -- start start 2024-09-13T17:10:42.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf749e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffbf015ae70 0x7ffbf00ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf749e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbf006dea0 0x7ffbf00aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf749e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbf00ca250 con 0x7ffbf015aa90 2024-09-13T17:10:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf749e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbf00af720 con 0x7ffbf015ae70 2024-09-13T17:10:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf749e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf00ca510 con 0x7ffbf006dea0 2024-09-13T17:10:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf523a700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ffbf015aa90 0x7ffbf006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40410/0 (socket says 172.21.15.123:40410) 2024-09-13T17:10:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf523a700 1 -- 172.21.15.123:0/2084999883 learned_addr learned my addr 172.21.15.123:0/2084999883 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf4a39700 1 --2- 172.21.15.123:0/2084999883 >> v2:172.21.15.123:3300/0 conn(0x7ffbf015ae70 0x7ffbf00ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf5a3b700 1 --2- 172.21.15.123:0/2084999883 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbf006dea0 0x7ffbf00aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbeffff700 1 -- 172.21.15.123:0/2084999883 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716366801 0 0) 0x7ffbf00ca250 con 0x7ffbf015aa90 2024-09-13T17:10:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbeffff700 1 -- 172.21.15.123:0/2084999883 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbd80035d0 con 0x7ffbf015aa90 2024-09-13T17:10:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbeffff700 1 -- 172.21.15.123:0/2084999883 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3717797621 0 0) 0x7ffbd80035d0 con 0x7ffbf015aa90 2024-09-13T17:10:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf4a39700 1 -- 172.21.15.123:0/2084999883 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbf006dea0 msgr2=0x7ffbf00aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf4a39700 1 --2- 172.21.15.123:0/2084999883 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbf006dea0 0x7ffbf00aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf4a39700 1 -- 172.21.15.123:0/2084999883 >> v1:172.21.15.123:6789/0 conn(0x7ffbf015aa90 legacy=0x7ffbf006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf4a39700 1 -- 172.21.15.123:0/2084999883 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbf00ca7f0 con 0x7ffbf015ae70 2024-09-13T17:10:42.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbf4a39700 1 --2- 172.21.15.123:0/2084999883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbf015ae70 0x7ffbf00ae980 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009850 tx=0x7ffbe4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7007b16c523749e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:42.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbeffff700 1 -- 172.21.15.123:0/2084999883 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8001a10 con 0x7ffbf015ae70 2024-09-13T17:10:42.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbeffff700 1 -- 172.21.15.123:0/2084999883 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe4004030 con 0x7ffbf015ae70 2024-09-13T17:10:42.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.981+0000 7ffbeffff700 1 -- 172.21.15.123:0/2084999883 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe40043e0 con 0x7ffbf015ae70 2024-09-13T17:10:42.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 -- 172.21.15.123:0/2084999883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbf015ae70 msgr2=0x7ffbf00ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 --2- 172.21.15.123:0/2084999883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbf015ae70 0x7ffbf00ae980 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009850 tx=0x7ffbe4009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:42.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 -- 172.21.15.123:0/2084999883 shutdown_connections 2024-09-13T17:10:42.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 --2- 172.21.15.123:0/2084999883 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbf006dea0 0x7ffbf00aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 --2- 172.21.15.123:0/2084999883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbf015ae70 0x7ffbf00ae980 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 -- 172.21.15.123:0/2084999883 >> 172.21.15.123:0/2084999883 conn(0x7ffbf00b0450 msgr2=0x7ffbf00b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:42.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 -- 172.21.15.123:0/2084999883 shutdown_connections 2024-09-13T17:10:42.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 -- 172.21.15.123:0/2084999883 wait complete. 2024-09-13T17:10:42.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 Processor -- start 2024-09-13T17:10:42.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 -- start start 2024-09-13T17:10:42.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbf006dea0 0x7ffbf014ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbf015aa90 0x7ffbf014ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbf00c5970 0x7ffbf00cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf014f340 con 0x7ffbf015aa90 2024-09-13T17:10:42.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf014c690 con 0x7ffbf00c5970 2024-09-13T17:10:42.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf749e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf014c970 con 0x7ffbf006dea0 2024-09-13T17:10:42.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf4a39700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbf015aa90 0x7ffbf014ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf4a39700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbf015aa90 0x7ffbf014ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50524/0 (socket says 172.21.15.123:50524) 2024-09-13T17:10:42.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf4a39700 1 -- 172.21.15.123:0/127051669 learned_addr learned my addr 172.21.15.123:0/127051669 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:42.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf523a700 1 --2- 172.21.15.123:0/127051669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbf006dea0 0x7ffbf014ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf5a3b700 1 --2- 172.21.15.123:0/127051669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbf00c5970 0x7ffbf00cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf4a39700 1 -- 172.21.15.123:0/127051669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbf006dea0 msgr2=0x7ffbf014ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf4a39700 1 --2- 172.21.15.123:0/127051669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbf006dea0 0x7ffbf014ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf4a39700 1 -- 172.21.15.123:0/127051669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbf00c5970 msgr2=0x7ffbf00cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:42.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf4a39700 1 --2- 172.21.15.123:0/127051669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbf00c5970 0x7ffbf00cd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:42.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf4a39700 1 -- 172.21.15.123:0/127051669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe40094b0 con 0x7ffbf015aa90 2024-09-13T17:10:42.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.985+0000 7ffbf4a39700 1 --2- 172.21.15.123:0/127051669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbf015aa90 0x7ffbf014ba80 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4000c00 tx=0x7ffbe4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:42.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.989+0000 7ffbedffb700 1 -- 172.21.15.123:0/127051669 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4003b00 con 0x7ffbf015aa90 2024-09-13T17:10:42.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.989+0000 7ffbedffb700 1 -- 172.21.15.123:0/127051669 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe401f070 con 0x7ffbf015aa90 2024-09-13T17:10:42.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.989+0000 7ffbf749e700 1 -- 172.21.15.123:0/127051669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbf014cc50 con 0x7ffbf015aa90 2024-09-13T17:10:42.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.989+0000 7ffbedffb700 1 -- 172.21.15.123:0/127051669 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4011630 con 0x7ffbf015aa90 2024-09-13T17:10:42.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.989+0000 7ffbf749e700 1 -- 172.21.15.123:0/127051669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbf014d210 con 0x7ffbf015aa90 2024-09-13T17:10:42.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.989+0000 7ffbf749e700 1 -- 172.21.15.123:0/127051669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbf014d400 con 0x7ffbf015aa90 2024-09-13T17:10:42.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.989+0000 7ffbedffb700 1 -- 172.21.15.123:0/127051669 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffbe402f080 con 0x7ffbf015aa90 2024-09-13T17:10:42.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.989+0000 7ffbedffb700 1 --2- 172.21.15.123:0/127051669 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffbdc066730 0x7ffbdc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:42.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.989+0000 7ffbedffb700 1 -- 172.21.15.123:0/127051669 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffbe402d070 con 0x7ffbf015aa90 2024-09-13T17:10:42.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.989+0000 7ffbf523a700 1 --2- 172.21.15.123:0/127051669 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffbdc066730 0x7ffbdc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:42.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.993+0000 7ffbf523a700 1 --2- 172.21.15.123:0/127051669 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffbdc066730 0x7ffbdc068bf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffbe80012e0 tx=0x7ffbe80015d0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:42.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:42.997+0000 7ffbedffb700 1 -- 172.21.15.123:0/127051669 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffbe4051ef0 con 0x7ffbf015aa90 2024-09-13T17:10:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.169+0000 7ffbf749e700 1 -- 172.21.15.123:0/127051669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffbf006d790 con 0x7ffbf015aa90 2024-09-13T17:10:43.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.169+0000 7ffbedffb700 1 -- 172.21.15.123:0/127051669 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffbe4055510 con 0x7ffbf015aa90 2024-09-13T17:10:43.173 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.173+0000 7ffbf749e700 1 -- 172.21.15.123:0/127051669 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffbdc066730 msgr2=0x7ffbdc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.173+0000 7ffbf749e700 1 --2- 172.21.15.123:0/127051669 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffbdc066730 0x7ffbdc068bf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffbe80012e0 tx=0x7ffbe80015d0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.173+0000 7ffbf749e700 1 -- 172.21.15.123:0/127051669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbf015aa90 msgr2=0x7ffbf014ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.173+0000 7ffbf749e700 1 --2- 172.21.15.123:0/127051669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbf015aa90 0x7ffbf014ba80 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4000c00 tx=0x7ffbe4004770 comp rx=0 tx=0).stop 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.173+0000 7ffbf749e700 1 -- 172.21.15.123:0/127051669 shutdown_connections 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.173+0000 7ffbf749e700 1 --2- 172.21.15.123:0/127051669 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffbdc066730 0x7ffbdc068bf0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.173+0000 7ffbf749e700 1 --2- 172.21.15.123:0/127051669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbf00c5970 0x7ffbf00cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.173+0000 7ffbf749e700 1 --2- 172.21.15.123:0/127051669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbf015aa90 0x7ffbf014ba80 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.173+0000 7ffbf749e700 1 --2- 172.21.15.123:0/127051669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbf006dea0 0x7ffbf014ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.173+0000 7ffbf749e700 1 -- 172.21.15.123:0/127051669 >> 172.21.15.123:0/127051669 conn(0x7ffbf00b0450 msgr2=0x7ffbf00cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:43.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.173+0000 7ffbf749e700 1 -- 172.21.15.123:0/127051669 shutdown_connections 2024-09-13T17:10:43.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.173+0000 7ffbf749e700 1 -- 172.21.15.123:0/127051669 wait complete. 2024-09-13T17:10:43.189 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:10:43.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.305+0000 7f404a7e4700 1 Processor -- start 2024-09-13T17:10:43.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.305+0000 7f404a7e4700 1 -- start start 2024-09-13T17:10:43.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.305+0000 7f404a7e4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f40440d0f40 0x7f40440d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.305+0000 7f404a7e4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f40440b58b0 0x7f40440d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.305+0000 7f404a7e4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40440b0060 con 0x7f40440b1100 2024-09-13T17:10:43.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.305+0000 7f404a7e4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40440b0340 con 0x7f40440b58b0 2024-09-13T17:10:43.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.305+0000 7f404a7e4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40440b0620 con 0x7f40440d0f40 2024-09-13T17:10:43.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.305+0000 7f4048fe1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f40440b58b0 0x7f40440d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.305+0000 7f4048fe1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f40440b58b0 0x7f40440d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50536/0 (socket says 172.21.15.123:50536) 2024-09-13T17:10:43.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.305+0000 7f4048fe1700 1 -- 172.21.15.123:0/836969790 learned_addr learned my addr 172.21.15.123:0/836969790 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:43.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.305+0000 7f40497e2700 1 --2- 172.21.15.123:0/836969790 >> v2:172.21.15.153:3300/0 conn(0x7f40440d0f40 0x7f40440d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f4048fe1700 1 -- 172.21.15.123:0/836969790 >> v2:172.21.15.153:3300/0 conn(0x7f40440d0f40 msgr2=0x7f40440d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:43.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f4048fe1700 1 --2- 172.21.15.123:0/836969790 >> v2:172.21.15.153:3300/0 conn(0x7f40440d0f40 0x7f40440d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f4048fe1700 1 -- 172.21.15.123:0/836969790 >> v1:172.21.15.153:6789/0 conn(0x7f40440b1100 legacy=0x7f40440b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f4048fe1700 1 -- 172.21.15.123:0/836969790 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40440b0900 con 0x7f40440b58b0 2024-09-13T17:10:43.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f4048fe1700 1 --2- 172.21.15.123:0/836969790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40440b58b0 0x7f40440d05a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f404408bc60 tx=0x7f4040009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ff103d830d9332 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:43.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f403bfff700 1 -- 172.21.15.123:0/836969790 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040011830 con 0x7f40440b58b0 2024-09-13T17:10:43.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f403bfff700 1 -- 172.21.15.123:0/836969790 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4040011990 con 0x7f40440b58b0 2024-09-13T17:10:43.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f403bfff700 1 -- 172.21.15.123:0/836969790 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040011d20 con 0x7f40440b58b0 2024-09-13T17:10:43.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f404a7e4700 1 -- 172.21.15.123:0/836969790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40440b58b0 msgr2=0x7f40440d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f404a7e4700 1 --2- 172.21.15.123:0/836969790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40440b58b0 0x7f40440d05a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f404408bc60 tx=0x7f4040009bf0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f404a7e4700 1 -- 172.21.15.123:0/836969790 shutdown_connections 2024-09-13T17:10:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f404a7e4700 1 --2- 172.21.15.123:0/836969790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40440b58b0 0x7f40440d05a0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f404a7e4700 1 --2- 172.21.15.123:0/836969790 >> v2:172.21.15.153:3300/0 conn(0x7f40440d0f40 0x7f40440d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f404a7e4700 1 -- 172.21.15.123:0/836969790 >> 172.21.15.123:0/836969790 conn(0x7f40440d2a60 msgr2=0x7f40440d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f404a7e4700 1 -- 172.21.15.123:0/836969790 shutdown_connections 2024-09-13T17:10:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f404a7e4700 1 -- 172.21.15.123:0/836969790 wait complete. 2024-09-13T17:10:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f404a7e4700 1 Processor -- start 2024-09-13T17:10:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.309+0000 7f404a7e4700 1 -- start start 2024-09-13T17:10:43.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f404a7e4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40440b1100 0x7f40440c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f404a7e4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40440b58b0 0x7f4044157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f404a7e4700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40440d0f40 0x7f404415b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f404a7e4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40440cad40 con 0x7f40440b58b0 2024-09-13T17:10:43.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f404a7e4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40440b45e0 con 0x7f40440b1100 2024-09-13T17:10:43.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f404a7e4700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40440ca130 con 0x7f40440d0f40 2024-09-13T17:10:43.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f4048fe1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40440b58b0 0x7f4044157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f4048fe1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40440b58b0 0x7f4044157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50552/0 (socket says 172.21.15.123:50552) 2024-09-13T17:10:43.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f4048fe1700 1 -- 172.21.15.123:0/766656157 learned_addr learned my addr 172.21.15.123:0/766656157 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:43.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f40497e2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40440b1100 0x7f40440c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f4049fe3700 1 --2- 172.21.15.123:0/766656157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40440d0f40 0x7f404415b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f4048fe1700 1 -- 172.21.15.123:0/766656157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40440d0f40 msgr2=0x7f404415b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f4048fe1700 1 --2- 172.21.15.123:0/766656157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40440d0f40 0x7f404415b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f4048fe1700 1 -- 172.21.15.123:0/766656157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40440b1100 msgr2=0x7f40440c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f4048fe1700 1 --2- 172.21.15.123:0/766656157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40440b1100 0x7f40440c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f4048fe1700 1 -- 172.21.15.123:0/766656157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040009570 con 0x7f40440b58b0 2024-09-13T17:10:43.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f4048fe1700 1 --2- 172.21.15.123:0/766656157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40440b58b0 0x7f4044157360 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f40440d29c0 tx=0x7f4040004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:43.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f4039ffb700 1 -- 172.21.15.123:0/766656157 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040004380 con 0x7f40440b58b0 2024-09-13T17:10:43.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f4039ffb700 1 -- 172.21.15.123:0/766656157 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404001f070 con 0x7f40440b58b0 2024-09-13T17:10:43.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f4039ffb700 1 -- 172.21.15.123:0/766656157 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40400036c0 con 0x7f40440b58b0 2024-09-13T17:10:43.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f404a7e4700 1 -- 172.21.15.123:0/766656157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40440ca410 con 0x7f40440b58b0 2024-09-13T17:10:43.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.313+0000 7f404a7e4700 1 -- 172.21.15.123:0/766656157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40440ca9d0 con 0x7f40440b58b0 2024-09-13T17:10:43.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.317+0000 7f4039ffb700 1 -- 172.21.15.123:0/766656157 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4040021030 con 0x7f40440b58b0 2024-09-13T17:10:43.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.317+0000 7f404a7e4700 1 -- 172.21.15.123:0/766656157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404415ce70 con 0x7f40440b58b0 2024-09-13T17:10:43.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.317+0000 7f4039ffb700 1 --2- 172.21.15.123:0/766656157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4028066760 0x7f4028068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.317+0000 7f4039ffb700 1 -- 172.21.15.123:0/766656157 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4040085350 con 0x7f40440b58b0 2024-09-13T17:10:43.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.317+0000 7f40497e2700 1 --2- 172.21.15.123:0/766656157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4028066760 0x7f4028068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.317+0000 7f40497e2700 1 --2- 172.21.15.123:0/766656157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4028066760 0x7f4028068c20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f40440707a0 tx=0x7f4034009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:43.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.321+0000 7f4039ffb700 1 -- 172.21.15.123:0/766656157 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4040052750 con 0x7f40440b58b0 2024-09-13T17:10:43.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.497+0000 7f404a7e4700 1 -- 172.21.15.123:0/766656157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f404408c250 con 0x7f40440b58b0 2024-09-13T17:10:43.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.497+0000 7f4039ffb700 1 -- 172.21.15.123:0/766656157 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4040055d70 con 0x7f40440b58b0 2024-09-13T17:10:43.499 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:10:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.497+0000 7f404a7e4700 1 -- 172.21.15.123:0/766656157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4028066760 msgr2=0x7f4028068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.497+0000 7f404a7e4700 1 --2- 172.21.15.123:0/766656157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4028066760 0x7f4028068c20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f40440707a0 tx=0x7f4034009240 comp rx=0 tx=0).stop 2024-09-13T17:10:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.497+0000 7f404a7e4700 1 -- 172.21.15.123:0/766656157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40440b58b0 msgr2=0x7f4044157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.497+0000 7f404a7e4700 1 --2- 172.21.15.123:0/766656157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40440b58b0 0x7f4044157360 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f40440d29c0 tx=0x7f4040004770 comp rx=0 tx=0).stop 2024-09-13T17:10:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.497+0000 7f404a7e4700 1 -- 172.21.15.123:0/766656157 shutdown_connections 2024-09-13T17:10:43.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.497+0000 7f404a7e4700 1 --2- 172.21.15.123:0/766656157 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4028066760 0x7f4028068c20 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.497+0000 7f404a7e4700 1 --2- 172.21.15.123:0/766656157 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40440d0f40 0x7f404415b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.497+0000 7f404a7e4700 1 --2- 172.21.15.123:0/766656157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40440b58b0 0x7f4044157360 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.497+0000 7f404a7e4700 1 --2- 172.21.15.123:0/766656157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40440b1100 0x7f40440c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.497+0000 7f404a7e4700 1 -- 172.21.15.123:0/766656157 >> 172.21.15.123:0/766656157 conn(0x7f40440d2a60 msgr2=0x7f4044070930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:43.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.497+0000 7f404a7e4700 1 -- 172.21.15.123:0/766656157 shutdown_connections 2024-09-13T17:10:43.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.497+0000 7f404a7e4700 1 -- 172.21.15.123:0/766656157 wait complete. 2024-09-13T17:10:43.514 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:10:43.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.629+0000 7f2dfda1e700 1 Processor -- start 2024-09-13T17:10:43.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.629+0000 7f2dfda1e700 1 -- start start 2024-09-13T17:10:43.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.629+0000 7f2dfda1e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2df815b000 0x7f2df8071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.629+0000 7f2dfda1e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df80cdb90 con 0x7f2df80cb780 2024-09-13T17:10:43.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.629+0000 7f2dfda1e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df80cc580 con 0x7f2df80ccfd0 2024-09-13T17:10:43.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.629+0000 7f2dfda1e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80cdde0 con 0x7f2df815b000 2024-09-13T17:10:43.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.629+0000 7f2dfd21d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2df80cb780 0x7f2df80b14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40414/0 (socket says 172.21.15.123:40414) 2024-09-13T17:10:43.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.629+0000 7f2dfd21d700 1 -- 172.21.15.123:0/3155252660 learned_addr learned my addr 172.21.15.123:0/3155252660 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:43.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.629+0000 7f2dfca1c700 1 --2- 172.21.15.123:0/3155252660 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2df815b000 0x7f2df8071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2df77fe700 1 -- 172.21.15.123:0/3155252660 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758523132 0 0) 0x7f2df80cdb90 con 0x7f2df80cb780 2024-09-13T17:10:43.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2df77fe700 1 -- 172.21.15.123:0/3155252660 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2de00035d0 con 0x7f2df80cb780 2024-09-13T17:10:43.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2df77fe700 1 -- 172.21.15.123:0/3155252660 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788991456 0 0) 0x7f2df80cc580 con 0x7f2df80ccfd0 2024-09-13T17:10:43.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2df77fe700 1 -- 172.21.15.123:0/3155252660 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2df80cdb90 con 0x7f2df80ccfd0 2024-09-13T17:10:43.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2dfca1c700 1 -- 172.21.15.123:0/3155252660 >> v1:172.21.15.153:6789/0 conn(0x7f2df80ccfd0 legacy=0x7f2df80cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2dfca1c700 1 -- 172.21.15.123:0/3155252660 >> v1:172.21.15.123:6789/0 conn(0x7f2df80cb780 legacy=0x7f2df80b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2dfca1c700 1 -- 172.21.15.123:0/3155252660 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df80ce0c0 con 0x7f2df815b000 2024-09-13T17:10:43.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2dfca1c700 1 --2- 172.21.15.123:0/3155252660 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2df815b000 0x7f2df8071f50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009880 tx=0x7f2dec009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1713483709875e38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:43.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2df77fe700 1 -- 172.21.15.123:0/3155252660 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec011830 con 0x7f2df815b000 2024-09-13T17:10:43.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2df77fe700 1 -- 172.21.15.123:0/3155252660 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec011990 con 0x7f2df815b000 2024-09-13T17:10:43.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2df77fe700 1 -- 172.21.15.123:0/3155252660 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec011d20 con 0x7f2df815b000 2024-09-13T17:10:43.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2dfda1e700 1 -- 172.21.15.123:0/3155252660 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2df815b000 msgr2=0x7f2df8071f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2dfda1e700 1 --2- 172.21.15.123:0/3155252660 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2df815b000 0x7f2df8071f50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009880 tx=0x7f2dec009b90 comp rx=0 tx=0).stop 2024-09-13T17:10:43.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2dfda1e700 1 -- 172.21.15.123:0/3155252660 shutdown_connections 2024-09-13T17:10:43.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2dfda1e700 1 --2- 172.21.15.123:0/3155252660 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2df815b000 0x7f2df8071f50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2dfda1e700 1 -- 172.21.15.123:0/3155252660 >> 172.21.15.123:0/3155252660 conn(0x7f2df80b01d0 msgr2=0x7f2df80b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:43.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2dfda1e700 1 -- 172.21.15.123:0/3155252660 shutdown_connections 2024-09-13T17:10:43.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.633+0000 7f2dfda1e700 1 -- 172.21.15.123:0/3155252660 wait complete. 2024-09-13T17:10:43.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.637+0000 7f2dfda1e700 1 Processor -- start 2024-09-13T17:10:43.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.637+0000 7f2dfda1e700 1 -- start start 2024-09-13T17:10:43.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.637+0000 7f2dfda1e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2df80cb780 0x7f2df80c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.637+0000 7f2dfda1e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2df80ccfd0 0x7f2df80af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.637+0000 7f2dfda1e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df815b000 0x7f2df81517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.637+0000 7f2dfda1e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80c3100 con 0x7f2df815b000 2024-09-13T17:10:43.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.637+0000 7f2dfda1e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80c33d0 con 0x7f2df80ccfd0 2024-09-13T17:10:43.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.637+0000 7f2dfda1e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80c36b0 con 0x7f2df80cb780 2024-09-13T17:10:43.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.637+0000 7f2dfd21d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df815b000 0x7f2df81517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.637+0000 7f2dfd21d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df815b000 0x7f2df81517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50562/0 (socket says 172.21.15.123:50562) 2024-09-13T17:10:43.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.637+0000 7f2dfd21d700 1 -- 172.21.15.123:0/2646566790 learned_addr learned my addr 172.21.15.123:0/2646566790 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.637+0000 7f2dfca1c700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2df80cb780 0x7f2df80c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.637+0000 7f2df7fff700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2df80ccfd0 0x7f2df80af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.641+0000 7f2dfca1c700 1 -- 172.21.15.123:0/2646566790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2df80ccfd0 msgr2=0x7f2df80af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.641+0000 7f2dfca1c700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2df80ccfd0 0x7f2df80af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.641+0000 7f2dfca1c700 1 -- 172.21.15.123:0/2646566790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df815b000 msgr2=0x7f2df81517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.641+0000 7f2dfca1c700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df815b000 0x7f2df81517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.641+0000 7f2dfca1c700 1 -- 172.21.15.123:0/2646566790 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec0094b0 con 0x7f2df80cb780 2024-09-13T17:10:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.641+0000 7f2dfd21d700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df815b000 0x7f2df81517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.641+0000 7f2dfca1c700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2df80cb780 0x7f2df80c2bc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2dec015000 tx=0x7f2dec004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.641+0000 7f2df57fa700 1 -- 172.21.15.123:0/2646566790 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec01a8c0 con 0x7f2df80cb780 2024-09-13T17:10:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.641+0000 7f2df57fa700 1 -- 172.21.15.123:0/2646566790 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec01e070 con 0x7f2df80cb780 2024-09-13T17:10:43.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.641+0000 7f2dfda1e700 1 -- 172.21.15.123:0/2646566790 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df80c3990 con 0x7f2df80cb780 2024-09-13T17:10:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.641+0000 7f2df57fa700 1 -- 172.21.15.123:0/2646566790 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec01ac80 con 0x7f2df80cb780 2024-09-13T17:10:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.641+0000 7f2dfda1e700 1 -- 172.21.15.123:0/2646566790 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df80c3f50 con 0x7f2df80cb780 2024-09-13T17:10:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.641+0000 7f2dfda1e700 1 -- 172.21.15.123:0/2646566790 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df80cd410 con 0x7f2df80cb780 2024-09-13T17:10:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.645+0000 7f2df57fa700 1 -- 172.21.15.123:0/2646566790 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2dec02d450 con 0x7f2df80cb780 2024-09-13T17:10:43.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.645+0000 7f2df57fa700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2de4066760 0x7f2de4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.645+0000 7f2df57fa700 1 -- 172.21.15.123:0/2646566790 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2dec084f70 con 0x7f2df80cb780 2024-09-13T17:10:43.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.645+0000 7f2df7fff700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2de4066760 0x7f2de4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.645+0000 7f2df7fff700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2de4066760 0x7f2de4068c20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2df80b3f70 tx=0x7f2de8009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:43.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.657+0000 7f2df57fa700 1 -- 172.21.15.123:0/2646566790 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2dec0b6db0 con 0x7f2df80cb780 2024-09-13T17:10:43.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.841+0000 7f2dfda1e700 1 -- 172.21.15.123:0/2646566790 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2df80c37f0 con 0x7f2df80cb780 2024-09-13T17:10:43.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.841+0000 7f2df57fa700 1 -- 172.21.15.123:0/2646566790 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v98) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2df80c37f0 con 0x7f2df80cb780 2024-09-13T17:10:43.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.845+0000 7f2dfda1e700 1 -- 172.21.15.123:0/2646566790 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2de4066760 msgr2=0x7f2de4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.845+0000 7f2dfda1e700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2de4066760 0x7f2de4068c20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2df80b3f70 tx=0x7f2de8009040 comp rx=0 tx=0).stop 2024-09-13T17:10:43.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.845+0000 7f2dfda1e700 1 -- 172.21.15.123:0/2646566790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2df80cb780 msgr2=0x7f2df80c2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.845+0000 7f2dfda1e700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2df80cb780 0x7f2df80c2bc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2dec015000 tx=0x7f2dec004770 comp rx=0 tx=0).stop 2024-09-13T17:10:43.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.845+0000 7f2dfda1e700 1 -- 172.21.15.123:0/2646566790 shutdown_connections 2024-09-13T17:10:43.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.845+0000 7f2dfda1e700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2de4066760 0x7f2de4068c20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.845+0000 7f2dfda1e700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df815b000 0x7f2df81517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.845+0000 7f2dfda1e700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2df80ccfd0 0x7f2df80af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.845+0000 7f2dfda1e700 1 --2- 172.21.15.123:0/2646566790 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2df80cb780 0x7f2df80c2bc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.849+0000 7f2dfda1e700 1 -- 172.21.15.123:0/2646566790 >> 172.21.15.123:0/2646566790 conn(0x7f2df80b01d0 msgr2=0x7f2df8157600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:43.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.849+0000 7f2dfda1e700 1 -- 172.21.15.123:0/2646566790 shutdown_connections 2024-09-13T17:10:43.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:43.849+0000 7f2dfda1e700 1 -- 172.21.15.123:0/2646566790 wait complete. 2024-09-13T17:10:43.851 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-13T17:10:43.866 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-09-13T17:10:43.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:43.866 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:10:43.880 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi153.stderr:ceph-fuse[33769]: fuse finished with error 0 and tester_r 0 2024-09-13T17:10:43.883 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:10:43.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:43.883 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:10:44.054 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:10:44.054 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:44.061 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:10:44.062 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:10:44.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:44.062 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:10:44.068 INFO:teuthology.orchestra.run.smithi123.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T17:10:44.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:10:44.069 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:10:44.069 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:44.104 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:10:44.104 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:10:44.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:44.104 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:10:44.111 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T17:10:44.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:10:44.112 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:44.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.233+0000 7f64d68e0700 1 Processor -- start 2024-09-13T17:10:44.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.233+0000 7f64d68e0700 1 -- start start 2024-09-13T17:10:44.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d01598b0 0x7f64d0071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f64d00cdfd0 0x7f64d00ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f64d00cebf0 0x7f64d00b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d00cf080 con 0x7f64d00cebf0 2024-09-13T17:10:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d015d360 con 0x7f64d00cdfd0 2024-09-13T17:10:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00ce3d0 con 0x7f64d01598b0 2024-09-13T17:10:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d60df700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f64d00cebf0 0x7f64d00b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d60df700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f64d00cebf0 0x7f64d00b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50566/0 (socket says 172.21.15.123:50566) 2024-09-13T17:10:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d60df700 1 -- 172.21.15.123:0/3174438312 learned_addr learned my addr 172.21.15.123:0/3174438312 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d50dd700 1 --2- 172.21.15.123:0/3174438312 >> v2:172.21.15.153:3300/0 conn(0x7f64d00cdfd0 0x7f64d00ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d58de700 1 --2- 172.21.15.123:0/3174438312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d01598b0 0x7f64d0071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d60df700 1 -- 172.21.15.123:0/3174438312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d01598b0 msgr2=0x7f64d0071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d60df700 1 --2- 172.21.15.123:0/3174438312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d01598b0 0x7f64d0071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d60df700 1 -- 172.21.15.123:0/3174438312 >> v2:172.21.15.153:3300/0 conn(0x7f64d00cdfd0 msgr2=0x7f64d00ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d60df700 1 --2- 172.21.15.123:0/3174438312 >> v2:172.21.15.153:3300/0 conn(0x7f64d00cdfd0 0x7f64d00ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d60df700 1 -- 172.21.15.123:0/3174438312 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d00724c0 con 0x7f64d00cebf0 2024-09-13T17:10:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d60df700 1 --2- 172.21.15.123:0/3174438312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d00cebf0 0x7f64d00b15d0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f64d00cc4f0 tx=0x7f64c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3d16d00a571488 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d48dc700 1 -- 172.21.15.123:0/3174438312 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c800e070 con 0x7f64d00cebf0 2024-09-13T17:10:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d48dc700 1 -- 172.21.15.123:0/3174438312 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c800b9c0 con 0x7f64d00cebf0 2024-09-13T17:10:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d48dc700 1 -- 172.21.15.123:0/3174438312 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c800bd70 con 0x7f64d00cebf0 2024-09-13T17:10:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 -- 172.21.15.123:0/3174438312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d00cebf0 msgr2=0x7f64d00b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 --2- 172.21.15.123:0/3174438312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d00cebf0 0x7f64d00b15d0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f64d00cc4f0 tx=0x7f64c800b330 comp rx=0 tx=0).stop 2024-09-13T17:10:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 -- 172.21.15.123:0/3174438312 shutdown_connections 2024-09-13T17:10:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 --2- 172.21.15.123:0/3174438312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d00cebf0 0x7f64d00b15d0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 --2- 172.21.15.123:0/3174438312 >> v2:172.21.15.153:3300/0 conn(0x7f64d00cdfd0 0x7f64d00ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 --2- 172.21.15.123:0/3174438312 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d01598b0 0x7f64d0071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 -- 172.21.15.123:0/3174438312 >> 172.21.15.123:0/3174438312 conn(0x7f64d0066150 msgr2=0x7f64d0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:44.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 -- 172.21.15.123:0/3174438312 shutdown_connections 2024-09-13T17:10:44.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.237+0000 7f64d68e0700 1 -- 172.21.15.123:0/3174438312 wait complete. 2024-09-13T17:10:44.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d68e0700 1 Processor -- start 2024-09-13T17:10:44.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d68e0700 1 -- start start 2024-09-13T17:10:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d68e0700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d00cdfd0 0x7f64d0147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d68e0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d00cebf0 0x7f64d00a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d68e0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64d01598b0 0x7f64d0147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d68e0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00a8f60 con 0x7f64d00cebf0 2024-09-13T17:10:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d68e0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00a9240 con 0x7f64d01598b0 2024-09-13T17:10:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d68e0700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00a9520 con 0x7f64d00cdfd0 2024-09-13T17:10:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d50dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d00cebf0 0x7f64d00a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d50dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d00cebf0 0x7f64d00a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50578/0 (socket says 172.21.15.123:50578) 2024-09-13T17:10:44.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d50dd700 1 -- 172.21.15.123:0/4280762735 learned_addr learned my addr 172.21.15.123:0/4280762735 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:44.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d58de700 1 --2- 172.21.15.123:0/4280762735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d00cdfd0 0x7f64d0147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d60df700 1 --2- 172.21.15.123:0/4280762735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64d01598b0 0x7f64d0147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d50dd700 1 -- 172.21.15.123:0/4280762735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d00cdfd0 msgr2=0x7f64d0147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d50dd700 1 --2- 172.21.15.123:0/4280762735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d00cdfd0 0x7f64d0147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d50dd700 1 -- 172.21.15.123:0/4280762735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64d01598b0 msgr2=0x7f64d0147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d50dd700 1 --2- 172.21.15.123:0/4280762735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64d01598b0 0x7f64d0147e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d50dd700 1 -- 172.21.15.123:0/4280762735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c8009b30 con 0x7f64d00cebf0 2024-09-13T17:10:44.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d50dd700 1 --2- 172.21.15.123:0/4280762735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d00cebf0 0x7f64d00a84a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f64c000e730 tx=0x7f64c000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:44.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64c67fc700 1 -- 172.21.15.123:0/4280762735 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000c070 con 0x7f64d00cebf0 2024-09-13T17:10:44.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64c67fc700 1 -- 172.21.15.123:0/4280762735 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c0004020 con 0x7f64d00cebf0 2024-09-13T17:10:44.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64c67fc700 1 -- 172.21.15.123:0/4280762735 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c00043d0 con 0x7f64d00cebf0 2024-09-13T17:10:44.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d68e0700 1 -- 172.21.15.123:0/4280762735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d00ae330 con 0x7f64d00cebf0 2024-09-13T17:10:44.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.241+0000 7f64d68e0700 1 -- 172.21.15.123:0/4280762735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d01478b0 con 0x7f64d00cebf0 2024-09-13T17:10:44.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.245+0000 7f64d68e0700 1 -- 172.21.15.123:0/4280762735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d00677f0 con 0x7f64d00cebf0 2024-09-13T17:10:44.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.245+0000 7f64c67fc700 1 -- 172.21.15.123:0/4280762735 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f64c00036c0 con 0x7f64d00cebf0 2024-09-13T17:10:44.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.245+0000 7f64c67fc700 1 --2- 172.21.15.123:0/4280762735 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64b4066730 0x7f64b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.245+0000 7f64c67fc700 1 -- 172.21.15.123:0/4280762735 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64c0083b20 con 0x7f64d00cebf0 2024-09-13T17:10:44.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.245+0000 7f64d58de700 1 --2- 172.21.15.123:0/4280762735 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64b4066730 0x7f64b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.245+0000 7f64d58de700 1 --2- 172.21.15.123:0/4280762735 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64b4066730 0x7f64b4068bf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f64cc006b40 tx=0x7f64cc008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:44.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.253+0000 7f64c67fc700 1 -- 172.21.15.123:0/4280762735 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f64c0050d70 con 0x7f64d00cebf0 2024-09-13T17:10:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.457+0000 7f64d68e0700 1 -- 172.21.15.123:0/4280762735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64d00ae190 con 0x7f64d00cebf0 2024-09-13T17:10:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.457+0000 7f64c67fc700 1 -- 172.21.15.123:0/4280762735 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f64d00ae190 con 0x7f64d00cebf0 2024-09-13T17:10:44.461 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:44.461 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":48,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7156,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3705271604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705271604},{"type":"v1","addr":"172.21.15.153:6834","nonce":3705271604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2842144578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":2842144578},{"type":"v1","addr":"172.21.15.153:6835","nonce":2842144578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7398,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2022373739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2022373739},{"type":"v1","addr":"172.21.15.123:6835","nonce":2022373739}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:10:28.586943+0000","modified":"2024-09-13T17:10:31.604775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7401":{"gid":7401,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/1688881065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1688881065},{"type":"v1","addr":"172.21.15.123:6837","nonce":1688881065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:10:44.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.461+0000 7f64d68e0700 1 -- 172.21.15.123:0/4280762735 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64b4066730 msgr2=0x7f64b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.461+0000 7f64d68e0700 1 --2- 172.21.15.123:0/4280762735 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64b4066730 0x7f64b4068bf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f64cc006b40 tx=0x7f64cc008040 comp rx=0 tx=0).stop 2024-09-13T17:10:44.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.461+0000 7f64d68e0700 1 -- 172.21.15.123:0/4280762735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d00cebf0 msgr2=0x7f64d00a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.461+0000 7f64d68e0700 1 --2- 172.21.15.123:0/4280762735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d00cebf0 0x7f64d00a84a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f64c000e730 tx=0x7f64c000ea40 comp rx=0 tx=0).stop 2024-09-13T17:10:44.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.461+0000 7f64d68e0700 1 -- 172.21.15.123:0/4280762735 shutdown_connections 2024-09-13T17:10:44.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.461+0000 7f64d68e0700 1 --2- 172.21.15.123:0/4280762735 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f64b4066730 0x7f64b4068bf0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.461+0000 7f64d68e0700 1 --2- 172.21.15.123:0/4280762735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64d01598b0 0x7f64d0147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.461+0000 7f64d68e0700 1 --2- 172.21.15.123:0/4280762735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64d00cebf0 0x7f64d00a84a0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.461+0000 7f64d68e0700 1 --2- 172.21.15.123:0/4280762735 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f64d00cdfd0 0x7f64d0147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.461+0000 7f64d68e0700 1 -- 172.21.15.123:0/4280762735 >> 172.21.15.123:0/4280762735 conn(0x7f64d0066150 msgr2=0x7f64d0066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:44.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.461+0000 7f64d68e0700 1 -- 172.21.15.123:0/4280762735 shutdown_connections 2024-09-13T17:10:44.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.461+0000 7f64d68e0700 1 -- 172.21.15.123:0/4280762735 wait complete. 2024-09-13T17:10:44.465 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 48 2024-09-13T17:10:44.476 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:44.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b3fff700 1 Processor -- start 2024-09-13T17:10:44.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b3fff700 1 -- start start 2024-09-13T17:10:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82b415e920 0x7f82b40caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f82b415ed00 0x7f82b40cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b3fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b4162550 con 0x7f82b40cb020 2024-09-13T17:10:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b3fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b40cd690 con 0x7f82b415ed00 2024-09-13T17:10:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b4161f90 con 0x7f82b415e920 2024-09-13T17:10:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b2ffd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82b415e920 0x7f82b40caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b27fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f82b40cb020 0x7f82b4161540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:54064/0 (socket says 172.21.15.123:54064) 2024-09-13T17:10:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b27fc700 1 -- 172.21.15.123:0/619346865 learned_addr learned my addr 172.21.15.123:0/619346865 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b37fe700 1 --2- 172.21.15.123:0/619346865 >> v2:172.21.15.153:3300/0 conn(0x7f82b415ed00 0x7f82b40cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b2ffd700 1 -- 172.21.15.123:0/619346865 >> v2:172.21.15.153:3300/0 conn(0x7f82b415ed00 msgr2=0x7f82b40cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:44.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b2ffd700 1 --2- 172.21.15.123:0/619346865 >> v2:172.21.15.153:3300/0 conn(0x7f82b415ed00 0x7f82b40cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b2ffd700 1 -- 172.21.15.123:0/619346865 >> v1:172.21.15.153:6789/0 conn(0x7f82b40cb020 legacy=0x7f82b4161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b2ffd700 1 -- 172.21.15.123:0/619346865 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b4162270 con 0x7f82b415e920 2024-09-13T17:10:44.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b2ffd700 1 --2- 172.21.15.123:0/619346865 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82b415e920 0x7f82b40caae0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f82a8009850 tx=0x7f82a8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb1c40d62b95954 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:44.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b1ffb700 1 -- 172.21.15.123:0/619346865 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8011830 con 0x7f82b415e920 2024-09-13T17:10:44.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b1ffb700 1 -- 172.21.15.123:0/619346865 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a8011990 con 0x7f82b415e920 2024-09-13T17:10:44.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.589+0000 7f82b1ffb700 1 -- 172.21.15.123:0/619346865 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8011d40 con 0x7f82b415e920 2024-09-13T17:10:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 -- 172.21.15.123:0/619346865 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82b415e920 msgr2=0x7f82b40caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 --2- 172.21.15.123:0/619346865 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82b415e920 0x7f82b40caae0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f82a8009850 tx=0x7f82a8009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 -- 172.21.15.123:0/619346865 shutdown_connections 2024-09-13T17:10:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 --2- 172.21.15.123:0/619346865 >> v2:172.21.15.153:3300/0 conn(0x7f82b415ed00 0x7f82b40cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 --2- 172.21.15.123:0/619346865 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82b415e920 0x7f82b40caae0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 -- 172.21.15.123:0/619346865 >> 172.21.15.123:0/619346865 conn(0x7f82b4066150 msgr2=0x7f82b4066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 -- 172.21.15.123:0/619346865 shutdown_connections 2024-09-13T17:10:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 -- 172.21.15.123:0/619346865 wait complete. 2024-09-13T17:10:44.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 Processor -- start 2024-09-13T17:10:44.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 -- start start 2024-09-13T17:10:44.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b40cb020 0x7f82b41eb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82b415e920 0x7f82b414ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82b415ed00 0x7f82b414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b414bf70 con 0x7f82b415e920 2024-09-13T17:10:44.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b414b090 con 0x7f82b40cb020 2024-09-13T17:10:44.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b3fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b414b2f0 con 0x7f82b415ed00 2024-09-13T17:10:44.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b27fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82b415e920 0x7f82b414ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b37fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82b415ed00 0x7f82b414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b40cb020 0x7f82b41eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b27fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82b415e920 0x7f82b414ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50594/0 (socket says 172.21.15.123:50594) 2024-09-13T17:10:44.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b37fe700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82b415ed00 0x7f82b414a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:59488/0 (socket says 172.21.15.123:59488) 2024-09-13T17:10:44.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b27fc700 1 -- 172.21.15.123:0/4129086060 learned_addr learned my addr 172.21.15.123:0/4129086060 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b27fc700 1 -- 172.21.15.123:0/4129086060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82b415ed00 msgr2=0x7f82b414a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b27fc700 1 --2- 172.21.15.123:0/4129086060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82b415ed00 0x7f82b414a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b27fc700 1 -- 172.21.15.123:0/4129086060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b40cb020 msgr2=0x7f82b41eb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b27fc700 1 --2- 172.21.15.123:0/4129086060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b40cb020 0x7f82b41eb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b27fc700 1 -- 172.21.15.123:0/4129086060 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a80094b0 con 0x7f82b415e920 2024-09-13T17:10:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.593+0000 7f82b27fc700 1 --2- 172.21.15.123:0/4129086060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82b415e920 0x7f82b414ab50 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f82a400c500 tx=0x7f82a400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.597+0000 7f829b7fe700 1 -- 172.21.15.123:0/4129086060 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4005d90 con 0x7f82b415e920 2024-09-13T17:10:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.597+0000 7f829b7fe700 1 -- 172.21.15.123:0/4129086060 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a40070d0 con 0x7f82b415e920 2024-09-13T17:10:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.597+0000 7f82b3fff700 1 -- 172.21.15.123:0/4129086060 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b414b5d0 con 0x7f82b415e920 2024-09-13T17:10:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.597+0000 7f829b7fe700 1 -- 172.21.15.123:0/4129086060 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4007460 con 0x7f82b415e920 2024-09-13T17:10:44.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.597+0000 7f82b3fff700 1 -- 172.21.15.123:0/4129086060 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b414bb90 con 0x7f82b415e920 2024-09-13T17:10:44.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.597+0000 7f82b3fff700 1 -- 172.21.15.123:0/4129086060 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b40677f0 con 0x7f82b415e920 2024-09-13T17:10:44.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.597+0000 7f829b7fe700 1 -- 172.21.15.123:0/4129086060 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f82a40075c0 con 0x7f82b415e920 2024-09-13T17:10:44.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.597+0000 7f829b7fe700 1 --2- 172.21.15.123:0/4129086060 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82a0066730 0x7f82a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.601+0000 7f829b7fe700 1 -- 172.21.15.123:0/4129086060 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82a4083910 con 0x7f82b415e920 2024-09-13T17:10:44.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.601+0000 7f82b2ffd700 1 --2- 172.21.15.123:0/4129086060 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82a0066730 0x7f82a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.601+0000 7f82b2ffd700 1 --2- 172.21.15.123:0/4129086060 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82a0066730 0x7f82a0068bf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f82a80090b0 tx=0x7f82a8008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:44.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.605+0000 7f829b7fe700 1 -- 172.21.15.123:0/4129086060 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82a4050cf0 con 0x7f82b415e920 2024-09-13T17:10:44.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.777+0000 7f82b3fff700 1 -- 172.21.15.123:0/4129086060 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82b414c0b0 con 0x7f82b415e920 2024-09-13T17:10:44.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.781+0000 7f829b7fe700 1 -- 172.21.15.123:0/4129086060 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16556 (secure 0 0 0) 0x7f82b414c0b0 con 0x7f82b415e920 2024-09-13T17:10:44.784 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:44.784 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":98,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:29.590478+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:10:26.903248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T17:10:27.570928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:44.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.785+0000 7f82b3fff700 1 -- 172.21.15.123:0/4129086060 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82a0066730 msgr2=0x7f82a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.785+0000 7f82b3fff700 1 --2- 172.21.15.123:0/4129086060 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82a0066730 0x7f82a0068bf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f82a80090b0 tx=0x7f82a8008030 comp rx=0 tx=0).stop 2024-09-13T17:10:44.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.785+0000 7f82b3fff700 1 -- 172.21.15.123:0/4129086060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82b415e920 msgr2=0x7f82b414ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.785+0000 7f82b3fff700 1 --2- 172.21.15.123:0/4129086060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82b415e920 0x7f82b414ab50 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f82a400c500 tx=0x7f82a400c810 comp rx=0 tx=0).stop 2024-09-13T17:10:44.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.785+0000 7f82b3fff700 1 -- 172.21.15.123:0/4129086060 shutdown_connections 2024-09-13T17:10:44.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.785+0000 7f82b3fff700 1 --2- 172.21.15.123:0/4129086060 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f82a0066730 0x7f82a0068bf0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.785+0000 7f82b3fff700 1 --2- 172.21.15.123:0/4129086060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f82b415ed00 0x7f82b414a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.785+0000 7f82b3fff700 1 --2- 172.21.15.123:0/4129086060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82b415e920 0x7f82b414ab50 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.785+0000 7f82b3fff700 1 --2- 172.21.15.123:0/4129086060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b40cb020 0x7f82b41eb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.785+0000 7f82b3fff700 1 -- 172.21.15.123:0/4129086060 >> 172.21.15.123:0/4129086060 conn(0x7f82b4066150 msgr2=0x7f82b4070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:44.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.785+0000 7f82b3fff700 1 -- 172.21.15.123:0/4129086060 shutdown_connections 2024-09-13T17:10:44.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.785+0000 7f82b3fff700 1 -- 172.21.15.123:0/4129086060 wait complete. 2024-09-13T17:10:44.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:06:36.796221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:10:26.903248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:10:27.570928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:10:44.803 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:10:44.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe79e6700 1 Processor -- start 2024-09-13T17:10:44.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe79e6700 1 -- start start 2024-09-13T17:10:44.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe79e6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfe015ae70 0x7fbfe00ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe79e6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbfe006dea0 0x7fbfe00aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe79e6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe00ca250 con 0x7fbfe015aa90 2024-09-13T17:10:44.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe79e6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe00af720 con 0x7fbfe006dea0 2024-09-13T17:10:44.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe79e6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00ca510 con 0x7fbfe015ae70 2024-09-13T17:10:44.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe5782700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbfe015aa90 0x7fbfe006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40422/0 (socket says 172.21.15.123:40422) 2024-09-13T17:10:44.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe5f83700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbfe006dea0 0x7fbfe00aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe5782700 1 -- 172.21.15.123:0/3699067452 learned_addr learned my addr 172.21.15.123:0/3699067452 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:44.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe4f81700 1 --2- 172.21.15.123:0/3699067452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfe015ae70 0x7fbfe00ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfd7fff700 1 -- 172.21.15.123:0/3699067452 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687587013 0 0) 0x7fbfe00ca250 con 0x7fbfe015aa90 2024-09-13T17:10:44.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe5f83700 1 -- 172.21.15.123:0/3699067452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfe015ae70 msgr2=0x7fbfe00ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:44.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe5f83700 1 --2- 172.21.15.123:0/3699067452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfe015ae70 0x7fbfe00ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe5f83700 1 -- 172.21.15.123:0/3699067452 >> v1:172.21.15.123:6789/0 conn(0x7fbfe015aa90 legacy=0x7fbfe006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.909+0000 7fbfe5f83700 1 -- 172.21.15.123:0/3699067452 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe00ca7f0 con 0x7fbfe006dea0 2024-09-13T17:10:44.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.913+0000 7fbfe5f83700 1 --2- 172.21.15.123:0/3699067452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe006dea0 0x7fbfe00aeec0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009850 tx=0x7fbfd8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96e2055f4652cd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:44.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.913+0000 7fbfd7fff700 1 -- 172.21.15.123:0/3699067452 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8011830 con 0x7fbfe006dea0 2024-09-13T17:10:44.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.913+0000 7fbfd7fff700 1 -- 172.21.15.123:0/3699067452 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd8011990 con 0x7fbfe006dea0 2024-09-13T17:10:44.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.913+0000 7fbfd7fff700 1 -- 172.21.15.123:0/3699067452 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8011d40 con 0x7fbfe006dea0 2024-09-13T17:10:44.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.913+0000 7fbfe79e6700 1 -- 172.21.15.123:0/3699067452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe006dea0 msgr2=0x7fbfe00aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.913+0000 7fbfe79e6700 1 --2- 172.21.15.123:0/3699067452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe006dea0 0x7fbfe00aeec0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009850 tx=0x7fbfd8009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:44.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.913+0000 7fbfe79e6700 1 -- 172.21.15.123:0/3699067452 shutdown_connections 2024-09-13T17:10:44.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.913+0000 7fbfe79e6700 1 --2- 172.21.15.123:0/3699067452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe006dea0 0x7fbfe00aeec0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.913+0000 7fbfe79e6700 1 --2- 172.21.15.123:0/3699067452 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfe015ae70 0x7fbfe00ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.913+0000 7fbfe79e6700 1 -- 172.21.15.123:0/3699067452 >> 172.21.15.123:0/3699067452 conn(0x7fbfe00b0450 msgr2=0x7fbfe00b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:44.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.913+0000 7fbfe79e6700 1 -- 172.21.15.123:0/3699067452 shutdown_connections 2024-09-13T17:10:44.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.913+0000 7fbfe79e6700 1 -- 172.21.15.123:0/3699067452 wait complete. 2024-09-13T17:10:44.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe79e6700 1 Processor -- start 2024-09-13T17:10:44.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe79e6700 1 -- start start 2024-09-13T17:10:44.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe79e6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe006dea0 0x7fbfe015db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe79e6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfe015aa90 0x7fbfe0151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe79e6700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfe015b790 0x7fbfe015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe79e6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00c68b0 con 0x7fbfe006dea0 2024-09-13T17:10:44.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe79e6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe0151e90 con 0x7fbfe015aa90 2024-09-13T17:10:44.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe79e6700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00c5ca0 con 0x7fbfe015b790 2024-09-13T17:10:44.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe5782700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe006dea0 0x7fbfe015db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe5782700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe006dea0 0x7fbfe015db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50616/0 (socket says 172.21.15.123:50616) 2024-09-13T17:10:44.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe5782700 1 -- 172.21.15.123:0/1193014730 learned_addr learned my addr 172.21.15.123:0/1193014730 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:44.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe5f83700 1 --2- 172.21.15.123:0/1193014730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfe015b790 0x7fbfe015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe4f81700 1 --2- 172.21.15.123:0/1193014730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfe015aa90 0x7fbfe0151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe5782700 1 -- 172.21.15.123:0/1193014730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfe015b790 msgr2=0x7fbfe015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe5782700 1 --2- 172.21.15.123:0/1193014730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfe015b790 0x7fbfe015bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe5782700 1 -- 172.21.15.123:0/1193014730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfe015aa90 msgr2=0x7fbfe0151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:44.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe5782700 1 --2- 172.21.15.123:0/1193014730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfe015aa90 0x7fbfe0151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:44.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.917+0000 7fbfe5782700 1 -- 172.21.15.123:0/1193014730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd80094b0 con 0x7fbfe006dea0 2024-09-13T17:10:44.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.921+0000 7fbfe5782700 1 --2- 172.21.15.123:0/1193014730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe006dea0 0x7fbfe015db40 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000c580 tx=0x7fbfd000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:44.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.921+0000 7fbfd5ffb700 1 -- 172.21.15.123:0/1193014730 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0004ca0 con 0x7fbfe006dea0 2024-09-13T17:10:44.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.921+0000 7fbfd5ffb700 1 -- 172.21.15.123:0/1193014730 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd0004e20 con 0x7fbfe006dea0 2024-09-13T17:10:44.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.921+0000 7fbfe79e6700 1 -- 172.21.15.123:0/1193014730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe00c5f80 con 0x7fbfe006dea0 2024-09-13T17:10:44.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.921+0000 7fbfd5ffb700 1 -- 172.21.15.123:0/1193014730 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0007310 con 0x7fbfe006dea0 2024-09-13T17:10:44.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.921+0000 7fbfe79e6700 1 -- 172.21.15.123:0/1193014730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe00c6540 con 0x7fbfe006dea0 2024-09-13T17:10:44.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.921+0000 7fbfe79e6700 1 -- 172.21.15.123:0/1193014730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe006d790 con 0x7fbfe006dea0 2024-09-13T17:10:44.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.921+0000 7fbfd5ffb700 1 -- 172.21.15.123:0/1193014730 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbfd0007470 con 0x7fbfe006dea0 2024-09-13T17:10:44.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.921+0000 7fbfd5ffb700 1 --2- 172.21.15.123:0/1193014730 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbfc4066730 0x7fbfc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:44.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.921+0000 7fbfd5ffb700 1 -- 172.21.15.123:0/1193014730 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfd0083de0 con 0x7fbfe006dea0 2024-09-13T17:10:44.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.921+0000 7fbfe4f81700 1 --2- 172.21.15.123:0/1193014730 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbfc4066730 0x7fbfc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:44.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.925+0000 7fbfe4f81700 1 --2- 172.21.15.123:0/1193014730 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbfc4066730 0x7fbfc4068bf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00c51c0 tx=0x7fbfdc00b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:44.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:44.933+0000 7fbfd5ffb700 1 -- 172.21.15.123:0/1193014730 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbfd0051160 con 0x7fbfe006dea0 2024-09-13T17:10:45.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.105+0000 7fbfe79e6700 1 -- 172.21.15.123:0/1193014730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbfe006cf50 con 0x7fbfe006dea0 2024-09-13T17:10:45.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.105+0000 7fbfd5ffb700 1 -- 172.21.15.123:0/1193014730 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbfd0007720 con 0x7fbfe006dea0 2024-09-13T17:10:45.109 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-13T17:10:45.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.109+0000 7fbfe79e6700 1 -- 172.21.15.123:0/1193014730 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbfc4066730 msgr2=0x7fbfc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.109+0000 7fbfe79e6700 1 --2- 172.21.15.123:0/1193014730 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbfc4066730 0x7fbfc4068bf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00c51c0 tx=0x7fbfdc00b040 comp rx=0 tx=0).stop 2024-09-13T17:10:45.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.109+0000 7fbfe79e6700 1 -- 172.21.15.123:0/1193014730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe006dea0 msgr2=0x7fbfe015db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.109+0000 7fbfe79e6700 1 --2- 172.21.15.123:0/1193014730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe006dea0 0x7fbfe015db40 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000c580 tx=0x7fbfd000c890 comp rx=0 tx=0).stop 2024-09-13T17:10:45.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.109+0000 7fbfe79e6700 1 -- 172.21.15.123:0/1193014730 shutdown_connections 2024-09-13T17:10:45.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.109+0000 7fbfe79e6700 1 --2- 172.21.15.123:0/1193014730 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbfc4066730 0x7fbfc4068bf0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.109+0000 7fbfe79e6700 1 --2- 172.21.15.123:0/1193014730 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbfe015b790 0x7fbfe015bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.109+0000 7fbfe79e6700 1 --2- 172.21.15.123:0/1193014730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfe015aa90 0x7fbfe0151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.109+0000 7fbfe79e6700 1 --2- 172.21.15.123:0/1193014730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfe006dea0 0x7fbfe015db40 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.109+0000 7fbfe79e6700 1 -- 172.21.15.123:0/1193014730 >> 172.21.15.123:0/1193014730 conn(0x7fbfe00b0450 msgr2=0x7fbfe00cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:45.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.109+0000 7fbfe79e6700 1 -- 172.21.15.123:0/1193014730 shutdown_connections 2024-09-13T17:10:45.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.109+0000 7fbfe79e6700 1 -- 172.21.15.123:0/1193014730 wait complete. 2024-09-13T17:10:45.124 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:10:45.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f7577fff700 1 Processor -- start 2024-09-13T17:10:45.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f7577fff700 1 -- start start 2024-09-13T17:10:45.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f7577fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75780d0f40 0x7f75780d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f7577fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75780cd5e0 0x7f75780cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f7577fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75780d0cb0 con 0x7f75780b58b0 2024-09-13T17:10:45.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f7577fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75780b0060 con 0x7f75780cd5e0 2024-09-13T17:10:45.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f7577fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75780b0340 con 0x7f75780d0f40 2024-09-13T17:10:45.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f75777fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75780cd5e0 0x7f75780cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f75767fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f75780b58b0 0x7f75780d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40434/0 (socket says 172.21.15.123:40434) 2024-09-13T17:10:45.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f75767fc700 1 -- 172.21.15.123:0/3247564125 learned_addr learned my addr 172.21.15.123:0/3247564125 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:45.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f7576ffd700 1 --2- 172.21.15.123:0/3247564125 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75780d0f40 0x7f75780d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f75777fe700 1 -- 172.21.15.123:0/3247564125 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75780d0f40 msgr2=0x7f75780d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:45.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f75777fe700 1 --2- 172.21.15.123:0/3247564125 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75780d0f40 0x7f75780d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f75777fe700 1 -- 172.21.15.123:0/3247564125 >> v1:172.21.15.123:6789/0 conn(0x7f75780b58b0 legacy=0x7f75780d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f75777fe700 1 -- 172.21.15.123:0/3247564125 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75780b0620 con 0x7f75780cd5e0 2024-09-13T17:10:45.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f7575ffb700 1 -- 172.21.15.123:0/3247564125 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411425482 0 0) 0x7f75780d0cb0 con 0x7f75780b58b0 2024-09-13T17:10:45.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f75777fe700 1 --2- 172.21.15.123:0/3247564125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75780cd5e0 0x7f75780cda30 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7570009d90 tx=0x7f757000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59b4f4438779e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:45.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f7575ffb700 1 -- 172.21.15.123:0/3247564125 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000e070 con 0x7f75780cd5e0 2024-09-13T17:10:45.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f7575ffb700 1 -- 172.21.15.123:0/3247564125 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757000bb20 con 0x7f75780cd5e0 2024-09-13T17:10:45.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.245+0000 7f7575ffb700 1 -- 172.21.15.123:0/3247564125 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570012430 con 0x7f75780cd5e0 2024-09-13T17:10:45.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 -- 172.21.15.123:0/3247564125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75780cd5e0 msgr2=0x7f75780cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 --2- 172.21.15.123:0/3247564125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75780cd5e0 0x7f75780cda30 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7570009d90 tx=0x7f757000b330 comp rx=0 tx=0).stop 2024-09-13T17:10:45.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 -- 172.21.15.123:0/3247564125 shutdown_connections 2024-09-13T17:10:45.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 --2- 172.21.15.123:0/3247564125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75780cd5e0 0x7f75780cda30 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 --2- 172.21.15.123:0/3247564125 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75780d0f40 0x7f75780d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 -- 172.21.15.123:0/3247564125 >> 172.21.15.123:0/3247564125 conn(0x7f75780d2a60 msgr2=0x7f75780d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:45.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 -- 172.21.15.123:0/3247564125 shutdown_connections 2024-09-13T17:10:45.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 -- 172.21.15.123:0/3247564125 wait complete. 2024-09-13T17:10:45.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 Processor -- start 2024-09-13T17:10:45.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 -- start start 2024-09-13T17:10:45.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75780b58b0 0x7f757815bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75780cd5e0 0x7f75780c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75780d0f40 0x7f75780c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757815c060 con 0x7f75780d0f40 2024-09-13T17:10:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75780c7840 con 0x7f75780cd5e0 2024-09-13T17:10:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75780c7d20 con 0x7f75780b58b0 2024-09-13T17:10:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f75777fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75780d0f40 0x7f75780c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f75777fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75780d0f40 0x7f75780c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50636/0 (socket says 172.21.15.123:50636) 2024-09-13T17:10:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f75777fe700 1 -- 172.21.15.123:0/947430382 learned_addr learned my addr 172.21.15.123:0/947430382 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7576ffd700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75780b58b0 0x7f757815bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f75767fc700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75780cd5e0 0x7f75780c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f75777fe700 1 -- 172.21.15.123:0/947430382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75780b58b0 msgr2=0x7f757815bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f75777fe700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75780b58b0 0x7f757815bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f75777fe700 1 -- 172.21.15.123:0/947430382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75780cd5e0 msgr2=0x7f75780c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f75777fe700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75780cd5e0 0x7f75780c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f75777fe700 1 -- 172.21.15.123:0/947430382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7570009a70 con 0x7f75780d0f40 2024-09-13T17:10:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f75767fc700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75780cd5e0 0x7f75780c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:45.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f75777fe700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75780d0f40 0x7f75780c8ae0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f7570014040 tx=0x7f7570004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:45.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f755f7fe700 1 -- 172.21.15.123:0/947430382 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570012430 con 0x7f75780d0f40 2024-09-13T17:10:45.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f755f7fe700 1 -- 172.21.15.123:0/947430382 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7570020070 con 0x7f75780d0f40 2024-09-13T17:10:45.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 -- 172.21.15.123:0/947430382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75780c8000 con 0x7f75780d0f40 2024-09-13T17:10:45.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f755f7fe700 1 -- 172.21.15.123:0/947430382 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570004280 con 0x7f75780d0f40 2024-09-13T17:10:45.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.249+0000 7f7577fff700 1 -- 172.21.15.123:0/947430382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75780c85c0 con 0x7f75780d0f40 2024-09-13T17:10:45.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.253+0000 7f7577fff700 1 -- 172.21.15.123:0/947430382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757815ce70 con 0x7f75780d0f40 2024-09-13T17:10:45.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.253+0000 7f755f7fe700 1 -- 172.21.15.123:0/947430382 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f75700043e0 con 0x7f75780d0f40 2024-09-13T17:10:45.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.253+0000 7f755f7fe700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7564066730 0x7f7564068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.253+0000 7f755f7fe700 1 -- 172.21.15.123:0/947430382 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7570022070 con 0x7f75780d0f40 2024-09-13T17:10:45.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.253+0000 7f7576ffd700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7564066730 0x7f7564068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.253+0000 7f7576ffd700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7564066730 0x7f7564068bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7568009b80 tx=0x7f7568008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:45.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.265+0000 7f755f7fe700 1 -- 172.21.15.123:0/947430382 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f75700b7db0 con 0x7f75780d0f40 2024-09-13T17:10:45.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.433+0000 7f7577fff700 1 -- 172.21.15.123:0/947430382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75780b7bc0 con 0x7f75780d0f40 2024-09-13T17:10:45.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.433+0000 7f755f7fe700 1 -- 172.21.15.123:0/947430382 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7570053570 con 0x7f75780d0f40 2024-09-13T17:10:45.435 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-13T17:10:45.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.433+0000 7f7577fff700 1 -- 172.21.15.123:0/947430382 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7564066730 msgr2=0x7f7564068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.433+0000 7f7577fff700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7564066730 0x7f7564068bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7568009b80 tx=0x7f7568008040 comp rx=0 tx=0).stop 2024-09-13T17:10:45.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.433+0000 7f7577fff700 1 -- 172.21.15.123:0/947430382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75780d0f40 msgr2=0x7f75780c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.433+0000 7f7577fff700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75780d0f40 0x7f75780c8ae0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f7570014040 tx=0x7f7570004af0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.437+0000 7f7577fff700 1 -- 172.21.15.123:0/947430382 shutdown_connections 2024-09-13T17:10:45.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.437+0000 7f7577fff700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7564066730 0x7f7564068bf0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.437+0000 7f7577fff700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75780d0f40 0x7f75780c8ae0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.437+0000 7f7577fff700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75780cd5e0 0x7f75780c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.437+0000 7f7577fff700 1 --2- 172.21.15.123:0/947430382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75780b58b0 0x7f757815bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.437+0000 7f7577fff700 1 -- 172.21.15.123:0/947430382 >> 172.21.15.123:0/947430382 conn(0x7f75780d2a60 msgr2=0x7f75781e8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:45.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.437+0000 7f7577fff700 1 -- 172.21.15.123:0/947430382 shutdown_connections 2024-09-13T17:10:45.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.437+0000 7f7577fff700 1 -- 172.21.15.123:0/947430382 wait complete. 2024-09-13T17:10:45.454 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:10:45.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.573+0000 7ff56a704700 1 Processor -- start 2024-09-13T17:10:45.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.573+0000 7ff56a704700 1 -- start start 2024-09-13T17:10:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.573+0000 7ff56a704700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff5641596c0 0x7ff56415d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.573+0000 7ff56a704700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff56406dc90 0x7ff564070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.573+0000 7ff56a704700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5640cd2e0 con 0x7ff5641592e0 2024-09-13T17:10:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.573+0000 7ff56a704700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5640cd5c0 con 0x7ff5641596c0 2024-09-13T17:10:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.573+0000 7ff56a704700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5640cd8a0 con 0x7ff56406dc90 2024-09-13T17:10:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.573+0000 7ff568f01700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff5641596c0 0x7ff56415d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.573+0000 7ff569702700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff5641592e0 0x7ff56415d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40436/0 (socket says 172.21.15.123:40436) 2024-09-13T17:10:45.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.573+0000 7ff569702700 1 -- 172.21.15.123:0/3493748279 learned_addr learned my addr 172.21.15.123:0/3493748279 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:45.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.573+0000 7ff569f03700 1 --2- 172.21.15.123:0/3493748279 >> v2:172.21.15.153:3300/0 conn(0x7ff56406dc90 0x7ff564070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff568f01700 1 -- 172.21.15.123:0/3493748279 >> v2:172.21.15.153:3300/0 conn(0x7ff56406dc90 msgr2=0x7ff564070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:45.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff568f01700 1 --2- 172.21.15.123:0/3493748279 >> v2:172.21.15.153:3300/0 conn(0x7ff56406dc90 0x7ff564070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff568f01700 1 -- 172.21.15.123:0/3493748279 >> v1:172.21.15.123:6789/0 conn(0x7ff5641592e0 legacy=0x7ff56415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff557fff700 1 -- 172.21.15.123:0/3493748279 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729125577 0 0) 0x7ff5640cd2e0 con 0x7ff5641592e0 2024-09-13T17:10:45.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff568f01700 1 -- 172.21.15.123:0/3493748279 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5640cdb80 con 0x7ff5641596c0 2024-09-13T17:10:45.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff568f01700 1 --2- 172.21.15.123:0/3493748279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5641596c0 0x7ff56415d740 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ff5640cc160 tx=0x7ff558009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483165ae2550bef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:45.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff557fff700 1 -- 172.21.15.123:0/3493748279 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558010800 con 0x7ff5641596c0 2024-09-13T17:10:45.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff557fff700 1 -- 172.21.15.123:0/3493748279 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558010960 con 0x7ff5641596c0 2024-09-13T17:10:45.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff557fff700 1 -- 172.21.15.123:0/3493748279 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558010cf0 con 0x7ff5641596c0 2024-09-13T17:10:45.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 -- 172.21.15.123:0/3493748279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5641596c0 msgr2=0x7ff56415d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 --2- 172.21.15.123:0/3493748279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5641596c0 0x7ff56415d740 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ff5640cc160 tx=0x7ff558009b30 comp rx=0 tx=0).stop 2024-09-13T17:10:45.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 -- 172.21.15.123:0/3493748279 shutdown_connections 2024-09-13T17:10:45.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 --2- 172.21.15.123:0/3493748279 >> v2:172.21.15.153:3300/0 conn(0x7ff56406dc90 0x7ff564070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 --2- 172.21.15.123:0/3493748279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5641596c0 0x7ff56415d740 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 -- 172.21.15.123:0/3493748279 >> 172.21.15.123:0/3493748279 conn(0x7ff5640b01d0 msgr2=0x7ff5640b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:45.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 -- 172.21.15.123:0/3493748279 shutdown_connections 2024-09-13T17:10:45.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 -- 172.21.15.123:0/3493748279 wait complete. 2024-09-13T17:10:45.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 Processor -- start 2024-09-13T17:10:45.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 -- start start 2024-09-13T17:10:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff56406dc90 0x7ff56415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5641592e0 0x7ff56415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5641596c0 0x7ff56415b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640c6b60 con 0x7ff5641596c0 2024-09-13T17:10:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56415c510 con 0x7ff5641592e0 2024-09-13T17:10:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff56a704700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640c5ee0 con 0x7ff56406dc90 2024-09-13T17:10:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.577+0000 7ff569f03700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5641596c0 0x7ff56415b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff569f03700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5641596c0 0x7ff56415b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50650/0 (socket says 172.21.15.123:50650) 2024-09-13T17:10:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff568f01700 1 --2- 172.21.15.123:0/3721375682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5641592e0 0x7ff56415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff569f03700 1 -- 172.21.15.123:0/3721375682 learned_addr learned my addr 172.21.15.123:0/3721375682 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff569702700 1 --2- 172.21.15.123:0/3721375682 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff56406dc90 0x7ff56415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff569f03700 1 -- 172.21.15.123:0/3721375682 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff56406dc90 msgr2=0x7ff56415bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff569f03700 1 --2- 172.21.15.123:0/3721375682 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff56406dc90 0x7ff56415bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff569f03700 1 -- 172.21.15.123:0/3721375682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5641592e0 msgr2=0x7ff56415ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff569f03700 1 --2- 172.21.15.123:0/3721375682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5641592e0 0x7ff56415ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff569f03700 1 -- 172.21.15.123:0/3721375682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5580094b0 con 0x7ff5641596c0 2024-09-13T17:10:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff569f03700 1 --2- 172.21.15.123:0/3721375682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5641596c0 0x7ff56415b060 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00efc0 tx=0x7ff55c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff555ffb700 1 -- 172.21.15.123:0/3721375682 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00cad0 con 0x7ff5641596c0 2024-09-13T17:10:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff555ffb700 1 -- 172.21.15.123:0/3721375682 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c00f040 con 0x7ff5641596c0 2024-09-13T17:10:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff56a704700 1 -- 172.21.15.123:0/3721375682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5640c61c0 con 0x7ff5641596c0 2024-09-13T17:10:45.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff555ffb700 1 -- 172.21.15.123:0/3721375682 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00ce70 con 0x7ff5641596c0 2024-09-13T17:10:45.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff56a704700 1 -- 172.21.15.123:0/3721375682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5640c6780 con 0x7ff5641596c0 2024-09-13T17:10:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.581+0000 7ff56a704700 1 -- 172.21.15.123:0/3721375682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5640c6ca0 con 0x7ff5641596c0 2024-09-13T17:10:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.585+0000 7ff555ffb700 1 -- 172.21.15.123:0/3721375682 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff55c014480 con 0x7ff5641596c0 2024-09-13T17:10:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.585+0000 7ff555ffb700 1 --2- 172.21.15.123:0/3721375682 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff548066730 0x7ff548068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.585+0000 7ff555ffb700 1 -- 172.21.15.123:0/3721375682 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff55c084800 con 0x7ff5641596c0 2024-09-13T17:10:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.585+0000 7ff569702700 1 --2- 172.21.15.123:0/3721375682 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff548066730 0x7ff548068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.585+0000 7ff569702700 1 --2- 172.21.15.123:0/3721375682 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff548066730 0x7ff548068bf0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff560000f60 tx=0x7ff560007e90 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:45.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.593+0000 7ff555ffb700 1 -- 172.21.15.123:0/3721375682 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5640c6ca0 con 0x7ff5641596c0 2024-09-13T17:10:45.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.761+0000 7ff56a704700 1 -- 172.21.15.123:0/3721375682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5640c6ca0 con 0x7ff5641596c0 2024-09-13T17:10:45.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.761+0000 7ff555ffb700 1 -- 172.21.15.123:0/3721375682 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5640c6ca0 con 0x7ff5641596c0 2024-09-13T17:10:45.764 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-13T17:10:45.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.765+0000 7ff56a704700 1 -- 172.21.15.123:0/3721375682 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff548066730 msgr2=0x7ff548068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.765+0000 7ff56a704700 1 --2- 172.21.15.123:0/3721375682 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff548066730 0x7ff548068bf0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff560000f60 tx=0x7ff560007e90 comp rx=0 tx=0).stop 2024-09-13T17:10:45.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.765+0000 7ff56a704700 1 -- 172.21.15.123:0/3721375682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5641596c0 msgr2=0x7ff56415b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.765+0000 7ff56a704700 1 --2- 172.21.15.123:0/3721375682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5641596c0 0x7ff56415b060 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00efc0 tx=0x7ff55c00c0c0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.765+0000 7ff56a704700 1 -- 172.21.15.123:0/3721375682 shutdown_connections 2024-09-13T17:10:45.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.765+0000 7ff56a704700 1 --2- 172.21.15.123:0/3721375682 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff548066730 0x7ff548068bf0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.765+0000 7ff56a704700 1 --2- 172.21.15.123:0/3721375682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5641596c0 0x7ff56415b060 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.765+0000 7ff56a704700 1 --2- 172.21.15.123:0/3721375682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5641592e0 0x7ff56415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.765+0000 7ff56a704700 1 --2- 172.21.15.123:0/3721375682 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff56406dc90 0x7ff56415bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.765+0000 7ff56a704700 1 -- 172.21.15.123:0/3721375682 >> 172.21.15.123:0/3721375682 conn(0x7ff5640b01d0 msgr2=0x7ff5640b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:45.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.765+0000 7ff56a704700 1 -- 172.21.15.123:0/3721375682 shutdown_connections 2024-09-13T17:10:45.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.765+0000 7ff56a704700 1 -- 172.21.15.123:0/3721375682 wait complete. 2024-09-13T17:10:45.784 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:45.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.893+0000 7fb353fff700 1 Processor -- start 2024-09-13T17:10:45.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.893+0000 7fb353fff700 1 -- start start 2024-09-13T17:10:45.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.893+0000 7fb353fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb35415e920 0x7fb3540caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.893+0000 7fb353fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3540cb020 0x7fb354161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.893+0000 7fb353fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb35415ed00 0x7fb3540cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.893+0000 7fb353fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb354162550 con 0x7fb35415ed00 2024-09-13T17:10:45.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.893+0000 7fb353fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3540cd690 con 0x7fb35415e920 2024-09-13T17:10:45.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.893+0000 7fb353fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb354161f90 con 0x7fb3540cb020 2024-09-13T17:10:45.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.893+0000 7fb3537fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb35415ed00 0x7fb3540cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.893+0000 7fb3537fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb35415ed00 0x7fb3540cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50656/0 (socket says 172.21.15.123:50656) 2024-09-13T17:10:45.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.893+0000 7fb3527fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3540cb020 0x7fb354161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.893+0000 7fb352ffd700 1 --2- 172.21.15.123:0/2135317578 >> v2:172.21.15.153:3300/0 conn(0x7fb35415e920 0x7fb3540caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.893+0000 7fb3537fe700 1 -- 172.21.15.123:0/2135317578 learned_addr learned my addr 172.21.15.123:0/2135317578 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:45.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb3537fe700 1 -- 172.21.15.123:0/2135317578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3540cb020 msgr2=0x7fb354161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:45.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb3537fe700 1 --2- 172.21.15.123:0/2135317578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3540cb020 0x7fb354161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb3537fe700 1 -- 172.21.15.123:0/2135317578 >> v2:172.21.15.153:3300/0 conn(0x7fb35415e920 msgr2=0x7fb3540caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:45.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb3537fe700 1 --2- 172.21.15.123:0/2135317578 >> v2:172.21.15.153:3300/0 conn(0x7fb35415e920 0x7fb3540caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb3537fe700 1 -- 172.21.15.123:0/2135317578 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354162270 con 0x7fb35415ed00 2024-09-13T17:10:45.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb3537fe700 1 --2- 172.21.15.123:0/2135317578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb35415ed00 0x7fb3540cdb20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fb354066f90 tx=0x7fb34c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28084bf8d146cbb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:45.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb351ffb700 1 -- 172.21.15.123:0/2135317578 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c00e070 con 0x7fb35415ed00 2024-09-13T17:10:45.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb351ffb700 1 -- 172.21.15.123:0/2135317578 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c00b910 con 0x7fb35415ed00 2024-09-13T17:10:45.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb351ffb700 1 -- 172.21.15.123:0/2135317578 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c00bcc0 con 0x7fb35415ed00 2024-09-13T17:10:45.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb353fff700 1 -- 172.21.15.123:0/2135317578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb35415ed00 msgr2=0x7fb3540cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb353fff700 1 --2- 172.21.15.123:0/2135317578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb35415ed00 0x7fb3540cdb20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fb354066f90 tx=0x7fb34c00b330 comp rx=0 tx=0).stop 2024-09-13T17:10:45.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb353fff700 1 -- 172.21.15.123:0/2135317578 shutdown_connections 2024-09-13T17:10:45.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb353fff700 1 --2- 172.21.15.123:0/2135317578 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3540cb020 0x7fb354161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb353fff700 1 --2- 172.21.15.123:0/2135317578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb35415ed00 0x7fb3540cdb20 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb353fff700 1 --2- 172.21.15.123:0/2135317578 >> v2:172.21.15.153:3300/0 conn(0x7fb35415e920 0x7fb3540caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb353fff700 1 -- 172.21.15.123:0/2135317578 >> 172.21.15.123:0/2135317578 conn(0x7fb354066150 msgr2=0x7fb354066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:45.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb353fff700 1 -- 172.21.15.123:0/2135317578 shutdown_connections 2024-09-13T17:10:45.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.897+0000 7fb353fff700 1 -- 172.21.15.123:0/2135317578 wait complete. 2024-09-13T17:10:45.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb353fff700 1 Processor -- start 2024-09-13T17:10:45.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb353fff700 1 -- start start 2024-09-13T17:10:45.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb353fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3540cb020 0x7fb3540c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb353fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb35415e920 0x7fb3540c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb353fff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb35415ed00 0x7fb3540711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb353fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3541566a0 con 0x7fb3540cb020 2024-09-13T17:10:45.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb353fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb354156980 con 0x7fb35415e920 2024-09-13T17:10:45.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb353fff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb354156c60 con 0x7fb35415ed00 2024-09-13T17:10:45.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb352ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3540cb020 0x7fb3540c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb352ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3540cb020 0x7fb3540c4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50668/0 (socket says 172.21.15.123:50668) 2024-09-13T17:10:45.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb352ffd700 1 -- 172.21.15.123:0/2677035996 learned_addr learned my addr 172.21.15.123:0/2677035996 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:45.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb3537fe700 1 --2- 172.21.15.123:0/2677035996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb35415ed00 0x7fb3540711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb3527fc700 1 --2- 172.21.15.123:0/2677035996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb35415e920 0x7fb3540c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb352ffd700 1 -- 172.21.15.123:0/2677035996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb35415ed00 msgr2=0x7fb3540711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb352ffd700 1 --2- 172.21.15.123:0/2677035996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb35415ed00 0x7fb3540711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb352ffd700 1 -- 172.21.15.123:0/2677035996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb35415e920 msgr2=0x7fb3540c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb352ffd700 1 --2- 172.21.15.123:0/2677035996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb35415e920 0x7fb3540c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb352ffd700 1 -- 172.21.15.123:0/2677035996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c009b30 con 0x7fb3540cb020 2024-09-13T17:10:45.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb352ffd700 1 --2- 172.21.15.123:0/2677035996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3540cb020 0x7fb3540c4840 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fb34400e9d0 tx=0x7fb34400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:45.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb33b7fe700 1 -- 172.21.15.123:0/2677035996 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344009720 con 0x7fb3540cb020 2024-09-13T17:10:45.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb33b7fe700 1 -- 172.21.15.123:0/2677035996 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34400ee70 con 0x7fb3540cb020 2024-09-13T17:10:45.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb353fff700 1 -- 172.21.15.123:0/2677035996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb354156f40 con 0x7fb3540cb020 2024-09-13T17:10:45.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb33b7fe700 1 -- 172.21.15.123:0/2677035996 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34400ca50 con 0x7fb3540cb020 2024-09-13T17:10:45.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.901+0000 7fb353fff700 1 -- 172.21.15.123:0/2677035996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35414f1b0 con 0x7fb3540cb020 2024-09-13T17:10:45.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.905+0000 7fb353fff700 1 -- 172.21.15.123:0/2677035996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3540677f0 con 0x7fb3540cb020 2024-09-13T17:10:45.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.905+0000 7fb33b7fe700 1 -- 172.21.15.123:0/2677035996 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb34400cbb0 con 0x7fb3540cb020 2024-09-13T17:10:45.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.905+0000 7fb33b7fe700 1 --2- 172.21.15.123:0/2677035996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb340066730 0x7fb340068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.905+0000 7fb33b7fe700 1 -- 172.21.15.123:0/2677035996 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3440840c0 con 0x7fb3540cb020 2024-09-13T17:10:45.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.905+0000 7fb3527fc700 1 --2- 172.21.15.123:0/2677035996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb340066730 0x7fb340068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.905+0000 7fb3527fc700 1 --2- 172.21.15.123:0/2677035996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb340066730 0x7fb340068bf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb3540726e0 tx=0x7fb348009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:45.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:45.909+0000 7fb33b7fe700 1 -- 172.21.15.123:0/2677035996 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb344051430 con 0x7fb3540cb020 2024-09-13T17:10:46.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.109+0000 7fb353fff700 1 -- 172.21.15.123:0/2677035996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3540b1c40 con 0x7fb3540cb020 2024-09-13T17:10:46.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.113+0000 7fb33b7fe700 1 -- 172.21.15.123:0/2677035996 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4748 (secure 0 0 0) 0x7fb34400ce60 con 0x7fb3540cb020 2024-09-13T17:10:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:46.115 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":48,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7156,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3705271604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705271604},{"type":"v1","addr":"172.21.15.153:6834","nonce":3705271604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2842144578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":2842144578},{"type":"v1","addr":"172.21.15.153:6835","nonce":2842144578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7398,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2022373739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2022373739},{"type":"v1","addr":"172.21.15.123:6835","nonce":2022373739}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:10:28.586943+0000","modified":"2024-09-13T17:10:31.604775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7401":{"gid":7401,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/1688881065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1688881065},{"type":"v1","addr":"172.21.15.123:6837","nonce":1688881065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:10:46.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.113+0000 7fb353fff700 1 -- 172.21.15.123:0/2677035996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb340066730 msgr2=0x7fb340068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.113+0000 7fb353fff700 1 --2- 172.21.15.123:0/2677035996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb340066730 0x7fb340068bf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb3540726e0 tx=0x7fb348009240 comp rx=0 tx=0).stop 2024-09-13T17:10:46.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.113+0000 7fb353fff700 1 -- 172.21.15.123:0/2677035996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3540cb020 msgr2=0x7fb3540c4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.113+0000 7fb353fff700 1 --2- 172.21.15.123:0/2677035996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3540cb020 0x7fb3540c4840 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fb34400e9d0 tx=0x7fb34400ece0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.113+0000 7fb353fff700 1 -- 172.21.15.123:0/2677035996 shutdown_connections 2024-09-13T17:10:46.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.113+0000 7fb353fff700 1 --2- 172.21.15.123:0/2677035996 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb340066730 0x7fb340068bf0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.113+0000 7fb353fff700 1 --2- 172.21.15.123:0/2677035996 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb35415ed00 0x7fb3540711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.113+0000 7fb353fff700 1 --2- 172.21.15.123:0/2677035996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb35415e920 0x7fb3540c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.113+0000 7fb353fff700 1 --2- 172.21.15.123:0/2677035996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3540cb020 0x7fb3540c4840 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.113+0000 7fb353fff700 1 -- 172.21.15.123:0/2677035996 >> 172.21.15.123:0/2677035996 conn(0x7fb354066150 msgr2=0x7fb354066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:46.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.113+0000 7fb353fff700 1 -- 172.21.15.123:0/2677035996 shutdown_connections 2024-09-13T17:10:46.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.113+0000 7fb353fff700 1 -- 172.21.15.123:0/2677035996 wait complete. 2024-09-13T17:10:46.119 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 48 2024-09-13T17:10:46.130 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:46.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b68861700 1 Processor -- start 2024-09-13T17:10:46.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b68861700 1 -- start start 2024-09-13T17:10:46.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b68861700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0b640cdb20 0x7f0b640cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b68861700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b64162550 con 0x7f0b6415ed00 2024-09-13T17:10:46.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b68861700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b640ce4a0 con 0x7f0b6415e920 2024-09-13T17:10:46.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b68861700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b640cd690 con 0x7f0b640cdb20 2024-09-13T17:10:46.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b6359e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0b640cdb20 0x7f0b640cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b6259c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0b6415ed00 0x7f0b64161540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40450/0 (socket says 172.21.15.123:40450) 2024-09-13T17:10:46.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b6259c700 1 -- 172.21.15.123:0/1547867153 learned_addr learned my addr 172.21.15.123:0/1547867153 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:46.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b6359e700 1 -- 172.21.15.123:0/1547867153 >> v1:172.21.15.153:6789/0 conn(0x7f0b6415e920 legacy=0x7f0b640caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b6359e700 1 -- 172.21.15.123:0/1547867153 >> v1:172.21.15.123:6789/0 conn(0x7f0b6415ed00 legacy=0x7f0b64161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b6359e700 1 -- 172.21.15.123:0/1547867153 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b64161f90 con 0x7f0b640cdb20 2024-09-13T17:10:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b6359e700 1 --2- 172.21.15.123:0/1547867153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b640cdb20 0x7f0b640cdf60 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009d90 tx=0x7f0b5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee1053172b632e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b61d9b700 1 -- 172.21.15.123:0/1547867153 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c00e070 con 0x7f0b640cdb20 2024-09-13T17:10:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b61d9b700 1 -- 172.21.15.123:0/1547867153 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c00bbd0 con 0x7f0b640cdb20 2024-09-13T17:10:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b61d9b700 1 -- 172.21.15.123:0/1547867153 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c012430 con 0x7f0b640cdb20 2024-09-13T17:10:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b68861700 1 -- 172.21.15.123:0/1547867153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b640cdb20 msgr2=0x7f0b640cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b68861700 1 --2- 172.21.15.123:0/1547867153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b640cdb20 0x7f0b640cdf60 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009d90 tx=0x7f0b5c00b330 comp rx=0 tx=0).stop 2024-09-13T17:10:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b68861700 1 -- 172.21.15.123:0/1547867153 shutdown_connections 2024-09-13T17:10:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b68861700 1 --2- 172.21.15.123:0/1547867153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b640cdb20 0x7f0b640cdf60 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b68861700 1 -- 172.21.15.123:0/1547867153 >> 172.21.15.123:0/1547867153 conn(0x7f0b64066150 msgr2=0x7f0b64066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b68861700 1 -- 172.21.15.123:0/1547867153 shutdown_connections 2024-09-13T17:10:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.245+0000 7f0b68861700 1 -- 172.21.15.123:0/1547867153 wait complete. 2024-09-13T17:10:46.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.249+0000 7f0b68861700 1 Processor -- start 2024-09-13T17:10:46.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.249+0000 7f0b68861700 1 -- start start 2024-09-13T17:10:46.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b68861700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b640cdb20 0x7f0b64158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b68861700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b6415e920 0x7f0b641ea520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b68861700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b6415ed00 0x7f0b641eaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b68861700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6415cd40 con 0x7f0b6415e920 2024-09-13T17:10:46.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b68861700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6415d020 con 0x7f0b6415ed00 2024-09-13T17:10:46.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b68861700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6415d300 con 0x7f0b640cdb20 2024-09-13T17:10:46.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b6259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b6415e920 0x7f0b641ea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b6259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b6415e920 0x7f0b641ea520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50696/0 (socket says 172.21.15.123:50696) 2024-09-13T17:10:46.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b6259c700 1 -- 172.21.15.123:0/647725249 learned_addr learned my addr 172.21.15.123:0/647725249 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:46.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b62d9d700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b640cdb20 0x7f0b64158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b6359e700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b6415ed00 0x7f0b641eaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b6259c700 1 -- 172.21.15.123:0/647725249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b640cdb20 msgr2=0x7f0b64158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b6259c700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b640cdb20 0x7f0b64158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b6259c700 1 -- 172.21.15.123:0/647725249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b6415ed00 msgr2=0x7f0b641eaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b6259c700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b6415ed00 0x7f0b641eaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b6259c700 1 -- 172.21.15.123:0/647725249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c009a70 con 0x7f0b6415e920 2024-09-13T17:10:46.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b6359e700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b6415ed00 0x7f0b641eaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:46.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b6259c700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b6415e920 0x7f0b641ea520 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c001eb0 tx=0x7f0b4c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:46.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b5b7fe700 1 -- 172.21.15.123:0/647725249 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c005d90 con 0x7f0b6415e920 2024-09-13T17:10:46.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b5b7fe700 1 -- 172.21.15.123:0/647725249 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c0070d0 con 0x7f0b6415e920 2024-09-13T17:10:46.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b68861700 1 -- 172.21.15.123:0/647725249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6415d5e0 con 0x7f0b6415e920 2024-09-13T17:10:46.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b5b7fe700 1 -- 172.21.15.123:0/647725249 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c007440 con 0x7f0b6415e920 2024-09-13T17:10:46.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b68861700 1 -- 172.21.15.123:0/647725249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b64157260 con 0x7f0b6415e920 2024-09-13T17:10:46.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b68861700 1 -- 172.21.15.123:0/647725249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b640677f0 con 0x7f0b6415e920 2024-09-13T17:10:46.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.253+0000 7f0b5b7fe700 1 -- 172.21.15.123:0/647725249 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0b4c0075a0 con 0x7f0b6415e920 2024-09-13T17:10:46.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.257+0000 7f0b5b7fe700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0b44066730 0x7f0b44068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.257+0000 7f0b62d9d700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0b44066730 0x7f0b44068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.257+0000 7f0b5b7fe700 1 -- 172.21.15.123:0/647725249 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b4c083540 con 0x7f0b6415e920 2024-09-13T17:10:46.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.257+0000 7f0b62d9d700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0b44066730 0x7f0b44068bf0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0b54000f60 tx=0x7f0b54009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.265+0000 7f0b5b7fe700 1 -- 172.21.15.123:0/647725249 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0b4c0508c0 con 0x7f0b6415e920 2024-09-13T17:10:46.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.437+0000 7f0b68861700 1 -- 172.21.15.123:0/647725249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b640cc900 con 0x7f0b6415e920 2024-09-13T17:10:46.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.437+0000 7f0b5b7fe700 1 -- 172.21.15.123:0/647725249 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16556 (secure 0 0 0) 0x7f0b4c053ee0 con 0x7f0b6415e920 2024-09-13T17:10:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:46.441 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":98,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:29.590478+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:10:26.903248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T17:10:27.570928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:46.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.441+0000 7f0b68861700 1 -- 172.21.15.123:0/647725249 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0b44066730 msgr2=0x7f0b44068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.441+0000 7f0b68861700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0b44066730 0x7f0b44068bf0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0b54000f60 tx=0x7f0b54009040 comp rx=0 tx=0).stop 2024-09-13T17:10:46.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.441+0000 7f0b68861700 1 -- 172.21.15.123:0/647725249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b6415e920 msgr2=0x7f0b641ea520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.441+0000 7f0b68861700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b6415e920 0x7f0b641ea520 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c001eb0 tx=0x7f0b4c00c860 comp rx=0 tx=0).stop 2024-09-13T17:10:46.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.441+0000 7f0b68861700 1 -- 172.21.15.123:0/647725249 shutdown_connections 2024-09-13T17:10:46.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.441+0000 7f0b68861700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f0b44066730 0x7f0b44068bf0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.441+0000 7f0b68861700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b6415ed00 0x7f0b641eaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.441+0000 7f0b68861700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b6415e920 0x7f0b641ea520 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.441+0000 7f0b68861700 1 --2- 172.21.15.123:0/647725249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b640cdb20 0x7f0b64158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.441+0000 7f0b68861700 1 -- 172.21.15.123:0/647725249 >> 172.21.15.123:0/647725249 conn(0x7f0b64066150 msgr2=0x7f0b640ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:46.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.441+0000 7f0b68861700 1 -- 172.21.15.123:0/647725249 shutdown_connections 2024-09-13T17:10:46.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.441+0000 7f0b68861700 1 -- 172.21.15.123:0/647725249 wait complete. 2024-09-13T17:10:46.461 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:10:46.461 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:46.556 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:10:46.559 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:10:46.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f8298a60700 1 Processor -- start 2024-09-13T17:10:46.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f8298a60700 1 -- start start 2024-09-13T17:10:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f8298a60700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8294153f00 0x7f82940ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f8298a60700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f829415e0d0 0x7f82940cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f8298a60700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82941542e0 con 0x7f829415ab30 2024-09-13T17:10:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f8298a60700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82940ced30 con 0x7f8294153f00 2024-09-13T17:10:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f8298a60700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8294159df0 con 0x7f829415e0d0 2024-09-13T17:10:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f82937fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8294153f00 0x7f82940ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f82937fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8294153f00 0x7f82940ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50710/0 (socket says 172.21.15.123:50710) 2024-09-13T17:10:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f82937fe700 1 -- 172.21.15.123:0/2344081296 learned_addr learned my addr 172.21.15.123:0/2344081296 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f8292ffd700 1 --2- 172.21.15.123:0/2344081296 >> v2:172.21.15.153:3300/0 conn(0x7f829415e0d0 0x7f82940cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f82937fe700 1 -- 172.21.15.123:0/2344081296 >> v2:172.21.15.153:3300/0 conn(0x7f829415e0d0 msgr2=0x7f82940cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f82937fe700 1 --2- 172.21.15.123:0/2344081296 >> v2:172.21.15.153:3300/0 conn(0x7f829415e0d0 0x7f82940cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f82937fe700 1 -- 172.21.15.123:0/2344081296 >> v1:172.21.15.123:6789/0 conn(0x7f829415ab30 legacy=0x7f829406d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.565+0000 7f82937fe700 1 -- 172.21.15.123:0/2344081296 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940cea50 con 0x7f8294153f00 2024-09-13T17:10:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.569+0000 7f82937fe700 1 --2- 172.21.15.123:0/2344081296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8294153f00 0x7f82940ce0e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f82940cde80 tx=0x7f8284009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b766274949a4c10f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.569+0000 7f82927fc700 1 -- 172.21.15.123:0/2344081296 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400b8a0 con 0x7f8294153f00 2024-09-13T17:10:46.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.569+0000 7f82927fc700 1 -- 172.21.15.123:0/2344081296 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828400ba00 con 0x7f8294153f00 2024-09-13T17:10:46.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.569+0000 7f82927fc700 1 -- 172.21.15.123:0/2344081296 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400bd90 con 0x7f8294153f00 2024-09-13T17:10:46.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.569+0000 7f8298a60700 1 -- 172.21.15.123:0/2344081296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8294153f00 msgr2=0x7f82940ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.569+0000 7f8298a60700 1 --2- 172.21.15.123:0/2344081296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8294153f00 0x7f82940ce0e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f82940cde80 tx=0x7f8284009bf0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.569+0000 7f8298a60700 1 -- 172.21.15.123:0/2344081296 shutdown_connections 2024-09-13T17:10:46.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.569+0000 7f8298a60700 1 --2- 172.21.15.123:0/2344081296 >> v2:172.21.15.153:3300/0 conn(0x7f829415e0d0 0x7f82940cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.569+0000 7f8298a60700 1 --2- 172.21.15.123:0/2344081296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8294153f00 0x7f82940ce0e0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.569+0000 7f8298a60700 1 -- 172.21.15.123:0/2344081296 >> 172.21.15.123:0/2344081296 conn(0x7f8294066780 msgr2=0x7f82940719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.569+0000 7f8298a60700 1 -- 172.21.15.123:0/2344081296 shutdown_connections 2024-09-13T17:10:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.569+0000 7f8298a60700 1 -- 172.21.15.123:0/2344081296 wait complete. 2024-09-13T17:10:46.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8298a60700 1 Processor -- start 2024-09-13T17:10:46.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8298a60700 1 -- start start 2024-09-13T17:10:46.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8298a60700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8294153f00 0x7f829414e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8298a60700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f829415ab30 0x7f8294144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8298a60700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f829415e0d0 0x7f8294156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8298a60700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8294156990 con 0x7f829415ab30 2024-09-13T17:10:46.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8298a60700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8294155d10 con 0x7f829415e0d0 2024-09-13T17:10:46.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8298a60700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8294155ff0 con 0x7f8294153f00 2024-09-13T17:10:46.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8292ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f829415ab30 0x7f8294144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8292ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f829415ab30 0x7f8294144130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50716/0 (socket says 172.21.15.123:50716) 2024-09-13T17:10:46.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8292ffd700 1 -- 172.21.15.123:0/1392890299 learned_addr learned my addr 172.21.15.123:0/1392890299 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:46.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f82937fe700 1 --2- 172.21.15.123:0/1392890299 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8294153f00 0x7f829414e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8293fff700 1 --2- 172.21.15.123:0/1392890299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f829415e0d0 0x7f8294156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8292ffd700 1 -- 172.21.15.123:0/1392890299 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8294153f00 msgr2=0x7f829414e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8292ffd700 1 --2- 172.21.15.123:0/1392890299 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8294153f00 0x7f829414e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8292ffd700 1 -- 172.21.15.123:0/1392890299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f829415e0d0 msgr2=0x7f8294156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8292ffd700 1 --2- 172.21.15.123:0/1392890299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f829415e0d0 0x7f8294156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8292ffd700 1 -- 172.21.15.123:0/1392890299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8284009570 con 0x7f829415ab30 2024-09-13T17:10:46.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8292ffd700 1 --2- 172.21.15.123:0/1392890299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f829415ab30 0x7f8294144130 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f828800d800 tx=0x7f828800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:46.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f827bfff700 1 -- 172.21.15.123:0/1392890299 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288004240 con 0x7f829415ab30 2024-09-13T17:10:46.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f827bfff700 1 -- 172.21.15.123:0/1392890299 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82880043a0 con 0x7f829415ab30 2024-09-13T17:10:46.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8298a60700 1 -- 172.21.15.123:0/1392890299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82941562d0 con 0x7f829415ab30 2024-09-13T17:10:46.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f827bfff700 1 -- 172.21.15.123:0/1392890299 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82880036c0 con 0x7f829415ab30 2024-09-13T17:10:46.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.573+0000 7f8298a60700 1 -- 172.21.15.123:0/1392890299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8294144670 con 0x7f829415ab30 2024-09-13T17:10:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.577+0000 7f827bfff700 1 -- 172.21.15.123:0/1392890299 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8288003820 con 0x7f829415ab30 2024-09-13T17:10:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.577+0000 7f8298a60700 1 -- 172.21.15.123:0/1392890299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82940ce0e0 con 0x7f829415ab30 2024-09-13T17:10:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.577+0000 7f827bfff700 1 --2- 172.21.15.123:0/1392890299 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8280066730 0x7f8280068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.577+0000 7f827bfff700 1 -- 172.21.15.123:0/1392890299 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8288083cf0 con 0x7f829415ab30 2024-09-13T17:10:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.577+0000 7f82937fe700 1 --2- 172.21.15.123:0/1392890299 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8280066730 0x7f8280068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.577+0000 7f82937fe700 1 --2- 172.21.15.123:0/1392890299 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8280066730 0x7f8280068bf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8284000c00 tx=0x7f8284008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:46.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.581+0000 7f827bfff700 1 -- 172.21.15.123:0/1392890299 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8288088070 con 0x7f829415ab30 2024-09-13T17:10:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.785+0000 7f8298a60700 1 -- 172.21.15.123:0/1392890299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8294072640 con 0x7f829415ab30 2024-09-13T17:10:46.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.785+0000 7f827bfff700 1 -- 172.21.15.123:0/1392890299 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f82880510f0 con 0x7f829415ab30 2024-09-13T17:10:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:46.788 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":48,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7156,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3705271604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705271604},{"type":"v1","addr":"172.21.15.153:6834","nonce":3705271604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2842144578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":2842144578},{"type":"v1","addr":"172.21.15.153:6835","nonce":2842144578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7398,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2022373739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2022373739},{"type":"v1","addr":"172.21.15.123:6835","nonce":2022373739}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:10:28.586943+0000","modified":"2024-09-13T17:10:31.604775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7401":{"gid":7401,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/1688881065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1688881065},{"type":"v1","addr":"172.21.15.123:6837","nonce":1688881065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:10:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.789+0000 7f8298a60700 1 -- 172.21.15.123:0/1392890299 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8280066730 msgr2=0x7f8280068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.789+0000 7f8298a60700 1 --2- 172.21.15.123:0/1392890299 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8280066730 0x7f8280068bf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8284000c00 tx=0x7f8284008030 comp rx=0 tx=0).stop 2024-09-13T17:10:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.789+0000 7f8298a60700 1 -- 172.21.15.123:0/1392890299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f829415ab30 msgr2=0x7f8294144130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.789+0000 7f8298a60700 1 --2- 172.21.15.123:0/1392890299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f829415ab30 0x7f8294144130 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f828800d800 tx=0x7f828800db10 comp rx=0 tx=0).stop 2024-09-13T17:10:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.789+0000 7f8298a60700 1 -- 172.21.15.123:0/1392890299 shutdown_connections 2024-09-13T17:10:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.789+0000 7f8298a60700 1 --2- 172.21.15.123:0/1392890299 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8280066730 0x7f8280068bf0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.789+0000 7f8298a60700 1 --2- 172.21.15.123:0/1392890299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f829415e0d0 0x7f8294156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.789+0000 7f8298a60700 1 --2- 172.21.15.123:0/1392890299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f829415ab30 0x7f8294144130 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.789+0000 7f8298a60700 1 --2- 172.21.15.123:0/1392890299 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8294153f00 0x7f829414e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.789+0000 7f8298a60700 1 -- 172.21.15.123:0/1392890299 >> 172.21.15.123:0/1392890299 conn(0x7f8294066780 msgr2=0x7f82940b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:46.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.789+0000 7f8298a60700 1 -- 172.21.15.123:0/1392890299 shutdown_connections 2024-09-13T17:10:46.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.789+0000 7f8298a60700 1 -- 172.21.15.123:0/1392890299 wait complete. 2024-09-13T17:10:46.792 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 48 2024-09-13T17:10:46.803 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.905+0000 7f8970b0b700 1 Processor -- start 2024-09-13T17:10:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.905+0000 7f8970b0b700 1 -- start start 2024-09-13T17:10:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.905+0000 7f8970b0b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f896c165510 0x7f896c0d35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.905+0000 7f8970b0b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c0d1890 con 0x7f896c0c5830 2024-09-13T17:10:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.905+0000 7f8970b0b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c1659d0 con 0x7f896c0b4f20 2024-09-13T17:10:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.905+0000 7f8970b0b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0d1280 con 0x7f896c165510 2024-09-13T17:10:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.909+0000 7f896bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f896c0c5830 0x7f896c0b58d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40466/0 (socket says 172.21.15.123:40466) 2024-09-13T17:10:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.909+0000 7f896bfff700 1 -- 172.21.15.123:0/2976772483 learned_addr learned my addr 172.21.15.123:0/2976772483 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.909+0000 7f896affd700 1 --2- 172.21.15.123:0/2976772483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f896c165510 0x7f896c0d35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.909+0000 7f896affd700 1 -- 172.21.15.123:0/2976772483 >> v1:172.21.15.153:6789/0 conn(0x7f896c0b4f20 legacy=0x7f896c164e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.909+0000 7f896affd700 1 -- 172.21.15.123:0/2976772483 >> v1:172.21.15.123:6789/0 conn(0x7f896c0c5830 legacy=0x7f896c0b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.909+0000 7f896affd700 1 -- 172.21.15.123:0/2976772483 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c0d1520 con 0x7f896c165510 2024-09-13T17:10:46.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.909+0000 7f896affd700 1 --2- 172.21.15.123:0/2976772483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f896c165510 0x7f896c0d35a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8964009dc0 tx=0x7f896400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cdcd04f166eadce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:46.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.917+0000 7f896a7fc700 1 -- 172.21.15.123:0/2976772483 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896400e070 con 0x7f896c165510 2024-09-13T17:10:46.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.917+0000 7f896a7fc700 1 -- 172.21.15.123:0/2976772483 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896400bbd0 con 0x7f896c165510 2024-09-13T17:10:46.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.917+0000 7f896a7fc700 1 -- 172.21.15.123:0/2976772483 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964012430 con 0x7f896c165510 2024-09-13T17:10:46.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.917+0000 7f8970b0b700 1 -- 172.21.15.123:0/2976772483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f896c165510 msgr2=0x7f896c0d35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.917+0000 7f8970b0b700 1 --2- 172.21.15.123:0/2976772483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f896c165510 0x7f896c0d35a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8964009dc0 tx=0x7f896400b330 comp rx=0 tx=0).stop 2024-09-13T17:10:46.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.917+0000 7f8970b0b700 1 -- 172.21.15.123:0/2976772483 shutdown_connections 2024-09-13T17:10:46.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.917+0000 7f8970b0b700 1 --2- 172.21.15.123:0/2976772483 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f896c165510 0x7f896c0d35a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.917+0000 7f8970b0b700 1 -- 172.21.15.123:0/2976772483 >> 172.21.15.123:0/2976772483 conn(0x7f896c0d2a80 msgr2=0x7f896c0d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:46.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.917+0000 7f8970b0b700 1 -- 172.21.15.123:0/2976772483 shutdown_connections 2024-09-13T17:10:46.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.917+0000 7f8970b0b700 1 -- 172.21.15.123:0/2976772483 wait complete. 2024-09-13T17:10:46.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.921+0000 7f8970b0b700 1 Processor -- start 2024-09-13T17:10:46.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.921+0000 7f8970b0b700 1 -- start start 2024-09-13T17:10:46.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.921+0000 7f8970b0b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f896c0b4f20 0x7f896c157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.921+0000 7f8970b0b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f896c0c5830 0x7f896c155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.921+0000 7f8970b0b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f896c165510 0x7f896c1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.921+0000 7f8970b0b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c156620 con 0x7f896c0c5830 2024-09-13T17:10:46.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.921+0000 7f8970b0b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c15a410 con 0x7f896c0b4f20 2024-09-13T17:10:46.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.921+0000 7f8970b0b700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0c6900 con 0x7f896c165510 2024-09-13T17:10:46.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.921+0000 7f896affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f896c0c5830 0x7f896c155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.921+0000 7f896affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f896c0c5830 0x7f896c155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50722/0 (socket says 172.21.15.123:50722) 2024-09-13T17:10:46.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.921+0000 7f896affd700 1 -- 172.21.15.123:0/3355380597 learned_addr learned my addr 172.21.15.123:0/3355380597 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:46.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.921+0000 7f896b7fe700 1 --2- 172.21.15.123:0/3355380597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f896c0b4f20 0x7f896c157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.921+0000 7f896bfff700 1 --2- 172.21.15.123:0/3355380597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f896c165510 0x7f896c1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.925+0000 7f896affd700 1 -- 172.21.15.123:0/3355380597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f896c165510 msgr2=0x7f896c1560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.925+0000 7f896affd700 1 --2- 172.21.15.123:0/3355380597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f896c165510 0x7f896c1560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.925+0000 7f896affd700 1 -- 172.21.15.123:0/3355380597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f896c0b4f20 msgr2=0x7f896c157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:46.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.925+0000 7f896affd700 1 --2- 172.21.15.123:0/3355380597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f896c0b4f20 0x7f896c157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:46.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.925+0000 7f896affd700 1 -- 172.21.15.123:0/3355380597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8964009a70 con 0x7f896c0c5830 2024-09-13T17:10:46.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.925+0000 7f896affd700 1 --2- 172.21.15.123:0/3355380597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f896c0c5830 0x7f896c155ba0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f8964014040 tx=0x7f8964004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:46.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.925+0000 7f8953fff700 1 -- 172.21.15.123:0/3355380597 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964012e20 con 0x7f896c0c5830 2024-09-13T17:10:46.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.925+0000 7f8953fff700 1 -- 172.21.15.123:0/3355380597 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8964020070 con 0x7f896c0c5830 2024-09-13T17:10:46.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.925+0000 7f8970b0b700 1 -- 172.21.15.123:0/3355380597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896c159e50 con 0x7f896c0c5830 2024-09-13T17:10:46.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.925+0000 7f8953fff700 1 -- 172.21.15.123:0/3355380597 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964004280 con 0x7f896c0c5830 2024-09-13T17:10:46.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.925+0000 7f8970b0b700 1 -- 172.21.15.123:0/3355380597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896c0c6ba0 con 0x7f896c0c5830 2024-09-13T17:10:46.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.925+0000 7f8970b0b700 1 -- 172.21.15.123:0/3355380597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896c08cb10 con 0x7f896c0c5830 2024-09-13T17:10:46.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.925+0000 7f8953fff700 1 -- 172.21.15.123:0/3355380597 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89640043e0 con 0x7f896c0c5830 2024-09-13T17:10:46.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.929+0000 7f8953fff700 1 --2- 172.21.15.123:0/3355380597 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8958066730 0x7f8958068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:46.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.929+0000 7f8953fff700 1 -- 172.21.15.123:0/3355380597 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8964022070 con 0x7f896c0c5830 2024-09-13T17:10:46.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.929+0000 7f896b7fe700 1 --2- 172.21.15.123:0/3355380597 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8958066730 0x7f8958068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:46.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.929+0000 7f896b7fe700 1 --2- 172.21.15.123:0/3355380597 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8958066730 0x7f8958068bf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8960000f60 tx=0x7f8960009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:46.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:46.937+0000 7f8953fff700 1 -- 172.21.15.123:0/3355380597 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8964053670 con 0x7f896c0c5830 2024-09-13T17:10:47.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.141+0000 7f8970b0b700 1 -- 172.21.15.123:0/3355380597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f896c0b8160 con 0x7f896c0c5830 2024-09-13T17:10:47.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.145+0000 7f8953fff700 1 -- 172.21.15.123:0/3355380597 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f8964056c90 con 0x7f896c0c5830 2024-09-13T17:10:47.146 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:47.146 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":48,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7156,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3705271604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705271604},{"type":"v1","addr":"172.21.15.153:6834","nonce":3705271604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2842144578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":2842144578},{"type":"v1","addr":"172.21.15.153:6835","nonce":2842144578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7398,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2022373739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2022373739},{"type":"v1","addr":"172.21.15.123:6835","nonce":2022373739}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:10:28.586943+0000","modified":"2024-09-13T17:10:31.604775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7401":{"gid":7401,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6837/1688881065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1688881065},{"type":"v1","addr":"172.21.15.123:6837","nonce":1688881065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:10:47.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.145+0000 7f8970b0b700 1 -- 172.21.15.123:0/3355380597 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8958066730 msgr2=0x7f8958068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.145+0000 7f8970b0b700 1 --2- 172.21.15.123:0/3355380597 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8958066730 0x7f8958068bf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8960000f60 tx=0x7f8960009040 comp rx=0 tx=0).stop 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.145+0000 7f8970b0b700 1 -- 172.21.15.123:0/3355380597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f896c0c5830 msgr2=0x7f896c155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.145+0000 7f8970b0b700 1 --2- 172.21.15.123:0/3355380597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f896c0c5830 0x7f896c155ba0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f8964014040 tx=0x7f8964004af0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.145+0000 7f8970b0b700 1 -- 172.21.15.123:0/3355380597 shutdown_connections 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.145+0000 7f8970b0b700 1 --2- 172.21.15.123:0/3355380597 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8958066730 0x7f8958068bf0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.145+0000 7f8970b0b700 1 --2- 172.21.15.123:0/3355380597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f896c165510 0x7f896c1560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.145+0000 7f8970b0b700 1 --2- 172.21.15.123:0/3355380597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f896c0c5830 0x7f896c155ba0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.145+0000 7f8970b0b700 1 --2- 172.21.15.123:0/3355380597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f896c0b4f20 0x7f896c157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.145+0000 7f8970b0b700 1 -- 172.21.15.123:0/3355380597 >> 172.21.15.123:0/3355380597 conn(0x7f896c0d2a80 msgr2=0x7f896c0d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.145+0000 7f8970b0b700 1 -- 172.21.15.123:0/3355380597 shutdown_connections 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.145+0000 7f8970b0b700 1 -- 172.21.15.123:0/3355380597 wait complete. 2024-09-13T17:10:47.150 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 48 2024-09-13T17:10:47.161 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:47.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 Processor -- start 2024-09-13T17:10:47.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 -- start start 2024-09-13T17:10:47.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff738160fb0 0x7ff73806de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7380cec90 0x7ff7380cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7380cf5f0 con 0x7ff73806c050 2024-09-13T17:10:47.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73806cb60 con 0x7ff7380cec90 2024-09-13T17:10:47.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73806e340 con 0x7ff738160fb0 2024-09-13T17:10:47.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff7377fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7380cec90 0x7ff7380cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff7377fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7380cec90 0x7ff7380cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50726/0 (socket says 172.21.15.123:50726) 2024-09-13T17:10:47.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff7377fe700 1 -- 172.21.15.123:0/1335427018 learned_addr learned my addr 172.21.15.123:0/1335427018 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:47.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff737fff700 1 --2- 172.21.15.123:0/1335427018 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff738160fb0 0x7ff73806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff7377fe700 1 -- 172.21.15.123:0/1335427018 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff738160fb0 msgr2=0x7ff73806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:47.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff7377fe700 1 --2- 172.21.15.123:0/1335427018 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff738160fb0 0x7ff73806de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff7377fe700 1 -- 172.21.15.123:0/1335427018 >> v1:172.21.15.153:6789/0 conn(0x7ff73806c050 legacy=0x7ff73806c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:47.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff7377fe700 1 -- 172.21.15.123:0/1335427018 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73806cd60 con 0x7ff7380cec90 2024-09-13T17:10:47.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff7377fe700 1 --2- 172.21.15.123:0/1335427018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7380cec90 0x7ff7380cf0b0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff730009e50 tx=0x7ff73000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcca26188408f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff736ffd700 1 -- 172.21.15.123:0/1335427018 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73000e070 con 0x7ff7380cec90 2024-09-13T17:10:47.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff736ffd700 1 -- 172.21.15.123:0/1335427018 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff730003a40 con 0x7ff7380cec90 2024-09-13T17:10:47.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff736ffd700 1 -- 172.21.15.123:0/1335427018 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730003df0 con 0x7ff7380cec90 2024-09-13T17:10:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 -- 172.21.15.123:0/1335427018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7380cec90 msgr2=0x7ff7380cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 --2- 172.21.15.123:0/1335427018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7380cec90 0x7ff7380cf0b0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff730009e50 tx=0x7ff73000b330 comp rx=0 tx=0).stop 2024-09-13T17:10:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 -- 172.21.15.123:0/1335427018 shutdown_connections 2024-09-13T17:10:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 --2- 172.21.15.123:0/1335427018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7380cec90 0x7ff7380cf0b0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 --2- 172.21.15.123:0/1335427018 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff738160fb0 0x7ff73806de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 -- 172.21.15.123:0/1335427018 >> 172.21.15.123:0/1335427018 conn(0x7ff738066570 msgr2=0x7ff738066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 -- 172.21.15.123:0/1335427018 shutdown_connections 2024-09-13T17:10:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.273+0000 7ff73e312700 1 -- 172.21.15.123:0/1335427018 wait complete. 2024-09-13T17:10:47.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.277+0000 7ff73e312700 1 Processor -- start 2024-09-13T17:10:47.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.277+0000 7ff73e312700 1 -- start start 2024-09-13T17:10:47.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73e312700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff73806c050 0x7ff73815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73e312700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7380cec90 0x7ff73815ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73e312700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff738160fb0 0x7ff738141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73e312700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73814f690 con 0x7ff738160fb0 2024-09-13T17:10:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73e312700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73814fc50 con 0x7ff7380cec90 2024-09-13T17:10:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73e312700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73815b1f0 con 0x7ff73806c050 2024-09-13T17:10:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73c8af700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff738160fb0 0x7ff738141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73c8af700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff738160fb0 0x7ff738141160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50728/0 (socket says 172.21.15.123:50728) 2024-09-13T17:10:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73c8af700 1 -- 172.21.15.123:0/1915950333 learned_addr learned my addr 172.21.15.123:0/1915950333 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff737fff700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff73806c050 0x7ff73815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff7377fe700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7380cec90 0x7ff73815ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73c8af700 1 -- 172.21.15.123:0/1915950333 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff73806c050 msgr2=0x7ff73815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73c8af700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff73806c050 0x7ff73815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73c8af700 1 -- 172.21.15.123:0/1915950333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7380cec90 msgr2=0x7ff73815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73c8af700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7380cec90 0x7ff73815ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73c8af700 1 -- 172.21.15.123:0/1915950333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730009b30 con 0x7ff738160fb0 2024-09-13T17:10:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff7377fe700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7380cec90 0x7ff73815ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73c8af700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff738160fb0 0x7ff738141160 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff72800b4b0 tx=0x7ff72800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff734ff9700 1 -- 172.21.15.123:0/1915950333 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff728011830 con 0x7ff738160fb0 2024-09-13T17:10:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff734ff9700 1 -- 172.21.15.123:0/1915950333 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff728011990 con 0x7ff738160fb0 2024-09-13T17:10:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff734ff9700 1 -- 172.21.15.123:0/1915950333 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff728011d40 con 0x7ff738160fb0 2024-09-13T17:10:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73e312700 1 -- 172.21.15.123:0/1915950333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73815b4d0 con 0x7ff738160fb0 2024-09-13T17:10:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73e312700 1 -- 172.21.15.123:0/1915950333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff738158ab0 con 0x7ff738160fb0 2024-09-13T17:10:47.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.281+0000 7ff73e312700 1 -- 172.21.15.123:0/1915950333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73814fde0 con 0x7ff738160fb0 2024-09-13T17:10:47.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.285+0000 7ff734ff9700 1 -- 172.21.15.123:0/1915950333 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff72801a400 con 0x7ff738160fb0 2024-09-13T17:10:47.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.285+0000 7ff734ff9700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff718066730 0x7ff718068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.285+0000 7ff734ff9700 1 -- 172.21.15.123:0/1915950333 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff728083ec0 con 0x7ff738160fb0 2024-09-13T17:10:47.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.285+0000 7ff737fff700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff718066730 0x7ff718068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.285+0000 7ff737fff700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff718066730 0x7ff718068bf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff72000a9b0 tx=0x7ff720008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.289+0000 7ff734ff9700 1 -- 172.21.15.123:0/1915950333 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff728051190 con 0x7ff738160fb0 2024-09-13T17:10:47.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.461+0000 7ff73e312700 1 -- 172.21.15.123:0/1915950333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7380cf0b0 con 0x7ff738160fb0 2024-09-13T17:10:47.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.465+0000 7ff734ff9700 1 -- 172.21.15.123:0/1915950333 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16556 (secure 0 0 0) 0x7ff7280547b0 con 0x7ff738160fb0 2024-09-13T17:10:47.466 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:47.466 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":98,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:29.590478+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:10:26.903248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T17:10:27.570928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:47.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.465+0000 7ff73e312700 1 -- 172.21.15.123:0/1915950333 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff718066730 msgr2=0x7ff718068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.465+0000 7ff73e312700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff718066730 0x7ff718068bf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff72000a9b0 tx=0x7ff720008040 comp rx=0 tx=0).stop 2024-09-13T17:10:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.465+0000 7ff73e312700 1 -- 172.21.15.123:0/1915950333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff738160fb0 msgr2=0x7ff738141160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.465+0000 7ff73e312700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff738160fb0 0x7ff738141160 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff72800b4b0 tx=0x7ff72800b870 comp rx=0 tx=0).stop 2024-09-13T17:10:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.465+0000 7ff73e312700 1 -- 172.21.15.123:0/1915950333 shutdown_connections 2024-09-13T17:10:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.465+0000 7ff73e312700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ff718066730 0x7ff718068bf0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.465+0000 7ff73e312700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff738160fb0 0x7ff738141160 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.465+0000 7ff73e312700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7380cec90 0x7ff73815ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.465+0000 7ff73e312700 1 --2- 172.21.15.123:0/1915950333 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff73806c050 0x7ff73815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.465+0000 7ff73e312700 1 -- 172.21.15.123:0/1915950333 >> 172.21.15.123:0/1915950333 conn(0x7ff738066570 msgr2=0x7ff73815dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.465+0000 7ff73e312700 1 -- 172.21.15.123:0/1915950333 shutdown_connections 2024-09-13T17:10:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.465+0000 7ff73e312700 1 -- 172.21.15.123:0/1915950333 wait complete. 2024-09-13T17:10:47.487 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:10:47.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e7122700 1 Processor -- start 2024-09-13T17:10:47.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e7122700 1 -- start start 2024-09-13T17:10:47.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e7122700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9e00c8cd0 0x7fd9e00ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e7122700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd9e00c1280 0x7fd9e00c1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e7122700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e00c93b0 con 0x7fd9e00cb090 2024-09-13T17:10:47.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e7122700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e00cae90 con 0x7fd9e00c1280 2024-09-13T17:10:47.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e7122700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e00cc580 con 0x7fd9e00c8cd0 2024-09-13T17:10:47.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e591f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9e00c8cd0 0x7fd9e00ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e6921700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd9e00c1280 0x7fd9e00c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e591f700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9e00c8cd0 0x7fd9e00ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:59638/0 (socket says 172.21.15.123:59638) 2024-09-13T17:10:47.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e591f700 1 -- 172.21.15.123:0/4217107256 learned_addr learned my addr 172.21.15.123:0/4217107256 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:47.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e591f700 1 -- 172.21.15.123:0/4217107256 >> v2:172.21.15.153:3300/0 conn(0x7fd9e00c1280 msgr2=0x7fd9e00c1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:47.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e591f700 1 --2- 172.21.15.123:0/4217107256 >> v2:172.21.15.153:3300/0 conn(0x7fd9e00c1280 0x7fd9e00c1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e591f700 1 -- 172.21.15.123:0/4217107256 >> v1:172.21.15.153:6789/0 conn(0x7fd9e00cb090 legacy=0x7fd9e00cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e591f700 1 -- 172.21.15.123:0/4217107256 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e00cd100 con 0x7fd9e00c8cd0 2024-09-13T17:10:47.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.597+0000 7fd9e6921700 1 --2- 172.21.15.123:0/4217107256 >> v2:172.21.15.153:3300/0 conn(0x7fd9e00c1280 0x7fd9e00c1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:47.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.601+0000 7fd9e591f700 1 --2- 172.21.15.123:0/4217107256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9e00c8cd0 0x7fd9e00ca950 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009910 tx=0x7fd9d0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14761631d77e5718 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.601+0000 7fd9e511e700 1 -- 172.21.15.123:0/4217107256 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0011830 con 0x7fd9e00c8cd0 2024-09-13T17:10:47.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.601+0000 7fd9e511e700 1 -- 172.21.15.123:0/4217107256 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d0011990 con 0x7fd9e00c8cd0 2024-09-13T17:10:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.601+0000 7fd9e511e700 1 -- 172.21.15.123:0/4217107256 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0011d40 con 0x7fd9e00c8cd0 2024-09-13T17:10:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.601+0000 7fd9e7122700 1 -- 172.21.15.123:0/4217107256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9e00c8cd0 msgr2=0x7fd9e00ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.601+0000 7fd9e7122700 1 --2- 172.21.15.123:0/4217107256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9e00c8cd0 0x7fd9e00ca950 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009910 tx=0x7fd9d0009c20 comp rx=0 tx=0).stop 2024-09-13T17:10:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.601+0000 7fd9e7122700 1 -- 172.21.15.123:0/4217107256 shutdown_connections 2024-09-13T17:10:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.601+0000 7fd9e7122700 1 --2- 172.21.15.123:0/4217107256 >> v2:172.21.15.153:3300/0 conn(0x7fd9e00c1280 0x7fd9e00c1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.601+0000 7fd9e7122700 1 --2- 172.21.15.123:0/4217107256 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9e00c8cd0 0x7fd9e00ca950 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.601+0000 7fd9e7122700 1 -- 172.21.15.123:0/4217107256 >> 172.21.15.123:0/4217107256 conn(0x7fd9e00b01d0 msgr2=0x7fd9e00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.601+0000 7fd9e7122700 1 -- 172.21.15.123:0/4217107256 shutdown_connections 2024-09-13T17:10:47.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.601+0000 7fd9e7122700 1 -- 172.21.15.123:0/4217107256 wait complete. 2024-09-13T17:10:47.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.601+0000 7fd9e7122700 1 Processor -- start 2024-09-13T17:10:47.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.601+0000 7fd9e7122700 1 -- start start 2024-09-13T17:10:47.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e7122700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9e00c1280 0x7fd9e00c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e7122700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e00c8cd0 0x7fd9e00c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e7122700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9e00cb090 0x7fd9e00c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e7122700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e0156800 con 0x7fd9e00c1280 2024-09-13T17:10:47.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e7122700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e00c76f0 con 0x7fd9e00c8cd0 2024-09-13T17:10:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e7122700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e00c79d0 con 0x7fd9e00cb090 2024-09-13T17:10:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e6120700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9e00c1280 0x7fd9e00c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e591f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e00c8cd0 0x7fd9e00c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e6120700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9e00c1280 0x7fd9e00c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50734/0 (socket says 172.21.15.123:50734) 2024-09-13T17:10:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e6120700 1 -- 172.21.15.123:0/1413956767 learned_addr learned my addr 172.21.15.123:0/1413956767 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e6921700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9e00cb090 0x7fd9e00c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e6120700 1 -- 172.21.15.123:0/1413956767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9e00cb090 msgr2=0x7fd9e00c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e6120700 1 --2- 172.21.15.123:0/1413956767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9e00cb090 0x7fd9e00c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e6120700 1 -- 172.21.15.123:0/1413956767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e00c8cd0 msgr2=0x7fd9e00c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e6120700 1 --2- 172.21.15.123:0/1413956767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e00c8cd0 0x7fd9e00c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e6120700 1 -- 172.21.15.123:0/1413956767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d8009a70 con 0x7fd9e00c1280 2024-09-13T17:10:47.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e6120700 1 --2- 172.21.15.123:0/1413956767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9e00c1280 0x7fd9e00c8790 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400c500 tx=0x7fd9d400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9deffd700 1 -- 172.21.15.123:0/1413956767 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d40052d0 con 0x7fd9e00c1280 2024-09-13T17:10:47.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9deffd700 1 -- 172.21.15.123:0/1413956767 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d4005430 con 0x7fd9e00c1280 2024-09-13T17:10:47.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e7122700 1 -- 172.21.15.123:0/1413956767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d0009570 con 0x7fd9e00c1280 2024-09-13T17:10:47.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9deffd700 1 -- 172.21.15.123:0/1413956767 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d40055a0 con 0x7fd9e00c1280 2024-09-13T17:10:47.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.605+0000 7fd9e7122700 1 -- 172.21.15.123:0/1413956767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e00c7f90 con 0x7fd9e00c1280 2024-09-13T17:10:47.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.609+0000 7fd9e7122700 1 -- 172.21.15.123:0/1413956767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e00ccd90 con 0x7fd9e00c1280 2024-09-13T17:10:47.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.609+0000 7fd9deffd700 1 -- 172.21.15.123:0/1413956767 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd9d40038e0 con 0x7fd9e00c1280 2024-09-13T17:10:47.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.609+0000 7fd9deffd700 1 --2- 172.21.15.123:0/1413956767 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9cc066760 0x7fd9cc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.609+0000 7fd9deffd700 1 -- 172.21.15.123:0/1413956767 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9d40835b0 con 0x7fd9e00c1280 2024-09-13T17:10:47.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.609+0000 7fd9e591f700 1 --2- 172.21.15.123:0/1413956767 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9cc066760 0x7fd9cc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.609+0000 7fd9e591f700 1 --2- 172.21.15.123:0/1413956767 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9cc066760 0x7fd9cc068c20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009910 tx=0x7fd9d0008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.613+0000 7fd9deffd700 1 -- 172.21.15.123:0/1413956767 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd9d40508a0 con 0x7fd9e00c1280 2024-09-13T17:10:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.821+0000 7fd9e7122700 1 -- 172.21.15.123:0/1413956767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd9e00aff90 con 0x7fd9e00c1280 2024-09-13T17:10:47.826 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-13T17:10:47.825+0000 7f1c63ac9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:10:47.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.841+0000 7fd9deffd700 1 -- 172.21.15.123:0/1413956767 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd9d4053ec0 con 0x7fd9e00c1280 2024-09-13T17:10:47.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.845+0000 7fd9e7122700 1 -- 172.21.15.123:0/1413956767 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9cc066760 msgr2=0x7fd9cc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.845+0000 7fd9e7122700 1 --2- 172.21.15.123:0/1413956767 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9cc066760 0x7fd9cc068c20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009910 tx=0x7fd9d0008030 comp rx=0 tx=0).stop 2024-09-13T17:10:47.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.845+0000 7fd9e7122700 1 -- 172.21.15.123:0/1413956767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9e00c1280 msgr2=0x7fd9e00c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.845+0000 7fd9e7122700 1 --2- 172.21.15.123:0/1413956767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9e00c1280 0x7fd9e00c8790 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400c500 tx=0x7fd9d400c810 comp rx=0 tx=0).stop 2024-09-13T17:10:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.845+0000 7fd9e7122700 1 -- 172.21.15.123:0/1413956767 shutdown_connections 2024-09-13T17:10:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.845+0000 7fd9e7122700 1 --2- 172.21.15.123:0/1413956767 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd9cc066760 0x7fd9cc068c20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.845+0000 7fd9e7122700 1 --2- 172.21.15.123:0/1413956767 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd9e00cb090 0x7fd9e00c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.845+0000 7fd9e7122700 1 --2- 172.21.15.123:0/1413956767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e00c8cd0 0x7fd9e00c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.845+0000 7fd9e7122700 1 --2- 172.21.15.123:0/1413956767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9e00c1280 0x7fd9e00c8790 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.845+0000 7fd9e7122700 1 -- 172.21.15.123:0/1413956767 >> 172.21.15.123:0/1413956767 conn(0x7fd9e00b01d0 msgr2=0x7fd9e00ced00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.845+0000 7fd9e7122700 1 -- 172.21.15.123:0/1413956767 shutdown_connections 2024-09-13T17:10:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.845+0000 7fd9e7122700 1 -- 172.21.15.123:0/1413956767 wait complete. 2024-09-13T17:10:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:10:47.864 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:10:47.886 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-13T17:10:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.973+0000 7fe59f29e700 1 Processor -- start 2024-09-13T17:10:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.973+0000 7fe59f29e700 1 -- start start 2024-09-13T17:10:47.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.973+0000 7fe59f29e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe59815cfb0 0x7fe5980ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.973+0000 7fe59f29e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5980cd890 con 0x7fe5980d12d0 2024-09-13T17:10:47.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.973+0000 7fe59f29e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59815d390 con 0x7fe5980d3800 2024-09-13T17:10:47.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.973+0000 7fe59f29e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5980d10c0 con 0x7fe59815cfb0 2024-09-13T17:10:47.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.973+0000 7fe59d83b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe5980d12d0 0x7fe5980b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40472/0 (socket says 172.21.15.123:40472) 2024-09-13T17:10:47.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.973+0000 7fe59d83b700 1 -- 172.21.15.123:0/474020572 learned_addr learned my addr 172.21.15.123:0/474020572 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:47.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.973+0000 7fe59d03a700 1 --2- 172.21.15.123:0/474020572 >> v2:172.21.15.153:3300/0 conn(0x7fe59815cfb0 0x7fe5980ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe58ffff700 1 -- 172.21.15.123:0/474020572 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183444171 0 0) 0x7fe5980cd890 con 0x7fe5980d12d0 2024-09-13T17:10:47.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe58ffff700 1 -- 172.21.15.123:0/474020572 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5840035d0 con 0x7fe5980d12d0 2024-09-13T17:10:47.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe59d03a700 1 -- 172.21.15.123:0/474020572 >> v1:172.21.15.153:6789/0 conn(0x7fe5980d3800 legacy=0x7fe5980d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe59d03a700 1 -- 172.21.15.123:0/474020572 >> v1:172.21.15.123:6789/0 conn(0x7fe5980d12d0 legacy=0x7fe5980b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe59d03a700 1 -- 172.21.15.123:0/474020572 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5980cdac0 con 0x7fe59815cfb0 2024-09-13T17:10:47.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe59d03a700 1 --2- 172.21.15.123:0/474020572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe59815cfb0 0x7fe5980ce840 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe594009850 tx=0x7fe594009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77178b33790c607 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe58ffff700 1 -- 172.21.15.123:0/474020572 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594011830 con 0x7fe59815cfb0 2024-09-13T17:10:47.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe58ffff700 1 -- 172.21.15.123:0/474020572 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe594011990 con 0x7fe59815cfb0 2024-09-13T17:10:47.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe58ffff700 1 -- 172.21.15.123:0/474020572 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594011d00 con 0x7fe59815cfb0 2024-09-13T17:10:47.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe59f29e700 1 -- 172.21.15.123:0/474020572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe59815cfb0 msgr2=0x7fe5980ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe59f29e700 1 --2- 172.21.15.123:0/474020572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe59815cfb0 0x7fe5980ce840 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe594009850 tx=0x7fe594009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe59f29e700 1 -- 172.21.15.123:0/474020572 shutdown_connections 2024-09-13T17:10:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe59f29e700 1 --2- 172.21.15.123:0/474020572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe59815cfb0 0x7fe5980ce840 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe59f29e700 1 -- 172.21.15.123:0/474020572 >> 172.21.15.123:0/474020572 conn(0x7fe5980d2d10 msgr2=0x7fe5980d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe59f29e700 1 -- 172.21.15.123:0/474020572 shutdown_connections 2024-09-13T17:10:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.977+0000 7fe59f29e700 1 -- 172.21.15.123:0/474020572 wait complete. 2024-09-13T17:10:47.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.981+0000 7fe59f29e700 1 Processor -- start 2024-09-13T17:10:47.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.981+0000 7fe59f29e700 1 -- start start 2024-09-13T17:10:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.981+0000 7fe59f29e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5980d12d0 0x7fe5981f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.981+0000 7fe59f29e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5980d3800 0x7fe59809f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.981+0000 7fe59f29e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe59815cfb0 0x7fe5980cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.981+0000 7fe59f29e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59809fc20 con 0x7fe5980d3800 2024-09-13T17:10:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.981+0000 7fe59f29e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59809ff00 con 0x7fe5980d12d0 2024-09-13T17:10:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.981+0000 7fe59f29e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5980a01e0 con 0x7fe59815cfb0 2024-09-13T17:10:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe59c839700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5980d3800 0x7fe59809f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe59d03a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5980d12d0 0x7fe5981f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe59c839700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5980d3800 0x7fe59809f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50752/0 (socket says 172.21.15.123:50752) 2024-09-13T17:10:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe59c839700 1 -- 172.21.15.123:0/595988190 learned_addr learned my addr 172.21.15.123:0/595988190 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe59d83b700 1 --2- 172.21.15.123:0/595988190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe59815cfb0 0x7fe5980cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe59c839700 1 -- 172.21.15.123:0/595988190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe59815cfb0 msgr2=0x7fe5980cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe59c839700 1 --2- 172.21.15.123:0/595988190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe59815cfb0 0x7fe5980cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe59c839700 1 -- 172.21.15.123:0/595988190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5980d12d0 msgr2=0x7fe5981f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe59c839700 1 --2- 172.21.15.123:0/595988190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5980d12d0 0x7fe5981f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe59c839700 1 -- 172.21.15.123:0/595988190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940094b0 con 0x7fe5980d3800 2024-09-13T17:10:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe59c839700 1 --2- 172.21.15.123:0/595988190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5980d3800 0x7fe59809f140 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c480 tx=0x7fe58800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe58dffb700 1 -- 172.21.15.123:0/595988190 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5880052d0 con 0x7fe5980d3800 2024-09-13T17:10:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe58dffb700 1 -- 172.21.15.123:0/595988190 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58800ce90 con 0x7fe5980d3800 2024-09-13T17:10:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe59f29e700 1 -- 172.21.15.123:0/595988190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5980a04c0 con 0x7fe5980d3800 2024-09-13T17:10:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe58dffb700 1 -- 172.21.15.123:0/595988190 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588006880 con 0x7fe5980d3800 2024-09-13T17:10:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe59f29e700 1 -- 172.21.15.123:0/595988190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe598159490 con 0x7fe5980d3800 2024-09-13T17:10:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe59f29e700 1 -- 172.21.15.123:0/595988190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe598159650 con 0x7fe5980d3800 2024-09-13T17:10:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.985+0000 7fe58dffb700 1 -- 172.21.15.123:0/595988190 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe5880036a0 con 0x7fe5980d3800 2024-09-13T17:10:47.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.989+0000 7fe58dffb700 1 --2- 172.21.15.123:0/595988190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe57c066730 0x7fe57c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.989+0000 7fe59d03a700 1 --2- 172.21.15.123:0/595988190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe57c066730 0x7fe57c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.989+0000 7fe58dffb700 1 -- 172.21.15.123:0/595988190 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe5880833f0 con 0x7fe5980d3800 2024-09-13T17:10:47.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.989+0000 7fe59d03a700 1 --2- 172.21.15.123:0/595988190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe57c066730 0x7fe57c068bf0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe594000c00 tx=0x7fe59401c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:47.993+0000 7fe58dffb700 1 -- 172.21.15.123:0/595988190 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe588050660 con 0x7fe5980d3800 2024-09-13T17:10:48.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.197+0000 7fe59f29e700 1 -- 172.21.15.123:0/595988190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe59809fd60 con 0x7fe5980d3800 2024-09-13T17:10:48.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.845+0000 7fe58dffb700 1 -- 172.21.15.123:0/595988190 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v50) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe59809fd60 con 0x7fe5980d3800 2024-09-13T17:10:48.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.849+0000 7fe59f29e700 1 -- 172.21.15.123:0/595988190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe57c066730 msgr2=0x7fe57c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:48.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.849+0000 7fe59f29e700 1 --2- 172.21.15.123:0/595988190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe57c066730 0x7fe57c068bf0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe594000c00 tx=0x7fe59401c040 comp rx=0 tx=0).stop 2024-09-13T17:10:48.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.849+0000 7fe59f29e700 1 -- 172.21.15.123:0/595988190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5980d3800 msgr2=0x7fe59809f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:48.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.849+0000 7fe59f29e700 1 --2- 172.21.15.123:0/595988190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5980d3800 0x7fe59809f140 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c480 tx=0x7fe58800c790 comp rx=0 tx=0).stop 2024-09-13T17:10:48.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.849+0000 7fe59f29e700 1 -- 172.21.15.123:0/595988190 shutdown_connections 2024-09-13T17:10:48.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.849+0000 7fe59f29e700 1 --2- 172.21.15.123:0/595988190 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe57c066730 0x7fe57c068bf0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:48.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.849+0000 7fe59f29e700 1 --2- 172.21.15.123:0/595988190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe59815cfb0 0x7fe5980cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:48.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.849+0000 7fe59f29e700 1 --2- 172.21.15.123:0/595988190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5980d3800 0x7fe59809f140 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:48.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.849+0000 7fe59f29e700 1 --2- 172.21.15.123:0/595988190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5980d12d0 0x7fe5981f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:48.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.849+0000 7fe59f29e700 1 -- 172.21.15.123:0/595988190 >> 172.21.15.123:0/595988190 conn(0x7fe5980d2d10 msgr2=0x7fe5980b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:48.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.849+0000 7fe59f29e700 1 -- 172.21.15.123:0/595988190 shutdown_connections 2024-09-13T17:10:48.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.849+0000 7fe59f29e700 1 -- 172.21.15.123:0/595988190 wait complete. 2024-09-13T17:10:48.867 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:10:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefffff700 1 Processor -- start 2024-09-13T17:10:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefffff700 1 -- start start 2024-09-13T17:10:48.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef0015cb80 0x7fef000b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:48.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefffff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef00071b90 con 0x7fef000b57d0 2024-09-13T17:10:48.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefffff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef000723a0 con 0x7fef000b3a70 2024-09-13T17:10:48.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefffff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef00071de0 con 0x7fef0015cb80 2024-09-13T17:10:48.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefeffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef0015cb80 0x7fef000b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:48.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefe7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fef000b57d0 0x7fef000709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40476/0 (socket says 172.21.15.123:40476) 2024-09-13T17:10:48.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefe7fc700 1 -- 172.21.15.123:0/3825467567 learned_addr learned my addr 172.21.15.123:0/3825467567 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:48.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefeffd700 1 -- 172.21.15.123:0/3825467567 >> v1:172.21.15.153:6789/0 conn(0x7fef000b3a70 legacy=0x7fef0006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:48.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefeffd700 1 -- 172.21.15.123:0/3825467567 >> v1:172.21.15.123:6789/0 conn(0x7fef000b57d0 legacy=0x7fef000709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:48.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefeffd700 1 -- 172.21.15.123:0/3825467567 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000720c0 con 0x7fef0015cb80 2024-09-13T17:10:48.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefeffd700 1 --2- 172.21.15.123:0/3825467567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef0015cb80 0x7fef000b5290 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7feee8009850 tx=0x7feee8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a7d3326b989f50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:48.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefdffb700 1 -- 172.21.15.123:0/3825467567 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8004230 con 0x7fef0015cb80 2024-09-13T17:10:48.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefdffb700 1 -- 172.21.15.123:0/3825467567 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee8004390 con 0x7fef0015cb80 2024-09-13T17:10:48.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefdffb700 1 -- 172.21.15.123:0/3825467567 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80036c0 con 0x7fef0015cb80 2024-09-13T17:10:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefffff700 1 -- 172.21.15.123:0/3825467567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef0015cb80 msgr2=0x7fef000b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefffff700 1 --2- 172.21.15.123:0/3825467567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef0015cb80 0x7fef000b5290 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7feee8009850 tx=0x7feee8009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefffff700 1 -- 172.21.15.123:0/3825467567 shutdown_connections 2024-09-13T17:10:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefffff700 1 --2- 172.21.15.123:0/3825467567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef0015cb80 0x7fef000b5290 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefffff700 1 -- 172.21.15.123:0/3825467567 >> 172.21.15.123:0/3825467567 conn(0x7fef000b6110 msgr2=0x7fef0006a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefffff700 1 -- 172.21.15.123:0/3825467567 shutdown_connections 2024-09-13T17:10:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.989+0000 7feefffff700 1 -- 172.21.15.123:0/3825467567 wait complete. 2024-09-13T17:10:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.993+0000 7feefffff700 1 Processor -- start 2024-09-13T17:10:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.993+0000 7feefffff700 1 -- start start 2024-09-13T17:10:48.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.993+0000 7feefffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef000b3a70 0x7fef00143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:48.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.993+0000 7feefffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef000b57d0 0x7fef00154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:48.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.993+0000 7feefffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef00154a40 0x7fef001e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:48.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.993+0000 7feefffff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef001e3100 con 0x7fef000b3a70 2024-09-13T17:10:48.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.993+0000 7feefffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef00154ed0 con 0x7fef00154a40 2024-09-13T17:10:48.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.993+0000 7feefffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef001e75d0 con 0x7fef000b57d0 2024-09-13T17:10:48.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.993+0000 7feefeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef000b3a70 0x7fef00143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:48.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.993+0000 7feefeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef000b3a70 0x7fef00143270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50778/0 (socket says 172.21.15.123:50778) 2024-09-13T17:10:48.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.993+0000 7feefeffd700 1 -- 172.21.15.123:0/2074348083 learned_addr learned my addr 172.21.15.123:0/2074348083 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:48.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.993+0000 7feefe7fc700 1 --2- 172.21.15.123:0/2074348083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef000b57d0 0x7fef00154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:49.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.993+0000 7feeff7fe700 1 --2- 172.21.15.123:0/2074348083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef00154a40 0x7fef001e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:49.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.997+0000 7feefeffd700 1 -- 172.21.15.123:0/2074348083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef000b57d0 msgr2=0x7fef00154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:49.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.997+0000 7feefeffd700 1 --2- 172.21.15.123:0/2074348083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef000b57d0 0x7fef00154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:49.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.997+0000 7feefeffd700 1 -- 172.21.15.123:0/2074348083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef00154a40 msgr2=0x7fef001e68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:49.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.997+0000 7feefeffd700 1 --2- 172.21.15.123:0/2074348083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef00154a40 0x7fef001e68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:49.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.997+0000 7feefeffd700 1 -- 172.21.15.123:0/2074348083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee80094b0 con 0x7fef000b3a70 2024-09-13T17:10:49.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.997+0000 7feefeffd700 1 --2- 172.21.15.123:0/2074348083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef000b3a70 0x7fef00143270 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7feee8014040 tx=0x7feee8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:49.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.997+0000 7feef77fe700 1 -- 172.21.15.123:0/2074348083 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8011630 con 0x7fef000b3a70 2024-09-13T17:10:49.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.997+0000 7feef77fe700 1 -- 172.21.15.123:0/2074348083 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee80117d0 con 0x7fef000b3a70 2024-09-13T17:10:49.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.997+0000 7feefffff700 1 -- 172.21.15.123:0/2074348083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef001e2a40 con 0x7fef000b3a70 2024-09-13T17:10:49.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.997+0000 7feef77fe700 1 -- 172.21.15.123:0/2074348083 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8011b80 con 0x7fef000b3a70 2024-09-13T17:10:49.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.997+0000 7feefffff700 1 -- 172.21.15.123:0/2074348083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef001437b0 con 0x7fef000b3a70 2024-09-13T17:10:49.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.997+0000 7feefffff700 1 -- 172.21.15.123:0/2074348083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef000677f0 con 0x7fef000b3a70 2024-09-13T17:10:49.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:48.997+0000 7feef77fe700 1 -- 172.21.15.123:0/2074348083 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feee8018050 con 0x7fef000b3a70 2024-09-13T17:10:49.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.001+0000 7feef77fe700 1 --2- 172.21.15.123:0/2074348083 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feee0066730 0x7feee0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:49.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.001+0000 7feef77fe700 1 -- 172.21.15.123:0/2074348083 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5795+0+0 (secure 0 0 0) 0x7feee8084ce0 con 0x7fef000b3a70 2024-09-13T17:10:49.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.001+0000 7feefe7fc700 1 --2- 172.21.15.123:0/2074348083 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feee0066730 0x7feee0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:49.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.001+0000 7feefe7fc700 1 --2- 172.21.15.123:0/2074348083 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feee0066730 0x7feee0068bf0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fef001e7f10 tx=0x7feef0004a70 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:49.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.005+0000 7feef77fe700 1 -- 172.21.15.123:0/2074348083 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feee80521a0 con 0x7fef000b3a70 2024-09-13T17:10:49.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.177+0000 7feefffff700 1 -- 172.21.15.123:0/2074348083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef001e28a0 con 0x7fef000b3a70 2024-09-13T17:10:49.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.941+0000 7feef77fe700 1 -- 172.21.15.123:0/2074348083 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v100) v1 ==== 181+0+0 (secure 0 0 0) 0x7fef001e28a0 con 0x7fef000b3a70 2024-09-13T17:10:49.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.949+0000 7feefffff700 1 -- 172.21.15.123:0/2074348083 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feee0066730 msgr2=0x7feee0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:49.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.949+0000 7feefffff700 1 --2- 172.21.15.123:0/2074348083 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feee0066730 0x7feee0068bf0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fef001e7f10 tx=0x7feef0004a70 comp rx=0 tx=0).stop 2024-09-13T17:10:49.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.949+0000 7feefffff700 1 -- 172.21.15.123:0/2074348083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef000b3a70 msgr2=0x7fef00143270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:49.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.949+0000 7feefffff700 1 --2- 172.21.15.123:0/2074348083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef000b3a70 0x7fef00143270 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7feee8014040 tx=0x7feee8004770 comp rx=0 tx=0).stop 2024-09-13T17:10:49.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.949+0000 7feefffff700 1 -- 172.21.15.123:0/2074348083 shutdown_connections 2024-09-13T17:10:49.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.949+0000 7feefffff700 1 --2- 172.21.15.123:0/2074348083 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7feee0066730 0x7feee0068bf0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:49.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.949+0000 7feefffff700 1 --2- 172.21.15.123:0/2074348083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef00154a40 0x7fef001e68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:49.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.949+0000 7feefffff700 1 --2- 172.21.15.123:0/2074348083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fef000b57d0 0x7fef00154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:49.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.949+0000 7feefffff700 1 --2- 172.21.15.123:0/2074348083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef000b3a70 0x7fef00143270 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:49.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.949+0000 7feefffff700 1 -- 172.21.15.123:0/2074348083 >> 172.21.15.123:0/2074348083 conn(0x7fef000b6110 msgr2=0x7fef0015b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:49.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.949+0000 7feefffff700 1 -- 172.21.15.123:0/2074348083 shutdown_connections 2024-09-13T17:10:49.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:49.949+0000 7feefffff700 1 -- 172.21.15.123:0/2074348083 wait complete. 2024-09-13T17:10:49.953 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:10:49.965 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:10:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.085+0000 7ffbcb59e700 1 Processor -- start 2024-09-13T17:10:50.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.085+0000 7ffbcb59e700 1 -- start start 2024-09-13T17:10:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbcb59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffbcc158a90 0x7ffbcc06dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:50.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbcb59e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc15c3f0 con 0x7ffbcc155010 2024-09-13T17:10:50.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbcb59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc15c6d0 con 0x7ffbcc06e500 2024-09-13T17:10:50.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbcb59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbcc158f20 con 0x7ffbcc158a90 2024-09-13T17:10:50.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbc1d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffbcc158a90 0x7ffbcc06dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:50.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbc1d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffbcc158a90 0x7ffbcc06dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50782/0 (socket says 172.21.15.123:50782) 2024-09-13T17:10:50.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbc1d9b700 1 -- 172.21.15.123:0/1792969420 learned_addr learned my addr 172.21.15.123:0/1792969420 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:50.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbc1d9b700 1 -- 172.21.15.123:0/1792969420 >> v1:172.21.15.153:6789/0 conn(0x7ffbcc06e500 legacy=0x7ffbcc15d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:50.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbc1d9b700 1 -- 172.21.15.123:0/1792969420 >> v1:172.21.15.123:6789/0 conn(0x7ffbcc155010 legacy=0x7ffbcc15b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:50.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbc1d9b700 1 -- 172.21.15.123:0/1792969420 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc15c9b0 con 0x7ffbcc158a90 2024-09-13T17:10:50.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbc1d9b700 1 --2- 172.21.15.123:0/1792969420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbcc158a90 0x7ffbcc06dfc0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009910 tx=0x7ffbb4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f236b29601362bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:50.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbc9d9b700 1 -- 172.21.15.123:0/1792969420 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400ba60 con 0x7ffbcc158a90 2024-09-13T17:10:50.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbc9d9b700 1 -- 172.21.15.123:0/1792969420 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb400bbc0 con 0x7ffbcc158a90 2024-09-13T17:10:50.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbc9d9b700 1 -- 172.21.15.123:0/1792969420 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4009e60 con 0x7ffbcc158a90 2024-09-13T17:10:50.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1792969420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbcc158a90 msgr2=0x7ffbcc06dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:50.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbcb59e700 1 --2- 172.21.15.123:0/1792969420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbcc158a90 0x7ffbcc06dfc0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009910 tx=0x7ffbb4009c20 comp rx=0 tx=0).stop 2024-09-13T17:10:50.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1792969420 shutdown_connections 2024-09-13T17:10:50.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbcb59e700 1 --2- 172.21.15.123:0/1792969420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbcc158a90 0x7ffbcc06dfc0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1792969420 >> 172.21.15.123:0/1792969420 conn(0x7ffbcc072730 msgr2=0x7ffbcc066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1792969420 shutdown_connections 2024-09-13T17:10:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.089+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1792969420 wait complete. 2024-09-13T17:10:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbcb59e700 1 Processor -- start 2024-09-13T17:10:50.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbcb59e700 1 -- start start 2024-09-13T17:10:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbcb59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbcc06e500 0x7ffbcc1423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbcb59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbcc155010 0x7ffbcc0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbcb59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbcc158a90 0x7ffbcc151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbcb59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc142900 con 0x7ffbcc158a90 2024-09-13T17:10:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbcb59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc157430 con 0x7ffbcc06e500 2024-09-13T17:10:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbcb59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc1f2960 con 0x7ffbcc155010 2024-09-13T17:10:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbcad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbcc158a90 0x7ffbcc151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbc1d9b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbcc155010 0x7ffbcc0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbcad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbcc158a90 0x7ffbcc151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50788/0 (socket says 172.21.15.123:50788) 2024-09-13T17:10:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbc1d9b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbcc155010 0x7ffbcc0ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:59698/0 (socket says 172.21.15.123:59698) 2024-09-13T17:10:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbcad9d700 1 -- 172.21.15.123:0/1136741547 learned_addr learned my addr 172.21.15.123:0/1136741547 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbca59c700 1 --2- 172.21.15.123:0/1136741547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbcc06e500 0x7ffbcc1423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbc1d9b700 1 -- 172.21.15.123:0/1136741547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbcc06e500 msgr2=0x7ffbcc1423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbc1d9b700 1 --2- 172.21.15.123:0/1136741547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbcc06e500 0x7ffbcc1423c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbc1d9b700 1 -- 172.21.15.123:0/1136741547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbcc158a90 msgr2=0x7ffbcc151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbc1d9b700 1 --2- 172.21.15.123:0/1136741547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbcc158a90 0x7ffbcc151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbc1d9b700 1 -- 172.21.15.123:0/1136741547 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb4009570 con 0x7ffbcc155010 2024-09-13T17:10:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbcad9d700 1 --2- 172.21.15.123:0/1136741547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbcc158a90 0x7ffbcc151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbc1d9b700 1 --2- 172.21.15.123:0/1136741547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbcc155010 0x7ffbcc0ac8b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4016000 tx=0x7ffbb4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbc37fe700 1 -- 172.21.15.123:0/1136741547 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40036c0 con 0x7ffbcc155010 2024-09-13T17:10:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbc37fe700 1 -- 172.21.15.123:0/1136741547 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb401e070 con 0x7ffbcc155010 2024-09-13T17:10:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1136741547 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc1568b0 con 0x7ffbcc155010 2024-09-13T17:10:50.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbc37fe700 1 -- 172.21.15.123:0/1136741547 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4003a80 con 0x7ffbcc155010 2024-09-13T17:10:50.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.093+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1136741547 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc156e70 con 0x7ffbcc155010 2024-09-13T17:10:50.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.097+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1136741547 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbcc1486e0 con 0x7ffbcc155010 2024-09-13T17:10:50.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.097+0000 7ffbc37fe700 1 -- 172.21.15.123:0/1136741547 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffbb4003be0 con 0x7ffbcc155010 2024-09-13T17:10:50.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.097+0000 7ffbc37fe700 1 --2- 172.21.15.123:0/1136741547 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffbb0066730 0x7ffbb0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:50.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.097+0000 7ffbc37fe700 1 -- 172.21.15.123:0/1136741547 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5357+0+0 (secure 0 0 0) 0x7ffbb4020070 con 0x7ffbcc155010 2024-09-13T17:10:50.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.097+0000 7ffbca59c700 1 --2- 172.21.15.123:0/1136741547 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffbb0066730 0x7ffbb0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:50.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.101+0000 7ffbca59c700 1 --2- 172.21.15.123:0/1136741547 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffbb0066730 0x7ffbb0068bf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc000f60 tx=0x7ffbbc009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:50.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.109+0000 7ffbc37fe700 1 -- 172.21.15.123:0/1136741547 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffbb4052990 con 0x7ffbcc155010 2024-09-13T17:10:50.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.285+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1136741547 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffbcc0677f0 con 0x7ffbcc155010 2024-09-13T17:10:50.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.945+0000 7ffbc37fe700 1 -- 172.21.15.123:0/1136741547 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v101) v1 ==== 169+0+0 (secure 0 0 0) 0x7ffbb40150d0 con 0x7ffbcc155010 2024-09-13T17:10:50.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.953+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1136741547 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffbb0066730 msgr2=0x7ffbb0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:50.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.953+0000 7ffbcb59e700 1 --2- 172.21.15.123:0/1136741547 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffbb0066730 0x7ffbb0068bf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc000f60 tx=0x7ffbbc009040 comp rx=0 tx=0).stop 2024-09-13T17:10:50.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.953+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1136741547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbcc155010 msgr2=0x7ffbcc0ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:50.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.953+0000 7ffbcb59e700 1 --2- 172.21.15.123:0/1136741547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbcc155010 0x7ffbcc0ac8b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4016000 tx=0x7ffbb4004770 comp rx=0 tx=0).stop 2024-09-13T17:10:50.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.953+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1136741547 shutdown_connections 2024-09-13T17:10:50.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.953+0000 7ffbcb59e700 1 --2- 172.21.15.123:0/1136741547 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7ffbb0066730 0x7ffbb0068bf0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.953+0000 7ffbcb59e700 1 --2- 172.21.15.123:0/1136741547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffbcc158a90 0x7ffbcc151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.953+0000 7ffbcb59e700 1 --2- 172.21.15.123:0/1136741547 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbcc155010 0x7ffbcc0ac8b0 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4016000 tx=0x7ffbb4004770 comp rx=0 tx=0).stop 2024-09-13T17:10:50.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.953+0000 7ffbcb59e700 1 --2- 172.21.15.123:0/1136741547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbcc06e500 0x7ffbcc1423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.953+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1136741547 >> 172.21.15.123:0/1136741547 conn(0x7ffbcc072730 msgr2=0x7ffbcc152900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:50.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.953+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1136741547 shutdown_connections 2024-09-13T17:10:50.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:50.953+0000 7ffbcb59e700 1 -- 172.21.15.123:0/1136741547 wait complete. 2024-09-13T17:10:50.957 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-13T17:10:50.969 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T17:10:51.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.077+0000 7f1653508700 1 Processor -- start 2024-09-13T17:10:51.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.077+0000 7f1653508700 1 -- start start 2024-09-13T17:10:51.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.077+0000 7f1653508700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f164c1595f0 0x7f164c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:51.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.077+0000 7f1653508700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f164c0c93e0 0x7f164c0714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:51.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.077+0000 7f1653508700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c0cdec0 con 0x7f164c0cbbd0 2024-09-13T17:10:51.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.077+0000 7f1653508700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c1599d0 con 0x7f164c0c93e0 2024-09-13T17:10:51.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.077+0000 7f1653508700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0cd900 con 0x7f164c1595f0 2024-09-13T17:10:51.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.077+0000 7f1652d07700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f164c0c93e0 0x7f164c0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:51.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.077+0000 7f1652d07700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f164c0c93e0 0x7f164c0714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50794/0 (socket says 172.21.15.123:50794) 2024-09-13T17:10:51.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.077+0000 7f1652d07700 1 -- 172.21.15.123:0/2730159630 learned_addr learned my addr 172.21.15.123:0/2730159630 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:51.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.077+0000 7f1652506700 1 --2- 172.21.15.123:0/2730159630 >> v2:172.21.15.153:3300/0 conn(0x7f164c1595f0 0x7f164c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:51.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1652d07700 1 -- 172.21.15.123:0/2730159630 >> v2:172.21.15.153:3300/0 conn(0x7f164c1595f0 msgr2=0x7f164c0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:51.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1652d07700 1 --2- 172.21.15.123:0/2730159630 >> v2:172.21.15.153:3300/0 conn(0x7f164c1595f0 0x7f164c0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1652d07700 1 -- 172.21.15.123:0/2730159630 >> v1:172.21.15.153:6789/0 conn(0x7f164c0cbbd0 legacy=0x7f164c0c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:51.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1652d07700 1 -- 172.21.15.123:0/2730159630 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c0cdbe0 con 0x7f164c0c93e0 2024-09-13T17:10:51.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1652d07700 1 --2- 172.21.15.123:0/2730159630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f164c0c93e0 0x7f164c0714e0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f164c070030 tx=0x7f1644009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7159b1cba9ea43d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:51.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1651504700 1 -- 172.21.15.123:0/2730159630 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400b8a0 con 0x7f164c0c93e0 2024-09-13T17:10:51.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1651504700 1 -- 172.21.15.123:0/2730159630 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164400ba00 con 0x7f164c0c93e0 2024-09-13T17:10:51.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1651504700 1 -- 172.21.15.123:0/2730159630 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400bd90 con 0x7f164c0c93e0 2024-09-13T17:10:51.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 -- 172.21.15.123:0/2730159630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f164c0c93e0 msgr2=0x7f164c0714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:51.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 --2- 172.21.15.123:0/2730159630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f164c0c93e0 0x7f164c0714e0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f164c070030 tx=0x7f1644009bf0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 -- 172.21.15.123:0/2730159630 shutdown_connections 2024-09-13T17:10:51.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 --2- 172.21.15.123:0/2730159630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f164c0c93e0 0x7f164c0714e0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 --2- 172.21.15.123:0/2730159630 >> v2:172.21.15.153:3300/0 conn(0x7f164c1595f0 0x7f164c0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 -- 172.21.15.123:0/2730159630 >> 172.21.15.123:0/2730159630 conn(0x7f164c0b01d0 msgr2=0x7f164c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:51.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 -- 172.21.15.123:0/2730159630 shutdown_connections 2024-09-13T17:10:51.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 -- 172.21.15.123:0/2730159630 wait complete. 2024-09-13T17:10:51.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 Processor -- start 2024-09-13T17:10:51.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 -- start start 2024-09-13T17:10:51.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f164c0c93e0 0x7f164c06bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:51.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f164c0cbbd0 0x7f164c06d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:51.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f164c1595f0 0x7f164c14b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:51.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c06c510 con 0x7f164c0c93e0 2024-09-13T17:10:51.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c06c7f0 con 0x7f164c0cbbd0 2024-09-13T17:10:51.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1653508700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c06cad0 con 0x7f164c1595f0 2024-09-13T17:10:51.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1652506700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f164c0c93e0 0x7f164c06bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:51.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1652506700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f164c0c93e0 0x7f164c06bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50804/0 (socket says 172.21.15.123:50804) 2024-09-13T17:10:51.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.081+0000 7f1652506700 1 -- 172.21.15.123:0/1772060835 learned_addr learned my addr 172.21.15.123:0/1772060835 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:51.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1652d07700 1 --2- 172.21.15.123:0/1772060835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f164c1595f0 0x7f164c14b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:51.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1651d05700 1 --2- 172.21.15.123:0/1772060835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f164c0cbbd0 0x7f164c06d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:51.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1652506700 1 -- 172.21.15.123:0/1772060835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f164c1595f0 msgr2=0x7f164c14b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:51.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1652506700 1 --2- 172.21.15.123:0/1772060835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f164c1595f0 0x7f164c14b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1652506700 1 -- 172.21.15.123:0/1772060835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f164c0cbbd0 msgr2=0x7f164c06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:51.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1652506700 1 --2- 172.21.15.123:0/1772060835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f164c0cbbd0 0x7f164c06d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1652506700 1 -- 172.21.15.123:0/1772060835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1644009570 con 0x7f164c0c93e0 2024-09-13T17:10:51.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1652506700 1 --2- 172.21.15.123:0/1772060835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f164c0c93e0 0x7f164c06bf30 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f163c00d800 tx=0x7f163c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:51.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1642ffd700 1 -- 172.21.15.123:0/1772060835 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c0125f0 con 0x7f164c0c93e0 2024-09-13T17:10:51.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1642ffd700 1 -- 172.21.15.123:0/1772060835 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c012750 con 0x7f164c0c93e0 2024-09-13T17:10:51.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1653508700 1 -- 172.21.15.123:0/1772060835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c06cdb0 con 0x7f164c0c93e0 2024-09-13T17:10:51.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1642ffd700 1 -- 172.21.15.123:0/1772060835 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c012ac0 con 0x7f164c0c93e0 2024-09-13T17:10:51.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1653508700 1 -- 172.21.15.123:0/1772060835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c06dad0 con 0x7f164c0c93e0 2024-09-13T17:10:51.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1653508700 1 -- 172.21.15.123:0/1772060835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c0ccf90 con 0x7f164c0c93e0 2024-09-13T17:10:51.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.085+0000 7f1642ffd700 1 -- 172.21.15.123:0/1772060835 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f163c012c20 con 0x7f164c0c93e0 2024-09-13T17:10:51.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.089+0000 7f1642ffd700 1 --2- 172.21.15.123:0/1772060835 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1630066730 0x7f1630068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:51.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.089+0000 7f1642ffd700 1 -- 172.21.15.123:0/1772060835 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f163c0848b0 con 0x7f164c0c93e0 2024-09-13T17:10:51.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.089+0000 7f1651d05700 1 --2- 172.21.15.123:0/1772060835 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1630066730 0x7f1630068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:51.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.089+0000 7f1651d05700 1 --2- 172.21.15.123:0/1772060835 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1630066730 0x7f1630068bf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f164c0b4170 tx=0x7f1648009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:51.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.093+0000 7f1642ffd700 1 -- 172.21.15.123:0/1772060835 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f163c052090 con 0x7f164c0c93e0 2024-09-13T17:10:51.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.261+0000 7f1653508700 1 -- 172.21.15.123:0/1772060835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f164c1490c0 con 0x7f164c0c93e0 2024-09-13T17:10:51.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.269+0000 7f1642ffd700 1 -- 172.21.15.123:0/1772060835 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f163c0556b0 con 0x7f164c0c93e0 2024-09-13T17:10:51.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.273+0000 7f1653508700 1 -- 172.21.15.123:0/1772060835 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1630066730 msgr2=0x7f1630068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:51.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.273+0000 7f1653508700 1 --2- 172.21.15.123:0/1772060835 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1630066730 0x7f1630068bf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f164c0b4170 tx=0x7f1648009040 comp rx=0 tx=0).stop 2024-09-13T17:10:51.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.273+0000 7f1653508700 1 -- 172.21.15.123:0/1772060835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f164c0c93e0 msgr2=0x7f164c06bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:51.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.273+0000 7f1653508700 1 --2- 172.21.15.123:0/1772060835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f164c0c93e0 0x7f164c06bf30 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f163c00d800 tx=0x7f163c00db10 comp rx=0 tx=0).stop 2024-09-13T17:10:51.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.273+0000 7f1653508700 1 -- 172.21.15.123:0/1772060835 shutdown_connections 2024-09-13T17:10:51.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.273+0000 7f1653508700 1 --2- 172.21.15.123:0/1772060835 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f1630066730 0x7f1630068bf0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.273+0000 7f1653508700 1 --2- 172.21.15.123:0/1772060835 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f164c1595f0 0x7f164c14b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.273+0000 7f1653508700 1 --2- 172.21.15.123:0/1772060835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f164c0cbbd0 0x7f164c06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.273+0000 7f1653508700 1 --2- 172.21.15.123:0/1772060835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f164c0c93e0 0x7f164c06bf30 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.273+0000 7f1653508700 1 -- 172.21.15.123:0/1772060835 >> 172.21.15.123:0/1772060835 conn(0x7f164c0b01d0 msgr2=0x7f164c0af690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:51.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.273+0000 7f1653508700 1 -- 172.21.15.123:0/1772060835 shutdown_connections 2024-09-13T17:10:51.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.273+0000 7f1653508700 1 -- 172.21.15.123:0/1772060835 wait complete. 2024-09-13T17:10:51.288 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_write' 2024-09-13T17:10:51.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f883ad00700 1 Processor -- start 2024-09-13T17:10:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f883ad00700 1 -- start start 2024-09-13T17:10:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f883ad00700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f88340cb840 0x7f8834159580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f883ad00700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f88340b1b90 0x7f88340b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f883ad00700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88340b24d0 con 0x7f88341534a0 2024-09-13T17:10:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f883ad00700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88340cb1a0 con 0x7f88340b1b90 2024-09-13T17:10:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f883ad00700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8834159bd0 con 0x7f88340cb840 2024-09-13T17:10:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f883a4ff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f88340b1b90 0x7f88340b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f883a4ff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f88340b1b90 0x7f88340b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50806/0 (socket says 172.21.15.123:50806) 2024-09-13T17:10:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f883a4ff700 1 -- 172.21.15.123:0/1022311958 learned_addr learned my addr 172.21.15.123:0/1022311958 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f88394fd700 1 --2- 172.21.15.123:0/1022311958 >> v2:172.21.15.153:3300/0 conn(0x7f88340cb840 0x7f8834159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f883a4ff700 1 -- 172.21.15.123:0/1022311958 >> v2:172.21.15.153:3300/0 conn(0x7f88340cb840 msgr2=0x7f8834159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f883a4ff700 1 --2- 172.21.15.123:0/1022311958 >> v2:172.21.15.153:3300/0 conn(0x7f88340cb840 0x7f8834159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f883a4ff700 1 -- 172.21.15.123:0/1022311958 >> v1:172.21.15.153:6789/0 conn(0x7f88341534a0 legacy=0x7f8834071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:51.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.397+0000 7f883a4ff700 1 -- 172.21.15.123:0/1022311958 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8834159eb0 con 0x7f88340b1b90 2024-09-13T17:10:51.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.401+0000 7f883a4ff700 1 --2- 172.21.15.123:0/1022311958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88340b1b90 0x7f88340b1f90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f88340713d0 tx=0x7f882c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fc63054ba3dd1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:51.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.401+0000 7f8838cfc700 1 -- 172.21.15.123:0/1022311958 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c00b8a0 con 0x7f88340b1b90 2024-09-13T17:10:51.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.401+0000 7f8838cfc700 1 -- 172.21.15.123:0/1022311958 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c00ba00 con 0x7f88340b1b90 2024-09-13T17:10:51.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.401+0000 7f8838cfc700 1 -- 172.21.15.123:0/1022311958 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c00bd90 con 0x7f88340b1b90 2024-09-13T17:10:51.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.401+0000 7f883ad00700 1 -- 172.21.15.123:0/1022311958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88340b1b90 msgr2=0x7f88340b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:51.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.401+0000 7f883ad00700 1 --2- 172.21.15.123:0/1022311958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88340b1b90 0x7f88340b1f90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f88340713d0 tx=0x7f882c009bf0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.401+0000 7f883ad00700 1 -- 172.21.15.123:0/1022311958 shutdown_connections 2024-09-13T17:10:51.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.401+0000 7f883ad00700 1 --2- 172.21.15.123:0/1022311958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88340b1b90 0x7f88340b1f90 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.401+0000 7f883ad00700 1 --2- 172.21.15.123:0/1022311958 >> v2:172.21.15.153:3300/0 conn(0x7f88340cb840 0x7f8834159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.401+0000 7f883ad00700 1 -- 172.21.15.123:0/1022311958 >> 172.21.15.123:0/1022311958 conn(0x7f8834066150 msgr2=0x7f8834066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:51.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.401+0000 7f883ad00700 1 -- 172.21.15.123:0/1022311958 shutdown_connections 2024-09-13T17:10:51.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.401+0000 7f883ad00700 1 -- 172.21.15.123:0/1022311958 wait complete. 2024-09-13T17:10:51.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.401+0000 7f883ad00700 1 Processor -- start 2024-09-13T17:10:51.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.401+0000 7f883ad00700 1 -- start start 2024-09-13T17:10:51.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f883ad00700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88340b1b90 0x7f88340c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:51.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f883ad00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88340cb840 0x7f8834150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:51.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f883ad00700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88341534a0 0x7f88340c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:51.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f883ad00700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88341ef350 con 0x7f88340b1b90 2024-09-13T17:10:51.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f883ad00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834157100 con 0x7f88340cb840 2024-09-13T17:10:51.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f883ad00700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8834150540 con 0x7f88341534a0 2024-09-13T17:10:51.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f8839cfe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88340b1b90 0x7f88340c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:51.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f8839cfe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88340b1b90 0x7f88340c9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50816/0 (socket says 172.21.15.123:50816) 2024-09-13T17:10:51.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f8839cfe700 1 -- 172.21.15.123:0/3977938706 learned_addr learned my addr 172.21.15.123:0/3977938706 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:51.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f88394fd700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88340cb840 0x7f8834150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:51.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f883a4ff700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88341534a0 0x7f88340c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:51.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f8839cfe700 1 -- 172.21.15.123:0/3977938706 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88341534a0 msgr2=0x7f88340c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:51.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f8839cfe700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88341534a0 0x7f88340c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f8839cfe700 1 -- 172.21.15.123:0/3977938706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88340cb840 msgr2=0x7f8834150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:51.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f8839cfe700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88340cb840 0x7f8834150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f8839cfe700 1 -- 172.21.15.123:0/3977938706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c009570 con 0x7f88340b1b90 2024-09-13T17:10:51.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f883a4ff700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88341534a0 0x7f88340c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:51.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f8839cfe700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88340b1b90 0x7f88340c9f90 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f882400c410 tx=0x7f882400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:51.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f882a7fc700 1 -- 172.21.15.123:0/3977938706 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88240052d0 con 0x7f88340b1b90 2024-09-13T17:10:51.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f882a7fc700 1 -- 172.21.15.123:0/3977938706 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8824005430 con 0x7f88340b1b90 2024-09-13T17:10:51.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f883ad00700 1 -- 172.21.15.123:0/3977938706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8834156130 con 0x7f88340b1b90 2024-09-13T17:10:51.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f882a7fc700 1 -- 172.21.15.123:0/3977938706 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88240055a0 con 0x7f88340b1b90 2024-09-13T17:10:51.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f883ad00700 1 -- 172.21.15.123:0/3977938706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8834157350 con 0x7f88340b1b90 2024-09-13T17:10:51.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f883ad00700 1 -- 172.21.15.123:0/3977938706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88340677f0 con 0x7f88340b1b90 2024-09-13T17:10:51.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.405+0000 7f882a7fc700 1 -- 172.21.15.123:0/3977938706 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f88240036a0 con 0x7f88340b1b90 2024-09-13T17:10:51.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.409+0000 7f882a7fc700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8820066730 0x7f8820068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:51.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.409+0000 7f88394fd700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8820066730 0x7f8820068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:51.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.409+0000 7f882a7fc700 1 -- 172.21.15.123:0/3977938706 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8824083010 con 0x7f88340b1b90 2024-09-13T17:10:51.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.409+0000 7f88394fd700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8820066730 0x7f8820068bf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8834157090 tx=0x7f883000b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:51.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.413+0000 7f882a7fc700 1 -- 172.21.15.123:0/3977938706 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8824050710 con 0x7f88340b1b90 2024-09-13T17:10:51.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.652+0000 7f883ad00700 1 -- 172.21.15.123:0/3977938706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]} v 0) v1 -- 0x7f88340b1f90 con 0x7f88340b1b90 2024-09-13T17:10:51.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.956+0000 7f882a7fc700 1 -- 172.21.15.123:0/3977938706 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]}]=0 v244) v1 ==== 137+0+0 (secure 0 0 0) 0x7f8824053d30 con 0x7f88340b1b90 2024-09-13T17:10:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.960+0000 7f883ad00700 1 -- 172.21.15.123:0/3977938706 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8820066730 msgr2=0x7f8820068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.960+0000 7f883ad00700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8820066730 0x7f8820068bf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8834157090 tx=0x7f883000b040 comp rx=0 tx=0).stop 2024-09-13T17:10:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.960+0000 7f883ad00700 1 -- 172.21.15.123:0/3977938706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88340b1b90 msgr2=0x7f88340c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.960+0000 7f883ad00700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88340b1b90 0x7f88340c9f90 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f882400c410 tx=0x7f882400c7d0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.960+0000 7f883ad00700 1 -- 172.21.15.123:0/3977938706 shutdown_connections 2024-09-13T17:10:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.960+0000 7f883ad00700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8820066730 0x7f8820068bf0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.960+0000 7f883ad00700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f88341534a0 0x7f88340c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.960+0000 7f883ad00700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88340cb840 0x7f8834150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.960+0000 7f883ad00700 1 --2- 172.21.15.123:0/3977938706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88340b1b90 0x7f88340c9f90 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.960+0000 7f883ad00700 1 -- 172.21.15.123:0/3977938706 >> 172.21.15.123:0/3977938706 conn(0x7f8834066150 msgr2=0x7f883415a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:51.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.960+0000 7f883ad00700 1 -- 172.21.15.123:0/3977938706 shutdown_connections 2024-09-13T17:10:51.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:51.960+0000 7f883ad00700 1 -- 172.21.15.123:0/3977938706 wait complete. 2024-09-13T17:10:51.981 INFO:tasks.cephfs_test_runner:That when a client modifies the quota on a directory used ... ok 2024-09-13T17:10:51.981 INFO:tasks.cephfs_test_runner: 2024-09-13T17:10:51.981 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-13T17:10:51.981 INFO:tasks.cephfs_test_runner:Ran 6 tests in 215.007s 2024-09-13T17:10:51.981 INFO:tasks.cephfs_test_runner: 2024-09-13T17:10:51.981 INFO:tasks.cephfs_test_runner:OK 2024-09-13T17:10:51.982 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-13T17:10:51.991 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T17:10:52.027 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T17:10:52.027 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:10:52.027 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:52.035 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:10:52.036 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-13T17:10:52.036 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:52.043 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=143 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:10:52.043 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:10:52.043 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:52.052 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:10:52.052 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-13T17:10:52.052 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:10:52.058 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346336k,nr_inodes=4086584,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16513 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275492k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275496k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:10:52.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:52.059 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-13T17:10:52.068 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:10:52.068 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:10:52.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:52.069 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:10:52.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:52.126 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:10:52.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:52.138 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-09-13T17:10:52.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:52.296 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-13T17:10:52.303 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:10:52.304 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:10:52.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:52.304 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:10:52.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:52.359 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:10:52.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:10:52.376 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-09-13T17:10:52.503 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T17:10:52.517 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T17:10:52.517 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:10:52.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.636+0000 7f8e1f59e700 1 Processor -- start 2024-09-13T17:10:52.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.636+0000 7f8e1f59e700 1 -- start start 2024-09-13T17:10:52.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1f59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e201536f0 0x7f8e2006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1f59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e2015a020 0x7f8e2015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1f59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2015a480 con 0x7f8e2006a260 2024-09-13T17:10:52.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1f59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2015ac30 con 0x7f8e201536f0 2024-09-13T17:10:52.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1f59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2006ce50 con 0x7f8e2015a020 2024-09-13T17:10:52.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1e59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e201536f0 0x7f8e2006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1e59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e201536f0 0x7f8e2006c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57880/0 (socket says 172.21.15.123:57880) 2024-09-13T17:10:52.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1e59c700 1 -- 172.21.15.123:0/2538786960 learned_addr learned my addr 172.21.15.123:0/2538786960 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:52.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e15d9b700 1 --2- 172.21.15.123:0/2538786960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e2015a020 0x7f8e2015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1dd9b700 1 -- 172.21.15.123:0/2538786960 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984209627 0 0) 0x7f8e2015a480 con 0x7f8e2006a260 2024-09-13T17:10:52.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1e59c700 1 -- 172.21.15.123:0/2538786960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e2015a020 msgr2=0x7f8e2015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:52.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1e59c700 1 --2- 172.21.15.123:0/2538786960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e2015a020 0x7f8e2015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1e59c700 1 -- 172.21.15.123:0/2538786960 >> v1:172.21.15.153:6789/0 conn(0x7f8e2006a260 legacy=0x7f8e200b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1e59c700 1 -- 172.21.15.123:0/2538786960 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e200b2b10 con 0x7f8e201536f0 2024-09-13T17:10:52.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1e59c700 1 --2- 172.21.15.123:0/2538786960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e201536f0 0x7f8e2006c7c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009910 tx=0x7f8e10009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9388eeca37c908ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:52.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1dd9b700 1 -- 172.21.15.123:0/2538786960 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10011830 con 0x7f8e201536f0 2024-09-13T17:10:52.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1dd9b700 1 -- 172.21.15.123:0/2538786960 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e10011990 con 0x7f8e201536f0 2024-09-13T17:10:52.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1dd9b700 1 -- 172.21.15.123:0/2538786960 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10011d40 con 0x7f8e201536f0 2024-09-13T17:10:52.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1f59e700 1 -- 172.21.15.123:0/2538786960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e201536f0 msgr2=0x7f8e2006c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.640+0000 7f8e1f59e700 1 --2- 172.21.15.123:0/2538786960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e201536f0 0x7f8e2006c7c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009910 tx=0x7f8e10009c20 comp rx=0 tx=0).stop 2024-09-13T17:10:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.644+0000 7f8e1f59e700 1 -- 172.21.15.123:0/2538786960 shutdown_connections 2024-09-13T17:10:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.644+0000 7f8e1f59e700 1 --2- 172.21.15.123:0/2538786960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e2015a020 0x7f8e2015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.644+0000 7f8e1f59e700 1 --2- 172.21.15.123:0/2538786960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e201536f0 0x7f8e2006c7c0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.644+0000 7f8e1f59e700 1 -- 172.21.15.123:0/2538786960 >> 172.21.15.123:0/2538786960 conn(0x7f8e2006fa10 msgr2=0x7f8e200b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.644+0000 7f8e1f59e700 1 -- 172.21.15.123:0/2538786960 shutdown_connections 2024-09-13T17:10:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.644+0000 7f8e1f59e700 1 -- 172.21.15.123:0/2538786960 wait complete. 2024-09-13T17:10:52.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.644+0000 7f8e1f59e700 1 Processor -- start 2024-09-13T17:10:52.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.644+0000 7f8e1f59e700 1 -- start start 2024-09-13T17:10:52.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1f59e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e2006a260 0x7f8e201500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e201536f0 0x7f8e20145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e2015a020 0x7f8e2014a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1f59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20150600 con 0x7f8e2015a020 2024-09-13T17:10:52.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20150830 con 0x7f8e201536f0 2024-09-13T17:10:52.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1f59e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20150b10 con 0x7f8e2006a260 2024-09-13T17:10:52.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e2015a020 0x7f8e2014a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e2015a020 0x7f8e2014a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57892/0 (socket says 172.21.15.123:57892) 2024-09-13T17:10:52.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1ed9d700 1 -- 172.21.15.123:0/1874597857 learned_addr learned my addr 172.21.15.123:0/1874597857 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:52.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1e59c700 1 --2- 172.21.15.123:0/1874597857 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e2006a260 0x7f8e201500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e15d9b700 1 --2- 172.21.15.123:0/1874597857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e201536f0 0x7f8e20145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1ed9d700 1 -- 172.21.15.123:0/1874597857 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e2006a260 msgr2=0x7f8e201500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1ed9d700 1 --2- 172.21.15.123:0/1874597857 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e2006a260 0x7f8e201500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1ed9d700 1 -- 172.21.15.123:0/1874597857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e201536f0 msgr2=0x7f8e20145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1ed9d700 1 --2- 172.21.15.123:0/1874597857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e201536f0 0x7f8e20145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1ed9d700 1 -- 172.21.15.123:0/1874597857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e10009570 con 0x7f8e2015a020 2024-09-13T17:10:52.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1ed9d700 1 --2- 172.21.15.123:0/1874597857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e2015a020 0x7f8e2014a4f0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800cc70 tx=0x7f8e1800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:52.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e177fe700 1 -- 172.21.15.123:0/1874597857 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18003e50 con 0x7f8e2015a020 2024-09-13T17:10:52.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e177fe700 1 -- 172.21.15.123:0/1874597857 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1800a6f0 con 0x7f8e2015a020 2024-09-13T17:10:52.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1f59e700 1 -- 172.21.15.123:0/1874597857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e20150df0 con 0x7f8e2015a020 2024-09-13T17:10:52.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e177fe700 1 -- 172.21.15.123:0/1874597857 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800aaa0 con 0x7f8e2015a020 2024-09-13T17:10:52.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1f59e700 1 -- 172.21.15.123:0/1874597857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e20146130 con 0x7f8e2015a020 2024-09-13T17:10:52.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.648+0000 7f8e1f59e700 1 -- 172.21.15.123:0/1874597857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e20154b20 con 0x7f8e2015a020 2024-09-13T17:10:52.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.652+0000 7f8e177fe700 1 -- 172.21.15.123:0/1874597857 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e1800ac00 con 0x7f8e2015a020 2024-09-13T17:10:52.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.652+0000 7f8e177fe700 1 --2- 172.21.15.123:0/1874597857 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8e00066730 0x7f8e00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.652+0000 7f8e177fe700 1 -- 172.21.15.123:0/1874597857 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8e18083920 con 0x7f8e2015a020 2024-09-13T17:10:52.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.652+0000 7f8e1e59c700 1 --2- 172.21.15.123:0/1874597857 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8e00066730 0x7f8e00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.652+0000 7f8e1e59c700 1 --2- 172.21.15.123:0/1874597857 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8e00066730 0x7f8e00068bf0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8e10000c00 tx=0x7f8e10008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:52.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.660+0000 7f8e177fe700 1 -- 172.21.15.123:0/1874597857 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e20154b20 con 0x7f8e2015a020 2024-09-13T17:10:52.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.832+0000 7f8e1f59e700 1 -- 172.21.15.123:0/1874597857 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e200b33b0 con 0x7f8e00066730 2024-09-13T17:10:52.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.836+0000 7f8e177fe700 1 -- 172.21.15.123:0/1874597857 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49405 (secure 0 0 0) 0x7f8e10011cb0 con 0x7f8e00066730 2024-09-13T17:10:52.842 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:52.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.840+0000 7f8e1f59e700 1 -- 172.21.15.123:0/1874597857 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8e00066730 msgr2=0x7f8e00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.840+0000 7f8e1f59e700 1 --2- 172.21.15.123:0/1874597857 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8e00066730 0x7f8e00068bf0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8e10000c00 tx=0x7f8e10008030 comp rx=0 tx=0).stop 2024-09-13T17:10:52.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.840+0000 7f8e1f59e700 1 -- 172.21.15.123:0/1874597857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e2015a020 msgr2=0x7f8e2014a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.840+0000 7f8e1f59e700 1 --2- 172.21.15.123:0/1874597857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e2015a020 0x7f8e2014a4f0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800cc70 tx=0x7f8e1800cf80 comp rx=0 tx=0).stop 2024-09-13T17:10:52.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.840+0000 7f8e1f59e700 1 -- 172.21.15.123:0/1874597857 shutdown_connections 2024-09-13T17:10:52.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.840+0000 7f8e1f59e700 1 --2- 172.21.15.123:0/1874597857 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f8e00066730 0x7f8e00068bf0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.840+0000 7f8e1f59e700 1 --2- 172.21.15.123:0/1874597857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e2015a020 0x7f8e2014a4f0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.840+0000 7f8e1f59e700 1 --2- 172.21.15.123:0/1874597857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e201536f0 0x7f8e20145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.840+0000 7f8e1f59e700 1 --2- 172.21.15.123:0/1874597857 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8e2006a260 0x7f8e201500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.840+0000 7f8e1f59e700 1 -- 172.21.15.123:0/1874597857 >> 172.21.15.123:0/1874597857 conn(0x7f8e2006fa10 msgr2=0x7f8e2014e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:52.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.840+0000 7f8e1f59e700 1 -- 172.21.15.123:0/1874597857 shutdown_connections 2024-09-13T17:10:52.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.840+0000 7f8e1f59e700 1 -- 172.21.15.123:0/1874597857 wait complete. 2024-09-13T17:10:52.845 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:10:52.856 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-09-13T17:10:52.808833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":255848,"kb_used_data":15100,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754718872,"statfs":{"total":773094113280,"available":772832124928,"internally_reserved":0,"allocated":15462400,"data_stored":9641196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2327480,"num_objects":-47,"num_object_clones":0,"num_object_copies":-94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-214,"num_write_kb":-22851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":247,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T17:10:49.936852+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:10:49.936852+0000","last_peered":"2024-09-13T17:10:49.936852+0000","last_clean":"2024-09-13T17:10:49.936852+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:10:49.936852+0000","last_undegraded":"2024-09-13T17:10:49.936852+0000","last_fullsized":"2024-09-13T17:10:49.936852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34976,"kb_used_data":3860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94336864,"statfs":{"total":96636764160,"available":96600948736,"internally_reserved":0,"allocated":3952640,"data_stored":3218705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.57699999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0920000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.63},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.89600000000000002},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.129,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.117}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.90500000000000003,"15min":0.92100000000000004},"min":{"1min":0.52000000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2070000000000001,"5min":1.456,"15min":1.456},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.54000000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.101,"5min":1.609,"15min":1.609},"last":0.96499999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.85899999999999999,"15min":0.86099999999999999},"min":{"1min":0.59599999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.22,"5min":1.238,"15min":1.238},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.96999999999999997,"15min":0.999},"min":{"1min":0.60399999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1739999999999999,"5min":1.839,"15min":1.839},"last":1.2030000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.92700000000000005,"15min":0.92000000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3440000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96099999999999997,"15min":0.99099999999999999},"min":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1499999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2989999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90400000000000003,"15min":0.90200000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.0900000000000001,"15min":1.1140000000000001},"min":{"1min":0.73999999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4079999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.083}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.69699999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4390000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.252},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0129999999999999,"15min":1.0149999999999999},"min":{"1min":0.72399999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3200000000000001,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.056}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0720000000000001,"15min":1.1140000000000001},"min":{"1min":0.76800000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3120000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.175},{"interface":"front","average":{"1min":1.157,"5min":1.123,"15min":1.135},"min":{"1min":0.83699999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.522,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1519999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1249280,"data_stored":531181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.753},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83699999999999997,"15min":0.86899999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.091,"5min":1.431,"15min":1.431},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91400000000000003,"15min":0.92400000000000004},"min":{"1min":0.65300000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.087,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.876,"5min":0.90400000000000003,"15min":0.90900000000000003},"min":{"1min":0.60899999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.177,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.86599999999999999,"15min":0.90300000000000002},"min":{"1min":0.65200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92700000000000005,"15min":0.96899999999999997},"min":{"1min":0.59499999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4350000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.0089999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.94899999999999995,"15min":0.97399999999999998},"min":{"1min":0.64400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.157},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.022,"15min":1.044},"min":{"1min":0.84699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.139,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.90400000000000003,"15min":0.90800000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0229999999999999,"15min":1.0249999999999999},"min":{"1min":0.76300000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0049999999999999,"15min":1.0149999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.1950000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.0409999999999999,"15min":1.0640000000000001},"min":{"1min":0.74299999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.0369999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0980000000000001,"15min":1.1060000000000001},"min":{"1min":0.78700000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.099},{"interface":"front","average":{"1min":1.169,"5min":1.1599999999999999,"15min":1.1879999999999999},"min":{"1min":0.96499999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.9950000000000001,"5min":2.194,"15min":2.194},"last":1.1339999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34400,"kb_used_data":3284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337440,"statfs":{"total":96636764160,"available":96601538560,"internally_reserved":0,"allocated":3362816,"data_stored":2628340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.82899999999999996,"15min":0.85999999999999999},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.71},{"interface":"front","average":{"1min":0.874,"5min":0.85899999999999999,"15min":0.88100000000000001},"min":{"1min":0.64100000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.627}]},{"osd":1,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.93600000000000005,"15min":0.95299999999999996},"min":{"1min":0.67600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.133,"5min":1.508,"15min":1.508},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.751,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.24,"5min":1.482,"15min":1.482},"last":0.86699999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85799999999999998,"15min":0.85499999999999998},"min":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.8069999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.93000000000000005,"15min":0.92700000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.375,"5min":5.375,"15min":5.375},"last":5.375}]},{"osd":3,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96599999999999997,"15min":0.997},"min":{"1min":0.626,"5min":0.622,"15min":0.622},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":3.762},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.93200000000000005,"15min":0.93500000000000005},"min":{"1min":0.70999999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.329,"5min":1.603,"15min":1.603},"last":1.329}]},{"osd":4,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.006,"15min":1.054},"min":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.367,"5min":1.466,"15min":1.466},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.024,"5min":0.995,"15min":1.03},"min":{"1min":0.80500000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3759999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.141}]},{"osd":6,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0289999999999999,"15min":1.0620000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.244,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.091},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.123,"15min":1.177},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5660000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.5660000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.131},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.242,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.024},{"interface":"front","average":{"1min":1.234,"5min":1.171,"15min":1.206},"min":{"1min":0.76100000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":2.867}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32336,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1249280,"data_stored":531181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.56499999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.23,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82399999999999995,"15min":0.83599999999999997},"min":{"1min":0.48699999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.66100000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90200000000000002,"15min":0.90600000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2290000000000001,"5min":1.357,"15min":1.357},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93500000000000005,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.288,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.88400000000000001,"15min":0.88100000000000001},"min":{"1min":0.501,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.131,"5min":1.272,"15min":1.272},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.95899999999999996,"15min":0.92100000000000004},"min":{"1min":0.77100000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.252,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.079}]},{"osd":3,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.89300000000000002,"15min":0.91600000000000004},"min":{"1min":0.58799999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.371,"5min":1.464,"15min":1.464},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88900000000000001,"15min":0.88400000000000001},"min":{"1min":0.63700000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.161,"5min":1.353,"15min":1.353},"last":0.82999999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.94299999999999995,"15min":0.93899999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1830000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.069,"5min":1.075,"15min":1.0649999999999999},"min":{"1min":0.64500000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3540000000000001,"5min":1.478,"15min":1.478},"last":1.1779999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.749,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1679999999999999,"5min":1.26,"15min":1.26},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.079,"15min":1.0549999999999999},"min":{"1min":0.88,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.367,"5min":1.613,"15min":1.613},"last":1.1599999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.097,"15min":1.0900000000000001},"min":{"1min":0.82199999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.123,"15min":1.125},"min":{"1min":0.85799999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.331,"5min":2.032,"15min":2.032},"last":1.0069999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32348,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.022,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.44,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89500000000000002,"5min":1.081,"15min":1.081},"last":0.41699999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.629,"15min":0.64900000000000002},"min":{"1min":0.46200000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.90800000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.56899999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1140000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.498}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.71199999999999997},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96899999999999997,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72899999999999998,"15min":0.73799999999999999},"min":{"1min":0.443,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.443}]},{"osd":4,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.91500000000000004},"min":{"1min":0.64200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.014,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.92500000000000004,"15min":0.95399999999999996},"min":{"1min":0.64600000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3089999999999999,"5min":1.899,"15min":1.899},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90900000000000003,"15min":0.92700000000000005},"min":{"1min":0.77000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.381,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.97999999999999998,"15min":0.99099999999999999},"min":{"1min":0.75,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.25,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.81499999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.997,"15min":1.0169999999999999},"min":{"1min":0.72099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2130000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.018,"5min":1.01,"15min":1.038},"min":{"1min":0.68899999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.427,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0569999999999999,"15min":1.0840000000000001},"min":{"1min":0.77900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.282,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0349999999999999,"15min":1.0629999999999999},"min":{"1min":0.752,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.345,"5min":1.756,"15min":1.756},"last":0.86299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28252,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.61599999999999999,"15min":0.59499999999999997},"min":{"1min":0.47599999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60899999999999999,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93200000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58899999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.48799999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.214,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.78000000000000003,"15min":0.76800000000000002},"min":{"1min":0.56000000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.7140000000000004,"5min":4.7140000000000004,"15min":4.7140000000000004},"last":1.032}]},{"osd":4,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.71699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.133},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.70899999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.252,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.95799999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93600000000000005,"15min":0.95199999999999996},"min":{"1min":0.68400000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2450000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.66000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.2210000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.91400000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97899999999999998,"15min":0.97199999999999998},"min":{"1min":0.79700000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.169,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.948,"5min":1.1910000000000001,"15min":1.056},"min":{"1min":0.68700000000000006,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":21.474,"5min":21.474,"15min":21.474},"last":1.2250000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0209999999999999,"15min":1.0509999999999999},"min":{"1min":0.67600000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.292,"5min":1.506,"15min":1.506},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.024,"15min":1.0329999999999999},"min":{"1min":0.79300000000000004,"5min":0.625,"15min":0.625},"max":{"1min":1.2769999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.0649999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32344,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64600000000000002,"15min":0.66000000000000003},"min":{"1min":0.438,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82999999999999996,"5min":1.151,"15min":1.151},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.02,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.625,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.79200000000000004,"5min":1.306,"15min":1.306},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.39800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.008,"5min":1.28,"15min":1.28},"last":1.151}]},{"osd":3,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.139,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78100000000000003,"15min":0.81799999999999995},"min":{"1min":0.55900000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":1.905,"15min":1.905},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.71899999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.236,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.97199999999999998,"15min":1.0209999999999999},"min":{"1min":0.65400000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.181,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.119}]},{"osd":5,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.98499999999999999,"15min":1.0509999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1279999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0629999999999999,"15min":1.1040000000000001},"min":{"1min":0.80300000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.546,"5min":1.556,"15min":1.556},"last":1.5720000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.038,"15min":1.071},"min":{"1min":0.82399999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3009999999999999,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.458},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.077,"15min":1.125},"min":{"1min":0.73799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2470000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.3089999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1120000000000001,"15min":1.151},"min":{"1min":0.62,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6639999999999999,"5min":1.712,"15min":1.712},"last":1.659},{"interface":"front","average":{"1min":1.028,"5min":1.0700000000000001,"15min":1.093},"min":{"1min":0.79200000000000004,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3959999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.27}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1121560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.411,"5min":3.25,"15min":3.25},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.746,"15min":0.80000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93300000000000005,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.77000000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69399999999999995,"15min":0.72999999999999998},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.91600000000000004,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77800000000000002,"15min":0.86199999999999999},"min":{"1min":0.49399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.006,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.747,"15min":0.84099999999999997},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.073,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.85299999999999998,"15min":0.94099999999999995},"min":{"1min":0.48499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3149999999999999,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.627}]},{"osd":4,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.93899999999999995,"15min":1.0089999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.379,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.093,"5min":1.0289999999999999,"15min":1.0569999999999999},"min":{"1min":0.76700000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.1150000000000002,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.004,"15min":1.0620000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3129999999999999,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.016,"15min":1.093},"min":{"1min":0.63600000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.2450000000000001,"5min":5.399,"15min":5.399},"last":1.048}]},{"osd":6,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1040000000000001,"15min":1.1479999999999999},"min":{"1min":0.68700000000000006,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.0390000000000001,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.878},{"interface":"front","average":{"1min":0.997,"5min":1.056,"15min":1.1060000000000001},"min":{"1min":0.77800000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2649999999999999,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.89600000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.087,"15min":1.1220000000000001},"min":{"1min":0.74099999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2789999999999999,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.006},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1120000000000001,"15min":1.2},"min":{"1min":0.72599999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3149999999999999,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":1.0900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:10:52.858 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:10:52.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.964+0000 7f3c9649e700 1 Processor -- start 2024-09-13T17:10:52.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.964+0000 7f3c9649e700 1 -- start start 2024-09-13T17:10:52.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9649e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3c901602d0 0x7f3c900d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9649e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c900d0ea0 con 0x7f3c900cf920 2024-09-13T17:10:52.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9649e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c900d0c70 con 0x7f3c900d3680 2024-09-13T17:10:52.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9649e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c900ceab0 con 0x7f3c901602d0 2024-09-13T17:10:52.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c95c9d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3c900cf920 0x7f3c900b59b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53416/0 (socket says 172.21.15.123:53416) 2024-09-13T17:10:52.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c95c9d700 1 -- 172.21.15.123:0/3928759636 learned_addr learned my addr 172.21.15.123:0/3928759636 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:52.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9549c700 1 --2- 172.21.15.123:0/3928759636 >> v2:172.21.15.153:3300/0 conn(0x7f3c901602d0 0x7f3c900d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c87fff700 1 -- 172.21.15.123:0/3928759636 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318853423 0 0) 0x7f3c900d0ea0 con 0x7f3c900cf920 2024-09-13T17:10:52.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c87fff700 1 -- 172.21.15.123:0/3928759636 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c7c0035d0 con 0x7f3c900cf920 2024-09-13T17:10:52.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9549c700 1 -- 172.21.15.123:0/3928759636 >> v1:172.21.15.153:6789/0 conn(0x7f3c900d3680 legacy=0x7f3c900cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9549c700 1 -- 172.21.15.123:0/3928759636 >> v1:172.21.15.123:6789/0 conn(0x7f3c900cf920 legacy=0x7f3c900b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9549c700 1 -- 172.21.15.123:0/3928759636 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c900cff00 con 0x7f3c901602d0 2024-09-13T17:10:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9549c700 1 --2- 172.21.15.123:0/3928759636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c901602d0 0x7f3c900d0730 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009880 tx=0x7f3c8c009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f81c556237ec0e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c87fff700 1 -- 172.21.15.123:0/3928759636 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c011830 con 0x7f3c901602d0 2024-09-13T17:10:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c87fff700 1 -- 172.21.15.123:0/3928759636 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c011990 con 0x7f3c901602d0 2024-09-13T17:10:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c87fff700 1 -- 172.21.15.123:0/3928759636 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c011d00 con 0x7f3c901602d0 2024-09-13T17:10:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9649e700 1 -- 172.21.15.123:0/3928759636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c901602d0 msgr2=0x7f3c900d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9649e700 1 --2- 172.21.15.123:0/3928759636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c901602d0 0x7f3c900d0730 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009880 tx=0x7f3c8c009b90 comp rx=0 tx=0).stop 2024-09-13T17:10:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9649e700 1 -- 172.21.15.123:0/3928759636 shutdown_connections 2024-09-13T17:10:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9649e700 1 --2- 172.21.15.123:0/3928759636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c901602d0 0x7f3c900d0730 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9649e700 1 -- 172.21.15.123:0/3928759636 >> 172.21.15.123:0/3928759636 conn(0x7f3c900d2b60 msgr2=0x7f3c900d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9649e700 1 -- 172.21.15.123:0/3928759636 shutdown_connections 2024-09-13T17:10:52.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.968+0000 7f3c9649e700 1 -- 172.21.15.123:0/3928759636 wait complete. 2024-09-13T17:10:52.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c9649e700 1 Processor -- start 2024-09-13T17:10:52.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c9649e700 1 -- start start 2024-09-13T17:10:52.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c9649e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c900cf920 0x7f3c90158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c9649e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c900d3680 0x7f3c900cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c9649e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c901602d0 0x7f3c900cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c9649e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c900cc850 con 0x7f3c901602d0 2024-09-13T17:10:52.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c9649e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90158670 con 0x7f3c900cf920 2024-09-13T17:10:52.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c9649e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c900b1b00 con 0x7f3c900d3680 2024-09-13T17:10:52.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c9549c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c900cf920 0x7f3c90158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c95c9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c901602d0 0x7f3c900cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c9549c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c900cf920 0x7f3c90158130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:45648/0 (socket says 172.21.15.123:45648) 2024-09-13T17:10:52.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c9549c700 1 -- 172.21.15.123:0/2689812670 learned_addr learned my addr 172.21.15.123:0/2689812670 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:52.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c94c9b700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c900d3680 0x7f3c900cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c95c9d700 1 -- 172.21.15.123:0/2689812670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c900d3680 msgr2=0x7f3c900cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c95c9d700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c900d3680 0x7f3c900cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c95c9d700 1 -- 172.21.15.123:0/2689812670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c900cf920 msgr2=0x7f3c90158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c95c9d700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c900cf920 0x7f3c90158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c95c9d700 1 -- 172.21.15.123:0/2689812670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c0094b0 con 0x7f3c901602d0 2024-09-13T17:10:52.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c9549c700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c900cf920 0x7f3c90158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:52.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c94c9b700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c900d3680 0x7f3c900cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:52.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c95c9d700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c901602d0 0x7f3c900cbf10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800ca80 tx=0x7f3c8800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:52.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c85ffb700 1 -- 172.21.15.123:0/2689812670 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88007480 con 0x7f3c901602d0 2024-09-13T17:10:52.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c85ffb700 1 -- 172.21.15.123:0/2689812670 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c880075e0 con 0x7f3c901602d0 2024-09-13T17:10:52.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c9649e700 1 -- 172.21.15.123:0/2689812670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c900b1de0 con 0x7f3c901602d0 2024-09-13T17:10:52.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c85ffb700 1 -- 172.21.15.123:0/2689812670 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88007950 con 0x7f3c901602d0 2024-09-13T17:10:52.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.972+0000 7f3c9649e700 1 -- 172.21.15.123:0/2689812670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c900b23a0 con 0x7f3c901602d0 2024-09-13T17:10:52.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.976+0000 7f3c9649e700 1 -- 172.21.15.123:0/2689812670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c900d0390 con 0x7f3c901602d0 2024-09-13T17:10:52.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.976+0000 7f3c85ffb700 1 -- 172.21.15.123:0/2689812670 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3c8801b3b0 con 0x7f3c901602d0 2024-09-13T17:10:52.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.976+0000 7f3c85ffb700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3c74066730 0x7f3c74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.976+0000 7f3c9549c700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3c74066730 0x7f3c74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.976+0000 7f3c85ffb700 1 -- 172.21.15.123:0/2689812670 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3c880836a0 con 0x7f3c901602d0 2024-09-13T17:10:52.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.976+0000 7f3c9549c700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3c74066730 0x7f3c74068bf0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009fd0 tx=0x7f3c8c01c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:52.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:52.984+0000 7f3c85ffb700 1 -- 172.21.15.123:0/2689812670 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3c88050dc0 con 0x7f3c901602d0 2024-09-13T17:10:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.148+0000 7f3c9649e700 1 -- 172.21.15.123:0/2689812670 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c900b3d70 con 0x7f3c74066730 2024-09-13T17:10:53.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.152+0000 7f3c85ffb700 1 -- 172.21.15.123:0/2689812670 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49405 (secure 0 0 0) 0x7f3c8c0117b0 con 0x7f3c74066730 2024-09-13T17:10:53.157 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:53.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.156+0000 7f3c9649e700 1 -- 172.21.15.123:0/2689812670 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3c74066730 msgr2=0x7f3c74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:53.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.156+0000 7f3c9649e700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3c74066730 0x7f3c74068bf0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009fd0 tx=0x7f3c8c01c040 comp rx=0 tx=0).stop 2024-09-13T17:10:53.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.156+0000 7f3c9649e700 1 -- 172.21.15.123:0/2689812670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c901602d0 msgr2=0x7f3c900cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:53.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.156+0000 7f3c9649e700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c901602d0 0x7f3c900cbf10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800ca80 tx=0x7f3c8800cab0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.156+0000 7f3c9649e700 1 -- 172.21.15.123:0/2689812670 shutdown_connections 2024-09-13T17:10:53.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.156+0000 7f3c9649e700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3c74066730 0x7f3c74068bf0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.156+0000 7f3c9649e700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c901602d0 0x7f3c900cbf10 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.156+0000 7f3c9649e700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3c900d3680 0x7f3c900cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.156+0000 7f3c9649e700 1 --2- 172.21.15.123:0/2689812670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c900cf920 0x7f3c90158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.156+0000 7f3c9649e700 1 -- 172.21.15.123:0/2689812670 >> 172.21.15.123:0/2689812670 conn(0x7f3c900d2b60 msgr2=0x7f3c90070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:53.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.156+0000 7f3c9649e700 1 -- 172.21.15.123:0/2689812670 shutdown_connections 2024-09-13T17:10:53.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.156+0000 7f3c9649e700 1 -- 172.21.15.123:0/2689812670 wait complete. 2024-09-13T17:10:53.161 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:10:53.173 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-09-13T17:10:52.808833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":255848,"kb_used_data":15100,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754718872,"statfs":{"total":773094113280,"available":772832124928,"internally_reserved":0,"allocated":15462400,"data_stored":9641196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2327480,"num_objects":-47,"num_object_clones":0,"num_object_copies":-94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-214,"num_write_kb":-22851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":247,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T17:10:49.936852+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:10:49.936852+0000","last_peered":"2024-09-13T17:10:49.936852+0000","last_clean":"2024-09-13T17:10:49.936852+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:10:49.936852+0000","last_undegraded":"2024-09-13T17:10:49.936852+0000","last_fullsized":"2024-09-13T17:10:49.936852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34976,"kb_used_data":3860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94336864,"statfs":{"total":96636764160,"available":96600948736,"internally_reserved":0,"allocated":3952640,"data_stored":3218705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.57699999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0920000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.63},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.89600000000000002},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.129,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.117}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.90500000000000003,"15min":0.92100000000000004},"min":{"1min":0.52000000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2070000000000001,"5min":1.456,"15min":1.456},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.54000000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.101,"5min":1.609,"15min":1.609},"last":0.96499999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.85899999999999999,"15min":0.86099999999999999},"min":{"1min":0.59599999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.22,"5min":1.238,"15min":1.238},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.96999999999999997,"15min":0.999},"min":{"1min":0.60399999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1739999999999999,"5min":1.839,"15min":1.839},"last":1.2030000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.92700000000000005,"15min":0.92000000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3440000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96099999999999997,"15min":0.99099999999999999},"min":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1499999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2989999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90400000000000003,"15min":0.90200000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.0900000000000001,"15min":1.1140000000000001},"min":{"1min":0.73999999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4079999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.083}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.69699999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4390000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.252},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0129999999999999,"15min":1.0149999999999999},"min":{"1min":0.72399999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3200000000000001,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.056}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0720000000000001,"15min":1.1140000000000001},"min":{"1min":0.76800000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3120000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.175},{"interface":"front","average":{"1min":1.157,"5min":1.123,"15min":1.135},"min":{"1min":0.83699999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.522,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1519999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1249280,"data_stored":531181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.753},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83699999999999997,"15min":0.86899999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.091,"5min":1.431,"15min":1.431},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91400000000000003,"15min":0.92400000000000004},"min":{"1min":0.65300000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.087,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.876,"5min":0.90400000000000003,"15min":0.90900000000000003},"min":{"1min":0.60899999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.177,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.86599999999999999,"15min":0.90300000000000002},"min":{"1min":0.65200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92700000000000005,"15min":0.96899999999999997},"min":{"1min":0.59499999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4350000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.0089999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.94899999999999995,"15min":0.97399999999999998},"min":{"1min":0.64400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.157},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.022,"15min":1.044},"min":{"1min":0.84699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.139,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.90400000000000003,"15min":0.90800000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0229999999999999,"15min":1.0249999999999999},"min":{"1min":0.76300000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0049999999999999,"15min":1.0149999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.1950000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.0409999999999999,"15min":1.0640000000000001},"min":{"1min":0.74299999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.0369999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0980000000000001,"15min":1.1060000000000001},"min":{"1min":0.78700000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.099},{"interface":"front","average":{"1min":1.169,"5min":1.1599999999999999,"15min":1.1879999999999999},"min":{"1min":0.96499999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.9950000000000001,"5min":2.194,"15min":2.194},"last":1.1339999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34400,"kb_used_data":3284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337440,"statfs":{"total":96636764160,"available":96601538560,"internally_reserved":0,"allocated":3362816,"data_stored":2628340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.82899999999999996,"15min":0.85999999999999999},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.71},{"interface":"front","average":{"1min":0.874,"5min":0.85899999999999999,"15min":0.88100000000000001},"min":{"1min":0.64100000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.627}]},{"osd":1,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.93600000000000005,"15min":0.95299999999999996},"min":{"1min":0.67600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.133,"5min":1.508,"15min":1.508},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.751,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.24,"5min":1.482,"15min":1.482},"last":0.86699999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85799999999999998,"15min":0.85499999999999998},"min":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.8069999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.93000000000000005,"15min":0.92700000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.375,"5min":5.375,"15min":5.375},"last":5.375}]},{"osd":3,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96599999999999997,"15min":0.997},"min":{"1min":0.626,"5min":0.622,"15min":0.622},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":3.762},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.93200000000000005,"15min":0.93500000000000005},"min":{"1min":0.70999999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.329,"5min":1.603,"15min":1.603},"last":1.329}]},{"osd":4,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.006,"15min":1.054},"min":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.367,"5min":1.466,"15min":1.466},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.024,"5min":0.995,"15min":1.03},"min":{"1min":0.80500000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3759999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.141}]},{"osd":6,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0289999999999999,"15min":1.0620000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.244,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.091},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.123,"15min":1.177},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5660000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.5660000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.131},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.242,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.024},{"interface":"front","average":{"1min":1.234,"5min":1.171,"15min":1.206},"min":{"1min":0.76100000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":2.867}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32336,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1249280,"data_stored":531181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.56499999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.23,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82399999999999995,"15min":0.83599999999999997},"min":{"1min":0.48699999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.66100000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90200000000000002,"15min":0.90600000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2290000000000001,"5min":1.357,"15min":1.357},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93500000000000005,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.288,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.88400000000000001,"15min":0.88100000000000001},"min":{"1min":0.501,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.131,"5min":1.272,"15min":1.272},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.95899999999999996,"15min":0.92100000000000004},"min":{"1min":0.77100000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.252,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.079}]},{"osd":3,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.89300000000000002,"15min":0.91600000000000004},"min":{"1min":0.58799999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.371,"5min":1.464,"15min":1.464},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88900000000000001,"15min":0.88400000000000001},"min":{"1min":0.63700000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.161,"5min":1.353,"15min":1.353},"last":0.82999999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.94299999999999995,"15min":0.93899999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1830000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.069,"5min":1.075,"15min":1.0649999999999999},"min":{"1min":0.64500000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3540000000000001,"5min":1.478,"15min":1.478},"last":1.1779999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.749,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1679999999999999,"5min":1.26,"15min":1.26},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.079,"15min":1.0549999999999999},"min":{"1min":0.88,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.367,"5min":1.613,"15min":1.613},"last":1.1599999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.097,"15min":1.0900000000000001},"min":{"1min":0.82199999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.123,"15min":1.125},"min":{"1min":0.85799999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.331,"5min":2.032,"15min":2.032},"last":1.0069999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32348,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.022,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.44,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89500000000000002,"5min":1.081,"15min":1.081},"last":0.41699999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.629,"15min":0.64900000000000002},"min":{"1min":0.46200000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.90800000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.56899999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1140000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.498}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.71199999999999997},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96899999999999997,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72899999999999998,"15min":0.73799999999999999},"min":{"1min":0.443,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.443}]},{"osd":4,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.91500000000000004},"min":{"1min":0.64200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.014,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.92500000000000004,"15min":0.95399999999999996},"min":{"1min":0.64600000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3089999999999999,"5min":1.899,"15min":1.899},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90900000000000003,"15min":0.92700000000000005},"min":{"1min":0.77000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.381,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.97999999999999998,"15min":0.99099999999999999},"min":{"1min":0.75,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.25,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.81499999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.997,"15min":1.0169999999999999},"min":{"1min":0.72099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2130000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.018,"5min":1.01,"15min":1.038},"min":{"1min":0.68899999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.427,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0569999999999999,"15min":1.0840000000000001},"min":{"1min":0.77900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.282,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0349999999999999,"15min":1.0629999999999999},"min":{"1min":0.752,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.345,"5min":1.756,"15min":1.756},"last":0.86299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28252,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.61599999999999999,"15min":0.59499999999999997},"min":{"1min":0.47599999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60899999999999999,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93200000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58899999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.48799999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.214,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.78000000000000003,"15min":0.76800000000000002},"min":{"1min":0.56000000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.7140000000000004,"5min":4.7140000000000004,"15min":4.7140000000000004},"last":1.032}]},{"osd":4,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.71699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.133},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.70899999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.252,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.95799999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93600000000000005,"15min":0.95199999999999996},"min":{"1min":0.68400000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2450000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.66000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.2210000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.91400000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97899999999999998,"15min":0.97199999999999998},"min":{"1min":0.79700000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.169,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.948,"5min":1.1910000000000001,"15min":1.056},"min":{"1min":0.68700000000000006,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":21.474,"5min":21.474,"15min":21.474},"last":1.2250000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0209999999999999,"15min":1.0509999999999999},"min":{"1min":0.67600000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.292,"5min":1.506,"15min":1.506},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.024,"15min":1.0329999999999999},"min":{"1min":0.79300000000000004,"5min":0.625,"15min":0.625},"max":{"1min":1.2769999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.0649999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32344,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64600000000000002,"15min":0.66000000000000003},"min":{"1min":0.438,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82999999999999996,"5min":1.151,"15min":1.151},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.02,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.625,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.79200000000000004,"5min":1.306,"15min":1.306},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.39800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.008,"5min":1.28,"15min":1.28},"last":1.151}]},{"osd":3,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.139,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78100000000000003,"15min":0.81799999999999995},"min":{"1min":0.55900000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":1.905,"15min":1.905},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.71899999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.236,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.97199999999999998,"15min":1.0209999999999999},"min":{"1min":0.65400000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.181,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.119}]},{"osd":5,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.98499999999999999,"15min":1.0509999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1279999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0629999999999999,"15min":1.1040000000000001},"min":{"1min":0.80300000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.546,"5min":1.556,"15min":1.556},"last":1.5720000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.038,"15min":1.071},"min":{"1min":0.82399999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3009999999999999,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.458},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.077,"15min":1.125},"min":{"1min":0.73799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2470000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.3089999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1120000000000001,"15min":1.151},"min":{"1min":0.62,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6639999999999999,"5min":1.712,"15min":1.712},"last":1.659},{"interface":"front","average":{"1min":1.028,"5min":1.0700000000000001,"15min":1.093},"min":{"1min":0.79200000000000004,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3959999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.27}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1121560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.411,"5min":3.25,"15min":3.25},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.746,"15min":0.80000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93300000000000005,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.77000000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69399999999999995,"15min":0.72999999999999998},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.91600000000000004,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77800000000000002,"15min":0.86199999999999999},"min":{"1min":0.49399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.006,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.747,"15min":0.84099999999999997},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.073,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.85299999999999998,"15min":0.94099999999999995},"min":{"1min":0.48499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3149999999999999,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.627}]},{"osd":4,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.93899999999999995,"15min":1.0089999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.379,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.093,"5min":1.0289999999999999,"15min":1.0569999999999999},"min":{"1min":0.76700000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.1150000000000002,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.004,"15min":1.0620000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3129999999999999,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.016,"15min":1.093},"min":{"1min":0.63600000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.2450000000000001,"5min":5.399,"15min":5.399},"last":1.048}]},{"osd":6,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1040000000000001,"15min":1.1479999999999999},"min":{"1min":0.68700000000000006,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.0390000000000001,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.878},{"interface":"front","average":{"1min":0.997,"5min":1.056,"15min":1.1060000000000001},"min":{"1min":0.77800000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2649999999999999,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.89600000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.087,"15min":1.1220000000000001},"min":{"1min":0.74099999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2789999999999999,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.006},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1120000000000001,"15min":1.2},"min":{"1min":0.72599999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3149999999999999,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":1.0900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:10:53.175 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T17:10:53.175 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:10:53.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a8c88700 1 Processor -- start 2024-09-13T17:10:53.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a8c88700 1 -- start start 2024-09-13T17:10:53.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a8c88700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe2a40cec90 0x7fe2a40cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:53.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a8c88700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe2a406c050 0x7fe2a406c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:53.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a8c88700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a40cf600 con 0x7fe2a4160fb0 2024-09-13T17:10:53.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a8c88700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a406cd60 con 0x7fe2a406c050 2024-09-13T17:10:53.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a8c88700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a406d040 con 0x7fe2a40cec90 2024-09-13T17:10:53.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a259c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe2a4160fb0 0x7fe2a406de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53430/0 (socket says 172.21.15.123:53430) 2024-09-13T17:10:53.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a259c700 1 -- 172.21.15.123:0/3746613968 learned_addr learned my addr 172.21.15.123:0/3746613968 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:53.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a2d9d700 1 --2- 172.21.15.123:0/3746613968 >> v2:172.21.15.123:3300/0 conn(0x7fe2a406c050 0x7fe2a406c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:53.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe299d9b700 1 --2- 172.21.15.123:0/3746613968 >> v2:172.21.15.153:3300/0 conn(0x7fe2a40cec90 0x7fe2a40cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:53.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a1d9b700 1 -- 172.21.15.123:0/3746613968 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217637076 0 0) 0x7fe2a40cf600 con 0x7fe2a4160fb0 2024-09-13T17:10:53.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a1d9b700 1 -- 172.21.15.123:0/3746613968 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2900035d0 con 0x7fe2a4160fb0 2024-09-13T17:10:53.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a2d9d700 1 -- 172.21.15.123:0/3746613968 >> v2:172.21.15.153:3300/0 conn(0x7fe2a40cec90 msgr2=0x7fe2a40cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:53.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a2d9d700 1 --2- 172.21.15.123:0/3746613968 >> v2:172.21.15.153:3300/0 conn(0x7fe2a40cec90 0x7fe2a40cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a2d9d700 1 -- 172.21.15.123:0/3746613968 >> v1:172.21.15.123:6789/0 conn(0x7fe2a4160fb0 legacy=0x7fe2a406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:53.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a2d9d700 1 -- 172.21.15.123:0/3746613968 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a406d320 con 0x7fe2a406c050 2024-09-13T17:10:53.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a2d9d700 1 --2- 172.21.15.123:0/3746613968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2a406c050 0x7fe2a406c4c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe2a406a370 tx=0x7fe29c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f1d7b07b4a6f43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:53.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a1d9b700 1 -- 172.21.15.123:0/3746613968 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c00e070 con 0x7fe2a406c050 2024-09-13T17:10:53.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a1d9b700 1 -- 172.21.15.123:0/3746613968 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c00bb20 con 0x7fe2a406c050 2024-09-13T17:10:53.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a1d9b700 1 -- 172.21.15.123:0/3746613968 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c012430 con 0x7fe2a406c050 2024-09-13T17:10:53.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a8c88700 1 -- 172.21.15.123:0/3746613968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2a406c050 msgr2=0x7fe2a406c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:53.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a8c88700 1 --2- 172.21.15.123:0/3746613968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2a406c050 0x7fe2a406c4c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe2a406a370 tx=0x7fe29c00b330 comp rx=0 tx=0).stop 2024-09-13T17:10:53.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a8c88700 1 -- 172.21.15.123:0/3746613968 shutdown_connections 2024-09-13T17:10:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a8c88700 1 --2- 172.21.15.123:0/3746613968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2a406c050 0x7fe2a406c4c0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a8c88700 1 --2- 172.21.15.123:0/3746613968 >> v2:172.21.15.153:3300/0 conn(0x7fe2a40cec90 0x7fe2a40cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.284+0000 7fe2a8c88700 1 -- 172.21.15.123:0/3746613968 >> 172.21.15.123:0/3746613968 conn(0x7fe2a4066570 msgr2=0x7fe2a4066980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.288+0000 7fe2a8c88700 1 -- 172.21.15.123:0/3746613968 shutdown_connections 2024-09-13T17:10:53.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.288+0000 7fe2a8c88700 1 -- 172.21.15.123:0/3746613968 wait complete. 2024-09-13T17:10:53.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.288+0000 7fe2a8c88700 1 Processor -- start 2024-09-13T17:10:53.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.288+0000 7fe2a8c88700 1 -- start start 2024-09-13T17:10:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.288+0000 7fe2a8c88700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2a406c050 0x7fe2a4147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.288+0000 7fe2a8c88700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2a40cec90 0x7fe2a41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a8c88700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2a4160fb0 0x7fe2a4157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a8c88700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a4150310 con 0x7fe2a406c050 2024-09-13T17:10:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a8c88700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a414f700 con 0x7fe2a40cec90 2024-09-13T17:10:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a8c88700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a414f9e0 con 0x7fe2a4160fb0 2024-09-13T17:10:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2a406c050 0x7fe2a4147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2a406c050 0x7fe2a4147b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57916/0 (socket says 172.21.15.123:57916) 2024-09-13T17:10:53.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a259c700 1 -- 172.21.15.123:0/2403878948 learned_addr learned my addr 172.21.15.123:0/2403878948 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:53.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a2d9d700 1 --2- 172.21.15.123:0/2403878948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2a4160fb0 0x7fe2a4157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:53.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe299d9b700 1 --2- 172.21.15.123:0/2403878948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2a40cec90 0x7fe2a41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a259c700 1 -- 172.21.15.123:0/2403878948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2a4160fb0 msgr2=0x7fe2a4157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a259c700 1 --2- 172.21.15.123:0/2403878948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2a4160fb0 0x7fe2a4157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a259c700 1 -- 172.21.15.123:0/2403878948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2a40cec90 msgr2=0x7fe2a41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a259c700 1 --2- 172.21.15.123:0/2403878948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2a40cec90 0x7fe2a41594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a259c700 1 -- 172.21.15.123:0/2403878948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c009a70 con 0x7fe2a406c050 2024-09-13T17:10:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a259c700 1 --2- 172.21.15.123:0/2403878948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2a406c050 0x7fe2a4147b40 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe29400c4d0 tx=0x7fe29400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe29b7fe700 1 -- 172.21.15.123:0/2403878948 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe294005d90 con 0x7fe2a406c050 2024-09-13T17:10:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe29b7fe700 1 -- 172.21.15.123:0/2403878948 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2940070d0 con 0x7fe2a406c050 2024-09-13T17:10:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a8c88700 1 -- 172.21.15.123:0/2403878948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a414fcc0 con 0x7fe2a406c050 2024-09-13T17:10:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe29b7fe700 1 -- 172.21.15.123:0/2403878948 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe294007480 con 0x7fe2a406c050 2024-09-13T17:10:53.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a8c88700 1 -- 172.21.15.123:0/2403878948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a414dde0 con 0x7fe2a406c050 2024-09-13T17:10:53.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe2a8c88700 1 -- 172.21.15.123:0/2403878948 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a406c4c0 con 0x7fe2a406c050 2024-09-13T17:10:53.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.292+0000 7fe29b7fe700 1 -- 172.21.15.123:0/2403878948 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2940075e0 con 0x7fe2a406c050 2024-09-13T17:10:53.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.296+0000 7fe29b7fe700 1 --2- 172.21.15.123:0/2403878948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe284066730 0x7fe284068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:53.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.296+0000 7fe299d9b700 1 --2- 172.21.15.123:0/2403878948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe284066730 0x7fe284068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:53.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.296+0000 7fe29b7fe700 1 -- 172.21.15.123:0/2403878948 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe294083290 con 0x7fe2a406c050 2024-09-13T17:10:53.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.296+0000 7fe299d9b700 1 --2- 172.21.15.123:0/2403878948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe284066730 0x7fe284068bf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe2a414f110 tx=0x7fe28c009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:53.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.300+0000 7fe29b7fe700 1 -- 172.21.15.123:0/2403878948 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe2940508f0 con 0x7fe2a406c050 2024-09-13T17:10:53.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.472+0000 7fe2a8c88700 1 -- 172.21.15.123:0/2403878948 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2a406ca00 con 0x7fe284066730 2024-09-13T17:10:53.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.472+0000 7fe29b7fe700 1 -- 172.21.15.123:0/2403878948 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49405 (secure 0 0 0) 0x7fe28c011810 con 0x7fe284066730 2024-09-13T17:10:53.477 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:53.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.476+0000 7fe2a8c88700 1 -- 172.21.15.123:0/2403878948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe284066730 msgr2=0x7fe284068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:53.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.476+0000 7fe2a8c88700 1 --2- 172.21.15.123:0/2403878948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe284066730 0x7fe284068bf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe2a414f110 tx=0x7fe28c009240 comp rx=0 tx=0).stop 2024-09-13T17:10:53.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.476+0000 7fe2a8c88700 1 -- 172.21.15.123:0/2403878948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2a406c050 msgr2=0x7fe2a4147b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:53.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.476+0000 7fe2a8c88700 1 --2- 172.21.15.123:0/2403878948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2a406c050 0x7fe2a4147b40 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe29400c4d0 tx=0x7fe29400c7e0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.476+0000 7fe2a8c88700 1 -- 172.21.15.123:0/2403878948 shutdown_connections 2024-09-13T17:10:53.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.476+0000 7fe2a8c88700 1 --2- 172.21.15.123:0/2403878948 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe284066730 0x7fe284068bf0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.476+0000 7fe2a8c88700 1 --2- 172.21.15.123:0/2403878948 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2a4160fb0 0x7fe2a4157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.476+0000 7fe2a8c88700 1 --2- 172.21.15.123:0/2403878948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2a40cec90 0x7fe2a41594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.476+0000 7fe2a8c88700 1 --2- 172.21.15.123:0/2403878948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2a406c050 0x7fe2a4147b40 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.476+0000 7fe2a8c88700 1 -- 172.21.15.123:0/2403878948 >> 172.21.15.123:0/2403878948 conn(0x7fe2a4066570 msgr2=0x7fe2a415c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:53.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.476+0000 7fe2a8c88700 1 -- 172.21.15.123:0/2403878948 shutdown_connections 2024-09-13T17:10:53.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.476+0000 7fe2a8c88700 1 -- 172.21.15.123:0/2403878948 wait complete. 2024-09-13T17:10:53.481 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:10:53.491 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-09-13T17:10:52.808833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":255848,"kb_used_data":15100,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754718872,"statfs":{"total":773094113280,"available":772832124928,"internally_reserved":0,"allocated":15462400,"data_stored":9641196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2327480,"num_objects":-47,"num_object_clones":0,"num_object_copies":-94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-214,"num_write_kb":-22851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":247,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T17:10:49.936852+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:10:49.936852+0000","last_peered":"2024-09-13T17:10:49.936852+0000","last_clean":"2024-09-13T17:10:49.936852+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:10:49.936852+0000","last_undegraded":"2024-09-13T17:10:49.936852+0000","last_fullsized":"2024-09-13T17:10:49.936852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34976,"kb_used_data":3860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94336864,"statfs":{"total":96636764160,"available":96600948736,"internally_reserved":0,"allocated":3952640,"data_stored":3218705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.57699999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0920000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.63},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.89600000000000002},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.129,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.117}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.90500000000000003,"15min":0.92100000000000004},"min":{"1min":0.52000000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2070000000000001,"5min":1.456,"15min":1.456},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.54000000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.101,"5min":1.609,"15min":1.609},"last":0.96499999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.85899999999999999,"15min":0.86099999999999999},"min":{"1min":0.59599999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.22,"5min":1.238,"15min":1.238},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.96999999999999997,"15min":0.999},"min":{"1min":0.60399999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1739999999999999,"5min":1.839,"15min":1.839},"last":1.2030000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.92700000000000005,"15min":0.92000000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3440000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96099999999999997,"15min":0.99099999999999999},"min":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1499999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2989999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90400000000000003,"15min":0.90200000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.0900000000000001,"15min":1.1140000000000001},"min":{"1min":0.73999999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4079999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.083}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.69699999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4390000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.252},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0129999999999999,"15min":1.0149999999999999},"min":{"1min":0.72399999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3200000000000001,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.056}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0720000000000001,"15min":1.1140000000000001},"min":{"1min":0.76800000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3120000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.175},{"interface":"front","average":{"1min":1.157,"5min":1.123,"15min":1.135},"min":{"1min":0.83699999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.522,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1519999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1249280,"data_stored":531181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.753},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83699999999999997,"15min":0.86899999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.091,"5min":1.431,"15min":1.431},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91400000000000003,"15min":0.92400000000000004},"min":{"1min":0.65300000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.087,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.876,"5min":0.90400000000000003,"15min":0.90900000000000003},"min":{"1min":0.60899999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.177,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.86599999999999999,"15min":0.90300000000000002},"min":{"1min":0.65200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92700000000000005,"15min":0.96899999999999997},"min":{"1min":0.59499999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4350000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.0089999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.94899999999999995,"15min":0.97399999999999998},"min":{"1min":0.64400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.157},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.022,"15min":1.044},"min":{"1min":0.84699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.139,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.90400000000000003,"15min":0.90800000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0229999999999999,"15min":1.0249999999999999},"min":{"1min":0.76300000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0049999999999999,"15min":1.0149999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.1950000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.0409999999999999,"15min":1.0640000000000001},"min":{"1min":0.74299999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.0369999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0980000000000001,"15min":1.1060000000000001},"min":{"1min":0.78700000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.099},{"interface":"front","average":{"1min":1.169,"5min":1.1599999999999999,"15min":1.1879999999999999},"min":{"1min":0.96499999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.9950000000000001,"5min":2.194,"15min":2.194},"last":1.1339999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34400,"kb_used_data":3284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337440,"statfs":{"total":96636764160,"available":96601538560,"internally_reserved":0,"allocated":3362816,"data_stored":2628340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.82899999999999996,"15min":0.85999999999999999},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.71},{"interface":"front","average":{"1min":0.874,"5min":0.85899999999999999,"15min":0.88100000000000001},"min":{"1min":0.64100000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.627}]},{"osd":1,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.93600000000000005,"15min":0.95299999999999996},"min":{"1min":0.67600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.133,"5min":1.508,"15min":1.508},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.751,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.24,"5min":1.482,"15min":1.482},"last":0.86699999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85799999999999998,"15min":0.85499999999999998},"min":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.8069999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.93000000000000005,"15min":0.92700000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.375,"5min":5.375,"15min":5.375},"last":5.375}]},{"osd":3,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96599999999999997,"15min":0.997},"min":{"1min":0.626,"5min":0.622,"15min":0.622},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":3.762},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.93200000000000005,"15min":0.93500000000000005},"min":{"1min":0.70999999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.329,"5min":1.603,"15min":1.603},"last":1.329}]},{"osd":4,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.006,"15min":1.054},"min":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.367,"5min":1.466,"15min":1.466},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.024,"5min":0.995,"15min":1.03},"min":{"1min":0.80500000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3759999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.141}]},{"osd":6,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0289999999999999,"15min":1.0620000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.244,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.091},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.123,"15min":1.177},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5660000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.5660000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.131},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.242,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.024},{"interface":"front","average":{"1min":1.234,"5min":1.171,"15min":1.206},"min":{"1min":0.76100000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":2.867}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32336,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1249280,"data_stored":531181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.56499999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.23,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82399999999999995,"15min":0.83599999999999997},"min":{"1min":0.48699999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.66100000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90200000000000002,"15min":0.90600000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2290000000000001,"5min":1.357,"15min":1.357},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93500000000000005,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.288,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.88400000000000001,"15min":0.88100000000000001},"min":{"1min":0.501,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.131,"5min":1.272,"15min":1.272},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.95899999999999996,"15min":0.92100000000000004},"min":{"1min":0.77100000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.252,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.079}]},{"osd":3,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.89300000000000002,"15min":0.91600000000000004},"min":{"1min":0.58799999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.371,"5min":1.464,"15min":1.464},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88900000000000001,"15min":0.88400000000000001},"min":{"1min":0.63700000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.161,"5min":1.353,"15min":1.353},"last":0.82999999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.94299999999999995,"15min":0.93899999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1830000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.069,"5min":1.075,"15min":1.0649999999999999},"min":{"1min":0.64500000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3540000000000001,"5min":1.478,"15min":1.478},"last":1.1779999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.749,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1679999999999999,"5min":1.26,"15min":1.26},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.079,"15min":1.0549999999999999},"min":{"1min":0.88,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.367,"5min":1.613,"15min":1.613},"last":1.1599999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.097,"15min":1.0900000000000001},"min":{"1min":0.82199999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.123,"15min":1.125},"min":{"1min":0.85799999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.331,"5min":2.032,"15min":2.032},"last":1.0069999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32348,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.022,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.44,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89500000000000002,"5min":1.081,"15min":1.081},"last":0.41699999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.629,"15min":0.64900000000000002},"min":{"1min":0.46200000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.90800000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.56899999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1140000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.498}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.71199999999999997},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96899999999999997,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72899999999999998,"15min":0.73799999999999999},"min":{"1min":0.443,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.443}]},{"osd":4,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.91500000000000004},"min":{"1min":0.64200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.014,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.92500000000000004,"15min":0.95399999999999996},"min":{"1min":0.64600000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3089999999999999,"5min":1.899,"15min":1.899},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90900000000000003,"15min":0.92700000000000005},"min":{"1min":0.77000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.381,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.97999999999999998,"15min":0.99099999999999999},"min":{"1min":0.75,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.25,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.81499999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.997,"15min":1.0169999999999999},"min":{"1min":0.72099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2130000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.018,"5min":1.01,"15min":1.038},"min":{"1min":0.68899999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.427,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0569999999999999,"15min":1.0840000000000001},"min":{"1min":0.77900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.282,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0349999999999999,"15min":1.0629999999999999},"min":{"1min":0.752,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.345,"5min":1.756,"15min":1.756},"last":0.86299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28252,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.61599999999999999,"15min":0.59499999999999997},"min":{"1min":0.47599999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60899999999999999,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93200000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58899999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.48799999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.214,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.78000000000000003,"15min":0.76800000000000002},"min":{"1min":0.56000000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.7140000000000004,"5min":4.7140000000000004,"15min":4.7140000000000004},"last":1.032}]},{"osd":4,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.71699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.133},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.70899999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.252,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.95799999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93600000000000005,"15min":0.95199999999999996},"min":{"1min":0.68400000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2450000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.66000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.2210000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.91400000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97899999999999998,"15min":0.97199999999999998},"min":{"1min":0.79700000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.169,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.948,"5min":1.1910000000000001,"15min":1.056},"min":{"1min":0.68700000000000006,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":21.474,"5min":21.474,"15min":21.474},"last":1.2250000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0209999999999999,"15min":1.0509999999999999},"min":{"1min":0.67600000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.292,"5min":1.506,"15min":1.506},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.024,"15min":1.0329999999999999},"min":{"1min":0.79300000000000004,"5min":0.625,"15min":0.625},"max":{"1min":1.2769999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.0649999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32344,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64600000000000002,"15min":0.66000000000000003},"min":{"1min":0.438,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82999999999999996,"5min":1.151,"15min":1.151},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.02,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.625,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.79200000000000004,"5min":1.306,"15min":1.306},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.39800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.008,"5min":1.28,"15min":1.28},"last":1.151}]},{"osd":3,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.139,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78100000000000003,"15min":0.81799999999999995},"min":{"1min":0.55900000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":1.905,"15min":1.905},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.71899999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.236,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.97199999999999998,"15min":1.0209999999999999},"min":{"1min":0.65400000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.181,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.119}]},{"osd":5,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.98499999999999999,"15min":1.0509999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1279999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0629999999999999,"15min":1.1040000000000001},"min":{"1min":0.80300000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.546,"5min":1.556,"15min":1.556},"last":1.5720000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.038,"15min":1.071},"min":{"1min":0.82399999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3009999999999999,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.458},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.077,"15min":1.125},"min":{"1min":0.73799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2470000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.3089999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1120000000000001,"15min":1.151},"min":{"1min":0.62,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6639999999999999,"5min":1.712,"15min":1.712},"last":1.659},{"interface":"front","average":{"1min":1.028,"5min":1.0700000000000001,"15min":1.093},"min":{"1min":0.79200000000000004,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3959999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.27}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1875968,"data_stored":1121560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.411,"5min":3.25,"15min":3.25},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.746,"15min":0.80000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93300000000000005,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.77000000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69399999999999995,"15min":0.72999999999999998},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.91600000000000004,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77800000000000002,"15min":0.86199999999999999},"min":{"1min":0.49399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.006,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.747,"15min":0.84099999999999997},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.073,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.85299999999999998,"15min":0.94099999999999995},"min":{"1min":0.48499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3149999999999999,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.627}]},{"osd":4,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.93899999999999995,"15min":1.0089999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.379,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.093,"5min":1.0289999999999999,"15min":1.0569999999999999},"min":{"1min":0.76700000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.1150000000000002,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.004,"15min":1.0620000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3129999999999999,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.016,"15min":1.093},"min":{"1min":0.63600000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.2450000000000001,"5min":5.399,"15min":5.399},"last":1.048}]},{"osd":6,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1040000000000001,"15min":1.1479999999999999},"min":{"1min":0.68700000000000006,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.0390000000000001,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.878},{"interface":"front","average":{"1min":0.997,"5min":1.056,"15min":1.1060000000000001},"min":{"1min":0.77800000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2649999999999999,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.89600000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.087,"15min":1.1220000000000001},"min":{"1min":0.74099999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2789999999999999,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.006},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1120000000000001,"15min":1.2},"min":{"1min":0.72599999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3149999999999999,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":1.0900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:10:53.493 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:53.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb31c9700 1 Processor -- start 2024-09-13T17:10:53.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb31c9700 1 -- start start 2024-09-13T17:10:53.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb31c9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbbac153390 0x7fbbac159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:53.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb31c9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbbac0cdb70 0x7fbbac0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:53.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb31c9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbac153770 0x7fbbac0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb31c9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac1595a0 con 0x7fbbac0cdb70 2024-09-13T17:10:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb31c9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac15a4c0 con 0x7fbbac153390 2024-09-13T17:10:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb31c9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac0cb730 con 0x7fbbac153770 2024-09-13T17:10:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb19c6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbbac0cdb70 0x7fbbac0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb19c6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbbac0cdb70 0x7fbbac0cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57926/0 (socket says 172.21.15.123:57926) 2024-09-13T17:10:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb19c6700 1 -- 172.21.15.123:0/2332970708 learned_addr learned my addr 172.21.15.123:0/2332970708 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb29c8700 1 --2- 172.21.15.123:0/2332970708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbac153770 0x7fbbac0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb21c7700 1 --2- 172.21.15.123:0/2332970708 >> v2:172.21.15.153:3300/0 conn(0x7fbbac153390 0x7fbbac159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb19c6700 1 -- 172.21.15.123:0/2332970708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbac153770 msgr2=0x7fbbac0ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb19c6700 1 --2- 172.21.15.123:0/2332970708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbac153770 0x7fbbac0ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb19c6700 1 -- 172.21.15.123:0/2332970708 >> v2:172.21.15.153:3300/0 conn(0x7fbbac153390 msgr2=0x7fbbac159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb19c6700 1 --2- 172.21.15.123:0/2332970708 >> v2:172.21.15.153:3300/0 conn(0x7fbbac153390 0x7fbbac159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb19c6700 1 -- 172.21.15.123:0/2332970708 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac0cba10 con 0x7fbbac0cdb70 2024-09-13T17:10:53.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb21c7700 1 --2- 172.21.15.123:0/2332970708 >> v2:172.21.15.153:3300/0 conn(0x7fbbac153390 0x7fbbac159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:53.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb29c8700 1 --2- 172.21.15.123:0/2332970708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbac153770 0x7fbbac0ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:53.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb19c6700 1 --2- 172.21.15.123:0/2332970708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbac0cdb70 0x7fbbac0cae30 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009910 tx=0x7fbb9c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5c46e408f743a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:53.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.604+0000 7fbbb11c5700 1 -- 172.21.15.123:0/2332970708 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c00ba20 con 0x7fbbac0cdb70 2024-09-13T17:10:53.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.608+0000 7fbbb11c5700 1 -- 172.21.15.123:0/2332970708 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c00bb80 con 0x7fbbac0cdb70 2024-09-13T17:10:53.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.608+0000 7fbbb11c5700 1 -- 172.21.15.123:0/2332970708 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c009e60 con 0x7fbbac0cdb70 2024-09-13T17:10:53.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.608+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2332970708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbac0cdb70 msgr2=0x7fbbac0cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:53.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.608+0000 7fbbb31c9700 1 --2- 172.21.15.123:0/2332970708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbac0cdb70 0x7fbbac0cae30 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009910 tx=0x7fbb9c009c20 comp rx=0 tx=0).stop 2024-09-13T17:10:53.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.608+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2332970708 shutdown_connections 2024-09-13T17:10:53.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.608+0000 7fbbb31c9700 1 --2- 172.21.15.123:0/2332970708 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbac153770 0x7fbbac0ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.608+0000 7fbbb31c9700 1 --2- 172.21.15.123:0/2332970708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbac0cdb70 0x7fbbac0cae30 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.608+0000 7fbbb31c9700 1 --2- 172.21.15.123:0/2332970708 >> v2:172.21.15.153:3300/0 conn(0x7fbbac153390 0x7fbbac159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.608+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2332970708 >> 172.21.15.123:0/2332970708 conn(0x7fbbac066150 msgr2=0x7fbbac066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:53.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.608+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2332970708 shutdown_connections 2024-09-13T17:10:53.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.608+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2332970708 wait complete. 2024-09-13T17:10:53.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb31c9700 1 Processor -- start 2024-09-13T17:10:53.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb31c9700 1 -- start start 2024-09-13T17:10:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb31c9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbac0cdb70 0x7fbbac0b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb31c9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbac153390 0x7fbbac155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb31c9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbac153770 0x7fbbac146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb31c9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac155e40 con 0x7fbbac153390 2024-09-13T17:10:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb31c9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac146980 con 0x7fbbac153770 2024-09-13T17:10:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb31c9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac156070 con 0x7fbbac0cdb70 2024-09-13T17:10:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb19c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbac153390 0x7fbbac155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb19c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbac153390 0x7fbbac155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57928/0 (socket says 172.21.15.123:57928) 2024-09-13T17:10:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb19c6700 1 -- 172.21.15.123:0/2053601786 learned_addr learned my addr 172.21.15.123:0/2053601786 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb21c7700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbac0cdb70 0x7fbbac0b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb29c8700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbac153770 0x7fbbac146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb19c6700 1 -- 172.21.15.123:0/2053601786 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbac0cdb70 msgr2=0x7fbbac0b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb19c6700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbac0cdb70 0x7fbbac0b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb19c6700 1 -- 172.21.15.123:0/2053601786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbac153770 msgr2=0x7fbbac146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb19c6700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbac153770 0x7fbbac146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb19c6700 1 -- 172.21.15.123:0/2053601786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c009570 con 0x7fbbac153390 2024-09-13T17:10:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb29c8700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbac153770 0x7fbbac146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb19c6700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbac153390 0x7fbbac155900 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0cf1a0 tx=0x7fbb9c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbba2ffd700 1 -- 172.21.15.123:0/2053601786 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c004610 con 0x7fbbac153390 2024-09-13T17:10:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbba2ffd700 1 -- 172.21.15.123:0/2053601786 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c0036c0 con 0x7fbbac153390 2024-09-13T17:10:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2053601786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac156350 con 0x7fbbac153390 2024-09-13T17:10:53.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbba2ffd700 1 -- 172.21.15.123:0/2053601786 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c003a50 con 0x7fbbac153390 2024-09-13T17:10:53.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.612+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2053601786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbac0ae250 con 0x7fbbac153390 2024-09-13T17:10:53.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.616+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2053601786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbac0677f0 con 0x7fbbac153390 2024-09-13T17:10:53.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.616+0000 7fbba2ffd700 1 -- 172.21.15.123:0/2053601786 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbb9c021070 con 0x7fbbac153390 2024-09-13T17:10:53.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.616+0000 7fbba2ffd700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb90066730 0x7fbb90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:53.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.616+0000 7fbbb21c7700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb90066730 0x7fbb90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:53.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.616+0000 7fbba2ffd700 1 -- 172.21.15.123:0/2053601786 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbb9c085530 con 0x7fbbac153390 2024-09-13T17:10:53.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.616+0000 7fbbb21c7700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb90066730 0x7fbb90068bf0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbba8003910 tx=0x7fbba8008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:53.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.624+0000 7fbba2ffd700 1 -- 172.21.15.123:0/2053601786 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbb9c052ba0 con 0x7fbbac153390 2024-09-13T17:10:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.796+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2053601786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbac0add60 con 0x7fbbac153390 2024-09-13T17:10:53.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.800+0000 7fbba2ffd700 1 -- 172.21.15.123:0/2053601786 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+13038 (secure 0 0 0) 0x7fbb9c015090 con 0x7fbbac153390 2024-09-13T17:10:53.803 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:53.803 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":101,"fsid":"c45759e3-62b7-46ff-ad19-917097e4c126","created":"2024-09-13T17:06:24.718572+0000","modified":"2024-09-13T17:10:50.933601+0000","last_up_change":"2024-09-13T17:06:35.968141+0000","last_in_change":"2024-09-13T17:06:26.818267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:06:36.796221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59c5e23d-dc55-4161-b6e2-bf8b8c70a229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6801","nonce":3880880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6803","nonce":3880880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6807","nonce":3880880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":3880880552},{"type":"v1","addr":"172.21.15.123:6805","nonce":3880880552}]},"public_addr":"172.21.15.123:6801/3880880552","cluster_addr":"172.21.15.123:6803/3880880552","heartbeat_back_addr":"172.21.15.123:6807/3880880552","heartbeat_front_addr":"172.21.15.123:6805/3880880552","state":["exists","up"]},{"osd":1,"uuid":"4f7d4173-67dd-4f16-9411-9fdb1daaae99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6825","nonce":2043264613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6827","nonce":2043264613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6831","nonce":2043264613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2043264613},{"type":"v1","addr":"172.21.15.123:6829","nonce":2043264613}]},"public_addr":"172.21.15.123:6825/2043264613","cluster_addr":"172.21.15.123:6827/2043264613","heartbeat_back_addr":"172.21.15.123:6831/2043264613","heartbeat_front_addr":"172.21.15.123:6829/2043264613","state":["exists","up"]},{"osd":2,"uuid":"2e5f2e54-c6da-4917-ae3a-27e990c44c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6817","nonce":2789168215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6819","nonce":2789168215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6823","nonce":2789168215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2789168215},{"type":"v1","addr":"172.21.15.123:6821","nonce":2789168215}]},"public_addr":"172.21.15.123:6817/2789168215","cluster_addr":"172.21.15.123:6819/2789168215","heartbeat_back_addr":"172.21.15.123:6823/2789168215","heartbeat_front_addr":"172.21.15.123:6821/2789168215","state":["exists","up"]},{"osd":3,"uuid":"9607b19e-7c56-4054-858f-79d8ffd7c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6809","nonce":2512830091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6811","nonce":2512830091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6815","nonce":2512830091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2512830091},{"type":"v1","addr":"172.21.15.123:6813","nonce":2512830091}]},"public_addr":"172.21.15.123:6809/2512830091","cluster_addr":"172.21.15.123:6811/2512830091","heartbeat_back_addr":"172.21.15.123:6815/2512830091","heartbeat_front_addr":"172.21.15.123:6813/2512830091","state":["exists","up"]},{"osd":4,"uuid":"46839187-e0d6-48e9-9eda-79f2604f3201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6817","nonce":639257190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6819","nonce":639257190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6823","nonce":639257190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":639257190},{"type":"v1","addr":"172.21.15.153:6821","nonce":639257190}]},"public_addr":"172.21.15.153:6817/639257190","cluster_addr":"172.21.15.153:6819/639257190","heartbeat_back_addr":"172.21.15.153:6823/639257190","heartbeat_front_addr":"172.21.15.153:6821/639257190","state":["exists","up"]},{"osd":5,"uuid":"38b885f1-f1d4-4f1a-8d32-d5092dd9b69c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6801","nonce":1764587592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6803","nonce":1764587592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6807","nonce":1764587592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1764587592},{"type":"v1","addr":"172.21.15.153:6805","nonce":1764587592}]},"public_addr":"172.21.15.153:6801/1764587592","cluster_addr":"172.21.15.153:6803/1764587592","heartbeat_back_addr":"172.21.15.153:6807/1764587592","heartbeat_front_addr":"172.21.15.153:6805/1764587592","state":["exists","up"]},{"osd":6,"uuid":"6cee067d-ae45-45f3-9a3c-7f50be869c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6825","nonce":2955379880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6827","nonce":2955379880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6831","nonce":2955379880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2955379880},{"type":"v1","addr":"172.21.15.153:6829","nonce":2955379880}]},"public_addr":"172.21.15.153:6825/2955379880","cluster_addr":"172.21.15.153:6827/2955379880","heartbeat_back_addr":"172.21.15.153:6831/2955379880","heartbeat_front_addr":"172.21.15.153:6829/2955379880","state":["exists","up"]},{"osd":7,"uuid":"01e1117a-c2f1-43ab-baca-2f3df0fc9e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6809","nonce":1517292799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6811","nonce":1517292799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6815","nonce":1517292799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1517292799},{"type":"v1","addr":"172.21.15.153:6813","nonce":1517292799}]},"public_addr":"172.21.15.153:6809/1517292799","cluster_addr":"172.21.15.153:6811/1517292799","heartbeat_back_addr":"172.21.15.153:6815/1517292799","heartbeat_front_addr":"172.21.15.153:6813/1517292799","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.799385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.304590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.091144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:31.890835+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.103583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.230527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.343338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:32.065460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6837/1688881065":"2024-09-14T17:10:47.825048+0000","172.21.15.123:6836/1688881065":"2024-09-14T17:10:47.825048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.800+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2053601786 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb90066730 msgr2=0x7fbb90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.800+0000 7fbbb31c9700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb90066730 0x7fbb90068bf0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbba8003910 tx=0x7fbba8008040 comp rx=0 tx=0).stop 2024-09-13T17:10:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.800+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2053601786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbac153390 msgr2=0x7fbbac155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.800+0000 7fbbb31c9700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbac153390 0x7fbbac155900 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0cf1a0 tx=0x7fbb9c004770 comp rx=0 tx=0).stop 2024-09-13T17:10:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.800+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2053601786 shutdown_connections 2024-09-13T17:10:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.800+0000 7fbbb31c9700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbb90066730 0x7fbb90068bf0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.800+0000 7fbbb31c9700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbac153770 0x7fbbac146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.800+0000 7fbbb31c9700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbac153390 0x7fbbac155900 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.800+0000 7fbbb31c9700 1 --2- 172.21.15.123:0/2053601786 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbbac0cdb70 0x7fbbac0b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.800+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2053601786 >> 172.21.15.123:0/2053601786 conn(0x7fbbac066150 msgr2=0x7fbbac066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.804+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2053601786 shutdown_connections 2024-09-13T17:10:53.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:53.804+0000 7fbbb31c9700 1 -- 172.21.15.123:0/2053601786 wait complete. 2024-09-13T17:10:54.819 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T17:10:54.819 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:10:54.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.948+0000 7f3048cb5700 1 Processor -- start 2024-09-13T17:10:54.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.948+0000 7f3048cb5700 1 -- start start 2024-09-13T17:10:54.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.948+0000 7f3048cb5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30440b3a70 0x7f30440709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:54.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.948+0000 7f3048cb5700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3044070f00 0x7f304406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:54.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.948+0000 7f3048cb5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3044071b90 con 0x7f304415cb80 2024-09-13T17:10:54.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.948+0000 7f3048cb5700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30440723a0 con 0x7f3044070f00 2024-09-13T17:10:54.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.948+0000 7f3048cb5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30440b59a0 con 0x7f30440b3a70 2024-09-13T17:10:54.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f30437fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f304415cb80 0x7f30440b5290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53436/0 (socket says 172.21.15.123:53436) 2024-09-13T17:10:54.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f30437fe700 1 -- 172.21.15.123:0/1307689342 learned_addr learned my addr 172.21.15.123:0/1307689342 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:54.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3042ffd700 1 --2- 172.21.15.123:0/1307689342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30440b3a70 0x7f30440709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:54.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3043fff700 1 --2- 172.21.15.123:0/1307689342 >> v2:172.21.15.153:3300/0 conn(0x7f3044070f00 0x7f304406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:54.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f30427fc700 1 -- 172.21.15.123:0/1307689342 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074398608 0 0) 0x7f3044071b90 con 0x7f304415cb80 2024-09-13T17:10:54.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f30427fc700 1 -- 172.21.15.123:0/1307689342 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f302c0035d0 con 0x7f304415cb80 2024-09-13T17:10:54.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3043fff700 1 -- 172.21.15.123:0/1307689342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30440b3a70 msgr2=0x7f30440709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:54.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3043fff700 1 --2- 172.21.15.123:0/1307689342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30440b3a70 0x7f30440709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f30427fc700 1 -- 172.21.15.123:0/1307689342 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4002677131 0 0) 0x7f302c0035d0 con 0x7f304415cb80 2024-09-13T17:10:54.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3043fff700 1 -- 172.21.15.123:0/1307689342 >> v1:172.21.15.123:6789/0 conn(0x7f304415cb80 legacy=0x7f30440b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:54.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3043fff700 1 -- 172.21.15.123:0/1307689342 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3044071de0 con 0x7f3044070f00 2024-09-13T17:10:54.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3042ffd700 1 --2- 172.21.15.123:0/1307689342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30440b3a70 0x7f30440709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:54.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3043fff700 1 --2- 172.21.15.123:0/1307689342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3044070f00 0x7f304406e000 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f303c009d90 tx=0x7f303c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2358950e8c0e867 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:54.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f30427fc700 1 -- 172.21.15.123:0/1307689342 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c00e070 con 0x7f3044070f00 2024-09-13T17:10:54.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f30427fc700 1 -- 172.21.15.123:0/1307689342 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c003a40 con 0x7f3044070f00 2024-09-13T17:10:54.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f30427fc700 1 -- 172.21.15.123:0/1307689342 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038001670 con 0x7f3044070f00 2024-09-13T17:10:54.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3048cb5700 1 -- 172.21.15.123:0/1307689342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3044070f00 msgr2=0x7f304406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:54.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3048cb5700 1 --2- 172.21.15.123:0/1307689342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3044070f00 0x7f304406e000 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f303c009d90 tx=0x7f303c00b330 comp rx=0 tx=0).stop 2024-09-13T17:10:54.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3048cb5700 1 -- 172.21.15.123:0/1307689342 shutdown_connections 2024-09-13T17:10:54.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3048cb5700 1 --2- 172.21.15.123:0/1307689342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3044070f00 0x7f304406e000 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3048cb5700 1 --2- 172.21.15.123:0/1307689342 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f30440b3a70 0x7f30440709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3048cb5700 1 -- 172.21.15.123:0/1307689342 >> 172.21.15.123:0/1307689342 conn(0x7f30440b6110 msgr2=0x7f304406a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:54.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3048cb5700 1 -- 172.21.15.123:0/1307689342 shutdown_connections 2024-09-13T17:10:54.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.952+0000 7f3048cb5700 1 -- 172.21.15.123:0/1307689342 wait complete. 2024-09-13T17:10:54.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3048cb5700 1 Processor -- start 2024-09-13T17:10:54.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3048cb5700 1 -- start start 2024-09-13T17:10:54.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3048cb5700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3044070f00 0x7f3044142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:54.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3048cb5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30440b3a70 0x7f304415dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:54.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3048cb5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f304415cb80 0x7f30440c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:54.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3048cb5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304415eaa0 con 0x7f304415cb80 2024-09-13T17:10:54.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3048cb5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304415ed80 con 0x7f30440b3a70 2024-09-13T17:10:54.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3048cb5700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304415f060 con 0x7f3044070f00 2024-09-13T17:10:54.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3043fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f304415cb80 0x7f30440c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:54.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3043fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f304415cb80 0x7f30440c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57932/0 (socket says 172.21.15.123:57932) 2024-09-13T17:10:54.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3043fff700 1 -- 172.21.15.123:0/2178507245 learned_addr learned my addr 172.21.15.123:0/2178507245 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:54.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3042ffd700 1 --2- 172.21.15.123:0/2178507245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30440b3a70 0x7f304415dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:54.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f30437fe700 1 --2- 172.21.15.123:0/2178507245 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3044070f00 0x7f3044142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:54.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3043fff700 1 -- 172.21.15.123:0/2178507245 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3044070f00 msgr2=0x7f3044142fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:54.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3043fff700 1 --2- 172.21.15.123:0/2178507245 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3044070f00 0x7f3044142fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3043fff700 1 -- 172.21.15.123:0/2178507245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30440b3a70 msgr2=0x7f304415dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3043fff700 1 --2- 172.21.15.123:0/2178507245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30440b3a70 0x7f304415dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3043fff700 1 -- 172.21.15.123:0/2178507245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30340094b0 con 0x7f304415cb80 2024-09-13T17:10:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3043fff700 1 --2- 172.21.15.123:0/2178507245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f304415cb80 0x7f30440c9b80 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f303c00b370 tx=0x7f303c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f302bfff700 1 -- 172.21.15.123:0/2178507245 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c004540 con 0x7f304415cb80 2024-09-13T17:10:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f302bfff700 1 -- 172.21.15.123:0/2178507245 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c0046a0 con 0x7f304415cb80 2024-09-13T17:10:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3048cb5700 1 -- 172.21.15.123:0/2178507245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c009a70 con 0x7f304415cb80 2024-09-13T17:10:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f302bfff700 1 -- 172.21.15.123:0/2178507245 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c01c440 con 0x7f304415cb80 2024-09-13T17:10:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.956+0000 7f3048cb5700 1 -- 172.21.15.123:0/2178507245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304415f620 con 0x7f304415cb80 2024-09-13T17:10:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.960+0000 7f3048cb5700 1 -- 172.21.15.123:0/2178507245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f304415eef0 con 0x7f304415cb80 2024-09-13T17:10:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.960+0000 7f302bfff700 1 -- 172.21.15.123:0/2178507245 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f303c01c5a0 con 0x7f304415cb80 2024-09-13T17:10:54.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.960+0000 7f302bfff700 1 --2- 172.21.15.123:0/2178507245 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3030066730 0x7f3030068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:54.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.960+0000 7f30437fe700 1 --2- 172.21.15.123:0/2178507245 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3030066730 0x7f3030068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:54.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.960+0000 7f302bfff700 1 -- 172.21.15.123:0/2178507245 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f303c085aa0 con 0x7f304415cb80 2024-09-13T17:10:54.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.960+0000 7f302bfff700 1 --2- 172.21.15.123:0/2178507245 >> [v2:172.21.15.123:6800/3880880552,v1:172.21.15.123:6801/3880880552] conn(0x7f303006c590 0x7f303006e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:54.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.960+0000 7f302bfff700 1 -- 172.21.15.123:0/2178507245 --> [v2:172.21.15.123:6800/3880880552,v1:172.21.15.123:6801/3880880552] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f303006f060 con 0x7f303006c590 2024-09-13T17:10:54.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.960+0000 7f302bfff700 1 -- 172.21.15.123:0/2178507245 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f303c08a2c0 con 0x7f304415cb80 2024-09-13T17:10:54.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.964+0000 7f30437fe700 1 --2- 172.21.15.123:0/2178507245 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3030066730 0x7f3030068bf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f30380011e0 tx=0x7f3038001da0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:54.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.964+0000 7f3042ffd700 1 --2- 172.21.15.123:0/2178507245 >> [v2:172.21.15.123:6800/3880880552,v1:172.21.15.123:6801/3880880552] conn(0x7f303006c590 0x7f303006e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:54.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.964+0000 7f3042ffd700 1 --2- 172.21.15.123:0/2178507245 >> [v2:172.21.15.123:6800/3880880552,v1:172.21.15.123:6801/3880880552] conn(0x7f303006c590 0x7f303006e9b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.964+0000 7f302bfff700 1 -- 172.21.15.123:0/2178507245 <== osd.0 v2:172.21.15.123:6800/3880880552 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f303006f060 con 0x7f303006c590 2024-09-13T17:10:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.980+0000 7f3048cb5700 1 -- 172.21.15.123:0/2178507245 --> [v2:172.21.15.123:6800/3880880552,v1:172.21.15.123:6801/3880880552] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f30440704a0 con 0x7f303006c590 2024-09-13T17:10:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.984+0000 7f302bfff700 1 -- 172.21.15.123:0/2178507245 <== osd.0 v2:172.21.15.123:6800/3880880552 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3034009e10 con 0x7f303006c590 2024-09-13T17:10:54.986 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:10:54.986 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:10:54.986 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:10:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.984+0000 7f3048cb5700 1 -- 172.21.15.123:0/2178507245 >> [v2:172.21.15.123:6800/3880880552,v1:172.21.15.123:6801/3880880552] conn(0x7f303006c590 msgr2=0x7f303006e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.984+0000 7f3048cb5700 1 --2- 172.21.15.123:0/2178507245 >> [v2:172.21.15.123:6800/3880880552,v1:172.21.15.123:6801/3880880552] conn(0x7f303006c590 0x7f303006e9b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.984+0000 7f3048cb5700 1 -- 172.21.15.123:0/2178507245 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3030066730 msgr2=0x7f3030068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.984+0000 7f3048cb5700 1 --2- 172.21.15.123:0/2178507245 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f3030066730 0x7f3030068bf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f30380011e0 tx=0x7f3038001da0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.984+0000 7f3048cb5700 1 -- 172.21.15.123:0/2178507245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f304415cb80 msgr2=0x7f30440c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.984+0000 7f3048cb5700 1 --2- 172.21.15.123:0/2178507245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f304415cb80 0x7f30440c9b80 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f303c00b370 tx=0x7f303c004af0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.984+0000 7f3043fff700 1 -- 172.21.15.123:0/2178507245 reap_dead start 2024-09-13T17:10:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.984+0000 7f3048cb5700 1 -- 172.21.15.123:0/2178507245 shutdown_connections 2024-09-13T17:10:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.984+0000 7f3048cb5700 1 -- 172.21.15.123:0/2178507245 >> 172.21.15.123:0/2178507245 conn(0x7f30440b6110 msgr2=0x7f304406a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.984+0000 7f3048cb5700 1 -- 172.21.15.123:0/2178507245 shutdown_connections 2024-09-13T17:10:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:54.984+0000 7f3048cb5700 1 -- 172.21.15.123:0/2178507245 wait complete. 2024-09-13T17:10:55.000 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T17:10:55.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9fdccc700 1 Processor -- start 2024-09-13T17:10:55.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9fdccc700 1 -- start start 2024-09-13T17:10:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9fdccc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa9f80ca950 0x7fa9f80c1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9fdccc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f80c93b0 con 0x7fa9f80c8cd0 2024-09-13T17:10:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9fdccc700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f80cc580 con 0x7fa9f80cb090 2024-09-13T17:10:55.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9fdccc700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f80cd100 con 0x7fa9f80ca950 2024-09-13T17:10:55.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9f7fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa9f80c8cd0 0x7fa9f80c1280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53446/0 (socket says 172.21.15.123:53446) 2024-09-13T17:10:55.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9f7fff700 1 -- 172.21.15.123:0/3066266208 learned_addr learned my addr 172.21.15.123:0/3066266208 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:55.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9fd4cb700 1 --2- 172.21.15.123:0/3066266208 >> v2:172.21.15.153:3300/0 conn(0x7fa9f80ca950 0x7fa9f80c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9f77fe700 1 -- 172.21.15.123:0/3066266208 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964969770 0 0) 0x7fa9f80c93b0 con 0x7fa9f80c8cd0 2024-09-13T17:10:55.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9f77fe700 1 -- 172.21.15.123:0/3066266208 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9e40035d0 con 0x7fa9f80c8cd0 2024-09-13T17:10:55.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9fd4cb700 1 -- 172.21.15.123:0/3066266208 >> v1:172.21.15.153:6789/0 conn(0x7fa9f80cb090 legacy=0x7fa9f80cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9f77fe700 1 -- 172.21.15.123:0/3066266208 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3586078724 0 0) 0x7fa9e40035d0 con 0x7fa9f80c8cd0 2024-09-13T17:10:55.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9fd4cb700 1 -- 172.21.15.123:0/3066266208 >> v1:172.21.15.123:6789/0 conn(0x7fa9f80c8cd0 legacy=0x7fa9f80c1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9fd4cb700 1 -- 172.21.15.123:0/3066266208 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f81617b0 con 0x7fa9f80ca950 2024-09-13T17:10:55.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9fd4cb700 1 --2- 172.21.15.123:0/3066266208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9f80ca950 0x7fa9f80c1990 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009850 tx=0x7fa9e8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e38f89b13af71bb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:55.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9f77fe700 1 -- 172.21.15.123:0/3066266208 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f00019f0 con 0x7fa9f80ca950 2024-09-13T17:10:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9f77fe700 1 -- 172.21.15.123:0/3066266208 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e8004030 con 0x7fa9f80ca950 2024-09-13T17:10:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.120+0000 7fa9f77fe700 1 -- 172.21.15.123:0/3066266208 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e80043a0 con 0x7fa9f80ca950 2024-09-13T17:10:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3066266208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9f80ca950 msgr2=0x7fa9f80c1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 --2- 172.21.15.123:0/3066266208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9f80ca950 0x7fa9f80c1990 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009850 tx=0x7fa9e8009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3066266208 shutdown_connections 2024-09-13T17:10:55.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 --2- 172.21.15.123:0/3066266208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9f80ca950 0x7fa9f80c1990 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3066266208 >> 172.21.15.123:0/3066266208 conn(0x7fa9f80b01d0 msgr2=0x7fa9f80b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:55.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3066266208 shutdown_connections 2024-09-13T17:10:55.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3066266208 wait complete. 2024-09-13T17:10:55.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 Processor -- start 2024-09-13T17:10:55.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 -- start start 2024-09-13T17:10:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9f80c8cd0 0x7fa9f815ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f80ca950 0x7fa9f80c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f80cb090 0x7fa9f8162b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f80c66d0 con 0x7fa9f80cb090 2024-09-13T17:10:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f80c6d90 con 0x7fa9f80c8cd0 2024-09-13T17:10:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fdccc700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f815b220 con 0x7fa9f80ca950 2024-09-13T17:10:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fd4cb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f80cb090 0x7fa9f8162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fd4cb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f80cb090 0x7fa9f8162b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57940/0 (socket says 172.21.15.123:57940) 2024-09-13T17:10:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.124+0000 7fa9fd4cb700 1 -- 172.21.15.123:0/3457114588 learned_addr learned my addr 172.21.15.123:0/3457114588 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9f7fff700 1 --2- 172.21.15.123:0/3457114588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f80ca950 0x7fa9f80c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9fccca700 1 --2- 172.21.15.123:0/3457114588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9f80c8cd0 0x7fa9f815ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9fd4cb700 1 -- 172.21.15.123:0/3457114588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f80ca950 msgr2=0x7fa9f80c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9fd4cb700 1 --2- 172.21.15.123:0/3457114588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f80ca950 0x7fa9f80c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9fd4cb700 1 -- 172.21.15.123:0/3457114588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9f80c8cd0 msgr2=0x7fa9f815ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9fd4cb700 1 --2- 172.21.15.123:0/3457114588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9f80c8cd0 0x7fa9f815ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9fd4cb700 1 -- 172.21.15.123:0/3457114588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e80094b0 con 0x7fa9f80cb090 2024-09-13T17:10:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9fd4cb700 1 --2- 172.21.15.123:0/3457114588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f80cb090 0x7fa9f8162b20 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80cb060 tx=0x7fa9e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9f57fa700 1 -- 172.21.15.123:0/3457114588 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8003c20 con 0x7fa9f80cb090 2024-09-13T17:10:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3457114588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f81f7cb0 con 0x7fa9f80cb090 2024-09-13T17:10:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9f57fa700 1 -- 172.21.15.123:0/3457114588 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e801f070 con 0x7fa9f80cb090 2024-09-13T17:10:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3457114588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f80c63f0 con 0x7fa9f80cb090 2024-09-13T17:10:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9f57fa700 1 -- 172.21.15.123:0/3457114588 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8011630 con 0x7fa9f80cb090 2024-09-13T17:10:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3457114588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f80c90d0 con 0x7fa9f80cb090 2024-09-13T17:10:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9f57fa700 1 -- 172.21.15.123:0/3457114588 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa9e8021030 con 0x7fa9f80cb090 2024-09-13T17:10:55.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9f57fa700 1 --2- 172.21.15.123:0/3457114588 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa9d8066730 0x7fa9d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9f57fa700 1 -- 172.21.15.123:0/3457114588 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa9e8085440 con 0x7fa9f80cb090 2024-09-13T17:10:55.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.128+0000 7fa9fccca700 1 --2- 172.21.15.123:0/3457114588 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa9d8066730 0x7fa9d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.132+0000 7fa9fccca700 1 --2- 172.21.15.123:0/3457114588 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa9d8066730 0x7fa9d8068bf0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00016e0 tx=0x7fa9e0009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:55.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.140+0000 7fa9f57fa700 1 -- 172.21.15.123:0/3457114588 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa9e8052b40 con 0x7fa9f80cb090 2024-09-13T17:10:55.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.308+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3457114588 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9f80cc7d0 con 0x7fa9d8066730 2024-09-13T17:10:55.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.308+0000 7fa9f57fa700 1 -- 172.21.15.123:0/3457114588 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa9e00050d0 con 0x7fa9d8066730 2024-09-13T17:10:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.312+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3457114588 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa9d8066730 msgr2=0x7fa9d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.312+0000 7fa9fdccc700 1 --2- 172.21.15.123:0/3457114588 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa9d8066730 0x7fa9d8068bf0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00016e0 tx=0x7fa9e0009040 comp rx=0 tx=0).stop 2024-09-13T17:10:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.312+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3457114588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f80cb090 msgr2=0x7fa9f8162b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.312+0000 7fa9fdccc700 1 --2- 172.21.15.123:0/3457114588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f80cb090 0x7fa9f8162b20 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80cb060 tx=0x7fa9e8004770 comp rx=0 tx=0).stop 2024-09-13T17:10:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.312+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3457114588 shutdown_connections 2024-09-13T17:10:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.312+0000 7fa9fdccc700 1 --2- 172.21.15.123:0/3457114588 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fa9d8066730 0x7fa9d8068bf0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.312+0000 7fa9fdccc700 1 --2- 172.21.15.123:0/3457114588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f80cb090 0x7fa9f8162b20 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.312+0000 7fa9fdccc700 1 --2- 172.21.15.123:0/3457114588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa9f80ca950 0x7fa9f80c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.312+0000 7fa9fdccc700 1 --2- 172.21.15.123:0/3457114588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9f80c8cd0 0x7fa9f815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.312+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3457114588 >> 172.21.15.123:0/3457114588 conn(0x7fa9f80b01d0 msgr2=0x7fa9f80cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:55.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.312+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3457114588 shutdown_connections 2024-09-13T17:10:55.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.312+0000 7fa9fdccc700 1 -- 172.21.15.123:0/3457114588 wait complete. 2024-09-13T17:10:55.317 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T17:10:55.332 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T17:10:55.332 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:10:55.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf2759e700 1 Processor -- start 2024-09-13T17:10:55.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf2759e700 1 -- start start 2024-09-13T17:10:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf2759e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faf2806acb0 0x7faf28161170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf2759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2806f280 0x7faf2806f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf2759e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf280b4ce0 con 0x7faf2815c7d0 2024-09-13T17:10:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf2759e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2806fc50 con 0x7faf2806acb0 2024-09-13T17:10:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf2759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf280b4750 con 0x7faf2806f280 2024-09-13T17:10:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf25d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faf2806acb0 0x7faf28161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf25d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faf2806acb0 0x7faf28161170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57954/0 (socket says 172.21.15.123:57954) 2024-09-13T17:10:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf25d9b700 1 -- 172.21.15.123:0/3481481698 learned_addr learned my addr 172.21.15.123:0/3481481698 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf26d9d700 1 --2- 172.21.15.123:0/3481481698 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2806f280 0x7faf2806f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf25d9b700 1 -- 172.21.15.123:0/3481481698 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2806f280 msgr2=0x7faf2806f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf25d9b700 1 --2- 172.21.15.123:0/3481481698 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2806f280 0x7faf2806f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf25d9b700 1 -- 172.21.15.123:0/3481481698 >> v1:172.21.15.123:6789/0 conn(0x7faf2815c7d0 legacy=0x7faf280b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.444+0000 7faf25d9b700 1 -- 172.21.15.123:0/3481481698 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf280b4a00 con 0x7faf2806acb0 2024-09-13T17:10:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.448+0000 7faf25d9b700 1 --2- 172.21.15.123:0/3481481698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf2806acb0 0x7faf28161170 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7faf18009910 tx=0x7faf18009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b3959a9779b135 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.448+0000 7faf2559a700 1 -- 172.21.15.123:0/3481481698 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1800ba60 con 0x7faf2806acb0 2024-09-13T17:10:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.448+0000 7faf2559a700 1 -- 172.21.15.123:0/3481481698 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1800bbc0 con 0x7faf2806acb0 2024-09-13T17:10:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.448+0000 7faf2559a700 1 -- 172.21.15.123:0/3481481698 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18009e60 con 0x7faf2806acb0 2024-09-13T17:10:55.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.448+0000 7faf2759e700 1 -- 172.21.15.123:0/3481481698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf2806acb0 msgr2=0x7faf28161170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.448+0000 7faf2759e700 1 --2- 172.21.15.123:0/3481481698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf2806acb0 0x7faf28161170 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7faf18009910 tx=0x7faf18009c20 comp rx=0 tx=0).stop 2024-09-13T17:10:55.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.448+0000 7faf2759e700 1 -- 172.21.15.123:0/3481481698 shutdown_connections 2024-09-13T17:10:55.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.448+0000 7faf2759e700 1 --2- 172.21.15.123:0/3481481698 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2806f280 0x7faf2806f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.448+0000 7faf2759e700 1 --2- 172.21.15.123:0/3481481698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf2806acb0 0x7faf28161170 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.448+0000 7faf2759e700 1 -- 172.21.15.123:0/3481481698 >> 172.21.15.123:0/3481481698 conn(0x7faf280b14b0 msgr2=0x7faf280b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:55.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.448+0000 7faf2759e700 1 -- 172.21.15.123:0/3481481698 shutdown_connections 2024-09-13T17:10:55.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.448+0000 7faf2759e700 1 -- 172.21.15.123:0/3481481698 wait complete. 2024-09-13T17:10:55.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.448+0000 7faf2759e700 1 Processor -- start 2024-09-13T17:10:55.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.448+0000 7faf2759e700 1 -- start start 2024-09-13T17:10:55.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf2759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2806acb0 0x7faf28154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf2759e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2806f280 0x7faf28152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf2759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf2815c7d0 0x7faf28144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf2759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28154890 con 0x7faf2815c7d0 2024-09-13T17:10:55.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf2759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28153fc0 con 0x7faf2806acb0 2024-09-13T17:10:55.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf2759e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf281f7b90 con 0x7faf2806f280 2024-09-13T17:10:55.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf26d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf2815c7d0 0x7faf28144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf26d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf2815c7d0 0x7faf28144b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57968/0 (socket says 172.21.15.123:57968) 2024-09-13T17:10:55.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf26d9d700 1 -- 172.21.15.123:0/4008461630 learned_addr learned my addr 172.21.15.123:0/4008461630 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:55.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf2659c700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2806acb0 0x7faf28154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf25d9b700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2806f280 0x7faf28152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf26d9d700 1 -- 172.21.15.123:0/4008461630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2806f280 msgr2=0x7faf28152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf26d9d700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7faf2806f280 0x7faf28152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf26d9d700 1 -- 172.21.15.123:0/4008461630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2806acb0 msgr2=0x7faf28154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf26d9d700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2806acb0 0x7faf28154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf26d9d700 1 -- 172.21.15.123:0/4008461630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf18009570 con 0x7faf2815c7d0 2024-09-13T17:10:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf2659c700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf2806acb0 0x7faf28154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf26d9d700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf2815c7d0 0x7faf28144b80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7faf20007dc0 tx=0x7faf2000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf16ffd700 1 -- 172.21.15.123:0/4008461630 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2000ede0 con 0x7faf2815c7d0 2024-09-13T17:10:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf16ffd700 1 -- 172.21.15.123:0/4008461630 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf20014420 con 0x7faf2815c7d0 2024-09-13T17:10:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf2759e700 1 -- 172.21.15.123:0/4008461630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf281f78b0 con 0x7faf2815c7d0 2024-09-13T17:10:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf16ffd700 1 -- 172.21.15.123:0/4008461630 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf200147d0 con 0x7faf2815c7d0 2024-09-13T17:10:55.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf2759e700 1 -- 172.21.15.123:0/4008461630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf281544b0 con 0x7faf2815c7d0 2024-09-13T17:10:55.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf2759e700 1 -- 172.21.15.123:0/4008461630 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf28160c50 con 0x7faf2815c7d0 2024-09-13T17:10:55.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf16ffd700 1 -- 172.21.15.123:0/4008461630 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf20014930 con 0x7faf2815c7d0 2024-09-13T17:10:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf16ffd700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faf08066730 0x7faf08068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf16ffd700 1 -- 172.21.15.123:0/4008461630 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faf200845a0 con 0x7faf2815c7d0 2024-09-13T17:10:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf16ffd700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.123:6824/2043264613,v1:172.21.15.123:6825/2043264613] conn(0x7faf0806c590 0x7faf0806e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf16ffd700 1 -- 172.21.15.123:0/4008461630 --> [v2:172.21.15.123:6824/2043264613,v1:172.21.15.123:6825/2043264613] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf0806f060 con 0x7faf0806c590 2024-09-13T17:10:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf2659c700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faf08066730 0x7faf08068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf16ffd700 1 -- 172.21.15.123:0/4008461630 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf20086c60 con 0x7faf2815c7d0 2024-09-13T17:10:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.452+0000 7faf25d9b700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.123:6824/2043264613,v1:172.21.15.123:6825/2043264613] conn(0x7faf0806c590 0x7faf0806e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.456+0000 7faf2659c700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faf08066730 0x7faf08068bf0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7faf1c000f60 tx=0x7faf1c009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:55.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.456+0000 7faf25d9b700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.123:6824/2043264613,v1:172.21.15.123:6825/2043264613] conn(0x7faf0806c590 0x7faf0806e9b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:55.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.456+0000 7faf16ffd700 1 -- 172.21.15.123:0/4008461630 <== osd.1 v2:172.21.15.123:6824/2043264613 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7faf0806f060 con 0x7faf0806c590 2024-09-13T17:10:55.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.472+0000 7faf2759e700 1 -- 172.21.15.123:0/4008461630 --> [v2:172.21.15.123:6824/2043264613,v1:172.21.15.123:6825/2043264613] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faf28160970 con 0x7faf0806c590 2024-09-13T17:10:55.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.472+0000 7faf16ffd700 1 -- 172.21.15.123:0/4008461630 <== osd.1 v2:172.21.15.123:6824/2043264613 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7faf1800beb0 con 0x7faf0806c590 2024-09-13T17:10:55.477 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:10:55.477 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:10:55.477 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:10:55.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.472+0000 7faf2759e700 1 -- 172.21.15.123:0/4008461630 >> [v2:172.21.15.123:6824/2043264613,v1:172.21.15.123:6825/2043264613] conn(0x7faf0806c590 msgr2=0x7faf0806e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.472+0000 7faf2759e700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.123:6824/2043264613,v1:172.21.15.123:6825/2043264613] conn(0x7faf0806c590 0x7faf0806e9b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.472+0000 7faf2759e700 1 -- 172.21.15.123:0/4008461630 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faf08066730 msgr2=0x7faf08068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.472+0000 7faf2759e700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7faf08066730 0x7faf08068bf0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7faf1c000f60 tx=0x7faf1c009040 comp rx=0 tx=0).stop 2024-09-13T17:10:55.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.472+0000 7faf2759e700 1 -- 172.21.15.123:0/4008461630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf2815c7d0 msgr2=0x7faf28144b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.472+0000 7faf2759e700 1 --2- 172.21.15.123:0/4008461630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf2815c7d0 0x7faf28144b80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7faf20007dc0 tx=0x7faf2000e3c0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.472+0000 7faf26d9d700 1 -- 172.21.15.123:0/4008461630 reap_dead start 2024-09-13T17:10:55.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.472+0000 7faf2759e700 1 -- 172.21.15.123:0/4008461630 shutdown_connections 2024-09-13T17:10:55.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.472+0000 7faf2759e700 1 -- 172.21.15.123:0/4008461630 >> 172.21.15.123:0/4008461630 conn(0x7faf280b14b0 msgr2=0x7faf280ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:55.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.472+0000 7faf2759e700 1 -- 172.21.15.123:0/4008461630 shutdown_connections 2024-09-13T17:10:55.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.476+0000 7faf2759e700 1 -- 172.21.15.123:0/4008461630 wait complete. 2024-09-13T17:10:55.489 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T17:10:55.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c6402700 1 Processor -- start 2024-09-13T17:10:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c6402700 1 -- start start 2024-09-13T17:10:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c6402700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9c00c9f80 0x7fe9c00c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c6402700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe9c006c610 0x7fe9c006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c6402700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe9c00cd690 0x7fe9c00cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c6402700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c00ce080 con 0x7fe9c006c610 2024-09-13T17:10:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c6402700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c00c95f0 con 0x7fe9c00cd690 2024-09-13T17:10:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c6402700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c015b180 con 0x7fe9c00c9f80 2024-09-13T17:10:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c4bff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe9c006c610 0x7fe9c006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c4bff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe9c006c610 0x7fe9c006ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57974/0 (socket says 172.21.15.123:57974) 2024-09-13T17:10:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c4bff700 1 -- 172.21.15.123:0/4255275762 learned_addr learned my addr 172.21.15.123:0/4255275762 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c5400700 1 --2- 172.21.15.123:0/4255275762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9c00c9f80 0x7fe9c00c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c5c01700 1 --2- 172.21.15.123:0/4255275762 >> v2:172.21.15.153:3300/0 conn(0x7fe9c00cd690 0x7fe9c00cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c4bff700 1 -- 172.21.15.123:0/4255275762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9c00c9f80 msgr2=0x7fe9c00c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c4bff700 1 --2- 172.21.15.123:0/4255275762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9c00c9f80 0x7fe9c00c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c4bff700 1 -- 172.21.15.123:0/4255275762 >> v2:172.21.15.153:3300/0 conn(0x7fe9c00cd690 msgr2=0x7fe9c00cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c4bff700 1 --2- 172.21.15.123:0/4255275762 >> v2:172.21.15.153:3300/0 conn(0x7fe9c00cd690 0x7fe9c00cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c4bff700 1 -- 172.21.15.123:0/4255275762 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c00cae70 con 0x7fe9c006c610 2024-09-13T17:10:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c5c01700 1 --2- 172.21.15.123:0/4255275762 >> v2:172.21.15.153:3300/0 conn(0x7fe9c00cd690 0x7fe9c00cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.604+0000 7fe9c5400700 1 --2- 172.21.15.123:0/4255275762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9c00c9f80 0x7fe9c00c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9c4bff700 1 --2- 172.21.15.123:0/4255275762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9c006c610 0x7fe9c006ca70 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00bbe0 tx=0x7fe9bc00bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb704626a27731e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9b7fff700 1 -- 172.21.15.123:0/4255275762 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc00dd60 con 0x7fe9c006c610 2024-09-13T17:10:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9b7fff700 1 -- 172.21.15.123:0/4255275762 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc010470 con 0x7fe9c006c610 2024-09-13T17:10:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9b7fff700 1 -- 172.21.15.123:0/4255275762 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc010800 con 0x7fe9c006c610 2024-09-13T17:10:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9c6402700 1 -- 172.21.15.123:0/4255275762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9c006c610 msgr2=0x7fe9c006ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9c6402700 1 --2- 172.21.15.123:0/4255275762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9c006c610 0x7fe9c006ca70 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00bbe0 tx=0x7fe9bc00bef0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9c6402700 1 -- 172.21.15.123:0/4255275762 shutdown_connections 2024-09-13T17:10:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9c6402700 1 --2- 172.21.15.123:0/4255275762 >> v2:172.21.15.153:3300/0 conn(0x7fe9c00cd690 0x7fe9c00cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9c6402700 1 --2- 172.21.15.123:0/4255275762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9c006c610 0x7fe9c006ca70 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9c6402700 1 --2- 172.21.15.123:0/4255275762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9c00c9f80 0x7fe9c00c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9c6402700 1 -- 172.21.15.123:0/4255275762 >> 172.21.15.123:0/4255275762 conn(0x7fe9c00b01d0 msgr2=0x7fe9c00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9c6402700 1 -- 172.21.15.123:0/4255275762 shutdown_connections 2024-09-13T17:10:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9c6402700 1 -- 172.21.15.123:0/4255275762 wait complete. 2024-09-13T17:10:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9c6402700 1 Processor -- start 2024-09-13T17:10:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.608+0000 7fe9c6402700 1 -- start start 2024-09-13T17:10:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c6402700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9c006c610 0x7fe9c014f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c6402700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9c00c9f80 0x7fe9c0153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c6402700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9c00cd690 0x7fe9c00b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c6402700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c014f9f0 con 0x7fe9c00cd690 2024-09-13T17:10:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c6402700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c00c6cd0 con 0x7fe9c006c610 2024-09-13T17:10:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c6402700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c00c6fb0 con 0x7fe9c00c9f80 2024-09-13T17:10:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c5c01700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9c00cd690 0x7fe9c00b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c5c01700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9c00cd690 0x7fe9c00b3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57984/0 (socket says 172.21.15.123:57984) 2024-09-13T17:10:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c5c01700 1 -- 172.21.15.123:0/1853422249 learned_addr learned my addr 172.21.15.123:0/1853422249 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c4bff700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9c00c9f80 0x7fe9c0153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c5400700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9c006c610 0x7fe9c014f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c5c01700 1 -- 172.21.15.123:0/1853422249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9c00c9f80 msgr2=0x7fe9c0153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c5c01700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9c00c9f80 0x7fe9c0153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c5c01700 1 -- 172.21.15.123:0/1853422249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9c006c610 msgr2=0x7fe9c014f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c5c01700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9c006c610 0x7fe9c014f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c5c01700 1 -- 172.21.15.123:0/1853422249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9bc00b810 con 0x7fe9c00cd690 2024-09-13T17:10:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c5400700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9c006c610 0x7fe9c014f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c5c01700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9c00cd690 0x7fe9c00b3060 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800cd50 tx=0x7fe9b800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:55.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9b5ffb700 1 -- 172.21.15.123:0/1853422249 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b800cea0 con 0x7fe9c00cd690 2024-09-13T17:10:55.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c6402700 1 -- 172.21.15.123:0/1853422249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c00c7290 con 0x7fe9c00cd690 2024-09-13T17:10:55.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9b5ffb700 1 -- 172.21.15.123:0/1853422249 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b800f480 con 0x7fe9c00cd690 2024-09-13T17:10:55.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9b5ffb700 1 -- 172.21.15.123:0/1853422249 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b800f810 con 0x7fe9c00cd690 2024-09-13T17:10:55.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c6402700 1 -- 172.21.15.123:0/1853422249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c00c7850 con 0x7fe9c00cd690 2024-09-13T17:10:55.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9c6402700 1 -- 172.21.15.123:0/1853422249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c00c7a40 con 0x7fe9c00cd690 2024-09-13T17:10:55.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.612+0000 7fe9b5ffb700 1 -- 172.21.15.123:0/1853422249 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe9b800b040 con 0x7fe9c00cd690 2024-09-13T17:10:55.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.616+0000 7fe9b5ffb700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe9a4066730 0x7fe9a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.616+0000 7fe9b5ffb700 1 -- 172.21.15.123:0/1853422249 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe9b80846c0 con 0x7fe9c00cd690 2024-09-13T17:10:55.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.616+0000 7fe9c5400700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe9a4066730 0x7fe9a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.616+0000 7fe9c5400700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe9a4066730 0x7fe9a4068bf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0006bc0 tx=0x7fe9b0008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:55.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.624+0000 7fe9b5ffb700 1 -- 172.21.15.123:0/1853422249 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe9b8051ca0 con 0x7fe9c00cd690 2024-09-13T17:10:55.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.792+0000 7fe9c6402700 1 -- 172.21.15.123:0/1853422249 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9c015abc0 con 0x7fe9a4066730 2024-09-13T17:10:55.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.792+0000 7fe9b5ffb700 1 -- 172.21.15.123:0/1853422249 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe9b000a760 con 0x7fe9a4066730 2024-09-13T17:10:55.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.796+0000 7fe9c6402700 1 -- 172.21.15.123:0/1853422249 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe9a4066730 msgr2=0x7fe9a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.796+0000 7fe9c6402700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe9a4066730 0x7fe9a4068bf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0006bc0 tx=0x7fe9b0008040 comp rx=0 tx=0).stop 2024-09-13T17:10:55.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.796+0000 7fe9c6402700 1 -- 172.21.15.123:0/1853422249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9c00cd690 msgr2=0x7fe9c00b3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.796+0000 7fe9c6402700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9c00cd690 0x7fe9c00b3060 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800cd50 tx=0x7fe9b800a560 comp rx=0 tx=0).stop 2024-09-13T17:10:55.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.796+0000 7fe9c6402700 1 -- 172.21.15.123:0/1853422249 shutdown_connections 2024-09-13T17:10:55.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.796+0000 7fe9c6402700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe9a4066730 0x7fe9a4068bf0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.796+0000 7fe9c6402700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9c00cd690 0x7fe9c00b3060 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.796+0000 7fe9c6402700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe9c00c9f80 0x7fe9c0153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.796+0000 7fe9c6402700 1 --2- 172.21.15.123:0/1853422249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9c006c610 0x7fe9c014f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.796+0000 7fe9c6402700 1 -- 172.21.15.123:0/1853422249 >> 172.21.15.123:0/1853422249 conn(0x7fe9c00b01d0 msgr2=0x7fe9c015b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:55.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.796+0000 7fe9c6402700 1 -- 172.21.15.123:0/1853422249 shutdown_connections 2024-09-13T17:10:55.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.796+0000 7fe9c6402700 1 -- 172.21.15.123:0/1853422249 wait complete. 2024-09-13T17:10:55.799 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T17:10:55.810 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T17:10:55.811 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:10:55.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.920+0000 7fbc7ac85700 1 Processor -- start 2024-09-13T17:10:55.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.920+0000 7fbc7ac85700 1 -- start start 2024-09-13T17:10:55.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbc74159780 0x7fbc7406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc74159b60 0x7fbc740b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc74072030 0x7fbc740b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7406d800 con 0x7fbc74159b60 2024-09-13T17:10:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7406dae0 con 0x7fbc74159780 2024-09-13T17:10:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7406ddc0 con 0x7fbc74072030 2024-09-13T17:10:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc79482700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc74159b60 0x7fbc740b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc79482700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc74159b60 0x7fbc740b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57988/0 (socket says 172.21.15.123:57988) 2024-09-13T17:10:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc79482700 1 -- 172.21.15.123:0/907260282 learned_addr learned my addr 172.21.15.123:0/907260282 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7a484700 1 --2- 172.21.15.123:0/907260282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc74072030 0x7fbc740b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc79c83700 1 --2- 172.21.15.123:0/907260282 >> v2:172.21.15.153:3300/0 conn(0x7fbc74159780 0x7fbc7406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc79482700 1 -- 172.21.15.123:0/907260282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc74072030 msgr2=0x7fbc740b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc79482700 1 --2- 172.21.15.123:0/907260282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc74072030 0x7fbc740b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc79482700 1 -- 172.21.15.123:0/907260282 >> v2:172.21.15.153:3300/0 conn(0x7fbc74159780 msgr2=0x7fbc7406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc79482700 1 --2- 172.21.15.123:0/907260282 >> v2:172.21.15.153:3300/0 conn(0x7fbc74159780 0x7fbc7406cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc79482700 1 -- 172.21.15.123:0/907260282 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc74159fe0 con 0x7fbc74159b60 2024-09-13T17:10:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc79482700 1 --2- 172.21.15.123:0/907260282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc74159b60 0x7fbc740b14b0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fbc7406c910 tx=0x7fbc64009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42de54e919f40cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc78c81700 1 -- 172.21.15.123:0/907260282 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64011830 con 0x7fbc74159b60 2024-09-13T17:10:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc78c81700 1 -- 172.21.15.123:0/907260282 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc64011990 con 0x7fbc74159b60 2024-09-13T17:10:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc78c81700 1 -- 172.21.15.123:0/907260282 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64011d20 con 0x7fbc74159b60 2024-09-13T17:10:55.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 -- 172.21.15.123:0/907260282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc74159b60 msgr2=0x7fbc740b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 --2- 172.21.15.123:0/907260282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc74159b60 0x7fbc740b14b0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fbc7406c910 tx=0x7fbc64009bf0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 -- 172.21.15.123:0/907260282 shutdown_connections 2024-09-13T17:10:55.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 --2- 172.21.15.123:0/907260282 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc74072030 0x7fbc740b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 --2- 172.21.15.123:0/907260282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc74159b60 0x7fbc740b14b0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 --2- 172.21.15.123:0/907260282 >> v2:172.21.15.153:3300/0 conn(0x7fbc74159780 0x7fbc7406cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 -- 172.21.15.123:0/907260282 >> 172.21.15.123:0/907260282 conn(0x7fbc740737d0 msgr2=0x7fbc7406a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:55.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 -- 172.21.15.123:0/907260282 shutdown_connections 2024-09-13T17:10:55.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.924+0000 7fbc7ac85700 1 -- 172.21.15.123:0/907260282 wait complete. 2024-09-13T17:10:55.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc7ac85700 1 Processor -- start 2024-09-13T17:10:55.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc7ac85700 1 -- start start 2024-09-13T17:10:55.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc7ac85700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc74072030 0x7fbc741515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc7ac85700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc74159780 0x7fbc7406f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc7ac85700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc74159b60 0x7fbc740aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc7ac85700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74146180 con 0x7fbc74159b60 2024-09-13T17:10:55.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc7ac85700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74151b30 con 0x7fbc74159780 2024-09-13T17:10:55.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc7ac85700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74151e00 con 0x7fbc74072030 2024-09-13T17:10:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc7a484700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc74159b60 0x7fbc740aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc79c83700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc74072030 0x7fbc741515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc79482700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc74159780 0x7fbc7406f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc79c83700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc74072030 0x7fbc741515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:49912/0 (socket says 172.21.15.123:49912) 2024-09-13T17:10:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc79c83700 1 -- 172.21.15.123:0/3019640012 learned_addr learned my addr 172.21.15.123:0/3019640012 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc7a484700 1 -- 172.21.15.123:0/3019640012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc74072030 msgr2=0x7fbc741515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc7a484700 1 --2- 172.21.15.123:0/3019640012 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc74072030 0x7fbc741515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc7a484700 1 -- 172.21.15.123:0/3019640012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc74159780 msgr2=0x7fbc7406f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc7a484700 1 --2- 172.21.15.123:0/3019640012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc74159780 0x7fbc7406f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.928+0000 7fbc7a484700 1 -- 172.21.15.123:0/3019640012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc64009570 con 0x7fbc74159b60 2024-09-13T17:10:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.932+0000 7fbc7a484700 1 --2- 172.21.15.123:0/3019640012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc74159b60 0x7fbc740aeb00 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00efc0 tx=0x7fbc6c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.932+0000 7fbc6a7fc700 1 -- 172.21.15.123:0/3019640012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00cc90 con 0x7fbc74159b60 2024-09-13T17:10:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.932+0000 7fbc6a7fc700 1 -- 172.21.15.123:0/3019640012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c00f040 con 0x7fbc74159b60 2024-09-13T17:10:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.932+0000 7fbc7ac85700 1 -- 172.21.15.123:0/3019640012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc741520e0 con 0x7fbc74159b60 2024-09-13T17:10:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.932+0000 7fbc6a7fc700 1 -- 172.21.15.123:0/3019640012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0146c0 con 0x7fbc74159b60 2024-09-13T17:10:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.932+0000 7fbc7ac85700 1 -- 172.21.15.123:0/3019640012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7406fa30 con 0x7fbc74159b60 2024-09-13T17:10:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.932+0000 7fbc7ac85700 1 -- 172.21.15.123:0/3019640012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc74158240 con 0x7fbc74159b60 2024-09-13T17:10:55.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.932+0000 7fbc6a7fc700 1 -- 172.21.15.123:0/3019640012 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbc6c014820 con 0x7fbc74159b60 2024-09-13T17:10:55.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.932+0000 7fbc6a7fc700 1 --2- 172.21.15.123:0/3019640012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbc58066730 0x7fbc58068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.936+0000 7fbc6a7fc700 1 -- 172.21.15.123:0/3019640012 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbc6c084980 con 0x7fbc74159b60 2024-09-13T17:10:55.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.936+0000 7fbc79c83700 1 --2- 172.21.15.123:0/3019640012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbc58066730 0x7fbc58068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.936+0000 7fbc6a7fc700 1 --2- 172.21.15.123:0/3019640012 >> [v2:172.21.15.123:6816/2789168215,v1:172.21.15.123:6817/2789168215] conn(0x7fbc5806c590 0x7fbc5806e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:55.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.936+0000 7fbc6a7fc700 1 -- 172.21.15.123:0/3019640012 --> [v2:172.21.15.123:6816/2789168215,v1:172.21.15.123:6817/2789168215] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc5806f060 con 0x7fbc5806c590 2024-09-13T17:10:55.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.936+0000 7fbc6a7fc700 1 -- 172.21.15.123:0/3019640012 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc6c0892c0 con 0x7fbc74159b60 2024-09-13T17:10:55.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.936+0000 7fbc79482700 1 --2- 172.21.15.123:0/3019640012 >> [v2:172.21.15.123:6816/2789168215,v1:172.21.15.123:6817/2789168215] conn(0x7fbc5806c590 0x7fbc5806e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:55.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.936+0000 7fbc79482700 1 --2- 172.21.15.123:0/3019640012 >> [v2:172.21.15.123:6816/2789168215,v1:172.21.15.123:6817/2789168215] conn(0x7fbc5806c590 0x7fbc5806e9b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:55.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.936+0000 7fbc79c83700 1 --2- 172.21.15.123:0/3019640012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbc58066730 0x7fbc58068bf0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbc74157bf0 tx=0x7fbc70009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:55.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.936+0000 7fbc6a7fc700 1 -- 172.21.15.123:0/3019640012 <== osd.2 v2:172.21.15.123:6816/2789168215 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbc5806f060 con 0x7fbc5806c590 2024-09-13T17:10:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.952+0000 7fbc7ac85700 1 -- 172.21.15.123:0/3019640012 --> [v2:172.21.15.123:6816/2789168215,v1:172.21.15.123:6817/2789168215] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbc740cf970 con 0x7fbc5806c590 2024-09-13T17:10:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.952+0000 7fbc6a7fc700 1 -- 172.21.15.123:0/3019640012 <== osd.2 v2:172.21.15.123:6816/2789168215 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbc740cf970 con 0x7fbc5806c590 2024-09-13T17:10:55.956 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:10:55.956 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:10:55.956 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:10:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.952+0000 7fbc7ac85700 1 -- 172.21.15.123:0/3019640012 >> [v2:172.21.15.123:6816/2789168215,v1:172.21.15.123:6817/2789168215] conn(0x7fbc5806c590 msgr2=0x7fbc5806e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.952+0000 7fbc7ac85700 1 --2- 172.21.15.123:0/3019640012 >> [v2:172.21.15.123:6816/2789168215,v1:172.21.15.123:6817/2789168215] conn(0x7fbc5806c590 0x7fbc5806e9b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.952+0000 7fbc7ac85700 1 -- 172.21.15.123:0/3019640012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbc58066730 msgr2=0x7fbc58068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.952+0000 7fbc7ac85700 1 --2- 172.21.15.123:0/3019640012 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbc58066730 0x7fbc58068bf0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbc74157bf0 tx=0x7fbc70009240 comp rx=0 tx=0).stop 2024-09-13T17:10:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.952+0000 7fbc7ac85700 1 -- 172.21.15.123:0/3019640012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc74159b60 msgr2=0x7fbc740aeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.952+0000 7fbc7ac85700 1 --2- 172.21.15.123:0/3019640012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc74159b60 0x7fbc740aeb00 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00efc0 tx=0x7fbc6c00c3a0 comp rx=0 tx=0).stop 2024-09-13T17:10:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.952+0000 7fbc7a484700 1 -- 172.21.15.123:0/3019640012 reap_dead start 2024-09-13T17:10:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.952+0000 7fbc7ac85700 1 -- 172.21.15.123:0/3019640012 shutdown_connections 2024-09-13T17:10:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.952+0000 7fbc7ac85700 1 -- 172.21.15.123:0/3019640012 >> 172.21.15.123:0/3019640012 conn(0x7fbc740737d0 msgr2=0x7fbc7406a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.952+0000 7fbc7ac85700 1 -- 172.21.15.123:0/3019640012 shutdown_connections 2024-09-13T17:10:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:55.952+0000 7fbc7ac85700 1 -- 172.21.15.123:0/3019640012 wait complete. 2024-09-13T17:10:55.968 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T17:10:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.080+0000 7fb67285a700 1 Processor -- start 2024-09-13T17:10:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb67285a700 1 -- start start 2024-09-13T17:10:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb67285a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb66c0c8cd0 0x7fb66c0ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb67285a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb66c0c1280 0x7fb66c0c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb67285a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c0c93b0 con 0x7fb66c0cb090 2024-09-13T17:10:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb67285a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66c0cae90 con 0x7fb66c0c8cd0 2024-09-13T17:10:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb67285a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0cc580 con 0x7fb66c0c1280 2024-09-13T17:10:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb672059700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb66c0c1280 0x7fb66c0c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb672059700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb66c0c1280 0x7fb66c0c1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:49926/0 (socket says 172.21.15.123:49926) 2024-09-13T17:10:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb672059700 1 -- 172.21.15.123:0/3581787309 learned_addr learned my addr 172.21.15.123:0/3581787309 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb671057700 1 --2- 172.21.15.123:0/3581787309 >> v2:172.21.15.153:3300/0 conn(0x7fb66c0c8cd0 0x7fb66c0ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb672059700 1 -- 172.21.15.123:0/3581787309 >> v2:172.21.15.153:3300/0 conn(0x7fb66c0c8cd0 msgr2=0x7fb66c0ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:56.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb672059700 1 --2- 172.21.15.123:0/3581787309 >> v2:172.21.15.153:3300/0 conn(0x7fb66c0c8cd0 0x7fb66c0ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb672059700 1 -- 172.21.15.123:0/3581787309 >> v1:172.21.15.153:6789/0 conn(0x7fb66c0cb090 legacy=0x7fb66c0cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb672059700 1 -- 172.21.15.123:0/3581787309 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c0cd100 con 0x7fb66c0c1280 2024-09-13T17:10:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb672059700 1 --2- 172.21.15.123:0/3581787309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb66c0c1280 0x7fb66c0c1710 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb664009910 tx=0x7fb664009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dadb828e97465b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb670856700 1 -- 172.21.15.123:0/3581787309 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664011830 con 0x7fb66c0c1280 2024-09-13T17:10:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb670856700 1 -- 172.21.15.123:0/3581787309 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb664011990 con 0x7fb66c0c1280 2024-09-13T17:10:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb670856700 1 -- 172.21.15.123:0/3581787309 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664011d40 con 0x7fb66c0c1280 2024-09-13T17:10:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb67285a700 1 -- 172.21.15.123:0/3581787309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb66c0c1280 msgr2=0x7fb66c0c1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb67285a700 1 --2- 172.21.15.123:0/3581787309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb66c0c1280 0x7fb66c0c1710 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb664009910 tx=0x7fb664009c20 comp rx=0 tx=0).stop 2024-09-13T17:10:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb67285a700 1 -- 172.21.15.123:0/3581787309 shutdown_connections 2024-09-13T17:10:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb67285a700 1 --2- 172.21.15.123:0/3581787309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb66c0c1280 0x7fb66c0c1710 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb67285a700 1 --2- 172.21.15.123:0/3581787309 >> v2:172.21.15.153:3300/0 conn(0x7fb66c0c8cd0 0x7fb66c0ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb67285a700 1 -- 172.21.15.123:0/3581787309 >> 172.21.15.123:0/3581787309 conn(0x7fb66c0b01d0 msgr2=0x7fb66c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb67285a700 1 -- 172.21.15.123:0/3581787309 shutdown_connections 2024-09-13T17:10:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.084+0000 7fb67285a700 1 -- 172.21.15.123:0/3581787309 wait complete. 2024-09-13T17:10:56.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb67285a700 1 Processor -- start 2024-09-13T17:10:56.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb67285a700 1 -- start start 2024-09-13T17:10:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb67285a700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb66c0c1280 0x7fb66c1f9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb67285a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb66c0c8cd0 0x7fb66c160690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb67285a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb66c0cb090 0x7fb66c160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb67285a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c1f8300 con 0x7fb66c0cb090 2024-09-13T17:10:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb67285a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c164760 con 0x7fb66c0c8cd0 2024-09-13T17:10:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb67285a700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0c6d50 con 0x7fb66c0c1280 2024-09-13T17:10:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb672059700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb66c0cb090 0x7fb66c160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb672059700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb66c0cb090 0x7fb66c160bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58000/0 (socket says 172.21.15.123:58000) 2024-09-13T17:10:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb672059700 1 -- 172.21.15.123:0/2351436218 learned_addr learned my addr 172.21.15.123:0/2351436218 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb671858700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb66c0c1280 0x7fb66c1f9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb671057700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb66c0c8cd0 0x7fb66c160690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb672059700 1 -- 172.21.15.123:0/2351436218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb66c0c1280 msgr2=0x7fb66c1f9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb672059700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb66c0c1280 0x7fb66c1f9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb672059700 1 -- 172.21.15.123:0/2351436218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb66c0c8cd0 msgr2=0x7fb66c160690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb672059700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb66c0c8cd0 0x7fb66c160690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb672059700 1 -- 172.21.15.123:0/2351436218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb664009570 con 0x7fb66c0cb090 2024-09-13T17:10:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb671057700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb66c0c8cd0 0x7fb66c160690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb672059700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb66c0cb090 0x7fb66c160bd0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0cc6c0 tx=0x7fb664004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb6627fc700 1 -- 172.21.15.123:0/2351436218 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664004590 con 0x7fb66c0cb090 2024-09-13T17:10:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb67285a700 1 -- 172.21.15.123:0/2351436218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c0c6ff0 con 0x7fb66c0cb090 2024-09-13T17:10:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb67285a700 1 -- 172.21.15.123:0/2351436218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c0c75b0 con 0x7fb66c0cb090 2024-09-13T17:10:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb6627fc700 1 -- 172.21.15.123:0/2351436218 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66401e070 con 0x7fb66c0cb090 2024-09-13T17:10:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.088+0000 7fb6627fc700 1 -- 172.21.15.123:0/2351436218 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640038c0 con 0x7fb66c0cb090 2024-09-13T17:10:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.092+0000 7fb67285a700 1 -- 172.21.15.123:0/2351436218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb654005310 con 0x7fb66c0cb090 2024-09-13T17:10:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.092+0000 7fb6627fc700 1 -- 172.21.15.123:0/2351436218 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb664003a20 con 0x7fb66c0cb090 2024-09-13T17:10:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.092+0000 7fb6627fc700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb650066760 0x7fb650068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.092+0000 7fb6627fc700 1 -- 172.21.15.123:0/2351436218 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb664084db0 con 0x7fb66c0cb090 2024-09-13T17:10:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.092+0000 7fb671858700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb650066760 0x7fb650068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.092+0000 7fb671858700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb650066760 0x7fb650068c20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0cf660 tx=0x7fb65c009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.100+0000 7fb6627fc700 1 -- 172.21.15.123:0/2351436218 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb6640524f0 con 0x7fb66c0cb090 2024-09-13T17:10:56.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.272+0000 7fb67285a700 1 -- 172.21.15.123:0/2351436218 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb654000bc0 con 0x7fb650066760 2024-09-13T17:10:56.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.272+0000 7fb6627fc700 1 -- 172.21.15.123:0/2351436218 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb654000bc0 con 0x7fb650066760 2024-09-13T17:10:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.276+0000 7fb67285a700 1 -- 172.21.15.123:0/2351436218 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb650066760 msgr2=0x7fb650068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.276+0000 7fb67285a700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb650066760 0x7fb650068c20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0cf660 tx=0x7fb65c009040 comp rx=0 tx=0).stop 2024-09-13T17:10:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.276+0000 7fb67285a700 1 -- 172.21.15.123:0/2351436218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb66c0cb090 msgr2=0x7fb66c160bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.276+0000 7fb67285a700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb66c0cb090 0x7fb66c160bd0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0cc6c0 tx=0x7fb664004770 comp rx=0 tx=0).stop 2024-09-13T17:10:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.276+0000 7fb67285a700 1 -- 172.21.15.123:0/2351436218 shutdown_connections 2024-09-13T17:10:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.276+0000 7fb67285a700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fb650066760 0x7fb650068c20 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.276+0000 7fb67285a700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb66c0cb090 0x7fb66c160bd0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.276+0000 7fb67285a700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb66c0c8cd0 0x7fb66c160690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.276+0000 7fb67285a700 1 --2- 172.21.15.123:0/2351436218 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb66c0c1280 0x7fb66c1f9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.276+0000 7fb67285a700 1 -- 172.21.15.123:0/2351436218 >> 172.21.15.123:0/2351436218 conn(0x7fb66c0b01d0 msgr2=0x7fb66c06cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.276+0000 7fb67285a700 1 -- 172.21.15.123:0/2351436218 shutdown_connections 2024-09-13T17:10:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.276+0000 7fb67285a700 1 -- 172.21.15.123:0/2351436218 wait complete. 2024-09-13T17:10:56.279 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T17:10:56.290 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T17:10:56.291 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:10:56.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.404+0000 7f157ffff700 1 Processor -- start 2024-09-13T17:10:56.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.404+0000 7f157ffff700 1 -- start start 2024-09-13T17:10:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f158015cdd0 0x7f15800d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f15800d1580 0x7f15800ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157ffff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15800ce020 con 0x7f15800cf6b0 2024-09-13T17:10:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157ffff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15800d3cb0 con 0x7f15800d1580 2024-09-13T17:10:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157ffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15800cd750 con 0x7f158015cdd0 2024-09-13T17:10:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157e7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f15800d1580 0x7f15800ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157effd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f158015cdd0 0x7f15800d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157f7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f15800cf6b0 0x7f15800b2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:48718/0 (socket says 172.21.15.123:48718) 2024-09-13T17:10:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157e7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f15800d1580 0x7f15800ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:45792/0 (socket says 172.21.15.123:45792) 2024-09-13T17:10:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157f7fe700 1 -- 172.21.15.123:0/2531221156 learned_addr learned my addr 172.21.15.123:0/2531221156 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157effd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f158015cdd0 0x7f15800d33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:49948/0 (socket says 172.21.15.123:49948) 2024-09-13T17:10:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157dffb700 1 -- 172.21.15.123:0/2531221156 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744862402 0 0) 0x7f15800ce020 con 0x7f15800cf6b0 2024-09-13T17:10:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157effd700 1 -- 172.21.15.123:0/2531221156 >> v2:172.21.15.153:3300/0 conn(0x7f15800d1580 msgr2=0x7f15800ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157effd700 1 --2- 172.21.15.123:0/2531221156 >> v2:172.21.15.153:3300/0 conn(0x7f15800d1580 0x7f15800ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157effd700 1 -- 172.21.15.123:0/2531221156 >> v1:172.21.15.153:6789/0 conn(0x7f15800cf6b0 legacy=0x7f15800b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157effd700 1 -- 172.21.15.123:0/2531221156 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158015d1b0 con 0x7f158015cdd0 2024-09-13T17:10:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157e7fc700 1 --2- 172.21.15.123:0/2531221156 >> v2:172.21.15.153:3300/0 conn(0x7f15800d1580 0x7f15800ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:56.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157effd700 1 --2- 172.21.15.123:0/2531221156 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f158015cdd0 0x7f15800d33f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1574009850 tx=0x7f1574009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b96f578093f8d80b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:56.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157dffb700 1 -- 172.21.15.123:0/2531221156 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1574011830 con 0x7f158015cdd0 2024-09-13T17:10:56.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157dffb700 1 -- 172.21.15.123:0/2531221156 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1574011990 con 0x7f158015cdd0 2024-09-13T17:10:56.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157dffb700 1 -- 172.21.15.123:0/2531221156 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1574011d40 con 0x7f158015cdd0 2024-09-13T17:10:56.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157ffff700 1 -- 172.21.15.123:0/2531221156 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f158015cdd0 msgr2=0x7f15800d33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157ffff700 1 --2- 172.21.15.123:0/2531221156 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f158015cdd0 0x7f15800d33f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1574009850 tx=0x7f1574009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:56.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157ffff700 1 -- 172.21.15.123:0/2531221156 shutdown_connections 2024-09-13T17:10:56.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157ffff700 1 --2- 172.21.15.123:0/2531221156 >> v2:172.21.15.153:3300/0 conn(0x7f15800d1580 0x7f15800ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157ffff700 1 --2- 172.21.15.123:0/2531221156 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f158015cdd0 0x7f15800d33f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157ffff700 1 -- 172.21.15.123:0/2531221156 >> 172.21.15.123:0/2531221156 conn(0x7f158009c010 msgr2=0x7f15800d2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:56.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157ffff700 1 -- 172.21.15.123:0/2531221156 shutdown_connections 2024-09-13T17:10:56.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.408+0000 7f157ffff700 1 -- 172.21.15.123:0/2531221156 wait complete. 2024-09-13T17:10:56.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157ffff700 1 Processor -- start 2024-09-13T17:10:56.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157ffff700 1 -- start start 2024-09-13T17:10:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15800cf6b0 0x7f158015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15800d1580 0x7f1580151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f158015cdd0 0x7f1580156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157ffff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1580152480 con 0x7f15800d1580 2024-09-13T17:10:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157ffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1580157e10 con 0x7f15800cf6b0 2024-09-13T17:10:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157ffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1580157850 con 0x7f158015cdd0 2024-09-13T17:10:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15800d1580 0x7f1580151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15800d1580 0x7f1580151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58002/0 (socket says 172.21.15.123:58002) 2024-09-13T17:10:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157e7fc700 1 -- 172.21.15.123:0/3993135242 learned_addr learned my addr 172.21.15.123:0/3993135242 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157f7fe700 1 --2- 172.21.15.123:0/3993135242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f158015cdd0 0x7f1580156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157effd700 1 --2- 172.21.15.123:0/3993135242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15800cf6b0 0x7f158015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157e7fc700 1 -- 172.21.15.123:0/3993135242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f158015cdd0 msgr2=0x7f1580156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157e7fc700 1 --2- 172.21.15.123:0/3993135242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f158015cdd0 0x7f1580156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157e7fc700 1 -- 172.21.15.123:0/3993135242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15800cf6b0 msgr2=0x7f158015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157e7fc700 1 --2- 172.21.15.123:0/3993135242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15800cf6b0 0x7f158015fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.412+0000 7f157e7fc700 1 -- 172.21.15.123:0/3993135242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15700094b0 con 0x7f15800d1580 2024-09-13T17:10:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.416+0000 7f157e7fc700 1 --2- 172.21.15.123:0/3993135242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15800d1580 0x7f1580151f40 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f157000ebb0 tx=0x7f157000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.416+0000 7f15677fe700 1 -- 172.21.15.123:0/3993135242 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157000c850 con 0x7f15800d1580 2024-09-13T17:10:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.416+0000 7f15677fe700 1 -- 172.21.15.123:0/3993135242 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157000c9b0 con 0x7f15800d1580 2024-09-13T17:10:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.416+0000 7f157ffff700 1 -- 172.21.15.123:0/3993135242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15740094b0 con 0x7f15800d1580 2024-09-13T17:10:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.416+0000 7f15677fe700 1 -- 172.21.15.123:0/3993135242 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157000cd40 con 0x7f15800d1580 2024-09-13T17:10:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.416+0000 7f157ffff700 1 -- 172.21.15.123:0/3993135242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158015f2d0 con 0x7f15800d1580 2024-09-13T17:10:56.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.416+0000 7f157ffff700 1 -- 172.21.15.123:0/3993135242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15800ce6c0 con 0x7f15800d1580 2024-09-13T17:10:56.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.416+0000 7f15677fe700 1 -- 172.21.15.123:0/3993135242 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1570013470 con 0x7f15800d1580 2024-09-13T17:10:56.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.420+0000 7f15677fe700 1 --2- 172.21.15.123:0/3993135242 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f156c066730 0x7f156c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.420+0000 7f15677fe700 1 -- 172.21.15.123:0/3993135242 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1570084320 con 0x7f15800d1580 2024-09-13T17:10:56.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.420+0000 7f157effd700 1 --2- 172.21.15.123:0/3993135242 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f156c066730 0x7f156c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.420+0000 7f15677fe700 1 --2- 172.21.15.123:0/3993135242 >> [v2:172.21.15.123:6808/2512830091,v1:172.21.15.123:6809/2512830091] conn(0x7f156c06c590 0x7f156c06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.420+0000 7f15677fe700 1 -- 172.21.15.123:0/3993135242 --> [v2:172.21.15.123:6808/2512830091,v1:172.21.15.123:6809/2512830091] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f156c06f060 con 0x7f156c06c590 2024-09-13T17:10:56.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.420+0000 7f15677fe700 1 -- 172.21.15.123:0/3993135242 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1570084770 con 0x7f15800d1580 2024-09-13T17:10:56.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.420+0000 7f157f7fe700 1 --2- 172.21.15.123:0/3993135242 >> [v2:172.21.15.123:6808/2512830091,v1:172.21.15.123:6809/2512830091] conn(0x7f156c06c590 0x7f156c06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.420+0000 7f157f7fe700 1 --2- 172.21.15.123:0/3993135242 >> [v2:172.21.15.123:6808/2512830091,v1:172.21.15.123:6809/2512830091] conn(0x7f156c06c590 0x7f156c06e9b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:56.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.420+0000 7f157effd700 1 --2- 172.21.15.123:0/3993135242 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f156c066730 0x7f156c068bf0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f15740090b0 tx=0x7f157401c040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:56.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.420+0000 7f15677fe700 1 -- 172.21.15.123:0/3993135242 <== osd.3 v2:172.21.15.123:6808/2512830091 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f156c06f060 con 0x7f156c06c590 2024-09-13T17:10:56.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.440+0000 7f157ffff700 1 -- 172.21.15.123:0/3993135242 --> [v2:172.21.15.123:6808/2512830091,v1:172.21.15.123:6809/2512830091] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f15800cdcb0 con 0x7f156c06c590 2024-09-13T17:10:56.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.440+0000 7f15677fe700 1 -- 172.21.15.123:0/3993135242 <== osd.3 v2:172.21.15.123:6808/2512830091 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1578007150 con 0x7f156c06c590 2024-09-13T17:10:56.443 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:10:56.443 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:10:56.443 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:10:56.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.440+0000 7f157ffff700 1 -- 172.21.15.123:0/3993135242 >> [v2:172.21.15.123:6808/2512830091,v1:172.21.15.123:6809/2512830091] conn(0x7f156c06c590 msgr2=0x7f156c06e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.440+0000 7f157ffff700 1 --2- 172.21.15.123:0/3993135242 >> [v2:172.21.15.123:6808/2512830091,v1:172.21.15.123:6809/2512830091] conn(0x7f156c06c590 0x7f156c06e9b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.440+0000 7f157ffff700 1 -- 172.21.15.123:0/3993135242 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f156c066730 msgr2=0x7f156c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.440+0000 7f157ffff700 1 --2- 172.21.15.123:0/3993135242 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f156c066730 0x7f156c068bf0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f15740090b0 tx=0x7f157401c040 comp rx=0 tx=0).stop 2024-09-13T17:10:56.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.440+0000 7f157ffff700 1 -- 172.21.15.123:0/3993135242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15800d1580 msgr2=0x7f1580151f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.440+0000 7f157ffff700 1 --2- 172.21.15.123:0/3993135242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15800d1580 0x7f1580151f40 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f157000ebb0 tx=0x7f157000eec0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.440+0000 7f157f7fe700 1 -- 172.21.15.123:0/3993135242 reap_dead start 2024-09-13T17:10:56.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.440+0000 7f157ffff700 1 -- 172.21.15.123:0/3993135242 shutdown_connections 2024-09-13T17:10:56.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.440+0000 7f157ffff700 1 -- 172.21.15.123:0/3993135242 >> 172.21.15.123:0/3993135242 conn(0x7f158009c010 msgr2=0x7f15800d2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:56.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.440+0000 7f157ffff700 1 -- 172.21.15.123:0/3993135242 shutdown_connections 2024-09-13T17:10:56.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.440+0000 7f157ffff700 1 -- 172.21.15.123:0/3993135242 wait complete. 2024-09-13T17:10:56.456 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T17:10:56.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2bafe8700 1 Processor -- start 2024-09-13T17:10:56.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2bafe8700 1 -- start start 2024-09-13T17:10:56.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2bafe8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2b40b58b0 0x7fe2b40d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2bafe8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe2b40cd5e0 0x7fe2b40cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2bafe8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b40b0060 con 0x7fe2b40d0f40 2024-09-13T17:10:56.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2bafe8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b40b0340 con 0x7fe2b40cd5e0 2024-09-13T17:10:56.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2bafe8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40b0620 con 0x7fe2b40b58b0 2024-09-13T17:10:56.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2b9fe6700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe2b40d0f40 0x7fe2b40d1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53464/0 (socket says 172.21.15.123:53464) 2024-09-13T17:10:56.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2b9fe6700 1 -- 172.21.15.123:0/2096132705 learned_addr learned my addr 172.21.15.123:0/2096132705 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:56.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2ba7e7700 1 --2- 172.21.15.123:0/2096132705 >> v2:172.21.15.123:3300/0 conn(0x7fe2b40cd5e0 0x7fe2b40cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2b97e5700 1 --2- 172.21.15.123:0/2096132705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2b40b58b0 0x7fe2b40d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2b8fe4700 1 -- 172.21.15.123:0/2096132705 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467055351 0 0) 0x7fe2b40b0060 con 0x7fe2b40d0f40 2024-09-13T17:10:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2b8fe4700 1 -- 172.21.15.123:0/2096132705 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2a00035d0 con 0x7fe2b40d0f40 2024-09-13T17:10:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2ba7e7700 1 -- 172.21.15.123:0/2096132705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2b40b58b0 msgr2=0x7fe2b40d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2ba7e7700 1 --2- 172.21.15.123:0/2096132705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2b40b58b0 0x7fe2b40d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2ba7e7700 1 -- 172.21.15.123:0/2096132705 >> v1:172.21.15.123:6789/0 conn(0x7fe2b40d0f40 legacy=0x7fe2b40d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2ba7e7700 1 -- 172.21.15.123:0/2096132705 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40b0900 con 0x7fe2b40cd5e0 2024-09-13T17:10:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2ba7e7700 1 --2- 172.21.15.123:0/2096132705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b40cd5e0 0x7fe2b40cda30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fe29c009850 tx=0x7fe29c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5543ef4c6918afac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2b8fe4700 1 -- 172.21.15.123:0/2096132705 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c011830 con 0x7fe2b40cd5e0 2024-09-13T17:10:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2b8fe4700 1 -- 172.21.15.123:0/2096132705 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c011990 con 0x7fe2b40cd5e0 2024-09-13T17:10:56.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.572+0000 7fe2b8fe4700 1 -- 172.21.15.123:0/2096132705 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c011d40 con 0x7fe2b40cd5e0 2024-09-13T17:10:56.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.576+0000 7fe2bafe8700 1 -- 172.21.15.123:0/2096132705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b40cd5e0 msgr2=0x7fe2b40cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.576+0000 7fe2bafe8700 1 --2- 172.21.15.123:0/2096132705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b40cd5e0 0x7fe2b40cda30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fe29c009850 tx=0x7fe29c009b60 comp rx=0 tx=0).stop 2024-09-13T17:10:56.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.576+0000 7fe2bafe8700 1 -- 172.21.15.123:0/2096132705 shutdown_connections 2024-09-13T17:10:56.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.576+0000 7fe2bafe8700 1 --2- 172.21.15.123:0/2096132705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b40cd5e0 0x7fe2b40cda30 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.576+0000 7fe2bafe8700 1 --2- 172.21.15.123:0/2096132705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2b40b58b0 0x7fe2b40d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.576+0000 7fe2bafe8700 1 -- 172.21.15.123:0/2096132705 >> 172.21.15.123:0/2096132705 conn(0x7fe2b40d2a60 msgr2=0x7fe2b40d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:56.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.576+0000 7fe2bafe8700 1 -- 172.21.15.123:0/2096132705 shutdown_connections 2024-09-13T17:10:56.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.576+0000 7fe2bafe8700 1 -- 172.21.15.123:0/2096132705 wait complete. 2024-09-13T17:10:56.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.576+0000 7fe2bafe8700 1 Processor -- start 2024-09-13T17:10:56.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.576+0000 7fe2bafe8700 1 -- start start 2024-09-13T17:10:56.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2bafe8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b40b58b0 0x7fe2b40c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2bafe8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2b40cd5e0 0x7fe2b415bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2bafe8700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2b40d0f40 0x7fe2b40ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2bafe8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40b23c0 con 0x7fe2b40b58b0 2024-09-13T17:10:56.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2bafe8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40c7d60 con 0x7fe2b40cd5e0 2024-09-13T17:10:56.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2bafe8700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40caf00 con 0x7fe2b40d0f40 2024-09-13T17:10:56.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2b9fe6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b40b58b0 0x7fe2b40c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2b9fe6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b40b58b0 0x7fe2b40c7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58012/0 (socket says 172.21.15.123:58012) 2024-09-13T17:10:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2b9fe6700 1 -- 172.21.15.123:0/1269145024 learned_addr learned my addr 172.21.15.123:0/1269145024 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2ba7e7700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2b40d0f40 0x7fe2b40ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2b97e5700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2b40cd5e0 0x7fe2b415bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2b9fe6700 1 -- 172.21.15.123:0/1269145024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2b40d0f40 msgr2=0x7fe2b40ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2b9fe6700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2b40d0f40 0x7fe2b40ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2b9fe6700 1 -- 172.21.15.123:0/1269145024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2b40cd5e0 msgr2=0x7fe2b415bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2b9fe6700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2b40cd5e0 0x7fe2b415bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2b9fe6700 1 -- 172.21.15.123:0/1269145024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c0094b0 con 0x7fe2b40b58b0 2024-09-13T17:10:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2b97e5700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2b40cd5e0 0x7fe2b415bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2b9fe6700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b40b58b0 0x7fe2b40c7820 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00c4d0 tx=0x7fe2ac00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2b27fc700 1 -- 172.21.15.123:0/1269145024 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac005d90 con 0x7fe2b40b58b0 2024-09-13T17:10:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2bafe8700 1 -- 172.21.15.123:0/1269145024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b40b2610 con 0x7fe2b40b58b0 2024-09-13T17:10:56.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2b27fc700 1 -- 172.21.15.123:0/1269145024 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac0070d0 con 0x7fe2b40b58b0 2024-09-13T17:10:56.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2b27fc700 1 -- 172.21.15.123:0/1269145024 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac007480 con 0x7fe2b40b58b0 2024-09-13T17:10:56.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2bafe8700 1 -- 172.21.15.123:0/1269145024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b40b2bd0 con 0x7fe2b40b58b0 2024-09-13T17:10:56.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.580+0000 7fe2bafe8700 1 -- 172.21.15.123:0/1269145024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b40b0060 con 0x7fe2b40b58b0 2024-09-13T17:10:56.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.584+0000 7fe2b27fc700 1 -- 172.21.15.123:0/1269145024 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2ac0075e0 con 0x7fe2b40b58b0 2024-09-13T17:10:56.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.584+0000 7fe2b27fc700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe294066760 0x7fe294068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.584+0000 7fe2b27fc700 1 -- 172.21.15.123:0/1269145024 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe2ac0833c0 con 0x7fe2b40b58b0 2024-09-13T17:10:56.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.584+0000 7fe2b97e5700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe294066760 0x7fe294068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.584+0000 7fe2b97e5700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe294066760 0x7fe294068c20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40b4bb0 tx=0x7fe2a400b040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:56.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.588+0000 7fe2b27fc700 1 -- 172.21.15.123:0/1269145024 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe2ac050a40 con 0x7fe2b40b58b0 2024-09-13T17:10:56.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.756+0000 7fe2bafe8700 1 -- 172.21.15.123:0/1269145024 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2b415ce70 con 0x7fe294066760 2024-09-13T17:10:56.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.760+0000 7fe2b27fc700 1 -- 172.21.15.123:0/1269145024 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe2a4007da0 con 0x7fe294066760 2024-09-13T17:10:56.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.764+0000 7fe2bafe8700 1 -- 172.21.15.123:0/1269145024 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe294066760 msgr2=0x7fe294068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.764+0000 7fe2bafe8700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe294066760 0x7fe294068c20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40b4bb0 tx=0x7fe2a400b040 comp rx=0 tx=0).stop 2024-09-13T17:10:56.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.764+0000 7fe2bafe8700 1 -- 172.21.15.123:0/1269145024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b40b58b0 msgr2=0x7fe2b40c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.764+0000 7fe2bafe8700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b40b58b0 0x7fe2b40c7820 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00c4d0 tx=0x7fe2ac00c890 comp rx=0 tx=0).stop 2024-09-13T17:10:56.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.764+0000 7fe2bafe8700 1 -- 172.21.15.123:0/1269145024 shutdown_connections 2024-09-13T17:10:56.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.764+0000 7fe2bafe8700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fe294066760 0x7fe294068c20 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.764+0000 7fe2bafe8700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe2b40d0f40 0x7fe2b40ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.764+0000 7fe2bafe8700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2b40cd5e0 0x7fe2b415bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.764+0000 7fe2bafe8700 1 --2- 172.21.15.123:0/1269145024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b40b58b0 0x7fe2b40c7820 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.764+0000 7fe2bafe8700 1 -- 172.21.15.123:0/1269145024 >> 172.21.15.123:0/1269145024 conn(0x7fe2b40d2a60 msgr2=0x7fe2b40cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:56.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.764+0000 7fe2bafe8700 1 -- 172.21.15.123:0/1269145024 shutdown_connections 2024-09-13T17:10:56.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.764+0000 7fe2bafe8700 1 -- 172.21.15.123:0/1269145024 wait complete. 2024-09-13T17:10:56.768 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T17:10:56.782 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T17:10:56.782 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:10:56.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.904+0000 7fc8b5c52700 1 Processor -- start 2024-09-13T17:10:56.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.904+0000 7fc8b5c52700 1 -- start start 2024-09-13T17:10:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5c52700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8b006f990 0x7fc8b0161170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5c52700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b00b4ce0 con 0x7fc8b006acb0 2024-09-13T17:10:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5c52700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b00b4750 con 0x7fc8b015c7d0 2024-09-13T17:10:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5c52700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b00b4a00 con 0x7fc8b006f990 2024-09-13T17:10:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8a7fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc8b006acb0 0x7fc8b006f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53472/0 (socket says 172.21.15.123:53472) 2024-09-13T17:10:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8a7fff700 1 -- 172.21.15.123:0/3773906571 learned_addr learned my addr 172.21.15.123:0/3773906571 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5451700 1 --2- 172.21.15.123:0/3773906571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8b006f990 0x7fc8b0161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8a77fe700 1 -- 172.21.15.123:0/3773906571 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747775100 0 0) 0x7fc8b00b4ce0 con 0x7fc8b006acb0 2024-09-13T17:10:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8a77fe700 1 -- 172.21.15.123:0/3773906571 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8980035d0 con 0x7fc8b006acb0 2024-09-13T17:10:56.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5451700 1 -- 172.21.15.123:0/3773906571 >> v1:172.21.15.153:6789/0 conn(0x7fc8b015c7d0 legacy=0x7fc8b00b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5451700 1 -- 172.21.15.123:0/3773906571 >> v1:172.21.15.123:6789/0 conn(0x7fc8b006acb0 legacy=0x7fc8b006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5451700 1 -- 172.21.15.123:0/3773906571 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b0160690 con 0x7fc8b006f990 2024-09-13T17:10:56.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5451700 1 --2- 172.21.15.123:0/3773906571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8b006f990 0x7fc8b0161170 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009dc0 tx=0x7fc8a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e61c4704fc87d49e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:56.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8a77fe700 1 -- 172.21.15.123:0/3773906571 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a800e070 con 0x7fc8b006f990 2024-09-13T17:10:56.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8a77fe700 1 -- 172.21.15.123:0/3773906571 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a800bb20 con 0x7fc8b006f990 2024-09-13T17:10:56.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8a77fe700 1 -- 172.21.15.123:0/3773906571 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8012430 con 0x7fc8b006f990 2024-09-13T17:10:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3773906571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8b006f990 msgr2=0x7fc8b0161170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5c52700 1 --2- 172.21.15.123:0/3773906571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8b006f990 0x7fc8b0161170 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009dc0 tx=0x7fc8a800b330 comp rx=0 tx=0).stop 2024-09-13T17:10:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3773906571 shutdown_connections 2024-09-13T17:10:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5c52700 1 --2- 172.21.15.123:0/3773906571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8b006f990 0x7fc8b0161170 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3773906571 >> 172.21.15.123:0/3773906571 conn(0x7fc8b00b14b0 msgr2=0x7fc8b00b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3773906571 shutdown_connections 2024-09-13T17:10:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.908+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3773906571 wait complete. 2024-09-13T17:10:56.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.912+0000 7fc8b5c52700 1 Processor -- start 2024-09-13T17:10:56.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.912+0000 7fc8b5c52700 1 -- start start 2024-09-13T17:10:56.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.912+0000 7fc8b5c52700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8b006acb0 0x7fc8b014e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.912+0000 7fc8b5c52700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b006f990 0x7fc8b0151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.912+0000 7fc8b5c52700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8b015c7d0 0x7fc8b0155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.912+0000 7fc8b5c52700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b014ec50 con 0x7fc8b006f990 2024-09-13T17:10:56.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.912+0000 7fc8b5c52700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b0151e40 con 0x7fc8b006acb0 2024-09-13T17:10:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.912+0000 7fc8b5c52700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b01569d0 con 0x7fc8b015c7d0 2024-09-13T17:10:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.912+0000 7fc8a7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b006f990 0x7fc8b0151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.912+0000 7fc8a7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b006f990 0x7fc8b0151900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58014/0 (socket says 172.21.15.123:58014) 2024-09-13T17:10:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.912+0000 7fc8a7fff700 1 -- 172.21.15.123:0/3155867805 learned_addr learned my addr 172.21.15.123:0/3155867805 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.912+0000 7fc8b4c50700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8b006acb0 0x7fc8b014e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.912+0000 7fc8b5451700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8b015c7d0 0x7fc8b0155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.916+0000 7fc8a7fff700 1 -- 172.21.15.123:0/3155867805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8b015c7d0 msgr2=0x7fc8b0155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.916+0000 7fc8a7fff700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8b015c7d0 0x7fc8b0155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.916+0000 7fc8a7fff700 1 -- 172.21.15.123:0/3155867805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8b006acb0 msgr2=0x7fc8b014e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.916+0000 7fc8a7fff700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8b006acb0 0x7fc8b014e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.916+0000 7fc8a7fff700 1 -- 172.21.15.123:0/3155867805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a8009a70 con 0x7fc8b006f990 2024-09-13T17:10:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.916+0000 7fc8b5451700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc8b015c7d0 0x7fc8b0155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.916+0000 7fc8a7fff700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b006f990 0x7fc8b0151900 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000c550 tx=0x7fc8a000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:56.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.916+0000 7fc8a57fa700 1 -- 172.21.15.123:0/3155867805 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0005d90 con 0x7fc8b006f990 2024-09-13T17:10:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.916+0000 7fc8a57fa700 1 -- 172.21.15.123:0/3155867805 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a00070d0 con 0x7fc8b006f990 2024-09-13T17:10:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.916+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3155867805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b0156cb0 con 0x7fc8b006f990 2024-09-13T17:10:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.916+0000 7fc8a57fa700 1 -- 172.21.15.123:0/3155867805 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0007480 con 0x7fc8b006f990 2024-09-13T17:10:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.916+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3155867805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b0150030 con 0x7fc8b006f990 2024-09-13T17:10:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.916+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3155867805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc8b0160c50 con 0x7fc8b006f990 2024-09-13T17:10:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.916+0000 7fc8a57fa700 1 -- 172.21.15.123:0/3155867805 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc8a00075e0 con 0x7fc8b006f990 2024-09-13T17:10:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.920+0000 7fc8a57fa700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc89c066730 0x7fc89c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.920+0000 7fc8b4c50700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc89c066730 0x7fc89c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.920+0000 7fc8a57fa700 1 -- 172.21.15.123:0/3155867805 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc8a0083210 con 0x7fc8b006f990 2024-09-13T17:10:56.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.920+0000 7fc8a57fa700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.153:6816/639257190,v1:172.21.15.153:6817/639257190] conn(0x7fc89c06c590 0x7fc89c06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:56.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.920+0000 7fc8a57fa700 1 -- 172.21.15.123:0/3155867805 --> [v2:172.21.15.153:6816/639257190,v1:172.21.15.153:6817/639257190] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc89c06f060 con 0x7fc89c06c590 2024-09-13T17:10:56.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.920+0000 7fc8a57fa700 1 -- 172.21.15.123:0/3155867805 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8a00858d0 con 0x7fc8b006f990 2024-09-13T17:10:56.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.920+0000 7fc8b4c50700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc89c066730 0x7fc89c068bf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00b3350 tx=0x7fc8ac009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:56.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.920+0000 7fc8b5451700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.153:6816/639257190,v1:172.21.15.153:6817/639257190] conn(0x7fc89c06c590 0x7fc89c06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:56.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.920+0000 7fc8b5451700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.153:6816/639257190,v1:172.21.15.153:6817/639257190] conn(0x7fc89c06c590 0x7fc89c06e9b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.920+0000 7fc8a57fa700 1 -- 172.21.15.123:0/3155867805 <== osd.4 v2:172.21.15.153:6816/639257190 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc89c06f060 con 0x7fc89c06c590 2024-09-13T17:10:56.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.940+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3155867805 --> [v2:172.21.15.153:6816/639257190,v1:172.21.15.153:6817/639257190] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc8b00677f0 con 0x7fc89c06c590 2024-09-13T17:10:56.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.940+0000 7fc8a57fa700 1 -- 172.21.15.123:0/3155867805 <== osd.4 v2:172.21.15.153:6816/639257190 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc8b00677f0 con 0x7fc89c06c590 2024-09-13T17:10:56.943 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:10:56.943 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:10:56.944 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:10:56.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.940+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3155867805 >> [v2:172.21.15.153:6816/639257190,v1:172.21.15.153:6817/639257190] conn(0x7fc89c06c590 msgr2=0x7fc89c06e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.940+0000 7fc8b5c52700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.153:6816/639257190,v1:172.21.15.153:6817/639257190] conn(0x7fc89c06c590 0x7fc89c06e9b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:56.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.940+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3155867805 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc89c066730 msgr2=0x7fc89c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.940+0000 7fc8b5c52700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fc89c066730 0x7fc89c068bf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00b3350 tx=0x7fc8ac009040 comp rx=0 tx=0).stop 2024-09-13T17:10:56.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.940+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3155867805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b006f990 msgr2=0x7fc8b0151900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:56.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.940+0000 7fc8b5c52700 1 --2- 172.21.15.123:0/3155867805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b006f990 0x7fc8b0151900 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000c550 tx=0x7fc8a000c860 comp rx=0 tx=0).stop 2024-09-13T17:10:56.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.940+0000 7fc8b5451700 1 -- 172.21.15.123:0/3155867805 reap_dead start 2024-09-13T17:10:56.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.940+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3155867805 shutdown_connections 2024-09-13T17:10:56.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.940+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3155867805 >> 172.21.15.123:0/3155867805 conn(0x7fc8b00b14b0 msgr2=0x7fc8b0071700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:56.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.940+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3155867805 shutdown_connections 2024-09-13T17:10:56.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:56.940+0000 7fc8b5c52700 1 -- 172.21.15.123:0/3155867805 wait complete. 2024-09-13T17:10:56.956 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T17:10:57.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.064+0000 7f9448d44700 1 Processor -- start 2024-09-13T17:10:57.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.064+0000 7f9448d44700 1 -- start start 2024-09-13T17:10:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.064+0000 7f9448d44700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94440b58b0 0x7f94440d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.064+0000 7f9448d44700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94440b0060 con 0x7f94440cd5e0 2024-09-13T17:10:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9448d44700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94440b0340 con 0x7f94440d0f40 2024-09-13T17:10:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9448d44700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94440b0620 con 0x7f94440b58b0 2024-09-13T17:10:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9443fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f94440cd5e0 0x7f94440cda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53488/0 (socket says 172.21.15.123:53488) 2024-09-13T17:10:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9443fff700 1 -- 172.21.15.123:0/703250445 learned_addr learned my addr 172.21.15.123:0/703250445 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9442ffd700 1 --2- 172.21.15.123:0/703250445 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94440b58b0 0x7f94440d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f94427fc700 1 -- 172.21.15.123:0/703250445 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786848684 0 0) 0x7f94440b0060 con 0x7f94440cd5e0 2024-09-13T17:10:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f94427fc700 1 -- 172.21.15.123:0/703250445 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94300035d0 con 0x7f94440cd5e0 2024-09-13T17:10:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9442ffd700 1 -- 172.21.15.123:0/703250445 >> v1:172.21.15.153:6789/0 conn(0x7f94440d0f40 legacy=0x7f94440d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9442ffd700 1 -- 172.21.15.123:0/703250445 >> v1:172.21.15.123:6789/0 conn(0x7f94440cd5e0 legacy=0x7f94440cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9442ffd700 1 -- 172.21.15.123:0/703250445 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94440b0900 con 0x7f94440b58b0 2024-09-13T17:10:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9442ffd700 1 --2- 172.21.15.123:0/703250445 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94440b58b0 0x7f94440d05a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f942c009880 tx=0x7f942c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a90fe64601711cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f94427fc700 1 -- 172.21.15.123:0/703250445 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c011830 con 0x7f94440b58b0 2024-09-13T17:10:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f94427fc700 1 -- 172.21.15.123:0/703250445 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c011990 con 0x7f94440b58b0 2024-09-13T17:10:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f94427fc700 1 -- 172.21.15.123:0/703250445 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c011d00 con 0x7f94440b58b0 2024-09-13T17:10:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9448d44700 1 -- 172.21.15.123:0/703250445 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94440b58b0 msgr2=0x7f94440d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9448d44700 1 --2- 172.21.15.123:0/703250445 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94440b58b0 0x7f94440d05a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f942c009880 tx=0x7f942c009b90 comp rx=0 tx=0).stop 2024-09-13T17:10:57.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9448d44700 1 -- 172.21.15.123:0/703250445 shutdown_connections 2024-09-13T17:10:57.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9448d44700 1 --2- 172.21.15.123:0/703250445 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94440b58b0 0x7f94440d05a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9448d44700 1 -- 172.21.15.123:0/703250445 >> 172.21.15.123:0/703250445 conn(0x7f94440d2a60 msgr2=0x7f94440d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:57.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9448d44700 1 -- 172.21.15.123:0/703250445 shutdown_connections 2024-09-13T17:10:57.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9448d44700 1 -- 172.21.15.123:0/703250445 wait complete. 2024-09-13T17:10:57.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9448d44700 1 Processor -- start 2024-09-13T17:10:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.068+0000 7f9448d44700 1 -- start start 2024-09-13T17:10:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9448d44700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94440b58b0 0x7f94440b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9448d44700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94440cd5e0 0x7f944415f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9448d44700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94440d0f40 0x7f94440c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9448d44700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94440b53e0 con 0x7f94440d0f40 2024-09-13T17:10:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9448d44700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944415efc0 con 0x7f94440cd5e0 2024-09-13T17:10:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9448d44700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944415e3b0 con 0x7f94440b58b0 2024-09-13T17:10:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9443fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94440d0f40 0x7f94440c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9443fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94440d0f40 0x7f94440c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58030/0 (socket says 172.21.15.123:58030) 2024-09-13T17:10:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9443fff700 1 -- 172.21.15.123:0/3316559924 learned_addr learned my addr 172.21.15.123:0/3316559924 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9442ffd700 1 --2- 172.21.15.123:0/3316559924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94440cd5e0 0x7f944415f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f94437fe700 1 --2- 172.21.15.123:0/3316559924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94440b58b0 0x7f94440b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9443fff700 1 -- 172.21.15.123:0/3316559924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94440b58b0 msgr2=0x7f94440b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9443fff700 1 --2- 172.21.15.123:0/3316559924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94440b58b0 0x7f94440b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9443fff700 1 -- 172.21.15.123:0/3316559924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94440cd5e0 msgr2=0x7f944415f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9443fff700 1 --2- 172.21.15.123:0/3316559924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94440cd5e0 0x7f944415f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9443fff700 1 -- 172.21.15.123:0/3316559924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c0094b0 con 0x7f94440d0f40 2024-09-13T17:10:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9443fff700 1 --2- 172.21.15.123:0/3316559924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94440d0f40 0x7f94440c8f50 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f943c00caa0 tx=0x7f943c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f943bfff700 1 -- 172.21.15.123:0/3316559924 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c007480 con 0x7f94440d0f40 2024-09-13T17:10:57.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f943bfff700 1 -- 172.21.15.123:0/3316559924 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c0075e0 con 0x7f94440d0f40 2024-09-13T17:10:57.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9448d44700 1 -- 172.21.15.123:0/3316559924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944415e690 con 0x7f94440d0f40 2024-09-13T17:10:57.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f943bfff700 1 -- 172.21.15.123:0/3316559924 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c007970 con 0x7f94440d0f40 2024-09-13T17:10:57.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9448d44700 1 -- 172.21.15.123:0/3316559924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944415ec50 con 0x7f94440d0f40 2024-09-13T17:10:57.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.072+0000 7f9448d44700 1 -- 172.21.15.123:0/3316559924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944415f130 con 0x7f94440d0f40 2024-09-13T17:10:57.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.076+0000 7f943bfff700 1 -- 172.21.15.123:0/3316559924 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f943c01b3b0 con 0x7f94440d0f40 2024-09-13T17:10:57.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.076+0000 7f943bfff700 1 --2- 172.21.15.123:0/3316559924 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9424066730 0x7f9424068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.076+0000 7f943bfff700 1 -- 172.21.15.123:0/3316559924 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f943c0837c0 con 0x7f94440d0f40 2024-09-13T17:10:57.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.076+0000 7f94437fe700 1 --2- 172.21.15.123:0/3316559924 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9424066730 0x7f9424068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.076+0000 7f94437fe700 1 --2- 172.21.15.123:0/3316559924 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9424066730 0x7f9424068bf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9434000f60 tx=0x7f9434009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.084+0000 7f943bfff700 1 -- 172.21.15.123:0/3316559924 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f943c050e30 con 0x7f94440d0f40 2024-09-13T17:10:57.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.248+0000 7f9448d44700 1 -- 172.21.15.123:0/3316559924 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f944415ce70 con 0x7f9424066730 2024-09-13T17:10:57.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.248+0000 7f943bfff700 1 -- 172.21.15.123:0/3316559924 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f94340050d0 con 0x7f9424066730 2024-09-13T17:10:57.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.252+0000 7f9448d44700 1 -- 172.21.15.123:0/3316559924 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9424066730 msgr2=0x7f9424068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.252+0000 7f9448d44700 1 --2- 172.21.15.123:0/3316559924 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9424066730 0x7f9424068bf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9434000f60 tx=0x7f9434009040 comp rx=0 tx=0).stop 2024-09-13T17:10:57.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.252+0000 7f9448d44700 1 -- 172.21.15.123:0/3316559924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94440d0f40 msgr2=0x7f94440c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.252+0000 7f9448d44700 1 --2- 172.21.15.123:0/3316559924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94440d0f40 0x7f94440c8f50 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f943c00caa0 tx=0x7f943c00cad0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.252+0000 7f9448d44700 1 -- 172.21.15.123:0/3316559924 shutdown_connections 2024-09-13T17:10:57.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.252+0000 7f9448d44700 1 --2- 172.21.15.123:0/3316559924 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9424066730 0x7f9424068bf0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.252+0000 7f9448d44700 1 --2- 172.21.15.123:0/3316559924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94440d0f40 0x7f94440c8f50 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.252+0000 7f9448d44700 1 --2- 172.21.15.123:0/3316559924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94440cd5e0 0x7f944415f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.252+0000 7f9448d44700 1 --2- 172.21.15.123:0/3316559924 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f94440b58b0 0x7f94440b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.252+0000 7f9448d44700 1 -- 172.21.15.123:0/3316559924 >> 172.21.15.123:0/3316559924 conn(0x7f94440d2a60 msgr2=0x7f9444070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:57.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.252+0000 7f9448d44700 1 -- 172.21.15.123:0/3316559924 shutdown_connections 2024-09-13T17:10:57.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.252+0000 7f9448d44700 1 -- 172.21.15.123:0/3316559924 wait complete. 2024-09-13T17:10:57.257 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T17:10:57.268 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T17:10:57.268 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:10:57.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cbfff700 1 Processor -- start 2024-09-13T17:10:57.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cbfff700 1 -- start start 2024-09-13T17:10:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cbfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84cc0cc5e0 0x7f84cc0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cbfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f84cc0cd540 0x7f84cc0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cbfff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84cc15b000 con 0x7f84cc15ac20 2024-09-13T17:10:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cbfff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84cc0ce9a0 con 0x7f84cc0cd540 2024-09-13T17:10:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cbfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0cdef0 con 0x7f84cc0cc5e0 2024-09-13T17:10:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cb7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f84cc0cd540 0x7f84cc0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84ca7fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84cc0cc5e0 0x7f84cc0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cb7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f84cc0cd540 0x7f84cc0cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.123:45830/0 (socket says 172.21.15.123:45830) 2024-09-13T17:10:57.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cb7fe700 1 -- 172.21.15.123:0/616687960 learned_addr learned my addr 172.21.15.123:0/616687960 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:57.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cb7fe700 1 -- 172.21.15.123:0/616687960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84cc0cc5e0 msgr2=0x7f84cc0b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:57.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cb7fe700 1 --2- 172.21.15.123:0/616687960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84cc0cc5e0 0x7f84cc0b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cb7fe700 1 -- 172.21.15.123:0/616687960 >> v1:172.21.15.153:6789/0 conn(0x7f84cc15ac20 legacy=0x7f84cc0b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cb7fe700 1 -- 172.21.15.123:0/616687960 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc0b6ad0 con 0x7f84cc0cd540 2024-09-13T17:10:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84cb7fe700 1 --2- 172.21.15.123:0/616687960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84cc0cd540 0x7f84cc0cd9b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009e80 tx=0x7f84c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c718f82f546430 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84c9ffb700 1 -- 172.21.15.123:0/616687960 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c400e070 con 0x7f84cc0cd540 2024-09-13T17:10:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84c9ffb700 1 -- 172.21.15.123:0/616687960 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c400b8d0 con 0x7f84cc0cd540 2024-09-13T17:10:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.380+0000 7f84c9ffb700 1 -- 172.21.15.123:0/616687960 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c400bc80 con 0x7f84cc0cd540 2024-09-13T17:10:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 -- 172.21.15.123:0/616687960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84cc0cd540 msgr2=0x7f84cc0cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 --2- 172.21.15.123:0/616687960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84cc0cd540 0x7f84cc0cd9b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009e80 tx=0x7f84c400b330 comp rx=0 tx=0).stop 2024-09-13T17:10:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 -- 172.21.15.123:0/616687960 shutdown_connections 2024-09-13T17:10:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 --2- 172.21.15.123:0/616687960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84cc0cd540 0x7f84cc0cd9b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 --2- 172.21.15.123:0/616687960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84cc0cc5e0 0x7f84cc0b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 -- 172.21.15.123:0/616687960 >> 172.21.15.123:0/616687960 conn(0x7f84cc066150 msgr2=0x7f84cc066530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 -- 172.21.15.123:0/616687960 shutdown_connections 2024-09-13T17:10:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 -- 172.21.15.123:0/616687960 wait complete. 2024-09-13T17:10:57.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 Processor -- start 2024-09-13T17:10:57.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 -- start start 2024-09-13T17:10:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84cc0cc5e0 0x7f84cc1552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84cc0cd540 0x7f84cc070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84cc15ac20 0x7f84cc1f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc1f33f0 con 0x7f84cc15ac20 2024-09-13T17:10:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.384+0000 7f84cbfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc1f2e30 con 0x7f84cc0cc5e0 2024-09-13T17:10:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84cbfff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc1f3110 con 0x7f84cc0cd540 2024-09-13T17:10:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84cb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84cc15ac20 0x7f84cc1f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84cb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84cc15ac20 0x7f84cc1f2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58034/0 (socket says 172.21.15.123:58034) 2024-09-13T17:10:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84cb7fe700 1 -- 172.21.15.123:0/4148017466 learned_addr learned my addr 172.21.15.123:0/4148017466 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84ca7fc700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84cc0cd540 0x7f84cc070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84caffd700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84cc0cc5e0 0x7f84cc1552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84cb7fe700 1 -- 172.21.15.123:0/4148017466 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84cc0cd540 msgr2=0x7f84cc070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84cb7fe700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84cc0cd540 0x7f84cc070d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84cb7fe700 1 -- 172.21.15.123:0/4148017466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84cc0cc5e0 msgr2=0x7f84cc1552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84cb7fe700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84cc0cc5e0 0x7f84cc1552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84cb7fe700 1 -- 172.21.15.123:0/4148017466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c4009b30 con 0x7f84cc15ac20 2024-09-13T17:10:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84caffd700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84cc0cc5e0 0x7f84cc1552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84cb7fe700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84cc15ac20 0x7f84cc1f2470 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f84cc067630 tx=0x7f84c4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84c37fe700 1 -- 172.21.15.123:0/4148017466 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c40048b0 con 0x7f84cc15ac20 2024-09-13T17:10:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84c37fe700 1 -- 172.21.15.123:0/4148017466 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c40092e0 con 0x7f84cc15ac20 2024-09-13T17:10:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84cbfff700 1 -- 172.21.15.123:0/4148017466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84cc070530 con 0x7f84cc15ac20 2024-09-13T17:10:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84c37fe700 1 -- 172.21.15.123:0/4148017466 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c401c680 con 0x7f84cc15ac20 2024-09-13T17:10:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84cbfff700 1 -- 172.21.15.123:0/4148017466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84cc071270 con 0x7f84cc15ac20 2024-09-13T17:10:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84cbfff700 1 -- 172.21.15.123:0/4148017466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84cc0cd130 con 0x7f84cc15ac20 2024-09-13T17:10:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84c37fe700 1 -- 172.21.15.123:0/4148017466 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f84c401c7e0 con 0x7f84cc15ac20 2024-09-13T17:10:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84c37fe700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f84ac066730 0x7f84ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84c37fe700 1 -- 172.21.15.123:0/4148017466 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f84c4085e30 con 0x7f84cc15ac20 2024-09-13T17:10:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84caffd700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f84ac066730 0x7f84ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84c37fe700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.153:6800/1764587592,v1:172.21.15.153:6801/1764587592] conn(0x7f84ac06c590 0x7f84ac06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84c37fe700 1 -- 172.21.15.123:0/4148017466 --> [v2:172.21.15.153:6800/1764587592,v1:172.21.15.153:6801/1764587592] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f84ac06f060 con 0x7f84ac06c590 2024-09-13T17:10:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.388+0000 7f84c37fe700 1 -- 172.21.15.123:0/4148017466 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84c4086280 con 0x7f84cc15ac20 2024-09-13T17:10:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.392+0000 7f84ca7fc700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.153:6800/1764587592,v1:172.21.15.153:6801/1764587592] conn(0x7f84ac06c590 0x7f84ac06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.392+0000 7f84caffd700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f84ac066730 0x7f84ac068bf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f84bc000f60 tx=0x7f84bc009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.392+0000 7f84ca7fc700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.153:6800/1764587592,v1:172.21.15.153:6801/1764587592] conn(0x7f84ac06c590 0x7f84ac06e9b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.392+0000 7f84c37fe700 1 -- 172.21.15.123:0/4148017466 <== osd.5 v2:172.21.15.153:6800/1764587592 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f84ac06f060 con 0x7f84ac06c590 2024-09-13T17:10:57.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.408+0000 7f84cbfff700 1 -- 172.21.15.123:0/4148017466 --> [v2:172.21.15.153:6800/1764587592,v1:172.21.15.153:6801/1764587592] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f84cc0727b0 con 0x7f84ac06c590 2024-09-13T17:10:57.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.408+0000 7f84c37fe700 1 -- 172.21.15.123:0/4148017466 <== osd.5 v2:172.21.15.153:6800/1764587592 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f84cc0727b0 con 0x7f84ac06c590 2024-09-13T17:10:57.413 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:10:57.413 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:10:57.413 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:10:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.412+0000 7f84cbfff700 1 -- 172.21.15.123:0/4148017466 >> [v2:172.21.15.153:6800/1764587592,v1:172.21.15.153:6801/1764587592] conn(0x7f84ac06c590 msgr2=0x7f84ac06e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.412+0000 7f84cbfff700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.153:6800/1764587592,v1:172.21.15.153:6801/1764587592] conn(0x7f84ac06c590 0x7f84ac06e9b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.412+0000 7f84cbfff700 1 -- 172.21.15.123:0/4148017466 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f84ac066730 msgr2=0x7f84ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.412+0000 7f84cbfff700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f84ac066730 0x7f84ac068bf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f84bc000f60 tx=0x7f84bc009040 comp rx=0 tx=0).stop 2024-09-13T17:10:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.412+0000 7f84cbfff700 1 -- 172.21.15.123:0/4148017466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84cc15ac20 msgr2=0x7f84cc1f2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.412+0000 7f84cbfff700 1 --2- 172.21.15.123:0/4148017466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84cc15ac20 0x7f84cc1f2470 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f84cc067630 tx=0x7f84c4004af0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.412+0000 7f84cb7fe700 1 -- 172.21.15.123:0/4148017466 reap_dead start 2024-09-13T17:10:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.412+0000 7f84cbfff700 1 -- 172.21.15.123:0/4148017466 shutdown_connections 2024-09-13T17:10:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.412+0000 7f84cbfff700 1 -- 172.21.15.123:0/4148017466 >> 172.21.15.123:0/4148017466 conn(0x7f84cc066150 msgr2=0x7f84cc073f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.412+0000 7f84cbfff700 1 -- 172.21.15.123:0/4148017466 shutdown_connections 2024-09-13T17:10:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.412+0000 7f84cbfff700 1 -- 172.21.15.123:0/4148017466 wait complete. 2024-09-13T17:10:57.431 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T17:10:57.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1ffff700 1 Processor -- start 2024-09-13T17:10:57.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1ffff700 1 -- start start 2024-09-13T17:10:57.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab200c8cd0 0x7fab200ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab200c1280 0x7fab200c1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1ffff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab200c93b0 con 0x7fab200cb090 2024-09-13T17:10:57.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1ffff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab200cae90 con 0x7fab200c1280 2024-09-13T17:10:57.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1ffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab200cc580 con 0x7fab200c8cd0 2024-09-13T17:10:57.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1e7fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab200c8cd0 0x7fab200ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab200c1280 0x7fab200c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1e7fc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab200c8cd0 0x7fab200ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.123:50038/0 (socket says 172.21.15.123:50038) 2024-09-13T17:10:57.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1e7fc700 1 -- 172.21.15.123:0/522857215 learned_addr learned my addr 172.21.15.123:0/522857215 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:57.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1effd700 1 --1- 172.21.15.123:0/522857215 >> v1:172.21.15.153:6789/0 conn(0x7fab200cb090 0x7fab200cb470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.123:48766/0 (socket says 172.21.15.123:48766) 2024-09-13T17:10:57.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1e7fc700 1 -- 172.21.15.123:0/522857215 >> v2:172.21.15.153:3300/0 conn(0x7fab200c1280 msgr2=0x7fab200c1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:57.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1e7fc700 1 --2- 172.21.15.123:0/522857215 >> v2:172.21.15.153:3300/0 conn(0x7fab200c1280 0x7fab200c1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1e7fc700 1 -- 172.21.15.123:0/522857215 >> v1:172.21.15.153:6789/0 conn(0x7fab200cb090 legacy=0x7fab200cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1e7fc700 1 -- 172.21.15.123:0/522857215 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab200cd100 con 0x7fab200c8cd0 2024-09-13T17:10:57.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1e7fc700 1 --2- 172.21.15.123:0/522857215 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab200c8cd0 0x7fab200ca950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fab18009e50 tx=0x7fab1800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b15edc64d040ec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1dffb700 1 -- 172.21.15.123:0/522857215 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1800e070 con 0x7fab200c8cd0 2024-09-13T17:10:57.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1dffb700 1 -- 172.21.15.123:0/522857215 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1800b910 con 0x7fab200c8cd0 2024-09-13T17:10:57.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.548+0000 7fab1dffb700 1 -- 172.21.15.123:0/522857215 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1800bcc0 con 0x7fab200c8cd0 2024-09-13T17:10:57.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 -- 172.21.15.123:0/522857215 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab200c8cd0 msgr2=0x7fab200ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 --2- 172.21.15.123:0/522857215 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab200c8cd0 0x7fab200ca950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fab18009e50 tx=0x7fab1800b330 comp rx=0 tx=0).stop 2024-09-13T17:10:57.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 -- 172.21.15.123:0/522857215 shutdown_connections 2024-09-13T17:10:57.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 --2- 172.21.15.123:0/522857215 >> v2:172.21.15.153:3300/0 conn(0x7fab200c1280 0x7fab200c1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 --2- 172.21.15.123:0/522857215 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab200c8cd0 0x7fab200ca950 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 -- 172.21.15.123:0/522857215 >> 172.21.15.123:0/522857215 conn(0x7fab200b01d0 msgr2=0x7fab200b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:57.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 -- 172.21.15.123:0/522857215 shutdown_connections 2024-09-13T17:10:57.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 -- 172.21.15.123:0/522857215 wait complete. 2024-09-13T17:10:57.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 Processor -- start 2024-09-13T17:10:57.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 -- start start 2024-09-13T17:10:57.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab200c1280 0x7fab200c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab200c8cd0 0x7fab200c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab200cb090 0x7fab200710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab200b1700 con 0x7fab200cb090 2024-09-13T17:10:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab200c6e80 con 0x7fab200c8cd0 2024-09-13T17:10:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1ffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab200c2fd0 con 0x7fab200c1280 2024-09-13T17:10:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab200cb090 0x7fab200710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1effd700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab200c1280 0x7fab200c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab200cb090 0x7fab200710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58042/0 (socket says 172.21.15.123:58042) 2024-09-13T17:10:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab200c8cd0 0x7fab200c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.552+0000 7fab1f7fe700 1 -- 172.21.15.123:0/194163060 learned_addr learned my addr 172.21.15.123:0/194163060 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.556+0000 7fab1f7fe700 1 -- 172.21.15.123:0/194163060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab200c1280 msgr2=0x7fab200c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.556+0000 7fab1f7fe700 1 --2- 172.21.15.123:0/194163060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab200c1280 0x7fab200c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.556+0000 7fab1f7fe700 1 -- 172.21.15.123:0/194163060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab200c8cd0 msgr2=0x7fab200c2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.556+0000 7fab1f7fe700 1 --2- 172.21.15.123:0/194163060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab200c8cd0 0x7fab200c2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.556+0000 7fab1f7fe700 1 -- 172.21.15.123:0/194163060 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab18009b30 con 0x7fab200cb090 2024-09-13T17:10:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.556+0000 7fab1f7fe700 1 --2- 172.21.15.123:0/194163060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab200cb090 0x7fab200710e0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fab1000e7f0 tx=0x7fab1000eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.556+0000 7fab177fe700 1 -- 172.21.15.123:0/194163060 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab100095c0 con 0x7fab200cb090 2024-09-13T17:10:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.556+0000 7fab177fe700 1 -- 172.21.15.123:0/194163060 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab10013680 con 0x7fab200cb090 2024-09-13T17:10:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.556+0000 7fab1ffff700 1 -- 172.21.15.123:0/194163060 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab200c32b0 con 0x7fab200cb090 2024-09-13T17:10:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.556+0000 7fab177fe700 1 -- 172.21.15.123:0/194163060 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10013a10 con 0x7fab200cb090 2024-09-13T17:10:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.556+0000 7fab1ffff700 1 -- 172.21.15.123:0/194163060 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab200c2cc0 con 0x7fab200cb090 2024-09-13T17:10:57.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.556+0000 7fab1ffff700 1 -- 172.21.15.123:0/194163060 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab200c37d0 con 0x7fab200cb090 2024-09-13T17:10:57.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.556+0000 7fab177fe700 1 -- 172.21.15.123:0/194163060 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fab10013b90 con 0x7fab200cb090 2024-09-13T17:10:57.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.560+0000 7fab177fe700 1 --2- 172.21.15.123:0/194163060 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fab00066730 0x7fab00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.560+0000 7fab177fe700 1 -- 172.21.15.123:0/194163060 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fab10083c50 con 0x7fab200cb090 2024-09-13T17:10:57.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.560+0000 7fab1effd700 1 --2- 172.21.15.123:0/194163060 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fab00066730 0x7fab00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.560+0000 7fab1effd700 1 --2- 172.21.15.123:0/194163060 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fab00066730 0x7fab00068bf0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fab08000f60 tx=0x7fab08007ef0 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.564+0000 7fab177fe700 1 -- 172.21.15.123:0/194163060 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fab200c37d0 con 0x7fab200cb090 2024-09-13T17:10:57.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.736+0000 7fab1ffff700 1 -- 172.21.15.123:0/194163060 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fab201617b0 con 0x7fab00066730 2024-09-13T17:10:57.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.736+0000 7fab177fe700 1 -- 172.21.15.123:0/194163060 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fab08001350 con 0x7fab00066730 2024-09-13T17:10:57.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.740+0000 7fab1ffff700 1 -- 172.21.15.123:0/194163060 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fab00066730 msgr2=0x7fab00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.740+0000 7fab1ffff700 1 --2- 172.21.15.123:0/194163060 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fab00066730 0x7fab00068bf0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fab08000f60 tx=0x7fab08007ef0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.740+0000 7fab1ffff700 1 -- 172.21.15.123:0/194163060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab200cb090 msgr2=0x7fab200710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.740+0000 7fab1ffff700 1 --2- 172.21.15.123:0/194163060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab200cb090 0x7fab200710e0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fab1000e7f0 tx=0x7fab1000eb00 comp rx=0 tx=0).stop 2024-09-13T17:10:57.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.740+0000 7fab1ffff700 1 -- 172.21.15.123:0/194163060 shutdown_connections 2024-09-13T17:10:57.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.740+0000 7fab1ffff700 1 --2- 172.21.15.123:0/194163060 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fab00066730 0x7fab00068bf0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.740+0000 7fab1ffff700 1 --2- 172.21.15.123:0/194163060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab200cb090 0x7fab200710e0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.740+0000 7fab1ffff700 1 --2- 172.21.15.123:0/194163060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab200c8cd0 0x7fab200c2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.740+0000 7fab1ffff700 1 --2- 172.21.15.123:0/194163060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab200c1280 0x7fab200c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.740+0000 7fab1ffff700 1 -- 172.21.15.123:0/194163060 >> 172.21.15.123:0/194163060 conn(0x7fab200b01d0 msgr2=0x7fab200ae140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:57.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.740+0000 7fab1ffff700 1 -- 172.21.15.123:0/194163060 shutdown_connections 2024-09-13T17:10:57.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.740+0000 7fab1ffff700 1 -- 172.21.15.123:0/194163060 wait complete. 2024-09-13T17:10:57.743 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T17:10:57.753 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T17:10:57.753 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:10:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.868+0000 7f9d3e739700 1 Processor -- start 2024-09-13T17:10:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.868+0000 7f9d3e739700 1 -- start start 2024-09-13T17:10:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3e739700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9d38160310 0x7f9d380d36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3e739700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9d380d1080 0x7f9d380d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3e739700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d381606f0 con 0x7f9d380d3220 2024-09-13T17:10:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3e739700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d380d1a30 con 0x7f9d380d1080 2024-09-13T17:10:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3e739700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d380ce7b0 con 0x7f9d38160310 2024-09-13T17:10:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3df38700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9d380d1080 0x7f9d380d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3cf36700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9d380d3220 0x7f9d380cf850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53500/0 (socket says 172.21.15.123:53500) 2024-09-13T17:10:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3cf36700 1 -- 172.21.15.123:0/2370611124 learned_addr learned my addr 172.21.15.123:0/2370611124 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3d737700 1 --2- 172.21.15.123:0/2370611124 >> v2:172.21.15.153:3300/0 conn(0x7f9d38160310 0x7f9d380d36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3df38700 1 -- 172.21.15.123:0/2370611124 >> v2:172.21.15.153:3300/0 conn(0x7f9d38160310 msgr2=0x7f9d380d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:57.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3df38700 1 --2- 172.21.15.123:0/2370611124 >> v2:172.21.15.153:3300/0 conn(0x7f9d38160310 0x7f9d380d36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3df38700 1 -- 172.21.15.123:0/2370611124 >> v1:172.21.15.123:6789/0 conn(0x7f9d380d3220 legacy=0x7f9d380cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3df38700 1 -- 172.21.15.123:0/2370611124 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d380cea90 con 0x7f9d380d1080 2024-09-13T17:10:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3df38700 1 --2- 172.21.15.123:0/2370611124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d380d1080 0x7f9d380d14f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009d90 tx=0x7f9d3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a2eb42d37ec875 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d2ffff700 1 -- 172.21.15.123:0/2370611124 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3000e070 con 0x7f9d380d1080 2024-09-13T17:10:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d2ffff700 1 -- 172.21.15.123:0/2370611124 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3000bb90 con 0x7f9d380d1080 2024-09-13T17:10:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d2ffff700 1 -- 172.21.15.123:0/2370611124 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30012430 con 0x7f9d380d1080 2024-09-13T17:10:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3e739700 1 -- 172.21.15.123:0/2370611124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d380d1080 msgr2=0x7f9d380d14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3e739700 1 --2- 172.21.15.123:0/2370611124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d380d1080 0x7f9d380d14f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009d90 tx=0x7f9d3000b330 comp rx=0 tx=0).stop 2024-09-13T17:10:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3e739700 1 -- 172.21.15.123:0/2370611124 shutdown_connections 2024-09-13T17:10:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3e739700 1 --2- 172.21.15.123:0/2370611124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d380d1080 0x7f9d380d14f0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3e739700 1 --2- 172.21.15.123:0/2370611124 >> v2:172.21.15.153:3300/0 conn(0x7f9d38160310 0x7f9d380d36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3e739700 1 -- 172.21.15.123:0/2370611124 >> 172.21.15.123:0/2370611124 conn(0x7f9d3809be50 msgr2=0x7f9d380d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:57.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3e739700 1 -- 172.21.15.123:0/2370611124 shutdown_connections 2024-09-13T17:10:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3e739700 1 -- 172.21.15.123:0/2370611124 wait complete. 2024-09-13T17:10:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.872+0000 7f9d3e739700 1 Processor -- start 2024-09-13T17:10:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3e739700 1 -- start start 2024-09-13T17:10:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3e739700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d380d1080 0x7f9d3815d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3e739700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d380d3220 0x7f9d380c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3e739700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d38160310 0x7f9d380c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3e739700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380c86d0 con 0x7f9d38160310 2024-09-13T17:10:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3e739700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380c8c00 con 0x7f9d380d1080 2024-09-13T17:10:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3e739700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380c7e40 con 0x7f9d380d3220 2024-09-13T17:10:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3df38700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d38160310 0x7f9d380c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3df38700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d38160310 0x7f9d380c7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58066/0 (socket says 172.21.15.123:58066) 2024-09-13T17:10:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3df38700 1 -- 172.21.15.123:0/3994131931 learned_addr learned my addr 172.21.15.123:0/3994131931 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3cf36700 1 --2- 172.21.15.123:0/3994131931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d380d3220 0x7f9d380c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3d737700 1 --2- 172.21.15.123:0/3994131931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d380d1080 0x7f9d3815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3df38700 1 -- 172.21.15.123:0/3994131931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d380d3220 msgr2=0x7f9d380c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3df38700 1 --2- 172.21.15.123:0/3994131931 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9d380d3220 0x7f9d380c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3df38700 1 -- 172.21.15.123:0/3994131931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d380d1080 msgr2=0x7f9d3815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3df38700 1 --2- 172.21.15.123:0/3994131931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d380d1080 0x7f9d3815d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3df38700 1 -- 172.21.15.123:0/3994131931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d30009a70 con 0x7f9d38160310 2024-09-13T17:10:57.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3df38700 1 --2- 172.21.15.123:0/3994131931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d38160310 0x7f9d380c7900 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f9d30014040 tx=0x7f9d30004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d2dffb700 1 -- 172.21.15.123:0/3994131931 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30012430 con 0x7f9d38160310 2024-09-13T17:10:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d2dffb700 1 -- 172.21.15.123:0/3994131931 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d30020070 con 0x7f9d38160310 2024-09-13T17:10:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3e739700 1 -- 172.21.15.123:0/3994131931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d380c8920 con 0x7f9d38160310 2024-09-13T17:10:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d2dffb700 1 -- 172.21.15.123:0/3994131931 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30004280 con 0x7f9d38160310 2024-09-13T17:10:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3e739700 1 -- 172.21.15.123:0/3994131931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d380c93e0 con 0x7f9d38160310 2024-09-13T17:10:57.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.876+0000 7f9d3e739700 1 -- 172.21.15.123:0/3994131931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d380cf330 con 0x7f9d38160310 2024-09-13T17:10:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.880+0000 7f9d2dffb700 1 -- 172.21.15.123:0/3994131931 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d300043e0 con 0x7f9d38160310 2024-09-13T17:10:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.880+0000 7f9d2dffb700 1 --2- 172.21.15.123:0/3994131931 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9d1c066730 0x7f9d1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.880+0000 7f9d2dffb700 1 -- 172.21.15.123:0/3994131931 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9d30022070 con 0x7f9d38160310 2024-09-13T17:10:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.880+0000 7f9d3d737700 1 --2- 172.21.15.123:0/3994131931 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9d1c066730 0x7f9d1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.880+0000 7f9d2dffb700 1 --2- 172.21.15.123:0/3994131931 >> [v2:172.21.15.153:6824/2955379880,v1:172.21.15.153:6825/2955379880] conn(0x7f9d1c06c590 0x7f9d1c06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.880+0000 7f9d2dffb700 1 -- 172.21.15.123:0/3994131931 --> [v2:172.21.15.153:6824/2955379880,v1:172.21.15.153:6825/2955379880] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d1c06f060 con 0x7f9d1c06c590 2024-09-13T17:10:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.880+0000 7f9d2dffb700 1 -- 172.21.15.123:0/3994131931 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d30086660 con 0x7f9d38160310 2024-09-13T17:10:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.880+0000 7f9d3cf36700 1 --2- 172.21.15.123:0/3994131931 >> [v2:172.21.15.153:6824/2955379880,v1:172.21.15.153:6825/2955379880] conn(0x7f9d1c06c590 0x7f9d1c06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.880+0000 7f9d3d737700 1 --2- 172.21.15.123:0/3994131931 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9d1c066730 0x7f9d1c068bf0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800b9d0 tx=0x7f9d28008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.880+0000 7f9d3cf36700 1 --2- 172.21.15.123:0/3994131931 >> [v2:172.21.15.153:6824/2955379880,v1:172.21.15.153:6825/2955379880] conn(0x7f9d1c06c590 0x7f9d1c06e9b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.884+0000 7f9d2dffb700 1 -- 172.21.15.123:0/3994131931 <== osd.6 v2:172.21.15.153:6824/2955379880 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9d1c06f060 con 0x7f9d1c06c590 2024-09-13T17:10:57.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.896+0000 7f9d3e739700 1 -- 172.21.15.123:0/3994131931 --> [v2:172.21.15.153:6824/2955379880,v1:172.21.15.153:6825/2955379880] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9d380cf050 con 0x7f9d1c06c590 2024-09-13T17:10:57.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.900+0000 7f9d2dffb700 1 -- 172.21.15.123:0/3994131931 <== osd.6 v2:172.21.15.153:6824/2955379880 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9d340015a0 con 0x7f9d1c06c590 2024-09-13T17:10:57.902 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:10:57.903 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:10:57.903 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:10:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.900+0000 7f9d3e739700 1 -- 172.21.15.123:0/3994131931 >> [v2:172.21.15.153:6824/2955379880,v1:172.21.15.153:6825/2955379880] conn(0x7f9d1c06c590 msgr2=0x7f9d1c06e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.900+0000 7f9d3e739700 1 --2- 172.21.15.123:0/3994131931 >> [v2:172.21.15.153:6824/2955379880,v1:172.21.15.153:6825/2955379880] conn(0x7f9d1c06c590 0x7f9d1c06e9b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.900+0000 7f9d3e739700 1 -- 172.21.15.123:0/3994131931 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9d1c066730 msgr2=0x7f9d1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.900+0000 7f9d3e739700 1 --2- 172.21.15.123:0/3994131931 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f9d1c066730 0x7f9d1c068bf0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800b9d0 tx=0x7f9d28008040 comp rx=0 tx=0).stop 2024-09-13T17:10:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.900+0000 7f9d3e739700 1 -- 172.21.15.123:0/3994131931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d38160310 msgr2=0x7f9d380c7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.900+0000 7f9d3e739700 1 --2- 172.21.15.123:0/3994131931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d38160310 0x7f9d380c7900 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f9d30014040 tx=0x7f9d30004af0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.900+0000 7f9d3df38700 1 -- 172.21.15.123:0/3994131931 reap_dead start 2024-09-13T17:10:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.900+0000 7f9d3e739700 1 -- 172.21.15.123:0/3994131931 shutdown_connections 2024-09-13T17:10:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.900+0000 7f9d3e739700 1 -- 172.21.15.123:0/3994131931 >> 172.21.15.123:0/3994131931 conn(0x7f9d3809be50 msgr2=0x7f9d380708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.900+0000 7f9d3e739700 1 -- 172.21.15.123:0/3994131931 shutdown_connections 2024-09-13T17:10:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:57.900+0000 7f9d3e739700 1 -- 172.21.15.123:0/3994131931 wait complete. 2024-09-13T17:10:57.915 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T17:10:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd51a427700 1 Processor -- start 2024-09-13T17:10:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd51a427700 1 -- start start 2024-09-13T17:10:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd51a427700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd5140ca950 0x7fd5140c1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd51a427700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5140c93b0 con 0x7fd5140cb090 2024-09-13T17:10:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd51a427700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5140cc580 con 0x7fd5140c8cd0 2024-09-13T17:10:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd51a427700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5140cd100 con 0x7fd5140ca950 2024-09-13T17:10:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd519c26700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd5140ca950 0x7fd5140c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd519425700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd5140cb090 0x7fd5140cb470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53506/0 (socket says 172.21.15.123:53506) 2024-09-13T17:10:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd519425700 1 -- 172.21.15.123:0/3661876323 learned_addr learned my addr 172.21.15.123:0/3661876323 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:58.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd50bfff700 1 -- 172.21.15.123:0/3661876323 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965633179 0 0) 0x7fd5140c93b0 con 0x7fd5140cb090 2024-09-13T17:10:58.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd50bfff700 1 -- 172.21.15.123:0/3661876323 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5000035d0 con 0x7fd5140cb090 2024-09-13T17:10:58.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd519c26700 1 -- 172.21.15.123:0/3661876323 >> v1:172.21.15.153:6789/0 conn(0x7fd5140c8cd0 legacy=0x7fd5140c1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd519c26700 1 -- 172.21.15.123:0/3661876323 >> v1:172.21.15.123:6789/0 conn(0x7fd5140cb090 legacy=0x7fd5140cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd519c26700 1 -- 172.21.15.123:0/3661876323 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5141617b0 con 0x7fd5140ca950 2024-09-13T17:10:58.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd519c26700 1 --2- 172.21.15.123:0/3661876323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5140ca950 0x7fd5140c1990 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009d90 tx=0x7fd50c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b27ec5267870ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:58.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd50bfff700 1 -- 172.21.15.123:0/3661876323 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00e070 con 0x7fd5140ca950 2024-09-13T17:10:58.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd50bfff700 1 -- 172.21.15.123:0/3661876323 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00bb20 con 0x7fd5140ca950 2024-09-13T17:10:58.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.028+0000 7fd50bfff700 1 -- 172.21.15.123:0/3661876323 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00be90 con 0x7fd5140ca950 2024-09-13T17:10:58.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.032+0000 7fd51a427700 1 -- 172.21.15.123:0/3661876323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5140ca950 msgr2=0x7fd5140c1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.032+0000 7fd51a427700 1 --2- 172.21.15.123:0/3661876323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5140ca950 0x7fd5140c1990 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009d90 tx=0x7fd50c00b330 comp rx=0 tx=0).stop 2024-09-13T17:10:58.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.032+0000 7fd51a427700 1 -- 172.21.15.123:0/3661876323 shutdown_connections 2024-09-13T17:10:58.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.032+0000 7fd51a427700 1 --2- 172.21.15.123:0/3661876323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5140ca950 0x7fd5140c1990 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.032+0000 7fd51a427700 1 -- 172.21.15.123:0/3661876323 >> 172.21.15.123:0/3661876323 conn(0x7fd5140b01d0 msgr2=0x7fd5140b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:58.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.032+0000 7fd51a427700 1 -- 172.21.15.123:0/3661876323 shutdown_connections 2024-09-13T17:10:58.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.032+0000 7fd51a427700 1 -- 172.21.15.123:0/3661876323 wait complete. 2024-09-13T17:10:58.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.032+0000 7fd51a427700 1 Processor -- start 2024-09-13T17:10:58.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.032+0000 7fd51a427700 1 -- start start 2024-09-13T17:10:58.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd51a427700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5140c8cd0 0x7fd514153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd51a427700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5140ca950 0x7fd5140c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd51a427700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5140cb090 0x7fd5140b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd51a427700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5140c6f90 con 0x7fd5140ca950 2024-09-13T17:10:58.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd51a427700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5140b2cb0 con 0x7fd5140cb090 2024-09-13T17:10:58.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd51a427700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5140b2f90 con 0x7fd5140c8cd0 2024-09-13T17:10:58.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd518c24700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5140ca950 0x7fd5140c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd518c24700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5140ca950 0x7fd5140c6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58086/0 (socket says 172.21.15.123:58086) 2024-09-13T17:10:58.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd518c24700 1 -- 172.21.15.123:0/1314179671 learned_addr learned my addr 172.21.15.123:0/1314179671 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:58.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd519425700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5140c8cd0 0x7fd514153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd519c26700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5140cb090 0x7fd5140b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd518c24700 1 -- 172.21.15.123:0/1314179671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5140c8cd0 msgr2=0x7fd514153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd518c24700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5140c8cd0 0x7fd514153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd518c24700 1 -- 172.21.15.123:0/1314179671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5140cb090 msgr2=0x7fd5140b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd518c24700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5140cb090 0x7fd5140b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd518c24700 1 -- 172.21.15.123:0/1314179671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c009a70 con 0x7fd5140ca950 2024-09-13T17:10:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd519425700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5140c8cd0 0x7fd514153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd518c24700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5140ca950 0x7fd5140c6a50 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fd51000c410 tx=0x7fd51000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd509ffb700 1 -- 172.21.15.123:0/1314179671 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5100052d0 con 0x7fd5140ca950 2024-09-13T17:10:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd509ffb700 1 -- 172.21.15.123:0/1314179671 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd510005430 con 0x7fd5140ca950 2024-09-13T17:10:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd51a427700 1 -- 172.21.15.123:0/1314179671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5140b3270 con 0x7fd5140ca950 2024-09-13T17:10:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd509ffb700 1 -- 172.21.15.123:0/1314179671 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5100055a0 con 0x7fd5140ca950 2024-09-13T17:10:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.036+0000 7fd51a427700 1 -- 172.21.15.123:0/1314179671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5140b3830 con 0x7fd5140ca950 2024-09-13T17:10:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.040+0000 7fd509ffb700 1 -- 172.21.15.123:0/1314179671 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd5100036a0 con 0x7fd5140ca950 2024-09-13T17:10:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.040+0000 7fd51a427700 1 -- 172.21.15.123:0/1314179671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5140ccd90 con 0x7fd5140ca950 2024-09-13T17:10:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.040+0000 7fd509ffb700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd4f8066760 0x7fd4f8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.040+0000 7fd519425700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd4f8066760 0x7fd4f8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.040+0000 7fd509ffb700 1 -- 172.21.15.123:0/1314179671 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd510083080 con 0x7fd5140ca950 2024-09-13T17:10:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.040+0000 7fd519425700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd4f8066760 0x7fd4f8068c20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd5040011e0 tx=0x7fd504009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.044+0000 7fd509ffb700 1 -- 172.21.15.123:0/1314179671 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd510050780 con 0x7fd5140ca950 2024-09-13T17:10:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.212+0000 7fd51a427700 1 -- 172.21.15.123:0/1314179671 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5140c9110 con 0x7fd4f8066760 2024-09-13T17:10:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.212+0000 7fd509ffb700 1 -- 172.21.15.123:0/1314179671 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd5040014f0 con 0x7fd4f8066760 2024-09-13T17:10:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.216+0000 7fd51a427700 1 -- 172.21.15.123:0/1314179671 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd4f8066760 msgr2=0x7fd4f8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.216+0000 7fd51a427700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd4f8066760 0x7fd4f8068c20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd5040011e0 tx=0x7fd504009040 comp rx=0 tx=0).stop 2024-09-13T17:10:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.216+0000 7fd51a427700 1 -- 172.21.15.123:0/1314179671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5140ca950 msgr2=0x7fd5140c6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.216+0000 7fd51a427700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5140ca950 0x7fd5140c6a50 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fd51000c410 tx=0x7fd51000c7d0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.216+0000 7fd51a427700 1 -- 172.21.15.123:0/1314179671 shutdown_connections 2024-09-13T17:10:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.216+0000 7fd51a427700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fd4f8066760 0x7fd4f8068c20 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.216+0000 7fd51a427700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5140cb090 0x7fd5140b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.216+0000 7fd51a427700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5140ca950 0x7fd5140c6a50 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.216+0000 7fd51a427700 1 --2- 172.21.15.123:0/1314179671 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5140c8cd0 0x7fd514153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.216+0000 7fd51a427700 1 -- 172.21.15.123:0/1314179671 >> 172.21.15.123:0/1314179671 conn(0x7fd5140b01d0 msgr2=0x7fd5140cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.216+0000 7fd51a427700 1 -- 172.21.15.123:0/1314179671 shutdown_connections 2024-09-13T17:10:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.216+0000 7fd51a427700 1 -- 172.21.15.123:0/1314179671 wait complete. 2024-09-13T17:10:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T17:10:58.231 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T17:10:58.231 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:10:58.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.352+0000 7fbc469dc700 1 Processor -- start 2024-09-13T17:10:58.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.352+0000 7fbc469dc700 1 -- start start 2024-09-13T17:10:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc469dc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc4006acb0 0x7fbc40161170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc469dc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc4006f280 0x7fbc4006f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc469dc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc400b4ce0 con 0x7fbc4015c7d0 2024-09-13T17:10:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc469dc700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4006fc30 con 0x7fbc4006f280 2024-09-13T17:10:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc469dc700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400b4750 con 0x7fbc4006acb0 2024-09-13T17:10:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc461db700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc4006f280 0x7fbc4006f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc459da700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbc4015c7d0 0x7fbc400b4040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53516/0 (socket says 172.21.15.123:53516) 2024-09-13T17:10:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc459da700 1 -- 172.21.15.123:0/706971348 learned_addr learned my addr 172.21.15.123:0/706971348 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:10:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc451d9700 1 --2- 172.21.15.123:0/706971348 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc4006acb0 0x7fbc40161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc461db700 1 -- 172.21.15.123:0/706971348 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc4006acb0 msgr2=0x7fbc40161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc461db700 1 --2- 172.21.15.123:0/706971348 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc4006acb0 0x7fbc40161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc461db700 1 -- 172.21.15.123:0/706971348 >> v1:172.21.15.123:6789/0 conn(0x7fbc4015c7d0 legacy=0x7fbc400b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc461db700 1 -- 172.21.15.123:0/706971348 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc400b4a00 con 0x7fbc4006f280 2024-09-13T17:10:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc461db700 1 --2- 172.21.15.123:0/706971348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4006f280 0x7fbc4006f6f0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009d90 tx=0x7fbc3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50eefcb930691217 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc449d8700 1 -- 172.21.15.123:0/706971348 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3800e070 con 0x7fbc4006f280 2024-09-13T17:10:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc449d8700 1 -- 172.21.15.123:0/706971348 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3800bbd0 con 0x7fbc4006f280 2024-09-13T17:10:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc449d8700 1 -- 172.21.15.123:0/706971348 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38012430 con 0x7fbc4006f280 2024-09-13T17:10:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc469dc700 1 -- 172.21.15.123:0/706971348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4006f280 msgr2=0x7fbc4006f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc469dc700 1 --2- 172.21.15.123:0/706971348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4006f280 0x7fbc4006f6f0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009d90 tx=0x7fbc3800b330 comp rx=0 tx=0).stop 2024-09-13T17:10:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc469dc700 1 -- 172.21.15.123:0/706971348 shutdown_connections 2024-09-13T17:10:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc469dc700 1 --2- 172.21.15.123:0/706971348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4006f280 0x7fbc4006f6f0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc469dc700 1 --2- 172.21.15.123:0/706971348 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc4006acb0 0x7fbc40161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc469dc700 1 -- 172.21.15.123:0/706971348 >> 172.21.15.123:0/706971348 conn(0x7fbc400b14b0 msgr2=0x7fbc400b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc469dc700 1 -- 172.21.15.123:0/706971348 shutdown_connections 2024-09-13T17:10:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.356+0000 7fbc469dc700 1 -- 172.21.15.123:0/706971348 wait complete. 2024-09-13T17:10:58.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc469dc700 1 Processor -- start 2024-09-13T17:10:58.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc469dc700 1 -- start start 2024-09-13T17:10:58.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc469dc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4006acb0 0x7fbc40159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc469dc700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc4006f280 0x7fbc40156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc469dc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc4015c7d0 0x7fbc4014e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc469dc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4015b220 con 0x7fbc4006acb0 2024-09-13T17:10:58.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc469dc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4015a610 con 0x7fbc4015c7d0 2024-09-13T17:10:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc469dc700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4015a8f0 con 0x7fbc4006f280 2024-09-13T17:10:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc459da700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4006acb0 0x7fbc40159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc459da700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4006acb0 0x7fbc40159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58092/0 (socket says 172.21.15.123:58092) 2024-09-13T17:10:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc459da700 1 -- 172.21.15.123:0/1169897522 learned_addr learned my addr 172.21.15.123:0/1169897522 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc461db700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc4015c7d0 0x7fbc4014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc451d9700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc4006f280 0x7fbc40156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc459da700 1 -- 172.21.15.123:0/1169897522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc4006f280 msgr2=0x7fbc40156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc459da700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc4006f280 0x7fbc40156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc459da700 1 -- 172.21.15.123:0/1169897522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc4015c7d0 msgr2=0x7fbc4014e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc459da700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc4015c7d0 0x7fbc4014e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc459da700 1 -- 172.21.15.123:0/1169897522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38009a70 con 0x7fbc4006acb0 2024-09-13T17:10:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.360+0000 7fbc451d9700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbc4006f280 0x7fbc40156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc459da700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4006acb0 0x7fbc40159dc0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400c410 tx=0x7fbc3400c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc327fc700 1 -- 172.21.15.123:0/1169897522 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34005d90 con 0x7fbc4006acb0 2024-09-13T17:10:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc327fc700 1 -- 172.21.15.123:0/1169897522 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc340070d0 con 0x7fbc4006acb0 2024-09-13T17:10:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc469dc700 1 -- 172.21.15.123:0/1169897522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4015abd0 con 0x7fbc4006acb0 2024-09-13T17:10:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc327fc700 1 -- 172.21.15.123:0/1169897522 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34007460 con 0x7fbc4006acb0 2024-09-13T17:10:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc469dc700 1 -- 172.21.15.123:0/1169897522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4015a300 con 0x7fbc4006acb0 2024-09-13T17:10:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc469dc700 1 -- 172.21.15.123:0/1169897522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc40067340 con 0x7fbc4006acb0 2024-09-13T17:10:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc327fc700 1 -- 172.21.15.123:0/1169897522 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbc340075c0 con 0x7fbc4006acb0 2024-09-13T17:10:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc327fc700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbc24066730 0x7fbc24068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc451d9700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbc24066730 0x7fbc24068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc327fc700 1 -- 172.21.15.123:0/1169897522 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbc34083150 con 0x7fbc4006acb0 2024-09-13T17:10:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc327fc700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.153:6808/1517292799,v1:172.21.15.153:6809/1517292799] conn(0x7fbc2406c590 0x7fbc2406e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc327fc700 1 -- 172.21.15.123:0/1169897522 --> [v2:172.21.15.153:6808/1517292799,v1:172.21.15.153:6809/1517292799] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc2406f060 con 0x7fbc2406c590 2024-09-13T17:10:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc327fc700 1 -- 172.21.15.123:0/1169897522 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc34085810 con 0x7fbc4006acb0 2024-09-13T17:10:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc451d9700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbc24066730 0x7fbc24068bf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbc4006fc00 tx=0x7fbc3c008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.364+0000 7fbc461db700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.153:6808/1517292799,v1:172.21.15.153:6809/1517292799] conn(0x7fbc2406c590 0x7fbc2406e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.368+0000 7fbc461db700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.153:6808/1517292799,v1:172.21.15.153:6809/1517292799] conn(0x7fbc2406c590 0x7fbc2406e9b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.368+0000 7fbc327fc700 1 -- 172.21.15.123:0/1169897522 <== osd.7 v2:172.21.15.153:6808/1517292799 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbc2406f060 con 0x7fbc2406c590 2024-09-13T17:10:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.384+0000 7fbc469dc700 1 -- 172.21.15.123:0/1169897522 --> [v2:172.21.15.153:6808/1517292799,v1:172.21.15.153:6809/1517292799] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbc40160c50 con 0x7fbc2406c590 2024-09-13T17:10:58.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.384+0000 7fbc327fc700 1 -- 172.21.15.123:0/1169897522 <== osd.7 v2:172.21.15.153:6808/1517292799 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbc380098f0 con 0x7fbc2406c590 2024-09-13T17:10:58.389 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-13T17:10:58.390 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:10:58.390 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-13T17:10:58.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.384+0000 7fbc469dc700 1 -- 172.21.15.123:0/1169897522 >> [v2:172.21.15.153:6808/1517292799,v1:172.21.15.153:6809/1517292799] conn(0x7fbc2406c590 msgr2=0x7fbc2406e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.384+0000 7fbc469dc700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.153:6808/1517292799,v1:172.21.15.153:6809/1517292799] conn(0x7fbc2406c590 0x7fbc2406e9b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.388+0000 7fbc469dc700 1 -- 172.21.15.123:0/1169897522 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbc24066730 msgr2=0x7fbc24068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.388+0000 7fbc469dc700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7fbc24066730 0x7fbc24068bf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbc4006fc00 tx=0x7fbc3c008040 comp rx=0 tx=0).stop 2024-09-13T17:10:58.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.388+0000 7fbc469dc700 1 -- 172.21.15.123:0/1169897522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4006acb0 msgr2=0x7fbc40159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.388+0000 7fbc469dc700 1 --2- 172.21.15.123:0/1169897522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4006acb0 0x7fbc40159dc0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400c410 tx=0x7fbc3400c720 comp rx=0 tx=0).stop 2024-09-13T17:10:58.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.388+0000 7fbc461db700 1 -- 172.21.15.123:0/1169897522 reap_dead start 2024-09-13T17:10:58.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.388+0000 7fbc469dc700 1 -- 172.21.15.123:0/1169897522 shutdown_connections 2024-09-13T17:10:58.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.388+0000 7fbc469dc700 1 -- 172.21.15.123:0/1169897522 >> 172.21.15.123:0/1169897522 conn(0x7fbc400b14b0 msgr2=0x7fbc400cda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:58.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.388+0000 7fbc469dc700 1 -- 172.21.15.123:0/1169897522 shutdown_connections 2024-09-13T17:10:58.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.388+0000 7fbc469dc700 1 -- 172.21.15.123:0/1169897522 wait complete. 2024-09-13T17:10:58.402 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T17:10:58.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.512+0000 7f791ffff700 1 Processor -- start 2024-09-13T17:10:58.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.512+0000 7f791ffff700 1 -- start start 2024-09-13T17:10:58.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.512+0000 7f791ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79200d0f40 0x7f79200d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.512+0000 7f791ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f79200cd5e0 0x7f79200cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.512+0000 7f791ffff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79200d0cb0 con 0x7f79200b58b0 2024-09-13T17:10:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.512+0000 7f791ffff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79200b0060 con 0x7f79200cd5e0 2024-09-13T17:10:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.512+0000 7f791ffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79200b0340 con 0x7f79200d0f40 2024-09-13T17:10:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.512+0000 7f791f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f79200cd5e0 0x7f79200cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f79200cd5e0 0x7f79200cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58104/0 (socket says 172.21.15.123:58104) 2024-09-13T17:10:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791f7fe700 1 -- 172.21.15.123:0/792801311 learned_addr learned my addr 172.21.15.123:0/792801311 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791effd700 1 --2- 172.21.15.123:0/792801311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79200d0f40 0x7f79200d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791f7fe700 1 -- 172.21.15.123:0/792801311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79200d0f40 msgr2=0x7f79200d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791f7fe700 1 --2- 172.21.15.123:0/792801311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79200d0f40 0x7f79200d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791f7fe700 1 -- 172.21.15.123:0/792801311 >> v1:172.21.15.153:6789/0 conn(0x7f79200b58b0 legacy=0x7f79200d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791f7fe700 1 -- 172.21.15.123:0/792801311 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79200b0620 con 0x7f79200cd5e0 2024-09-13T17:10:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791f7fe700 1 --2- 172.21.15.123:0/792801311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79200cd5e0 0x7f79200cda30 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f7918009e50 tx=0x7f791800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c29f13c3aaf5be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791dffb700 1 -- 172.21.15.123:0/792801311 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791800e070 con 0x7f79200cd5e0 2024-09-13T17:10:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791dffb700 1 -- 172.21.15.123:0/792801311 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791800b9c0 con 0x7f79200cd5e0 2024-09-13T17:10:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791dffb700 1 -- 172.21.15.123:0/792801311 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791800bd70 con 0x7f79200cd5e0 2024-09-13T17:10:58.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791ffff700 1 -- 172.21.15.123:0/792801311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79200cd5e0 msgr2=0x7f79200cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791ffff700 1 --2- 172.21.15.123:0/792801311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79200cd5e0 0x7f79200cda30 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f7918009e50 tx=0x7f791800b330 comp rx=0 tx=0).stop 2024-09-13T17:10:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791ffff700 1 -- 172.21.15.123:0/792801311 shutdown_connections 2024-09-13T17:10:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791ffff700 1 --2- 172.21.15.123:0/792801311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79200cd5e0 0x7f79200cda30 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791ffff700 1 --2- 172.21.15.123:0/792801311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79200d0f40 0x7f79200d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791ffff700 1 -- 172.21.15.123:0/792801311 >> 172.21.15.123:0/792801311 conn(0x7f79200d2a60 msgr2=0x7f79200d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791ffff700 1 -- 172.21.15.123:0/792801311 shutdown_connections 2024-09-13T17:10:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791ffff700 1 -- 172.21.15.123:0/792801311 wait complete. 2024-09-13T17:10:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791ffff700 1 Processor -- start 2024-09-13T17:10:58.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.516+0000 7f791ffff700 1 -- start start 2024-09-13T17:10:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791ffff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79200b58b0 0x7f79200c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79200cd5e0 0x7f7920157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79200d0f40 0x7f792015eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791ffff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200c8790 con 0x7f79200d0f40 2024-09-13T17:10:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791ffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200c7dc0 con 0x7f79200cd5e0 2024-09-13T17:10:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791ffff700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79200c6ed0 con 0x7f79200b58b0 2024-09-13T17:10:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79200d0f40 0x7f792015eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79200d0f40 0x7f792015eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58114/0 (socket says 172.21.15.123:58114) 2024-09-13T17:10:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791f7fe700 1 -- 172.21.15.123:0/1124399034 learned_addr learned my addr 172.21.15.123:0/1124399034 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791effd700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79200b58b0 0x7f79200c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791e7fc700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79200cd5e0 0x7f7920157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791f7fe700 1 -- 172.21.15.123:0/1124399034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79200b58b0 msgr2=0x7f79200c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791f7fe700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79200b58b0 0x7f79200c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791f7fe700 1 -- 172.21.15.123:0/1124399034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79200cd5e0 msgr2=0x7f7920157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791f7fe700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79200cd5e0 0x7f7920157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791f7fe700 1 -- 172.21.15.123:0/1124399034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918009b30 con 0x7f79200d0f40 2024-09-13T17:10:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791e7fc700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79200cd5e0 0x7f7920157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791f7fe700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79200d0f40 0x7f792015eed0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f79200d29c0 tx=0x7f7918004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f79077fe700 1 -- 172.21.15.123:0/1124399034 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7918004960 con 0x7f79200d0f40 2024-09-13T17:10:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f79077fe700 1 -- 172.21.15.123:0/1124399034 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79180099b0 con 0x7f79200d0f40 2024-09-13T17:10:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791ffff700 1 -- 172.21.15.123:0/1124399034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79200c71b0 con 0x7f79200d0f40 2024-09-13T17:10:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f79077fe700 1 -- 172.21.15.123:0/1124399034 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791801c680 con 0x7f79200d0f40 2024-09-13T17:10:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.520+0000 7f791ffff700 1 -- 172.21.15.123:0/1124399034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79200c7770 con 0x7f79200d0f40 2024-09-13T17:10:58.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.524+0000 7f79077fe700 1 -- 172.21.15.123:0/1124399034 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f791801c7e0 con 0x7f79200d0f40 2024-09-13T17:10:58.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.524+0000 7f79077fe700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f790c066730 0x7f790c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.524+0000 7f79077fe700 1 -- 172.21.15.123:0/1124399034 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7918085a20 con 0x7f79200d0f40 2024-09-13T17:10:58.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.524+0000 7f791effd700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f790c066730 0x7f790c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.524+0000 7f791ffff700 1 -- 172.21.15.123:0/1124399034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79200c7f00 con 0x7f79200d0f40 2024-09-13T17:10:58.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.524+0000 7f791effd700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f790c066730 0x7f790c068bf0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f79200b2820 tx=0x7f7914008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.532+0000 7f79077fe700 1 -- 172.21.15.123:0/1124399034 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7918053120 con 0x7f79200d0f40 2024-09-13T17:10:58.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.700+0000 7f791ffff700 1 -- 172.21.15.123:0/1124399034 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f792006fce0 con 0x7f790c066730 2024-09-13T17:10:58.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.700+0000 7f79077fe700 1 -- 172.21.15.123:0/1124399034 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f792006fce0 con 0x7f790c066730 2024-09-13T17:10:58.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.704+0000 7f791ffff700 1 -- 172.21.15.123:0/1124399034 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f790c066730 msgr2=0x7f790c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.704+0000 7f791ffff700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f790c066730 0x7f790c068bf0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f79200b2820 tx=0x7f7914008040 comp rx=0 tx=0).stop 2024-09-13T17:10:58.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.704+0000 7f791ffff700 1 -- 172.21.15.123:0/1124399034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79200d0f40 msgr2=0x7f792015eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.704+0000 7f791ffff700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79200d0f40 0x7f792015eed0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f79200d29c0 tx=0x7f7918004af0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.704+0000 7f791ffff700 1 -- 172.21.15.123:0/1124399034 shutdown_connections 2024-09-13T17:10:58.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.704+0000 7f791ffff700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f790c066730 0x7f790c068bf0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.704+0000 7f791ffff700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79200d0f40 0x7f792015eed0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.704+0000 7f791ffff700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79200cd5e0 0x7f7920157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.704+0000 7f791ffff700 1 --2- 172.21.15.123:0/1124399034 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79200b58b0 0x7f79200c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.704+0000 7f791ffff700 1 -- 172.21.15.123:0/1124399034 >> 172.21.15.123:0/1124399034 conn(0x7f79200d2a60 msgr2=0x7f79200ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:58.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.704+0000 7f791ffff700 1 -- 172.21.15.123:0/1124399034 shutdown_connections 2024-09-13T17:10:58.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.704+0000 7f791ffff700 1 -- 172.21.15.123:0/1124399034 wait complete. 2024-09-13T17:10:58.709 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T17:10:58.720 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:10:58.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e388c9700 1 Processor -- start 2024-09-13T17:10:58.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e388c9700 1 -- start start 2024-09-13T17:10:58.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e388c9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e2c0eb420 0x7f2e2c04ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e388c9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2e2c007260 0x7f2e2c04f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e388c9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c01cfa0 con 0x7f2e2c033ac0 2024-09-13T17:10:58.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e388c9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c01c670 con 0x7f2e2c007260 2024-09-13T17:10:58.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e388c9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c01c950 con 0x7f2e2c0eb420 2024-09-13T17:10:58.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e33fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2e2c007260 0x7f2e2c04f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e33fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2e2c007260 0x7f2e2c04f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58118/0 (socket says 172.21.15.123:58118) 2024-09-13T17:10:58.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e33fff700 1 -- 172.21.15.123:0/520203851 learned_addr learned my addr 172.21.15.123:0/520203851 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:58.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e32ffd700 1 --2- 172.21.15.123:0/520203851 >> v2:172.21.15.153:3300/0 conn(0x7f2e2c0eb420 0x7f2e2c04ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e33fff700 1 -- 172.21.15.123:0/520203851 >> v2:172.21.15.153:3300/0 conn(0x7f2e2c0eb420 msgr2=0x7f2e2c04ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:10:58.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e33fff700 1 --2- 172.21.15.123:0/520203851 >> v2:172.21.15.153:3300/0 conn(0x7f2e2c0eb420 0x7f2e2c04ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e33fff700 1 -- 172.21.15.123:0/520203851 >> v1:172.21.15.153:6789/0 conn(0x7f2e2c033ac0 legacy=0x7f2e2c009ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e33fff700 1 -- 172.21.15.123:0/520203851 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c01cc30 con 0x7f2e2c007260 2024-09-13T17:10:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e33fff700 1 --2- 172.21.15.123:0/520203851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2c007260 0x7f2e2c04f150 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f2e34064010 tx=0x7f2e34069900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85542a3a1bf23712 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e327fc700 1 -- 172.21.15.123:0/520203851 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e340675b0 con 0x7f2e2c007260 2024-09-13T17:10:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.828+0000 7f2e327fc700 1 -- 172.21.15.123:0/520203851 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e34073f10 con 0x7f2e2c007260 2024-09-13T17:10:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.832+0000 7f2e327fc700 1 -- 172.21.15.123:0/520203851 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34067710 con 0x7f2e2c007260 2024-09-13T17:10:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.832+0000 7f2e388c9700 1 -- 172.21.15.123:0/520203851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2c007260 msgr2=0x7f2e2c04f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.832+0000 7f2e388c9700 1 --2- 172.21.15.123:0/520203851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2c007260 0x7f2e2c04f150 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f2e34064010 tx=0x7f2e34069900 comp rx=0 tx=0).stop 2024-09-13T17:10:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.832+0000 7f2e388c9700 1 -- 172.21.15.123:0/520203851 shutdown_connections 2024-09-13T17:10:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.832+0000 7f2e388c9700 1 --2- 172.21.15.123:0/520203851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2c007260 0x7f2e2c04f150 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.832+0000 7f2e388c9700 1 --2- 172.21.15.123:0/520203851 >> v2:172.21.15.153:3300/0 conn(0x7f2e2c0eb420 0x7f2e2c04ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.832+0000 7f2e388c9700 1 -- 172.21.15.123:0/520203851 >> 172.21.15.123:0/520203851 conn(0x7f2e2c036140 msgr2=0x7f2e2c036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.832+0000 7f2e388c9700 1 -- 172.21.15.123:0/520203851 shutdown_connections 2024-09-13T17:10:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.832+0000 7f2e388c9700 1 -- 172.21.15.123:0/520203851 wait complete. 2024-09-13T17:10:58.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.832+0000 7f2e388c9700 1 Processor -- start 2024-09-13T17:10:58.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.832+0000 7f2e388c9700 1 -- start start 2024-09-13T17:10:58.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e388c9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2c007260 0x7f2e2c0dca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e388c9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c033ac0 0x7f2e2c04ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e388c9700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e2c049310 0x7f2e2c04d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e388c9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c048270 con 0x7f2e2c007260 2024-09-13T17:10:58.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e388c9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c048550 con 0x7f2e2c033ac0 2024-09-13T17:10:58.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e388c9700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c048830 con 0x7f2e2c049310 2024-09-13T17:10:58.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e337fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2c007260 0x7f2e2c0dca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e337fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2c007260 0x7f2e2c0dca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58120/0 (socket says 172.21.15.123:58120) 2024-09-13T17:10:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e337fe700 1 -- 172.21.15.123:0/1329470347 learned_addr learned my addr 172.21.15.123:0/1329470347 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:10:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e32ffd700 1 --2- 172.21.15.123:0/1329470347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c033ac0 0x7f2e2c04ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e33fff700 1 --2- 172.21.15.123:0/1329470347 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e2c049310 0x7f2e2c04d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e337fe700 1 -- 172.21.15.123:0/1329470347 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e2c049310 msgr2=0x7f2e2c04d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e337fe700 1 --2- 172.21.15.123:0/1329470347 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e2c049310 0x7f2e2c04d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e337fe700 1 -- 172.21.15.123:0/1329470347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c033ac0 msgr2=0x7f2e2c04ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e337fe700 1 --2- 172.21.15.123:0/1329470347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c033ac0 0x7f2e2c04ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e337fe700 1 -- 172.21.15.123:0/1329470347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3404f5c0 con 0x7f2e2c007260 2024-09-13T17:10:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e337fe700 1 --2- 172.21.15.123:0/1329470347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2c007260 0x7f2e2c0dca70 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c4f0 tx=0x7f2e2800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e1bfff700 1 -- 172.21.15.123:0/1329470347 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e280052d0 con 0x7f2e2c007260 2024-09-13T17:10:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e1bfff700 1 -- 172.21.15.123:0/1329470347 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e28005430 con 0x7f2e2c007260 2024-09-13T17:10:58.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e388c9700 1 -- 172.21.15.123:0/1329470347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2c048b10 con 0x7f2e2c007260 2024-09-13T17:10:58.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e1bfff700 1 -- 172.21.15.123:0/1329470347 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28003930 con 0x7f2e2c007260 2024-09-13T17:10:58.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e388c9700 1 -- 172.21.15.123:0/1329470347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2c0dcfb0 con 0x7f2e2c007260 2024-09-13T17:10:58.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.836+0000 7f2e388c9700 1 -- 172.21.15.123:0/1329470347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2c049030 con 0x7f2e2c007260 2024-09-13T17:10:58.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.840+0000 7f2e1bfff700 1 -- 172.21.15.123:0/1329470347 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2e28003a90 con 0x7f2e2c007260 2024-09-13T17:10:58.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.840+0000 7f2e1bfff700 1 --2- 172.21.15.123:0/1329470347 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e20066730 0x7f2e20068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:58.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.840+0000 7f2e1bfff700 1 -- 172.21.15.123:0/1329470347 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2e28083360 con 0x7f2e2c007260 2024-09-13T17:10:58.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.840+0000 7f2e32ffd700 1 --2- 172.21.15.123:0/1329470347 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e20066730 0x7f2e20068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:58.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.840+0000 7f2e32ffd700 1 --2- 172.21.15.123:0/1329470347 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e20066730 0x7f2e20068bf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0e9f20 tx=0x7f2e24008040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:58.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:58.848+0000 7f2e1bfff700 1 -- 172.21.15.123:0/1329470347 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2e2c049030 con 0x7f2e2c007260 2024-09-13T17:10:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:59.016+0000 7f2e388c9700 1 -- 172.21.15.123:0/1329470347 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e2c049030 con 0x7f2e20066730 2024-09-13T17:10:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:59.020+0000 7f2e1bfff700 1 -- 172.21.15.123:0/1329470347 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49530 (secure 0 0 0) 0x7f2e2c049030 con 0x7f2e20066730 2024-09-13T17:10:59.024 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:10:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:59.020+0000 7f2e388c9700 1 -- 172.21.15.123:0/1329470347 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e20066730 msgr2=0x7f2e20068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:59.020+0000 7f2e388c9700 1 --2- 172.21.15.123:0/1329470347 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e20066730 0x7f2e20068bf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0e9f20 tx=0x7f2e24008040 comp rx=0 tx=0).stop 2024-09-13T17:10:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:59.020+0000 7f2e388c9700 1 -- 172.21.15.123:0/1329470347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2c007260 msgr2=0x7f2e2c0dca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:59.020+0000 7f2e388c9700 1 --2- 172.21.15.123:0/1329470347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2c007260 0x7f2e2c0dca70 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c4f0 tx=0x7f2e2800c8b0 comp rx=0 tx=0).stop 2024-09-13T17:10:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:59.020+0000 7f2e388c9700 1 -- 172.21.15.123:0/1329470347 shutdown_connections 2024-09-13T17:10:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:59.024+0000 7f2e388c9700 1 --2- 172.21.15.123:0/1329470347 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f2e20066730 0x7f2e20068bf0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:59.024+0000 7f2e388c9700 1 --2- 172.21.15.123:0/1329470347 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2e2c049310 0x7f2e2c04d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:59.024+0000 7f2e388c9700 1 --2- 172.21.15.123:0/1329470347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c033ac0 0x7f2e2c04ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:59.024+0000 7f2e388c9700 1 --2- 172.21.15.123:0/1329470347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2c007260 0x7f2e2c0dca70 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:59.024+0000 7f2e388c9700 1 -- 172.21.15.123:0/1329470347 >> 172.21.15.123:0/1329470347 conn(0x7f2e2c036140 msgr2=0x7f2e2c035740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:59.024+0000 7f2e388c9700 1 -- 172.21.15.123:0/1329470347 shutdown_connections 2024-09-13T17:10:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:10:59.024+0000 7f2e388c9700 1 -- 172.21.15.123:0/1329470347 wait complete. 2024-09-13T17:10:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:10:59.040 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-09-13T17:10:58.810258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":255832,"kb_used_data":10984,"kb_used_omap":12,"kb_used_meta":244723,"kb_avail":754718888,"statfs":{"total":773094113280,"available":772832141312,"internally_reserved":0,"allocated":11247616,"data_stored":5474680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":250596921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2097182,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-71,"num_write_kb":-22568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.873875"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":247,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-13T17:10:49.936852+0000","last_change":"2024-09-13T17:06:38.843777+0000","last_active":"2024-09-13T17:10:49.936852+0000","last_peered":"2024-09-13T17:10:49.936852+0000","last_clean":"2024-09-13T17:10:49.936852+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:10:49.936852+0000","last_undegraded":"2024-09-13T17:10:49.936852+0000","last_fullsized":"2024-09-13T17:10:49.936852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:06:36.982447+0000","last_clean_scrub_stamp":"2024-09-13T17:06:36.982447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:00.264894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1851392,"data_stored":1127111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.57699999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0920000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.89600000000000002},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.129,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.78100000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.90500000000000003,"15min":0.92100000000000004},"min":{"1min":0.52000000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2070000000000001,"5min":1.456,"15min":1.456},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.54000000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.101,"5min":1.609,"15min":1.609},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.85899999999999999,"15min":0.86099999999999999},"min":{"1min":0.59599999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.22,"5min":1.238,"15min":1.238},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.96999999999999997,"15min":0.999},"min":{"1min":0.60399999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1739999999999999,"5min":1.839,"15min":1.839},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.92700000000000005,"15min":0.92000000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3440000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96099999999999997,"15min":0.99099999999999999},"min":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1499999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.84699999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90400000000000003,"15min":0.90200000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.083,"5min":1.0900000000000001,"15min":1.1140000000000001},"min":{"1min":0.73999999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4079999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.006}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.69699999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4390000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0129999999999999,"15min":1.0149999999999999},"min":{"1min":0.72399999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3200000000000001,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.0620000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0720000000000001,"15min":1.1140000000000001},"min":{"1min":0.76800000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3120000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.123,"15min":1.135},"min":{"1min":0.83699999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.522,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.0509999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32344,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.753},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83699999999999997,"15min":0.86899999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.091,"5min":1.431,"15min":1.431},"last":0.54300000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91400000000000003,"15min":0.92400000000000004},"min":{"1min":0.65300000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.087,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.90400000000000003,"15min":0.90900000000000003},"min":{"1min":0.60899999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.177,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.93300000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.86599999999999999,"15min":0.90300000000000002},"min":{"1min":0.65200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92700000000000005,"15min":0.96899999999999997},"min":{"1min":0.59499999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4350000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.94899999999999995,"15min":0.97399999999999998},"min":{"1min":0.64400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.749},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.022,"15min":1.044},"min":{"1min":0.84699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.139,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.79100000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.90400000000000003,"15min":0.90800000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0229999999999999,"15min":1.0249999999999999},"min":{"1min":0.76300000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.86699999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0049999999999999,"15min":1.0149999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.1950000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.093,"5min":1.0409999999999999,"15min":1.0640000000000001},"min":{"1min":0.74299999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.0149999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0980000000000001,"15min":1.1060000000000001},"min":{"1min":0.78700000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.63},{"interface":"front","average":{"1min":1.169,"5min":1.1599999999999999,"15min":1.1879999999999999},"min":{"1min":0.96499999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.9950000000000001,"5min":2.194,"15min":2.194},"last":1.0529999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32348,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.82899999999999996,"15min":0.85999999999999999},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.874,"5min":0.85899999999999999,"15min":0.88100000000000001},"min":{"1min":0.64100000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.73399999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.93600000000000005,"15min":0.95299999999999996},"min":{"1min":0.67600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.133,"5min":1.508,"15min":1.508},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.751,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.24,"5min":1.482,"15min":1.482},"last":1.2290000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85799999999999998,"15min":0.85499999999999998},"min":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.93000000000000005,"15min":0.92700000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.375,"5min":5.375,"15min":5.375},"last":1.0269999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96599999999999997,"15min":0.997},"min":{"1min":0.626,"5min":0.622,"15min":0.622},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.93200000000000005,"15min":0.93500000000000005},"min":{"1min":0.70999999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.329,"5min":1.603,"15min":1.603},"last":0.94699999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.006,"15min":1.054},"min":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.367,"5min":1.466,"15min":1.466},"last":1.175},{"interface":"front","average":{"1min":1.024,"5min":0.995,"15min":1.03},"min":{"1min":0.80500000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3759999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.99299999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0289999999999999,"15min":1.0620000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.244,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.105},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.123,"15min":1.177},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5660000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.2829999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.131},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.242,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.125},{"interface":"front","average":{"1min":1.234,"5min":1.171,"15min":1.206},"min":{"1min":0.76100000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":1.1519999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32348,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.56499999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.23,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82399999999999995,"15min":0.83599999999999997},"min":{"1min":0.48699999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.76400000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90200000000000002,"15min":0.90600000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2290000000000001,"5min":1.357,"15min":1.357},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93500000000000005,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.288,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.82599999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.88400000000000001,"15min":0.88100000000000001},"min":{"1min":0.501,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.131,"5min":1.272,"15min":1.272},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.95899999999999996,"15min":0.92100000000000004},"min":{"1min":0.77100000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.252,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0089999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.89300000000000002,"15min":0.91600000000000004},"min":{"1min":0.58799999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.371,"5min":1.464,"15min":1.464},"last":0.88},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88900000000000001,"15min":0.88400000000000001},"min":{"1min":0.63700000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.161,"5min":1.353,"15min":1.353},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.94299999999999995,"15min":0.93899999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1830000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.075,"15min":1.0649999999999999},"min":{"1min":0.64500000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3540000000000001,"5min":1.478,"15min":1.478},"last":0.94399999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.749,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1679999999999999,"5min":1.26,"15min":1.26},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.079,"15min":1.0549999999999999},"min":{"1min":0.88,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.367,"5min":1.613,"15min":1.613},"last":0.91200000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.097,"15min":1.0900000000000001},"min":{"1min":0.82199999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.044},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.123,"15min":1.125},"min":{"1min":0.85799999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.331,"5min":2.032,"15min":2.032},"last":0.85499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32348,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.022,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.44,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89500000000000002,"5min":1.081,"15min":1.081},"last":0.45800000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.629,"15min":0.64900000000000002},"min":{"1min":0.46200000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.90800000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.56899999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1140000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.56200000000000006}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.71199999999999997},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96899999999999997,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72899999999999998,"15min":0.73799999999999999},"min":{"1min":0.443,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.91500000000000004},"min":{"1min":0.64200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.014,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.92500000000000004,"15min":0.95399999999999996},"min":{"1min":0.64600000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3089999999999999,"5min":1.899,"15min":1.899},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90900000000000003,"15min":0.92700000000000005},"min":{"1min":0.77000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.381,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.97999999999999998,"15min":0.99099999999999999},"min":{"1min":0.75,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.25,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.747}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.997,"15min":1.0169999999999999},"min":{"1min":0.72099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2130000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.879},{"interface":"front","average":{"1min":1.018,"5min":1.01,"15min":1.038},"min":{"1min":0.68899999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.427,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.67600000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0569999999999999,"15min":1.0840000000000001},"min":{"1min":0.77900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.282,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0349999999999999,"15min":1.0629999999999999},"min":{"1min":0.752,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.345,"5min":1.756,"15min":1.756},"last":0.91700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28252,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.61599999999999999,"15min":0.59499999999999997},"min":{"1min":0.47599999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60899999999999999,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93200000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":0.995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.48799999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.214,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.78000000000000003,"15min":0.76800000000000002},"min":{"1min":0.56000000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.7140000000000004,"5min":4.7140000000000004,"15min":4.7140000000000004},"last":0.89500000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.71699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.04},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.70899999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.252,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93600000000000005,"15min":0.95199999999999996},"min":{"1min":0.68400000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2450000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.66000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.2210000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.0589999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97899999999999998,"15min":0.97199999999999998},"min":{"1min":0.79700000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.169,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.948,"5min":1.1910000000000001,"15min":1.056},"min":{"1min":0.68700000000000006,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":21.474,"5min":21.474,"15min":21.474},"last":1.0800000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0209999999999999,"15min":1.0509999999999999},"min":{"1min":0.67600000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.292,"5min":1.506,"15min":1.506},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.024,"15min":1.0329999999999999},"min":{"1min":0.79300000000000004,"5min":0.625,"15min":0.625},"max":{"1min":1.2769999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.95999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32344,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64600000000000002,"15min":0.66000000000000003},"min":{"1min":0.438,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82999999999999996,"5min":1.151,"15min":1.151},"last":0.437},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.02,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.625,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.79200000000000004,"5min":1.306,"15min":1.306},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.39800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.008,"5min":1.28,"15min":1.28},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.139,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78100000000000003,"15min":0.81799999999999995},"min":{"1min":0.55900000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":1.905,"15min":1.905},"last":0.72699999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.71899999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.236,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.97199999999999998,"15min":1.0209999999999999},"min":{"1min":0.65400000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.181,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.018}]},{"osd":5,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.98499999999999999,"15min":1.0509999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1279999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.083},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0629999999999999,"15min":1.1040000000000001},"min":{"1min":0.80300000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.546,"5min":1.556,"15min":1.556},"last":0.92500000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.038,"15min":1.071},"min":{"1min":0.82399999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3009999999999999,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.159},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.077,"15min":1.125},"min":{"1min":0.73799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2470000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.96699999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1120000000000001,"15min":1.151},"min":{"1min":0.62,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6639999999999999,"5min":1.712,"15min":1.712},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.0700000000000001,"15min":1.093},"min":{"1min":0.79200000000000004,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3959999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.1080000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1851392,"data_stored":1127111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.411,"5min":3.25,"15min":3.25},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.746,"15min":0.80000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93300000000000005,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.60899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69399999999999995,"15min":0.72999999999999998},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.91600000000000004,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77800000000000002,"15min":0.86199999999999999},"min":{"1min":0.49399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.006,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.747,"15min":0.84099999999999997},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.073,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.85299999999999998,"15min":0.94099999999999995},"min":{"1min":0.48499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3149999999999999,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.56200000000000006}]},{"osd":4,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.93899999999999995,"15min":1.0089999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.379,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.093,"5min":1.0289999999999999,"15min":1.0569999999999999},"min":{"1min":0.76700000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.1150000000000002,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":0.63}]},{"osd":5,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.004,"15min":1.0620000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3129999999999999,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.016,"15min":1.093},"min":{"1min":0.63600000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.2450000000000001,"5min":5.399,"15min":5.399},"last":0.79900000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1040000000000001,"15min":1.1479999999999999},"min":{"1min":0.68700000000000006,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.0390000000000001,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.997,"5min":1.056,"15min":1.1060000000000001},"min":{"1min":0.77800000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2649999999999999,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.087,"15min":1.1220000000000001},"min":{"1min":0.74099999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2789999999999999,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1120000000000001,"15min":1.2},"min":{"1min":0.72599999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3149999999999999,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":0.75800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:10:59.045 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T17:06:36.982447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=6, tm_sec=36, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=10, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:10:59.045 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T17:11:16.613 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:11:16.616 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:11:19.046 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:11:19.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.164+0000 7f4f71f95700 1 Processor -- start 2024-09-13T17:11:19.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.164+0000 7f4f71f95700 1 -- start start 2024-09-13T17:11:19.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.164+0000 7f4f71f95700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4f6c15e0d0 0x7f4f6c0cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.164+0000 7f4f71f95700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c1542e0 con 0x7f4f6c15ab30 2024-09-13T17:11:19.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.164+0000 7f4f71f95700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c159df0 con 0x7f4f6c153f00 2024-09-13T17:11:19.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.164+0000 7f4f71f95700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6c0ced30 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.164+0000 7f4f71794700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4f6c15ab30 0x7f4f6c06a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53304/0 (socket says 172.21.15.123:53304) 2024-09-13T17:11:19.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.164+0000 7f4f71794700 1 -- 172.21.15.123:0/2753229510 learned_addr learned my addr 172.21.15.123:0/2753229510 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:11:19.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.164+0000 7f4f6bfff700 1 --2- 172.21.15.123:0/2753229510 >> v2:172.21.15.153:3300/0 conn(0x7f4f6c15e0d0 0x7f4f6c0cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f6b7fe700 1 -- 172.21.15.123:0/2753229510 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581174745 0 0) 0x7f4f6c1542e0 con 0x7f4f6c15ab30 2024-09-13T17:11:19.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f6b7fe700 1 -- 172.21.15.123:0/2753229510 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f540035d0 con 0x7f4f6c15ab30 2024-09-13T17:11:19.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f6bfff700 1 -- 172.21.15.123:0/2753229510 >> v1:172.21.15.153:6789/0 conn(0x7f4f6c153f00 legacy=0x7f4f6c0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f6bfff700 1 -- 172.21.15.123:0/2753229510 >> v1:172.21.15.123:6789/0 conn(0x7f4f6c15ab30 legacy=0x7f4f6c06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f6bfff700 1 -- 172.21.15.123:0/2753229510 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c0ce7f0 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f6bfff700 1 --2- 172.21.15.123:0/2753229510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f6c15e0d0 0x7f4f6c0cc220 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009850 tx=0x7f4f60009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f763b34587ac5aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:19.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f6b7fe700 1 -- 172.21.15.123:0/2753229510 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f60011830 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f6b7fe700 1 -- 172.21.15.123:0/2753229510 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f60011990 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f6b7fe700 1 -- 172.21.15.123:0/2753229510 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f60011d40 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f71f95700 1 -- 172.21.15.123:0/2753229510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f6c15e0d0 msgr2=0x7f4f6c0cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f71f95700 1 --2- 172.21.15.123:0/2753229510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f6c15e0d0 0x7f4f6c0cc220 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009850 tx=0x7f4f60009b60 comp rx=0 tx=0).stop 2024-09-13T17:11:19.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f71f95700 1 -- 172.21.15.123:0/2753229510 shutdown_connections 2024-09-13T17:11:19.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f71f95700 1 --2- 172.21.15.123:0/2753229510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f6c15e0d0 0x7f4f6c0cc220 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f71f95700 1 -- 172.21.15.123:0/2753229510 >> 172.21.15.123:0/2753229510 conn(0x7f4f6c066780 msgr2=0x7f4f6c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:19.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f71f95700 1 -- 172.21.15.123:0/2753229510 shutdown_connections 2024-09-13T17:11:19.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.168+0000 7f4f71f95700 1 -- 172.21.15.123:0/2753229510 wait complete. 2024-09-13T17:11:19.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71f95700 1 Processor -- start 2024-09-13T17:11:19.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71f95700 1 -- start start 2024-09-13T17:11:19.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71f95700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f6c153f00 0x7f4f6c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71f95700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f6c15ab30 0x7f4f6c14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71f95700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c15e0d0 0x7f4f6c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71f95700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c14a6f0 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71f95700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c147a60 con 0x7f4f6c153f00 2024-09-13T17:11:19.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71f95700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c147780 con 0x7f4f6c15ab30 2024-09-13T17:11:19.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71794700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c15e0d0 0x7f4f6c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f6bfff700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f6c15ab30 0x7f4f6c14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f70f93700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f6c153f00 0x7f4f6c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71794700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c15e0d0 0x7f4f6c06f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35652/0 (socket says 172.21.15.123:35652) 2024-09-13T17:11:19.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71794700 1 -- 172.21.15.123:0/590535829 learned_addr learned my addr 172.21.15.123:0/590535829 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:11:19.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71794700 1 -- 172.21.15.123:0/590535829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f6c15ab30 msgr2=0x7f4f6c14a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71794700 1 --2- 172.21.15.123:0/590535829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f6c15ab30 0x7f4f6c14a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71794700 1 -- 172.21.15.123:0/590535829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f6c153f00 msgr2=0x7f4f6c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71794700 1 --2- 172.21.15.123:0/590535829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f6c153f00 0x7f4f6c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f71794700 1 -- 172.21.15.123:0/590535829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f600094b0 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f6bfff700 1 --2- 172.21.15.123:0/590535829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f6c15ab30 0x7f4f6c14a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:11:19.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.172+0000 7f4f70f93700 1 --2- 172.21.15.123:0/590535829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f6c153f00 0x7f4f6c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:11:19.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.176+0000 7f4f71794700 1 --2- 172.21.15.123:0/590535829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c15e0d0 0x7f4f6c06f280 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400cbc0 tx=0x7f4f6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:19.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.176+0000 7f4f697fa700 1 -- 172.21.15.123:0/590535829 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64007480 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.176+0000 7f4f697fa700 1 -- 172.21.15.123:0/590535829 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f640075e0 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.176+0000 7f4f71f95700 1 -- 172.21.15.123:0/590535829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6c1496d0 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.176+0000 7f4f697fa700 1 -- 172.21.15.123:0/590535829 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f640079b0 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.176+0000 7f4f71f95700 1 -- 172.21.15.123:0/590535829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c149c90 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.176+0000 7f4f71f95700 1 -- 172.21.15.123:0/590535829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c070350 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.176+0000 7f4f697fa700 1 -- 172.21.15.123:0/590535829 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f6401b3b0 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.176+0000 7f4f697fa700 1 --2- 172.21.15.123:0/590535829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4f58066760 0x7f4f58068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.176+0000 7f4f697fa700 1 -- 172.21.15.123:0/590535829 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4f64083850 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.176+0000 7f4f70f93700 1 --2- 172.21.15.123:0/590535829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4f58066760 0x7f4f58068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.180+0000 7f4f70f93700 1 --2- 172.21.15.123:0/590535829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4f58066760 0x7f4f58068c20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c14aab0 tx=0x7f4f5c009040 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:19.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.184+0000 7f4f697fa700 1 -- 172.21.15.123:0/590535829 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4f64050da0 con 0x7f4f6c15e0d0 2024-09-13T17:11:19.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.356+0000 7f4f71f95700 1 -- 172.21.15.123:0/590535829 --> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f6c15a330 con 0x7f4f58066760 2024-09-13T17:11:19.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.356+0000 7f4f697fa700 1 -- 172.21.15.123:0/590535829 <== mgr.4128 v2:172.21.15.123:6832/2143283540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49436 (secure 0 0 0) 0x7f4f5c00fa20 con 0x7f4f58066760 2024-09-13T17:11:19.362 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:11:19.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.360+0000 7f4f71f95700 1 -- 172.21.15.123:0/590535829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4f58066760 msgr2=0x7f4f58068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.360+0000 7f4f71f95700 1 --2- 172.21.15.123:0/590535829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4f58066760 0x7f4f58068c20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c14aab0 tx=0x7f4f5c009040 comp rx=0 tx=0).stop 2024-09-13T17:11:19.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.360+0000 7f4f71f95700 1 -- 172.21.15.123:0/590535829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c15e0d0 msgr2=0x7f4f6c06f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.360+0000 7f4f71f95700 1 --2- 172.21.15.123:0/590535829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c15e0d0 0x7f4f6c06f280 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400cbc0 tx=0x7f4f6400cbf0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.360+0000 7f4f71f95700 1 -- 172.21.15.123:0/590535829 shutdown_connections 2024-09-13T17:11:19.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.360+0000 7f4f71f95700 1 --2- 172.21.15.123:0/590535829 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f4f58066760 0x7f4f58068c20 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.360+0000 7f4f71f95700 1 --2- 172.21.15.123:0/590535829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f6c15e0d0 0x7f4f6c06f280 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.360+0000 7f4f71f95700 1 --2- 172.21.15.123:0/590535829 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4f6c15ab30 0x7f4f6c14a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.360+0000 7f4f71f95700 1 --2- 172.21.15.123:0/590535829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f6c153f00 0x7f4f6c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.360+0000 7f4f71f95700 1 -- 172.21.15.123:0/590535829 >> 172.21.15.123:0/590535829 conn(0x7f4f6c066780 msgr2=0x7f4f6c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:19.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.360+0000 7f4f71f95700 1 -- 172.21.15.123:0/590535829 shutdown_connections 2024-09-13T17:11:19.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.360+0000 7f4f71f95700 1 -- 172.21.15.123:0/590535829 wait complete. 2024-09-13T17:11:19.366 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-13T17:11:19.376 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-09-13T17:11:18.815628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":255824,"kb_used_data":10984,"kb_used_omap":12,"kb_used_meta":244723,"kb_avail":754718896,"statfs":{"total":773094113280,"available":772832149504,"internally_reserved":0,"allocated":11247616,"data_stored":5474680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":250596921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003172"},"pg_stats":[{"pgid":"1.0","version":"101'119","reported_seq":261,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-13T17:11:03.972561+0000","last_change":"2024-09-13T17:11:03.972798+0000","last_active":"2024-09-13T17:11:03.972561+0000","last_peered":"2024-09-13T17:11:03.972561+0000","last_clean":"2024-09-13T17:11:03.972561+0000","last_became_active":"2024-09-13T17:06:38.841676+0000","last_became_peered":"2024-09-13T17:06:38.841676+0000","last_unstale":"2024-09-13T17:11:03.972561+0000","last_undegraded":"2024-09-13T17:11:03.972561+0000","last_fullsized":"2024-09-13T17:11:03.972561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'119","last_scrub_stamp":"2024-09-13T17:11:03.972512+0000","last_deep_scrub":"101'119","last_deep_scrub_stamp":"2024-09-13T17:11:03.972512+0000","last_clean_scrub_stamp":"2024-09-13T17:11:03.972512+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:08.516371+0000","scrub_duration":0.009699081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1851392,"data_stored":1127111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.57699999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0920000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.89600000000000002},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.129,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.89900000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.90500000000000003,"15min":0.92100000000000004},"min":{"1min":0.52000000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2070000000000001,"5min":1.456,"15min":1.456},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.54000000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.101,"5min":1.609,"15min":1.609},"last":0.92200000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.85899999999999999,"15min":0.86099999999999999},"min":{"1min":0.59599999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.22,"5min":1.238,"15min":1.238},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.96999999999999997,"15min":0.999},"min":{"1min":0.60399999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1739999999999999,"5min":1.839,"15min":1.839},"last":1.012}]},{"osd":3,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.92700000000000005,"15min":0.92000000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3440000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96099999999999997,"15min":0.99099999999999999},"min":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1499999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.83699999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90400000000000003,"15min":0.90200000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.0900000000000001,"15min":1.1140000000000001},"min":{"1min":0.73999999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4079999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.95799999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.69699999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4390000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0129999999999999,"15min":1.0149999999999999},"min":{"1min":0.72399999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3200000000000001,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.79900000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0720000000000001,"15min":1.1140000000000001},"min":{"1min":0.76800000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3120000000000001,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.123,"15min":1.135},"min":{"1min":0.83699999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.522,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1180000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32344,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.753},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83699999999999997,"15min":0.86899999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.091,"5min":1.431,"15min":1.431},"last":0.80600000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91400000000000003,"15min":0.92400000000000004},"min":{"1min":0.65300000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.087,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.876,"5min":0.90400000000000003,"15min":0.90900000000000003},"min":{"1min":0.60899999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.177,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.006}]},{"osd":2,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.86599999999999999,"15min":0.90300000000000002},"min":{"1min":0.65200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92700000000000005,"15min":0.96899999999999997},"min":{"1min":0.59499999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4350000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.89900000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.94899999999999995,"15min":0.97399999999999998},"min":{"1min":0.64400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.022,"15min":1.044},"min":{"1min":0.84699999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.139,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.151}]},{"osd":4,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.90400000000000003,"15min":0.90800000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0229999999999999,"15min":1.0249999999999999},"min":{"1min":0.76300000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.71199999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0049999999999999,"15min":1.0149999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.1950000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.879},{"interface":"front","average":{"1min":1.093,"5min":1.0409999999999999,"15min":1.0640000000000001},"min":{"1min":0.74299999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":1.1100000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:10:45 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0980000000000001,"15min":1.1060000000000001},"min":{"1min":0.78700000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.169,"5min":1.1599999999999999,"15min":1.1879999999999999},"min":{"1min":0.96499999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.9950000000000001,"5min":2.194,"15min":2.194},"last":1.056}]}]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32348,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.82899999999999996,"15min":0.85999999999999999},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.874,"5min":0.85899999999999999,"15min":0.88100000000000001},"min":{"1min":0.64100000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.61899999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.93600000000000005,"15min":0.95299999999999996},"min":{"1min":0.67600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.133,"5min":1.508,"15min":1.508},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.751,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.24,"5min":1.482,"15min":1.482},"last":0.94899999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85799999999999998,"15min":0.85499999999999998},"min":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.93000000000000005,"15min":0.92700000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.375,"5min":5.375,"15min":5.375},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96599999999999997,"15min":0.997},"min":{"1min":0.626,"5min":0.622,"15min":0.622},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":1.103},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.93200000000000005,"15min":0.93500000000000005},"min":{"1min":0.70999999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.329,"5min":1.603,"15min":1.603},"last":1.0029999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.006,"15min":1.054},"min":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.367,"5min":1.466,"15min":1.466},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.024,"5min":0.995,"15min":1.03},"min":{"1min":0.80500000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3759999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.054}]},{"osd":6,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0289999999999999,"15min":1.0620000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.244,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.137},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.123,"15min":1.177},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5660000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1890000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:10:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0780000000000001,"15min":1.131},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.242,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.171,"15min":1.206},"min":{"1min":0.76100000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":1.216}]}]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32348,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.56499999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.23,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82399999999999995,"15min":0.83599999999999997},"min":{"1min":0.48699999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.72499999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90200000000000002,"15min":0.90600000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2290000000000001,"5min":1.357,"15min":1.357},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93500000000000005,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.288,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.92000000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.88400000000000001,"15min":0.88100000000000001},"min":{"1min":0.501,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.131,"5min":1.272,"15min":1.272},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.95899999999999996,"15min":0.92100000000000004},"min":{"1min":0.77100000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.252,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0189999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.89300000000000002,"15min":0.91600000000000004},"min":{"1min":0.58799999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.371,"5min":1.464,"15min":1.464},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88900000000000001,"15min":0.88400000000000001},"min":{"1min":0.63700000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.161,"5min":1.353,"15min":1.353},"last":0.98699999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.94299999999999995,"15min":0.93899999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1830000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.069,"5min":1.075,"15min":1.0649999999999999},"min":{"1min":0.64500000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3540000000000001,"5min":1.478,"15min":1.478},"last":1.075}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.749,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1679999999999999,"5min":1.26,"15min":1.26},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.079,"15min":1.0549999999999999},"min":{"1min":0.88,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.367,"5min":1.613,"15min":1.613},"last":0.68000000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.097,"15min":1.0900000000000001},"min":{"1min":0.82199999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.123,"15min":1.125},"min":{"1min":0.85799999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.331,"5min":2.032,"15min":2.032},"last":0.89200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32348,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.022,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.44,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89500000000000002,"5min":1.081,"15min":1.081},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.629,"15min":0.64900000000000002},"min":{"1min":0.46200000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.90800000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.56899999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1140000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.78400000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.71199999999999997},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96899999999999997,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72899999999999998,"15min":0.73799999999999999},"min":{"1min":0.443,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70499999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.91500000000000004},"min":{"1min":0.64200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.014,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.92500000000000004,"15min":0.95399999999999996},"min":{"1min":0.64600000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3089999999999999,"5min":1.899,"15min":1.899},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90900000000000003,"15min":0.92700000000000005},"min":{"1min":0.77000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.381,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.97999999999999998,"15min":0.99099999999999999},"min":{"1min":0.75,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.25,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.86099999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.997,"15min":1.0169999999999999},"min":{"1min":0.72099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2130000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.01,"15min":1.038},"min":{"1min":0.68899999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.427,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.93600000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:10:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0569999999999999,"15min":1.0840000000000001},"min":{"1min":0.77900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.282,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.038},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0349999999999999,"15min":1.0629999999999999},"min":{"1min":0.752,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.345,"5min":1.756,"15min":1.756},"last":1.0640000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28252,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.61599999999999999,"15min":0.59499999999999997},"min":{"1min":0.47599999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60899999999999999,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93200000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.97299999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.48799999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.214,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.78000000000000003,"15min":0.76800000000000002},"min":{"1min":0.56000000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.7140000000000004,"5min":4.7140000000000004,"15min":4.7140000000000004},"last":0.94199999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.71699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.70899999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.252,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.083}]},{"osd":5,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93600000000000005,"15min":0.95199999999999996},"min":{"1min":0.68400000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2450000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.66000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.2210000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.1639999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97899999999999998,"15min":0.97199999999999998},"min":{"1min":0.79700000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.169,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.948,"5min":1.1910000000000001,"15min":1.056},"min":{"1min":0.68700000000000006,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":21.474,"5min":21.474,"15min":21.474},"last":1.264}]},{"osd":7,"last update":"Fri Sep 13 17:10:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0209999999999999,"15min":1.0509999999999999},"min":{"1min":0.67600000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.292,"5min":1.506,"15min":1.506},"last":1.125},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.024,"15min":1.0329999999999999},"min":{"1min":0.79300000000000004,"5min":0.625,"15min":0.625},"max":{"1min":1.2769999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.2390000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32344,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1257472,"data_stored":536743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64600000000000002,"15min":0.66000000000000003},"min":{"1min":0.438,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82999999999999996,"5min":1.151,"15min":1.151},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.02,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.77800000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.625,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.79200000000000004,"5min":1.306,"15min":1.306},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.39800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.008,"5min":1.28,"15min":1.28},"last":0.82399999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.139,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.746},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78100000000000003,"15min":0.81799999999999995},"min":{"1min":0.55900000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":1.905,"15min":1.905},"last":0.67600000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.71899999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.236,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.97199999999999998,"15min":1.0209999999999999},"min":{"1min":0.65400000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.181,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.97499999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.98499999999999999,"15min":1.0509999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1279999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0629999999999999,"15min":1.1040000000000001},"min":{"1min":0.80300000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.546,"5min":1.556,"15min":1.556},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.038,"15min":1.071},"min":{"1min":0.82399999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3009999999999999,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.077,"15min":1.125},"min":{"1min":0.73799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2470000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.0509999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1120000000000001,"15min":1.151},"min":{"1min":0.62,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.6639999999999999,"5min":1.712,"15min":1.712},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.0700000000000001,"15min":1.093},"min":{"1min":0.79200000000000004,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3959999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.153}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1851392,"data_stored":1127111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.411,"5min":3.25,"15min":3.25},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.746,"15min":0.80000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93300000000000005,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69399999999999995,"15min":0.72999999999999998},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.91600000000000004,"5min":3.5590000000000002,"15min":3.5590000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77800000000000002,"15min":0.86199999999999999},"min":{"1min":0.49399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.006,"5min":6.4089999999999998,"15min":6.4089999999999998},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.747,"15min":0.84099999999999997},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.073,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.85299999999999998,"15min":0.94099999999999995},"min":{"1min":0.48499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3149999999999999,"5min":6.2729999999999997,"15min":6.2729999999999997},"last":0.83499999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.93899999999999995,"15min":1.0089999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.379,"5min":5.3019999999999996,"15min":5.3019999999999996},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.0289999999999999,"15min":1.0569999999999999},"min":{"1min":0.76700000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.1150000000000002,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":1.01}]},{"osd":5,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.004,"15min":1.0620000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3129999999999999,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.016,"15min":1.093},"min":{"1min":0.63600000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.2450000000000001,"5min":5.399,"15min":5.399},"last":0.90300000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1040000000000001,"15min":1.1479999999999999},"min":{"1min":0.68700000000000006,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.0390000000000001,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.997,"5min":1.056,"15min":1.1060000000000001},"min":{"1min":0.77800000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2649999999999999,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.109}]},{"osd":7,"last update":"Fri Sep 13 17:10:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.087,"15min":1.1220000000000001},"min":{"1min":0.74099999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2789999999999999,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.034},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1120000000000001,"15min":1.2},"min":{"1min":0.72599999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3149999999999999,"5min":5.7510000000000003,"15min":5.7510000000000003},"last":1.077}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:11:19.378 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T17:11:19.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.488+0000 7f890359e700 1 Processor -- start 2024-09-13T17:11:19.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.488+0000 7f890359e700 1 -- start start 2024-09-13T17:11:19.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.488+0000 7f890359e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f890415a980 0x7f89040cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.488+0000 7f890359e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f89040b2740 0x7f89040cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.488+0000 7f890359e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89040b2eb0 con 0x7f890406f280 2024-09-13T17:11:19.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.488+0000 7f890359e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89040b1860 con 0x7f89040b2740 2024-09-13T17:11:19.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.488+0000 7f890359e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89040cdc30 con 0x7f890415a980 2024-09-13T17:11:19.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.488+0000 7f8901d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f89040b2740 0x7f89040cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.488+0000 7f8901d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f89040b2740 0x7f89040cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35666/0 (socket says 172.21.15.123:35666) 2024-09-13T17:11:19.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.488+0000 7f8901d9b700 1 -- 172.21.15.123:0/4114688330 learned_addr learned my addr 172.21.15.123:0/4114688330 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:11:19.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.488+0000 7f890259c700 1 --2- 172.21.15.123:0/4114688330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f890415a980 0x7f89040cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f8901d9b700 1 -- 172.21.15.123:0/4114688330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f890415a980 msgr2=0x7f89040cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:11:19.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f890159a700 1 -- 172.21.15.123:0/4114688330 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168053167 0 0) 0x7f89040b2eb0 con 0x7f890406f280 2024-09-13T17:11:19.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f8901d9b700 1 --2- 172.21.15.123:0/4114688330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f890415a980 0x7f89040cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f8901d9b700 1 -- 172.21.15.123:0/4114688330 >> v1:172.21.15.153:6789/0 conn(0x7f890406f280 legacy=0x7f890415d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f8901d9b700 1 -- 172.21.15.123:0/4114688330 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89040b2350 con 0x7f89040b2740 2024-09-13T17:11:19.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f8901d9b700 1 --2- 172.21.15.123:0/4114688330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89040b2740 0x7f89040cd6f0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f88f4009910 tx=0x7f88f4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3774d6e1d1bc7f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:19.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f890159a700 1 -- 172.21.15.123:0/4114688330 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4011830 con 0x7f89040b2740 2024-09-13T17:11:19.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f890159a700 1 -- 172.21.15.123:0/4114688330 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f4011990 con 0x7f89040b2740 2024-09-13T17:11:19.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f890159a700 1 -- 172.21.15.123:0/4114688330 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4011d40 con 0x7f89040b2740 2024-09-13T17:11:19.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f890359e700 1 -- 172.21.15.123:0/4114688330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89040b2740 msgr2=0x7f89040cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f890359e700 1 --2- 172.21.15.123:0/4114688330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89040b2740 0x7f89040cd6f0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f88f4009910 tx=0x7f88f4009c20 comp rx=0 tx=0).stop 2024-09-13T17:11:19.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f890359e700 1 -- 172.21.15.123:0/4114688330 shutdown_connections 2024-09-13T17:11:19.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f890359e700 1 --2- 172.21.15.123:0/4114688330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89040b2740 0x7f89040cd6f0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f890359e700 1 --2- 172.21.15.123:0/4114688330 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f890415a980 0x7f89040cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f890359e700 1 -- 172.21.15.123:0/4114688330 >> 172.21.15.123:0/4114688330 conn(0x7f89040735c0 msgr2=0x7f8904066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:19.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f890359e700 1 -- 172.21.15.123:0/4114688330 shutdown_connections 2024-09-13T17:11:19.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.492+0000 7f890359e700 1 -- 172.21.15.123:0/4114688330 wait complete. 2024-09-13T17:11:19.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.496+0000 7f890359e700 1 Processor -- start 2024-09-13T17:11:19.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.496+0000 7f890359e700 1 -- start start 2024-09-13T17:11:19.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.496+0000 7f890359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f890406f280 0x7f890414e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.496+0000 7f890359e700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89040b2740 0x7f890415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.496+0000 7f890359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f890415a980 0x7f8904159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890359e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890414e920 con 0x7f890406f280 2024-09-13T17:11:19.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8904153e80 con 0x7f890415a980 2024-09-13T17:11:19.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890359e700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8904154160 con 0x7f89040b2740 2024-09-13T17:11:19.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f890406f280 0x7f890414e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f890406f280 0x7f890414e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35670/0 (socket says 172.21.15.123:35670) 2024-09-13T17:11:19.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890259c700 1 -- 172.21.15.123:0/2742230602 learned_addr learned my addr 172.21.15.123:0/2742230602 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:11:19.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f8901d9b700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89040b2740 0x7f890415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f8902d9d700 1 --2- 172.21.15.123:0/2742230602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f890415a980 0x7f8904159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890259c700 1 -- 172.21.15.123:0/2742230602 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89040b2740 msgr2=0x7f890415ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890259c700 1 --2- 172.21.15.123:0/2742230602 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89040b2740 0x7f890415ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890259c700 1 -- 172.21.15.123:0/2742230602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f890415a980 msgr2=0x7f8904159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890259c700 1 --2- 172.21.15.123:0/2742230602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f890415a980 0x7f8904159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890259c700 1 -- 172.21.15.123:0/2742230602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f4009570 con 0x7f890406f280 2024-09-13T17:11:19.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890259c700 1 --2- 172.21.15.123:0/2742230602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f890406f280 0x7f890414e3e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f88f800e840 tx=0x7f88f800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:19.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f88f2ffd700 1 -- 172.21.15.123:0/2742230602 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f80095a0 con 0x7f890406f280 2024-09-13T17:11:19.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f88f2ffd700 1 -- 172.21.15.123:0/2742230602 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f8013680 con 0x7f890406f280 2024-09-13T17:11:19.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f88f2ffd700 1 -- 172.21.15.123:0/2742230602 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f80139f0 con 0x7f890406f280 2024-09-13T17:11:19.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890359e700 1 -- 172.21.15.123:0/2742230602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8904154440 con 0x7f890406f280 2024-09-13T17:11:19.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890359e700 1 -- 172.21.15.123:0/2742230602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8904154a00 con 0x7f890406f280 2024-09-13T17:11:19.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.500+0000 7f890359e700 1 -- 172.21.15.123:0/2742230602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89040cd6f0 con 0x7f890406f280 2024-09-13T17:11:19.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.504+0000 7f88f2ffd700 1 -- 172.21.15.123:0/2742230602 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f88f8013b50 con 0x7f890406f280 2024-09-13T17:11:19.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.504+0000 7f88f2ffd700 1 --2- 172.21.15.123:0/2742230602 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f88e4066730 0x7f88e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.504+0000 7f8901d9b700 1 --2- 172.21.15.123:0/2742230602 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f88e4066730 0x7f88e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.504+0000 7f88f2ffd700 1 -- 172.21.15.123:0/2742230602 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f88f8084120 con 0x7f890406f280 2024-09-13T17:11:19.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.504+0000 7f8901d9b700 1 --2- 172.21.15.123:0/2742230602 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f88e4066730 0x7f88e4068bf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f88f4000c00 tx=0x7f88f4008030 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:19.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.512+0000 7f88f2ffd700 1 -- 172.21.15.123:0/2742230602 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f88f80516f0 con 0x7f890406f280 2024-09-13T17:11:19.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.684+0000 7f890359e700 1 -- 172.21.15.123:0/2742230602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f890414fa10 con 0x7f890406f280 2024-09-13T17:11:19.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.688+0000 7f88f2ffd700 1 -- 172.21.15.123:0/2742230602 <== mon.0 v2:172.21.15.123:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f88f80516f0 con 0x7f890406f280 2024-09-13T17:11:19.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.688+0000 7f88f2ffd700 1 -- 172.21.15.123:0/2742230602 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f88f8054d10 con 0x7f890406f280 2024-09-13T17:11:19.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.692+0000 7f890359e700 1 -- 172.21.15.123:0/2742230602 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f88e4066730 msgr2=0x7f88e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.692+0000 7f890359e700 1 --2- 172.21.15.123:0/2742230602 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f88e4066730 0x7f88e4068bf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f88f4000c00 tx=0x7f88f4008030 comp rx=0 tx=0).stop 2024-09-13T17:11:19.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.692+0000 7f890359e700 1 -- 172.21.15.123:0/2742230602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f890406f280 msgr2=0x7f890414e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.692+0000 7f890359e700 1 --2- 172.21.15.123:0/2742230602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f890406f280 0x7f890414e3e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f88f800e840 tx=0x7f88f800eb50 comp rx=0 tx=0).stop 2024-09-13T17:11:19.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.692+0000 7f890359e700 1 -- 172.21.15.123:0/2742230602 shutdown_connections 2024-09-13T17:11:19.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.692+0000 7f890359e700 1 --2- 172.21.15.123:0/2742230602 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f88e4066730 0x7f88e4068bf0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.692+0000 7f890359e700 1 --2- 172.21.15.123:0/2742230602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f890415a980 0x7f8904159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.692+0000 7f890359e700 1 --2- 172.21.15.123:0/2742230602 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89040b2740 0x7f890415ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.692+0000 7f890359e700 1 --2- 172.21.15.123:0/2742230602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f890406f280 0x7f890414e3e0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.692+0000 7f890359e700 1 -- 172.21.15.123:0/2742230602 >> 172.21.15.123:0/2742230602 conn(0x7f89040735c0 msgr2=0x7f890415b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:19.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.692+0000 7f890359e700 1 -- 172.21.15.123:0/2742230602 shutdown_connections 2024-09-13T17:11:19.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.692+0000 7f890359e700 1 -- 172.21.15.123:0/2742230602 wait complete. 2024-09-13T17:11:19.714 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:11:19.715 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:11:19.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ffaede700 1 Processor -- start 2024-09-13T17:11:19.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ffaede700 1 -- start start 2024-09-13T17:11:19.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ffaede700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7ff406dee0 0x7f7ff40cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ffaede700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7ff41611a0 0x7f7ff406d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ffaede700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff4145c40 con 0x7f7ff406d560 2024-09-13T17:11:19.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ffaede700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff406ba80 con 0x7f7ff41611a0 2024-09-13T17:11:19.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ffaede700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff406e2c0 con 0x7f7ff406dee0 2024-09-13T17:11:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ffa6dd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7ff406d560 0x7f7ff406a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53318/0 (socket says 172.21.15.123:53318) 2024-09-13T17:11:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ff96db700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7ff41611a0 0x7f7ff406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ffa6dd700 1 -- 172.21.15.123:0/1390554085 learned_addr learned my addr 172.21.15.123:0/1390554085 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-13T17:11:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ff9edc700 1 --2- 172.21.15.123:0/1390554085 >> v2:172.21.15.153:3300/0 conn(0x7f7ff406dee0 0x7f7ff40cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ff96db700 1 -- 172.21.15.123:0/1390554085 >> v2:172.21.15.153:3300/0 conn(0x7f7ff406dee0 msgr2=0x7f7ff40cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:11:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ff96db700 1 --2- 172.21.15.123:0/1390554085 >> v2:172.21.15.153:3300/0 conn(0x7f7ff406dee0 0x7f7ff40cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ff96db700 1 -- 172.21.15.123:0/1390554085 >> v1:172.21.15.123:6789/0 conn(0x7f7ff406d560 legacy=0x7f7ff406a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ff96db700 1 -- 172.21.15.123:0/1390554085 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff406b500 con 0x7f7ff41611a0 2024-09-13T17:11:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ff96db700 1 --2- 172.21.15.123:0/1390554085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ff41611a0 0x7f7ff406d020 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40cd3a0 tx=0x7f7fe4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3625b9c8f77f7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ff8eda700 1 -- 172.21.15.123:0/1390554085 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4011830 con 0x7f7ff41611a0 2024-09-13T17:11:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ff8eda700 1 -- 172.21.15.123:0/1390554085 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7fe4011990 con 0x7f7ff41611a0 2024-09-13T17:11:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.820+0000 7f7ff8eda700 1 -- 172.21.15.123:0/1390554085 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4011d40 con 0x7f7ff41611a0 2024-09-13T17:11:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.824+0000 7f7ffaede700 1 -- 172.21.15.123:0/1390554085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ff41611a0 msgr2=0x7f7ff406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.824+0000 7f7ffaede700 1 --2- 172.21.15.123:0/1390554085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ff41611a0 0x7f7ff406d020 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40cd3a0 tx=0x7f7fe4009b30 comp rx=0 tx=0).stop 2024-09-13T17:11:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.824+0000 7f7ffaede700 1 -- 172.21.15.123:0/1390554085 shutdown_connections 2024-09-13T17:11:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.824+0000 7f7ffaede700 1 --2- 172.21.15.123:0/1390554085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ff41611a0 0x7f7ff406d020 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.824+0000 7f7ffaede700 1 --2- 172.21.15.123:0/1390554085 >> v2:172.21.15.153:3300/0 conn(0x7f7ff406dee0 0x7f7ff40cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.824+0000 7f7ffaede700 1 -- 172.21.15.123:0/1390554085 >> 172.21.15.123:0/1390554085 conn(0x7f7ff4066780 msgr2=0x7f7ff40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.824+0000 7f7ffaede700 1 -- 172.21.15.123:0/1390554085 shutdown_connections 2024-09-13T17:11:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.824+0000 7f7ffaede700 1 -- 172.21.15.123:0/1390554085 wait complete. 2024-09-13T17:11:19.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.824+0000 7f7ffaede700 1 Processor -- start 2024-09-13T17:11:19.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.824+0000 7f7ffaede700 1 -- start start 2024-09-13T17:11:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ffaede700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ff406d560 0x7f7ff413d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ffaede700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ff406dee0 0x7f7ff415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ffaede700 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ff41611a0 0x7f7ff415e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ffaede700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff415d960 con 0x7f7ff406dee0 2024-09-13T17:11:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ffaede700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff415d430 con 0x7f7ff406d560 2024-09-13T17:11:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ffaede700 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff415d680 con 0x7f7ff41611a0 2024-09-13T17:11:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ff96db700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ff406dee0 0x7f7ff415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ff96db700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ff406dee0 0x7f7ff415dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35686/0 (socket says 172.21.15.123:35686) 2024-09-13T17:11:19.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ff96db700 1 -- 172.21.15.123:0/1820142957 learned_addr learned my addr 172.21.15.123:0/1820142957 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-13T17:11:19.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ff9edc700 1 --2- 172.21.15.123:0/1820142957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ff406d560 0x7f7ff413d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ffa6dd700 1 --2- 172.21.15.123:0/1820142957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ff41611a0 0x7f7ff415e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ff96db700 1 -- 172.21.15.123:0/1820142957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ff41611a0 msgr2=0x7f7ff415e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ff96db700 1 --2- 172.21.15.123:0/1820142957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ff41611a0 0x7f7ff415e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ff96db700 1 -- 172.21.15.123:0/1820142957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ff406d560 msgr2=0x7f7ff413d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:19.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ff96db700 1 --2- 172.21.15.123:0/1820142957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ff406d560 0x7f7ff413d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:19.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ff96db700 1 -- 172.21.15.123:0/1820142957 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe40094b0 con 0x7f7ff406dee0 2024-09-13T17:11:19.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ff96db700 1 --2- 172.21.15.123:0/1820142957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ff406dee0 0x7f7ff415dbb0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4014040 tx=0x7f7fe4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:19.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7fea7fc700 1 -- 172.21.15.123:0/1820142957 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe40036c0 con 0x7f7ff406dee0 2024-09-13T17:11:19.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7fea7fc700 1 -- 172.21.15.123:0/1820142957 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7fe401e070 con 0x7f7ff406dee0 2024-09-13T17:11:19.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ffaede700 1 -- 172.21.15.123:0/1820142957 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff4141d60 con 0x7f7ff406dee0 2024-09-13T17:11:19.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7fea7fc700 1 -- 172.21.15.123:0/1820142957 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4003a60 con 0x7f7ff406dee0 2024-09-13T17:11:19.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ffaede700 1 -- 172.21.15.123:0/1820142957 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff4142320 con 0x7f7ff406dee0 2024-09-13T17:11:19.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.828+0000 7f7ffaede700 1 -- 172.21.15.123:0/1820142957 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff40b4e20 con 0x7f7ff406dee0 2024-09-13T17:11:19.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.832+0000 7f7fea7fc700 1 -- 172.21.15.123:0/1820142957 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7fe4003bc0 con 0x7f7ff406dee0 2024-09-13T17:11:19.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.832+0000 7f7fea7fc700 1 --2- 172.21.15.123:0/1820142957 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7fd8066730 0x7f7fd8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:19.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.832+0000 7f7fea7fc700 1 -- 172.21.15.123:0/1820142957 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7fe4020070 con 0x7f7ff406dee0 2024-09-13T17:11:19.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.832+0000 7f7ff9edc700 1 --2- 172.21.15.123:0/1820142957 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7fd8066730 0x7f7fd8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:19.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.832+0000 7f7ff9edc700 1 --2- 172.21.15.123:0/1820142957 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7fd8066730 0x7f7fd8068bf0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009bf0 tx=0x7f7ff0009240 comp rx=0 tx=0).ready entity=mgr.4128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:19.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:19.840+0000 7f7fea7fc700 1 -- 172.21.15.123:0/1820142957 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7fe40529f0 con 0x7f7ff406dee0 2024-09-13T17:11:20.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:20.048+0000 7f7ffaede700 1 -- 172.21.15.123:0/1820142957 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ff4142540 con 0x7f7ff406dee0 2024-09-13T17:11:20.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:20.048+0000 7f7fea7fc700 1 -- 172.21.15.123:0/1820142957 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f7fe4015090 con 0x7f7ff406dee0 2024-09-13T17:11:20.052 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-13T17:11:20.052 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":50,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7156,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3705271604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705271604},{"type":"v1","addr":"172.21.15.153:6834","nonce":3705271604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7159,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2842144578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":2842144578},{"type":"v1","addr":"172.21.15.153:6835","nonce":2842144578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7398,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2022373739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2022373739},{"type":"v1","addr":"172.21.15.123:6835","nonce":2022373739}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7716,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/443676037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":443676037},{"type":"v1","addr":"172.21.15.123:6837","nonce":443676037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[]} 2024-09-13T17:11:20.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:20.048+0000 7f7ffaede700 1 -- 172.21.15.123:0/1820142957 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7fd8066730 msgr2=0x7f7fd8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:20.048+0000 7f7ffaede700 1 --2- 172.21.15.123:0/1820142957 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7fd8066730 0x7f7fd8068bf0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009bf0 tx=0x7f7ff0009240 comp rx=0 tx=0).stop 2024-09-13T17:11:20.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:20.048+0000 7f7ffaede700 1 -- 172.21.15.123:0/1820142957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ff406dee0 msgr2=0x7f7ff415dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:20.048+0000 7f7ffaede700 1 --2- 172.21.15.123:0/1820142957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ff406dee0 0x7f7ff415dbb0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4014040 tx=0x7f7fe4004770 comp rx=0 tx=0).stop 2024-09-13T17:11:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:20.048+0000 7f7ffaede700 1 -- 172.21.15.123:0/1820142957 shutdown_connections 2024-09-13T17:11:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:20.048+0000 7f7ffaede700 1 --2- 172.21.15.123:0/1820142957 >> [v2:172.21.15.123:6832/2143283540,v1:172.21.15.123:6833/2143283540] conn(0x7f7fd8066730 0x7f7fd8068bf0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:20.048+0000 7f7ffaede700 1 --2- 172.21.15.123:0/1820142957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ff41611a0 0x7f7ff415e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:20.048+0000 7f7ffaede700 1 --2- 172.21.15.123:0/1820142957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ff406dee0 0x7f7ff415dbb0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:20.048+0000 7f7ffaede700 1 --2- 172.21.15.123:0/1820142957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ff406d560 0x7f7ff413d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:20.048+0000 7f7ffaede700 1 -- 172.21.15.123:0/1820142957 >> 172.21.15.123:0/1820142957 conn(0x7f7ff4066780 msgr2=0x7f7ff40ad1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:20.048+0000 7f7ffaede700 1 -- 172.21.15.123:0/1820142957 shutdown_connections 2024-09-13T17:11:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-13T17:11:20.048+0000 7f7ffaede700 1 -- 172.21.15.123:0/1820142957 wait complete. 2024-09-13T17:11:20.055 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 50 2024-09-13T17:11:20.065 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-13T17:11:20.065 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T17:11:20.065 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:11:20.065 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:20.080 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:11:20.081 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:11:20.081 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:20.092 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:11:20.093 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:11:20.093 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:20.109 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:11:20.109 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:11:20.109 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:20.125 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:11:20.126 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T17:11:20.126 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T17:11:20.126 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:22.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-13T17:11:26.227 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T17:11:26.228 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T17:11:26.228 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:26.327 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T17:11:26.327 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T17:11:26.327 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:26.405 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T17:11:26.405 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T17:11:26.405 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:28.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-13T17:11:28.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-13T17:11:32.507 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T17:11:32.507 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T17:11:32.507 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:34.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-13T17:11:34.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-13T17:11:38.609 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T17:11:38.609 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T17:11:38.609 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:38.699 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T17:11:38.700 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T17:11:38.700 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:39.832 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-13T17:11:39.832 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-13T17:11:44.802 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T17:11:44.802 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T17:11:44.803 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:44.894 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T17:11:44.894 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T17:11:44.894 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T17:11:44.894 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:44.922 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T17:11:44.922 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T17:11:44.923 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:44.956 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T17:11:44.956 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T17:11:44.956 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T17:11:44.956 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:45.003 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T17:11:45.004 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T17:11:45.004 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:45.049 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T17:11:45.049 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T17:11:45.050 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:45.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-13T17:11:45.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-13T17:11:45.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-13T17:11:45.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-13T17:11:45.095 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T17:11:45.095 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T17:11:45.095 DEBUG:teuthology.orchestra.run.smithi123:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T17:11:45.120 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:11:45.120 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T17:11:45.417 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:11:45.417 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T17:11:45.706 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:11:45.706 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T17:11:45.917 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:11:45.918 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T17:11:46.109 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:11:46.110 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T17:11:46.287 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:11:46.287 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T17:11:46.544 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:11:46.544 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T17:11:46.692 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:11:46.695 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:11:46.786 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:11:46.787 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T17:11:47.031 INFO:tasks.ceph:Archiving mon data... 2024-09-13T17:11:47.032 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903865/data/mon.a.tgz 2024-09-13T17:11:47.032 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2024-09-13T17:11:47.039 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.w0bCCfE9ZZ 2024-09-13T17:11:47.040 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.w0bCCfE9ZZ 2024-09-13T17:11:47.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.w0bCCfE9ZZ 2024-09-13T17:11:47.178 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.w0bCCfE9ZZ is 473KB 2024-09-13T17:11:47.560 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.w0bCCfE9ZZ 2024-09-13T17:11:47.567 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903865/data/mon.b.tgz 2024-09-13T17:11:47.567 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-13T17:11:47.574 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.Qe0hd8jvQx 2024-09-13T17:11:47.575 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Qe0hd8jvQx 2024-09-13T17:11:47.718 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.Qe0hd8jvQx 2024-09-13T17:11:47.788 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.Qe0hd8jvQx is 615KB 2024-09-13T17:11:47.967 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.Qe0hd8jvQx 2024-09-13T17:11:47.974 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903865/data/mon.c.tgz 2024-09-13T17:11:47.974 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-13T17:11:47.980 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.592mnqrEvH 2024-09-13T17:11:47.981 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.592mnqrEvH 2024-09-13T17:11:48.171 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.592mnqrEvH 2024-09-13T17:11:48.196 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.592mnqrEvH is 615KB 2024-09-13T17:11:48.259 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.592mnqrEvH 2024-09-13T17:11:48.270 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T17:11:48.270 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T17:11:48.272 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T17:11:48.288 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T17:11:48.288 DEBUG:teuthology.orchestra.run.smithi123:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T17:11:48.335 DEBUG:teuthology.orchestra.run.smithi153:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T17:11:48.371 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T17:11:48.374 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T17:11:48.381 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T17:11:48.382 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903865/remote/smithi123/crash 2024-09-13T17:11:48.383 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T17:11:48.399 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903865/remote/smithi153/crash 2024-09-13T17:11:48.400 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T17:11:48.440 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T17:11:48.441 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:11:48.443 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:11:48.494 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T17:11:48.511 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T17:11:48.527 INFO:tasks.ceph:Compressing logs... 2024-09-13T17:11:48.527 DEBUG:teuthology.orchestra.run.smithi123:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:11:48.529 DEBUG:teuthology.orchestra.run.smithi153:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:11:50.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-13T17:11:50.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-13T17:11:50.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-13T17:11:50.467 INFO:tasks.ceph:Archiving logs... 2024-09-13T17:11:50.467 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903865/remote/smithi123/log 2024-09-13T17:11:50.468 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:11:51.195 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903865/remote/smithi153/log 2024-09-13T17:11:51.196 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:11:51.415 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T17:11:51.423 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T17:11:51.423 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:11:51.425 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:11:51.523 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T17:11:51.532 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T17:11:51.532 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:11:51.534 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:11:51.556 INFO:teuthology.orchestra.run.smithi123.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:11:51.557 INFO:teuthology.orchestra.run.smithi123.stdout:============================================================================== 2024-09-13T17:11:51.557 INFO:teuthology.orchestra.run.smithi123.stdout:*hv01.front.sepi 67.205.162.81 3 u 19 64 377 0.077 -0.705 0.736 2024-09-13T17:11:51.557 INFO:teuthology.orchestra.run.smithi123.stdout:+hv02.front.sepi 63.231.80.2 3 u 25 64 377 0.074 -0.482 0.514 2024-09-13T17:11:51.557 INFO:teuthology.orchestra.run.smithi123.stdout:+hv03.front.sepi 74.6.168.72 3 u 21 64 377 0.086 -0.036 0.716 2024-09-13T17:11:51.557 INFO:teuthology.orchestra.run.smithi123.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:11:51.559 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:11:51.559 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-09-13T17:11:51.559 INFO:teuthology.orchestra.run.smithi153.stdout:*hv01.front.sepi 67.205.162.81 3 u 21 64 377 0.076 0.743 0.412 2024-09-13T17:11:51.559 INFO:teuthology.orchestra.run.smithi153.stdout:+hv02.front.sepi 63.231.80.2 3 u 18 64 377 0.089 0.291 0.334 2024-09-13T17:11:51.559 INFO:teuthology.orchestra.run.smithi153.stdout:+hv03.front.sepi 74.6.168.72 3 u 23 64 377 0.084 1.296 0.444 2024-09-13T17:11:51.559 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T17:11:51.560 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T17:11:51.569 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T17:11:51.569 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T17:11:51.611 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T17:11:51.668 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T17:11:51.712 INFO:teuthology.task.internal:Duration was 896.636738 seconds 2024-09-13T17:11:51.712 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T17:11:51.763 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T17:11:51.763 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:11:51.766 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:11:51.817 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T17:11:51.818 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2024-09-13T17:11:51.818 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:11:51.830 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-09-13T17:11:51.831 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:11:51.841 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T17:11:51.841 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:11:51.844 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:11:51.881 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T17:11:51.881 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:11:51.883 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:11:51.960 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T17:11:51.969 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T17:11:51.970 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:11:51.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:11:52.003 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T17:11:52.013 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:11:52.015 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:11:52.027 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2024-09-13T17:11:52.029 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-09-13T17:11:52.043 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:11:52.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:11:52.049 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:11:52.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:11:52.090 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T17:11:52.100 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T17:11:52.101 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903865/remote/smithi123 2024-09-13T17:11:52.101 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:11:52.126 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903865/remote/smithi153 2024-09-13T17:11:52.126 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:11:52.150 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T17:11:52.151 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:11:52.167 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:11:52.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T17:11:52.206 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T17:11:52.206 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T17:11:52.238 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T17:11:52.238 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:11:52.241 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:11:52.246 INFO:teuthology.orchestra.run.smithi123.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:11 /home/ubuntu/cephtest 2024-09-13T17:11:52.249 INFO:teuthology.orchestra.run.smithi153.stdout: 924110 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:11 /home/ubuntu/cephtest 2024-09-13T17:11:52.250 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T17:11:52.288 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T17:11:52.392 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/quota} duration: 896.6367380619049 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T17:11:52.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:11:52.649 INFO:teuthology.run:pass